Nov 13 18:40:37 user nova-compute[75216]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=75216) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=75216) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=75216) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 13 18:40:37 user nova-compute[75216]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.019s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:40:37 user nova-compute[75216]: INFO nova.virt.driver [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] Loading compute driver 'libvirt.LibvirtDriver'
Nov 13 18:40:37 user nova-compute[75216]: INFO nova.compute.provider_config [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] Acquiring lock "singleton_lock" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] Acquired lock "singleton_lock" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] Releasing lock "singleton_lock" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] Full set of CONF: {{(pid=75216) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] ******************************************************************************** {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] Configuration options gathered from: {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] ================================================================================ {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] allow_resize_to_same_host      = True {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] arq_binding_timeout            = 300 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] backdoor_port                  = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] backdoor_socket                = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] block_device_allocate_retries  = 300 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] block_device_allocate_retries_interval = 5 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] cert                           = self.pem {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] compute_monitors               = [] {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] config_dir                     = [] {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] config_drive_format            = iso9660 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] config_source                  = [] {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] console_host                   = user {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] control_exchange               = nova {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] cpu_allocation_ratio           = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] daemon                         = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] debug                          = True {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] default_access_ip_network_name = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] default_availability_zone      = nova {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] default_ephemeral_format       = ext4 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] default_green_pool_size        = 1000 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] default_schedule_zone          = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] disk_allocation_ratio          = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] enable_new_services            = True {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] enabled_apis                   = ['osapi_compute'] {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] enabled_ssl_apis               = [] {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] flat_injected                  = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] force_config_drive             = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] force_raw_images               = True {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] graceful_shutdown_timeout      = 5 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] heal_instance_info_cache_interval = 60 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] host                           = user {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] instance_build_timeout         = 0 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] instance_delete_interval       = 300 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] instance_format                = [instance: %(uuid)s]  {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] instance_name_template         = instance-%08x {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] instance_usage_audit           = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] instance_usage_audit_period    = month {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] internal_service_availability_zone = internal {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] key                            = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] live_migration_retry_count     = 30 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] log_config_append              = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] log_dir                        = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] log_file                       = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] log_options                    = True {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] log_rotate_interval            = 1 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] log_rotate_interval_type       = days {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] log_rotation_type              = none {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] long_rpc_timeout               = 1800 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] max_concurrent_builds          = 10 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] max_concurrent_live_migrations = 1 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] max_concurrent_snapshots       = 5 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] max_local_block_devices        = 3 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] max_logfile_count              = 30 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] max_logfile_size_mb            = 200 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] maximum_instance_delete_attempts = 5 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] metadata_listen                = 0.0.0.0 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] metadata_listen_port           = 8775 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] metadata_workers               = 3 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] migrate_max_retries            = -1 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] mkisofs_cmd                    = genisoimage {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] my_ip                          = 10.0.0.210 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] network_allocate_retries       = 0 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] osapi_compute_listen_port      = 8774 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] osapi_compute_unique_server_name_scope =  {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] osapi_compute_workers          = 3 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] password_length                = 12 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] periodic_enable                = True {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] periodic_fuzzy_delay           = 60 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] pointer_model                  = ps2mouse {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] preallocate_images             = none {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] publish_errors                 = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] pybasedir                      = /opt/stack/nova {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] ram_allocation_ratio           = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] rate_limit_burst               = 0 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] rate_limit_except_level        = CRITICAL {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] rate_limit_interval            = 0 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] reboot_timeout                 = 0 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] reclaim_instance_interval      = 0 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] record                         = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] reimage_timeout_per_gb         = 60 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] report_interval                = 120 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] rescue_timeout                 = 0 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] reserved_host_cpus             = 0 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] reserved_host_disk_mb          = 0 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] reserved_host_memory_mb        = 512 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] reserved_huge_pages            = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] resize_confirm_window          = 0 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] resize_fs_using_block_device   = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] resume_guests_state_on_host_boot = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] rpc_response_timeout           = 60 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] run_external_periodic_tasks    = True {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] running_deleted_instance_action = reap {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] running_deleted_instance_poll_interval = 1800 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] running_deleted_instance_timeout = 0 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] scheduler_instance_sync_interval = 120 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] service_down_time              = 720 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] servicegroup_driver            = db {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] shelved_offload_time           = 0 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] shelved_poll_interval          = 3600 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] shutdown_timeout               = 0 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] source_is_ipv6                 = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] ssl_only                       = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] state_path                     = /opt/stack/data/nova {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] sync_power_state_interval      = 600 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] sync_power_state_pool_size     = 1000 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] syslog_log_facility            = LOG_USER {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] tempdir                        = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] timeout_nbd                    = 10 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] transport_url                  = **** {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] update_resources_interval      = 0 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] use_cow_images                 = True {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] use_eventlog                   = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] use_journal                    = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] use_json                       = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] use_rootwrap_daemon            = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] use_stderr                     = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] use_syslog                     = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] vcpu_pin_set                   = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] vif_plugging_is_fatal          = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] vif_plugging_timeout           = 0 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] virt_mkfs                      = [] {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] volume_usage_poll_interval     = 0 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] watch_log_file                 = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] web                            = /usr/share/spice-html5 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] oslo_concurrency.disable_process_locking = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] api.auth_strategy              = keystone {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] api.compute_link_prefix        = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] api.dhcp_domain                = novalocal {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] api.enable_instance_password   = True {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] api.glance_link_prefix         = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] api.instance_list_per_project_cells = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] api.list_records_by_skipping_down_cells = True {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] api.local_metadata_per_cell    = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] api.max_limit                  = 1000 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] api.metadata_cache_expiration  = 15 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] api.neutron_default_tenant_id  = default {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] api.use_forwarded_for          = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] api.use_neutron_default_nets   = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] api.vendordata_dynamic_targets = [] {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] api.vendordata_jsonfile_path   = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] cache.backend                  = dogpile.cache.memcached {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] cache.backend_argument         = **** {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] cache.config_prefix            = cache.oslo {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] cache.dead_timeout             = 60.0 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] cache.debug_cache_backend      = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] cache.enable_retry_client      = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] cache.enable_socket_keepalive  = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] cache.enabled                  = True {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] cache.expiration_time          = 600 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] cache.hashclient_retry_attempts = 2 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] cache.memcache_dead_retry      = 300 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] cache.memcache_password        =  {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] cache.memcache_pool_maxsize    = 10 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] cache.memcache_sasl_enabled    = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] cache.memcache_username        =  {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] cache.proxies                  = [] {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] cache.retry_attempts           = 2 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] cache.retry_delay              = 0.0 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] cache.socket_keepalive_count   = 1 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] cache.socket_keepalive_idle    = 1 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] cache.socket_keepalive_interval = 1 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] cache.tls_allowed_ciphers      = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] cache.tls_cafile               = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] cache.tls_certfile             = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] cache.tls_enabled              = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] cache.tls_keyfile              = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] cinder.auth_section            = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] cinder.auth_type               = password {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] cinder.cafile                  = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] cinder.certfile                = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] cinder.collect_timing          = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] cinder.cross_az_attach         = True {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] cinder.debug                   = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] cinder.endpoint_template       = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] cinder.http_retries            = 3 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] cinder.insecure                = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] cinder.keyfile                 = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] cinder.os_region_name          = RegionOne {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] cinder.split_loggers           = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] cinder.timeout                 = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] compute.cpu_dedicated_set      = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] compute.cpu_shared_set         = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] compute.image_type_exclude_list = [] {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] compute.max_concurrent_disk_ops = 0 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] compute.max_disk_devices_to_attach = -1 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] compute.resource_provider_association_refresh = 300 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] compute.shutdown_retry_interval = 10 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] conductor.workers              = 3 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] console.allowed_origins        = [] {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] console.ssl_ciphers            = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] console.ssl_minimum_version    = default {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] consoleauth.token_ttl          = 600 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] cyborg.cafile                  = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] cyborg.certfile                = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] cyborg.collect_timing          = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] cyborg.connect_retries         = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] cyborg.connect_retry_delay     = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] cyborg.endpoint_override       = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] cyborg.insecure                = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] cyborg.keyfile                 = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] cyborg.max_version             = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] cyborg.min_version             = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] cyborg.region_name             = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] cyborg.service_name            = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] cyborg.service_type            = accelerator {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] cyborg.split_loggers           = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] cyborg.status_code_retries     = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] cyborg.status_code_retry_delay = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] cyborg.timeout                 = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] cyborg.version                 = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] database.backend               = sqlalchemy {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] database.connection            = **** {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] database.connection_debug      = 0 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] database.connection_parameters =  {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] database.connection_recycle_time = 3600 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] database.connection_trace      = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] database.db_inc_retry_interval = True {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] database.db_max_retries        = 20 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] database.db_max_retry_interval = 10 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] database.db_retry_interval     = 1 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] database.max_overflow          = 50 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] database.max_pool_size         = 5 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] database.max_retries           = 10 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] database.mysql_wsrep_sync_wait = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] database.pool_timeout          = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] database.retry_interval        = 10 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] database.slave_connection      = **** {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] database.sqlite_synchronous    = True {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] api_database.backend           = sqlalchemy {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] api_database.connection        = **** {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] api_database.connection_debug  = 0 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] api_database.connection_parameters =  {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] api_database.connection_recycle_time = 3600 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] api_database.connection_trace  = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] api_database.db_inc_retry_interval = True {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] api_database.db_max_retries    = 20 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] api_database.db_max_retry_interval = 10 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] api_database.db_retry_interval = 1 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] api_database.max_overflow      = 50 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] api_database.max_pool_size     = 5 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] api_database.max_retries       = 10 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] api_database.pool_timeout      = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] api_database.retry_interval    = 10 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] api_database.slave_connection  = **** {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] api_database.sqlite_synchronous = True {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] devices.enabled_mdev_types     = [] {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] ephemeral_storage_encryption.enabled = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] glance.api_servers             = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] glance.cafile                  = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] glance.certfile                = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] glance.collect_timing          = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] glance.connect_retries         = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] glance.connect_retry_delay     = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] glance.debug                   = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] glance.default_trusted_certificate_ids = [] {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] glance.enable_certificate_validation = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] glance.enable_rbd_download     = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] glance.endpoint_override       = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] glance.insecure                = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] glance.keyfile                 = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] glance.max_version             = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] glance.min_version             = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] glance.num_retries             = 3 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] glance.rbd_ceph_conf           =  {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] glance.rbd_connect_timeout     = 5 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] glance.rbd_pool                =  {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] glance.rbd_user                =  {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] glance.region_name             = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] glance.service_name            = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] glance.service_type            = image {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] glance.split_loggers           = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] glance.status_code_retries     = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] glance.status_code_retry_delay = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] glance.timeout                 = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] glance.verify_glance_signatures = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] glance.version                 = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] guestfs.debug                  = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] hyperv.config_drive_cdrom      = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] hyperv.config_drive_inject_password = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] hyperv.enable_instance_metrics_collection = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] hyperv.enable_remotefx         = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] hyperv.instances_path_share    =  {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] hyperv.iscsi_initiator_list    = [] {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] hyperv.limit_cpu_features      = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] hyperv.power_state_check_timeframe = 60 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] hyperv.use_multipath_io        = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] hyperv.volume_attach_retry_count = 10 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] hyperv.vswitch_name            = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] mks.enabled                    = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] image_cache.manager_interval   = 2400 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] image_cache.precache_concurrency = 1 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] image_cache.remove_unused_base_images = True {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] image_cache.subdirectory_name  = _base {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] ironic.api_max_retries         = 60 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] ironic.api_retry_interval      = 2 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] ironic.auth_section            = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] ironic.auth_type               = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] ironic.cafile                  = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] ironic.certfile                = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] ironic.collect_timing          = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] ironic.conductor_group         = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] ironic.connect_retries         = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] ironic.connect_retry_delay     = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] ironic.endpoint_override       = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] ironic.insecure                = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] ironic.keyfile                 = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] ironic.max_version             = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] ironic.min_version             = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] ironic.peer_list               = [] {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] ironic.region_name             = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] ironic.serial_console_state_timeout = 10 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] ironic.service_name            = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] ironic.service_type            = baremetal {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] ironic.split_loggers           = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] ironic.status_code_retries     = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] ironic.status_code_retry_delay = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] ironic.timeout                 = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] ironic.version                 = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] key_manager.fixed_key          = **** {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] barbican.barbican_api_version  = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] barbican.barbican_endpoint     = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] barbican.barbican_endpoint_type = public {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] barbican.barbican_region_name  = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] barbican.cafile                = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] barbican.certfile              = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] barbican.collect_timing        = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] barbican.insecure              = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] barbican.keyfile               = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] barbican.number_of_retries     = 60 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] barbican.retry_delay           = 1 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] barbican.send_service_user_token = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] barbican.split_loggers         = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] barbican.timeout               = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] barbican.verify_ssl            = True {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] barbican.verify_ssl_path       = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] barbican_service_user.auth_section = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] barbican_service_user.auth_type = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] barbican_service_user.cafile   = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] barbican_service_user.certfile = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] barbican_service_user.collect_timing = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] barbican_service_user.insecure = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] barbican_service_user.keyfile  = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] barbican_service_user.split_loggers = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] barbican_service_user.timeout  = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] vault.approle_role_id          = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] vault.approle_secret_id        = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] vault.cafile                   = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] vault.certfile                 = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] vault.collect_timing           = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] vault.insecure                 = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] vault.keyfile                  = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] vault.kv_mountpoint            = secret {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] vault.kv_path                  = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] vault.kv_version               = 2 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] vault.namespace                = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] vault.root_token_id            = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] vault.split_loggers            = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] vault.ssl_ca_crt_file          = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] vault.timeout                  = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] vault.use_ssl                  = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] keystone.auth_section          = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] keystone.auth_type             = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] keystone.cafile                = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] keystone.certfile              = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] keystone.collect_timing        = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] keystone.connect_retries       = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] keystone.connect_retry_delay   = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] keystone.endpoint_override     = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] keystone.insecure              = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] keystone.keyfile               = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] keystone.max_version           = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] keystone.min_version           = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] keystone.region_name           = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] keystone.service_name          = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] keystone.service_type          = identity {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] keystone.split_loggers         = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] keystone.status_code_retries   = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] keystone.status_code_retry_delay = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] keystone.timeout               = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] keystone.version               = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] libvirt.connection_uri         =  {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] libvirt.cpu_mode               = custom {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: WARNING oslo_config.cfg [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] libvirt.cpu_power_governor_high = performance {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] libvirt.cpu_power_governor_low = powersave {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] libvirt.cpu_power_management   = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] libvirt.device_detach_attempts = 8 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] libvirt.device_detach_timeout  = 20 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] libvirt.disk_cachemodes        = [] {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] libvirt.disk_prefix            = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] libvirt.enabled_perf_events    = [] {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] libvirt.file_backed_memory     = 0 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] libvirt.gid_maps               = [] {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] libvirt.hw_disk_discard        = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] libvirt.hw_machine_type        = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] libvirt.images_rbd_glance_store_name =  {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] libvirt.images_rbd_pool        = rbd {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] libvirt.images_type            = default {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] libvirt.images_volume_group    = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] libvirt.inject_key             = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] libvirt.inject_partition       = -2 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] libvirt.inject_password        = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] libvirt.iscsi_iface            = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] libvirt.iser_use_multipath     = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] libvirt.live_migration_bandwidth = 0 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] libvirt.live_migration_downtime = 500 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] libvirt.live_migration_inbound_addr = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] libvirt.live_migration_permit_post_copy = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] libvirt.live_migration_scheme  = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] libvirt.live_migration_timeout_action = abort {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] libvirt.live_migration_tunnelled = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: WARNING oslo_config.cfg [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Nov 13 18:40:37 user nova-compute[75216]: live_migration_uri is deprecated for removal in favor of two other options that
Nov 13 18:40:37 user nova-compute[75216]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Nov 13 18:40:37 user nova-compute[75216]: and ``live_migration_inbound_addr`` respectively.
Nov 13 18:40:37 user nova-compute[75216]: ).  Its value may be silently ignored in the future.
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] libvirt.live_migration_with_native_tls = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] libvirt.max_queues             = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] libvirt.nfs_mount_options      = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] libvirt.num_memory_encrypted_guests = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] libvirt.num_pcie_ports         = 0 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] libvirt.pmem_namespaces        = [] {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] libvirt.quobyte_client_cfg     = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] libvirt.rbd_secret_uuid        = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] libvirt.rbd_user               = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] libvirt.remote_filesystem_transport = ssh {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] libvirt.rescue_image_id        = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] libvirt.rescue_kernel_id       = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] libvirt.rescue_ramdisk_id      = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] libvirt.rx_queue_size          = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] libvirt.smbfs_mount_options    =  {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] libvirt.snapshot_compression   = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] libvirt.snapshot_image_format  = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] libvirt.sparse_logical_volumes = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] libvirt.swtpm_enabled          = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] libvirt.swtpm_group            = tss {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] libvirt.swtpm_user             = tss {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] libvirt.sysinfo_serial         = unique {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] libvirt.tb_cache_size          = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] libvirt.tx_queue_size          = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] libvirt.uid_maps               = [] {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] libvirt.use_virtio_for_bridges = True {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] libvirt.virt_type              = kvm {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] libvirt.volume_clear           = zero {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] libvirt.volume_clear_size      = 0 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] libvirt.volume_use_multipath   = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] libvirt.vzstorage_cache_path   = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] libvirt.vzstorage_mount_user   = stack {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] neutron.auth_section           = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] neutron.auth_type              = password {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] neutron.cafile                 = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] neutron.certfile               = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] neutron.collect_timing         = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] neutron.connect_retries        = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] neutron.connect_retry_delay    = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] neutron.default_floating_pool  = public {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] neutron.endpoint_override      = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] neutron.extension_sync_interval = 600 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] neutron.http_retries           = 3 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] neutron.insecure               = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] neutron.keyfile                = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] neutron.max_version            = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] neutron.min_version            = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] neutron.ovs_bridge             = br-int {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] neutron.physnets               = [] {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] neutron.region_name            = RegionOne {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] neutron.service_metadata_proxy = True {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] neutron.service_name           = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] neutron.service_type           = network {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] neutron.split_loggers          = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] neutron.status_code_retries    = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] neutron.status_code_retry_delay = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] neutron.timeout                = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] neutron.version                = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] notifications.bdms_in_notifications = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] notifications.default_level    = INFO {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] notifications.notification_format = unversioned {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] notifications.notify_on_state_change = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] pci.alias                      = [] {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] pci.device_spec                = [] {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] pci.report_in_placement        = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] placement.auth_section         = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] placement.auth_type            = password {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] placement.cafile               = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] placement.certfile             = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] placement.collect_timing       = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] placement.connect_retries      = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] placement.connect_retry_delay  = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] placement.default_domain_id    = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] placement.default_domain_name  = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] placement.domain_id            = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] placement.domain_name          = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] placement.endpoint_override    = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] placement.insecure             = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] placement.keyfile              = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] placement.max_version          = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] placement.min_version          = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] placement.password             = **** {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] placement.project_domain_id    = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] placement.project_domain_name  = Default {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] placement.project_id           = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] placement.project_name         = service {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] placement.region_name          = RegionOne {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] placement.service_name         = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] placement.service_type         = placement {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] placement.split_loggers        = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] placement.status_code_retries  = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] placement.status_code_retry_delay = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] placement.system_scope         = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] placement.timeout              = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] placement.trust_id             = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] placement.user_domain_id       = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] placement.user_domain_name     = Default {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] placement.user_id              = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] placement.username             = placement {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] placement.version              = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] quota.cores                    = 20 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] quota.count_usage_from_placement = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] quota.injected_file_content_bytes = 10240 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] quota.injected_file_path_length = 255 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] quota.injected_files           = 5 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] quota.instances                = 10 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] quota.key_pairs                = 100 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] quota.metadata_items           = 128 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] quota.ram                      = 51200 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] quota.recheck_quota            = True {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] quota.server_group_members     = 10 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] quota.server_groups            = 10 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] rdp.enabled                    = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] scheduler.image_metadata_prefilter = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] scheduler.max_attempts         = 3 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] scheduler.max_placement_results = 1000 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] scheduler.query_placement_for_image_type_support = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] scheduler.workers              = 3 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] filter_scheduler.host_subset_size = 1 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] filter_scheduler.isolated_hosts = [] {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] filter_scheduler.isolated_images = [] {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] filter_scheduler.pci_in_placement = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] filter_scheduler.track_instance_changes = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] metrics.required               = True {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] metrics.weight_multiplier      = 1.0 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] metrics.weight_setting         = [] {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] serial_console.enabled         = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] serial_console.port_range      = 10000:20000 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] serial_console.serialproxy_port = 6083 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] service_user.auth_section      = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] service_user.auth_type         = password {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] service_user.cafile            = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] service_user.certfile          = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] service_user.collect_timing    = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] service_user.insecure          = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] service_user.keyfile           = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] service_user.send_service_user_token = True {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] service_user.split_loggers     = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] service_user.timeout           = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] spice.agent_enabled            = True {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] spice.enabled                  = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] spice.html5proxy_port          = 6082 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] spice.image_compression        = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] spice.jpeg_compression         = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] spice.playback_compression     = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] spice.server_listen            = 127.0.0.1 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] spice.streaming_mode           = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] spice.zlib_compression         = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] upgrade_levels.baseapi         = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] upgrade_levels.cert            = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] upgrade_levels.compute         = auto {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] upgrade_levels.conductor       = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] upgrade_levels.scheduler       = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] vendordata_dynamic_auth.auth_section = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] vendordata_dynamic_auth.auth_type = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] vendordata_dynamic_auth.cafile = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] vendordata_dynamic_auth.certfile = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] vendordata_dynamic_auth.insecure = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] vendordata_dynamic_auth.keyfile = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] vendordata_dynamic_auth.timeout = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] vmware.api_retry_count         = 10 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] vmware.ca_file                 = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] vmware.cache_prefix            = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] vmware.cluster_name            = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] vmware.connection_pool_size    = 10 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] vmware.console_delay_seconds   = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] vmware.datastore_regex         = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] vmware.host_ip                 = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] vmware.host_password           = **** {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] vmware.host_port               = 443 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] vmware.host_username           = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] vmware.insecure                = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] vmware.integration_bridge      = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] vmware.maximum_objects         = 100 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] vmware.pbm_default_policy      = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] vmware.pbm_enabled             = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] vmware.pbm_wsdl_location       = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] vmware.serial_port_proxy_uri   = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] vmware.serial_port_service_uri = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] vmware.task_poll_interval      = 0.5 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] vmware.use_linked_clone        = True {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] vmware.vnc_keymap              = en-us {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] vmware.vnc_port                = 5900 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] vmware.vnc_port_total          = 10000 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] vnc.auth_schemes               = ['none'] {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] vnc.enabled                    = True {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] vnc.novncproxy_port            = 6080 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] vnc.server_listen              = 0.0.0.0 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] vnc.vencrypt_ca_certs          = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] vnc.vencrypt_client_cert       = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] vnc.vencrypt_client_key        = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] workarounds.disable_rootwrap   = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] workarounds.enable_numa_live_migration = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] workarounds.libvirt_disable_apic = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] wsgi.client_socket_timeout     = 900 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] wsgi.default_pool_size         = 1000 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] wsgi.keep_alive                = True {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] wsgi.max_header_line           = 16384 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] wsgi.ssl_ca_file               = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] wsgi.ssl_cert_file             = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] wsgi.ssl_key_file              = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] wsgi.tcp_keepidle              = 600 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] zvm.ca_file                    = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] zvm.cloud_connector_url        = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] zvm.reachable_timeout          = 300 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] oslo_policy.enforce_new_defaults = True {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] oslo_policy.enforce_scope      = True {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] oslo_policy.policy_default_rule = default {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] oslo_policy.policy_file        = policy.yaml {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] profiler.connection_string     = messaging:// {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] profiler.enabled               = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] profiler.es_doc_type           = notification {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] profiler.es_scroll_size        = 10000 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] profiler.es_scroll_time        = 2m {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] profiler.filter_error_trace    = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] profiler.hmac_keys             = **** {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] profiler.sentinel_service_name = mymaster {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] profiler.socket_timeout        = 0.1 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] profiler.trace_requests        = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] profiler.trace_sqlalchemy      = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] profiler_jaeger.process_tags   = {} {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] profiler_jaeger.service_name_prefix = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] profiler_otlp.service_name_prefix = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] remote_debug.host              = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] remote_debug.port              = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:37 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:38 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:38 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:38 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:38 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:38 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:38 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:38 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:38 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:38 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:38 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:38 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] oslo_messaging_rabbit.ssl      = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:38 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:38 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:38 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:38 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:38 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:38 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:38 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] oslo_messaging_notifications.retry = -1 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:38 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:38 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:38 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] oslo_limit.auth_section        = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:38 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] oslo_limit.auth_type           = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:38 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] oslo_limit.cafile              = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:38 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] oslo_limit.certfile            = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:38 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] oslo_limit.collect_timing      = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:38 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] oslo_limit.connect_retries     = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:38 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] oslo_limit.connect_retry_delay = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:38 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] oslo_limit.endpoint_id         = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:38 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] oslo_limit.endpoint_override   = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:38 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] oslo_limit.insecure            = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:38 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] oslo_limit.keyfile             = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:38 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] oslo_limit.max_version         = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:38 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] oslo_limit.min_version         = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:38 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] oslo_limit.region_name         = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:38 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] oslo_limit.service_name        = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:38 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] oslo_limit.service_type        = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:38 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] oslo_limit.split_loggers       = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:38 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] oslo_limit.status_code_retries = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:38 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] oslo_limit.status_code_retry_delay = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:38 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] oslo_limit.timeout             = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:38 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] oslo_limit.valid_interfaces    = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:38 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] oslo_limit.version             = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:38 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] oslo_reports.file_event_handler = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:38 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:38 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] oslo_reports.log_dir           = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:38 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:38 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:38 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:38 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:38 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:38 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:38 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:38 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] vif_plug_ovs_privileged.group  = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:38 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:38 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:38 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:38 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] vif_plug_ovs_privileged.user   = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:38 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] os_vif_linux_bridge.flat_interface = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:38 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:38 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:38 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:38 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:38 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:38 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:38 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:38 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] os_vif_ovs.default_qos_type    = linux-noop {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:38 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] os_vif_ovs.isolate_vif         = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:38 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:38 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:38 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:38 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:38 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] os_vif_ovs.per_port_bridge     = False {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:38 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] os_brick.lock_path             = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:38 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] privsep_osbrick.capabilities   = [21] {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:38 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] privsep_osbrick.group          = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:38 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] privsep_osbrick.helper_command = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:38 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:38 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:38 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] privsep_osbrick.user           = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:38 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:38 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] nova_sys_admin.group           = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:38 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] nova_sys_admin.helper_command  = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:38 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:38 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:38 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] nova_sys_admin.user            = None {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 18:40:38 user nova-compute[75216]: DEBUG oslo_service.service [None req-f6a8a8a7-949b-48eb-b8ab-20c9bb88d5b4 None None] ******************************************************************************** {{(pid=75216) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Nov 13 18:40:38 user nova-compute[75216]: INFO nova.service [-] Starting compute node (version 0.0.0)
Nov 13 18:40:38 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-085a4235-df6a-43dd-bf96-2d3c95dda5d5 None None] Connecting to libvirt: qemu:///system {{(pid=75216) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:506}}
Nov 13 18:40:38 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-085a4235-df6a-43dd-bf96-2d3c95dda5d5 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7fe3c943afe0> {{(pid=75216) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:512}}
Nov 13 18:40:38 user nova-compute[75216]: libvirt:  error : internal error: could not initialize domain event timer
Nov 13 18:40:38 user nova-compute[75216]: WARNING nova.virt.libvirt.host [None req-085a4235-df6a-43dd-bf96-2d3c95dda5d5 None None] URI qemu:///system does not support events: internal error: could not initialize domain event timer: libvirt.libvirtError: internal error: could not initialize domain event timer
Nov 13 18:40:38 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-085a4235-df6a-43dd-bf96-2d3c95dda5d5 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7fe3c943afe0> {{(pid=75216) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:533}}
Nov 13 18:40:38 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-085a4235-df6a-43dd-bf96-2d3c95dda5d5 None None] Starting native event thread {{(pid=75216) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Nov 13 18:40:38 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-085a4235-df6a-43dd-bf96-2d3c95dda5d5 None None] Starting green dispatch thread {{(pid=75216) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Nov 13 18:40:38 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-085a4235-df6a-43dd-bf96-2d3c95dda5d5 None None] Starting connection event dispatch thread {{(pid=75216) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:501}}
Nov 13 18:40:38 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-085a4235-df6a-43dd-bf96-2d3c95dda5d5 None None] Connection event '1' reason 'None'
Nov 13 18:40:38 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-085a4235-df6a-43dd-bf96-2d3c95dda5d5 None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 13 18:40:38 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.mount [None req-085a4235-df6a-43dd-bf96-2d3c95dda5d5 None None] Initialising _HostMountState generation 0 {{(pid=75216) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Nov 13 18:40:45 user nova-compute[75216]: INFO nova.virt.libvirt.host [None req-085a4235-df6a-43dd-bf96-2d3c95dda5d5 None None] Libvirt host capabilities <capabilities>
Nov 13 18:40:45 user nova-compute[75216]:   <host>
Nov 13 18:40:45 user nova-compute[75216]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Nov 13 18:40:45 user nova-compute[75216]:     <cpu>
Nov 13 18:40:45 user nova-compute[75216]:       <arch>x86_64</arch>
Nov 13 18:40:45 user nova-compute[75216]:       <model>IvyBridge-IBRS</model>
Nov 13 18:40:45 user nova-compute[75216]:       <vendor>Intel</vendor>
Nov 13 18:40:45 user nova-compute[75216]:       <microcode version='1070'/>
Nov 13 18:40:45 user nova-compute[75216]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Nov 13 18:40:45 user nova-compute[75216]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Nov 13 18:40:45 user nova-compute[75216]:       <feature name='ss'/>
Nov 13 18:40:45 user nova-compute[75216]:       <feature name='vmx'/>
Nov 13 18:40:45 user nova-compute[75216]:       <feature name='pcid'/>
Nov 13 18:40:45 user nova-compute[75216]:       <feature name='osxsave'/>
Nov 13 18:40:45 user nova-compute[75216]:       <feature name='hypervisor'/>
Nov 13 18:40:45 user nova-compute[75216]:       <feature name='arat'/>
Nov 13 18:40:45 user nova-compute[75216]:       <feature name='tsc_adjust'/>
Nov 13 18:40:45 user nova-compute[75216]:       <feature name='md-clear'/>
Nov 13 18:40:45 user nova-compute[75216]:       <feature name='stibp'/>
Nov 13 18:40:45 user nova-compute[75216]:       <feature name='arch-capabilities'/>
Nov 13 18:40:45 user nova-compute[75216]:       <feature name='ssbd'/>
Nov 13 18:40:45 user nova-compute[75216]:       <feature name='invtsc'/>
Nov 13 18:40:45 user nova-compute[75216]:       <feature name='rsba'/>
Nov 13 18:40:45 user nova-compute[75216]:       <feature name='skip-l1dfl-vmentry'/>
Nov 13 18:40:45 user nova-compute[75216]:       <pages unit='KiB' size='4'/>
Nov 13 18:40:45 user nova-compute[75216]:       <pages unit='KiB' size='2048'/>
Nov 13 18:40:45 user nova-compute[75216]:     </cpu>
Nov 13 18:40:45 user nova-compute[75216]:     <power_management>
Nov 13 18:40:45 user nova-compute[75216]:       <suspend_mem/>
Nov 13 18:40:45 user nova-compute[75216]:       <suspend_disk/>
Nov 13 18:40:45 user nova-compute[75216]:       <suspend_hybrid/>
Nov 13 18:40:45 user nova-compute[75216]:     </power_management>
Nov 13 18:40:45 user nova-compute[75216]:     <iommu support='no'/>
Nov 13 18:40:45 user nova-compute[75216]:     <migration_features>
Nov 13 18:40:45 user nova-compute[75216]:       <live/>
Nov 13 18:40:45 user nova-compute[75216]:       <uri_transports>
Nov 13 18:40:45 user nova-compute[75216]:         <uri_transport>tcp</uri_transport>
Nov 13 18:40:45 user nova-compute[75216]:         <uri_transport>rdma</uri_transport>
Nov 13 18:40:45 user nova-compute[75216]:       </uri_transports>
Nov 13 18:40:45 user nova-compute[75216]:     </migration_features>
Nov 13 18:40:45 user nova-compute[75216]:     <topology>
Nov 13 18:40:45 user nova-compute[75216]:       <cells num='2'>
Nov 13 18:40:45 user nova-compute[75216]:         <cell id='0'>
Nov 13 18:40:45 user nova-compute[75216]:           <memory unit='KiB'>8189224</memory>
Nov 13 18:40:45 user nova-compute[75216]:           <pages unit='KiB' size='4'>2047306</pages>
Nov 13 18:40:45 user nova-compute[75216]:           <pages unit='KiB' size='2048'>0</pages>
Nov 13 18:40:45 user nova-compute[75216]:           <distances>
Nov 13 18:40:45 user nova-compute[75216]:             <sibling id='0' value='10'/>
Nov 13 18:40:45 user nova-compute[75216]:             <sibling id='1' value='20'/>
Nov 13 18:40:45 user nova-compute[75216]:           </distances>
Nov 13 18:40:45 user nova-compute[75216]:           <cpus num='6'>
Nov 13 18:40:45 user nova-compute[75216]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Nov 13 18:40:45 user nova-compute[75216]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Nov 13 18:40:45 user nova-compute[75216]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Nov 13 18:40:45 user nova-compute[75216]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Nov 13 18:40:45 user nova-compute[75216]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Nov 13 18:40:45 user nova-compute[75216]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Nov 13 18:40:45 user nova-compute[75216]:           </cpus>
Nov 13 18:40:45 user nova-compute[75216]:         </cell>
Nov 13 18:40:45 user nova-compute[75216]:         <cell id='1'>
Nov 13 18:40:45 user nova-compute[75216]:           <memory unit='KiB'>8206460</memory>
Nov 13 18:40:45 user nova-compute[75216]:           <pages unit='KiB' size='4'>2051615</pages>
Nov 13 18:40:45 user nova-compute[75216]:           <pages unit='KiB' size='2048'>0</pages>
Nov 13 18:40:45 user nova-compute[75216]:           <distances>
Nov 13 18:40:45 user nova-compute[75216]:             <sibling id='0' value='20'/>
Nov 13 18:40:45 user nova-compute[75216]:             <sibling id='1' value='10'/>
Nov 13 18:40:45 user nova-compute[75216]:           </distances>
Nov 13 18:40:45 user nova-compute[75216]:           <cpus num='6'>
Nov 13 18:40:45 user nova-compute[75216]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Nov 13 18:40:45 user nova-compute[75216]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Nov 13 18:40:45 user nova-compute[75216]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Nov 13 18:40:45 user nova-compute[75216]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Nov 13 18:40:45 user nova-compute[75216]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Nov 13 18:40:45 user nova-compute[75216]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Nov 13 18:40:45 user nova-compute[75216]:           </cpus>
Nov 13 18:40:45 user nova-compute[75216]:         </cell>
Nov 13 18:40:45 user nova-compute[75216]:       </cells>
Nov 13 18:40:45 user nova-compute[75216]:     </topology>
Nov 13 18:40:45 user nova-compute[75216]:     <cache>
Nov 13 18:40:45 user nova-compute[75216]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Nov 13 18:40:45 user nova-compute[75216]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Nov 13 18:40:45 user nova-compute[75216]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Nov 13 18:40:45 user nova-compute[75216]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Nov 13 18:40:45 user nova-compute[75216]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Nov 13 18:40:45 user nova-compute[75216]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Nov 13 18:40:45 user nova-compute[75216]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Nov 13 18:40:45 user nova-compute[75216]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Nov 13 18:40:45 user nova-compute[75216]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Nov 13 18:40:45 user nova-compute[75216]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Nov 13 18:40:45 user nova-compute[75216]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Nov 13 18:40:45 user nova-compute[75216]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Nov 13 18:40:45 user nova-compute[75216]:     </cache>
Nov 13 18:40:45 user nova-compute[75216]:     <secmodel>
Nov 13 18:40:45 user nova-compute[75216]:       <model>apparmor</model>
Nov 13 18:40:45 user nova-compute[75216]:       <doi>0</doi>
Nov 13 18:40:45 user nova-compute[75216]:     </secmodel>
Nov 13 18:40:45 user nova-compute[75216]:     <secmodel>
Nov 13 18:40:45 user nova-compute[75216]:       <model>dac</model>
Nov 13 18:40:45 user nova-compute[75216]:       <doi>0</doi>
Nov 13 18:40:45 user nova-compute[75216]:       <baselabel type='kvm'>+64055:+108</baselabel>
Nov 13 18:40:45 user nova-compute[75216]:       <baselabel type='qemu'>+64055:+108</baselabel>
Nov 13 18:40:45 user nova-compute[75216]:     </secmodel>
Nov 13 18:40:45 user nova-compute[75216]:   </host>
Nov 13 18:40:45 user nova-compute[75216]:   <guest>
Nov 13 18:40:45 user nova-compute[75216]:     <os_type>hvm</os_type>
Nov 13 18:40:45 user nova-compute[75216]:     <arch name='alpha'>
Nov 13 18:40:45 user nova-compute[75216]:       <wordsize>64</wordsize>
Nov 13 18:40:45 user nova-compute[75216]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='4'>clipper</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <domain type='qemu'/>
Nov 13 18:40:45 user nova-compute[75216]:     </arch>
Nov 13 18:40:45 user nova-compute[75216]:     <features>
Nov 13 18:40:45 user nova-compute[75216]:       <cpuselection/>
Nov 13 18:40:45 user nova-compute[75216]:       <deviceboot/>
Nov 13 18:40:45 user nova-compute[75216]:       <disksnapshot default='on' toggle='no'/>
Nov 13 18:40:45 user nova-compute[75216]:     </features>
Nov 13 18:40:45 user nova-compute[75216]:   </guest>
Nov 13 18:40:45 user nova-compute[75216]:   <guest>
Nov 13 18:40:45 user nova-compute[75216]:     <os_type>hvm</os_type>
Nov 13 18:40:45 user nova-compute[75216]:     <arch name='armv6l'>
Nov 13 18:40:45 user nova-compute[75216]:       <wordsize>32</wordsize>
Nov 13 18:40:45 user nova-compute[75216]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>integratorcp</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>borzoi</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>spitz</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='2'>nuri</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='2'>musca-b1</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>versatileab</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>kzm</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='2'>musca-a</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='2'>smdkc210</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>sx1</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>z2</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>tosa</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='4'>sabrelite</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>realview-eb</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>n810</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>n800</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>versatilepb</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>terrier</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>mainstone</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='4'>midway</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>musicpal</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>microbit</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>cubieboard</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>verdex</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>netduino2</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='4'>raspi2b</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>cheetah</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='4'>highbank</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>akita</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>connex</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>collie</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>raspi0</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <domain type='qemu'/>
Nov 13 18:40:45 user nova-compute[75216]:     </arch>
Nov 13 18:40:45 user nova-compute[75216]:     <features>
Nov 13 18:40:45 user nova-compute[75216]:       <cpuselection/>
Nov 13 18:40:45 user nova-compute[75216]:       <deviceboot/>
Nov 13 18:40:45 user nova-compute[75216]:       <disksnapshot default='on' toggle='no'/>
Nov 13 18:40:45 user nova-compute[75216]:     </features>
Nov 13 18:40:45 user nova-compute[75216]:   </guest>
Nov 13 18:40:45 user nova-compute[75216]:   <guest>
Nov 13 18:40:45 user nova-compute[75216]:     <os_type>hvm</os_type>
Nov 13 18:40:45 user nova-compute[75216]:     <arch name='armv7l'>
Nov 13 18:40:45 user nova-compute[75216]:       <wordsize>32</wordsize>
Nov 13 18:40:45 user nova-compute[75216]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>integratorcp</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>borzoi</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>spitz</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='2'>nuri</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='2'>musca-b1</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>versatileab</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>kzm</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='2'>musca-a</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='2'>smdkc210</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>sx1</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>z2</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>tosa</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='4'>sabrelite</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>realview-eb</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>n810</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>n800</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>versatilepb</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>terrier</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>mainstone</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='4'>midway</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>musicpal</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>microbit</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>cubieboard</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>verdex</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>netduino2</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='4'>raspi2b</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>cheetah</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='4'>highbank</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>akita</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>connex</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>collie</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>raspi0</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <domain type='qemu'/>
Nov 13 18:40:45 user nova-compute[75216]:     </arch>
Nov 13 18:40:45 user nova-compute[75216]:     <features>
Nov 13 18:40:45 user nova-compute[75216]:       <cpuselection/>
Nov 13 18:40:45 user nova-compute[75216]:       <deviceboot/>
Nov 13 18:40:45 user nova-compute[75216]:       <disksnapshot default='on' toggle='no'/>
Nov 13 18:40:45 user nova-compute[75216]:     </features>
Nov 13 18:40:45 user nova-compute[75216]:   </guest>
Nov 13 18:40:45 user nova-compute[75216]:   <guest>
Nov 13 18:40:45 user nova-compute[75216]:     <os_type>hvm</os_type>
Nov 13 18:40:45 user nova-compute[75216]:     <arch name='aarch64'>
Nov 13 18:40:45 user nova-compute[75216]:       <wordsize>64</wordsize>
Nov 13 18:40:45 user nova-compute[75216]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>integratorcp</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>borzoi</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>spitz</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='2'>nuri</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='2'>musca-b1</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>versatileab</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>kzm</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='2'>musca-a</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='2'>smdkc210</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>sx1</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>z2</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>tosa</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='4'>sabrelite</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>realview-eb</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='512'>sbsa-ref</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>n810</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>n800</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>versatilepb</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>terrier</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>mainstone</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='4'>midway</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>musicpal</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>microbit</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='4'>raspi3ap</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>cubieboard</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>verdex</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>netduino2</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='4'>raspi3b</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='4'>raspi2b</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>cheetah</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='4'>highbank</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>akita</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>connex</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>collie</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>raspi0</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <domain type='qemu'/>
Nov 13 18:40:45 user nova-compute[75216]:     </arch>
Nov 13 18:40:45 user nova-compute[75216]:     <features>
Nov 13 18:40:45 user nova-compute[75216]:       <acpi default='on' toggle='yes'/>
Nov 13 18:40:45 user nova-compute[75216]:       <cpuselection/>
Nov 13 18:40:45 user nova-compute[75216]:       <deviceboot/>
Nov 13 18:40:45 user nova-compute[75216]:       <disksnapshot default='on' toggle='no'/>
Nov 13 18:40:45 user nova-compute[75216]:     </features>
Nov 13 18:40:45 user nova-compute[75216]:   </guest>
Nov 13 18:40:45 user nova-compute[75216]:   <guest>
Nov 13 18:40:45 user nova-compute[75216]:     <os_type>hvm</os_type>
Nov 13 18:40:45 user nova-compute[75216]:     <arch name='cris'>
Nov 13 18:40:45 user nova-compute[75216]:       <wordsize>32</wordsize>
Nov 13 18:40:45 user nova-compute[75216]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>axis-dev88</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <domain type='qemu'/>
Nov 13 18:40:45 user nova-compute[75216]:     </arch>
Nov 13 18:40:45 user nova-compute[75216]:     <features>
Nov 13 18:40:45 user nova-compute[75216]:       <cpuselection/>
Nov 13 18:40:45 user nova-compute[75216]:       <deviceboot/>
Nov 13 18:40:45 user nova-compute[75216]:       <disksnapshot default='on' toggle='no'/>
Nov 13 18:40:45 user nova-compute[75216]:     </features>
Nov 13 18:40:45 user nova-compute[75216]:   </guest>
Nov 13 18:40:45 user nova-compute[75216]:   <guest>
Nov 13 18:40:45 user nova-compute[75216]:     <os_type>hvm</os_type>
Nov 13 18:40:45 user nova-compute[75216]:     <arch name='i686'>
Nov 13 18:40:45 user nova-compute[75216]:       <wordsize>32</wordsize>
Nov 13 18:40:45 user nova-compute[75216]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>x-remote</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>isapc</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='288'>microvm</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <domain type='qemu'/>
Nov 13 18:40:45 user nova-compute[75216]:       <domain type='kvm'/>
Nov 13 18:40:45 user nova-compute[75216]:     </arch>
Nov 13 18:40:45 user nova-compute[75216]:     <features>
Nov 13 18:40:45 user nova-compute[75216]:       <pae/>
Nov 13 18:40:45 user nova-compute[75216]:       <nonpae/>
Nov 13 18:40:45 user nova-compute[75216]:       <acpi default='on' toggle='yes'/>
Nov 13 18:40:45 user nova-compute[75216]:       <apic default='on' toggle='no'/>
Nov 13 18:40:45 user nova-compute[75216]:       <cpuselection/>
Nov 13 18:40:45 user nova-compute[75216]:       <deviceboot/>
Nov 13 18:40:45 user nova-compute[75216]:       <disksnapshot default='on' toggle='no'/>
Nov 13 18:40:45 user nova-compute[75216]:     </features>
Nov 13 18:40:45 user nova-compute[75216]:   </guest>
Nov 13 18:40:45 user nova-compute[75216]:   <guest>
Nov 13 18:40:45 user nova-compute[75216]:     <os_type>hvm</os_type>
Nov 13 18:40:45 user nova-compute[75216]:     <arch name='m68k'>
Nov 13 18:40:45 user nova-compute[75216]:       <wordsize>32</wordsize>
Nov 13 18:40:45 user nova-compute[75216]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>mcf5208evb</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>an5206</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>virt-6.0</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>q800</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>virt-6.2</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>next-cube</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>virt-6.1</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <domain type='qemu'/>
Nov 13 18:40:45 user nova-compute[75216]:     </arch>
Nov 13 18:40:45 user nova-compute[75216]:     <features>
Nov 13 18:40:45 user nova-compute[75216]:       <cpuselection/>
Nov 13 18:40:45 user nova-compute[75216]:       <deviceboot/>
Nov 13 18:40:45 user nova-compute[75216]:       <disksnapshot default='on' toggle='no'/>
Nov 13 18:40:45 user nova-compute[75216]:     </features>
Nov 13 18:40:45 user nova-compute[75216]:   </guest>
Nov 13 18:40:45 user nova-compute[75216]:   <guest>
Nov 13 18:40:45 user nova-compute[75216]:     <os_type>hvm</os_type>
Nov 13 18:40:45 user nova-compute[75216]:     <arch name='microblaze'>
Nov 13 18:40:45 user nova-compute[75216]:       <wordsize>32</wordsize>
Nov 13 18:40:45 user nova-compute[75216]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <domain type='qemu'/>
Nov 13 18:40:45 user nova-compute[75216]:     </arch>
Nov 13 18:40:45 user nova-compute[75216]:     <features>
Nov 13 18:40:45 user nova-compute[75216]:       <cpuselection/>
Nov 13 18:40:45 user nova-compute[75216]:       <deviceboot/>
Nov 13 18:40:45 user nova-compute[75216]:       <disksnapshot default='on' toggle='no'/>
Nov 13 18:40:45 user nova-compute[75216]:     </features>
Nov 13 18:40:45 user nova-compute[75216]:   </guest>
Nov 13 18:40:45 user nova-compute[75216]:   <guest>
Nov 13 18:40:45 user nova-compute[75216]:     <os_type>hvm</os_type>
Nov 13 18:40:45 user nova-compute[75216]:     <arch name='microblazeel'>
Nov 13 18:40:45 user nova-compute[75216]:       <wordsize>32</wordsize>
Nov 13 18:40:45 user nova-compute[75216]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <domain type='qemu'/>
Nov 13 18:40:45 user nova-compute[75216]:     </arch>
Nov 13 18:40:45 user nova-compute[75216]:     <features>
Nov 13 18:40:45 user nova-compute[75216]:       <cpuselection/>
Nov 13 18:40:45 user nova-compute[75216]:       <deviceboot/>
Nov 13 18:40:45 user nova-compute[75216]:       <disksnapshot default='on' toggle='no'/>
Nov 13 18:40:45 user nova-compute[75216]:     </features>
Nov 13 18:40:45 user nova-compute[75216]:   </guest>
Nov 13 18:40:45 user nova-compute[75216]:   <guest>
Nov 13 18:40:45 user nova-compute[75216]:     <os_type>hvm</os_type>
Nov 13 18:40:45 user nova-compute[75216]:     <arch name='mips'>
Nov 13 18:40:45 user nova-compute[75216]:       <wordsize>32</wordsize>
Nov 13 18:40:45 user nova-compute[75216]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='16'>malta</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>mipssim</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <domain type='qemu'/>
Nov 13 18:40:45 user nova-compute[75216]:     </arch>
Nov 13 18:40:45 user nova-compute[75216]:     <features>
Nov 13 18:40:45 user nova-compute[75216]:       <cpuselection/>
Nov 13 18:40:45 user nova-compute[75216]:       <deviceboot/>
Nov 13 18:40:45 user nova-compute[75216]:       <disksnapshot default='on' toggle='no'/>
Nov 13 18:40:45 user nova-compute[75216]:     </features>
Nov 13 18:40:45 user nova-compute[75216]:   </guest>
Nov 13 18:40:45 user nova-compute[75216]:   <guest>
Nov 13 18:40:45 user nova-compute[75216]:     <os_type>hvm</os_type>
Nov 13 18:40:45 user nova-compute[75216]:     <arch name='mipsel'>
Nov 13 18:40:45 user nova-compute[75216]:       <wordsize>32</wordsize>
Nov 13 18:40:45 user nova-compute[75216]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='16'>malta</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>mipssim</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <domain type='qemu'/>
Nov 13 18:40:45 user nova-compute[75216]:     </arch>
Nov 13 18:40:45 user nova-compute[75216]:     <features>
Nov 13 18:40:45 user nova-compute[75216]:       <cpuselection/>
Nov 13 18:40:45 user nova-compute[75216]:       <deviceboot/>
Nov 13 18:40:45 user nova-compute[75216]:       <disksnapshot default='on' toggle='no'/>
Nov 13 18:40:45 user nova-compute[75216]:     </features>
Nov 13 18:40:45 user nova-compute[75216]:   </guest>
Nov 13 18:40:45 user nova-compute[75216]:   <guest>
Nov 13 18:40:45 user nova-compute[75216]:     <os_type>hvm</os_type>
Nov 13 18:40:45 user nova-compute[75216]:     <arch name='mips64'>
Nov 13 18:40:45 user nova-compute[75216]:       <wordsize>64</wordsize>
Nov 13 18:40:45 user nova-compute[75216]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='16'>malta</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>mipssim</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>pica61</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>magnum</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <domain type='qemu'/>
Nov 13 18:40:45 user nova-compute[75216]:     </arch>
Nov 13 18:40:45 user nova-compute[75216]:     <features>
Nov 13 18:40:45 user nova-compute[75216]:       <cpuselection/>
Nov 13 18:40:45 user nova-compute[75216]:       <deviceboot/>
Nov 13 18:40:45 user nova-compute[75216]:       <disksnapshot default='on' toggle='no'/>
Nov 13 18:40:45 user nova-compute[75216]:     </features>
Nov 13 18:40:45 user nova-compute[75216]:   </guest>
Nov 13 18:40:45 user nova-compute[75216]:   <guest>
Nov 13 18:40:45 user nova-compute[75216]:     <os_type>hvm</os_type>
Nov 13 18:40:45 user nova-compute[75216]:     <arch name='mips64el'>
Nov 13 18:40:45 user nova-compute[75216]:       <wordsize>64</wordsize>
Nov 13 18:40:45 user nova-compute[75216]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='16'>malta</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='16'>loongson3-virt</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>mipssim</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>pica61</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>magnum</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='16'>boston</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>fuloong2e</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <domain type='qemu'/>
Nov 13 18:40:45 user nova-compute[75216]:     </arch>
Nov 13 18:40:45 user nova-compute[75216]:     <features>
Nov 13 18:40:45 user nova-compute[75216]:       <cpuselection/>
Nov 13 18:40:45 user nova-compute[75216]:       <deviceboot/>
Nov 13 18:40:45 user nova-compute[75216]:       <disksnapshot default='on' toggle='no'/>
Nov 13 18:40:45 user nova-compute[75216]:     </features>
Nov 13 18:40:45 user nova-compute[75216]:   </guest>
Nov 13 18:40:45 user nova-compute[75216]:   <guest>
Nov 13 18:40:45 user nova-compute[75216]:     <os_type>hvm</os_type>
Nov 13 18:40:45 user nova-compute[75216]:     <arch name='ppc'>
Nov 13 18:40:45 user nova-compute[75216]:       <wordsize>32</wordsize>
Nov 13 18:40:45 user nova-compute[75216]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>g3beige</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>mac99</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='32'>ppce500</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>pegasos2</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>sam460ex</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>bamboo</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>40p</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>ref405ep</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>taihu</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <domain type='qemu'/>
Nov 13 18:40:45 user nova-compute[75216]:     </arch>
Nov 13 18:40:45 user nova-compute[75216]:     <features>
Nov 13 18:40:45 user nova-compute[75216]:       <cpuselection/>
Nov 13 18:40:45 user nova-compute[75216]:       <deviceboot/>
Nov 13 18:40:45 user nova-compute[75216]:       <disksnapshot default='on' toggle='no'/>
Nov 13 18:40:45 user nova-compute[75216]:     </features>
Nov 13 18:40:45 user nova-compute[75216]:   </guest>
Nov 13 18:40:45 user nova-compute[75216]:   <guest>
Nov 13 18:40:45 user nova-compute[75216]:     <os_type>hvm</os_type>
Nov 13 18:40:45 user nova-compute[75216]:     <arch name='ppc64'>
Nov 13 18:40:45 user nova-compute[75216]:       <wordsize>64</wordsize>
Nov 13 18:40:45 user nova-compute[75216]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='2048'>powernv9</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>taihu</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='2048'>powernv10</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='32'>ppce500</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>40p</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>pegasos2</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>bamboo</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>g3beige</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>mac99</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>sam460ex</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>ref405ep</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='2048'>powernv8</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <domain type='qemu'/>
Nov 13 18:40:45 user nova-compute[75216]:     </arch>
Nov 13 18:40:45 user nova-compute[75216]:     <features>
Nov 13 18:40:45 user nova-compute[75216]:       <cpuselection/>
Nov 13 18:40:45 user nova-compute[75216]:       <deviceboot/>
Nov 13 18:40:45 user nova-compute[75216]:       <disksnapshot default='on' toggle='no'/>
Nov 13 18:40:45 user nova-compute[75216]:     </features>
Nov 13 18:40:45 user nova-compute[75216]:   </guest>
Nov 13 18:40:45 user nova-compute[75216]:   <guest>
Nov 13 18:40:45 user nova-compute[75216]:     <os_type>hvm</os_type>
Nov 13 18:40:45 user nova-compute[75216]:     <arch name='ppc64le'>
Nov 13 18:40:45 user nova-compute[75216]:       <wordsize>64</wordsize>
Nov 13 18:40:45 user nova-compute[75216]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='2048'>powernv9</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>taihu</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='2048'>powernv10</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='32'>ppce500</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>40p</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>pegasos2</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>bamboo</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>g3beige</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>mac99</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>sam460ex</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>ref405ep</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='2048'>powernv8</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <domain type='qemu'/>
Nov 13 18:40:45 user nova-compute[75216]:     </arch>
Nov 13 18:40:45 user nova-compute[75216]:     <features>
Nov 13 18:40:45 user nova-compute[75216]:       <cpuselection/>
Nov 13 18:40:45 user nova-compute[75216]:       <deviceboot/>
Nov 13 18:40:45 user nova-compute[75216]:       <disksnapshot default='on' toggle='no'/>
Nov 13 18:40:45 user nova-compute[75216]:     </features>
Nov 13 18:40:45 user nova-compute[75216]:   </guest>
Nov 13 18:40:45 user nova-compute[75216]:   <guest>
Nov 13 18:40:45 user nova-compute[75216]:     <os_type>hvm</os_type>
Nov 13 18:40:45 user nova-compute[75216]:     <arch name='riscv32'>
Nov 13 18:40:45 user nova-compute[75216]:       <wordsize>32</wordsize>
Nov 13 18:40:45 user nova-compute[75216]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='8'>spike</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>opentitan</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='5'>sifive_u</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>sifive_e</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='8'>virt</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <domain type='qemu'/>
Nov 13 18:40:45 user nova-compute[75216]:     </arch>
Nov 13 18:40:45 user nova-compute[75216]:     <features>
Nov 13 18:40:45 user nova-compute[75216]:       <cpuselection/>
Nov 13 18:40:45 user nova-compute[75216]:       <deviceboot/>
Nov 13 18:40:45 user nova-compute[75216]:       <disksnapshot default='on' toggle='no'/>
Nov 13 18:40:45 user nova-compute[75216]:     </features>
Nov 13 18:40:45 user nova-compute[75216]:   </guest>
Nov 13 18:40:45 user nova-compute[75216]:   <guest>
Nov 13 18:40:45 user nova-compute[75216]:     <os_type>hvm</os_type>
Nov 13 18:40:45 user nova-compute[75216]:     <arch name='riscv64'>
Nov 13 18:40:45 user nova-compute[75216]:       <wordsize>64</wordsize>
Nov 13 18:40:45 user nova-compute[75216]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='8'>spike</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='5'>sifive_u</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>shakti_c</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>sifive_e</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='8'>virt</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <domain type='qemu'/>
Nov 13 18:40:45 user nova-compute[75216]:     </arch>
Nov 13 18:40:45 user nova-compute[75216]:     <features>
Nov 13 18:40:45 user nova-compute[75216]:       <cpuselection/>
Nov 13 18:40:45 user nova-compute[75216]:       <deviceboot/>
Nov 13 18:40:45 user nova-compute[75216]:       <disksnapshot default='on' toggle='no'/>
Nov 13 18:40:45 user nova-compute[75216]:     </features>
Nov 13 18:40:45 user nova-compute[75216]:   </guest>
Nov 13 18:40:45 user nova-compute[75216]:   <guest>
Nov 13 18:40:45 user nova-compute[75216]:     <os_type>hvm</os_type>
Nov 13 18:40:45 user nova-compute[75216]:     <arch name='s390x'>
Nov 13 18:40:45 user nova-compute[75216]:       <wordsize>64</wordsize>
Nov 13 18:40:45 user nova-compute[75216]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <domain type='qemu'/>
Nov 13 18:40:45 user nova-compute[75216]:     </arch>
Nov 13 18:40:45 user nova-compute[75216]:     <features>
Nov 13 18:40:45 user nova-compute[75216]:       <cpuselection/>
Nov 13 18:40:45 user nova-compute[75216]:       <deviceboot/>
Nov 13 18:40:45 user nova-compute[75216]:       <disksnapshot default='on' toggle='no'/>
Nov 13 18:40:45 user nova-compute[75216]:     </features>
Nov 13 18:40:45 user nova-compute[75216]:   </guest>
Nov 13 18:40:45 user nova-compute[75216]:   <guest>
Nov 13 18:40:45 user nova-compute[75216]:     <os_type>hvm</os_type>
Nov 13 18:40:45 user nova-compute[75216]:     <arch name='sh4'>
Nov 13 18:40:45 user nova-compute[75216]:       <wordsize>32</wordsize>
Nov 13 18:40:45 user nova-compute[75216]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>shix</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>r2d</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <domain type='qemu'/>
Nov 13 18:40:45 user nova-compute[75216]:     </arch>
Nov 13 18:40:45 user nova-compute[75216]:     <features>
Nov 13 18:40:45 user nova-compute[75216]:       <cpuselection/>
Nov 13 18:40:45 user nova-compute[75216]:       <deviceboot/>
Nov 13 18:40:45 user nova-compute[75216]:       <disksnapshot default='on' toggle='no'/>
Nov 13 18:40:45 user nova-compute[75216]:     </features>
Nov 13 18:40:45 user nova-compute[75216]:   </guest>
Nov 13 18:40:45 user nova-compute[75216]:   <guest>
Nov 13 18:40:45 user nova-compute[75216]:     <os_type>hvm</os_type>
Nov 13 18:40:45 user nova-compute[75216]:     <arch name='sh4eb'>
Nov 13 18:40:45 user nova-compute[75216]:       <wordsize>64</wordsize>
Nov 13 18:40:45 user nova-compute[75216]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>shix</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>r2d</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <domain type='qemu'/>
Nov 13 18:40:45 user nova-compute[75216]:     </arch>
Nov 13 18:40:45 user nova-compute[75216]:     <features>
Nov 13 18:40:45 user nova-compute[75216]:       <cpuselection/>
Nov 13 18:40:45 user nova-compute[75216]:       <deviceboot/>
Nov 13 18:40:45 user nova-compute[75216]:       <disksnapshot default='on' toggle='no'/>
Nov 13 18:40:45 user nova-compute[75216]:     </features>
Nov 13 18:40:45 user nova-compute[75216]:   </guest>
Nov 13 18:40:45 user nova-compute[75216]:   <guest>
Nov 13 18:40:45 user nova-compute[75216]:     <os_type>hvm</os_type>
Nov 13 18:40:45 user nova-compute[75216]:     <arch name='sparc'>
Nov 13 18:40:45 user nova-compute[75216]:       <wordsize>32</wordsize>
Nov 13 18:40:45 user nova-compute[75216]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>SS-5</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='4'>SS-20</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>LX</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>SPARCClassic</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>leon3_generic</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>SPARCbook</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>SS-4</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='4'>SS-600MP</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='4'>SS-10</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>Voyager</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <domain type='qemu'/>
Nov 13 18:40:45 user nova-compute[75216]:     </arch>
Nov 13 18:40:45 user nova-compute[75216]:     <features>
Nov 13 18:40:45 user nova-compute[75216]:       <cpuselection/>
Nov 13 18:40:45 user nova-compute[75216]:       <deviceboot/>
Nov 13 18:40:45 user nova-compute[75216]:       <disksnapshot default='on' toggle='no'/>
Nov 13 18:40:45 user nova-compute[75216]:     </features>
Nov 13 18:40:45 user nova-compute[75216]:   </guest>
Nov 13 18:40:45 user nova-compute[75216]:   <guest>
Nov 13 18:40:45 user nova-compute[75216]:     <os_type>hvm</os_type>
Nov 13 18:40:45 user nova-compute[75216]:     <arch name='sparc64'>
Nov 13 18:40:45 user nova-compute[75216]:       <wordsize>64</wordsize>
Nov 13 18:40:45 user nova-compute[75216]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>sun4u</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>niagara</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>sun4v</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <domain type='qemu'/>
Nov 13 18:40:45 user nova-compute[75216]:     </arch>
Nov 13 18:40:45 user nova-compute[75216]:     <features>
Nov 13 18:40:45 user nova-compute[75216]:       <cpuselection/>
Nov 13 18:40:45 user nova-compute[75216]:       <deviceboot/>
Nov 13 18:40:45 user nova-compute[75216]:       <disksnapshot default='on' toggle='no'/>
Nov 13 18:40:45 user nova-compute[75216]:     </features>
Nov 13 18:40:45 user nova-compute[75216]:   </guest>
Nov 13 18:40:45 user nova-compute[75216]:   <guest>
Nov 13 18:40:45 user nova-compute[75216]:     <os_type>hvm</os_type>
Nov 13 18:40:45 user nova-compute[75216]:     <arch name='x86_64'>
Nov 13 18:40:45 user nova-compute[75216]:       <wordsize>64</wordsize>
Nov 13 18:40:45 user nova-compute[75216]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>x-remote</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='1'>isapc</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='288'>microvm</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <domain type='qemu'/>
Nov 13 18:40:45 user nova-compute[75216]:       <domain type='kvm'/>
Nov 13 18:40:45 user nova-compute[75216]:     </arch>
Nov 13 18:40:45 user nova-compute[75216]:     <features>
Nov 13 18:40:45 user nova-compute[75216]:       <acpi default='on' toggle='yes'/>
Nov 13 18:40:45 user nova-compute[75216]:       <apic default='on' toggle='no'/>
Nov 13 18:40:45 user nova-compute[75216]:       <cpuselection/>
Nov 13 18:40:45 user nova-compute[75216]:       <deviceboot/>
Nov 13 18:40:45 user nova-compute[75216]:       <disksnapshot default='on' toggle='no'/>
Nov 13 18:40:45 user nova-compute[75216]:     </features>
Nov 13 18:40:45 user nova-compute[75216]:   </guest>
Nov 13 18:40:45 user nova-compute[75216]:   <guest>
Nov 13 18:40:45 user nova-compute[75216]:     <os_type>hvm</os_type>
Nov 13 18:40:45 user nova-compute[75216]:     <arch name='xtensa'>
Nov 13 18:40:45 user nova-compute[75216]:       <wordsize>32</wordsize>
Nov 13 18:40:45 user nova-compute[75216]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='4'>sim</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='32'>kc705</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='32'>ml605</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='32'>virt</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='32'>lx200</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='32'>lx60</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <domain type='qemu'/>
Nov 13 18:40:45 user nova-compute[75216]:     </arch>
Nov 13 18:40:45 user nova-compute[75216]:     <features>
Nov 13 18:40:45 user nova-compute[75216]:       <cpuselection/>
Nov 13 18:40:45 user nova-compute[75216]:       <deviceboot/>
Nov 13 18:40:45 user nova-compute[75216]:       <disksnapshot default='on' toggle='no'/>
Nov 13 18:40:45 user nova-compute[75216]:     </features>
Nov 13 18:40:45 user nova-compute[75216]:   </guest>
Nov 13 18:40:45 user nova-compute[75216]:   <guest>
Nov 13 18:40:45 user nova-compute[75216]:     <os_type>hvm</os_type>
Nov 13 18:40:45 user nova-compute[75216]:     <arch name='xtensaeb'>
Nov 13 18:40:45 user nova-compute[75216]:       <wordsize>32</wordsize>
Nov 13 18:40:45 user nova-compute[75216]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='4'>sim</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='32'>kc705</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='32'>ml605</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='32'>virt</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='32'>lx200</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='32'>lx60</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 13 18:40:45 user nova-compute[75216]:       <domain type='qemu'/>
Nov 13 18:40:45 user nova-compute[75216]:     </arch>
Nov 13 18:40:45 user nova-compute[75216]:     <features>
Nov 13 18:40:45 user nova-compute[75216]:       <cpuselection/>
Nov 13 18:40:45 user nova-compute[75216]:       <deviceboot/>
Nov 13 18:40:45 user nova-compute[75216]:       <disksnapshot default='on' toggle='no'/>
Nov 13 18:40:45 user nova-compute[75216]:     </features>
Nov 13 18:40:45 user nova-compute[75216]:   </guest>
Nov 13 18:40:45 user nova-compute[75216]: </capabilities>
Nov 13 18:40:45 user nova-compute[75216]: 
Nov 13 18:40:45 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-085a4235-df6a-43dd-bf96-2d3c95dda5d5 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=75216) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 13 18:40:45 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-085a4235-df6a-43dd-bf96-2d3c95dda5d5 None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=75216) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 13 18:40:45 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-085a4235-df6a-43dd-bf96-2d3c95dda5d5 None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=75216) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 13 18:40:45 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-085a4235-df6a-43dd-bf96-2d3c95dda5d5 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75216) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 13 18:40:45 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-085a4235-df6a-43dd-bf96-2d3c95dda5d5 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75216) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 13 18:40:45 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-085a4235-df6a-43dd-bf96-2d3c95dda5d5 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=75216) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 13 18:40:45 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-085a4235-df6a-43dd-bf96-2d3c95dda5d5 None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75216) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 13 18:40:45 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-085a4235-df6a-43dd-bf96-2d3c95dda5d5 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=75216) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 13 18:40:45 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-085a4235-df6a-43dd-bf96-2d3c95dda5d5 None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=75216) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 13 18:40:45 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-085a4235-df6a-43dd-bf96-2d3c95dda5d5 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=75216) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 13 18:40:45 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-085a4235-df6a-43dd-bf96-2d3c95dda5d5 None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=75216) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 13 18:40:45 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-085a4235-df6a-43dd-bf96-2d3c95dda5d5 None None] Getting domain capabilities for i686 via machine types: {'ubuntu-q35', 'pc', 'ubuntu', 'q35'} {{(pid=75216) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 13 18:40:45 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-085a4235-df6a-43dd-bf96-2d3c95dda5d5 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Nov 13 18:40:45 user nova-compute[75216]: <domainCapabilities>
Nov 13 18:40:45 user nova-compute[75216]:   <path>/usr/bin/qemu-system-i386</path>
Nov 13 18:40:45 user nova-compute[75216]:   <domain>kvm</domain>
Nov 13 18:40:45 user nova-compute[75216]:   <machine>pc-q35-jammy</machine>
Nov 13 18:40:45 user nova-compute[75216]:   <arch>i686</arch>
Nov 13 18:40:45 user nova-compute[75216]:   <vcpu max='288'/>
Nov 13 18:40:45 user nova-compute[75216]:   <iothreads supported='yes'/>
Nov 13 18:40:45 user nova-compute[75216]:   <os supported='yes'>
Nov 13 18:40:45 user nova-compute[75216]:     <enum name='firmware'/>
Nov 13 18:40:45 user nova-compute[75216]:     <loader supported='yes'>
Nov 13 18:40:45 user nova-compute[75216]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 13 18:40:45 user nova-compute[75216]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 13 18:40:45 user nova-compute[75216]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 13 18:40:45 user nova-compute[75216]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 13 18:40:45 user nova-compute[75216]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 13 18:40:45 user nova-compute[75216]:       <enum name='type'>
Nov 13 18:40:45 user nova-compute[75216]:         <value>rom</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>pflash</value>
Nov 13 18:40:45 user nova-compute[75216]:       </enum>
Nov 13 18:40:45 user nova-compute[75216]:       <enum name='readonly'>
Nov 13 18:40:45 user nova-compute[75216]:         <value>yes</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>no</value>
Nov 13 18:40:45 user nova-compute[75216]:       </enum>
Nov 13 18:40:45 user nova-compute[75216]:       <enum name='secure'>
Nov 13 18:40:45 user nova-compute[75216]:         <value>no</value>
Nov 13 18:40:45 user nova-compute[75216]:       </enum>
Nov 13 18:40:45 user nova-compute[75216]:     </loader>
Nov 13 18:40:45 user nova-compute[75216]:   </os>
Nov 13 18:40:45 user nova-compute[75216]:   <cpu>
Nov 13 18:40:45 user nova-compute[75216]:     <mode name='host-passthrough' supported='yes'>
Nov 13 18:40:45 user nova-compute[75216]:       <enum name='hostPassthroughMigratable'>
Nov 13 18:40:45 user nova-compute[75216]:         <value>off</value>
Nov 13 18:40:45 user nova-compute[75216]:       </enum>
Nov 13 18:40:45 user nova-compute[75216]:     </mode>
Nov 13 18:40:45 user nova-compute[75216]:     <mode name='maximum' supported='yes'>
Nov 13 18:40:45 user nova-compute[75216]:       <enum name='maximumMigratable'>
Nov 13 18:40:45 user nova-compute[75216]:         <value>on</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>off</value>
Nov 13 18:40:45 user nova-compute[75216]:       </enum>
Nov 13 18:40:45 user nova-compute[75216]:     </mode>
Nov 13 18:40:45 user nova-compute[75216]:     <mode name='host-model' supported='yes'>
Nov 13 18:40:45 user nova-compute[75216]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 13 18:40:45 user nova-compute[75216]:       <vendor>Intel</vendor>
Nov 13 18:40:45 user nova-compute[75216]:       <feature policy='require' name='ss'/>
Nov 13 18:40:45 user nova-compute[75216]:       <feature policy='require' name='vmx'/>
Nov 13 18:40:45 user nova-compute[75216]:       <feature policy='require' name='pcid'/>
Nov 13 18:40:45 user nova-compute[75216]:       <feature policy='require' name='hypervisor'/>
Nov 13 18:40:45 user nova-compute[75216]:       <feature policy='require' name='arat'/>
Nov 13 18:40:45 user nova-compute[75216]:       <feature policy='require' name='tsc_adjust'/>
Nov 13 18:40:45 user nova-compute[75216]:       <feature policy='require' name='umip'/>
Nov 13 18:40:45 user nova-compute[75216]:       <feature policy='require' name='md-clear'/>
Nov 13 18:40:45 user nova-compute[75216]:       <feature policy='require' name='stibp'/>
Nov 13 18:40:45 user nova-compute[75216]:       <feature policy='require' name='arch-capabilities'/>
Nov 13 18:40:45 user nova-compute[75216]:       <feature policy='require' name='ssbd'/>
Nov 13 18:40:45 user nova-compute[75216]:       <feature policy='require' name='ibpb'/>
Nov 13 18:40:45 user nova-compute[75216]:       <feature policy='require' name='ibrs'/>
Nov 13 18:40:45 user nova-compute[75216]:       <feature policy='require' name='amd-stibp'/>
Nov 13 18:40:45 user nova-compute[75216]:       <feature policy='require' name='amd-ssbd'/>
Nov 13 18:40:45 user nova-compute[75216]:       <feature policy='disable' name='erms'/>
Nov 13 18:40:45 user nova-compute[75216]:       <feature policy='disable' name='xsaveopt'/>
Nov 13 18:40:45 user nova-compute[75216]:       <feature policy='disable' name='lm'/>
Nov 13 18:40:45 user nova-compute[75216]:     </mode>
Nov 13 18:40:45 user nova-compute[75216]:     <mode name='custom' supported='yes'>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>qemu64</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='yes'>qemu32</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>phenom</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='yes'>pentium3</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='yes'>pentium2</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='yes'>pentium</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>n270</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>kvm64</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='yes'>kvm32</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='yes'>coreduo</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>core2duo</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>athlon</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Westmere-IBRS</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Westmere</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Snowridge</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Skylake-Server</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Skylake-Client</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>SandyBridge</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Penryn</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Opteron_G5</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Opteron_G4</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Opteron_G3</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Opteron_G2</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Opteron_G1</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Nehalem-IBRS</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Nehalem</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>IvyBridge</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Icelake-Server</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Haswell-noTSX</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Haswell-IBRS</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Haswell</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>EPYC-Rome</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>EPYC-Milan</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>EPYC-IBPB</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>EPYC</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Dhyana</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Cooperlake</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Conroe</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Cascadelake-Server</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Broadwell-noTSX</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Broadwell-IBRS</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Broadwell</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='yes'>486</model>
Nov 13 18:40:45 user nova-compute[75216]:     </mode>
Nov 13 18:40:45 user nova-compute[75216]:   </cpu>
Nov 13 18:40:45 user nova-compute[75216]:   <memoryBacking supported='yes'>
Nov 13 18:40:45 user nova-compute[75216]:     <enum name='sourceType'>
Nov 13 18:40:45 user nova-compute[75216]:       <value>file</value>
Nov 13 18:40:45 user nova-compute[75216]:       <value>anonymous</value>
Nov 13 18:40:45 user nova-compute[75216]:       <value>memfd</value>
Nov 13 18:40:45 user nova-compute[75216]:     </enum>
Nov 13 18:40:45 user nova-compute[75216]:   </memoryBacking>
Nov 13 18:40:45 user nova-compute[75216]:   <devices>
Nov 13 18:40:45 user nova-compute[75216]:     <disk supported='yes'>
Nov 13 18:40:45 user nova-compute[75216]:       <enum name='diskDevice'>
Nov 13 18:40:45 user nova-compute[75216]:         <value>disk</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>cdrom</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>floppy</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>lun</value>
Nov 13 18:40:45 user nova-compute[75216]:       </enum>
Nov 13 18:40:45 user nova-compute[75216]:       <enum name='bus'>
Nov 13 18:40:45 user nova-compute[75216]:         <value>fdc</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>scsi</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>virtio</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>usb</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>sata</value>
Nov 13 18:40:45 user nova-compute[75216]:       </enum>
Nov 13 18:40:45 user nova-compute[75216]:       <enum name='model'>
Nov 13 18:40:45 user nova-compute[75216]:         <value>virtio</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>virtio-transitional</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>virtio-non-transitional</value>
Nov 13 18:40:45 user nova-compute[75216]:       </enum>
Nov 13 18:40:45 user nova-compute[75216]:     </disk>
Nov 13 18:40:45 user nova-compute[75216]:     <graphics supported='yes'>
Nov 13 18:40:45 user nova-compute[75216]:       <enum name='type'>
Nov 13 18:40:45 user nova-compute[75216]:         <value>sdl</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>vnc</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>spice</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>egl-headless</value>
Nov 13 18:40:45 user nova-compute[75216]:       </enum>
Nov 13 18:40:45 user nova-compute[75216]:     </graphics>
Nov 13 18:40:45 user nova-compute[75216]:     <video supported='yes'>
Nov 13 18:40:45 user nova-compute[75216]:       <enum name='modelType'>
Nov 13 18:40:45 user nova-compute[75216]:         <value>vga</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>cirrus</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>vmvga</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>qxl</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>virtio</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>none</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>bochs</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>ramfb</value>
Nov 13 18:40:45 user nova-compute[75216]:       </enum>
Nov 13 18:40:45 user nova-compute[75216]:     </video>
Nov 13 18:40:45 user nova-compute[75216]:     <hostdev supported='yes'>
Nov 13 18:40:45 user nova-compute[75216]:       <enum name='mode'>
Nov 13 18:40:45 user nova-compute[75216]:         <value>subsystem</value>
Nov 13 18:40:45 user nova-compute[75216]:       </enum>
Nov 13 18:40:45 user nova-compute[75216]:       <enum name='startupPolicy'>
Nov 13 18:40:45 user nova-compute[75216]:         <value>default</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>mandatory</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>requisite</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>optional</value>
Nov 13 18:40:45 user nova-compute[75216]:       </enum>
Nov 13 18:40:45 user nova-compute[75216]:       <enum name='subsysType'>
Nov 13 18:40:45 user nova-compute[75216]:         <value>usb</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>pci</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>scsi</value>
Nov 13 18:40:45 user nova-compute[75216]:       </enum>
Nov 13 18:40:45 user nova-compute[75216]:       <enum name='capsType'/>
Nov 13 18:40:45 user nova-compute[75216]:       <enum name='pciBackend'/>
Nov 13 18:40:45 user nova-compute[75216]:     </hostdev>
Nov 13 18:40:45 user nova-compute[75216]:     <rng supported='yes'>
Nov 13 18:40:45 user nova-compute[75216]:       <enum name='model'>
Nov 13 18:40:45 user nova-compute[75216]:         <value>virtio</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>virtio-transitional</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>virtio-non-transitional</value>
Nov 13 18:40:45 user nova-compute[75216]:       </enum>
Nov 13 18:40:45 user nova-compute[75216]:       <enum name='backendModel'>
Nov 13 18:40:45 user nova-compute[75216]:         <value>random</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>egd</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>builtin</value>
Nov 13 18:40:45 user nova-compute[75216]:       </enum>
Nov 13 18:40:45 user nova-compute[75216]:     </rng>
Nov 13 18:40:45 user nova-compute[75216]:     <filesystem supported='yes'>
Nov 13 18:40:45 user nova-compute[75216]:       <enum name='driverType'>
Nov 13 18:40:45 user nova-compute[75216]:         <value>path</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>handle</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>virtiofs</value>
Nov 13 18:40:45 user nova-compute[75216]:       </enum>
Nov 13 18:40:45 user nova-compute[75216]:     </filesystem>
Nov 13 18:40:45 user nova-compute[75216]:     <tpm supported='yes'>
Nov 13 18:40:45 user nova-compute[75216]:       <enum name='model'>
Nov 13 18:40:45 user nova-compute[75216]:         <value>tpm-tis</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>tpm-crb</value>
Nov 13 18:40:45 user nova-compute[75216]:       </enum>
Nov 13 18:40:45 user nova-compute[75216]:       <enum name='backendModel'>
Nov 13 18:40:45 user nova-compute[75216]:         <value>passthrough</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>emulator</value>
Nov 13 18:40:45 user nova-compute[75216]:       </enum>
Nov 13 18:40:45 user nova-compute[75216]:     </tpm>
Nov 13 18:40:45 user nova-compute[75216]:   </devices>
Nov 13 18:40:45 user nova-compute[75216]:   <features>
Nov 13 18:40:45 user nova-compute[75216]:     <gic supported='no'/>
Nov 13 18:40:45 user nova-compute[75216]:     <vmcoreinfo supported='yes'/>
Nov 13 18:40:45 user nova-compute[75216]:     <genid supported='yes'/>
Nov 13 18:40:45 user nova-compute[75216]:     <backingStoreInput supported='yes'/>
Nov 13 18:40:45 user nova-compute[75216]:     <backup supported='yes'/>
Nov 13 18:40:45 user nova-compute[75216]:     <sev supported='no'/>
Nov 13 18:40:45 user nova-compute[75216]:   </features>
Nov 13 18:40:45 user nova-compute[75216]: </domainCapabilities>
Nov 13 18:40:45 user nova-compute[75216]:  {{(pid=75216) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 13 18:40:45 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-085a4235-df6a-43dd-bf96-2d3c95dda5d5 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Nov 13 18:40:45 user nova-compute[75216]: <domainCapabilities>
Nov 13 18:40:45 user nova-compute[75216]:   <path>/usr/bin/qemu-system-i386</path>
Nov 13 18:40:45 user nova-compute[75216]:   <domain>kvm</domain>
Nov 13 18:40:45 user nova-compute[75216]:   <machine>pc-i440fx-6.2</machine>
Nov 13 18:40:45 user nova-compute[75216]:   <arch>i686</arch>
Nov 13 18:40:45 user nova-compute[75216]:   <vcpu max='255'/>
Nov 13 18:40:45 user nova-compute[75216]:   <iothreads supported='yes'/>
Nov 13 18:40:45 user nova-compute[75216]:   <os supported='yes'>
Nov 13 18:40:45 user nova-compute[75216]:     <enum name='firmware'/>
Nov 13 18:40:45 user nova-compute[75216]:     <loader supported='yes'>
Nov 13 18:40:45 user nova-compute[75216]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 13 18:40:45 user nova-compute[75216]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 13 18:40:45 user nova-compute[75216]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 13 18:40:45 user nova-compute[75216]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 13 18:40:45 user nova-compute[75216]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 13 18:40:45 user nova-compute[75216]:       <enum name='type'>
Nov 13 18:40:45 user nova-compute[75216]:         <value>rom</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>pflash</value>
Nov 13 18:40:45 user nova-compute[75216]:       </enum>
Nov 13 18:40:45 user nova-compute[75216]:       <enum name='readonly'>
Nov 13 18:40:45 user nova-compute[75216]:         <value>yes</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>no</value>
Nov 13 18:40:45 user nova-compute[75216]:       </enum>
Nov 13 18:40:45 user nova-compute[75216]:       <enum name='secure'>
Nov 13 18:40:45 user nova-compute[75216]:         <value>no</value>
Nov 13 18:40:45 user nova-compute[75216]:       </enum>
Nov 13 18:40:45 user nova-compute[75216]:     </loader>
Nov 13 18:40:45 user nova-compute[75216]:   </os>
Nov 13 18:40:45 user nova-compute[75216]:   <cpu>
Nov 13 18:40:45 user nova-compute[75216]:     <mode name='host-passthrough' supported='yes'>
Nov 13 18:40:45 user nova-compute[75216]:       <enum name='hostPassthroughMigratable'>
Nov 13 18:40:45 user nova-compute[75216]:         <value>off</value>
Nov 13 18:40:45 user nova-compute[75216]:       </enum>
Nov 13 18:40:45 user nova-compute[75216]:     </mode>
Nov 13 18:40:45 user nova-compute[75216]:     <mode name='maximum' supported='yes'>
Nov 13 18:40:45 user nova-compute[75216]:       <enum name='maximumMigratable'>
Nov 13 18:40:45 user nova-compute[75216]:         <value>on</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>off</value>
Nov 13 18:40:45 user nova-compute[75216]:       </enum>
Nov 13 18:40:45 user nova-compute[75216]:     </mode>
Nov 13 18:40:45 user nova-compute[75216]:     <mode name='host-model' supported='yes'>
Nov 13 18:40:45 user nova-compute[75216]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 13 18:40:45 user nova-compute[75216]:       <vendor>Intel</vendor>
Nov 13 18:40:45 user nova-compute[75216]:       <feature policy='require' name='ss'/>
Nov 13 18:40:45 user nova-compute[75216]:       <feature policy='require' name='vmx'/>
Nov 13 18:40:45 user nova-compute[75216]:       <feature policy='require' name='pcid'/>
Nov 13 18:40:45 user nova-compute[75216]:       <feature policy='require' name='hypervisor'/>
Nov 13 18:40:45 user nova-compute[75216]:       <feature policy='require' name='arat'/>
Nov 13 18:40:45 user nova-compute[75216]:       <feature policy='require' name='tsc_adjust'/>
Nov 13 18:40:45 user nova-compute[75216]:       <feature policy='require' name='umip'/>
Nov 13 18:40:45 user nova-compute[75216]:       <feature policy='require' name='md-clear'/>
Nov 13 18:40:45 user nova-compute[75216]:       <feature policy='require' name='stibp'/>
Nov 13 18:40:45 user nova-compute[75216]:       <feature policy='require' name='arch-capabilities'/>
Nov 13 18:40:45 user nova-compute[75216]:       <feature policy='require' name='ssbd'/>
Nov 13 18:40:45 user nova-compute[75216]:       <feature policy='require' name='ibpb'/>
Nov 13 18:40:45 user nova-compute[75216]:       <feature policy='require' name='ibrs'/>
Nov 13 18:40:45 user nova-compute[75216]:       <feature policy='require' name='amd-stibp'/>
Nov 13 18:40:45 user nova-compute[75216]:       <feature policy='require' name='amd-ssbd'/>
Nov 13 18:40:45 user nova-compute[75216]:       <feature policy='disable' name='erms'/>
Nov 13 18:40:45 user nova-compute[75216]:       <feature policy='disable' name='xsaveopt'/>
Nov 13 18:40:45 user nova-compute[75216]:       <feature policy='disable' name='lm'/>
Nov 13 18:40:45 user nova-compute[75216]:     </mode>
Nov 13 18:40:45 user nova-compute[75216]:     <mode name='custom' supported='yes'>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>qemu64</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='yes'>qemu32</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>phenom</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='yes'>pentium3</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='yes'>pentium2</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='yes'>pentium</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>n270</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>kvm64</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='yes'>kvm32</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='yes'>coreduo</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>core2duo</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>athlon</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Westmere-IBRS</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Westmere</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Snowridge</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Skylake-Server</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Skylake-Client</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>SandyBridge</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Penryn</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Opteron_G5</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Opteron_G4</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Opteron_G3</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Opteron_G2</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Opteron_G1</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Nehalem-IBRS</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Nehalem</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>IvyBridge</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Icelake-Server</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Haswell-noTSX</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Haswell-IBRS</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Haswell</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>EPYC-Rome</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>EPYC-Milan</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>EPYC-IBPB</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>EPYC</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Dhyana</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Cooperlake</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Conroe</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Cascadelake-Server</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Broadwell-noTSX</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Broadwell-IBRS</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Broadwell</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='yes'>486</model>
Nov 13 18:40:45 user nova-compute[75216]:     </mode>
Nov 13 18:40:45 user nova-compute[75216]:   </cpu>
Nov 13 18:40:45 user nova-compute[75216]:   <memoryBacking supported='yes'>
Nov 13 18:40:45 user nova-compute[75216]:     <enum name='sourceType'>
Nov 13 18:40:45 user nova-compute[75216]:       <value>file</value>
Nov 13 18:40:45 user nova-compute[75216]:       <value>anonymous</value>
Nov 13 18:40:45 user nova-compute[75216]:       <value>memfd</value>
Nov 13 18:40:45 user nova-compute[75216]:     </enum>
Nov 13 18:40:45 user nova-compute[75216]:   </memoryBacking>
Nov 13 18:40:45 user nova-compute[75216]:   <devices>
Nov 13 18:40:45 user nova-compute[75216]:     <disk supported='yes'>
Nov 13 18:40:45 user nova-compute[75216]:       <enum name='diskDevice'>
Nov 13 18:40:45 user nova-compute[75216]:         <value>disk</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>cdrom</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>floppy</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>lun</value>
Nov 13 18:40:45 user nova-compute[75216]:       </enum>
Nov 13 18:40:45 user nova-compute[75216]:       <enum name='bus'>
Nov 13 18:40:45 user nova-compute[75216]:         <value>ide</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>fdc</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>scsi</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>virtio</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>usb</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>sata</value>
Nov 13 18:40:45 user nova-compute[75216]:       </enum>
Nov 13 18:40:45 user nova-compute[75216]:       <enum name='model'>
Nov 13 18:40:45 user nova-compute[75216]:         <value>virtio</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>virtio-transitional</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>virtio-non-transitional</value>
Nov 13 18:40:45 user nova-compute[75216]:       </enum>
Nov 13 18:40:45 user nova-compute[75216]:     </disk>
Nov 13 18:40:45 user nova-compute[75216]:     <graphics supported='yes'>
Nov 13 18:40:45 user nova-compute[75216]:       <enum name='type'>
Nov 13 18:40:45 user nova-compute[75216]:         <value>sdl</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>vnc</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>spice</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>egl-headless</value>
Nov 13 18:40:45 user nova-compute[75216]:       </enum>
Nov 13 18:40:45 user nova-compute[75216]:     </graphics>
Nov 13 18:40:45 user nova-compute[75216]:     <video supported='yes'>
Nov 13 18:40:45 user nova-compute[75216]:       <enum name='modelType'>
Nov 13 18:40:45 user nova-compute[75216]:         <value>vga</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>cirrus</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>vmvga</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>qxl</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>virtio</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>none</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>bochs</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>ramfb</value>
Nov 13 18:40:45 user nova-compute[75216]:       </enum>
Nov 13 18:40:45 user nova-compute[75216]:     </video>
Nov 13 18:40:45 user nova-compute[75216]:     <hostdev supported='yes'>
Nov 13 18:40:45 user nova-compute[75216]:       <enum name='mode'>
Nov 13 18:40:45 user nova-compute[75216]:         <value>subsystem</value>
Nov 13 18:40:45 user nova-compute[75216]:       </enum>
Nov 13 18:40:45 user nova-compute[75216]:       <enum name='startupPolicy'>
Nov 13 18:40:45 user nova-compute[75216]:         <value>default</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>mandatory</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>requisite</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>optional</value>
Nov 13 18:40:45 user nova-compute[75216]:       </enum>
Nov 13 18:40:45 user nova-compute[75216]:       <enum name='subsysType'>
Nov 13 18:40:45 user nova-compute[75216]:         <value>usb</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>pci</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>scsi</value>
Nov 13 18:40:45 user nova-compute[75216]:       </enum>
Nov 13 18:40:45 user nova-compute[75216]:       <enum name='capsType'/>
Nov 13 18:40:45 user nova-compute[75216]:       <enum name='pciBackend'/>
Nov 13 18:40:45 user nova-compute[75216]:     </hostdev>
Nov 13 18:40:45 user nova-compute[75216]:     <rng supported='yes'>
Nov 13 18:40:45 user nova-compute[75216]:       <enum name='model'>
Nov 13 18:40:45 user nova-compute[75216]:         <value>virtio</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>virtio-transitional</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>virtio-non-transitional</value>
Nov 13 18:40:45 user nova-compute[75216]:       </enum>
Nov 13 18:40:45 user nova-compute[75216]:       <enum name='backendModel'>
Nov 13 18:40:45 user nova-compute[75216]:         <value>random</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>egd</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>builtin</value>
Nov 13 18:40:45 user nova-compute[75216]:       </enum>
Nov 13 18:40:45 user nova-compute[75216]:     </rng>
Nov 13 18:40:45 user nova-compute[75216]:     <filesystem supported='yes'>
Nov 13 18:40:45 user nova-compute[75216]:       <enum name='driverType'>
Nov 13 18:40:45 user nova-compute[75216]:         <value>path</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>handle</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>virtiofs</value>
Nov 13 18:40:45 user nova-compute[75216]:       </enum>
Nov 13 18:40:45 user nova-compute[75216]:     </filesystem>
Nov 13 18:40:45 user nova-compute[75216]:     <tpm supported='yes'>
Nov 13 18:40:45 user nova-compute[75216]:       <enum name='model'>
Nov 13 18:40:45 user nova-compute[75216]:         <value>tpm-tis</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>tpm-crb</value>
Nov 13 18:40:45 user nova-compute[75216]:       </enum>
Nov 13 18:40:45 user nova-compute[75216]:       <enum name='backendModel'>
Nov 13 18:40:45 user nova-compute[75216]:         <value>passthrough</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>emulator</value>
Nov 13 18:40:45 user nova-compute[75216]:       </enum>
Nov 13 18:40:45 user nova-compute[75216]:     </tpm>
Nov 13 18:40:45 user nova-compute[75216]:   </devices>
Nov 13 18:40:45 user nova-compute[75216]:   <features>
Nov 13 18:40:45 user nova-compute[75216]:     <gic supported='no'/>
Nov 13 18:40:45 user nova-compute[75216]:     <vmcoreinfo supported='yes'/>
Nov 13 18:40:45 user nova-compute[75216]:     <genid supported='yes'/>
Nov 13 18:40:45 user nova-compute[75216]:     <backingStoreInput supported='yes'/>
Nov 13 18:40:45 user nova-compute[75216]:     <backup supported='yes'/>
Nov 13 18:40:45 user nova-compute[75216]:     <sev supported='no'/>
Nov 13 18:40:45 user nova-compute[75216]:   </features>
Nov 13 18:40:45 user nova-compute[75216]: </domainCapabilities>
Nov 13 18:40:45 user nova-compute[75216]:  {{(pid=75216) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 13 18:40:45 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-085a4235-df6a-43dd-bf96-2d3c95dda5d5 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Nov 13 18:40:45 user nova-compute[75216]: <domainCapabilities>
Nov 13 18:40:45 user nova-compute[75216]:   <path>/usr/bin/qemu-system-i386</path>
Nov 13 18:40:45 user nova-compute[75216]:   <domain>kvm</domain>
Nov 13 18:40:45 user nova-compute[75216]:   <machine>pc-i440fx-jammy</machine>
Nov 13 18:40:45 user nova-compute[75216]:   <arch>i686</arch>
Nov 13 18:40:45 user nova-compute[75216]:   <vcpu max='255'/>
Nov 13 18:40:45 user nova-compute[75216]:   <iothreads supported='yes'/>
Nov 13 18:40:45 user nova-compute[75216]:   <os supported='yes'>
Nov 13 18:40:45 user nova-compute[75216]:     <enum name='firmware'/>
Nov 13 18:40:45 user nova-compute[75216]:     <loader supported='yes'>
Nov 13 18:40:45 user nova-compute[75216]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 13 18:40:45 user nova-compute[75216]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 13 18:40:45 user nova-compute[75216]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 13 18:40:45 user nova-compute[75216]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 13 18:40:45 user nova-compute[75216]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 13 18:40:45 user nova-compute[75216]:       <enum name='type'>
Nov 13 18:40:45 user nova-compute[75216]:         <value>rom</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>pflash</value>
Nov 13 18:40:45 user nova-compute[75216]:       </enum>
Nov 13 18:40:45 user nova-compute[75216]:       <enum name='readonly'>
Nov 13 18:40:45 user nova-compute[75216]:         <value>yes</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>no</value>
Nov 13 18:40:45 user nova-compute[75216]:       </enum>
Nov 13 18:40:45 user nova-compute[75216]:       <enum name='secure'>
Nov 13 18:40:45 user nova-compute[75216]:         <value>no</value>
Nov 13 18:40:45 user nova-compute[75216]:       </enum>
Nov 13 18:40:45 user nova-compute[75216]:     </loader>
Nov 13 18:40:45 user nova-compute[75216]:   </os>
Nov 13 18:40:45 user nova-compute[75216]:   <cpu>
Nov 13 18:40:45 user nova-compute[75216]:     <mode name='host-passthrough' supported='yes'>
Nov 13 18:40:45 user nova-compute[75216]:       <enum name='hostPassthroughMigratable'>
Nov 13 18:40:45 user nova-compute[75216]:         <value>off</value>
Nov 13 18:40:45 user nova-compute[75216]:       </enum>
Nov 13 18:40:45 user nova-compute[75216]:     </mode>
Nov 13 18:40:45 user nova-compute[75216]:     <mode name='maximum' supported='yes'>
Nov 13 18:40:45 user nova-compute[75216]:       <enum name='maximumMigratable'>
Nov 13 18:40:45 user nova-compute[75216]:         <value>on</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>off</value>
Nov 13 18:40:45 user nova-compute[75216]:       </enum>
Nov 13 18:40:45 user nova-compute[75216]:     </mode>
Nov 13 18:40:45 user nova-compute[75216]:     <mode name='host-model' supported='yes'>
Nov 13 18:40:45 user nova-compute[75216]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 13 18:40:45 user nova-compute[75216]:       <vendor>Intel</vendor>
Nov 13 18:40:45 user nova-compute[75216]:       <feature policy='require' name='ss'/>
Nov 13 18:40:45 user nova-compute[75216]:       <feature policy='require' name='vmx'/>
Nov 13 18:40:45 user nova-compute[75216]:       <feature policy='require' name='pcid'/>
Nov 13 18:40:45 user nova-compute[75216]:       <feature policy='require' name='hypervisor'/>
Nov 13 18:40:45 user nova-compute[75216]:       <feature policy='require' name='arat'/>
Nov 13 18:40:45 user nova-compute[75216]:       <feature policy='require' name='tsc_adjust'/>
Nov 13 18:40:45 user nova-compute[75216]:       <feature policy='require' name='umip'/>
Nov 13 18:40:45 user nova-compute[75216]:       <feature policy='require' name='md-clear'/>
Nov 13 18:40:45 user nova-compute[75216]:       <feature policy='require' name='stibp'/>
Nov 13 18:40:45 user nova-compute[75216]:       <feature policy='require' name='arch-capabilities'/>
Nov 13 18:40:45 user nova-compute[75216]:       <feature policy='require' name='ssbd'/>
Nov 13 18:40:45 user nova-compute[75216]:       <feature policy='require' name='ibpb'/>
Nov 13 18:40:45 user nova-compute[75216]:       <feature policy='require' name='ibrs'/>
Nov 13 18:40:45 user nova-compute[75216]:       <feature policy='require' name='amd-stibp'/>
Nov 13 18:40:45 user nova-compute[75216]:       <feature policy='require' name='amd-ssbd'/>
Nov 13 18:40:45 user nova-compute[75216]:       <feature policy='disable' name='erms'/>
Nov 13 18:40:45 user nova-compute[75216]:       <feature policy='disable' name='xsaveopt'/>
Nov 13 18:40:45 user nova-compute[75216]:       <feature policy='disable' name='lm'/>
Nov 13 18:40:45 user nova-compute[75216]:     </mode>
Nov 13 18:40:45 user nova-compute[75216]:     <mode name='custom' supported='yes'>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>qemu64</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='yes'>qemu32</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>phenom</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='yes'>pentium3</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='yes'>pentium2</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='yes'>pentium</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>n270</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>kvm64</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='yes'>kvm32</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='yes'>coreduo</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>core2duo</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>athlon</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Westmere-IBRS</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Westmere</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Snowridge</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Skylake-Server</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Skylake-Client</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>SandyBridge</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Penryn</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Opteron_G5</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Opteron_G4</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Opteron_G3</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Opteron_G2</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Opteron_G1</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Nehalem-IBRS</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Nehalem</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>IvyBridge</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Icelake-Server</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Haswell-noTSX</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Haswell-IBRS</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Haswell</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>EPYC-Rome</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>EPYC-Milan</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>EPYC-IBPB</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>EPYC</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Dhyana</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Cooperlake</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Conroe</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Cascadelake-Server</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Broadwell-noTSX</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Broadwell-IBRS</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Broadwell</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='yes'>486</model>
Nov 13 18:40:45 user nova-compute[75216]:     </mode>
Nov 13 18:40:45 user nova-compute[75216]:   </cpu>
Nov 13 18:40:45 user nova-compute[75216]:   <memoryBacking supported='yes'>
Nov 13 18:40:45 user nova-compute[75216]:     <enum name='sourceType'>
Nov 13 18:40:45 user nova-compute[75216]:       <value>file</value>
Nov 13 18:40:45 user nova-compute[75216]:       <value>anonymous</value>
Nov 13 18:40:45 user nova-compute[75216]:       <value>memfd</value>
Nov 13 18:40:45 user nova-compute[75216]:     </enum>
Nov 13 18:40:45 user nova-compute[75216]:   </memoryBacking>
Nov 13 18:40:45 user nova-compute[75216]:   <devices>
Nov 13 18:40:45 user nova-compute[75216]:     <disk supported='yes'>
Nov 13 18:40:45 user nova-compute[75216]:       <enum name='diskDevice'>
Nov 13 18:40:45 user nova-compute[75216]:         <value>disk</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>cdrom</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>floppy</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>lun</value>
Nov 13 18:40:45 user nova-compute[75216]:       </enum>
Nov 13 18:40:45 user nova-compute[75216]:       <enum name='bus'>
Nov 13 18:40:45 user nova-compute[75216]:         <value>ide</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>fdc</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>scsi</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>virtio</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>usb</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>sata</value>
Nov 13 18:40:45 user nova-compute[75216]:       </enum>
Nov 13 18:40:45 user nova-compute[75216]:       <enum name='model'>
Nov 13 18:40:45 user nova-compute[75216]:         <value>virtio</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>virtio-transitional</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>virtio-non-transitional</value>
Nov 13 18:40:45 user nova-compute[75216]:       </enum>
Nov 13 18:40:45 user nova-compute[75216]:     </disk>
Nov 13 18:40:45 user nova-compute[75216]:     <graphics supported='yes'>
Nov 13 18:40:45 user nova-compute[75216]:       <enum name='type'>
Nov 13 18:40:45 user nova-compute[75216]:         <value>sdl</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>vnc</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>spice</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>egl-headless</value>
Nov 13 18:40:45 user nova-compute[75216]:       </enum>
Nov 13 18:40:45 user nova-compute[75216]:     </graphics>
Nov 13 18:40:45 user nova-compute[75216]:     <video supported='yes'>
Nov 13 18:40:45 user nova-compute[75216]:       <enum name='modelType'>
Nov 13 18:40:45 user nova-compute[75216]:         <value>vga</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>cirrus</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>vmvga</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>qxl</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>virtio</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>none</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>bochs</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>ramfb</value>
Nov 13 18:40:45 user nova-compute[75216]:       </enum>
Nov 13 18:40:45 user nova-compute[75216]:     </video>
Nov 13 18:40:45 user nova-compute[75216]:     <hostdev supported='yes'>
Nov 13 18:40:45 user nova-compute[75216]:       <enum name='mode'>
Nov 13 18:40:45 user nova-compute[75216]:         <value>subsystem</value>
Nov 13 18:40:45 user nova-compute[75216]:       </enum>
Nov 13 18:40:45 user nova-compute[75216]:       <enum name='startupPolicy'>
Nov 13 18:40:45 user nova-compute[75216]:         <value>default</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>mandatory</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>requisite</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>optional</value>
Nov 13 18:40:45 user nova-compute[75216]:       </enum>
Nov 13 18:40:45 user nova-compute[75216]:       <enum name='subsysType'>
Nov 13 18:40:45 user nova-compute[75216]:         <value>usb</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>pci</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>scsi</value>
Nov 13 18:40:45 user nova-compute[75216]:       </enum>
Nov 13 18:40:45 user nova-compute[75216]:       <enum name='capsType'/>
Nov 13 18:40:45 user nova-compute[75216]:       <enum name='pciBackend'/>
Nov 13 18:40:45 user nova-compute[75216]:     </hostdev>
Nov 13 18:40:45 user nova-compute[75216]:     <rng supported='yes'>
Nov 13 18:40:45 user nova-compute[75216]:       <enum name='model'>
Nov 13 18:40:45 user nova-compute[75216]:         <value>virtio</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>virtio-transitional</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>virtio-non-transitional</value>
Nov 13 18:40:45 user nova-compute[75216]:       </enum>
Nov 13 18:40:45 user nova-compute[75216]:       <enum name='backendModel'>
Nov 13 18:40:45 user nova-compute[75216]:         <value>random</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>egd</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>builtin</value>
Nov 13 18:40:45 user nova-compute[75216]:       </enum>
Nov 13 18:40:45 user nova-compute[75216]:     </rng>
Nov 13 18:40:45 user nova-compute[75216]:     <filesystem supported='yes'>
Nov 13 18:40:45 user nova-compute[75216]:       <enum name='driverType'>
Nov 13 18:40:45 user nova-compute[75216]:         <value>path</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>handle</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>virtiofs</value>
Nov 13 18:40:45 user nova-compute[75216]:       </enum>
Nov 13 18:40:45 user nova-compute[75216]:     </filesystem>
Nov 13 18:40:45 user nova-compute[75216]:     <tpm supported='yes'>
Nov 13 18:40:45 user nova-compute[75216]:       <enum name='model'>
Nov 13 18:40:45 user nova-compute[75216]:         <value>tpm-tis</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>tpm-crb</value>
Nov 13 18:40:45 user nova-compute[75216]:       </enum>
Nov 13 18:40:45 user nova-compute[75216]:       <enum name='backendModel'>
Nov 13 18:40:45 user nova-compute[75216]:         <value>passthrough</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>emulator</value>
Nov 13 18:40:45 user nova-compute[75216]:       </enum>
Nov 13 18:40:45 user nova-compute[75216]:     </tpm>
Nov 13 18:40:45 user nova-compute[75216]:   </devices>
Nov 13 18:40:45 user nova-compute[75216]:   <features>
Nov 13 18:40:45 user nova-compute[75216]:     <gic supported='no'/>
Nov 13 18:40:45 user nova-compute[75216]:     <vmcoreinfo supported='yes'/>
Nov 13 18:40:45 user nova-compute[75216]:     <genid supported='yes'/>
Nov 13 18:40:45 user nova-compute[75216]:     <backingStoreInput supported='yes'/>
Nov 13 18:40:45 user nova-compute[75216]:     <backup supported='yes'/>
Nov 13 18:40:45 user nova-compute[75216]:     <sev supported='no'/>
Nov 13 18:40:45 user nova-compute[75216]:   </features>
Nov 13 18:40:45 user nova-compute[75216]: </domainCapabilities>
Nov 13 18:40:45 user nova-compute[75216]:  {{(pid=75216) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 13 18:40:45 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-085a4235-df6a-43dd-bf96-2d3c95dda5d5 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Nov 13 18:40:45 user nova-compute[75216]: <domainCapabilities>
Nov 13 18:40:45 user nova-compute[75216]:   <path>/usr/bin/qemu-system-i386</path>
Nov 13 18:40:45 user nova-compute[75216]:   <domain>kvm</domain>
Nov 13 18:40:45 user nova-compute[75216]:   <machine>pc-q35-6.2</machine>
Nov 13 18:40:45 user nova-compute[75216]:   <arch>i686</arch>
Nov 13 18:40:45 user nova-compute[75216]:   <vcpu max='288'/>
Nov 13 18:40:45 user nova-compute[75216]:   <iothreads supported='yes'/>
Nov 13 18:40:45 user nova-compute[75216]:   <os supported='yes'>
Nov 13 18:40:45 user nova-compute[75216]:     <enum name='firmware'/>
Nov 13 18:40:45 user nova-compute[75216]:     <loader supported='yes'>
Nov 13 18:40:45 user nova-compute[75216]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 13 18:40:45 user nova-compute[75216]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 13 18:40:45 user nova-compute[75216]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 13 18:40:45 user nova-compute[75216]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 13 18:40:45 user nova-compute[75216]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 13 18:40:45 user nova-compute[75216]:       <enum name='type'>
Nov 13 18:40:45 user nova-compute[75216]:         <value>rom</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>pflash</value>
Nov 13 18:40:45 user nova-compute[75216]:       </enum>
Nov 13 18:40:45 user nova-compute[75216]:       <enum name='readonly'>
Nov 13 18:40:45 user nova-compute[75216]:         <value>yes</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>no</value>
Nov 13 18:40:45 user nova-compute[75216]:       </enum>
Nov 13 18:40:45 user nova-compute[75216]:       <enum name='secure'>
Nov 13 18:40:45 user nova-compute[75216]:         <value>no</value>
Nov 13 18:40:45 user nova-compute[75216]:       </enum>
Nov 13 18:40:45 user nova-compute[75216]:     </loader>
Nov 13 18:40:45 user nova-compute[75216]:   </os>
Nov 13 18:40:45 user nova-compute[75216]:   <cpu>
Nov 13 18:40:45 user nova-compute[75216]:     <mode name='host-passthrough' supported='yes'>
Nov 13 18:40:45 user nova-compute[75216]:       <enum name='hostPassthroughMigratable'>
Nov 13 18:40:45 user nova-compute[75216]:         <value>off</value>
Nov 13 18:40:45 user nova-compute[75216]:       </enum>
Nov 13 18:40:45 user nova-compute[75216]:     </mode>
Nov 13 18:40:45 user nova-compute[75216]:     <mode name='maximum' supported='yes'>
Nov 13 18:40:45 user nova-compute[75216]:       <enum name='maximumMigratable'>
Nov 13 18:40:45 user nova-compute[75216]:         <value>on</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>off</value>
Nov 13 18:40:45 user nova-compute[75216]:       </enum>
Nov 13 18:40:45 user nova-compute[75216]:     </mode>
Nov 13 18:40:45 user nova-compute[75216]:     <mode name='host-model' supported='yes'>
Nov 13 18:40:45 user nova-compute[75216]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 13 18:40:45 user nova-compute[75216]:       <vendor>Intel</vendor>
Nov 13 18:40:45 user nova-compute[75216]:       <feature policy='require' name='ss'/>
Nov 13 18:40:45 user nova-compute[75216]:       <feature policy='require' name='vmx'/>
Nov 13 18:40:45 user nova-compute[75216]:       <feature policy='require' name='pcid'/>
Nov 13 18:40:45 user nova-compute[75216]:       <feature policy='require' name='hypervisor'/>
Nov 13 18:40:45 user nova-compute[75216]:       <feature policy='require' name='arat'/>
Nov 13 18:40:45 user nova-compute[75216]:       <feature policy='require' name='tsc_adjust'/>
Nov 13 18:40:45 user nova-compute[75216]:       <feature policy='require' name='umip'/>
Nov 13 18:40:45 user nova-compute[75216]:       <feature policy='require' name='md-clear'/>
Nov 13 18:40:45 user nova-compute[75216]:       <feature policy='require' name='stibp'/>
Nov 13 18:40:45 user nova-compute[75216]:       <feature policy='require' name='arch-capabilities'/>
Nov 13 18:40:45 user nova-compute[75216]:       <feature policy='require' name='ssbd'/>
Nov 13 18:40:45 user nova-compute[75216]:       <feature policy='require' name='ibpb'/>
Nov 13 18:40:45 user nova-compute[75216]:       <feature policy='require' name='ibrs'/>
Nov 13 18:40:45 user nova-compute[75216]:       <feature policy='require' name='amd-stibp'/>
Nov 13 18:40:45 user nova-compute[75216]:       <feature policy='require' name='amd-ssbd'/>
Nov 13 18:40:45 user nova-compute[75216]:       <feature policy='disable' name='erms'/>
Nov 13 18:40:45 user nova-compute[75216]:       <feature policy='disable' name='xsaveopt'/>
Nov 13 18:40:45 user nova-compute[75216]:       <feature policy='disable' name='lm'/>
Nov 13 18:40:45 user nova-compute[75216]:     </mode>
Nov 13 18:40:45 user nova-compute[75216]:     <mode name='custom' supported='yes'>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>qemu64</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='yes'>qemu32</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>phenom</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='yes'>pentium3</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='yes'>pentium2</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='yes'>pentium</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>n270</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>kvm64</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='yes'>kvm32</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='yes'>coreduo</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>core2duo</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>athlon</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Westmere-IBRS</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Westmere</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Snowridge</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Skylake-Server</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Skylake-Client</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>SandyBridge</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Penryn</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Opteron_G5</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Opteron_G4</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Opteron_G3</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Opteron_G2</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Opteron_G1</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Nehalem-IBRS</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Nehalem</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>IvyBridge</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Icelake-Server</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Haswell-noTSX</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Haswell-IBRS</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Haswell</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>EPYC-Rome</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>EPYC-Milan</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>EPYC-IBPB</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>EPYC</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Dhyana</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Cooperlake</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Conroe</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Cascadelake-Server</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Broadwell-noTSX</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Broadwell-IBRS</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Broadwell</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='yes'>486</model>
Nov 13 18:40:45 user nova-compute[75216]:     </mode>
Nov 13 18:40:45 user nova-compute[75216]:   </cpu>
Nov 13 18:40:45 user nova-compute[75216]:   <memoryBacking supported='yes'>
Nov 13 18:40:45 user nova-compute[75216]:     <enum name='sourceType'>
Nov 13 18:40:45 user nova-compute[75216]:       <value>file</value>
Nov 13 18:40:45 user nova-compute[75216]:       <value>anonymous</value>
Nov 13 18:40:45 user nova-compute[75216]:       <value>memfd</value>
Nov 13 18:40:45 user nova-compute[75216]:     </enum>
Nov 13 18:40:45 user nova-compute[75216]:   </memoryBacking>
Nov 13 18:40:45 user nova-compute[75216]:   <devices>
Nov 13 18:40:45 user nova-compute[75216]:     <disk supported='yes'>
Nov 13 18:40:45 user nova-compute[75216]:       <enum name='diskDevice'>
Nov 13 18:40:45 user nova-compute[75216]:         <value>disk</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>cdrom</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>floppy</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>lun</value>
Nov 13 18:40:45 user nova-compute[75216]:       </enum>
Nov 13 18:40:45 user nova-compute[75216]:       <enum name='bus'>
Nov 13 18:40:45 user nova-compute[75216]:         <value>fdc</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>scsi</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>virtio</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>usb</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>sata</value>
Nov 13 18:40:45 user nova-compute[75216]:       </enum>
Nov 13 18:40:45 user nova-compute[75216]:       <enum name='model'>
Nov 13 18:40:45 user nova-compute[75216]:         <value>virtio</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>virtio-transitional</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>virtio-non-transitional</value>
Nov 13 18:40:45 user nova-compute[75216]:       </enum>
Nov 13 18:40:45 user nova-compute[75216]:     </disk>
Nov 13 18:40:45 user nova-compute[75216]:     <graphics supported='yes'>
Nov 13 18:40:45 user nova-compute[75216]:       <enum name='type'>
Nov 13 18:40:45 user nova-compute[75216]:         <value>sdl</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>vnc</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>spice</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>egl-headless</value>
Nov 13 18:40:45 user nova-compute[75216]:       </enum>
Nov 13 18:40:45 user nova-compute[75216]:     </graphics>
Nov 13 18:40:45 user nova-compute[75216]:     <video supported='yes'>
Nov 13 18:40:45 user nova-compute[75216]:       <enum name='modelType'>
Nov 13 18:40:45 user nova-compute[75216]:         <value>vga</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>cirrus</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>vmvga</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>qxl</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>virtio</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>none</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>bochs</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>ramfb</value>
Nov 13 18:40:45 user nova-compute[75216]:       </enum>
Nov 13 18:40:45 user nova-compute[75216]:     </video>
Nov 13 18:40:45 user nova-compute[75216]:     <hostdev supported='yes'>
Nov 13 18:40:45 user nova-compute[75216]:       <enum name='mode'>
Nov 13 18:40:45 user nova-compute[75216]:         <value>subsystem</value>
Nov 13 18:40:45 user nova-compute[75216]:       </enum>
Nov 13 18:40:45 user nova-compute[75216]:       <enum name='startupPolicy'>
Nov 13 18:40:45 user nova-compute[75216]:         <value>default</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>mandatory</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>requisite</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>optional</value>
Nov 13 18:40:45 user nova-compute[75216]:       </enum>
Nov 13 18:40:45 user nova-compute[75216]:       <enum name='subsysType'>
Nov 13 18:40:45 user nova-compute[75216]:         <value>usb</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>pci</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>scsi</value>
Nov 13 18:40:45 user nova-compute[75216]:       </enum>
Nov 13 18:40:45 user nova-compute[75216]:       <enum name='capsType'/>
Nov 13 18:40:45 user nova-compute[75216]:       <enum name='pciBackend'/>
Nov 13 18:40:45 user nova-compute[75216]:     </hostdev>
Nov 13 18:40:45 user nova-compute[75216]:     <rng supported='yes'>
Nov 13 18:40:45 user nova-compute[75216]:       <enum name='model'>
Nov 13 18:40:45 user nova-compute[75216]:         <value>virtio</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>virtio-transitional</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>virtio-non-transitional</value>
Nov 13 18:40:45 user nova-compute[75216]:       </enum>
Nov 13 18:40:45 user nova-compute[75216]:       <enum name='backendModel'>
Nov 13 18:40:45 user nova-compute[75216]:         <value>random</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>egd</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>builtin</value>
Nov 13 18:40:45 user nova-compute[75216]:       </enum>
Nov 13 18:40:45 user nova-compute[75216]:     </rng>
Nov 13 18:40:45 user nova-compute[75216]:     <filesystem supported='yes'>
Nov 13 18:40:45 user nova-compute[75216]:       <enum name='driverType'>
Nov 13 18:40:45 user nova-compute[75216]:         <value>path</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>handle</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>virtiofs</value>
Nov 13 18:40:45 user nova-compute[75216]:       </enum>
Nov 13 18:40:45 user nova-compute[75216]:     </filesystem>
Nov 13 18:40:45 user nova-compute[75216]:     <tpm supported='yes'>
Nov 13 18:40:45 user nova-compute[75216]:       <enum name='model'>
Nov 13 18:40:45 user nova-compute[75216]:         <value>tpm-tis</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>tpm-crb</value>
Nov 13 18:40:45 user nova-compute[75216]:       </enum>
Nov 13 18:40:45 user nova-compute[75216]:       <enum name='backendModel'>
Nov 13 18:40:45 user nova-compute[75216]:         <value>passthrough</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>emulator</value>
Nov 13 18:40:45 user nova-compute[75216]:       </enum>
Nov 13 18:40:45 user nova-compute[75216]:     </tpm>
Nov 13 18:40:45 user nova-compute[75216]:   </devices>
Nov 13 18:40:45 user nova-compute[75216]:   <features>
Nov 13 18:40:45 user nova-compute[75216]:     <gic supported='no'/>
Nov 13 18:40:45 user nova-compute[75216]:     <vmcoreinfo supported='yes'/>
Nov 13 18:40:45 user nova-compute[75216]:     <genid supported='yes'/>
Nov 13 18:40:45 user nova-compute[75216]:     <backingStoreInput supported='yes'/>
Nov 13 18:40:45 user nova-compute[75216]:     <backup supported='yes'/>
Nov 13 18:40:45 user nova-compute[75216]:     <sev supported='no'/>
Nov 13 18:40:45 user nova-compute[75216]:   </features>
Nov 13 18:40:45 user nova-compute[75216]: </domainCapabilities>
Nov 13 18:40:45 user nova-compute[75216]:  {{(pid=75216) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 13 18:40:45 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-085a4235-df6a-43dd-bf96-2d3c95dda5d5 None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=75216) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 13 18:40:45 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-085a4235-df6a-43dd-bf96-2d3c95dda5d5 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=75216) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 13 18:40:45 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-085a4235-df6a-43dd-bf96-2d3c95dda5d5 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=75216) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 13 18:40:45 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-085a4235-df6a-43dd-bf96-2d3c95dda5d5 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=75216) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 13 18:40:45 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-085a4235-df6a-43dd-bf96-2d3c95dda5d5 None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=75216) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 13 18:40:45 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-085a4235-df6a-43dd-bf96-2d3c95dda5d5 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=75216) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 13 18:40:45 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-085a4235-df6a-43dd-bf96-2d3c95dda5d5 None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=75216) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 13 18:40:45 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-085a4235-df6a-43dd-bf96-2d3c95dda5d5 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=75216) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 13 18:40:45 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-085a4235-df6a-43dd-bf96-2d3c95dda5d5 None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=75216) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 13 18:40:45 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-085a4235-df6a-43dd-bf96-2d3c95dda5d5 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=75216) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 13 18:40:45 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-085a4235-df6a-43dd-bf96-2d3c95dda5d5 None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=75216) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 13 18:40:45 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-085a4235-df6a-43dd-bf96-2d3c95dda5d5 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=75216) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 13 18:40:45 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-085a4235-df6a-43dd-bf96-2d3c95dda5d5 None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=75216) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 13 18:40:45 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-085a4235-df6a-43dd-bf96-2d3c95dda5d5 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=75216) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 13 18:40:45 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-085a4235-df6a-43dd-bf96-2d3c95dda5d5 None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=75216) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 13 18:40:45 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-085a4235-df6a-43dd-bf96-2d3c95dda5d5 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=75216) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 13 18:40:45 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-085a4235-df6a-43dd-bf96-2d3c95dda5d5 None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=75216) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 13 18:40:45 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-085a4235-df6a-43dd-bf96-2d3c95dda5d5 None None] Getting domain capabilities for ppc64 via machine types: {'pseries', 'powernv', None} {{(pid=75216) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 13 18:40:45 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-085a4235-df6a-43dd-bf96-2d3c95dda5d5 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75216) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 13 18:40:45 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-085a4235-df6a-43dd-bf96-2d3c95dda5d5 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75216) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 13 18:40:45 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-085a4235-df6a-43dd-bf96-2d3c95dda5d5 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75216) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 13 18:40:45 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-085a4235-df6a-43dd-bf96-2d3c95dda5d5 None None] Getting domain capabilities for ppc64le via machine types: {'pseries', 'powernv'} {{(pid=75216) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 13 18:40:45 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-085a4235-df6a-43dd-bf96-2d3c95dda5d5 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=75216) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 13 18:40:45 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-085a4235-df6a-43dd-bf96-2d3c95dda5d5 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=75216) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 13 18:40:45 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-085a4235-df6a-43dd-bf96-2d3c95dda5d5 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=75216) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 13 18:40:45 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-085a4235-df6a-43dd-bf96-2d3c95dda5d5 None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=75216) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 13 18:40:45 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-085a4235-df6a-43dd-bf96-2d3c95dda5d5 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=75216) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 13 18:40:45 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-085a4235-df6a-43dd-bf96-2d3c95dda5d5 None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=75216) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 13 18:40:45 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-085a4235-df6a-43dd-bf96-2d3c95dda5d5 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=75216) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 13 18:40:45 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-085a4235-df6a-43dd-bf96-2d3c95dda5d5 None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=75216) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 13 18:40:45 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-085a4235-df6a-43dd-bf96-2d3c95dda5d5 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=75216) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 13 18:40:45 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-085a4235-df6a-43dd-bf96-2d3c95dda5d5 None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=75216) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 13 18:40:45 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-085a4235-df6a-43dd-bf96-2d3c95dda5d5 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=75216) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 13 18:40:45 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-085a4235-df6a-43dd-bf96-2d3c95dda5d5 None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=75216) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 13 18:40:45 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-085a4235-df6a-43dd-bf96-2d3c95dda5d5 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=75216) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 13 18:40:45 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-085a4235-df6a-43dd-bf96-2d3c95dda5d5 None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=75216) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 13 18:40:45 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-085a4235-df6a-43dd-bf96-2d3c95dda5d5 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=75216) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 13 18:40:45 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-085a4235-df6a-43dd-bf96-2d3c95dda5d5 None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=75216) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 13 18:40:45 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-085a4235-df6a-43dd-bf96-2d3c95dda5d5 None None] Getting domain capabilities for x86_64 via machine types: {'ubuntu-q35', 'pc', 'ubuntu', 'q35'} {{(pid=75216) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 13 18:40:45 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-085a4235-df6a-43dd-bf96-2d3c95dda5d5 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Nov 13 18:40:45 user nova-compute[75216]: <domainCapabilities>
Nov 13 18:40:45 user nova-compute[75216]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 13 18:40:45 user nova-compute[75216]:   <domain>kvm</domain>
Nov 13 18:40:45 user nova-compute[75216]:   <machine>pc-q35-jammy</machine>
Nov 13 18:40:45 user nova-compute[75216]:   <arch>x86_64</arch>
Nov 13 18:40:45 user nova-compute[75216]:   <vcpu max='288'/>
Nov 13 18:40:45 user nova-compute[75216]:   <iothreads supported='yes'/>
Nov 13 18:40:45 user nova-compute[75216]:   <os supported='yes'>
Nov 13 18:40:45 user nova-compute[75216]:     <enum name='firmware'>
Nov 13 18:40:45 user nova-compute[75216]:       <value>efi</value>
Nov 13 18:40:45 user nova-compute[75216]:     </enum>
Nov 13 18:40:45 user nova-compute[75216]:     <loader supported='yes'>
Nov 13 18:40:45 user nova-compute[75216]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 13 18:40:45 user nova-compute[75216]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 13 18:40:45 user nova-compute[75216]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 13 18:40:45 user nova-compute[75216]:       <enum name='type'>
Nov 13 18:40:45 user nova-compute[75216]:         <value>rom</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>pflash</value>
Nov 13 18:40:45 user nova-compute[75216]:       </enum>
Nov 13 18:40:45 user nova-compute[75216]:       <enum name='readonly'>
Nov 13 18:40:45 user nova-compute[75216]:         <value>yes</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>no</value>
Nov 13 18:40:45 user nova-compute[75216]:       </enum>
Nov 13 18:40:45 user nova-compute[75216]:       <enum name='secure'>
Nov 13 18:40:45 user nova-compute[75216]:         <value>yes</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>no</value>
Nov 13 18:40:45 user nova-compute[75216]:       </enum>
Nov 13 18:40:45 user nova-compute[75216]:     </loader>
Nov 13 18:40:45 user nova-compute[75216]:   </os>
Nov 13 18:40:45 user nova-compute[75216]:   <cpu>
Nov 13 18:40:45 user nova-compute[75216]:     <mode name='host-passthrough' supported='yes'>
Nov 13 18:40:45 user nova-compute[75216]:       <enum name='hostPassthroughMigratable'>
Nov 13 18:40:45 user nova-compute[75216]:         <value>on</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>off</value>
Nov 13 18:40:45 user nova-compute[75216]:       </enum>
Nov 13 18:40:45 user nova-compute[75216]:     </mode>
Nov 13 18:40:45 user nova-compute[75216]:     <mode name='maximum' supported='yes'>
Nov 13 18:40:45 user nova-compute[75216]:       <enum name='maximumMigratable'>
Nov 13 18:40:45 user nova-compute[75216]:         <value>on</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>off</value>
Nov 13 18:40:45 user nova-compute[75216]:       </enum>
Nov 13 18:40:45 user nova-compute[75216]:     </mode>
Nov 13 18:40:45 user nova-compute[75216]:     <mode name='host-model' supported='yes'>
Nov 13 18:40:45 user nova-compute[75216]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 13 18:40:45 user nova-compute[75216]:       <vendor>Intel</vendor>
Nov 13 18:40:45 user nova-compute[75216]:       <feature policy='require' name='ss'/>
Nov 13 18:40:45 user nova-compute[75216]:       <feature policy='require' name='vmx'/>
Nov 13 18:40:45 user nova-compute[75216]:       <feature policy='require' name='pcid'/>
Nov 13 18:40:45 user nova-compute[75216]:       <feature policy='require' name='hypervisor'/>
Nov 13 18:40:45 user nova-compute[75216]:       <feature policy='require' name='arat'/>
Nov 13 18:40:45 user nova-compute[75216]:       <feature policy='require' name='tsc_adjust'/>
Nov 13 18:40:45 user nova-compute[75216]:       <feature policy='require' name='umip'/>
Nov 13 18:40:45 user nova-compute[75216]:       <feature policy='require' name='md-clear'/>
Nov 13 18:40:45 user nova-compute[75216]:       <feature policy='require' name='stibp'/>
Nov 13 18:40:45 user nova-compute[75216]:       <feature policy='require' name='arch-capabilities'/>
Nov 13 18:40:45 user nova-compute[75216]:       <feature policy='require' name='ssbd'/>
Nov 13 18:40:45 user nova-compute[75216]:       <feature policy='require' name='invtsc'/>
Nov 13 18:40:45 user nova-compute[75216]:       <feature policy='require' name='ibpb'/>
Nov 13 18:40:45 user nova-compute[75216]:       <feature policy='require' name='ibrs'/>
Nov 13 18:40:45 user nova-compute[75216]:       <feature policy='require' name='amd-stibp'/>
Nov 13 18:40:45 user nova-compute[75216]:       <feature policy='require' name='amd-ssbd'/>
Nov 13 18:40:45 user nova-compute[75216]:       <feature policy='require' name='rsba'/>
Nov 13 18:40:45 user nova-compute[75216]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 13 18:40:45 user nova-compute[75216]:       <feature policy='require' name='pschange-mc-no'/>
Nov 13 18:40:45 user nova-compute[75216]:       <feature policy='disable' name='erms'/>
Nov 13 18:40:45 user nova-compute[75216]:       <feature policy='disable' name='xsaveopt'/>
Nov 13 18:40:45 user nova-compute[75216]:     </mode>
Nov 13 18:40:45 user nova-compute[75216]:     <mode name='custom' supported='yes'>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>qemu64</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='yes'>qemu32</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>phenom</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='yes'>pentium3</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='yes'>pentium2</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='yes'>pentium</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>n270</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='yes'>kvm64</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='yes'>kvm32</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='yes'>coreduo</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='yes'>core2duo</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>athlon</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='yes'>Westmere-IBRS</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='yes'>Westmere</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Snowridge</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Skylake-Server</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Skylake-Client</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>SandyBridge</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='yes'>Penryn</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Opteron_G5</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Opteron_G4</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Opteron_G3</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Opteron_G2</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='yes'>Opteron_G1</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='yes'>Nehalem</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>IvyBridge</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Icelake-Server</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Haswell-noTSX</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Haswell-IBRS</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Haswell</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>EPYC-Rome</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>EPYC-Milan</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>EPYC-IBPB</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>EPYC</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Dhyana</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Cooperlake</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='yes'>Conroe</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Cascadelake-Server</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Broadwell-noTSX</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Broadwell-IBRS</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Broadwell</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='yes'>486</model>
Nov 13 18:40:45 user nova-compute[75216]:     </mode>
Nov 13 18:40:45 user nova-compute[75216]:   </cpu>
Nov 13 18:40:45 user nova-compute[75216]:   <memoryBacking supported='yes'>
Nov 13 18:40:45 user nova-compute[75216]:     <enum name='sourceType'>
Nov 13 18:40:45 user nova-compute[75216]:       <value>file</value>
Nov 13 18:40:45 user nova-compute[75216]:       <value>anonymous</value>
Nov 13 18:40:45 user nova-compute[75216]:       <value>memfd</value>
Nov 13 18:40:45 user nova-compute[75216]:     </enum>
Nov 13 18:40:45 user nova-compute[75216]:   </memoryBacking>
Nov 13 18:40:45 user nova-compute[75216]:   <devices>
Nov 13 18:40:45 user nova-compute[75216]:     <disk supported='yes'>
Nov 13 18:40:45 user nova-compute[75216]:       <enum name='diskDevice'>
Nov 13 18:40:45 user nova-compute[75216]:         <value>disk</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>cdrom</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>floppy</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>lun</value>
Nov 13 18:40:45 user nova-compute[75216]:       </enum>
Nov 13 18:40:45 user nova-compute[75216]:       <enum name='bus'>
Nov 13 18:40:45 user nova-compute[75216]:         <value>fdc</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>scsi</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>virtio</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>usb</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>sata</value>
Nov 13 18:40:45 user nova-compute[75216]:       </enum>
Nov 13 18:40:45 user nova-compute[75216]:       <enum name='model'>
Nov 13 18:40:45 user nova-compute[75216]:         <value>virtio</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>virtio-transitional</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>virtio-non-transitional</value>
Nov 13 18:40:45 user nova-compute[75216]:       </enum>
Nov 13 18:40:45 user nova-compute[75216]:     </disk>
Nov 13 18:40:45 user nova-compute[75216]:     <graphics supported='yes'>
Nov 13 18:40:45 user nova-compute[75216]:       <enum name='type'>
Nov 13 18:40:45 user nova-compute[75216]:         <value>sdl</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>vnc</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>spice</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>egl-headless</value>
Nov 13 18:40:45 user nova-compute[75216]:       </enum>
Nov 13 18:40:45 user nova-compute[75216]:     </graphics>
Nov 13 18:40:45 user nova-compute[75216]:     <video supported='yes'>
Nov 13 18:40:45 user nova-compute[75216]:       <enum name='modelType'>
Nov 13 18:40:45 user nova-compute[75216]:         <value>vga</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>cirrus</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>vmvga</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>qxl</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>virtio</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>none</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>bochs</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>ramfb</value>
Nov 13 18:40:45 user nova-compute[75216]:       </enum>
Nov 13 18:40:45 user nova-compute[75216]:     </video>
Nov 13 18:40:45 user nova-compute[75216]:     <hostdev supported='yes'>
Nov 13 18:40:45 user nova-compute[75216]:       <enum name='mode'>
Nov 13 18:40:45 user nova-compute[75216]:         <value>subsystem</value>
Nov 13 18:40:45 user nova-compute[75216]:       </enum>
Nov 13 18:40:45 user nova-compute[75216]:       <enum name='startupPolicy'>
Nov 13 18:40:45 user nova-compute[75216]:         <value>default</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>mandatory</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>requisite</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>optional</value>
Nov 13 18:40:45 user nova-compute[75216]:       </enum>
Nov 13 18:40:45 user nova-compute[75216]:       <enum name='subsysType'>
Nov 13 18:40:45 user nova-compute[75216]:         <value>usb</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>pci</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>scsi</value>
Nov 13 18:40:45 user nova-compute[75216]:       </enum>
Nov 13 18:40:45 user nova-compute[75216]:       <enum name='capsType'/>
Nov 13 18:40:45 user nova-compute[75216]:       <enum name='pciBackend'/>
Nov 13 18:40:45 user nova-compute[75216]:     </hostdev>
Nov 13 18:40:45 user nova-compute[75216]:     <rng supported='yes'>
Nov 13 18:40:45 user nova-compute[75216]:       <enum name='model'>
Nov 13 18:40:45 user nova-compute[75216]:         <value>virtio</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>virtio-transitional</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>virtio-non-transitional</value>
Nov 13 18:40:45 user nova-compute[75216]:       </enum>
Nov 13 18:40:45 user nova-compute[75216]:       <enum name='backendModel'>
Nov 13 18:40:45 user nova-compute[75216]:         <value>random</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>egd</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>builtin</value>
Nov 13 18:40:45 user nova-compute[75216]:       </enum>
Nov 13 18:40:45 user nova-compute[75216]:     </rng>
Nov 13 18:40:45 user nova-compute[75216]:     <filesystem supported='yes'>
Nov 13 18:40:45 user nova-compute[75216]:       <enum name='driverType'>
Nov 13 18:40:45 user nova-compute[75216]:         <value>path</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>handle</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>virtiofs</value>
Nov 13 18:40:45 user nova-compute[75216]:       </enum>
Nov 13 18:40:45 user nova-compute[75216]:     </filesystem>
Nov 13 18:40:45 user nova-compute[75216]:     <tpm supported='yes'>
Nov 13 18:40:45 user nova-compute[75216]:       <enum name='model'>
Nov 13 18:40:45 user nova-compute[75216]:         <value>tpm-tis</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>tpm-crb</value>
Nov 13 18:40:45 user nova-compute[75216]:       </enum>
Nov 13 18:40:45 user nova-compute[75216]:       <enum name='backendModel'>
Nov 13 18:40:45 user nova-compute[75216]:         <value>passthrough</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>emulator</value>
Nov 13 18:40:45 user nova-compute[75216]:       </enum>
Nov 13 18:40:45 user nova-compute[75216]:     </tpm>
Nov 13 18:40:45 user nova-compute[75216]:   </devices>
Nov 13 18:40:45 user nova-compute[75216]:   <features>
Nov 13 18:40:45 user nova-compute[75216]:     <gic supported='no'/>
Nov 13 18:40:45 user nova-compute[75216]:     <vmcoreinfo supported='yes'/>
Nov 13 18:40:45 user nova-compute[75216]:     <genid supported='yes'/>
Nov 13 18:40:45 user nova-compute[75216]:     <backingStoreInput supported='yes'/>
Nov 13 18:40:45 user nova-compute[75216]:     <backup supported='yes'/>
Nov 13 18:40:45 user nova-compute[75216]:     <sev supported='no'/>
Nov 13 18:40:45 user nova-compute[75216]:   </features>
Nov 13 18:40:45 user nova-compute[75216]: </domainCapabilities>
Nov 13 18:40:45 user nova-compute[75216]:  {{(pid=75216) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 13 18:40:45 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-085a4235-df6a-43dd-bf96-2d3c95dda5d5 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Nov 13 18:40:45 user nova-compute[75216]: <domainCapabilities>
Nov 13 18:40:45 user nova-compute[75216]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 13 18:40:45 user nova-compute[75216]:   <domain>kvm</domain>
Nov 13 18:40:45 user nova-compute[75216]:   <machine>pc-i440fx-6.2</machine>
Nov 13 18:40:45 user nova-compute[75216]:   <arch>x86_64</arch>
Nov 13 18:40:45 user nova-compute[75216]:   <vcpu max='255'/>
Nov 13 18:40:45 user nova-compute[75216]:   <iothreads supported='yes'/>
Nov 13 18:40:45 user nova-compute[75216]:   <os supported='yes'>
Nov 13 18:40:45 user nova-compute[75216]:     <enum name='firmware'>
Nov 13 18:40:45 user nova-compute[75216]:       <value>efi</value>
Nov 13 18:40:45 user nova-compute[75216]:     </enum>
Nov 13 18:40:45 user nova-compute[75216]:     <loader supported='yes'>
Nov 13 18:40:45 user nova-compute[75216]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 13 18:40:45 user nova-compute[75216]:       <enum name='type'>
Nov 13 18:40:45 user nova-compute[75216]:         <value>rom</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>pflash</value>
Nov 13 18:40:45 user nova-compute[75216]:       </enum>
Nov 13 18:40:45 user nova-compute[75216]:       <enum name='readonly'>
Nov 13 18:40:45 user nova-compute[75216]:         <value>yes</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>no</value>
Nov 13 18:40:45 user nova-compute[75216]:       </enum>
Nov 13 18:40:45 user nova-compute[75216]:       <enum name='secure'>
Nov 13 18:40:45 user nova-compute[75216]:         <value>no</value>
Nov 13 18:40:45 user nova-compute[75216]:       </enum>
Nov 13 18:40:45 user nova-compute[75216]:     </loader>
Nov 13 18:40:45 user nova-compute[75216]:   </os>
Nov 13 18:40:45 user nova-compute[75216]:   <cpu>
Nov 13 18:40:45 user nova-compute[75216]:     <mode name='host-passthrough' supported='yes'>
Nov 13 18:40:45 user nova-compute[75216]:       <enum name='hostPassthroughMigratable'>
Nov 13 18:40:45 user nova-compute[75216]:         <value>on</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>off</value>
Nov 13 18:40:45 user nova-compute[75216]:       </enum>
Nov 13 18:40:45 user nova-compute[75216]:     </mode>
Nov 13 18:40:45 user nova-compute[75216]:     <mode name='maximum' supported='yes'>
Nov 13 18:40:45 user nova-compute[75216]:       <enum name='maximumMigratable'>
Nov 13 18:40:45 user nova-compute[75216]:         <value>on</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>off</value>
Nov 13 18:40:45 user nova-compute[75216]:       </enum>
Nov 13 18:40:45 user nova-compute[75216]:     </mode>
Nov 13 18:40:45 user nova-compute[75216]:     <mode name='host-model' supported='yes'>
Nov 13 18:40:45 user nova-compute[75216]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 13 18:40:45 user nova-compute[75216]:       <vendor>Intel</vendor>
Nov 13 18:40:45 user nova-compute[75216]:       <feature policy='require' name='ss'/>
Nov 13 18:40:45 user nova-compute[75216]:       <feature policy='require' name='vmx'/>
Nov 13 18:40:45 user nova-compute[75216]:       <feature policy='require' name='pcid'/>
Nov 13 18:40:45 user nova-compute[75216]:       <feature policy='require' name='hypervisor'/>
Nov 13 18:40:45 user nova-compute[75216]:       <feature policy='require' name='arat'/>
Nov 13 18:40:45 user nova-compute[75216]:       <feature policy='require' name='tsc_adjust'/>
Nov 13 18:40:45 user nova-compute[75216]:       <feature policy='require' name='umip'/>
Nov 13 18:40:45 user nova-compute[75216]:       <feature policy='require' name='md-clear'/>
Nov 13 18:40:45 user nova-compute[75216]:       <feature policy='require' name='stibp'/>
Nov 13 18:40:45 user nova-compute[75216]:       <feature policy='require' name='arch-capabilities'/>
Nov 13 18:40:45 user nova-compute[75216]:       <feature policy='require' name='ssbd'/>
Nov 13 18:40:45 user nova-compute[75216]:       <feature policy='require' name='invtsc'/>
Nov 13 18:40:45 user nova-compute[75216]:       <feature policy='require' name='ibpb'/>
Nov 13 18:40:45 user nova-compute[75216]:       <feature policy='require' name='ibrs'/>
Nov 13 18:40:45 user nova-compute[75216]:       <feature policy='require' name='amd-stibp'/>
Nov 13 18:40:45 user nova-compute[75216]:       <feature policy='require' name='amd-ssbd'/>
Nov 13 18:40:45 user nova-compute[75216]:       <feature policy='require' name='rsba'/>
Nov 13 18:40:45 user nova-compute[75216]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 13 18:40:45 user nova-compute[75216]:       <feature policy='require' name='pschange-mc-no'/>
Nov 13 18:40:45 user nova-compute[75216]:       <feature policy='disable' name='erms'/>
Nov 13 18:40:45 user nova-compute[75216]:       <feature policy='disable' name='xsaveopt'/>
Nov 13 18:40:45 user nova-compute[75216]:     </mode>
Nov 13 18:40:45 user nova-compute[75216]:     <mode name='custom' supported='yes'>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>qemu64</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='yes'>qemu32</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>phenom</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='yes'>pentium3</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='yes'>pentium2</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='yes'>pentium</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>n270</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='yes'>kvm64</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='yes'>kvm32</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='yes'>coreduo</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='yes'>core2duo</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>athlon</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='yes'>Westmere-IBRS</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='yes'>Westmere</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Snowridge</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Skylake-Server</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Skylake-Client</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>SandyBridge</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='yes'>Penryn</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Opteron_G5</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Opteron_G4</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Opteron_G3</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Opteron_G2</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='yes'>Opteron_G1</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='yes'>Nehalem</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>IvyBridge</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Icelake-Server</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Haswell-noTSX</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Haswell-IBRS</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Haswell</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>EPYC-Rome</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>EPYC-Milan</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>EPYC-IBPB</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>EPYC</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Dhyana</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Cooperlake</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='yes'>Conroe</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Cascadelake-Server</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Broadwell-noTSX</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Broadwell-IBRS</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Broadwell</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='yes'>486</model>
Nov 13 18:40:45 user nova-compute[75216]:     </mode>
Nov 13 18:40:45 user nova-compute[75216]:   </cpu>
Nov 13 18:40:45 user nova-compute[75216]:   <memoryBacking supported='yes'>
Nov 13 18:40:45 user nova-compute[75216]:     <enum name='sourceType'>
Nov 13 18:40:45 user nova-compute[75216]:       <value>file</value>
Nov 13 18:40:45 user nova-compute[75216]:       <value>anonymous</value>
Nov 13 18:40:45 user nova-compute[75216]:       <value>memfd</value>
Nov 13 18:40:45 user nova-compute[75216]:     </enum>
Nov 13 18:40:45 user nova-compute[75216]:   </memoryBacking>
Nov 13 18:40:45 user nova-compute[75216]:   <devices>
Nov 13 18:40:45 user nova-compute[75216]:     <disk supported='yes'>
Nov 13 18:40:45 user nova-compute[75216]:       <enum name='diskDevice'>
Nov 13 18:40:45 user nova-compute[75216]:         <value>disk</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>cdrom</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>floppy</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>lun</value>
Nov 13 18:40:45 user nova-compute[75216]:       </enum>
Nov 13 18:40:45 user nova-compute[75216]:       <enum name='bus'>
Nov 13 18:40:45 user nova-compute[75216]:         <value>ide</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>fdc</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>scsi</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>virtio</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>usb</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>sata</value>
Nov 13 18:40:45 user nova-compute[75216]:       </enum>
Nov 13 18:40:45 user nova-compute[75216]:       <enum name='model'>
Nov 13 18:40:45 user nova-compute[75216]:         <value>virtio</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>virtio-transitional</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>virtio-non-transitional</value>
Nov 13 18:40:45 user nova-compute[75216]:       </enum>
Nov 13 18:40:45 user nova-compute[75216]:     </disk>
Nov 13 18:40:45 user nova-compute[75216]:     <graphics supported='yes'>
Nov 13 18:40:45 user nova-compute[75216]:       <enum name='type'>
Nov 13 18:40:45 user nova-compute[75216]:         <value>sdl</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>vnc</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>spice</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>egl-headless</value>
Nov 13 18:40:45 user nova-compute[75216]:       </enum>
Nov 13 18:40:45 user nova-compute[75216]:     </graphics>
Nov 13 18:40:45 user nova-compute[75216]:     <video supported='yes'>
Nov 13 18:40:45 user nova-compute[75216]:       <enum name='modelType'>
Nov 13 18:40:45 user nova-compute[75216]:         <value>vga</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>cirrus</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>vmvga</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>qxl</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>virtio</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>none</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>bochs</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>ramfb</value>
Nov 13 18:40:45 user nova-compute[75216]:       </enum>
Nov 13 18:40:45 user nova-compute[75216]:     </video>
Nov 13 18:40:45 user nova-compute[75216]:     <hostdev supported='yes'>
Nov 13 18:40:45 user nova-compute[75216]:       <enum name='mode'>
Nov 13 18:40:45 user nova-compute[75216]:         <value>subsystem</value>
Nov 13 18:40:45 user nova-compute[75216]:       </enum>
Nov 13 18:40:45 user nova-compute[75216]:       <enum name='startupPolicy'>
Nov 13 18:40:45 user nova-compute[75216]:         <value>default</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>mandatory</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>requisite</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>optional</value>
Nov 13 18:40:45 user nova-compute[75216]:       </enum>
Nov 13 18:40:45 user nova-compute[75216]:       <enum name='subsysType'>
Nov 13 18:40:45 user nova-compute[75216]:         <value>usb</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>pci</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>scsi</value>
Nov 13 18:40:45 user nova-compute[75216]:       </enum>
Nov 13 18:40:45 user nova-compute[75216]:       <enum name='capsType'/>
Nov 13 18:40:45 user nova-compute[75216]:       <enum name='pciBackend'/>
Nov 13 18:40:45 user nova-compute[75216]:     </hostdev>
Nov 13 18:40:45 user nova-compute[75216]:     <rng supported='yes'>
Nov 13 18:40:45 user nova-compute[75216]:       <enum name='model'>
Nov 13 18:40:45 user nova-compute[75216]:         <value>virtio</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>virtio-transitional</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>virtio-non-transitional</value>
Nov 13 18:40:45 user nova-compute[75216]:       </enum>
Nov 13 18:40:45 user nova-compute[75216]:       <enum name='backendModel'>
Nov 13 18:40:45 user nova-compute[75216]:         <value>random</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>egd</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>builtin</value>
Nov 13 18:40:45 user nova-compute[75216]:       </enum>
Nov 13 18:40:45 user nova-compute[75216]:     </rng>
Nov 13 18:40:45 user nova-compute[75216]:     <filesystem supported='yes'>
Nov 13 18:40:45 user nova-compute[75216]:       <enum name='driverType'>
Nov 13 18:40:45 user nova-compute[75216]:         <value>path</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>handle</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>virtiofs</value>
Nov 13 18:40:45 user nova-compute[75216]:       </enum>
Nov 13 18:40:45 user nova-compute[75216]:     </filesystem>
Nov 13 18:40:45 user nova-compute[75216]:     <tpm supported='yes'>
Nov 13 18:40:45 user nova-compute[75216]:       <enum name='model'>
Nov 13 18:40:45 user nova-compute[75216]:         <value>tpm-tis</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>tpm-crb</value>
Nov 13 18:40:45 user nova-compute[75216]:       </enum>
Nov 13 18:40:45 user nova-compute[75216]:       <enum name='backendModel'>
Nov 13 18:40:45 user nova-compute[75216]:         <value>passthrough</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>emulator</value>
Nov 13 18:40:45 user nova-compute[75216]:       </enum>
Nov 13 18:40:45 user nova-compute[75216]:     </tpm>
Nov 13 18:40:45 user nova-compute[75216]:   </devices>
Nov 13 18:40:45 user nova-compute[75216]:   <features>
Nov 13 18:40:45 user nova-compute[75216]:     <gic supported='no'/>
Nov 13 18:40:45 user nova-compute[75216]:     <vmcoreinfo supported='yes'/>
Nov 13 18:40:45 user nova-compute[75216]:     <genid supported='yes'/>
Nov 13 18:40:45 user nova-compute[75216]:     <backingStoreInput supported='yes'/>
Nov 13 18:40:45 user nova-compute[75216]:     <backup supported='yes'/>
Nov 13 18:40:45 user nova-compute[75216]:     <sev supported='no'/>
Nov 13 18:40:45 user nova-compute[75216]:   </features>
Nov 13 18:40:45 user nova-compute[75216]: </domainCapabilities>
Nov 13 18:40:45 user nova-compute[75216]:  {{(pid=75216) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 13 18:40:45 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-085a4235-df6a-43dd-bf96-2d3c95dda5d5 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Nov 13 18:40:45 user nova-compute[75216]: <domainCapabilities>
Nov 13 18:40:45 user nova-compute[75216]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 13 18:40:45 user nova-compute[75216]:   <domain>kvm</domain>
Nov 13 18:40:45 user nova-compute[75216]:   <machine>pc-i440fx-jammy</machine>
Nov 13 18:40:45 user nova-compute[75216]:   <arch>x86_64</arch>
Nov 13 18:40:45 user nova-compute[75216]:   <vcpu max='255'/>
Nov 13 18:40:45 user nova-compute[75216]:   <iothreads supported='yes'/>
Nov 13 18:40:45 user nova-compute[75216]:   <os supported='yes'>
Nov 13 18:40:45 user nova-compute[75216]:     <enum name='firmware'>
Nov 13 18:40:45 user nova-compute[75216]:       <value>efi</value>
Nov 13 18:40:45 user nova-compute[75216]:     </enum>
Nov 13 18:40:45 user nova-compute[75216]:     <loader supported='yes'>
Nov 13 18:40:45 user nova-compute[75216]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 13 18:40:45 user nova-compute[75216]:       <enum name='type'>
Nov 13 18:40:45 user nova-compute[75216]:         <value>rom</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>pflash</value>
Nov 13 18:40:45 user nova-compute[75216]:       </enum>
Nov 13 18:40:45 user nova-compute[75216]:       <enum name='readonly'>
Nov 13 18:40:45 user nova-compute[75216]:         <value>yes</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>no</value>
Nov 13 18:40:45 user nova-compute[75216]:       </enum>
Nov 13 18:40:45 user nova-compute[75216]:       <enum name='secure'>
Nov 13 18:40:45 user nova-compute[75216]:         <value>no</value>
Nov 13 18:40:45 user nova-compute[75216]:       </enum>
Nov 13 18:40:45 user nova-compute[75216]:     </loader>
Nov 13 18:40:45 user nova-compute[75216]:   </os>
Nov 13 18:40:45 user nova-compute[75216]:   <cpu>
Nov 13 18:40:45 user nova-compute[75216]:     <mode name='host-passthrough' supported='yes'>
Nov 13 18:40:45 user nova-compute[75216]:       <enum name='hostPassthroughMigratable'>
Nov 13 18:40:45 user nova-compute[75216]:         <value>on</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>off</value>
Nov 13 18:40:45 user nova-compute[75216]:       </enum>
Nov 13 18:40:45 user nova-compute[75216]:     </mode>
Nov 13 18:40:45 user nova-compute[75216]:     <mode name='maximum' supported='yes'>
Nov 13 18:40:45 user nova-compute[75216]:       <enum name='maximumMigratable'>
Nov 13 18:40:45 user nova-compute[75216]:         <value>on</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>off</value>
Nov 13 18:40:45 user nova-compute[75216]:       </enum>
Nov 13 18:40:45 user nova-compute[75216]:     </mode>
Nov 13 18:40:45 user nova-compute[75216]:     <mode name='host-model' supported='yes'>
Nov 13 18:40:45 user nova-compute[75216]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 13 18:40:45 user nova-compute[75216]:       <vendor>Intel</vendor>
Nov 13 18:40:45 user nova-compute[75216]:       <feature policy='require' name='ss'/>
Nov 13 18:40:45 user nova-compute[75216]:       <feature policy='require' name='vmx'/>
Nov 13 18:40:45 user nova-compute[75216]:       <feature policy='require' name='pcid'/>
Nov 13 18:40:45 user nova-compute[75216]:       <feature policy='require' name='hypervisor'/>
Nov 13 18:40:45 user nova-compute[75216]:       <feature policy='require' name='arat'/>
Nov 13 18:40:45 user nova-compute[75216]:       <feature policy='require' name='tsc_adjust'/>
Nov 13 18:40:45 user nova-compute[75216]:       <feature policy='require' name='umip'/>
Nov 13 18:40:45 user nova-compute[75216]:       <feature policy='require' name='md-clear'/>
Nov 13 18:40:45 user nova-compute[75216]:       <feature policy='require' name='stibp'/>
Nov 13 18:40:45 user nova-compute[75216]:       <feature policy='require' name='arch-capabilities'/>
Nov 13 18:40:45 user nova-compute[75216]:       <feature policy='require' name='ssbd'/>
Nov 13 18:40:45 user nova-compute[75216]:       <feature policy='require' name='invtsc'/>
Nov 13 18:40:45 user nova-compute[75216]:       <feature policy='require' name='ibpb'/>
Nov 13 18:40:45 user nova-compute[75216]:       <feature policy='require' name='ibrs'/>
Nov 13 18:40:45 user nova-compute[75216]:       <feature policy='require' name='amd-stibp'/>
Nov 13 18:40:45 user nova-compute[75216]:       <feature policy='require' name='amd-ssbd'/>
Nov 13 18:40:45 user nova-compute[75216]:       <feature policy='require' name='rsba'/>
Nov 13 18:40:45 user nova-compute[75216]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 13 18:40:45 user nova-compute[75216]:       <feature policy='require' name='pschange-mc-no'/>
Nov 13 18:40:45 user nova-compute[75216]:       <feature policy='disable' name='erms'/>
Nov 13 18:40:45 user nova-compute[75216]:       <feature policy='disable' name='xsaveopt'/>
Nov 13 18:40:45 user nova-compute[75216]:     </mode>
Nov 13 18:40:45 user nova-compute[75216]:     <mode name='custom' supported='yes'>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>qemu64</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='yes'>qemu32</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>phenom</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='yes'>pentium3</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='yes'>pentium2</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='yes'>pentium</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>n270</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='yes'>kvm64</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='yes'>kvm32</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='yes'>coreduo</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='yes'>core2duo</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>athlon</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='yes'>Westmere-IBRS</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='yes'>Westmere</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Snowridge</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Skylake-Server</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Skylake-Client</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>SandyBridge</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='yes'>Penryn</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Opteron_G5</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Opteron_G4</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Opteron_G3</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Opteron_G2</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='yes'>Opteron_G1</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='yes'>Nehalem</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>IvyBridge</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Icelake-Server</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Haswell-noTSX</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Haswell-IBRS</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Haswell</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>EPYC-Rome</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>EPYC-Milan</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>EPYC-IBPB</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>EPYC</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Dhyana</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Cooperlake</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='yes'>Conroe</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Cascadelake-Server</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Broadwell-noTSX</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Broadwell-IBRS</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Broadwell</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='yes'>486</model>
Nov 13 18:40:45 user nova-compute[75216]:     </mode>
Nov 13 18:40:45 user nova-compute[75216]:   </cpu>
Nov 13 18:40:45 user nova-compute[75216]:   <memoryBacking supported='yes'>
Nov 13 18:40:45 user nova-compute[75216]:     <enum name='sourceType'>
Nov 13 18:40:45 user nova-compute[75216]:       <value>file</value>
Nov 13 18:40:45 user nova-compute[75216]:       <value>anonymous</value>
Nov 13 18:40:45 user nova-compute[75216]:       <value>memfd</value>
Nov 13 18:40:45 user nova-compute[75216]:     </enum>
Nov 13 18:40:45 user nova-compute[75216]:   </memoryBacking>
Nov 13 18:40:45 user nova-compute[75216]:   <devices>
Nov 13 18:40:45 user nova-compute[75216]:     <disk supported='yes'>
Nov 13 18:40:45 user nova-compute[75216]:       <enum name='diskDevice'>
Nov 13 18:40:45 user nova-compute[75216]:         <value>disk</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>cdrom</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>floppy</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>lun</value>
Nov 13 18:40:45 user nova-compute[75216]:       </enum>
Nov 13 18:40:45 user nova-compute[75216]:       <enum name='bus'>
Nov 13 18:40:45 user nova-compute[75216]:         <value>ide</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>fdc</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>scsi</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>virtio</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>usb</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>sata</value>
Nov 13 18:40:45 user nova-compute[75216]:       </enum>
Nov 13 18:40:45 user nova-compute[75216]:       <enum name='model'>
Nov 13 18:40:45 user nova-compute[75216]:         <value>virtio</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>virtio-transitional</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>virtio-non-transitional</value>
Nov 13 18:40:45 user nova-compute[75216]:       </enum>
Nov 13 18:40:45 user nova-compute[75216]:     </disk>
Nov 13 18:40:45 user nova-compute[75216]:     <graphics supported='yes'>
Nov 13 18:40:45 user nova-compute[75216]:       <enum name='type'>
Nov 13 18:40:45 user nova-compute[75216]:         <value>sdl</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>vnc</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>spice</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>egl-headless</value>
Nov 13 18:40:45 user nova-compute[75216]:       </enum>
Nov 13 18:40:45 user nova-compute[75216]:     </graphics>
Nov 13 18:40:45 user nova-compute[75216]:     <video supported='yes'>
Nov 13 18:40:45 user nova-compute[75216]:       <enum name='modelType'>
Nov 13 18:40:45 user nova-compute[75216]:         <value>vga</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>cirrus</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>vmvga</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>qxl</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>virtio</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>none</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>bochs</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>ramfb</value>
Nov 13 18:40:45 user nova-compute[75216]:       </enum>
Nov 13 18:40:45 user nova-compute[75216]:     </video>
Nov 13 18:40:45 user nova-compute[75216]:     <hostdev supported='yes'>
Nov 13 18:40:45 user nova-compute[75216]:       <enum name='mode'>
Nov 13 18:40:45 user nova-compute[75216]:         <value>subsystem</value>
Nov 13 18:40:45 user nova-compute[75216]:       </enum>
Nov 13 18:40:45 user nova-compute[75216]:       <enum name='startupPolicy'>
Nov 13 18:40:45 user nova-compute[75216]:         <value>default</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>mandatory</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>requisite</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>optional</value>
Nov 13 18:40:45 user nova-compute[75216]:       </enum>
Nov 13 18:40:45 user nova-compute[75216]:       <enum name='subsysType'>
Nov 13 18:40:45 user nova-compute[75216]:         <value>usb</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>pci</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>scsi</value>
Nov 13 18:40:45 user nova-compute[75216]:       </enum>
Nov 13 18:40:45 user nova-compute[75216]:       <enum name='capsType'/>
Nov 13 18:40:45 user nova-compute[75216]:       <enum name='pciBackend'/>
Nov 13 18:40:45 user nova-compute[75216]:     </hostdev>
Nov 13 18:40:45 user nova-compute[75216]:     <rng supported='yes'>
Nov 13 18:40:45 user nova-compute[75216]:       <enum name='model'>
Nov 13 18:40:45 user nova-compute[75216]:         <value>virtio</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>virtio-transitional</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>virtio-non-transitional</value>
Nov 13 18:40:45 user nova-compute[75216]:       </enum>
Nov 13 18:40:45 user nova-compute[75216]:       <enum name='backendModel'>
Nov 13 18:40:45 user nova-compute[75216]:         <value>random</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>egd</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>builtin</value>
Nov 13 18:40:45 user nova-compute[75216]:       </enum>
Nov 13 18:40:45 user nova-compute[75216]:     </rng>
Nov 13 18:40:45 user nova-compute[75216]:     <filesystem supported='yes'>
Nov 13 18:40:45 user nova-compute[75216]:       <enum name='driverType'>
Nov 13 18:40:45 user nova-compute[75216]:         <value>path</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>handle</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>virtiofs</value>
Nov 13 18:40:45 user nova-compute[75216]:       </enum>
Nov 13 18:40:45 user nova-compute[75216]:     </filesystem>
Nov 13 18:40:45 user nova-compute[75216]:     <tpm supported='yes'>
Nov 13 18:40:45 user nova-compute[75216]:       <enum name='model'>
Nov 13 18:40:45 user nova-compute[75216]:         <value>tpm-tis</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>tpm-crb</value>
Nov 13 18:40:45 user nova-compute[75216]:       </enum>
Nov 13 18:40:45 user nova-compute[75216]:       <enum name='backendModel'>
Nov 13 18:40:45 user nova-compute[75216]:         <value>passthrough</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>emulator</value>
Nov 13 18:40:45 user nova-compute[75216]:       </enum>
Nov 13 18:40:45 user nova-compute[75216]:     </tpm>
Nov 13 18:40:45 user nova-compute[75216]:   </devices>
Nov 13 18:40:45 user nova-compute[75216]:   <features>
Nov 13 18:40:45 user nova-compute[75216]:     <gic supported='no'/>
Nov 13 18:40:45 user nova-compute[75216]:     <vmcoreinfo supported='yes'/>
Nov 13 18:40:45 user nova-compute[75216]:     <genid supported='yes'/>
Nov 13 18:40:45 user nova-compute[75216]:     <backingStoreInput supported='yes'/>
Nov 13 18:40:45 user nova-compute[75216]:     <backup supported='yes'/>
Nov 13 18:40:45 user nova-compute[75216]:     <sev supported='no'/>
Nov 13 18:40:45 user nova-compute[75216]:   </features>
Nov 13 18:40:45 user nova-compute[75216]: </domainCapabilities>
Nov 13 18:40:45 user nova-compute[75216]:  {{(pid=75216) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 13 18:40:45 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-085a4235-df6a-43dd-bf96-2d3c95dda5d5 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Nov 13 18:40:45 user nova-compute[75216]: <domainCapabilities>
Nov 13 18:40:45 user nova-compute[75216]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 13 18:40:45 user nova-compute[75216]:   <domain>kvm</domain>
Nov 13 18:40:45 user nova-compute[75216]:   <machine>pc-q35-6.2</machine>
Nov 13 18:40:45 user nova-compute[75216]:   <arch>x86_64</arch>
Nov 13 18:40:45 user nova-compute[75216]:   <vcpu max='288'/>
Nov 13 18:40:45 user nova-compute[75216]:   <iothreads supported='yes'/>
Nov 13 18:40:45 user nova-compute[75216]:   <os supported='yes'>
Nov 13 18:40:45 user nova-compute[75216]:     <enum name='firmware'>
Nov 13 18:40:45 user nova-compute[75216]:       <value>efi</value>
Nov 13 18:40:45 user nova-compute[75216]:     </enum>
Nov 13 18:40:45 user nova-compute[75216]:     <loader supported='yes'>
Nov 13 18:40:45 user nova-compute[75216]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 13 18:40:45 user nova-compute[75216]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 13 18:40:45 user nova-compute[75216]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 13 18:40:45 user nova-compute[75216]:       <enum name='type'>
Nov 13 18:40:45 user nova-compute[75216]:         <value>rom</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>pflash</value>
Nov 13 18:40:45 user nova-compute[75216]:       </enum>
Nov 13 18:40:45 user nova-compute[75216]:       <enum name='readonly'>
Nov 13 18:40:45 user nova-compute[75216]:         <value>yes</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>no</value>
Nov 13 18:40:45 user nova-compute[75216]:       </enum>
Nov 13 18:40:45 user nova-compute[75216]:       <enum name='secure'>
Nov 13 18:40:45 user nova-compute[75216]:         <value>yes</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>no</value>
Nov 13 18:40:45 user nova-compute[75216]:       </enum>
Nov 13 18:40:45 user nova-compute[75216]:     </loader>
Nov 13 18:40:45 user nova-compute[75216]:   </os>
Nov 13 18:40:45 user nova-compute[75216]:   <cpu>
Nov 13 18:40:45 user nova-compute[75216]:     <mode name='host-passthrough' supported='yes'>
Nov 13 18:40:45 user nova-compute[75216]:       <enum name='hostPassthroughMigratable'>
Nov 13 18:40:45 user nova-compute[75216]:         <value>on</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>off</value>
Nov 13 18:40:45 user nova-compute[75216]:       </enum>
Nov 13 18:40:45 user nova-compute[75216]:     </mode>
Nov 13 18:40:45 user nova-compute[75216]:     <mode name='maximum' supported='yes'>
Nov 13 18:40:45 user nova-compute[75216]:       <enum name='maximumMigratable'>
Nov 13 18:40:45 user nova-compute[75216]:         <value>on</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>off</value>
Nov 13 18:40:45 user nova-compute[75216]:       </enum>
Nov 13 18:40:45 user nova-compute[75216]:     </mode>
Nov 13 18:40:45 user nova-compute[75216]:     <mode name='host-model' supported='yes'>
Nov 13 18:40:45 user nova-compute[75216]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 13 18:40:45 user nova-compute[75216]:       <vendor>Intel</vendor>
Nov 13 18:40:45 user nova-compute[75216]:       <feature policy='require' name='ss'/>
Nov 13 18:40:45 user nova-compute[75216]:       <feature policy='require' name='vmx'/>
Nov 13 18:40:45 user nova-compute[75216]:       <feature policy='require' name='pcid'/>
Nov 13 18:40:45 user nova-compute[75216]:       <feature policy='require' name='hypervisor'/>
Nov 13 18:40:45 user nova-compute[75216]:       <feature policy='require' name='arat'/>
Nov 13 18:40:45 user nova-compute[75216]:       <feature policy='require' name='tsc_adjust'/>
Nov 13 18:40:45 user nova-compute[75216]:       <feature policy='require' name='umip'/>
Nov 13 18:40:45 user nova-compute[75216]:       <feature policy='require' name='md-clear'/>
Nov 13 18:40:45 user nova-compute[75216]:       <feature policy='require' name='stibp'/>
Nov 13 18:40:45 user nova-compute[75216]:       <feature policy='require' name='arch-capabilities'/>
Nov 13 18:40:45 user nova-compute[75216]:       <feature policy='require' name='ssbd'/>
Nov 13 18:40:45 user nova-compute[75216]:       <feature policy='require' name='invtsc'/>
Nov 13 18:40:45 user nova-compute[75216]:       <feature policy='require' name='ibpb'/>
Nov 13 18:40:45 user nova-compute[75216]:       <feature policy='require' name='ibrs'/>
Nov 13 18:40:45 user nova-compute[75216]:       <feature policy='require' name='amd-stibp'/>
Nov 13 18:40:45 user nova-compute[75216]:       <feature policy='require' name='amd-ssbd'/>
Nov 13 18:40:45 user nova-compute[75216]:       <feature policy='require' name='rsba'/>
Nov 13 18:40:45 user nova-compute[75216]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 13 18:40:45 user nova-compute[75216]:       <feature policy='require' name='pschange-mc-no'/>
Nov 13 18:40:45 user nova-compute[75216]:       <feature policy='disable' name='erms'/>
Nov 13 18:40:45 user nova-compute[75216]:       <feature policy='disable' name='xsaveopt'/>
Nov 13 18:40:45 user nova-compute[75216]:     </mode>
Nov 13 18:40:45 user nova-compute[75216]:     <mode name='custom' supported='yes'>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>qemu64</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='yes'>qemu32</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>phenom</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='yes'>pentium3</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='yes'>pentium2</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='yes'>pentium</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>n270</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='yes'>kvm64</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='yes'>kvm32</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='yes'>coreduo</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='yes'>core2duo</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>athlon</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='yes'>Westmere-IBRS</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='yes'>Westmere</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Snowridge</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Skylake-Server</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Skylake-Client</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>SandyBridge</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='yes'>Penryn</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Opteron_G5</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Opteron_G4</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Opteron_G3</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Opteron_G2</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='yes'>Opteron_G1</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='yes'>Nehalem</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>IvyBridge</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Icelake-Server</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Haswell-noTSX</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Haswell-IBRS</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Haswell</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>EPYC-Rome</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>EPYC-Milan</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>EPYC-IBPB</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>EPYC</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Dhyana</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Cooperlake</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='yes'>Conroe</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Cascadelake-Server</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Broadwell-noTSX</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Broadwell-IBRS</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='no'>Broadwell</model>
Nov 13 18:40:45 user nova-compute[75216]:       <model usable='yes'>486</model>
Nov 13 18:40:45 user nova-compute[75216]:     </mode>
Nov 13 18:40:45 user nova-compute[75216]:   </cpu>
Nov 13 18:40:45 user nova-compute[75216]:   <memoryBacking supported='yes'>
Nov 13 18:40:45 user nova-compute[75216]:     <enum name='sourceType'>
Nov 13 18:40:45 user nova-compute[75216]:       <value>file</value>
Nov 13 18:40:45 user nova-compute[75216]:       <value>anonymous</value>
Nov 13 18:40:45 user nova-compute[75216]:       <value>memfd</value>
Nov 13 18:40:45 user nova-compute[75216]:     </enum>
Nov 13 18:40:45 user nova-compute[75216]:   </memoryBacking>
Nov 13 18:40:45 user nova-compute[75216]:   <devices>
Nov 13 18:40:45 user nova-compute[75216]:     <disk supported='yes'>
Nov 13 18:40:45 user nova-compute[75216]:       <enum name='diskDevice'>
Nov 13 18:40:45 user nova-compute[75216]:         <value>disk</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>cdrom</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>floppy</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>lun</value>
Nov 13 18:40:45 user nova-compute[75216]:       </enum>
Nov 13 18:40:45 user nova-compute[75216]:       <enum name='bus'>
Nov 13 18:40:45 user nova-compute[75216]:         <value>fdc</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>scsi</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>virtio</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>usb</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>sata</value>
Nov 13 18:40:45 user nova-compute[75216]:       </enum>
Nov 13 18:40:45 user nova-compute[75216]:       <enum name='model'>
Nov 13 18:40:45 user nova-compute[75216]:         <value>virtio</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>virtio-transitional</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>virtio-non-transitional</value>
Nov 13 18:40:45 user nova-compute[75216]:       </enum>
Nov 13 18:40:45 user nova-compute[75216]:     </disk>
Nov 13 18:40:45 user nova-compute[75216]:     <graphics supported='yes'>
Nov 13 18:40:45 user nova-compute[75216]:       <enum name='type'>
Nov 13 18:40:45 user nova-compute[75216]:         <value>sdl</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>vnc</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>spice</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>egl-headless</value>
Nov 13 18:40:45 user nova-compute[75216]:       </enum>
Nov 13 18:40:45 user nova-compute[75216]:     </graphics>
Nov 13 18:40:45 user nova-compute[75216]:     <video supported='yes'>
Nov 13 18:40:45 user nova-compute[75216]:       <enum name='modelType'>
Nov 13 18:40:45 user nova-compute[75216]:         <value>vga</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>cirrus</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>vmvga</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>qxl</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>virtio</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>none</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>bochs</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>ramfb</value>
Nov 13 18:40:45 user nova-compute[75216]:       </enum>
Nov 13 18:40:45 user nova-compute[75216]:     </video>
Nov 13 18:40:45 user nova-compute[75216]:     <hostdev supported='yes'>
Nov 13 18:40:45 user nova-compute[75216]:       <enum name='mode'>
Nov 13 18:40:45 user nova-compute[75216]:         <value>subsystem</value>
Nov 13 18:40:45 user nova-compute[75216]:       </enum>
Nov 13 18:40:45 user nova-compute[75216]:       <enum name='startupPolicy'>
Nov 13 18:40:45 user nova-compute[75216]:         <value>default</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>mandatory</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>requisite</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>optional</value>
Nov 13 18:40:45 user nova-compute[75216]:       </enum>
Nov 13 18:40:45 user nova-compute[75216]:       <enum name='subsysType'>
Nov 13 18:40:45 user nova-compute[75216]:         <value>usb</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>pci</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>scsi</value>
Nov 13 18:40:45 user nova-compute[75216]:       </enum>
Nov 13 18:40:45 user nova-compute[75216]:       <enum name='capsType'/>
Nov 13 18:40:45 user nova-compute[75216]:       <enum name='pciBackend'/>
Nov 13 18:40:45 user nova-compute[75216]:     </hostdev>
Nov 13 18:40:45 user nova-compute[75216]:     <rng supported='yes'>
Nov 13 18:40:45 user nova-compute[75216]:       <enum name='model'>
Nov 13 18:40:45 user nova-compute[75216]:         <value>virtio</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>virtio-transitional</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>virtio-non-transitional</value>
Nov 13 18:40:45 user nova-compute[75216]:       </enum>
Nov 13 18:40:45 user nova-compute[75216]:       <enum name='backendModel'>
Nov 13 18:40:45 user nova-compute[75216]:         <value>random</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>egd</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>builtin</value>
Nov 13 18:40:45 user nova-compute[75216]:       </enum>
Nov 13 18:40:45 user nova-compute[75216]:     </rng>
Nov 13 18:40:45 user nova-compute[75216]:     <filesystem supported='yes'>
Nov 13 18:40:45 user nova-compute[75216]:       <enum name='driverType'>
Nov 13 18:40:45 user nova-compute[75216]:         <value>path</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>handle</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>virtiofs</value>
Nov 13 18:40:45 user nova-compute[75216]:       </enum>
Nov 13 18:40:45 user nova-compute[75216]:     </filesystem>
Nov 13 18:40:45 user nova-compute[75216]:     <tpm supported='yes'>
Nov 13 18:40:45 user nova-compute[75216]:       <enum name='model'>
Nov 13 18:40:45 user nova-compute[75216]:         <value>tpm-tis</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>tpm-crb</value>
Nov 13 18:40:45 user nova-compute[75216]:       </enum>
Nov 13 18:40:45 user nova-compute[75216]:       <enum name='backendModel'>
Nov 13 18:40:45 user nova-compute[75216]:         <value>passthrough</value>
Nov 13 18:40:45 user nova-compute[75216]:         <value>emulator</value>
Nov 13 18:40:45 user nova-compute[75216]:       </enum>
Nov 13 18:40:45 user nova-compute[75216]:     </tpm>
Nov 13 18:40:45 user nova-compute[75216]:   </devices>
Nov 13 18:40:45 user nova-compute[75216]:   <features>
Nov 13 18:40:45 user nova-compute[75216]:     <gic supported='no'/>
Nov 13 18:40:45 user nova-compute[75216]:     <vmcoreinfo supported='yes'/>
Nov 13 18:40:45 user nova-compute[75216]:     <genid supported='yes'/>
Nov 13 18:40:45 user nova-compute[75216]:     <backingStoreInput supported='yes'/>
Nov 13 18:40:45 user nova-compute[75216]:     <backup supported='yes'/>
Nov 13 18:40:45 user nova-compute[75216]:     <sev supported='no'/>
Nov 13 18:40:45 user nova-compute[75216]:   </features>
Nov 13 18:40:45 user nova-compute[75216]: </domainCapabilities>
Nov 13 18:40:45 user nova-compute[75216]:  {{(pid=75216) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 13 18:40:45 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-085a4235-df6a-43dd-bf96-2d3c95dda5d5 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=75216) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 13 18:40:45 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-085a4235-df6a-43dd-bf96-2d3c95dda5d5 None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=75216) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 13 18:40:45 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-085a4235-df6a-43dd-bf96-2d3c95dda5d5 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=75216) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 13 18:40:45 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-085a4235-df6a-43dd-bf96-2d3c95dda5d5 None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=75216) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 13 18:40:45 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-085a4235-df6a-43dd-bf96-2d3c95dda5d5 None None] Checking secure boot support for host arch (x86_64) {{(pid=75216) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 13 18:40:45 user nova-compute[75216]: INFO nova.virt.libvirt.host [None req-085a4235-df6a-43dd-bf96-2d3c95dda5d5 None None] Secure Boot support detected
Nov 13 18:40:45 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-085a4235-df6a-43dd-bf96-2d3c95dda5d5 None None] cpu compare xml: <cpu match="exact">
Nov 13 18:40:45 user nova-compute[75216]:   <model>Nehalem</model>
Nov 13 18:40:45 user nova-compute[75216]: </cpu>
Nov 13 18:40:45 user nova-compute[75216]:  {{(pid=75216) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Nov 13 18:40:45 user nova-compute[75216]: INFO nova.virt.node [None req-085a4235-df6a-43dd-bf96-2d3c95dda5d5 None None] Generated node identity d927e00d-5a8b-43f7-ac04-6437958fac1f
Nov 13 18:40:45 user nova-compute[75216]: INFO nova.virt.node [None req-085a4235-df6a-43dd-bf96-2d3c95dda5d5 None None] Wrote node identity d927e00d-5a8b-43f7-ac04-6437958fac1f to /opt/stack/data/nova/compute_id
Nov 13 18:40:45 user nova-compute[75216]: WARNING nova.compute.manager [None req-085a4235-df6a-43dd-bf96-2d3c95dda5d5 None None] Compute nodes ['d927e00d-5a8b-43f7-ac04-6437958fac1f'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Nov 13 18:40:45 user nova-compute[75216]: INFO nova.compute.manager [None req-085a4235-df6a-43dd-bf96-2d3c95dda5d5 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Nov 13 18:40:45 user nova-compute[75216]: WARNING nova.compute.manager [None req-085a4235-df6a-43dd-bf96-2d3c95dda5d5 None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 13 18:40:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-085a4235-df6a-43dd-bf96-2d3c95dda5d5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:40:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-085a4235-df6a-43dd-bf96-2d3c95dda5d5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:40:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-085a4235-df6a-43dd-bf96-2d3c95dda5d5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:40:45 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-085a4235-df6a-43dd-bf96-2d3c95dda5d5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75216) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 18:40:46 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-085a4235-df6a-43dd-bf96-2d3c95dda5d5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 18:40:46 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-085a4235-df6a-43dd-bf96-2d3c95dda5d5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 18:40:46 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-085a4235-df6a-43dd-bf96-2d3c95dda5d5 None None] Hypervisor/Node resource view: name=user free_ram=10990MB free_disk=26.34237289428711GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=75216) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 18:40:46 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-085a4235-df6a-43dd-bf96-2d3c95dda5d5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:40:46 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-085a4235-df6a-43dd-bf96-2d3c95dda5d5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:40:46 user nova-compute[75216]: WARNING nova.compute.resource_tracker [None req-085a4235-df6a-43dd-bf96-2d3c95dda5d5 None None] No compute node record for user:d927e00d-5a8b-43f7-ac04-6437958fac1f: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host d927e00d-5a8b-43f7-ac04-6437958fac1f could not be found.
Nov 13 18:40:46 user nova-compute[75216]: INFO nova.compute.resource_tracker [None req-085a4235-df6a-43dd-bf96-2d3c95dda5d5 None None] Compute node record created for user:user with uuid: d927e00d-5a8b-43f7-ac04-6437958fac1f
Nov 13 18:40:46 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-085a4235-df6a-43dd-bf96-2d3c95dda5d5 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 18:40:46 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-085a4235-df6a-43dd-bf96-2d3c95dda5d5 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 18:40:46 user nova-compute[75216]: INFO nova.scheduler.client.report [None req-085a4235-df6a-43dd-bf96-2d3c95dda5d5 None None] [req-d11528ca-a7ea-4bd2-b142-3a00d5a20f06] Created resource provider record via placement API for resource provider with UUID d927e00d-5a8b-43f7-ac04-6437958fac1f and name user.
Nov 13 18:40:46 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-085a4235-df6a-43dd-bf96-2d3c95dda5d5 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=75216) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Nov 13 18:40:46 user nova-compute[75216]: INFO nova.virt.libvirt.host [None req-085a4235-df6a-43dd-bf96-2d3c95dda5d5 None None] kernel doesn't support AMD SEV
Nov 13 18:40:46 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-085a4235-df6a-43dd-bf96-2d3c95dda5d5 None None] Updating inventory in ProviderTree for provider d927e00d-5a8b-43f7-ac04-6437958fac1f with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 13 18:40:46 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-085a4235-df6a-43dd-bf96-2d3c95dda5d5 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75216) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 18:40:46 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-085a4235-df6a-43dd-bf96-2d3c95dda5d5 None None] Libvirt baseline CPU <cpu>
Nov 13 18:40:46 user nova-compute[75216]:   <arch>x86_64</arch>
Nov 13 18:40:46 user nova-compute[75216]:   <model>Nehalem</model>
Nov 13 18:40:46 user nova-compute[75216]:   <vendor>Intel</vendor>
Nov 13 18:40:46 user nova-compute[75216]:   <topology sockets="6" cores="1" threads="1"/>
Nov 13 18:40:46 user nova-compute[75216]: </cpu>
Nov 13 18:40:46 user nova-compute[75216]:  {{(pid=75216) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Nov 13 18:40:46 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-085a4235-df6a-43dd-bf96-2d3c95dda5d5 None None] Updated inventory for provider d927e00d-5a8b-43f7-ac04-6437958fac1f with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Nov 13 18:40:46 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-085a4235-df6a-43dd-bf96-2d3c95dda5d5 None None] Updating resource provider d927e00d-5a8b-43f7-ac04-6437958fac1f generation from 0 to 1 during operation: update_inventory {{(pid=75216) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 13 18:40:46 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-085a4235-df6a-43dd-bf96-2d3c95dda5d5 None None] Updating inventory in ProviderTree for provider d927e00d-5a8b-43f7-ac04-6437958fac1f with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 13 18:40:46 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-085a4235-df6a-43dd-bf96-2d3c95dda5d5 None None] Updating resource provider d927e00d-5a8b-43f7-ac04-6437958fac1f generation from 1 to 2 during operation: update_traits {{(pid=75216) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 13 18:40:46 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-085a4235-df6a-43dd-bf96-2d3c95dda5d5 None None] Compute_service record updated for user:user {{(pid=75216) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 18:40:46 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-085a4235-df6a-43dd-bf96-2d3c95dda5d5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.634s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:40:46 user nova-compute[75216]: DEBUG nova.service [None req-085a4235-df6a-43dd-bf96-2d3c95dda5d5 None None] Creating RPC server for service compute {{(pid=75216) start /opt/stack/nova/nova/service.py:182}}
Nov 13 18:40:46 user nova-compute[75216]: DEBUG nova.service [None req-085a4235-df6a-43dd-bf96-2d3c95dda5d5 None None] Join ServiceGroup membership for this service compute {{(pid=75216) start /opt/stack/nova/nova/service.py:199}}
Nov 13 18:40:46 user nova-compute[75216]: DEBUG nova.servicegroup.drivers.db [None req-085a4235-df6a-43dd-bf96-2d3c95dda5d5 None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=75216) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Nov 13 18:40:57 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:40:57 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:41:37 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:41:37 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:41:37 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Starting heal instance info cache {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 18:41:37 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Rebuilding the list of instances to heal {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 13 18:41:37 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Didn't find any instances for network info cache update. {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 13 18:41:37 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:41:37 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:41:37 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:41:37 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:41:37 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:41:37 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:41:37 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75216) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 18:41:37 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:41:37 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:41:37 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:41:37 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:41:37 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Auditing locally available compute resources for user (node: user) {{(pid=75216) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 18:41:37 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 18:41:37 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 18:41:37 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Hypervisor/Node resource view: name=user free_ram=10390MB free_disk=26.245914459228516GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=75216) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 18:41:37 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:41:37 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:41:37 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 18:41:37 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 18:41:37 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 18:41:37 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 18:41:37 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Compute_service record updated for user:user {{(pid=75216) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 18:41:37 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.135s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:42:37 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:42:37 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:42:37 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:42:37 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:42:37 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:42:37 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:42:37 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75216) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 18:42:37 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:42:37 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:42:37 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:42:37 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:42:37 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Auditing locally available compute resources for user (node: user) {{(pid=75216) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 18:42:38 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 18:42:38 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 18:42:38 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Hypervisor/Node resource view: name=user free_ram=10328MB free_disk=26.310474395751953GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=75216) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 18:42:38 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:42:38 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:42:38 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 18:42:38 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 18:42:38 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 18:42:38 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 18:42:38 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Compute_service record updated for user:user {{(pid=75216) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 18:42:38 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.095s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:42:38 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:42:38 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:42:39 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:42:39 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Starting heal instance info cache {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 18:42:39 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Rebuilding the list of instances to heal {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 13 18:42:39 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Didn't find any instances for network info cache update. {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 13 18:43:37 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:43:37 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:43:37 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75216) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 18:43:37 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:43:37 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:43:37 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:43:37 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:43:37 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Auditing locally available compute resources for user (node: user) {{(pid=75216) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 18:43:37 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 18:43:37 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 18:43:37 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Hypervisor/Node resource view: name=user free_ram=10319MB free_disk=26.062965393066406GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=75216) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 18:43:37 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:43:37 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:43:37 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 18:43:37 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 18:43:37 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 18:43:37 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 18:43:37 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Compute_service record updated for user:user {{(pid=75216) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 18:43:37 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.132s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:43:38 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:43:38 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:43:39 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:43:39 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:43:40 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:43:41 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:43:41 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Starting heal instance info cache {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 18:43:41 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Rebuilding the list of instances to heal {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 13 18:43:41 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Didn't find any instances for network info cache update. {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 13 18:44:37 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:44:38 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:44:38 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:44:38 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75216) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 18:44:39 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:44:39 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:44:39 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:44:39 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:44:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:44:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:44:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:44:39 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Auditing locally available compute resources for user (node: user) {{(pid=75216) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 18:44:39 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 18:44:39 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 18:44:39 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Hypervisor/Node resource view: name=user free_ram=9611MB free_disk=26.082923889160156GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=75216) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 18:44:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:44:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:44:39 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 18:44:39 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 18:44:39 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 18:44:39 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 18:44:39 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Compute_service record updated for user:user {{(pid=75216) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 18:44:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.159s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:44:40 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:44:40 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:44:43 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:44:43 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Starting heal instance info cache {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 18:44:43 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Rebuilding the list of instances to heal {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 13 18:44:43 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Didn't find any instances for network info cache update. {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 13 18:44:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-74f7ff1c-902a-44a8-9e18-2873eadc6591 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Acquiring lock "a1a3e849-6570-4820-97c8-75468b5bea4f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:44:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-74f7ff1c-902a-44a8-9e18-2873eadc6591 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Lock "a1a3e849-6570-4820-97c8-75468b5bea4f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:44:43 user nova-compute[75216]: DEBUG nova.compute.manager [None req-74f7ff1c-902a-44a8-9e18-2873eadc6591 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: a1a3e849-6570-4820-97c8-75468b5bea4f] Starting instance... {{(pid=75216) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 18:44:44 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-74f7ff1c-902a-44a8-9e18-2873eadc6591 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:44:44 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-74f7ff1c-902a-44a8-9e18-2873eadc6591 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:44:44 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-74f7ff1c-902a-44a8-9e18-2873eadc6591 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75216) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 18:44:44 user nova-compute[75216]: INFO nova.compute.claims [None req-74f7ff1c-902a-44a8-9e18-2873eadc6591 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: a1a3e849-6570-4820-97c8-75468b5bea4f] Claim successful on node user
Nov 13 18:44:44 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-74f7ff1c-902a-44a8-9e18-2873eadc6591 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 18:44:44 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-74f7ff1c-902a-44a8-9e18-2873eadc6591 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 18:44:44 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-74f7ff1c-902a-44a8-9e18-2873eadc6591 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.359s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:44:44 user nova-compute[75216]: DEBUG nova.compute.manager [None req-74f7ff1c-902a-44a8-9e18-2873eadc6591 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: a1a3e849-6570-4820-97c8-75468b5bea4f] Start building networks asynchronously for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 18:44:44 user nova-compute[75216]: DEBUG nova.compute.manager [None req-74f7ff1c-902a-44a8-9e18-2873eadc6591 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: a1a3e849-6570-4820-97c8-75468b5bea4f] Allocating IP information in the background. {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 18:44:44 user nova-compute[75216]: DEBUG nova.network.neutron [None req-74f7ff1c-902a-44a8-9e18-2873eadc6591 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: a1a3e849-6570-4820-97c8-75468b5bea4f] allocate_for_instance() {{(pid=75216) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 18:44:44 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-74f7ff1c-902a-44a8-9e18-2873eadc6591 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: a1a3e849-6570-4820-97c8-75468b5bea4f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 18:44:44 user nova-compute[75216]: DEBUG nova.compute.manager [None req-74f7ff1c-902a-44a8-9e18-2873eadc6591 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: a1a3e849-6570-4820-97c8-75468b5bea4f] Start building block device mappings for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 18:44:44 user nova-compute[75216]: DEBUG nova.compute.manager [None req-74f7ff1c-902a-44a8-9e18-2873eadc6591 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: a1a3e849-6570-4820-97c8-75468b5bea4f] Start spawning the instance on the hypervisor. {{(pid=75216) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 18:44:44 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-74f7ff1c-902a-44a8-9e18-2873eadc6591 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: a1a3e849-6570-4820-97c8-75468b5bea4f] Creating instance directory {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 18:44:44 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-74f7ff1c-902a-44a8-9e18-2873eadc6591 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: a1a3e849-6570-4820-97c8-75468b5bea4f] Creating image(s)
Nov 13 18:44:44 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-74f7ff1c-902a-44a8-9e18-2873eadc6591 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Acquiring lock "/opt/stack/data/nova/instances/a1a3e849-6570-4820-97c8-75468b5bea4f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:44:44 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-74f7ff1c-902a-44a8-9e18-2873eadc6591 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Lock "/opt/stack/data/nova/instances/a1a3e849-6570-4820-97c8-75468b5bea4f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:44:44 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-74f7ff1c-902a-44a8-9e18-2873eadc6591 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Lock "/opt/stack/data/nova/instances/a1a3e849-6570-4820-97c8-75468b5bea4f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:44:44 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-74f7ff1c-902a-44a8-9e18-2873eadc6591 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Acquiring lock "88c50a45bec9d6b0427462b3242b9b8e5f49c2b6" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:44:44 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-74f7ff1c-902a-44a8-9e18-2873eadc6591 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Lock "88c50a45bec9d6b0427462b3242b9b8e5f49c2b6" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:44:45 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-74f7ff1c-902a-44a8-9e18-2873eadc6591 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6.part --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:44:45 user nova-compute[75216]: DEBUG nova.policy [None req-74f7ff1c-902a-44a8-9e18-2873eadc6591 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '23f029ff09464d699e5bd6dbf44a905d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b7e11038e54e368acd22d06e54a351', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75216) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 18:44:45 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-74f7ff1c-902a-44a8-9e18-2873eadc6591 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6.part --force-share --output=json" returned: 0 in 0.270s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:44:45 user nova-compute[75216]: DEBUG nova.virt.images [None req-74f7ff1c-902a-44a8-9e18-2873eadc6591 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] 77bcb5ba-8510-41ec-a88d-96097bb431de was qcow2, converting to raw {{(pid=75216) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 13 18:44:45 user nova-compute[75216]: DEBUG nova.privsep.utils [None req-74f7ff1c-902a-44a8-9e18-2873eadc6591 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75216) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 13 18:44:45 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-74f7ff1c-902a-44a8-9e18-2873eadc6591 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6.part /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6.converted {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:44:45 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-74f7ff1c-902a-44a8-9e18-2873eadc6591 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6.part /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6.converted" returned: 0 in 0.246s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:44:45 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-74f7ff1c-902a-44a8-9e18-2873eadc6591 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6.converted --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:44:46 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-74f7ff1c-902a-44a8-9e18-2873eadc6591 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6.converted --force-share --output=json" returned: 0 in 0.199s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:44:46 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-74f7ff1c-902a-44a8-9e18-2873eadc6591 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Lock "88c50a45bec9d6b0427462b3242b9b8e5f49c2b6" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.181s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:44:46 user nova-compute[75216]: INFO oslo.privsep.daemon [None req-74f7ff1c-902a-44a8-9e18-2873eadc6591 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp977bdimf/privsep.sock']
Nov 13 18:44:46 user sudo[84526]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp977bdimf/privsep.sock
Nov 13 18:44:46 user sudo[84526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 13 18:44:47 user sudo[84526]: pam_unix(sudo:session): session closed for user root
Nov 13 18:44:47 user nova-compute[75216]: INFO oslo.privsep.daemon [None req-74f7ff1c-902a-44a8-9e18-2873eadc6591 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Spawned new privsep daemon via rootwrap
Nov 13 18:44:47 user nova-compute[75216]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 13 18:44:47 user nova-compute[75216]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 13 18:44:47 user nova-compute[75216]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Nov 13 18:44:47 user nova-compute[75216]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84540
Nov 13 18:44:47 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-74f7ff1c-902a-44a8-9e18-2873eadc6591 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:44:47 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-74f7ff1c-902a-44a8-9e18-2873eadc6591 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json" returned: 0 in 0.155s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:44:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-74f7ff1c-902a-44a8-9e18-2873eadc6591 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Acquiring lock "88c50a45bec9d6b0427462b3242b9b8e5f49c2b6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:44:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-74f7ff1c-902a-44a8-9e18-2873eadc6591 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Lock "88c50a45bec9d6b0427462b3242b9b8e5f49c2b6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:44:47 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-74f7ff1c-902a-44a8-9e18-2873eadc6591 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:44:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-aeaaf0e6-5466-4de4-b0b0-63e8abd55582 tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] Acquiring lock "347acafc-985e-4fa2-b286-07ea3b2e4033" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:44:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-aeaaf0e6-5466-4de4-b0b0-63e8abd55582 tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] Lock "347acafc-985e-4fa2-b286-07ea3b2e4033" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:44:47 user nova-compute[75216]: DEBUG nova.compute.manager [None req-aeaaf0e6-5466-4de4-b0b0-63e8abd55582 tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] [instance: 347acafc-985e-4fa2-b286-07ea3b2e4033] Starting instance... {{(pid=75216) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 18:44:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-aeaaf0e6-5466-4de4-b0b0-63e8abd55582 tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:44:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-aeaaf0e6-5466-4de4-b0b0-63e8abd55582 tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:44:47 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-aeaaf0e6-5466-4de4-b0b0-63e8abd55582 tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75216) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 18:44:47 user nova-compute[75216]: INFO nova.compute.claims [None req-aeaaf0e6-5466-4de4-b0b0-63e8abd55582 tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] [instance: 347acafc-985e-4fa2-b286-07ea3b2e4033] Claim successful on node user
Nov 13 18:44:47 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-74f7ff1c-902a-44a8-9e18-2873eadc6591 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json" returned: 0 in 0.175s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:44:47 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-74f7ff1c-902a-44a8-9e18-2873eadc6591 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6,backing_fmt=raw /opt/stack/data/nova/instances/a1a3e849-6570-4820-97c8-75468b5bea4f/disk 1073741824 {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:44:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-74f7ff1c-902a-44a8-9e18-2873eadc6591 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6,backing_fmt=raw /opt/stack/data/nova/instances/a1a3e849-6570-4820-97c8-75468b5bea4f/disk 1073741824" returned: 0 in 0.048s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:44:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-74f7ff1c-902a-44a8-9e18-2873eadc6591 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Lock "88c50a45bec9d6b0427462b3242b9b8e5f49c2b6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.226s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:44:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-74f7ff1c-902a-44a8-9e18-2873eadc6591 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:44:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-74f7ff1c-902a-44a8-9e18-2873eadc6591 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json" returned: 0 in 0.161s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:44:48 user nova-compute[75216]: DEBUG nova.virt.disk.api [None req-74f7ff1c-902a-44a8-9e18-2873eadc6591 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a1a3e849-6570-4820-97c8-75468b5bea4f/disk. size=1073741824 {{(pid=75216) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 18:44:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-74f7ff1c-902a-44a8-9e18-2873eadc6591 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a3e849-6570-4820-97c8-75468b5bea4f/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:44:48 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-aeaaf0e6-5466-4de4-b0b0-63e8abd55582 tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 18:44:48 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-aeaaf0e6-5466-4de4-b0b0-63e8abd55582 tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 18:44:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-aeaaf0e6-5466-4de4-b0b0-63e8abd55582 tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.362s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:44:48 user nova-compute[75216]: DEBUG nova.compute.manager [None req-aeaaf0e6-5466-4de4-b0b0-63e8abd55582 tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] [instance: 347acafc-985e-4fa2-b286-07ea3b2e4033] Start building networks asynchronously for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 18:44:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-74f7ff1c-902a-44a8-9e18-2873eadc6591 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a3e849-6570-4820-97c8-75468b5bea4f/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:44:48 user nova-compute[75216]: DEBUG nova.virt.disk.api [None req-74f7ff1c-902a-44a8-9e18-2873eadc6591 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Cannot resize image /opt/stack/data/nova/instances/a1a3e849-6570-4820-97c8-75468b5bea4f/disk to a smaller size. {{(pid=75216) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 18:44:48 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-74f7ff1c-902a-44a8-9e18-2873eadc6591 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: a1a3e849-6570-4820-97c8-75468b5bea4f] Created local disks {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 18:44:48 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-74f7ff1c-902a-44a8-9e18-2873eadc6591 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: a1a3e849-6570-4820-97c8-75468b5bea4f] Ensure instance console log exists: /opt/stack/data/nova/instances/a1a3e849-6570-4820-97c8-75468b5bea4f/console.log {{(pid=75216) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 18:44:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-74f7ff1c-902a-44a8-9e18-2873eadc6591 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:44:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-74f7ff1c-902a-44a8-9e18-2873eadc6591 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:44:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-74f7ff1c-902a-44a8-9e18-2873eadc6591 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:44:48 user nova-compute[75216]: DEBUG nova.compute.manager [None req-aeaaf0e6-5466-4de4-b0b0-63e8abd55582 tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] [instance: 347acafc-985e-4fa2-b286-07ea3b2e4033] Allocating IP information in the background. {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 18:44:48 user nova-compute[75216]: DEBUG nova.network.neutron [None req-aeaaf0e6-5466-4de4-b0b0-63e8abd55582 tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] [instance: 347acafc-985e-4fa2-b286-07ea3b2e4033] allocate_for_instance() {{(pid=75216) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 18:44:48 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-aeaaf0e6-5466-4de4-b0b0-63e8abd55582 tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] [instance: 347acafc-985e-4fa2-b286-07ea3b2e4033] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 18:44:48 user nova-compute[75216]: DEBUG nova.compute.manager [None req-aeaaf0e6-5466-4de4-b0b0-63e8abd55582 tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] [instance: 347acafc-985e-4fa2-b286-07ea3b2e4033] Start building block device mappings for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 18:44:48 user nova-compute[75216]: DEBUG nova.policy [None req-aeaaf0e6-5466-4de4-b0b0-63e8abd55582 tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '878aab34a341495994029578e54a1060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0588e8e737314d708edb0d3488e7e00a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75216) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 18:44:48 user nova-compute[75216]: DEBUG nova.compute.manager [None req-aeaaf0e6-5466-4de4-b0b0-63e8abd55582 tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] [instance: 347acafc-985e-4fa2-b286-07ea3b2e4033] Start spawning the instance on the hypervisor. {{(pid=75216) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 18:44:48 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-aeaaf0e6-5466-4de4-b0b0-63e8abd55582 tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] [instance: 347acafc-985e-4fa2-b286-07ea3b2e4033] Creating instance directory {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 18:44:48 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-aeaaf0e6-5466-4de4-b0b0-63e8abd55582 tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] [instance: 347acafc-985e-4fa2-b286-07ea3b2e4033] Creating image(s)
Nov 13 18:44:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-aeaaf0e6-5466-4de4-b0b0-63e8abd55582 tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] Acquiring lock "/opt/stack/data/nova/instances/347acafc-985e-4fa2-b286-07ea3b2e4033/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:44:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-aeaaf0e6-5466-4de4-b0b0-63e8abd55582 tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] Lock "/opt/stack/data/nova/instances/347acafc-985e-4fa2-b286-07ea3b2e4033/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:44:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-aeaaf0e6-5466-4de4-b0b0-63e8abd55582 tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] Lock "/opt/stack/data/nova/instances/347acafc-985e-4fa2-b286-07ea3b2e4033/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:44:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-aeaaf0e6-5466-4de4-b0b0-63e8abd55582 tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:44:48 user nova-compute[75216]: DEBUG nova.network.neutron [None req-74f7ff1c-902a-44a8-9e18-2873eadc6591 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: a1a3e849-6570-4820-97c8-75468b5bea4f] Successfully created port: 3544d3e3-8dfa-4043-b225-77f690cd3760 {{(pid=75216) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 18:44:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-aeaaf0e6-5466-4de4-b0b0-63e8abd55582 tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json" returned: 0 in 0.197s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:44:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-aeaaf0e6-5466-4de4-b0b0-63e8abd55582 tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] Acquiring lock "88c50a45bec9d6b0427462b3242b9b8e5f49c2b6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:44:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-aeaaf0e6-5466-4de4-b0b0-63e8abd55582 tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] Lock "88c50a45bec9d6b0427462b3242b9b8e5f49c2b6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.004s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:44:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-aeaaf0e6-5466-4de4-b0b0-63e8abd55582 tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:44:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a40e45ec-1b6c-470c-b24c-ef32df4b0617 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Acquiring lock "d589d57e-de50-482a-843f-e8246b3d7528" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:44:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a40e45ec-1b6c-470c-b24c-ef32df4b0617 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Lock "d589d57e-de50-482a-843f-e8246b3d7528" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:44:49 user nova-compute[75216]: DEBUG nova.compute.manager [None req-a40e45ec-1b6c-470c-b24c-ef32df4b0617 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] [instance: d589d57e-de50-482a-843f-e8246b3d7528] Starting instance... {{(pid=75216) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 18:44:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-aeaaf0e6-5466-4de4-b0b0-63e8abd55582 tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json" returned: 0 in 0.230s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:44:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-aeaaf0e6-5466-4de4-b0b0-63e8abd55582 tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6,backing_fmt=raw /opt/stack/data/nova/instances/347acafc-985e-4fa2-b286-07ea3b2e4033/disk 1073741824 {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:44:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-aeaaf0e6-5466-4de4-b0b0-63e8abd55582 tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6,backing_fmt=raw /opt/stack/data/nova/instances/347acafc-985e-4fa2-b286-07ea3b2e4033/disk 1073741824" returned: 0 in 0.046s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:44:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-aeaaf0e6-5466-4de4-b0b0-63e8abd55582 tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] Lock "88c50a45bec9d6b0427462b3242b9b8e5f49c2b6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.283s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:44:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-aeaaf0e6-5466-4de4-b0b0-63e8abd55582 tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:44:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-aeaaf0e6-5466-4de4-b0b0-63e8abd55582 tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json" returned: 0 in 0.178s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:44:49 user nova-compute[75216]: DEBUG nova.virt.disk.api [None req-aeaaf0e6-5466-4de4-b0b0-63e8abd55582 tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] Checking if we can resize image /opt/stack/data/nova/instances/347acafc-985e-4fa2-b286-07ea3b2e4033/disk. size=1073741824 {{(pid=75216) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 18:44:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-aeaaf0e6-5466-4de4-b0b0-63e8abd55582 tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/347acafc-985e-4fa2-b286-07ea3b2e4033/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:44:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a40e45ec-1b6c-470c-b24c-ef32df4b0617 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:44:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a40e45ec-1b6c-470c-b24c-ef32df4b0617 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:44:49 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-a40e45ec-1b6c-470c-b24c-ef32df4b0617 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75216) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 18:44:49 user nova-compute[75216]: INFO nova.compute.claims [None req-a40e45ec-1b6c-470c-b24c-ef32df4b0617 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] [instance: d589d57e-de50-482a-843f-e8246b3d7528] Claim successful on node user
Nov 13 18:44:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-aeaaf0e6-5466-4de4-b0b0-63e8abd55582 tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/347acafc-985e-4fa2-b286-07ea3b2e4033/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:44:49 user nova-compute[75216]: DEBUG nova.virt.disk.api [None req-aeaaf0e6-5466-4de4-b0b0-63e8abd55582 tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] Cannot resize image /opt/stack/data/nova/instances/347acafc-985e-4fa2-b286-07ea3b2e4033/disk to a smaller size. {{(pid=75216) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 18:44:49 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-aeaaf0e6-5466-4de4-b0b0-63e8abd55582 tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] [instance: 347acafc-985e-4fa2-b286-07ea3b2e4033] Created local disks {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 18:44:49 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-aeaaf0e6-5466-4de4-b0b0-63e8abd55582 tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] [instance: 347acafc-985e-4fa2-b286-07ea3b2e4033] Ensure instance console log exists: /opt/stack/data/nova/instances/347acafc-985e-4fa2-b286-07ea3b2e4033/console.log {{(pid=75216) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 18:44:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-aeaaf0e6-5466-4de4-b0b0-63e8abd55582 tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:44:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-aeaaf0e6-5466-4de4-b0b0-63e8abd55582 tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:44:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-aeaaf0e6-5466-4de4-b0b0-63e8abd55582 tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:44:49 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-a40e45ec-1b6c-470c-b24c-ef32df4b0617 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 18:44:49 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-a40e45ec-1b6c-470c-b24c-ef32df4b0617 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 18:44:50 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a40e45ec-1b6c-470c-b24c-ef32df4b0617 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.680s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:44:50 user nova-compute[75216]: DEBUG nova.compute.manager [None req-a40e45ec-1b6c-470c-b24c-ef32df4b0617 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] [instance: d589d57e-de50-482a-843f-e8246b3d7528] Start building networks asynchronously for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 18:44:50 user nova-compute[75216]: DEBUG nova.compute.manager [None req-a40e45ec-1b6c-470c-b24c-ef32df4b0617 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] [instance: d589d57e-de50-482a-843f-e8246b3d7528] Allocating IP information in the background. {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 18:44:50 user nova-compute[75216]: DEBUG nova.network.neutron [None req-a40e45ec-1b6c-470c-b24c-ef32df4b0617 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] [instance: d589d57e-de50-482a-843f-e8246b3d7528] allocate_for_instance() {{(pid=75216) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 18:44:50 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-a40e45ec-1b6c-470c-b24c-ef32df4b0617 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] [instance: d589d57e-de50-482a-843f-e8246b3d7528] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 18:44:50 user nova-compute[75216]: DEBUG nova.compute.manager [None req-a40e45ec-1b6c-470c-b24c-ef32df4b0617 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] [instance: d589d57e-de50-482a-843f-e8246b3d7528] Start building block device mappings for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 18:44:50 user nova-compute[75216]: DEBUG nova.network.neutron [None req-aeaaf0e6-5466-4de4-b0b0-63e8abd55582 tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] [instance: 347acafc-985e-4fa2-b286-07ea3b2e4033] Successfully created port: b7cb649d-2a7c-4b50-9844-8a96f99b5b11 {{(pid=75216) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 18:44:50 user nova-compute[75216]: DEBUG nova.compute.manager [None req-a40e45ec-1b6c-470c-b24c-ef32df4b0617 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] [instance: d589d57e-de50-482a-843f-e8246b3d7528] Start spawning the instance on the hypervisor. {{(pid=75216) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 18:44:50 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-a40e45ec-1b6c-470c-b24c-ef32df4b0617 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] [instance: d589d57e-de50-482a-843f-e8246b3d7528] Creating instance directory {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 18:44:50 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-a40e45ec-1b6c-470c-b24c-ef32df4b0617 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] [instance: d589d57e-de50-482a-843f-e8246b3d7528] Creating image(s)
Nov 13 18:44:50 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a40e45ec-1b6c-470c-b24c-ef32df4b0617 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Acquiring lock "/opt/stack/data/nova/instances/d589d57e-de50-482a-843f-e8246b3d7528/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:44:50 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a40e45ec-1b6c-470c-b24c-ef32df4b0617 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Lock "/opt/stack/data/nova/instances/d589d57e-de50-482a-843f-e8246b3d7528/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:44:50 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a40e45ec-1b6c-470c-b24c-ef32df4b0617 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Lock "/opt/stack/data/nova/instances/d589d57e-de50-482a-843f-e8246b3d7528/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:44:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-a40e45ec-1b6c-470c-b24c-ef32df4b0617 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:44:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-a40e45ec-1b6c-470c-b24c-ef32df4b0617 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json" returned: 0 in 0.163s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:44:50 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a40e45ec-1b6c-470c-b24c-ef32df4b0617 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Acquiring lock "88c50a45bec9d6b0427462b3242b9b8e5f49c2b6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:44:50 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a40e45ec-1b6c-470c-b24c-ef32df4b0617 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Lock "88c50a45bec9d6b0427462b3242b9b8e5f49c2b6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:44:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-a40e45ec-1b6c-470c-b24c-ef32df4b0617 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:44:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-a40e45ec-1b6c-470c-b24c-ef32df4b0617 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json" returned: 0 in 0.171s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:44:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-a40e45ec-1b6c-470c-b24c-ef32df4b0617 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6,backing_fmt=raw /opt/stack/data/nova/instances/d589d57e-de50-482a-843f-e8246b3d7528/disk 1073741824 {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:44:50 user nova-compute[75216]: DEBUG nova.policy [None req-a40e45ec-1b6c-470c-b24c-ef32df4b0617 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3587565f5b56450e95f2bd572d7e4f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efafc26c47c4050bd367c47469999fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75216) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 18:44:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-a40e45ec-1b6c-470c-b24c-ef32df4b0617 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6,backing_fmt=raw /opt/stack/data/nova/instances/d589d57e-de50-482a-843f-e8246b3d7528/disk 1073741824" returned: 0 in 0.053s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:44:50 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a40e45ec-1b6c-470c-b24c-ef32df4b0617 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Lock "88c50a45bec9d6b0427462b3242b9b8e5f49c2b6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.228s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:44:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-a40e45ec-1b6c-470c-b24c-ef32df4b0617 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:44:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-a40e45ec-1b6c-470c-b24c-ef32df4b0617 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json" returned: 0 in 0.184s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:44:50 user nova-compute[75216]: DEBUG nova.virt.disk.api [None req-a40e45ec-1b6c-470c-b24c-ef32df4b0617 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d589d57e-de50-482a-843f-e8246b3d7528/disk. size=1073741824 {{(pid=75216) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 18:44:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-a40e45ec-1b6c-470c-b24c-ef32df4b0617 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d589d57e-de50-482a-843f-e8246b3d7528/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:44:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-a40e45ec-1b6c-470c-b24c-ef32df4b0617 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d589d57e-de50-482a-843f-e8246b3d7528/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:44:51 user nova-compute[75216]: DEBUG nova.virt.disk.api [None req-a40e45ec-1b6c-470c-b24c-ef32df4b0617 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Cannot resize image /opt/stack/data/nova/instances/d589d57e-de50-482a-843f-e8246b3d7528/disk to a smaller size. {{(pid=75216) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 18:44:51 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-a40e45ec-1b6c-470c-b24c-ef32df4b0617 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] [instance: d589d57e-de50-482a-843f-e8246b3d7528] Created local disks {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 18:44:51 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-a40e45ec-1b6c-470c-b24c-ef32df4b0617 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] [instance: d589d57e-de50-482a-843f-e8246b3d7528] Ensure instance console log exists: /opt/stack/data/nova/instances/d589d57e-de50-482a-843f-e8246b3d7528/console.log {{(pid=75216) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 18:44:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a40e45ec-1b6c-470c-b24c-ef32df4b0617 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:44:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a40e45ec-1b6c-470c-b24c-ef32df4b0617 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:44:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a40e45ec-1b6c-470c-b24c-ef32df4b0617 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:44:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-bce76d9e-ab55-4efe-b276-000a1ad48f26 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Acquiring lock "85624c58-6c72-4490-8a3e-547953295ade" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:44:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-bce76d9e-ab55-4efe-b276-000a1ad48f26 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Lock "85624c58-6c72-4490-8a3e-547953295ade" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:44:51 user nova-compute[75216]: DEBUG nova.compute.manager [None req-bce76d9e-ab55-4efe-b276-000a1ad48f26 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] [instance: 85624c58-6c72-4490-8a3e-547953295ade] Starting instance... {{(pid=75216) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 18:44:51 user nova-compute[75216]: DEBUG nova.network.neutron [None req-aeaaf0e6-5466-4de4-b0b0-63e8abd55582 tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] [instance: 347acafc-985e-4fa2-b286-07ea3b2e4033] Successfully updated port: b7cb649d-2a7c-4b50-9844-8a96f99b5b11 {{(pid=75216) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 18:44:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-aeaaf0e6-5466-4de4-b0b0-63e8abd55582 tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] Acquiring lock "refresh_cache-347acafc-985e-4fa2-b286-07ea3b2e4033" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 18:44:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-aeaaf0e6-5466-4de4-b0b0-63e8abd55582 tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] Acquired lock "refresh_cache-347acafc-985e-4fa2-b286-07ea3b2e4033" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 18:44:51 user nova-compute[75216]: DEBUG nova.network.neutron [None req-aeaaf0e6-5466-4de4-b0b0-63e8abd55582 tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] [instance: 347acafc-985e-4fa2-b286-07ea3b2e4033] Building network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 18:44:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-bce76d9e-ab55-4efe-b276-000a1ad48f26 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:44:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-bce76d9e-ab55-4efe-b276-000a1ad48f26 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:44:51 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-bce76d9e-ab55-4efe-b276-000a1ad48f26 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75216) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 18:44:51 user nova-compute[75216]: INFO nova.compute.claims [None req-bce76d9e-ab55-4efe-b276-000a1ad48f26 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] [instance: 85624c58-6c72-4490-8a3e-547953295ade] Claim successful on node user
Nov 13 18:44:52 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-bce76d9e-ab55-4efe-b276-000a1ad48f26 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 18:44:52 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-bce76d9e-ab55-4efe-b276-000a1ad48f26 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 18:44:52 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-bce76d9e-ab55-4efe-b276-000a1ad48f26 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.297s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:44:52 user nova-compute[75216]: DEBUG nova.compute.manager [None req-bce76d9e-ab55-4efe-b276-000a1ad48f26 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] [instance: 85624c58-6c72-4490-8a3e-547953295ade] Start building networks asynchronously for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 18:44:52 user nova-compute[75216]: DEBUG nova.network.neutron [None req-aeaaf0e6-5466-4de4-b0b0-63e8abd55582 tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] [instance: 347acafc-985e-4fa2-b286-07ea3b2e4033] Instance cache missing network info. {{(pid=75216) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 18:44:52 user nova-compute[75216]: DEBUG nova.compute.manager [None req-bce76d9e-ab55-4efe-b276-000a1ad48f26 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] [instance: 85624c58-6c72-4490-8a3e-547953295ade] Allocating IP information in the background. {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 18:44:52 user nova-compute[75216]: DEBUG nova.network.neutron [None req-bce76d9e-ab55-4efe-b276-000a1ad48f26 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] [instance: 85624c58-6c72-4490-8a3e-547953295ade] allocate_for_instance() {{(pid=75216) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 18:44:52 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-bce76d9e-ab55-4efe-b276-000a1ad48f26 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] [instance: 85624c58-6c72-4490-8a3e-547953295ade] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 18:44:52 user nova-compute[75216]: DEBUG nova.compute.manager [None req-bce76d9e-ab55-4efe-b276-000a1ad48f26 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] [instance: 85624c58-6c72-4490-8a3e-547953295ade] Start building block device mappings for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 18:44:52 user nova-compute[75216]: DEBUG nova.compute.manager [req-fa21f3d9-db9b-4565-897e-59c46ddce4db req-e7d5fed9-0be1-4431-9a5c-885fd2655a2d service nova] [instance: 347acafc-985e-4fa2-b286-07ea3b2e4033] Received event network-changed-b7cb649d-2a7c-4b50-9844-8a96f99b5b11 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:44:52 user nova-compute[75216]: DEBUG nova.compute.manager [req-fa21f3d9-db9b-4565-897e-59c46ddce4db req-e7d5fed9-0be1-4431-9a5c-885fd2655a2d service nova] [instance: 347acafc-985e-4fa2-b286-07ea3b2e4033] Refreshing instance network info cache due to event network-changed-b7cb649d-2a7c-4b50-9844-8a96f99b5b11. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 18:44:52 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-fa21f3d9-db9b-4565-897e-59c46ddce4db req-e7d5fed9-0be1-4431-9a5c-885fd2655a2d service nova] Acquiring lock "refresh_cache-347acafc-985e-4fa2-b286-07ea3b2e4033" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 18:44:52 user nova-compute[75216]: DEBUG nova.compute.manager [None req-bce76d9e-ab55-4efe-b276-000a1ad48f26 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] [instance: 85624c58-6c72-4490-8a3e-547953295ade] Start spawning the instance on the hypervisor. {{(pid=75216) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 18:44:52 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-bce76d9e-ab55-4efe-b276-000a1ad48f26 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] [instance: 85624c58-6c72-4490-8a3e-547953295ade] Creating instance directory {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 18:44:52 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-bce76d9e-ab55-4efe-b276-000a1ad48f26 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] [instance: 85624c58-6c72-4490-8a3e-547953295ade] Creating image(s)
Nov 13 18:44:52 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-bce76d9e-ab55-4efe-b276-000a1ad48f26 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Acquiring lock "/opt/stack/data/nova/instances/85624c58-6c72-4490-8a3e-547953295ade/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:44:52 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-bce76d9e-ab55-4efe-b276-000a1ad48f26 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Lock "/opt/stack/data/nova/instances/85624c58-6c72-4490-8a3e-547953295ade/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:44:52 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-bce76d9e-ab55-4efe-b276-000a1ad48f26 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Lock "/opt/stack/data/nova/instances/85624c58-6c72-4490-8a3e-547953295ade/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.012s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:44:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-bce76d9e-ab55-4efe-b276-000a1ad48f26 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:44:52 user nova-compute[75216]: DEBUG nova.policy [None req-bce76d9e-ab55-4efe-b276-000a1ad48f26 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3587565f5b56450e95f2bd572d7e4f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efafc26c47c4050bd367c47469999fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75216) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 18:44:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-bce76d9e-ab55-4efe-b276-000a1ad48f26 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json" returned: 0 in 0.170s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:44:52 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-bce76d9e-ab55-4efe-b276-000a1ad48f26 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Acquiring lock "88c50a45bec9d6b0427462b3242b9b8e5f49c2b6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:44:52 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-bce76d9e-ab55-4efe-b276-000a1ad48f26 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Lock "88c50a45bec9d6b0427462b3242b9b8e5f49c2b6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:44:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-bce76d9e-ab55-4efe-b276-000a1ad48f26 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:44:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-bce76d9e-ab55-4efe-b276-000a1ad48f26 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json" returned: 0 in 0.168s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:44:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-bce76d9e-ab55-4efe-b276-000a1ad48f26 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6,backing_fmt=raw /opt/stack/data/nova/instances/85624c58-6c72-4490-8a3e-547953295ade/disk 1073741824 {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:44:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-bce76d9e-ab55-4efe-b276-000a1ad48f26 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6,backing_fmt=raw /opt/stack/data/nova/instances/85624c58-6c72-4490-8a3e-547953295ade/disk 1073741824" returned: 0 in 0.043s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:44:52 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-bce76d9e-ab55-4efe-b276-000a1ad48f26 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Lock "88c50a45bec9d6b0427462b3242b9b8e5f49c2b6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.216s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:44:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-bce76d9e-ab55-4efe-b276-000a1ad48f26 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:44:52 user nova-compute[75216]: DEBUG nova.network.neutron [None req-aeaaf0e6-5466-4de4-b0b0-63e8abd55582 tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] [instance: 347acafc-985e-4fa2-b286-07ea3b2e4033] Updating instance_info_cache with network_info: [{"id": "b7cb649d-2a7c-4b50-9844-8a96f99b5b11", "address": "fa:16:3e:d9:96:c6", "network": {"id": "69e4937e-3ba3-452c-ab80-f1a08296f50e", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-546345250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0588e8e737314d708edb0d3488e7e00a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7cb649d-2a", "ovs_interfaceid": "b7cb649d-2a7c-4b50-9844-8a96f99b5b11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 18:44:52 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-aeaaf0e6-5466-4de4-b0b0-63e8abd55582 tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] Releasing lock "refresh_cache-347acafc-985e-4fa2-b286-07ea3b2e4033" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 18:44:52 user nova-compute[75216]: DEBUG nova.compute.manager [None req-aeaaf0e6-5466-4de4-b0b0-63e8abd55582 tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] [instance: 347acafc-985e-4fa2-b286-07ea3b2e4033] Instance network_info: |[{"id": "b7cb649d-2a7c-4b50-9844-8a96f99b5b11", "address": "fa:16:3e:d9:96:c6", "network": {"id": "69e4937e-3ba3-452c-ab80-f1a08296f50e", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-546345250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0588e8e737314d708edb0d3488e7e00a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7cb649d-2a", "ovs_interfaceid": "b7cb649d-2a7c-4b50-9844-8a96f99b5b11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 18:44:52 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-fa21f3d9-db9b-4565-897e-59c46ddce4db req-e7d5fed9-0be1-4431-9a5c-885fd2655a2d service nova] Acquired lock "refresh_cache-347acafc-985e-4fa2-b286-07ea3b2e4033" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 18:44:52 user nova-compute[75216]: DEBUG nova.network.neutron [req-fa21f3d9-db9b-4565-897e-59c46ddce4db req-e7d5fed9-0be1-4431-9a5c-885fd2655a2d service nova] [instance: 347acafc-985e-4fa2-b286-07ea3b2e4033] Refreshing network info cache for port b7cb649d-2a7c-4b50-9844-8a96f99b5b11 {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 18:44:52 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-aeaaf0e6-5466-4de4-b0b0-63e8abd55582 tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] [instance: 347acafc-985e-4fa2-b286-07ea3b2e4033] Start _get_guest_xml network_info=[{"id": "b7cb649d-2a7c-4b50-9844-8a96f99b5b11", "address": "fa:16:3e:d9:96:c6", "network": {"id": "69e4937e-3ba3-452c-ab80-f1a08296f50e", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-546345250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0588e8e737314d708edb0d3488e7e00a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7cb649d-2a", "ovs_interfaceid": "b7cb649d-2a7c-4b50-9844-8a96f99b5b11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T18:41:06Z,direct_url=<?>,disk_format='qcow2',id=77bcb5ba-8510-41ec-a88d-96097bb431de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c465b7c26ec44582b6d1b7169536ecc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T18:41:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'guest_format': None, 'boot_index': 0, 'image_id': '77bcb5ba-8510-41ec-a88d-96097bb431de'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 18:44:52 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-aeaaf0e6-5466-4de4-b0b0-63e8abd55582 tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 18:44:52 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-aeaaf0e6-5466-4de4-b0b0-63e8abd55582 tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 18:44:52 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-aeaaf0e6-5466-4de4-b0b0-63e8abd55582 tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 18:44:52 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-aeaaf0e6-5466-4de4-b0b0-63e8abd55582 tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] CPU controller missing on host. {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 18:44:52 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-aeaaf0e6-5466-4de4-b0b0-63e8abd55582 tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 18:44:52 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-aeaaf0e6-5466-4de4-b0b0-63e8abd55582 tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] CPU controller found on host. {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 18:44:52 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-aeaaf0e6-5466-4de4-b0b0-63e8abd55582 tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75216) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 18:44:52 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-aeaaf0e6-5466-4de4-b0b0-63e8abd55582 tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T18:40:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T18:41:06Z,direct_url=<?>,disk_format='qcow2',id=77bcb5ba-8510-41ec-a88d-96097bb431de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c465b7c26ec44582b6d1b7169536ecc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T18:41:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 18:44:52 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-aeaaf0e6-5466-4de4-b0b0-63e8abd55582 tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] Flavor limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 18:44:52 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-aeaaf0e6-5466-4de4-b0b0-63e8abd55582 tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] Image limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 18:44:52 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-aeaaf0e6-5466-4de4-b0b0-63e8abd55582 tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] Flavor pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 18:44:52 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-aeaaf0e6-5466-4de4-b0b0-63e8abd55582 tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] Image pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 18:44:52 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-aeaaf0e6-5466-4de4-b0b0-63e8abd55582 tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 18:44:52 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-aeaaf0e6-5466-4de4-b0b0-63e8abd55582 tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 18:44:52 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-aeaaf0e6-5466-4de4-b0b0-63e8abd55582 tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 18:44:52 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-aeaaf0e6-5466-4de4-b0b0-63e8abd55582 tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] Got 1 possible topologies {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 18:44:52 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-aeaaf0e6-5466-4de4-b0b0-63e8abd55582 tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 18:44:52 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-aeaaf0e6-5466-4de4-b0b0-63e8abd55582 tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 18:44:52 user nova-compute[75216]: DEBUG nova.privsep.utils [None req-aeaaf0e6-5466-4de4-b0b0-63e8abd55582 tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75216) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 13 18:44:52 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-aeaaf0e6-5466-4de4-b0b0-63e8abd55582 tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T18:44:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-930083321',display_name='tempest-DeleteServersTestJSON-server-930083321',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-930083321',id=2,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0588e8e737314d708edb0d3488e7e00a',ramdisk_id='',reservation_id='r-wj8v3ufv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-2025775619',owner_user_name='tempest-DeleteServersTestJSON-2025775619-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T18:44:49Z,user_data=None,user_id='878aab34a341495994029578e54a1060',uuid=347acafc-985e-4fa2-b286-07ea3b2e4033,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b7cb649d-2a7c-4b50-9844-8a96f99b5b11", "address": "fa:16:3e:d9:96:c6", "network": {"id": "69e4937e-3ba3-452c-ab80-f1a08296f50e", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-546345250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0588e8e737314d708edb0d3488e7e00a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7cb649d-2a", "ovs_interfaceid": "b7cb649d-2a7c-4b50-9844-8a96f99b5b11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75216) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 18:44:52 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-aeaaf0e6-5466-4de4-b0b0-63e8abd55582 tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] Converting VIF {"id": "b7cb649d-2a7c-4b50-9844-8a96f99b5b11", "address": "fa:16:3e:d9:96:c6", "network": {"id": "69e4937e-3ba3-452c-ab80-f1a08296f50e", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-546345250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0588e8e737314d708edb0d3488e7e00a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7cb649d-2a", "ovs_interfaceid": "b7cb649d-2a7c-4b50-9844-8a96f99b5b11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 18:44:52 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-aeaaf0e6-5466-4de4-b0b0-63e8abd55582 tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:96:c6,bridge_name='br-int',has_traffic_filtering=True,id=b7cb649d-2a7c-4b50-9844-8a96f99b5b11,network=Network(69e4937e-3ba3-452c-ab80-f1a08296f50e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7cb649d-2a') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 18:44:52 user nova-compute[75216]: DEBUG nova.objects.instance [None req-aeaaf0e6-5466-4de4-b0b0-63e8abd55582 tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] Lazy-loading 'pci_devices' on Instance uuid 347acafc-985e-4fa2-b286-07ea3b2e4033 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 18:44:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-bce76d9e-ab55-4efe-b276-000a1ad48f26 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json" returned: 0 in 0.204s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:44:52 user nova-compute[75216]: DEBUG nova.virt.disk.api [None req-bce76d9e-ab55-4efe-b276-000a1ad48f26 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Checking if we can resize image /opt/stack/data/nova/instances/85624c58-6c72-4490-8a3e-547953295ade/disk. size=1073741824 {{(pid=75216) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 18:44:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-bce76d9e-ab55-4efe-b276-000a1ad48f26 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85624c58-6c72-4490-8a3e-547953295ade/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:44:53 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-aeaaf0e6-5466-4de4-b0b0-63e8abd55582 tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] [instance: 347acafc-985e-4fa2-b286-07ea3b2e4033] End _get_guest_xml xml=<domain type="kvm">
Nov 13 18:44:53 user nova-compute[75216]:   <uuid>347acafc-985e-4fa2-b286-07ea3b2e4033</uuid>
Nov 13 18:44:53 user nova-compute[75216]:   <name>instance-00000002</name>
Nov 13 18:44:53 user nova-compute[75216]:   <memory>524288</memory>
Nov 13 18:44:53 user nova-compute[75216]:   <vcpu>1</vcpu>
Nov 13 18:44:53 user nova-compute[75216]:   <metadata>
Nov 13 18:44:53 user nova-compute[75216]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 18:44:53 user nova-compute[75216]:       <nova:package version="0.0.0"/>
Nov 13 18:44:53 user nova-compute[75216]:       <nova:name>tempest-DeleteServersTestJSON-server-930083321</nova:name>
Nov 13 18:44:53 user nova-compute[75216]:       <nova:creationTime>2023-11-13 18:44:52</nova:creationTime>
Nov 13 18:44:53 user nova-compute[75216]:       <nova:flavor name="m1.tiny">
Nov 13 18:44:53 user nova-compute[75216]:         <nova:memory>512</nova:memory>
Nov 13 18:44:53 user nova-compute[75216]:         <nova:disk>1</nova:disk>
Nov 13 18:44:53 user nova-compute[75216]:         <nova:swap>0</nova:swap>
Nov 13 18:44:53 user nova-compute[75216]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 18:44:53 user nova-compute[75216]:         <nova:vcpus>1</nova:vcpus>
Nov 13 18:44:53 user nova-compute[75216]:       </nova:flavor>
Nov 13 18:44:53 user nova-compute[75216]:       <nova:owner>
Nov 13 18:44:53 user nova-compute[75216]:         <nova:user uuid="878aab34a341495994029578e54a1060">tempest-DeleteServersTestJSON-2025775619-project-member</nova:user>
Nov 13 18:44:53 user nova-compute[75216]:         <nova:project uuid="0588e8e737314d708edb0d3488e7e00a">tempest-DeleteServersTestJSON-2025775619</nova:project>
Nov 13 18:44:53 user nova-compute[75216]:       </nova:owner>
Nov 13 18:44:53 user nova-compute[75216]:       <nova:root type="image" uuid="77bcb5ba-8510-41ec-a88d-96097bb431de"/>
Nov 13 18:44:53 user nova-compute[75216]:       <nova:ports>
Nov 13 18:44:53 user nova-compute[75216]:         <nova:port uuid="b7cb649d-2a7c-4b50-9844-8a96f99b5b11">
Nov 13 18:44:53 user nova-compute[75216]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 13 18:44:53 user nova-compute[75216]:         </nova:port>
Nov 13 18:44:53 user nova-compute[75216]:       </nova:ports>
Nov 13 18:44:53 user nova-compute[75216]:     </nova:instance>
Nov 13 18:44:53 user nova-compute[75216]:   </metadata>
Nov 13 18:44:53 user nova-compute[75216]:   <sysinfo type="smbios">
Nov 13 18:44:53 user nova-compute[75216]:     <system>
Nov 13 18:44:53 user nova-compute[75216]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 18:44:53 user nova-compute[75216]:       <entry name="product">OpenStack Nova</entry>
Nov 13 18:44:53 user nova-compute[75216]:       <entry name="version">0.0.0</entry>
Nov 13 18:44:53 user nova-compute[75216]:       <entry name="serial">347acafc-985e-4fa2-b286-07ea3b2e4033</entry>
Nov 13 18:44:53 user nova-compute[75216]:       <entry name="uuid">347acafc-985e-4fa2-b286-07ea3b2e4033</entry>
Nov 13 18:44:53 user nova-compute[75216]:       <entry name="family">Virtual Machine</entry>
Nov 13 18:44:53 user nova-compute[75216]:     </system>
Nov 13 18:44:53 user nova-compute[75216]:   </sysinfo>
Nov 13 18:44:53 user nova-compute[75216]:   <os>
Nov 13 18:44:53 user nova-compute[75216]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 18:44:53 user nova-compute[75216]:     <boot dev="hd"/>
Nov 13 18:44:53 user nova-compute[75216]:     <smbios mode="sysinfo"/>
Nov 13 18:44:53 user nova-compute[75216]:   </os>
Nov 13 18:44:53 user nova-compute[75216]:   <features>
Nov 13 18:44:53 user nova-compute[75216]:     <acpi/>
Nov 13 18:44:53 user nova-compute[75216]:     <apic/>
Nov 13 18:44:53 user nova-compute[75216]:     <vmcoreinfo/>
Nov 13 18:44:53 user nova-compute[75216]:   </features>
Nov 13 18:44:53 user nova-compute[75216]:   <clock offset="utc">
Nov 13 18:44:53 user nova-compute[75216]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 18:44:53 user nova-compute[75216]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 18:44:53 user nova-compute[75216]:     <timer name="hpet" present="no"/>
Nov 13 18:44:53 user nova-compute[75216]:   </clock>
Nov 13 18:44:53 user nova-compute[75216]:   <cpu mode="custom" match="exact">
Nov 13 18:44:53 user nova-compute[75216]:     <model>Nehalem</model>
Nov 13 18:44:53 user nova-compute[75216]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 18:44:53 user nova-compute[75216]:   </cpu>
Nov 13 18:44:53 user nova-compute[75216]:   <devices>
Nov 13 18:44:53 user nova-compute[75216]:     <disk type="file" device="disk">
Nov 13 18:44:53 user nova-compute[75216]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 18:44:53 user nova-compute[75216]:       <source file="/opt/stack/data/nova/instances/347acafc-985e-4fa2-b286-07ea3b2e4033/disk"/>
Nov 13 18:44:53 user nova-compute[75216]:       <target dev="vda" bus="virtio"/>
Nov 13 18:44:53 user nova-compute[75216]:     </disk>
Nov 13 18:44:53 user nova-compute[75216]:     <interface type="ethernet">
Nov 13 18:44:53 user nova-compute[75216]:       <mac address="fa:16:3e:d9:96:c6"/>
Nov 13 18:44:53 user nova-compute[75216]:       <model type="virtio"/>
Nov 13 18:44:53 user nova-compute[75216]:       <mtu size="1442"/>
Nov 13 18:44:53 user nova-compute[75216]:       <target dev="tapb7cb649d-2a"/>
Nov 13 18:44:53 user nova-compute[75216]:     </interface>
Nov 13 18:44:53 user nova-compute[75216]:     <serial type="pty">
Nov 13 18:44:53 user nova-compute[75216]:       <log file="/opt/stack/data/nova/instances/347acafc-985e-4fa2-b286-07ea3b2e4033/console.log" append="off"/>
Nov 13 18:44:53 user nova-compute[75216]:     </serial>
Nov 13 18:44:53 user nova-compute[75216]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 18:44:53 user nova-compute[75216]:     <video>
Nov 13 18:44:53 user nova-compute[75216]:       <model type="virtio"/>
Nov 13 18:44:53 user nova-compute[75216]:     </video>
Nov 13 18:44:53 user nova-compute[75216]:     <rng model="virtio">
Nov 13 18:44:53 user nova-compute[75216]:       <backend model="random">/dev/urandom</backend>
Nov 13 18:44:53 user nova-compute[75216]:     </rng>
Nov 13 18:44:53 user nova-compute[75216]:     <controller type="usb" index="0" model="none"/>
Nov 13 18:44:53 user nova-compute[75216]:     <memballoon model="virtio">
Nov 13 18:44:53 user nova-compute[75216]:       <stats period="10"/>
Nov 13 18:44:53 user nova-compute[75216]:     </memballoon>
Nov 13 18:44:53 user nova-compute[75216]:   </devices>
Nov 13 18:44:53 user nova-compute[75216]: </domain>
Nov 13 18:44:53 user nova-compute[75216]:  {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 18:44:53 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-aeaaf0e6-5466-4de4-b0b0-63e8abd55582 tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T18:44:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-930083321',display_name='tempest-DeleteServersTestJSON-server-930083321',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-930083321',id=2,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0588e8e737314d708edb0d3488e7e00a',ramdisk_id='',reservation_id='r-wj8v3ufv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-2025775619',owner_user_name='tempest-DeleteServersTestJSON-2025775619-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T18:44:49Z,user_data=None,user_id='878aab34a341495994029578e54a1060',uuid=347acafc-985e-4fa2-b286-07ea3b2e4033,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b7cb649d-2a7c-4b50-9844-8a96f99b5b11", "address": "fa:16:3e:d9:96:c6", "network": {"id": "69e4937e-3ba3-452c-ab80-f1a08296f50e", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-546345250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0588e8e737314d708edb0d3488e7e00a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7cb649d-2a", "ovs_interfaceid": "b7cb649d-2a7c-4b50-9844-8a96f99b5b11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 18:44:53 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-aeaaf0e6-5466-4de4-b0b0-63e8abd55582 tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] Converting VIF {"id": "b7cb649d-2a7c-4b50-9844-8a96f99b5b11", "address": "fa:16:3e:d9:96:c6", "network": {"id": "69e4937e-3ba3-452c-ab80-f1a08296f50e", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-546345250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0588e8e737314d708edb0d3488e7e00a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7cb649d-2a", "ovs_interfaceid": "b7cb649d-2a7c-4b50-9844-8a96f99b5b11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 18:44:53 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-aeaaf0e6-5466-4de4-b0b0-63e8abd55582 tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:96:c6,bridge_name='br-int',has_traffic_filtering=True,id=b7cb649d-2a7c-4b50-9844-8a96f99b5b11,network=Network(69e4937e-3ba3-452c-ab80-f1a08296f50e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7cb649d-2a') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 18:44:53 user nova-compute[75216]: DEBUG os_vif [None req-aeaaf0e6-5466-4de4-b0b0-63e8abd55582 tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:96:c6,bridge_name='br-int',has_traffic_filtering=True,id=b7cb649d-2a7c-4b50-9844-8a96f99b5b11,network=Network(69e4937e-3ba3-452c-ab80-f1a08296f50e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7cb649d-2a') {{(pid=75216) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 18:44:53 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl [None req-aeaaf0e6-5466-4de4-b0b0-63e8abd55582 tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] Created schema index Interface.name {{(pid=75216) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 13 18:44:53 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl [None req-aeaaf0e6-5466-4de4-b0b0-63e8abd55582 tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] Created schema index Port.name {{(pid=75216) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 13 18:44:53 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl [None req-aeaaf0e6-5466-4de4-b0b0-63e8abd55582 tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] Created schema index Bridge.name {{(pid=75216) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 13 18:44:53 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-aeaaf0e6-5466-4de4-b0b0-63e8abd55582 tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 18:44:53 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-aeaaf0e6-5466-4de4-b0b0-63e8abd55582 tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] [POLLOUT] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:44:53 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-aeaaf0e6-5466-4de4-b0b0-63e8abd55582 tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 18:44:53 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-aeaaf0e6-5466-4de4-b0b0-63e8abd55582 tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:44:53 user nova-compute[75216]: DEBUG nova.network.neutron [None req-74f7ff1c-902a-44a8-9e18-2873eadc6591 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: a1a3e849-6570-4820-97c8-75468b5bea4f] Successfully updated port: 3544d3e3-8dfa-4043-b225-77f690cd3760 {{(pid=75216) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 18:44:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-bce76d9e-ab55-4efe-b276-000a1ad48f26 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85624c58-6c72-4490-8a3e-547953295ade/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:44:53 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:44:53 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:44:53 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 18:44:53 user nova-compute[75216]: DEBUG nova.virt.disk.api [None req-bce76d9e-ab55-4efe-b276-000a1ad48f26 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Cannot resize image /opt/stack/data/nova/instances/85624c58-6c72-4490-8a3e-547953295ade/disk to a smaller size. {{(pid=75216) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 18:44:53 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-bce76d9e-ab55-4efe-b276-000a1ad48f26 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] [instance: 85624c58-6c72-4490-8a3e-547953295ade] Created local disks {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 18:44:53 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-bce76d9e-ab55-4efe-b276-000a1ad48f26 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] [instance: 85624c58-6c72-4490-8a3e-547953295ade] Ensure instance console log exists: /opt/stack/data/nova/instances/85624c58-6c72-4490-8a3e-547953295ade/console.log {{(pid=75216) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 18:44:53 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-bce76d9e-ab55-4efe-b276-000a1ad48f26 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:44:53 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-bce76d9e-ab55-4efe-b276-000a1ad48f26 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:44:53 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-bce76d9e-ab55-4efe-b276-000a1ad48f26 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:44:53 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:44:53 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1d650517-4982-5b86-94b7-d3c32be678fb', '_type': 'linux-noop'}}, row=False) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:44:53 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:44:53 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-74f7ff1c-902a-44a8-9e18-2873eadc6591 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Acquiring lock "refresh_cache-a1a3e849-6570-4820-97c8-75468b5bea4f" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 18:44:53 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-74f7ff1c-902a-44a8-9e18-2873eadc6591 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Acquired lock "refresh_cache-a1a3e849-6570-4820-97c8-75468b5bea4f" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 18:44:53 user nova-compute[75216]: DEBUG nova.network.neutron [None req-74f7ff1c-902a-44a8-9e18-2873eadc6591 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: a1a3e849-6570-4820-97c8-75468b5bea4f] Building network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 18:44:53 user nova-compute[75216]: INFO oslo.privsep.daemon [None req-aeaaf0e6-5466-4de4-b0b0-63e8abd55582 tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpufvk0281/privsep.sock']
Nov 13 18:44:53 user sudo[84677]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpufvk0281/privsep.sock
Nov 13 18:44:53 user sudo[84677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 13 18:44:53 user nova-compute[75216]: DEBUG nova.network.neutron [None req-74f7ff1c-902a-44a8-9e18-2873eadc6591 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: a1a3e849-6570-4820-97c8-75468b5bea4f] Instance cache missing network info. {{(pid=75216) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 18:44:53 user nova-compute[75216]: DEBUG nova.compute.manager [req-8373bc40-654f-46de-9e58-da50625bf4ab req-9909fecd-9de7-4e89-a8af-f7d1ada16c51 service nova] [instance: a1a3e849-6570-4820-97c8-75468b5bea4f] Received event network-changed-3544d3e3-8dfa-4043-b225-77f690cd3760 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:44:53 user nova-compute[75216]: DEBUG nova.compute.manager [req-8373bc40-654f-46de-9e58-da50625bf4ab req-9909fecd-9de7-4e89-a8af-f7d1ada16c51 service nova] [instance: a1a3e849-6570-4820-97c8-75468b5bea4f] Refreshing instance network info cache due to event network-changed-3544d3e3-8dfa-4043-b225-77f690cd3760. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 18:44:53 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-8373bc40-654f-46de-9e58-da50625bf4ab req-9909fecd-9de7-4e89-a8af-f7d1ada16c51 service nova] Acquiring lock "refresh_cache-a1a3e849-6570-4820-97c8-75468b5bea4f" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 18:44:53 user nova-compute[75216]: DEBUG nova.network.neutron [None req-a40e45ec-1b6c-470c-b24c-ef32df4b0617 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] [instance: d589d57e-de50-482a-843f-e8246b3d7528] Successfully created port: 87426a6f-0164-4df3-aad0-becbbbfe8310 {{(pid=75216) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 18:44:54 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e02eca4f-180d-4b47-b6d8-392888b3a272 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] Acquiring lock "9b078f75-57f2-495a-abd5-f8adf72db80b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:44:54 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e02eca4f-180d-4b47-b6d8-392888b3a272 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] Lock "9b078f75-57f2-495a-abd5-f8adf72db80b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:44:54 user nova-compute[75216]: DEBUG nova.compute.manager [None req-e02eca4f-180d-4b47-b6d8-392888b3a272 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] [instance: 9b078f75-57f2-495a-abd5-f8adf72db80b] Starting instance... {{(pid=75216) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 18:44:54 user nova-compute[75216]: DEBUG nova.network.neutron [None req-bce76d9e-ab55-4efe-b276-000a1ad48f26 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] [instance: 85624c58-6c72-4490-8a3e-547953295ade] Successfully created port: 51ccc958-5ce8-4e1d-8d28-f10c5ac288bd {{(pid=75216) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 18:44:54 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e02eca4f-180d-4b47-b6d8-392888b3a272 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:44:54 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e02eca4f-180d-4b47-b6d8-392888b3a272 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:44:54 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-e02eca4f-180d-4b47-b6d8-392888b3a272 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75216) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 18:44:54 user nova-compute[75216]: INFO nova.compute.claims [None req-e02eca4f-180d-4b47-b6d8-392888b3a272 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] [instance: 9b078f75-57f2-495a-abd5-f8adf72db80b] Claim successful on node user
Nov 13 18:44:54 user nova-compute[75216]: DEBUG nova.network.neutron [None req-74f7ff1c-902a-44a8-9e18-2873eadc6591 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: a1a3e849-6570-4820-97c8-75468b5bea4f] Updating instance_info_cache with network_info: [{"id": "3544d3e3-8dfa-4043-b225-77f690cd3760", "address": "fa:16:3e:9e:b9:f7", "network": {"id": "d7a691f0-4495-40ad-a349-91b5dc9c635a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-961583097-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9b7e11038e54e368acd22d06e54a351", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3544d3e3-8d", "ovs_interfaceid": "3544d3e3-8dfa-4043-b225-77f690cd3760", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 18:44:54 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-74f7ff1c-902a-44a8-9e18-2873eadc6591 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Releasing lock "refresh_cache-a1a3e849-6570-4820-97c8-75468b5bea4f" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 18:44:54 user nova-compute[75216]: DEBUG nova.compute.manager [None req-74f7ff1c-902a-44a8-9e18-2873eadc6591 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: a1a3e849-6570-4820-97c8-75468b5bea4f] Instance network_info: |[{"id": "3544d3e3-8dfa-4043-b225-77f690cd3760", "address": "fa:16:3e:9e:b9:f7", "network": {"id": "d7a691f0-4495-40ad-a349-91b5dc9c635a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-961583097-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9b7e11038e54e368acd22d06e54a351", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3544d3e3-8d", "ovs_interfaceid": "3544d3e3-8dfa-4043-b225-77f690cd3760", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 18:44:54 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-8373bc40-654f-46de-9e58-da50625bf4ab req-9909fecd-9de7-4e89-a8af-f7d1ada16c51 service nova] Acquired lock "refresh_cache-a1a3e849-6570-4820-97c8-75468b5bea4f" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 18:44:54 user nova-compute[75216]: DEBUG nova.network.neutron [req-8373bc40-654f-46de-9e58-da50625bf4ab req-9909fecd-9de7-4e89-a8af-f7d1ada16c51 service nova] [instance: a1a3e849-6570-4820-97c8-75468b5bea4f] Refreshing network info cache for port 3544d3e3-8dfa-4043-b225-77f690cd3760 {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 18:44:54 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-74f7ff1c-902a-44a8-9e18-2873eadc6591 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: a1a3e849-6570-4820-97c8-75468b5bea4f] Start _get_guest_xml network_info=[{"id": "3544d3e3-8dfa-4043-b225-77f690cd3760", "address": "fa:16:3e:9e:b9:f7", "network": {"id": "d7a691f0-4495-40ad-a349-91b5dc9c635a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-961583097-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9b7e11038e54e368acd22d06e54a351", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3544d3e3-8d", "ovs_interfaceid": "3544d3e3-8dfa-4043-b225-77f690cd3760", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T18:41:06Z,direct_url=<?>,disk_format='qcow2',id=77bcb5ba-8510-41ec-a88d-96097bb431de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c465b7c26ec44582b6d1b7169536ecc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T18:41:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'guest_format': None, 'boot_index': 0, 'image_id': '77bcb5ba-8510-41ec-a88d-96097bb431de'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 18:44:54 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-74f7ff1c-902a-44a8-9e18-2873eadc6591 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 18:44:54 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-74f7ff1c-902a-44a8-9e18-2873eadc6591 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 18:44:54 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-e02eca4f-180d-4b47-b6d8-392888b3a272 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 18:44:54 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-74f7ff1c-902a-44a8-9e18-2873eadc6591 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 18:44:54 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-74f7ff1c-902a-44a8-9e18-2873eadc6591 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] CPU controller missing on host. {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 18:44:54 user sudo[84677]: pam_unix(sudo:session): session closed for user root
Nov 13 18:44:54 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-74f7ff1c-902a-44a8-9e18-2873eadc6591 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 18:44:54 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-74f7ff1c-902a-44a8-9e18-2873eadc6591 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] CPU controller found on host. {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 18:44:54 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-74f7ff1c-902a-44a8-9e18-2873eadc6591 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75216) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 18:44:54 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-74f7ff1c-902a-44a8-9e18-2873eadc6591 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T18:40:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T18:41:06Z,direct_url=<?>,disk_format='qcow2',id=77bcb5ba-8510-41ec-a88d-96097bb431de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c465b7c26ec44582b6d1b7169536ecc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T18:41:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 18:44:54 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-74f7ff1c-902a-44a8-9e18-2873eadc6591 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Flavor limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 18:44:54 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-74f7ff1c-902a-44a8-9e18-2873eadc6591 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Image limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 18:44:54 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-74f7ff1c-902a-44a8-9e18-2873eadc6591 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Flavor pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 18:44:54 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-74f7ff1c-902a-44a8-9e18-2873eadc6591 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Image pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 18:44:54 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-74f7ff1c-902a-44a8-9e18-2873eadc6591 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 18:44:54 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-74f7ff1c-902a-44a8-9e18-2873eadc6591 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 18:44:54 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-74f7ff1c-902a-44a8-9e18-2873eadc6591 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 18:44:54 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-74f7ff1c-902a-44a8-9e18-2873eadc6591 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Got 1 possible topologies {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 18:44:54 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-74f7ff1c-902a-44a8-9e18-2873eadc6591 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 18:44:54 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-74f7ff1c-902a-44a8-9e18-2873eadc6591 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 18:44:54 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-74f7ff1c-902a-44a8-9e18-2873eadc6591 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T18:44:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1633727482',display_name='tempest-ServerActionsTestOtherA-server-1633727482',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1633727482',id=1,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKz099Lx1XxYKMwpEh9A7Hze8Yy5EijTt+h0RSW+LWAAdums7McTLzxWcs+4M2TWx6M56tfd+yHdLdlnr7vz5lvq3aL+fZolVlZV3LeOornnUO38Y1O0XVUZqifXtvNPtQ==',key_name='tempest-keypair-1574128026',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b9b7e11038e54e368acd22d06e54a351',ramdisk_id='',reservation_id='r-iklkbpl8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-537419316',owner_user_name='tempest-ServerActionsTestOtherA-537419316-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T18:44:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='23f029ff09464d699e5bd6dbf44a905d',uuid=a1a3e849-6570-4820-97c8-75468b5bea4f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3544d3e3-8dfa-4043-b225-77f690cd3760", "address": "fa:16:3e:9e:b9:f7", "network": {"id": "d7a691f0-4495-40ad-a349-91b5dc9c635a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-961583097-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9b7e11038e54e368acd22d06e54a351", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3544d3e3-8d", "ovs_interfaceid": "3544d3e3-8dfa-4043-b225-77f690cd3760", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75216) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 18:44:54 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-74f7ff1c-902a-44a8-9e18-2873eadc6591 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Converting VIF {"id": "3544d3e3-8dfa-4043-b225-77f690cd3760", "address": "fa:16:3e:9e:b9:f7", "network": {"id": "d7a691f0-4495-40ad-a349-91b5dc9c635a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-961583097-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9b7e11038e54e368acd22d06e54a351", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3544d3e3-8d", "ovs_interfaceid": "3544d3e3-8dfa-4043-b225-77f690cd3760", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 18:44:54 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-74f7ff1c-902a-44a8-9e18-2873eadc6591 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:b9:f7,bridge_name='br-int',has_traffic_filtering=True,id=3544d3e3-8dfa-4043-b225-77f690cd3760,network=Network(d7a691f0-4495-40ad-a349-91b5dc9c635a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3544d3e3-8d') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 18:44:54 user nova-compute[75216]: DEBUG nova.objects.instance [None req-74f7ff1c-902a-44a8-9e18-2873eadc6591 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Lazy-loading 'pci_devices' on Instance uuid a1a3e849-6570-4820-97c8-75468b5bea4f {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 18:44:54 user nova-compute[75216]: DEBUG nova.network.neutron [req-fa21f3d9-db9b-4565-897e-59c46ddce4db req-e7d5fed9-0be1-4431-9a5c-885fd2655a2d service nova] [instance: 347acafc-985e-4fa2-b286-07ea3b2e4033] Updated VIF entry in instance network info cache for port b7cb649d-2a7c-4b50-9844-8a96f99b5b11. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 18:44:54 user nova-compute[75216]: DEBUG nova.network.neutron [req-fa21f3d9-db9b-4565-897e-59c46ddce4db req-e7d5fed9-0be1-4431-9a5c-885fd2655a2d service nova] [instance: 347acafc-985e-4fa2-b286-07ea3b2e4033] Updating instance_info_cache with network_info: [{"id": "b7cb649d-2a7c-4b50-9844-8a96f99b5b11", "address": "fa:16:3e:d9:96:c6", "network": {"id": "69e4937e-3ba3-452c-ab80-f1a08296f50e", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-546345250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0588e8e737314d708edb0d3488e7e00a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7cb649d-2a", "ovs_interfaceid": "b7cb649d-2a7c-4b50-9844-8a96f99b5b11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 18:44:54 user nova-compute[75216]: INFO oslo.privsep.daemon [None req-aeaaf0e6-5466-4de4-b0b0-63e8abd55582 tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] Spawned new privsep daemon via rootwrap
Nov 13 18:44:54 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-e02eca4f-180d-4b47-b6d8-392888b3a272 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 18:44:54 user nova-compute[75216]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 13 18:44:54 user nova-compute[75216]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 13 18:44:54 user nova-compute[75216]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Nov 13 18:44:54 user nova-compute[75216]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84684
Nov 13 18:44:54 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-74f7ff1c-902a-44a8-9e18-2873eadc6591 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: a1a3e849-6570-4820-97c8-75468b5bea4f] End _get_guest_xml xml=<domain type="kvm">
Nov 13 18:44:54 user nova-compute[75216]:   <uuid>a1a3e849-6570-4820-97c8-75468b5bea4f</uuid>
Nov 13 18:44:54 user nova-compute[75216]:   <name>instance-00000001</name>
Nov 13 18:44:54 user nova-compute[75216]:   <memory>524288</memory>
Nov 13 18:44:54 user nova-compute[75216]:   <vcpu>1</vcpu>
Nov 13 18:44:54 user nova-compute[75216]:   <metadata>
Nov 13 18:44:54 user nova-compute[75216]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 18:44:54 user nova-compute[75216]:       <nova:package version="0.0.0"/>
Nov 13 18:44:54 user nova-compute[75216]:       <nova:name>tempest-ServerActionsTestOtherA-server-1633727482</nova:name>
Nov 13 18:44:54 user nova-compute[75216]:       <nova:creationTime>2023-11-13 18:44:54</nova:creationTime>
Nov 13 18:44:54 user nova-compute[75216]:       <nova:flavor name="m1.tiny">
Nov 13 18:44:54 user nova-compute[75216]:         <nova:memory>512</nova:memory>
Nov 13 18:44:54 user nova-compute[75216]:         <nova:disk>1</nova:disk>
Nov 13 18:44:54 user nova-compute[75216]:         <nova:swap>0</nova:swap>
Nov 13 18:44:54 user nova-compute[75216]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 18:44:54 user nova-compute[75216]:         <nova:vcpus>1</nova:vcpus>
Nov 13 18:44:54 user nova-compute[75216]:       </nova:flavor>
Nov 13 18:44:54 user nova-compute[75216]:       <nova:owner>
Nov 13 18:44:54 user nova-compute[75216]:         <nova:user uuid="23f029ff09464d699e5bd6dbf44a905d">tempest-ServerActionsTestOtherA-537419316-project-member</nova:user>
Nov 13 18:44:54 user nova-compute[75216]:         <nova:project uuid="b9b7e11038e54e368acd22d06e54a351">tempest-ServerActionsTestOtherA-537419316</nova:project>
Nov 13 18:44:54 user nova-compute[75216]:       </nova:owner>
Nov 13 18:44:54 user nova-compute[75216]:       <nova:root type="image" uuid="77bcb5ba-8510-41ec-a88d-96097bb431de"/>
Nov 13 18:44:54 user nova-compute[75216]:       <nova:ports>
Nov 13 18:44:54 user nova-compute[75216]:         <nova:port uuid="3544d3e3-8dfa-4043-b225-77f690cd3760">
Nov 13 18:44:54 user nova-compute[75216]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 13 18:44:54 user nova-compute[75216]:         </nova:port>
Nov 13 18:44:54 user nova-compute[75216]:       </nova:ports>
Nov 13 18:44:54 user nova-compute[75216]:     </nova:instance>
Nov 13 18:44:54 user nova-compute[75216]:   </metadata>
Nov 13 18:44:54 user nova-compute[75216]:   <sysinfo type="smbios">
Nov 13 18:44:54 user nova-compute[75216]:     <system>
Nov 13 18:44:54 user nova-compute[75216]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 18:44:54 user nova-compute[75216]:       <entry name="product">OpenStack Nova</entry>
Nov 13 18:44:54 user nova-compute[75216]:       <entry name="version">0.0.0</entry>
Nov 13 18:44:54 user nova-compute[75216]:       <entry name="serial">a1a3e849-6570-4820-97c8-75468b5bea4f</entry>
Nov 13 18:44:54 user nova-compute[75216]:       <entry name="uuid">a1a3e849-6570-4820-97c8-75468b5bea4f</entry>
Nov 13 18:44:54 user nova-compute[75216]:       <entry name="family">Virtual Machine</entry>
Nov 13 18:44:54 user nova-compute[75216]:     </system>
Nov 13 18:44:54 user nova-compute[75216]:   </sysinfo>
Nov 13 18:44:54 user nova-compute[75216]:   <os>
Nov 13 18:44:54 user nova-compute[75216]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 18:44:54 user nova-compute[75216]:     <boot dev="hd"/>
Nov 13 18:44:54 user nova-compute[75216]:     <smbios mode="sysinfo"/>
Nov 13 18:44:54 user nova-compute[75216]:   </os>
Nov 13 18:44:54 user nova-compute[75216]:   <features>
Nov 13 18:44:54 user nova-compute[75216]:     <acpi/>
Nov 13 18:44:54 user nova-compute[75216]:     <apic/>
Nov 13 18:44:54 user nova-compute[75216]:     <vmcoreinfo/>
Nov 13 18:44:54 user nova-compute[75216]:   </features>
Nov 13 18:44:54 user nova-compute[75216]:   <clock offset="utc">
Nov 13 18:44:54 user nova-compute[75216]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 18:44:54 user nova-compute[75216]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 18:44:54 user nova-compute[75216]:     <timer name="hpet" present="no"/>
Nov 13 18:44:54 user nova-compute[75216]:   </clock>
Nov 13 18:44:54 user nova-compute[75216]:   <cpu mode="custom" match="exact">
Nov 13 18:44:54 user nova-compute[75216]:     <model>Nehalem</model>
Nov 13 18:44:54 user nova-compute[75216]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 18:44:54 user nova-compute[75216]:   </cpu>
Nov 13 18:44:54 user nova-compute[75216]:   <devices>
Nov 13 18:44:54 user nova-compute[75216]:     <disk type="file" device="disk">
Nov 13 18:44:54 user nova-compute[75216]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 18:44:54 user nova-compute[75216]:       <source file="/opt/stack/data/nova/instances/a1a3e849-6570-4820-97c8-75468b5bea4f/disk"/>
Nov 13 18:44:54 user nova-compute[75216]:       <target dev="vda" bus="virtio"/>
Nov 13 18:44:54 user nova-compute[75216]:     </disk>
Nov 13 18:44:54 user nova-compute[75216]:     <interface type="ethernet">
Nov 13 18:44:54 user nova-compute[75216]:       <mac address="fa:16:3e:9e:b9:f7"/>
Nov 13 18:44:54 user nova-compute[75216]:       <model type="virtio"/>
Nov 13 18:44:54 user nova-compute[75216]:       <mtu size="1442"/>
Nov 13 18:44:54 user nova-compute[75216]:       <target dev="tap3544d3e3-8d"/>
Nov 13 18:44:54 user nova-compute[75216]:     </interface>
Nov 13 18:44:54 user nova-compute[75216]:     <serial type="pty">
Nov 13 18:44:54 user nova-compute[75216]:       <log file="/opt/stack/data/nova/instances/a1a3e849-6570-4820-97c8-75468b5bea4f/console.log" append="off"/>
Nov 13 18:44:54 user nova-compute[75216]:     </serial>
Nov 13 18:44:54 user nova-compute[75216]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 18:44:54 user nova-compute[75216]:     <video>
Nov 13 18:44:54 user nova-compute[75216]:       <model type="virtio"/>
Nov 13 18:44:54 user nova-compute[75216]:     </video>
Nov 13 18:44:54 user nova-compute[75216]:     <rng model="virtio">
Nov 13 18:44:54 user nova-compute[75216]:       <backend model="random">/dev/urandom</backend>
Nov 13 18:44:54 user nova-compute[75216]:     </rng>
Nov 13 18:44:54 user nova-compute[75216]:     <controller type="usb" index="0" model="none"/>
Nov 13 18:44:54 user nova-compute[75216]:     <memballoon model="virtio">
Nov 13 18:44:54 user nova-compute[75216]:       <stats period="10"/>
Nov 13 18:44:54 user nova-compute[75216]:     </memballoon>
Nov 13 18:44:54 user nova-compute[75216]:   </devices>
Nov 13 18:44:54 user nova-compute[75216]: </domain>
Nov 13 18:44:54 user nova-compute[75216]:  {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 18:44:54 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-74f7ff1c-902a-44a8-9e18-2873eadc6591 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T18:44:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1633727482',display_name='tempest-ServerActionsTestOtherA-server-1633727482',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1633727482',id=1,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKz099Lx1XxYKMwpEh9A7Hze8Yy5EijTt+h0RSW+LWAAdums7McTLzxWcs+4M2TWx6M56tfd+yHdLdlnr7vz5lvq3aL+fZolVlZV3LeOornnUO38Y1O0XVUZqifXtvNPtQ==',key_name='tempest-keypair-1574128026',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b9b7e11038e54e368acd22d06e54a351',ramdisk_id='',reservation_id='r-iklkbpl8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-537419316',owner_user_name='tempest-ServerActionsTestOtherA-537419316-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T18:44:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='23f029ff09464d699e5bd6dbf44a905d',uuid=a1a3e849-6570-4820-97c8-75468b5bea4f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3544d3e3-8dfa-4043-b225-77f690cd3760", "address": "fa:16:3e:9e:b9:f7", "network": {"id": "d7a691f0-4495-40ad-a349-91b5dc9c635a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-961583097-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9b7e11038e54e368acd22d06e54a351", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3544d3e3-8d", "ovs_interfaceid": "3544d3e3-8dfa-4043-b225-77f690cd3760", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 18:44:54 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-74f7ff1c-902a-44a8-9e18-2873eadc6591 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Converting VIF {"id": "3544d3e3-8dfa-4043-b225-77f690cd3760", "address": "fa:16:3e:9e:b9:f7", "network": {"id": "d7a691f0-4495-40ad-a349-91b5dc9c635a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-961583097-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9b7e11038e54e368acd22d06e54a351", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3544d3e3-8d", "ovs_interfaceid": "3544d3e3-8dfa-4043-b225-77f690cd3760", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 18:44:54 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-74f7ff1c-902a-44a8-9e18-2873eadc6591 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:b9:f7,bridge_name='br-int',has_traffic_filtering=True,id=3544d3e3-8dfa-4043-b225-77f690cd3760,network=Network(d7a691f0-4495-40ad-a349-91b5dc9c635a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3544d3e3-8d') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 18:44:54 user nova-compute[75216]: DEBUG os_vif [None req-74f7ff1c-902a-44a8-9e18-2873eadc6591 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:b9:f7,bridge_name='br-int',has_traffic_filtering=True,id=3544d3e3-8dfa-4043-b225-77f690cd3760,network=Network(d7a691f0-4495-40ad-a349-91b5dc9c635a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3544d3e3-8d') {{(pid=75216) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 18:44:54 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:44:54 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:44:54 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 18:44:54 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:44:54 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f6ca18b9-c1c9-52a9-bbfb-32c3a6a7b811', '_type': 'linux-noop'}}, row=False) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:44:54 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:44:54 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e02eca4f-180d-4b47-b6d8-392888b3a272 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.450s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:44:54 user nova-compute[75216]: DEBUG nova.compute.manager [None req-e02eca4f-180d-4b47-b6d8-392888b3a272 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] [instance: 9b078f75-57f2-495a-abd5-f8adf72db80b] Start building networks asynchronously for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 18:44:54 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-fa21f3d9-db9b-4565-897e-59c46ddce4db req-e7d5fed9-0be1-4431-9a5c-885fd2655a2d service nova] Releasing lock "refresh_cache-347acafc-985e-4fa2-b286-07ea3b2e4033" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 18:44:54 user nova-compute[75216]: WARNING oslo_privsep.priv_context [None req-74f7ff1c-902a-44a8-9e18-2873eadc6591 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] privsep daemon already running
Nov 13 18:44:54 user nova-compute[75216]: DEBUG nova.compute.manager [None req-e02eca4f-180d-4b47-b6d8-392888b3a272 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] [instance: 9b078f75-57f2-495a-abd5-f8adf72db80b] Allocating IP information in the background. {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 18:44:54 user nova-compute[75216]: DEBUG nova.network.neutron [None req-e02eca4f-180d-4b47-b6d8-392888b3a272 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] [instance: 9b078f75-57f2-495a-abd5-f8adf72db80b] allocate_for_instance() {{(pid=75216) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 18:44:54 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-e02eca4f-180d-4b47-b6d8-392888b3a272 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] [instance: 9b078f75-57f2-495a-abd5-f8adf72db80b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 18:44:54 user nova-compute[75216]: DEBUG nova.compute.manager [None req-e02eca4f-180d-4b47-b6d8-392888b3a272 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] [instance: 9b078f75-57f2-495a-abd5-f8adf72db80b] Start building block device mappings for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 18:44:55 user nova-compute[75216]: DEBUG nova.compute.manager [None req-e02eca4f-180d-4b47-b6d8-392888b3a272 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] [instance: 9b078f75-57f2-495a-abd5-f8adf72db80b] Start spawning the instance on the hypervisor. {{(pid=75216) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 18:44:55 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-e02eca4f-180d-4b47-b6d8-392888b3a272 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] [instance: 9b078f75-57f2-495a-abd5-f8adf72db80b] Creating instance directory {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 18:44:55 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-e02eca4f-180d-4b47-b6d8-392888b3a272 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] [instance: 9b078f75-57f2-495a-abd5-f8adf72db80b] Creating image(s)
Nov 13 18:44:55 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e02eca4f-180d-4b47-b6d8-392888b3a272 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] Acquiring lock "/opt/stack/data/nova/instances/9b078f75-57f2-495a-abd5-f8adf72db80b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:44:55 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e02eca4f-180d-4b47-b6d8-392888b3a272 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] Lock "/opt/stack/data/nova/instances/9b078f75-57f2-495a-abd5-f8adf72db80b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:44:55 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e02eca4f-180d-4b47-b6d8-392888b3a272 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] Lock "/opt/stack/data/nova/instances/9b078f75-57f2-495a-abd5-f8adf72db80b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:44:55 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-e02eca4f-180d-4b47-b6d8-392888b3a272 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:44:55 user nova-compute[75216]: DEBUG nova.policy [None req-e02eca4f-180d-4b47-b6d8-392888b3a272 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b114ba28a4124b14a9376346953075bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76353a038ca478598ddd984f4503e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75216) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 18:44:55 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-e02eca4f-180d-4b47-b6d8-392888b3a272 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json" returned: 0 in 0.179s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:44:55 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e02eca4f-180d-4b47-b6d8-392888b3a272 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] Acquiring lock "88c50a45bec9d6b0427462b3242b9b8e5f49c2b6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:44:55 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e02eca4f-180d-4b47-b6d8-392888b3a272 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] Lock "88c50a45bec9d6b0427462b3242b9b8e5f49c2b6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:44:55 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-e02eca4f-180d-4b47-b6d8-392888b3a272 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:44:55 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:44:55 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3544d3e3-8d, may_exist=True, interface_attrs={}) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:44:55 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3544d3e3-8d, col_values=(('qos', UUID('38af537d-9881-4d25-886e-2d959116e89e')),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:44:55 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3544d3e3-8d, col_values=(('external_ids', {'iface-id': '3544d3e3-8dfa-4043-b225-77f690cd3760', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9e:b9:f7', 'vm-uuid': 'a1a3e849-6570-4820-97c8-75468b5bea4f'}),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:44:55 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:44:55 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:44:55 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:44:55 user nova-compute[75216]: INFO os_vif [None req-74f7ff1c-902a-44a8-9e18-2873eadc6591 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:b9:f7,bridge_name='br-int',has_traffic_filtering=True,id=3544d3e3-8dfa-4043-b225-77f690cd3760,network=Network(d7a691f0-4495-40ad-a349-91b5dc9c635a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3544d3e3-8d')
Nov 13 18:44:55 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:44:55 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb7cb649d-2a, may_exist=True, interface_attrs={}) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:44:55 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb7cb649d-2a, col_values=(('qos', UUID('2b08b011-b4e5-4be8-9ac8-fef101bd4815')),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:44:55 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb7cb649d-2a, col_values=(('external_ids', {'iface-id': 'b7cb649d-2a7c-4b50-9844-8a96f99b5b11', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d9:96:c6', 'vm-uuid': '347acafc-985e-4fa2-b286-07ea3b2e4033'}),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:44:55 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:44:55 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:44:55 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:44:55 user nova-compute[75216]: INFO os_vif [None req-aeaaf0e6-5466-4de4-b0b0-63e8abd55582 tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:96:c6,bridge_name='br-int',has_traffic_filtering=True,id=b7cb649d-2a7c-4b50-9844-8a96f99b5b11,network=Network(69e4937e-3ba3-452c-ab80-f1a08296f50e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7cb649d-2a')
Nov 13 18:44:55 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-e02eca4f-180d-4b47-b6d8-392888b3a272 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json" returned: 0 in 0.199s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:44:55 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-e02eca4f-180d-4b47-b6d8-392888b3a272 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6,backing_fmt=raw /opt/stack/data/nova/instances/9b078f75-57f2-495a-abd5-f8adf72db80b/disk 1073741824 {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:44:55 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-e02eca4f-180d-4b47-b6d8-392888b3a272 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6,backing_fmt=raw /opt/stack/data/nova/instances/9b078f75-57f2-495a-abd5-f8adf72db80b/disk 1073741824" returned: 0 in 0.044s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:44:55 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e02eca4f-180d-4b47-b6d8-392888b3a272 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] Lock "88c50a45bec9d6b0427462b3242b9b8e5f49c2b6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.247s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:44:55 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-e02eca4f-180d-4b47-b6d8-392888b3a272 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:44:55 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-74f7ff1c-902a-44a8-9e18-2873eadc6591 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 18:44:55 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-74f7ff1c-902a-44a8-9e18-2873eadc6591 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] No VIF found with MAC fa:16:3e:9e:b9:f7, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 18:44:55 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-aeaaf0e6-5466-4de4-b0b0-63e8abd55582 tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 18:44:55 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-aeaaf0e6-5466-4de4-b0b0-63e8abd55582 tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] No VIF found with MAC fa:16:3e:d9:96:c6, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 18:44:55 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-e02eca4f-180d-4b47-b6d8-392888b3a272 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json" returned: 0 in 0.175s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:44:55 user nova-compute[75216]: DEBUG nova.virt.disk.api [None req-e02eca4f-180d-4b47-b6d8-392888b3a272 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9b078f75-57f2-495a-abd5-f8adf72db80b/disk. size=1073741824 {{(pid=75216) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 18:44:55 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-e02eca4f-180d-4b47-b6d8-392888b3a272 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b078f75-57f2-495a-abd5-f8adf72db80b/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:44:55 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-e02eca4f-180d-4b47-b6d8-392888b3a272 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b078f75-57f2-495a-abd5-f8adf72db80b/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:44:55 user nova-compute[75216]: DEBUG nova.virt.disk.api [None req-e02eca4f-180d-4b47-b6d8-392888b3a272 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] Cannot resize image /opt/stack/data/nova/instances/9b078f75-57f2-495a-abd5-f8adf72db80b/disk to a smaller size. {{(pid=75216) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 18:44:55 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-e02eca4f-180d-4b47-b6d8-392888b3a272 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] [instance: 9b078f75-57f2-495a-abd5-f8adf72db80b] Created local disks {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 18:44:55 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-e02eca4f-180d-4b47-b6d8-392888b3a272 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] [instance: 9b078f75-57f2-495a-abd5-f8adf72db80b] Ensure instance console log exists: /opt/stack/data/nova/instances/9b078f75-57f2-495a-abd5-f8adf72db80b/console.log {{(pid=75216) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 18:44:55 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e02eca4f-180d-4b47-b6d8-392888b3a272 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:44:55 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e02eca4f-180d-4b47-b6d8-392888b3a272 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:44:55 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e02eca4f-180d-4b47-b6d8-392888b3a272 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:44:55 user nova-compute[75216]: DEBUG nova.network.neutron [None req-bce76d9e-ab55-4efe-b276-000a1ad48f26 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] [instance: 85624c58-6c72-4490-8a3e-547953295ade] Successfully updated port: 51ccc958-5ce8-4e1d-8d28-f10c5ac288bd {{(pid=75216) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 18:44:55 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-bce76d9e-ab55-4efe-b276-000a1ad48f26 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Acquiring lock "refresh_cache-85624c58-6c72-4490-8a3e-547953295ade" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 18:44:55 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-bce76d9e-ab55-4efe-b276-000a1ad48f26 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Acquired lock "refresh_cache-85624c58-6c72-4490-8a3e-547953295ade" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 18:44:55 user nova-compute[75216]: DEBUG nova.network.neutron [None req-bce76d9e-ab55-4efe-b276-000a1ad48f26 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] [instance: 85624c58-6c72-4490-8a3e-547953295ade] Building network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 18:44:56 user nova-compute[75216]: DEBUG nova.network.neutron [None req-bce76d9e-ab55-4efe-b276-000a1ad48f26 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] [instance: 85624c58-6c72-4490-8a3e-547953295ade] Instance cache missing network info. {{(pid=75216) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 18:44:56 user nova-compute[75216]: DEBUG nova.network.neutron [req-8373bc40-654f-46de-9e58-da50625bf4ab req-9909fecd-9de7-4e89-a8af-f7d1ada16c51 service nova] [instance: a1a3e849-6570-4820-97c8-75468b5bea4f] Updated VIF entry in instance network info cache for port 3544d3e3-8dfa-4043-b225-77f690cd3760. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 18:44:56 user nova-compute[75216]: DEBUG nova.network.neutron [req-8373bc40-654f-46de-9e58-da50625bf4ab req-9909fecd-9de7-4e89-a8af-f7d1ada16c51 service nova] [instance: a1a3e849-6570-4820-97c8-75468b5bea4f] Updating instance_info_cache with network_info: [{"id": "3544d3e3-8dfa-4043-b225-77f690cd3760", "address": "fa:16:3e:9e:b9:f7", "network": {"id": "d7a691f0-4495-40ad-a349-91b5dc9c635a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-961583097-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9b7e11038e54e368acd22d06e54a351", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3544d3e3-8d", "ovs_interfaceid": "3544d3e3-8dfa-4043-b225-77f690cd3760", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 18:44:56 user nova-compute[75216]: DEBUG nova.compute.manager [req-3dd4633c-4226-4447-85f4-e90633d2697c req-54ba4f3f-9171-4a4c-a80c-d7f7668a6b12 service nova] [instance: 85624c58-6c72-4490-8a3e-547953295ade] Received event network-changed-51ccc958-5ce8-4e1d-8d28-f10c5ac288bd {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:44:56 user nova-compute[75216]: DEBUG nova.compute.manager [req-3dd4633c-4226-4447-85f4-e90633d2697c req-54ba4f3f-9171-4a4c-a80c-d7f7668a6b12 service nova] [instance: 85624c58-6c72-4490-8a3e-547953295ade] Refreshing instance network info cache due to event network-changed-51ccc958-5ce8-4e1d-8d28-f10c5ac288bd. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 18:44:56 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-3dd4633c-4226-4447-85f4-e90633d2697c req-54ba4f3f-9171-4a4c-a80c-d7f7668a6b12 service nova] Acquiring lock "refresh_cache-85624c58-6c72-4490-8a3e-547953295ade" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 18:44:56 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-8373bc40-654f-46de-9e58-da50625bf4ab req-9909fecd-9de7-4e89-a8af-f7d1ada16c51 service nova] Releasing lock "refresh_cache-a1a3e849-6570-4820-97c8-75468b5bea4f" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 18:44:56 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:44:56 user nova-compute[75216]: DEBUG nova.network.neutron [None req-bce76d9e-ab55-4efe-b276-000a1ad48f26 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] [instance: 85624c58-6c72-4490-8a3e-547953295ade] Updating instance_info_cache with network_info: [{"id": "51ccc958-5ce8-4e1d-8d28-f10c5ac288bd", "address": "fa:16:3e:f4:a4:79", "network": {"id": "6d182db1-03b5-4d1b-86cf-b9367921b7b0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1877006951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2efafc26c47c4050bd367c47469999fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51ccc958-5c", "ovs_interfaceid": "51ccc958-5ce8-4e1d-8d28-f10c5ac288bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 18:44:56 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-bce76d9e-ab55-4efe-b276-000a1ad48f26 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Releasing lock "refresh_cache-85624c58-6c72-4490-8a3e-547953295ade" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 18:44:56 user nova-compute[75216]: DEBUG nova.compute.manager [None req-bce76d9e-ab55-4efe-b276-000a1ad48f26 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] [instance: 85624c58-6c72-4490-8a3e-547953295ade] Instance network_info: |[{"id": "51ccc958-5ce8-4e1d-8d28-f10c5ac288bd", "address": "fa:16:3e:f4:a4:79", "network": {"id": "6d182db1-03b5-4d1b-86cf-b9367921b7b0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1877006951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2efafc26c47c4050bd367c47469999fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51ccc958-5c", "ovs_interfaceid": "51ccc958-5ce8-4e1d-8d28-f10c5ac288bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 18:44:56 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-3dd4633c-4226-4447-85f4-e90633d2697c req-54ba4f3f-9171-4a4c-a80c-d7f7668a6b12 service nova] Acquired lock "refresh_cache-85624c58-6c72-4490-8a3e-547953295ade" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 18:44:56 user nova-compute[75216]: DEBUG nova.network.neutron [req-3dd4633c-4226-4447-85f4-e90633d2697c req-54ba4f3f-9171-4a4c-a80c-d7f7668a6b12 service nova] [instance: 85624c58-6c72-4490-8a3e-547953295ade] Refreshing network info cache for port 51ccc958-5ce8-4e1d-8d28-f10c5ac288bd {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 18:44:56 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-bce76d9e-ab55-4efe-b276-000a1ad48f26 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] [instance: 85624c58-6c72-4490-8a3e-547953295ade] Start _get_guest_xml network_info=[{"id": "51ccc958-5ce8-4e1d-8d28-f10c5ac288bd", "address": "fa:16:3e:f4:a4:79", "network": {"id": "6d182db1-03b5-4d1b-86cf-b9367921b7b0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1877006951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2efafc26c47c4050bd367c47469999fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51ccc958-5c", "ovs_interfaceid": "51ccc958-5ce8-4e1d-8d28-f10c5ac288bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T18:41:06Z,direct_url=<?>,disk_format='qcow2',id=77bcb5ba-8510-41ec-a88d-96097bb431de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c465b7c26ec44582b6d1b7169536ecc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T18:41:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'guest_format': None, 'boot_index': 0, 'image_id': '77bcb5ba-8510-41ec-a88d-96097bb431de'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 18:44:56 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-bce76d9e-ab55-4efe-b276-000a1ad48f26 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 18:44:56 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-bce76d9e-ab55-4efe-b276-000a1ad48f26 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 18:44:56 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-bce76d9e-ab55-4efe-b276-000a1ad48f26 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 18:44:56 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-bce76d9e-ab55-4efe-b276-000a1ad48f26 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] CPU controller missing on host. {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 18:44:56 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-bce76d9e-ab55-4efe-b276-000a1ad48f26 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 18:44:56 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-bce76d9e-ab55-4efe-b276-000a1ad48f26 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] CPU controller found on host. {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 18:44:56 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-bce76d9e-ab55-4efe-b276-000a1ad48f26 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75216) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 18:44:56 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-bce76d9e-ab55-4efe-b276-000a1ad48f26 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T18:40:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T18:41:06Z,direct_url=<?>,disk_format='qcow2',id=77bcb5ba-8510-41ec-a88d-96097bb431de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c465b7c26ec44582b6d1b7169536ecc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T18:41:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 18:44:56 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-bce76d9e-ab55-4efe-b276-000a1ad48f26 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Flavor limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 18:44:56 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-bce76d9e-ab55-4efe-b276-000a1ad48f26 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Image limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 18:44:56 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-bce76d9e-ab55-4efe-b276-000a1ad48f26 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Flavor pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 18:44:56 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-bce76d9e-ab55-4efe-b276-000a1ad48f26 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Image pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 18:44:56 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-bce76d9e-ab55-4efe-b276-000a1ad48f26 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 18:44:56 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-bce76d9e-ab55-4efe-b276-000a1ad48f26 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 18:44:56 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-bce76d9e-ab55-4efe-b276-000a1ad48f26 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 18:44:56 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-bce76d9e-ab55-4efe-b276-000a1ad48f26 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Got 1 possible topologies {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 18:44:56 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-bce76d9e-ab55-4efe-b276-000a1ad48f26 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 18:44:56 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-bce76d9e-ab55-4efe-b276-000a1ad48f26 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 18:44:56 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-bce76d9e-ab55-4efe-b276-000a1ad48f26 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T18:44:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1814419203',display_name='tempest-ServerRescueNegativeTestJSON-server-1814419203',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1814419203',id=4,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2efafc26c47c4050bd367c47469999fb',ramdisk_id='',reservation_id='r-s9cus3mx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-165310019',owner_user_name='tempest-ServerRescueNegativeTestJSON-165310019-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T18:44:52Z,user_data=None,user_id='3587565f5b56450e95f2bd572d7e4f88',uuid=85624c58-6c72-4490-8a3e-547953295ade,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "51ccc958-5ce8-4e1d-8d28-f10c5ac288bd", "address": "fa:16:3e:f4:a4:79", "network": {"id": "6d182db1-03b5-4d1b-86cf-b9367921b7b0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1877006951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2efafc26c47c4050bd367c47469999fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51ccc958-5c", "ovs_interfaceid": "51ccc958-5ce8-4e1d-8d28-f10c5ac288bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75216) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 18:44:56 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-bce76d9e-ab55-4efe-b276-000a1ad48f26 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Converting VIF {"id": "51ccc958-5ce8-4e1d-8d28-f10c5ac288bd", "address": "fa:16:3e:f4:a4:79", "network": {"id": "6d182db1-03b5-4d1b-86cf-b9367921b7b0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1877006951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2efafc26c47c4050bd367c47469999fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51ccc958-5c", "ovs_interfaceid": "51ccc958-5ce8-4e1d-8d28-f10c5ac288bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 18:44:56 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-bce76d9e-ab55-4efe-b276-000a1ad48f26 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:a4:79,bridge_name='br-int',has_traffic_filtering=True,id=51ccc958-5ce8-4e1d-8d28-f10c5ac288bd,network=Network(6d182db1-03b5-4d1b-86cf-b9367921b7b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51ccc958-5c') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 18:44:56 user nova-compute[75216]: DEBUG nova.objects.instance [None req-bce76d9e-ab55-4efe-b276-000a1ad48f26 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Lazy-loading 'pci_devices' on Instance uuid 85624c58-6c72-4490-8a3e-547953295ade {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 18:44:56 user nova-compute[75216]: DEBUG nova.network.neutron [None req-a40e45ec-1b6c-470c-b24c-ef32df4b0617 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] [instance: d589d57e-de50-482a-843f-e8246b3d7528] Successfully updated port: 87426a6f-0164-4df3-aad0-becbbbfe8310 {{(pid=75216) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 18:44:56 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-bce76d9e-ab55-4efe-b276-000a1ad48f26 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] [instance: 85624c58-6c72-4490-8a3e-547953295ade] End _get_guest_xml xml=<domain type="kvm">
Nov 13 18:44:56 user nova-compute[75216]:   <uuid>85624c58-6c72-4490-8a3e-547953295ade</uuid>
Nov 13 18:44:56 user nova-compute[75216]:   <name>instance-00000004</name>
Nov 13 18:44:56 user nova-compute[75216]:   <memory>524288</memory>
Nov 13 18:44:56 user nova-compute[75216]:   <vcpu>1</vcpu>
Nov 13 18:44:56 user nova-compute[75216]:   <metadata>
Nov 13 18:44:56 user nova-compute[75216]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 18:44:56 user nova-compute[75216]:       <nova:package version="0.0.0"/>
Nov 13 18:44:56 user nova-compute[75216]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1814419203</nova:name>
Nov 13 18:44:56 user nova-compute[75216]:       <nova:creationTime>2023-11-13 18:44:56</nova:creationTime>
Nov 13 18:44:56 user nova-compute[75216]:       <nova:flavor name="m1.tiny">
Nov 13 18:44:56 user nova-compute[75216]:         <nova:memory>512</nova:memory>
Nov 13 18:44:56 user nova-compute[75216]:         <nova:disk>1</nova:disk>
Nov 13 18:44:56 user nova-compute[75216]:         <nova:swap>0</nova:swap>
Nov 13 18:44:56 user nova-compute[75216]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 18:44:56 user nova-compute[75216]:         <nova:vcpus>1</nova:vcpus>
Nov 13 18:44:56 user nova-compute[75216]:       </nova:flavor>
Nov 13 18:44:56 user nova-compute[75216]:       <nova:owner>
Nov 13 18:44:56 user nova-compute[75216]:         <nova:user uuid="3587565f5b56450e95f2bd572d7e4f88">tempest-ServerRescueNegativeTestJSON-165310019-project-member</nova:user>
Nov 13 18:44:56 user nova-compute[75216]:         <nova:project uuid="2efafc26c47c4050bd367c47469999fb">tempest-ServerRescueNegativeTestJSON-165310019</nova:project>
Nov 13 18:44:56 user nova-compute[75216]:       </nova:owner>
Nov 13 18:44:56 user nova-compute[75216]:       <nova:root type="image" uuid="77bcb5ba-8510-41ec-a88d-96097bb431de"/>
Nov 13 18:44:56 user nova-compute[75216]:       <nova:ports>
Nov 13 18:44:56 user nova-compute[75216]:         <nova:port uuid="51ccc958-5ce8-4e1d-8d28-f10c5ac288bd">
Nov 13 18:44:56 user nova-compute[75216]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 13 18:44:56 user nova-compute[75216]:         </nova:port>
Nov 13 18:44:56 user nova-compute[75216]:       </nova:ports>
Nov 13 18:44:56 user nova-compute[75216]:     </nova:instance>
Nov 13 18:44:56 user nova-compute[75216]:   </metadata>
Nov 13 18:44:56 user nova-compute[75216]:   <sysinfo type="smbios">
Nov 13 18:44:56 user nova-compute[75216]:     <system>
Nov 13 18:44:56 user nova-compute[75216]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 18:44:56 user nova-compute[75216]:       <entry name="product">OpenStack Nova</entry>
Nov 13 18:44:56 user nova-compute[75216]:       <entry name="version">0.0.0</entry>
Nov 13 18:44:56 user nova-compute[75216]:       <entry name="serial">85624c58-6c72-4490-8a3e-547953295ade</entry>
Nov 13 18:44:56 user nova-compute[75216]:       <entry name="uuid">85624c58-6c72-4490-8a3e-547953295ade</entry>
Nov 13 18:44:56 user nova-compute[75216]:       <entry name="family">Virtual Machine</entry>
Nov 13 18:44:56 user nova-compute[75216]:     </system>
Nov 13 18:44:56 user nova-compute[75216]:   </sysinfo>
Nov 13 18:44:56 user nova-compute[75216]:   <os>
Nov 13 18:44:56 user nova-compute[75216]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 18:44:56 user nova-compute[75216]:     <boot dev="hd"/>
Nov 13 18:44:56 user nova-compute[75216]:     <smbios mode="sysinfo"/>
Nov 13 18:44:56 user nova-compute[75216]:   </os>
Nov 13 18:44:56 user nova-compute[75216]:   <features>
Nov 13 18:44:56 user nova-compute[75216]:     <acpi/>
Nov 13 18:44:56 user nova-compute[75216]:     <apic/>
Nov 13 18:44:56 user nova-compute[75216]:     <vmcoreinfo/>
Nov 13 18:44:56 user nova-compute[75216]:   </features>
Nov 13 18:44:56 user nova-compute[75216]:   <clock offset="utc">
Nov 13 18:44:56 user nova-compute[75216]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 18:44:56 user nova-compute[75216]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 18:44:56 user nova-compute[75216]:     <timer name="hpet" present="no"/>
Nov 13 18:44:56 user nova-compute[75216]:   </clock>
Nov 13 18:44:56 user nova-compute[75216]:   <cpu mode="custom" match="exact">
Nov 13 18:44:56 user nova-compute[75216]:     <model>Nehalem</model>
Nov 13 18:44:56 user nova-compute[75216]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 18:44:56 user nova-compute[75216]:   </cpu>
Nov 13 18:44:56 user nova-compute[75216]:   <devices>
Nov 13 18:44:56 user nova-compute[75216]:     <disk type="file" device="disk">
Nov 13 18:44:56 user nova-compute[75216]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 18:44:56 user nova-compute[75216]:       <source file="/opt/stack/data/nova/instances/85624c58-6c72-4490-8a3e-547953295ade/disk"/>
Nov 13 18:44:56 user nova-compute[75216]:       <target dev="vda" bus="virtio"/>
Nov 13 18:44:56 user nova-compute[75216]:     </disk>
Nov 13 18:44:56 user nova-compute[75216]:     <interface type="ethernet">
Nov 13 18:44:56 user nova-compute[75216]:       <mac address="fa:16:3e:f4:a4:79"/>
Nov 13 18:44:56 user nova-compute[75216]:       <model type="virtio"/>
Nov 13 18:44:56 user nova-compute[75216]:       <mtu size="1442"/>
Nov 13 18:44:56 user nova-compute[75216]:       <target dev="tap51ccc958-5c"/>
Nov 13 18:44:56 user nova-compute[75216]:     </interface>
Nov 13 18:44:56 user nova-compute[75216]:     <serial type="pty">
Nov 13 18:44:56 user nova-compute[75216]:       <log file="/opt/stack/data/nova/instances/85624c58-6c72-4490-8a3e-547953295ade/console.log" append="off"/>
Nov 13 18:44:56 user nova-compute[75216]:     </serial>
Nov 13 18:44:56 user nova-compute[75216]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 18:44:56 user nova-compute[75216]:     <video>
Nov 13 18:44:56 user nova-compute[75216]:       <model type="virtio"/>
Nov 13 18:44:56 user nova-compute[75216]:     </video>
Nov 13 18:44:56 user nova-compute[75216]:     <rng model="virtio">
Nov 13 18:44:56 user nova-compute[75216]:       <backend model="random">/dev/urandom</backend>
Nov 13 18:44:56 user nova-compute[75216]:     </rng>
Nov 13 18:44:56 user nova-compute[75216]:     <controller type="usb" index="0" model="none"/>
Nov 13 18:44:56 user nova-compute[75216]:     <memballoon model="virtio">
Nov 13 18:44:56 user nova-compute[75216]:       <stats period="10"/>
Nov 13 18:44:56 user nova-compute[75216]:     </memballoon>
Nov 13 18:44:56 user nova-compute[75216]:   </devices>
Nov 13 18:44:56 user nova-compute[75216]: </domain>
Nov 13 18:44:56 user nova-compute[75216]:  {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 18:44:56 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-bce76d9e-ab55-4efe-b276-000a1ad48f26 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T18:44:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1814419203',display_name='tempest-ServerRescueNegativeTestJSON-server-1814419203',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1814419203',id=4,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2efafc26c47c4050bd367c47469999fb',ramdisk_id='',reservation_id='r-s9cus3mx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-165310019',owner_user_name='tempest-ServerRescueNegativeTestJSON-165310019-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T18:44:52Z,user_data=None,user_id='3587565f5b56450e95f2bd572d7e4f88',uuid=85624c58-6c72-4490-8a3e-547953295ade,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "51ccc958-5ce8-4e1d-8d28-f10c5ac288bd", "address": "fa:16:3e:f4:a4:79", "network": {"id": "6d182db1-03b5-4d1b-86cf-b9367921b7b0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1877006951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2efafc26c47c4050bd367c47469999fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51ccc958-5c", "ovs_interfaceid": "51ccc958-5ce8-4e1d-8d28-f10c5ac288bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 18:44:56 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-bce76d9e-ab55-4efe-b276-000a1ad48f26 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Converting VIF {"id": "51ccc958-5ce8-4e1d-8d28-f10c5ac288bd", "address": "fa:16:3e:f4:a4:79", "network": {"id": "6d182db1-03b5-4d1b-86cf-b9367921b7b0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1877006951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2efafc26c47c4050bd367c47469999fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51ccc958-5c", "ovs_interfaceid": "51ccc958-5ce8-4e1d-8d28-f10c5ac288bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 18:44:56 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-bce76d9e-ab55-4efe-b276-000a1ad48f26 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:a4:79,bridge_name='br-int',has_traffic_filtering=True,id=51ccc958-5ce8-4e1d-8d28-f10c5ac288bd,network=Network(6d182db1-03b5-4d1b-86cf-b9367921b7b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51ccc958-5c') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 18:44:56 user nova-compute[75216]: DEBUG os_vif [None req-bce76d9e-ab55-4efe-b276-000a1ad48f26 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:a4:79,bridge_name='br-int',has_traffic_filtering=True,id=51ccc958-5ce8-4e1d-8d28-f10c5ac288bd,network=Network(6d182db1-03b5-4d1b-86cf-b9367921b7b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51ccc958-5c') {{(pid=75216) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 18:44:56 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:44:56 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:44:56 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 18:44:56 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:44:56 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3a96d82c-7302-5168-b650-88499a2c5e3b', '_type': 'linux-noop'}}, row=False) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:44:56 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:44:56 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:44:56 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:44:56 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a40e45ec-1b6c-470c-b24c-ef32df4b0617 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Acquiring lock "refresh_cache-d589d57e-de50-482a-843f-e8246b3d7528" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 18:44:56 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a40e45ec-1b6c-470c-b24c-ef32df4b0617 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Acquired lock "refresh_cache-d589d57e-de50-482a-843f-e8246b3d7528" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 18:44:56 user nova-compute[75216]: DEBUG nova.network.neutron [None req-a40e45ec-1b6c-470c-b24c-ef32df4b0617 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] [instance: d589d57e-de50-482a-843f-e8246b3d7528] Building network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 18:44:56 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:44:56 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap51ccc958-5c, may_exist=True, interface_attrs={}) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:44:56 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap51ccc958-5c, col_values=(('qos', UUID('b6a7c5ce-23b4-482a-9c55-866a48ad9b7e')),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:44:56 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap51ccc958-5c, col_values=(('external_ids', {'iface-id': '51ccc958-5ce8-4e1d-8d28-f10c5ac288bd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f4:a4:79', 'vm-uuid': '85624c58-6c72-4490-8a3e-547953295ade'}),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:44:56 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:44:56 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:44:56 user nova-compute[75216]: INFO os_vif [None req-bce76d9e-ab55-4efe-b276-000a1ad48f26 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:a4:79,bridge_name='br-int',has_traffic_filtering=True,id=51ccc958-5ce8-4e1d-8d28-f10c5ac288bd,network=Network(6d182db1-03b5-4d1b-86cf-b9367921b7b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51ccc958-5c')
Nov 13 18:44:56 user nova-compute[75216]: DEBUG nova.compute.manager [req-3d7dccba-4b2c-47a9-8b81-531318374497 req-18268baa-d8f7-48ff-bff6-fe58a2a1d0d9 service nova] [instance: d589d57e-de50-482a-843f-e8246b3d7528] Received event network-changed-87426a6f-0164-4df3-aad0-becbbbfe8310 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:44:56 user nova-compute[75216]: DEBUG nova.compute.manager [req-3d7dccba-4b2c-47a9-8b81-531318374497 req-18268baa-d8f7-48ff-bff6-fe58a2a1d0d9 service nova] [instance: d589d57e-de50-482a-843f-e8246b3d7528] Refreshing instance network info cache due to event network-changed-87426a6f-0164-4df3-aad0-becbbbfe8310. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 18:44:56 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-3d7dccba-4b2c-47a9-8b81-531318374497 req-18268baa-d8f7-48ff-bff6-fe58a2a1d0d9 service nova] Acquiring lock "refresh_cache-d589d57e-de50-482a-843f-e8246b3d7528" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 18:44:56 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-bce76d9e-ab55-4efe-b276-000a1ad48f26 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 18:44:56 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-bce76d9e-ab55-4efe-b276-000a1ad48f26 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] No VIF found with MAC fa:16:3e:f4:a4:79, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 18:44:57 user nova-compute[75216]: DEBUG nova.network.neutron [None req-a40e45ec-1b6c-470c-b24c-ef32df4b0617 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] [instance: d589d57e-de50-482a-843f-e8246b3d7528] Instance cache missing network info. {{(pid=75216) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 18:44:57 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:44:57 user nova-compute[75216]: DEBUG nova.network.neutron [None req-e02eca4f-180d-4b47-b6d8-392888b3a272 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] [instance: 9b078f75-57f2-495a-abd5-f8adf72db80b] Successfully created port: 96bda2a6-53d1-4052-9230-4907fe60d70b {{(pid=75216) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 18:44:57 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:44:58 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:44:58 user nova-compute[75216]: DEBUG nova.network.neutron [req-3dd4633c-4226-4447-85f4-e90633d2697c req-54ba4f3f-9171-4a4c-a80c-d7f7668a6b12 service nova] [instance: 85624c58-6c72-4490-8a3e-547953295ade] Updated VIF entry in instance network info cache for port 51ccc958-5ce8-4e1d-8d28-f10c5ac288bd. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 18:44:58 user nova-compute[75216]: DEBUG nova.network.neutron [req-3dd4633c-4226-4447-85f4-e90633d2697c req-54ba4f3f-9171-4a4c-a80c-d7f7668a6b12 service nova] [instance: 85624c58-6c72-4490-8a3e-547953295ade] Updating instance_info_cache with network_info: [{"id": "51ccc958-5ce8-4e1d-8d28-f10c5ac288bd", "address": "fa:16:3e:f4:a4:79", "network": {"id": "6d182db1-03b5-4d1b-86cf-b9367921b7b0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1877006951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2efafc26c47c4050bd367c47469999fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51ccc958-5c", "ovs_interfaceid": "51ccc958-5ce8-4e1d-8d28-f10c5ac288bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 18:44:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-3dd4633c-4226-4447-85f4-e90633d2697c req-54ba4f3f-9171-4a4c-a80c-d7f7668a6b12 service nova] Releasing lock "refresh_cache-85624c58-6c72-4490-8a3e-547953295ade" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 18:44:58 user nova-compute[75216]: DEBUG nova.network.neutron [None req-a40e45ec-1b6c-470c-b24c-ef32df4b0617 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] [instance: d589d57e-de50-482a-843f-e8246b3d7528] Updating instance_info_cache with network_info: [{"id": "87426a6f-0164-4df3-aad0-becbbbfe8310", "address": "fa:16:3e:64:4d:81", "network": {"id": "6d182db1-03b5-4d1b-86cf-b9367921b7b0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1877006951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2efafc26c47c4050bd367c47469999fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87426a6f-01", "ovs_interfaceid": "87426a6f-0164-4df3-aad0-becbbbfe8310", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 18:44:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a40e45ec-1b6c-470c-b24c-ef32df4b0617 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Releasing lock "refresh_cache-d589d57e-de50-482a-843f-e8246b3d7528" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 18:44:58 user nova-compute[75216]: DEBUG nova.compute.manager [None req-a40e45ec-1b6c-470c-b24c-ef32df4b0617 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] [instance: d589d57e-de50-482a-843f-e8246b3d7528] Instance network_info: |[{"id": "87426a6f-0164-4df3-aad0-becbbbfe8310", "address": "fa:16:3e:64:4d:81", "network": {"id": "6d182db1-03b5-4d1b-86cf-b9367921b7b0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1877006951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2efafc26c47c4050bd367c47469999fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87426a6f-01", "ovs_interfaceid": "87426a6f-0164-4df3-aad0-becbbbfe8310", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 18:44:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-3d7dccba-4b2c-47a9-8b81-531318374497 req-18268baa-d8f7-48ff-bff6-fe58a2a1d0d9 service nova] Acquired lock "refresh_cache-d589d57e-de50-482a-843f-e8246b3d7528" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 18:44:58 user nova-compute[75216]: DEBUG nova.network.neutron [req-3d7dccba-4b2c-47a9-8b81-531318374497 req-18268baa-d8f7-48ff-bff6-fe58a2a1d0d9 service nova] [instance: d589d57e-de50-482a-843f-e8246b3d7528] Refreshing network info cache for port 87426a6f-0164-4df3-aad0-becbbbfe8310 {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 18:44:58 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-a40e45ec-1b6c-470c-b24c-ef32df4b0617 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] [instance: d589d57e-de50-482a-843f-e8246b3d7528] Start _get_guest_xml network_info=[{"id": "87426a6f-0164-4df3-aad0-becbbbfe8310", "address": "fa:16:3e:64:4d:81", "network": {"id": "6d182db1-03b5-4d1b-86cf-b9367921b7b0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1877006951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2efafc26c47c4050bd367c47469999fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87426a6f-01", "ovs_interfaceid": "87426a6f-0164-4df3-aad0-becbbbfe8310", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T18:41:06Z,direct_url=<?>,disk_format='qcow2',id=77bcb5ba-8510-41ec-a88d-96097bb431de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c465b7c26ec44582b6d1b7169536ecc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T18:41:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'guest_format': None, 'boot_index': 0, 'image_id': '77bcb5ba-8510-41ec-a88d-96097bb431de'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 18:44:58 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-a40e45ec-1b6c-470c-b24c-ef32df4b0617 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 18:44:58 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-a40e45ec-1b6c-470c-b24c-ef32df4b0617 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 18:44:58 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-a40e45ec-1b6c-470c-b24c-ef32df4b0617 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 18:44:58 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-a40e45ec-1b6c-470c-b24c-ef32df4b0617 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] CPU controller missing on host. {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 18:44:58 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-a40e45ec-1b6c-470c-b24c-ef32df4b0617 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 18:44:58 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-a40e45ec-1b6c-470c-b24c-ef32df4b0617 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] CPU controller found on host. {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 18:44:58 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-a40e45ec-1b6c-470c-b24c-ef32df4b0617 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75216) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 18:44:58 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-a40e45ec-1b6c-470c-b24c-ef32df4b0617 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T18:40:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T18:41:06Z,direct_url=<?>,disk_format='qcow2',id=77bcb5ba-8510-41ec-a88d-96097bb431de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c465b7c26ec44582b6d1b7169536ecc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T18:41:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 18:44:58 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-a40e45ec-1b6c-470c-b24c-ef32df4b0617 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Flavor limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 18:44:58 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-a40e45ec-1b6c-470c-b24c-ef32df4b0617 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Image limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 18:44:58 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-a40e45ec-1b6c-470c-b24c-ef32df4b0617 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Flavor pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 18:44:58 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-a40e45ec-1b6c-470c-b24c-ef32df4b0617 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Image pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 18:44:58 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-a40e45ec-1b6c-470c-b24c-ef32df4b0617 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 18:44:58 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-a40e45ec-1b6c-470c-b24c-ef32df4b0617 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 18:44:58 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-a40e45ec-1b6c-470c-b24c-ef32df4b0617 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 18:44:58 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-a40e45ec-1b6c-470c-b24c-ef32df4b0617 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Got 1 possible topologies {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 18:44:58 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-a40e45ec-1b6c-470c-b24c-ef32df4b0617 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 18:44:58 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-a40e45ec-1b6c-470c-b24c-ef32df4b0617 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 18:44:58 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-a40e45ec-1b6c-470c-b24c-ef32df4b0617 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T18:44:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2144084973',display_name='tempest-ServerRescueNegativeTestJSON-server-2144084973',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2144084973',id=3,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2efafc26c47c4050bd367c47469999fb',ramdisk_id='',reservation_id='r-4hj1xmlx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-165310019',owner_user_name='tempest-ServerRescueNegativeTestJSON-165310019-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T18:44:50Z,user_data=None,user_id='3587565f5b56450e95f2bd572d7e4f88',uuid=d589d57e-de50-482a-843f-e8246b3d7528,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "87426a6f-0164-4df3-aad0-becbbbfe8310", "address": "fa:16:3e:64:4d:81", "network": {"id": "6d182db1-03b5-4d1b-86cf-b9367921b7b0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1877006951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2efafc26c47c4050bd367c47469999fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87426a6f-01", "ovs_interfaceid": "87426a6f-0164-4df3-aad0-becbbbfe8310", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75216) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 18:44:58 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-a40e45ec-1b6c-470c-b24c-ef32df4b0617 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Converting VIF {"id": "87426a6f-0164-4df3-aad0-becbbbfe8310", "address": "fa:16:3e:64:4d:81", "network": {"id": "6d182db1-03b5-4d1b-86cf-b9367921b7b0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1877006951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2efafc26c47c4050bd367c47469999fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87426a6f-01", "ovs_interfaceid": "87426a6f-0164-4df3-aad0-becbbbfe8310", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 18:44:58 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-a40e45ec-1b6c-470c-b24c-ef32df4b0617 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:4d:81,bridge_name='br-int',has_traffic_filtering=True,id=87426a6f-0164-4df3-aad0-becbbbfe8310,network=Network(6d182db1-03b5-4d1b-86cf-b9367921b7b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87426a6f-01') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 18:44:58 user nova-compute[75216]: DEBUG nova.objects.instance [None req-a40e45ec-1b6c-470c-b24c-ef32df4b0617 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Lazy-loading 'pci_devices' on Instance uuid d589d57e-de50-482a-843f-e8246b3d7528 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 18:44:58 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-a40e45ec-1b6c-470c-b24c-ef32df4b0617 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] [instance: d589d57e-de50-482a-843f-e8246b3d7528] End _get_guest_xml xml=<domain type="kvm">
Nov 13 18:44:58 user nova-compute[75216]:   <uuid>d589d57e-de50-482a-843f-e8246b3d7528</uuid>
Nov 13 18:44:58 user nova-compute[75216]:   <name>instance-00000003</name>
Nov 13 18:44:58 user nova-compute[75216]:   <memory>524288</memory>
Nov 13 18:44:58 user nova-compute[75216]:   <vcpu>1</vcpu>
Nov 13 18:44:58 user nova-compute[75216]:   <metadata>
Nov 13 18:44:58 user nova-compute[75216]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 18:44:58 user nova-compute[75216]:       <nova:package version="0.0.0"/>
Nov 13 18:44:58 user nova-compute[75216]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-2144084973</nova:name>
Nov 13 18:44:58 user nova-compute[75216]:       <nova:creationTime>2023-11-13 18:44:58</nova:creationTime>
Nov 13 18:44:58 user nova-compute[75216]:       <nova:flavor name="m1.tiny">
Nov 13 18:44:58 user nova-compute[75216]:         <nova:memory>512</nova:memory>
Nov 13 18:44:58 user nova-compute[75216]:         <nova:disk>1</nova:disk>
Nov 13 18:44:58 user nova-compute[75216]:         <nova:swap>0</nova:swap>
Nov 13 18:44:58 user nova-compute[75216]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 18:44:58 user nova-compute[75216]:         <nova:vcpus>1</nova:vcpus>
Nov 13 18:44:58 user nova-compute[75216]:       </nova:flavor>
Nov 13 18:44:58 user nova-compute[75216]:       <nova:owner>
Nov 13 18:44:58 user nova-compute[75216]:         <nova:user uuid="3587565f5b56450e95f2bd572d7e4f88">tempest-ServerRescueNegativeTestJSON-165310019-project-member</nova:user>
Nov 13 18:44:58 user nova-compute[75216]:         <nova:project uuid="2efafc26c47c4050bd367c47469999fb">tempest-ServerRescueNegativeTestJSON-165310019</nova:project>
Nov 13 18:44:58 user nova-compute[75216]:       </nova:owner>
Nov 13 18:44:58 user nova-compute[75216]:       <nova:root type="image" uuid="77bcb5ba-8510-41ec-a88d-96097bb431de"/>
Nov 13 18:44:58 user nova-compute[75216]:       <nova:ports>
Nov 13 18:44:58 user nova-compute[75216]:         <nova:port uuid="87426a6f-0164-4df3-aad0-becbbbfe8310">
Nov 13 18:44:58 user nova-compute[75216]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 13 18:44:58 user nova-compute[75216]:         </nova:port>
Nov 13 18:44:58 user nova-compute[75216]:       </nova:ports>
Nov 13 18:44:58 user nova-compute[75216]:     </nova:instance>
Nov 13 18:44:58 user nova-compute[75216]:   </metadata>
Nov 13 18:44:58 user nova-compute[75216]:   <sysinfo type="smbios">
Nov 13 18:44:58 user nova-compute[75216]:     <system>
Nov 13 18:44:58 user nova-compute[75216]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 18:44:58 user nova-compute[75216]:       <entry name="product">OpenStack Nova</entry>
Nov 13 18:44:58 user nova-compute[75216]:       <entry name="version">0.0.0</entry>
Nov 13 18:44:58 user nova-compute[75216]:       <entry name="serial">d589d57e-de50-482a-843f-e8246b3d7528</entry>
Nov 13 18:44:58 user nova-compute[75216]:       <entry name="uuid">d589d57e-de50-482a-843f-e8246b3d7528</entry>
Nov 13 18:44:58 user nova-compute[75216]:       <entry name="family">Virtual Machine</entry>
Nov 13 18:44:58 user nova-compute[75216]:     </system>
Nov 13 18:44:58 user nova-compute[75216]:   </sysinfo>
Nov 13 18:44:58 user nova-compute[75216]:   <os>
Nov 13 18:44:58 user nova-compute[75216]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 18:44:58 user nova-compute[75216]:     <boot dev="hd"/>
Nov 13 18:44:58 user nova-compute[75216]:     <smbios mode="sysinfo"/>
Nov 13 18:44:58 user nova-compute[75216]:   </os>
Nov 13 18:44:58 user nova-compute[75216]:   <features>
Nov 13 18:44:58 user nova-compute[75216]:     <acpi/>
Nov 13 18:44:58 user nova-compute[75216]:     <apic/>
Nov 13 18:44:58 user nova-compute[75216]:     <vmcoreinfo/>
Nov 13 18:44:58 user nova-compute[75216]:   </features>
Nov 13 18:44:58 user nova-compute[75216]:   <clock offset="utc">
Nov 13 18:44:58 user nova-compute[75216]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 18:44:58 user nova-compute[75216]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 18:44:58 user nova-compute[75216]:     <timer name="hpet" present="no"/>
Nov 13 18:44:58 user nova-compute[75216]:   </clock>
Nov 13 18:44:58 user nova-compute[75216]:   <cpu mode="custom" match="exact">
Nov 13 18:44:58 user nova-compute[75216]:     <model>Nehalem</model>
Nov 13 18:44:58 user nova-compute[75216]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 18:44:58 user nova-compute[75216]:   </cpu>
Nov 13 18:44:58 user nova-compute[75216]:   <devices>
Nov 13 18:44:58 user nova-compute[75216]:     <disk type="file" device="disk">
Nov 13 18:44:58 user nova-compute[75216]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 18:44:58 user nova-compute[75216]:       <source file="/opt/stack/data/nova/instances/d589d57e-de50-482a-843f-e8246b3d7528/disk"/>
Nov 13 18:44:58 user nova-compute[75216]:       <target dev="vda" bus="virtio"/>
Nov 13 18:44:58 user nova-compute[75216]:     </disk>
Nov 13 18:44:58 user nova-compute[75216]:     <interface type="ethernet">
Nov 13 18:44:58 user nova-compute[75216]:       <mac address="fa:16:3e:64:4d:81"/>
Nov 13 18:44:58 user nova-compute[75216]:       <model type="virtio"/>
Nov 13 18:44:58 user nova-compute[75216]:       <mtu size="1442"/>
Nov 13 18:44:58 user nova-compute[75216]:       <target dev="tap87426a6f-01"/>
Nov 13 18:44:58 user nova-compute[75216]:     </interface>
Nov 13 18:44:58 user nova-compute[75216]:     <serial type="pty">
Nov 13 18:44:58 user nova-compute[75216]:       <log file="/opt/stack/data/nova/instances/d589d57e-de50-482a-843f-e8246b3d7528/console.log" append="off"/>
Nov 13 18:44:58 user nova-compute[75216]:     </serial>
Nov 13 18:44:58 user nova-compute[75216]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 18:44:58 user nova-compute[75216]:     <video>
Nov 13 18:44:58 user nova-compute[75216]:       <model type="virtio"/>
Nov 13 18:44:58 user nova-compute[75216]:     </video>
Nov 13 18:44:58 user nova-compute[75216]:     <rng model="virtio">
Nov 13 18:44:58 user nova-compute[75216]:       <backend model="random">/dev/urandom</backend>
Nov 13 18:44:58 user nova-compute[75216]:     </rng>
Nov 13 18:44:58 user nova-compute[75216]:     <controller type="usb" index="0" model="none"/>
Nov 13 18:44:58 user nova-compute[75216]:     <memballoon model="virtio">
Nov 13 18:44:58 user nova-compute[75216]:       <stats period="10"/>
Nov 13 18:44:58 user nova-compute[75216]:     </memballoon>
Nov 13 18:44:58 user nova-compute[75216]:   </devices>
Nov 13 18:44:58 user nova-compute[75216]: </domain>
Nov 13 18:44:58 user nova-compute[75216]:  {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 18:44:58 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-a40e45ec-1b6c-470c-b24c-ef32df4b0617 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T18:44:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2144084973',display_name='tempest-ServerRescueNegativeTestJSON-server-2144084973',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2144084973',id=3,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2efafc26c47c4050bd367c47469999fb',ramdisk_id='',reservation_id='r-4hj1xmlx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-165310019',owner_user_name='tempest-ServerRescueNegativeTestJSON-165310019-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T18:44:50Z,user_data=None,user_id='3587565f5b56450e95f2bd572d7e4f88',uuid=d589d57e-de50-482a-843f-e8246b3d7528,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "87426a6f-0164-4df3-aad0-becbbbfe8310", "address": "fa:16:3e:64:4d:81", "network": {"id": "6d182db1-03b5-4d1b-86cf-b9367921b7b0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1877006951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2efafc26c47c4050bd367c47469999fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87426a6f-01", "ovs_interfaceid": "87426a6f-0164-4df3-aad0-becbbbfe8310", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 18:44:58 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-a40e45ec-1b6c-470c-b24c-ef32df4b0617 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Converting VIF {"id": "87426a6f-0164-4df3-aad0-becbbbfe8310", "address": "fa:16:3e:64:4d:81", "network": {"id": "6d182db1-03b5-4d1b-86cf-b9367921b7b0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1877006951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2efafc26c47c4050bd367c47469999fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87426a6f-01", "ovs_interfaceid": "87426a6f-0164-4df3-aad0-becbbbfe8310", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 18:44:58 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-a40e45ec-1b6c-470c-b24c-ef32df4b0617 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:4d:81,bridge_name='br-int',has_traffic_filtering=True,id=87426a6f-0164-4df3-aad0-becbbbfe8310,network=Network(6d182db1-03b5-4d1b-86cf-b9367921b7b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87426a6f-01') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 18:44:58 user nova-compute[75216]: DEBUG os_vif [None req-a40e45ec-1b6c-470c-b24c-ef32df4b0617 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:4d:81,bridge_name='br-int',has_traffic_filtering=True,id=87426a6f-0164-4df3-aad0-becbbbfe8310,network=Network(6d182db1-03b5-4d1b-86cf-b9367921b7b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87426a6f-01') {{(pid=75216) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 18:44:58 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:44:58 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:44:58 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 18:44:58 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:44:58 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5c8f7766-2370-56eb-beb4-818000b1e81f', '_type': 'linux-noop'}}, row=False) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:44:58 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:44:58 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:44:58 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:44:58 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:44:58 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap87426a6f-01, may_exist=True, interface_attrs={}) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:44:58 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap87426a6f-01, col_values=(('qos', UUID('c8c9eac1-e5b4-4bd1-bb11-7e5356f6fa1f')),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:44:58 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap87426a6f-01, col_values=(('external_ids', {'iface-id': '87426a6f-0164-4df3-aad0-becbbbfe8310', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:64:4d:81', 'vm-uuid': 'd589d57e-de50-482a-843f-e8246b3d7528'}),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:44:58 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:44:58 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:44:58 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:44:58 user nova-compute[75216]: INFO os_vif [None req-a40e45ec-1b6c-470c-b24c-ef32df4b0617 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:4d:81,bridge_name='br-int',has_traffic_filtering=True,id=87426a6f-0164-4df3-aad0-becbbbfe8310,network=Network(6d182db1-03b5-4d1b-86cf-b9367921b7b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87426a6f-01')
Nov 13 18:44:58 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-a40e45ec-1b6c-470c-b24c-ef32df4b0617 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 18:44:58 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-a40e45ec-1b6c-470c-b24c-ef32df4b0617 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] No VIF found with MAC fa:16:3e:64:4d:81, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 18:44:58 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:44:58 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:44:58 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:44:58 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:44:59 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:44:59 user nova-compute[75216]: DEBUG nova.network.neutron [req-3d7dccba-4b2c-47a9-8b81-531318374497 req-18268baa-d8f7-48ff-bff6-fe58a2a1d0d9 service nova] [instance: d589d57e-de50-482a-843f-e8246b3d7528] Updated VIF entry in instance network info cache for port 87426a6f-0164-4df3-aad0-becbbbfe8310. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 18:44:59 user nova-compute[75216]: DEBUG nova.network.neutron [req-3d7dccba-4b2c-47a9-8b81-531318374497 req-18268baa-d8f7-48ff-bff6-fe58a2a1d0d9 service nova] [instance: d589d57e-de50-482a-843f-e8246b3d7528] Updating instance_info_cache with network_info: [{"id": "87426a6f-0164-4df3-aad0-becbbbfe8310", "address": "fa:16:3e:64:4d:81", "network": {"id": "6d182db1-03b5-4d1b-86cf-b9367921b7b0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1877006951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2efafc26c47c4050bd367c47469999fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87426a6f-01", "ovs_interfaceid": "87426a6f-0164-4df3-aad0-becbbbfe8310", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 18:44:59 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-3d7dccba-4b2c-47a9-8b81-531318374497 req-18268baa-d8f7-48ff-bff6-fe58a2a1d0d9 service nova] Releasing lock "refresh_cache-d589d57e-de50-482a-843f-e8246b3d7528" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 18:44:59 user nova-compute[75216]: DEBUG nova.network.neutron [None req-e02eca4f-180d-4b47-b6d8-392888b3a272 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] [instance: 9b078f75-57f2-495a-abd5-f8adf72db80b] Successfully updated port: 96bda2a6-53d1-4052-9230-4907fe60d70b {{(pid=75216) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 18:44:59 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:44:59 user nova-compute[75216]: DEBUG nova.compute.manager [req-87939085-973c-43ae-af49-f72a05d5c843 req-c0b22bf1-ebbf-47db-acec-fe2209c26db0 service nova] [instance: 9b078f75-57f2-495a-abd5-f8adf72db80b] Received event network-changed-96bda2a6-53d1-4052-9230-4907fe60d70b {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:44:59 user nova-compute[75216]: DEBUG nova.compute.manager [req-87939085-973c-43ae-af49-f72a05d5c843 req-c0b22bf1-ebbf-47db-acec-fe2209c26db0 service nova] [instance: 9b078f75-57f2-495a-abd5-f8adf72db80b] Refreshing instance network info cache due to event network-changed-96bda2a6-53d1-4052-9230-4907fe60d70b. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 18:44:59 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-87939085-973c-43ae-af49-f72a05d5c843 req-c0b22bf1-ebbf-47db-acec-fe2209c26db0 service nova] Acquiring lock "refresh_cache-9b078f75-57f2-495a-abd5-f8adf72db80b" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 18:44:59 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-87939085-973c-43ae-af49-f72a05d5c843 req-c0b22bf1-ebbf-47db-acec-fe2209c26db0 service nova] Acquired lock "refresh_cache-9b078f75-57f2-495a-abd5-f8adf72db80b" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 18:44:59 user nova-compute[75216]: DEBUG nova.network.neutron [req-87939085-973c-43ae-af49-f72a05d5c843 req-c0b22bf1-ebbf-47db-acec-fe2209c26db0 service nova] [instance: 9b078f75-57f2-495a-abd5-f8adf72db80b] Refreshing network info cache for port 96bda2a6-53d1-4052-9230-4907fe60d70b {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 18:44:59 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e02eca4f-180d-4b47-b6d8-392888b3a272 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] Acquiring lock "refresh_cache-9b078f75-57f2-495a-abd5-f8adf72db80b" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 18:44:59 user nova-compute[75216]: DEBUG nova.network.neutron [req-87939085-973c-43ae-af49-f72a05d5c843 req-c0b22bf1-ebbf-47db-acec-fe2209c26db0 service nova] [instance: 9b078f75-57f2-495a-abd5-f8adf72db80b] Instance cache missing network info. {{(pid=75216) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 18:45:00 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:45:00 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:45:00 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:45:00 user nova-compute[75216]: DEBUG nova.network.neutron [req-87939085-973c-43ae-af49-f72a05d5c843 req-c0b22bf1-ebbf-47db-acec-fe2209c26db0 service nova] [instance: 9b078f75-57f2-495a-abd5-f8adf72db80b] Updating instance_info_cache with network_info: [] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 18:45:00 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-87939085-973c-43ae-af49-f72a05d5c843 req-c0b22bf1-ebbf-47db-acec-fe2209c26db0 service nova] Releasing lock "refresh_cache-9b078f75-57f2-495a-abd5-f8adf72db80b" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 18:45:00 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e02eca4f-180d-4b47-b6d8-392888b3a272 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] Acquired lock "refresh_cache-9b078f75-57f2-495a-abd5-f8adf72db80b" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 18:45:00 user nova-compute[75216]: DEBUG nova.network.neutron [None req-e02eca4f-180d-4b47-b6d8-392888b3a272 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] [instance: 9b078f75-57f2-495a-abd5-f8adf72db80b] Building network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 18:45:00 user nova-compute[75216]: DEBUG nova.network.neutron [None req-e02eca4f-180d-4b47-b6d8-392888b3a272 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] [instance: 9b078f75-57f2-495a-abd5-f8adf72db80b] Instance cache missing network info. {{(pid=75216) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 18:45:00 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:45:00 user nova-compute[75216]: DEBUG nova.compute.manager [req-890f5302-8c39-4c57-b7f1-ac004c1b6555 req-f72130d5-3809-4709-a65c-421222fd0e8f service nova] [instance: 347acafc-985e-4fa2-b286-07ea3b2e4033] Received event network-vif-plugged-b7cb649d-2a7c-4b50-9844-8a96f99b5b11 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:45:00 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-890f5302-8c39-4c57-b7f1-ac004c1b6555 req-f72130d5-3809-4709-a65c-421222fd0e8f service nova] Acquiring lock "347acafc-985e-4fa2-b286-07ea3b2e4033-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:45:00 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-890f5302-8c39-4c57-b7f1-ac004c1b6555 req-f72130d5-3809-4709-a65c-421222fd0e8f service nova] Lock "347acafc-985e-4fa2-b286-07ea3b2e4033-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:45:00 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-890f5302-8c39-4c57-b7f1-ac004c1b6555 req-f72130d5-3809-4709-a65c-421222fd0e8f service nova] Lock "347acafc-985e-4fa2-b286-07ea3b2e4033-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:45:00 user nova-compute[75216]: DEBUG nova.compute.manager [req-890f5302-8c39-4c57-b7f1-ac004c1b6555 req-f72130d5-3809-4709-a65c-421222fd0e8f service nova] [instance: 347acafc-985e-4fa2-b286-07ea3b2e4033] No waiting events found dispatching network-vif-plugged-b7cb649d-2a7c-4b50-9844-8a96f99b5b11 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:45:00 user nova-compute[75216]: WARNING nova.compute.manager [req-890f5302-8c39-4c57-b7f1-ac004c1b6555 req-f72130d5-3809-4709-a65c-421222fd0e8f service nova] [instance: 347acafc-985e-4fa2-b286-07ea3b2e4033] Received unexpected event network-vif-plugged-b7cb649d-2a7c-4b50-9844-8a96f99b5b11 for instance with vm_state building and task_state spawning.
Nov 13 18:45:01 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:45:01 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:45:01 user nova-compute[75216]: DEBUG nova.network.neutron [None req-e02eca4f-180d-4b47-b6d8-392888b3a272 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] [instance: 9b078f75-57f2-495a-abd5-f8adf72db80b] Updating instance_info_cache with network_info: [{"id": "96bda2a6-53d1-4052-9230-4907fe60d70b", "address": "fa:16:3e:30:88:c4", "network": {"id": "eac74a7f-b8a0-4653-82a9-1113186e7682", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1781360101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e76353a038ca478598ddd984f4503e34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96bda2a6-53", "ovs_interfaceid": "96bda2a6-53d1-4052-9230-4907fe60d70b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 18:45:02 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e02eca4f-180d-4b47-b6d8-392888b3a272 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] Releasing lock "refresh_cache-9b078f75-57f2-495a-abd5-f8adf72db80b" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 18:45:02 user nova-compute[75216]: DEBUG nova.compute.manager [None req-e02eca4f-180d-4b47-b6d8-392888b3a272 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] [instance: 9b078f75-57f2-495a-abd5-f8adf72db80b] Instance network_info: |[{"id": "96bda2a6-53d1-4052-9230-4907fe60d70b", "address": "fa:16:3e:30:88:c4", "network": {"id": "eac74a7f-b8a0-4653-82a9-1113186e7682", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1781360101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e76353a038ca478598ddd984f4503e34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96bda2a6-53", "ovs_interfaceid": "96bda2a6-53d1-4052-9230-4907fe60d70b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 18:45:02 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-e02eca4f-180d-4b47-b6d8-392888b3a272 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] [instance: 9b078f75-57f2-495a-abd5-f8adf72db80b] Start _get_guest_xml network_info=[{"id": "96bda2a6-53d1-4052-9230-4907fe60d70b", "address": "fa:16:3e:30:88:c4", "network": {"id": "eac74a7f-b8a0-4653-82a9-1113186e7682", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1781360101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e76353a038ca478598ddd984f4503e34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96bda2a6-53", "ovs_interfaceid": "96bda2a6-53d1-4052-9230-4907fe60d70b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T18:41:06Z,direct_url=<?>,disk_format='qcow2',id=77bcb5ba-8510-41ec-a88d-96097bb431de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c465b7c26ec44582b6d1b7169536ecc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T18:41:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'guest_format': None, 'boot_index': 0, 'image_id': '77bcb5ba-8510-41ec-a88d-96097bb431de'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 18:45:02 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-e02eca4f-180d-4b47-b6d8-392888b3a272 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 18:45:02 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-e02eca4f-180d-4b47-b6d8-392888b3a272 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 18:45:02 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-e02eca4f-180d-4b47-b6d8-392888b3a272 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 18:45:02 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-e02eca4f-180d-4b47-b6d8-392888b3a272 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] CPU controller missing on host. {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 18:45:02 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-e02eca4f-180d-4b47-b6d8-392888b3a272 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 18:45:02 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-e02eca4f-180d-4b47-b6d8-392888b3a272 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] CPU controller found on host. {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 18:45:02 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-e02eca4f-180d-4b47-b6d8-392888b3a272 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75216) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 18:45:02 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-e02eca4f-180d-4b47-b6d8-392888b3a272 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T18:40:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T18:41:06Z,direct_url=<?>,disk_format='qcow2',id=77bcb5ba-8510-41ec-a88d-96097bb431de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c465b7c26ec44582b6d1b7169536ecc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T18:41:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 18:45:02 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-e02eca4f-180d-4b47-b6d8-392888b3a272 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] Flavor limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 18:45:02 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-e02eca4f-180d-4b47-b6d8-392888b3a272 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] Image limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 18:45:02 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-e02eca4f-180d-4b47-b6d8-392888b3a272 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] Flavor pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 18:45:02 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-e02eca4f-180d-4b47-b6d8-392888b3a272 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] Image pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 18:45:02 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-e02eca4f-180d-4b47-b6d8-392888b3a272 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 18:45:02 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-e02eca4f-180d-4b47-b6d8-392888b3a272 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 18:45:02 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-e02eca4f-180d-4b47-b6d8-392888b3a272 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 18:45:02 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-e02eca4f-180d-4b47-b6d8-392888b3a272 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] Got 1 possible topologies {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 18:45:02 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-e02eca4f-180d-4b47-b6d8-392888b3a272 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 18:45:02 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-e02eca4f-180d-4b47-b6d8-392888b3a272 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 18:45:02 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-e02eca4f-180d-4b47-b6d8-392888b3a272 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T18:44:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-2037924683',display_name='tempest-ServerStableDeviceRescueTest-server-2037924683',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-2037924683',id=5,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDyNRjKkEXE946W7ATv6X8QWLmngeHlSnPG/JxUF3ZiVINBi3q8Kko9NDXYQqGAv1e8V8a0QDwPM0ffhuobkkIWKpFKPb2hwJDWRakg7VKmbTavuHCqEjEADGU4Zo+roSw==',key_name='tempest-keypair-1672182613',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e76353a038ca478598ddd984f4503e34',ramdisk_id='',reservation_id='r-n2dzdbze',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-689881972',owner_user_name='tempest-ServerStableDeviceRescueTest-689881972-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T18:44:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b114ba28a4124b14a9376346953075bf',uuid=9b078f75-57f2-495a-abd5-f8adf72db80b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "96bda2a6-53d1-4052-9230-4907fe60d70b", "address": "fa:16:3e:30:88:c4", "network": {"id": "eac74a7f-b8a0-4653-82a9-1113186e7682", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1781360101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e76353a038ca478598ddd984f4503e34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96bda2a6-53", "ovs_interfaceid": "96bda2a6-53d1-4052-9230-4907fe60d70b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75216) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 18:45:02 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-e02eca4f-180d-4b47-b6d8-392888b3a272 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] Converting VIF {"id": "96bda2a6-53d1-4052-9230-4907fe60d70b", "address": "fa:16:3e:30:88:c4", "network": {"id": "eac74a7f-b8a0-4653-82a9-1113186e7682", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1781360101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e76353a038ca478598ddd984f4503e34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96bda2a6-53", "ovs_interfaceid": "96bda2a6-53d1-4052-9230-4907fe60d70b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 18:45:02 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-e02eca4f-180d-4b47-b6d8-392888b3a272 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:88:c4,bridge_name='br-int',has_traffic_filtering=True,id=96bda2a6-53d1-4052-9230-4907fe60d70b,network=Network(eac74a7f-b8a0-4653-82a9-1113186e7682),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96bda2a6-53') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 18:45:02 user nova-compute[75216]: DEBUG nova.objects.instance [None req-e02eca4f-180d-4b47-b6d8-392888b3a272 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] Lazy-loading 'pci_devices' on Instance uuid 9b078f75-57f2-495a-abd5-f8adf72db80b {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 18:45:02 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-e02eca4f-180d-4b47-b6d8-392888b3a272 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] [instance: 9b078f75-57f2-495a-abd5-f8adf72db80b] End _get_guest_xml xml=<domain type="kvm">
Nov 13 18:45:02 user nova-compute[75216]:   <uuid>9b078f75-57f2-495a-abd5-f8adf72db80b</uuid>
Nov 13 18:45:02 user nova-compute[75216]:   <name>instance-00000005</name>
Nov 13 18:45:02 user nova-compute[75216]:   <memory>524288</memory>
Nov 13 18:45:02 user nova-compute[75216]:   <vcpu>1</vcpu>
Nov 13 18:45:02 user nova-compute[75216]:   <metadata>
Nov 13 18:45:02 user nova-compute[75216]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 18:45:02 user nova-compute[75216]:       <nova:package version="0.0.0"/>
Nov 13 18:45:02 user nova-compute[75216]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-2037924683</nova:name>
Nov 13 18:45:02 user nova-compute[75216]:       <nova:creationTime>2023-11-13 18:45:02</nova:creationTime>
Nov 13 18:45:02 user nova-compute[75216]:       <nova:flavor name="m1.tiny">
Nov 13 18:45:02 user nova-compute[75216]:         <nova:memory>512</nova:memory>
Nov 13 18:45:02 user nova-compute[75216]:         <nova:disk>1</nova:disk>
Nov 13 18:45:02 user nova-compute[75216]:         <nova:swap>0</nova:swap>
Nov 13 18:45:02 user nova-compute[75216]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 18:45:02 user nova-compute[75216]:         <nova:vcpus>1</nova:vcpus>
Nov 13 18:45:02 user nova-compute[75216]:       </nova:flavor>
Nov 13 18:45:02 user nova-compute[75216]:       <nova:owner>
Nov 13 18:45:02 user nova-compute[75216]:         <nova:user uuid="b114ba28a4124b14a9376346953075bf">tempest-ServerStableDeviceRescueTest-689881972-project-member</nova:user>
Nov 13 18:45:02 user nova-compute[75216]:         <nova:project uuid="e76353a038ca478598ddd984f4503e34">tempest-ServerStableDeviceRescueTest-689881972</nova:project>
Nov 13 18:45:02 user nova-compute[75216]:       </nova:owner>
Nov 13 18:45:02 user nova-compute[75216]:       <nova:root type="image" uuid="77bcb5ba-8510-41ec-a88d-96097bb431de"/>
Nov 13 18:45:02 user nova-compute[75216]:       <nova:ports>
Nov 13 18:45:02 user nova-compute[75216]:         <nova:port uuid="96bda2a6-53d1-4052-9230-4907fe60d70b">
Nov 13 18:45:02 user nova-compute[75216]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 13 18:45:02 user nova-compute[75216]:         </nova:port>
Nov 13 18:45:02 user nova-compute[75216]:       </nova:ports>
Nov 13 18:45:02 user nova-compute[75216]:     </nova:instance>
Nov 13 18:45:02 user nova-compute[75216]:   </metadata>
Nov 13 18:45:02 user nova-compute[75216]:   <sysinfo type="smbios">
Nov 13 18:45:02 user nova-compute[75216]:     <system>
Nov 13 18:45:02 user nova-compute[75216]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 18:45:02 user nova-compute[75216]:       <entry name="product">OpenStack Nova</entry>
Nov 13 18:45:02 user nova-compute[75216]:       <entry name="version">0.0.0</entry>
Nov 13 18:45:02 user nova-compute[75216]:       <entry name="serial">9b078f75-57f2-495a-abd5-f8adf72db80b</entry>
Nov 13 18:45:02 user nova-compute[75216]:       <entry name="uuid">9b078f75-57f2-495a-abd5-f8adf72db80b</entry>
Nov 13 18:45:02 user nova-compute[75216]:       <entry name="family">Virtual Machine</entry>
Nov 13 18:45:02 user nova-compute[75216]:     </system>
Nov 13 18:45:02 user nova-compute[75216]:   </sysinfo>
Nov 13 18:45:02 user nova-compute[75216]:   <os>
Nov 13 18:45:02 user nova-compute[75216]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 18:45:02 user nova-compute[75216]:     <boot dev="hd"/>
Nov 13 18:45:02 user nova-compute[75216]:     <smbios mode="sysinfo"/>
Nov 13 18:45:02 user nova-compute[75216]:   </os>
Nov 13 18:45:02 user nova-compute[75216]:   <features>
Nov 13 18:45:02 user nova-compute[75216]:     <acpi/>
Nov 13 18:45:02 user nova-compute[75216]:     <apic/>
Nov 13 18:45:02 user nova-compute[75216]:     <vmcoreinfo/>
Nov 13 18:45:02 user nova-compute[75216]:   </features>
Nov 13 18:45:02 user nova-compute[75216]:   <clock offset="utc">
Nov 13 18:45:02 user nova-compute[75216]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 18:45:02 user nova-compute[75216]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 18:45:02 user nova-compute[75216]:     <timer name="hpet" present="no"/>
Nov 13 18:45:02 user nova-compute[75216]:   </clock>
Nov 13 18:45:02 user nova-compute[75216]:   <cpu mode="custom" match="exact">
Nov 13 18:45:02 user nova-compute[75216]:     <model>Nehalem</model>
Nov 13 18:45:02 user nova-compute[75216]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 18:45:02 user nova-compute[75216]:   </cpu>
Nov 13 18:45:02 user nova-compute[75216]:   <devices>
Nov 13 18:45:02 user nova-compute[75216]:     <disk type="file" device="disk">
Nov 13 18:45:02 user nova-compute[75216]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 18:45:02 user nova-compute[75216]:       <source file="/opt/stack/data/nova/instances/9b078f75-57f2-495a-abd5-f8adf72db80b/disk"/>
Nov 13 18:45:02 user nova-compute[75216]:       <target dev="vda" bus="virtio"/>
Nov 13 18:45:02 user nova-compute[75216]:     </disk>
Nov 13 18:45:02 user nova-compute[75216]:     <interface type="ethernet">
Nov 13 18:45:02 user nova-compute[75216]:       <mac address="fa:16:3e:30:88:c4"/>
Nov 13 18:45:02 user nova-compute[75216]:       <model type="virtio"/>
Nov 13 18:45:02 user nova-compute[75216]:       <mtu size="1442"/>
Nov 13 18:45:02 user nova-compute[75216]:       <target dev="tap96bda2a6-53"/>
Nov 13 18:45:02 user nova-compute[75216]:     </interface>
Nov 13 18:45:02 user nova-compute[75216]:     <serial type="pty">
Nov 13 18:45:02 user nova-compute[75216]:       <log file="/opt/stack/data/nova/instances/9b078f75-57f2-495a-abd5-f8adf72db80b/console.log" append="off"/>
Nov 13 18:45:02 user nova-compute[75216]:     </serial>
Nov 13 18:45:02 user nova-compute[75216]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 18:45:02 user nova-compute[75216]:     <video>
Nov 13 18:45:02 user nova-compute[75216]:       <model type="virtio"/>
Nov 13 18:45:02 user nova-compute[75216]:     </video>
Nov 13 18:45:02 user nova-compute[75216]:     <rng model="virtio">
Nov 13 18:45:02 user nova-compute[75216]:       <backend model="random">/dev/urandom</backend>
Nov 13 18:45:02 user nova-compute[75216]:     </rng>
Nov 13 18:45:02 user nova-compute[75216]:     <controller type="usb" index="0" model="none"/>
Nov 13 18:45:02 user nova-compute[75216]:     <memballoon model="virtio">
Nov 13 18:45:02 user nova-compute[75216]:       <stats period="10"/>
Nov 13 18:45:02 user nova-compute[75216]:     </memballoon>
Nov 13 18:45:02 user nova-compute[75216]:   </devices>
Nov 13 18:45:02 user nova-compute[75216]: </domain>
Nov 13 18:45:02 user nova-compute[75216]:  {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 18:45:02 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-e02eca4f-180d-4b47-b6d8-392888b3a272 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T18:44:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-2037924683',display_name='tempest-ServerStableDeviceRescueTest-server-2037924683',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-2037924683',id=5,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDyNRjKkEXE946W7ATv6X8QWLmngeHlSnPG/JxUF3ZiVINBi3q8Kko9NDXYQqGAv1e8V8a0QDwPM0ffhuobkkIWKpFKPb2hwJDWRakg7VKmbTavuHCqEjEADGU4Zo+roSw==',key_name='tempest-keypair-1672182613',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e76353a038ca478598ddd984f4503e34',ramdisk_id='',reservation_id='r-n2dzdbze',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-689881972',owner_user_name='tempest-ServerStableDeviceRescueTest-689881972-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T18:44:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b114ba28a4124b14a9376346953075bf',uuid=9b078f75-57f2-495a-abd5-f8adf72db80b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "96bda2a6-53d1-4052-9230-4907fe60d70b", "address": "fa:16:3e:30:88:c4", "network": {"id": "eac74a7f-b8a0-4653-82a9-1113186e7682", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1781360101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e76353a038ca478598ddd984f4503e34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96bda2a6-53", "ovs_interfaceid": "96bda2a6-53d1-4052-9230-4907fe60d70b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 18:45:02 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-e02eca4f-180d-4b47-b6d8-392888b3a272 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] Converting VIF {"id": "96bda2a6-53d1-4052-9230-4907fe60d70b", "address": "fa:16:3e:30:88:c4", "network": {"id": "eac74a7f-b8a0-4653-82a9-1113186e7682", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1781360101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e76353a038ca478598ddd984f4503e34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96bda2a6-53", "ovs_interfaceid": "96bda2a6-53d1-4052-9230-4907fe60d70b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 18:45:02 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-e02eca4f-180d-4b47-b6d8-392888b3a272 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:88:c4,bridge_name='br-int',has_traffic_filtering=True,id=96bda2a6-53d1-4052-9230-4907fe60d70b,network=Network(eac74a7f-b8a0-4653-82a9-1113186e7682),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96bda2a6-53') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 18:45:02 user nova-compute[75216]: DEBUG os_vif [None req-e02eca4f-180d-4b47-b6d8-392888b3a272 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:88:c4,bridge_name='br-int',has_traffic_filtering=True,id=96bda2a6-53d1-4052-9230-4907fe60d70b,network=Network(eac74a7f-b8a0-4653-82a9-1113186e7682),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96bda2a6-53') {{(pid=75216) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 18:45:02 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:45:02 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:45:02 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 18:45:02 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:45:02 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0e2bc469-122d-52bc-8a77-e077d6df90a4', '_type': 'linux-noop'}}, row=False) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:45:02 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:45:02 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:45:02 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:45:02 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap96bda2a6-53, may_exist=True, interface_attrs={}) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:45:02 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap96bda2a6-53, col_values=(('qos', UUID('9364d39d-6774-4e15-ade6-41de231b093b')),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:45:02 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap96bda2a6-53, col_values=(('external_ids', {'iface-id': '96bda2a6-53d1-4052-9230-4907fe60d70b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:30:88:c4', 'vm-uuid': '9b078f75-57f2-495a-abd5-f8adf72db80b'}),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:45:02 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:45:02 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:45:02 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:45:02 user nova-compute[75216]: INFO os_vif [None req-e02eca4f-180d-4b47-b6d8-392888b3a272 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:88:c4,bridge_name='br-int',has_traffic_filtering=True,id=96bda2a6-53d1-4052-9230-4907fe60d70b,network=Network(eac74a7f-b8a0-4653-82a9-1113186e7682),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96bda2a6-53')
Nov 13 18:45:02 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-e02eca4f-180d-4b47-b6d8-392888b3a272 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 18:45:02 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-e02eca4f-180d-4b47-b6d8-392888b3a272 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] No VIF found with MAC fa:16:3e:30:88:c4, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 18:45:02 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:45:02 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:45:02 user nova-compute[75216]: DEBUG nova.compute.manager [req-fc68adb2-9aff-4124-ae5a-235ff8ded52c req-28dc5ebd-1374-45cd-bf4f-eced2803c6b3 service nova] [instance: 347acafc-985e-4fa2-b286-07ea3b2e4033] Received event network-vif-plugged-b7cb649d-2a7c-4b50-9844-8a96f99b5b11 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:45:02 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-fc68adb2-9aff-4124-ae5a-235ff8ded52c req-28dc5ebd-1374-45cd-bf4f-eced2803c6b3 service nova] Acquiring lock "347acafc-985e-4fa2-b286-07ea3b2e4033-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:45:02 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-fc68adb2-9aff-4124-ae5a-235ff8ded52c req-28dc5ebd-1374-45cd-bf4f-eced2803c6b3 service nova] Lock "347acafc-985e-4fa2-b286-07ea3b2e4033-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:45:02 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-fc68adb2-9aff-4124-ae5a-235ff8ded52c req-28dc5ebd-1374-45cd-bf4f-eced2803c6b3 service nova] Lock "347acafc-985e-4fa2-b286-07ea3b2e4033-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:45:03 user nova-compute[75216]: DEBUG nova.compute.manager [req-fc68adb2-9aff-4124-ae5a-235ff8ded52c req-28dc5ebd-1374-45cd-bf4f-eced2803c6b3 service nova] [instance: 347acafc-985e-4fa2-b286-07ea3b2e4033] No waiting events found dispatching network-vif-plugged-b7cb649d-2a7c-4b50-9844-8a96f99b5b11 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:45:03 user nova-compute[75216]: WARNING nova.compute.manager [req-fc68adb2-9aff-4124-ae5a-235ff8ded52c req-28dc5ebd-1374-45cd-bf4f-eced2803c6b3 service nova] [instance: 347acafc-985e-4fa2-b286-07ea3b2e4033] Received unexpected event network-vif-plugged-b7cb649d-2a7c-4b50-9844-8a96f99b5b11 for instance with vm_state building and task_state spawning.
Nov 13 18:45:03 user nova-compute[75216]: DEBUG nova.compute.manager [None req-74f7ff1c-902a-44a8-9e18-2873eadc6591 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: a1a3e849-6570-4820-97c8-75468b5bea4f] Instance event wait completed in 0 seconds for  {{(pid=75216) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 18:45:03 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-74f7ff1c-902a-44a8-9e18-2873eadc6591 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: a1a3e849-6570-4820-97c8-75468b5bea4f] Guest created on hypervisor {{(pid=75216) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 18:45:03 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: a1a3e849-6570-4820-97c8-75468b5bea4f] Instance spawned successfully.
Nov 13 18:45:03 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-74f7ff1c-902a-44a8-9e18-2873eadc6591 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: a1a3e849-6570-4820-97c8-75468b5bea4f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 18:45:03 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-74f7ff1c-902a-44a8-9e18-2873eadc6591 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: a1a3e849-6570-4820-97c8-75468b5bea4f] Found default for hw_cdrom_bus of ide {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 18:45:03 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-74f7ff1c-902a-44a8-9e18-2873eadc6591 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: a1a3e849-6570-4820-97c8-75468b5bea4f] Found default for hw_disk_bus of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 18:45:03 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-74f7ff1c-902a-44a8-9e18-2873eadc6591 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: a1a3e849-6570-4820-97c8-75468b5bea4f] Found default for hw_input_bus of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 18:45:03 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-74f7ff1c-902a-44a8-9e18-2873eadc6591 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: a1a3e849-6570-4820-97c8-75468b5bea4f] Found default for hw_pointer_model of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 18:45:03 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-74f7ff1c-902a-44a8-9e18-2873eadc6591 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: a1a3e849-6570-4820-97c8-75468b5bea4f] Found default for hw_video_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 18:45:03 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-74f7ff1c-902a-44a8-9e18-2873eadc6591 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: a1a3e849-6570-4820-97c8-75468b5bea4f] Found default for hw_vif_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 18:45:03 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:45:03 user nova-compute[75216]: INFO nova.compute.manager [None req-74f7ff1c-902a-44a8-9e18-2873eadc6591 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: a1a3e849-6570-4820-97c8-75468b5bea4f] Took 18.47 seconds to spawn the instance on the hypervisor.
Nov 13 18:45:03 user nova-compute[75216]: DEBUG nova.compute.manager [None req-74f7ff1c-902a-44a8-9e18-2873eadc6591 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: a1a3e849-6570-4820-97c8-75468b5bea4f] Checking state {{(pid=75216) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 18:45:03 user nova-compute[75216]: INFO nova.compute.manager [None req-74f7ff1c-902a-44a8-9e18-2873eadc6591 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: a1a3e849-6570-4820-97c8-75468b5bea4f] Took 19.69 seconds to build instance.
Nov 13 18:45:03 user nova-compute[75216]: DEBUG nova.compute.manager [None req-aeaaf0e6-5466-4de4-b0b0-63e8abd55582 tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] [instance: 347acafc-985e-4fa2-b286-07ea3b2e4033] Instance event wait completed in 0 seconds for  {{(pid=75216) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 18:45:03 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-aeaaf0e6-5466-4de4-b0b0-63e8abd55582 tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] [instance: 347acafc-985e-4fa2-b286-07ea3b2e4033] Guest created on hypervisor {{(pid=75216) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 18:45:03 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 347acafc-985e-4fa2-b286-07ea3b2e4033] Instance spawned successfully.
Nov 13 18:45:03 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-aeaaf0e6-5466-4de4-b0b0-63e8abd55582 tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] [instance: 347acafc-985e-4fa2-b286-07ea3b2e4033] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 18:45:03 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-74f7ff1c-902a-44a8-9e18-2873eadc6591 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Lock "a1a3e849-6570-4820-97c8-75468b5bea4f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.953s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:45:03 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-aeaaf0e6-5466-4de4-b0b0-63e8abd55582 tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] [instance: 347acafc-985e-4fa2-b286-07ea3b2e4033] Found default for hw_cdrom_bus of ide {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 18:45:03 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-aeaaf0e6-5466-4de4-b0b0-63e8abd55582 tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] [instance: 347acafc-985e-4fa2-b286-07ea3b2e4033] Found default for hw_disk_bus of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 18:45:03 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-aeaaf0e6-5466-4de4-b0b0-63e8abd55582 tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] [instance: 347acafc-985e-4fa2-b286-07ea3b2e4033] Found default for hw_input_bus of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 18:45:03 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-aeaaf0e6-5466-4de4-b0b0-63e8abd55582 tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] [instance: 347acafc-985e-4fa2-b286-07ea3b2e4033] Found default for hw_pointer_model of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 18:45:03 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-aeaaf0e6-5466-4de4-b0b0-63e8abd55582 tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] [instance: 347acafc-985e-4fa2-b286-07ea3b2e4033] Found default for hw_video_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 18:45:03 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-aeaaf0e6-5466-4de4-b0b0-63e8abd55582 tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] [instance: 347acafc-985e-4fa2-b286-07ea3b2e4033] Found default for hw_vif_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 18:45:03 user nova-compute[75216]: INFO nova.compute.manager [None req-aeaaf0e6-5466-4de4-b0b0-63e8abd55582 tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] [instance: 347acafc-985e-4fa2-b286-07ea3b2e4033] Took 15.11 seconds to spawn the instance on the hypervisor.
Nov 13 18:45:03 user nova-compute[75216]: DEBUG nova.compute.manager [None req-aeaaf0e6-5466-4de4-b0b0-63e8abd55582 tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] [instance: 347acafc-985e-4fa2-b286-07ea3b2e4033] Checking state {{(pid=75216) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 18:45:03 user nova-compute[75216]: DEBUG nova.compute.manager [req-fa1dc76a-5ac1-4a6f-b3df-bcf4ec503b77 req-1137bc75-5881-46a2-8164-1dce55a9ece2 service nova] [instance: a1a3e849-6570-4820-97c8-75468b5bea4f] Received event network-vif-plugged-3544d3e3-8dfa-4043-b225-77f690cd3760 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:45:03 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-fa1dc76a-5ac1-4a6f-b3df-bcf4ec503b77 req-1137bc75-5881-46a2-8164-1dce55a9ece2 service nova] Acquiring lock "a1a3e849-6570-4820-97c8-75468b5bea4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:45:03 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-fa1dc76a-5ac1-4a6f-b3df-bcf4ec503b77 req-1137bc75-5881-46a2-8164-1dce55a9ece2 service nova] Lock "a1a3e849-6570-4820-97c8-75468b5bea4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:45:03 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-fa1dc76a-5ac1-4a6f-b3df-bcf4ec503b77 req-1137bc75-5881-46a2-8164-1dce55a9ece2 service nova] Lock "a1a3e849-6570-4820-97c8-75468b5bea4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:45:03 user nova-compute[75216]: DEBUG nova.compute.manager [req-fa1dc76a-5ac1-4a6f-b3df-bcf4ec503b77 req-1137bc75-5881-46a2-8164-1dce55a9ece2 service nova] [instance: a1a3e849-6570-4820-97c8-75468b5bea4f] No waiting events found dispatching network-vif-plugged-3544d3e3-8dfa-4043-b225-77f690cd3760 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:45:03 user nova-compute[75216]: WARNING nova.compute.manager [req-fa1dc76a-5ac1-4a6f-b3df-bcf4ec503b77 req-1137bc75-5881-46a2-8164-1dce55a9ece2 service nova] [instance: a1a3e849-6570-4820-97c8-75468b5bea4f] Received unexpected event network-vif-plugged-3544d3e3-8dfa-4043-b225-77f690cd3760 for instance with vm_state active and task_state None.
Nov 13 18:45:03 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:45:03 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:45:04 user nova-compute[75216]: INFO nova.compute.manager [None req-aeaaf0e6-5466-4de4-b0b0-63e8abd55582 tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] [instance: 347acafc-985e-4fa2-b286-07ea3b2e4033] Took 16.06 seconds to build instance.
Nov 13 18:45:04 user nova-compute[75216]: DEBUG nova.compute.manager [None req-bce76d9e-ab55-4efe-b276-000a1ad48f26 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] [instance: 85624c58-6c72-4490-8a3e-547953295ade] Instance event wait completed in 0 seconds for  {{(pid=75216) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 18:45:04 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-bce76d9e-ab55-4efe-b276-000a1ad48f26 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] [instance: 85624c58-6c72-4490-8a3e-547953295ade] Guest created on hypervisor {{(pid=75216) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 18:45:04 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 85624c58-6c72-4490-8a3e-547953295ade] Instance spawned successfully.
Nov 13 18:45:04 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-bce76d9e-ab55-4efe-b276-000a1ad48f26 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] [instance: 85624c58-6c72-4490-8a3e-547953295ade] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 18:45:04 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-aeaaf0e6-5466-4de4-b0b0-63e8abd55582 tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] Lock "347acafc-985e-4fa2-b286-07ea3b2e4033" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.204s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:45:04 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-bce76d9e-ab55-4efe-b276-000a1ad48f26 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] [instance: 85624c58-6c72-4490-8a3e-547953295ade] Found default for hw_cdrom_bus of ide {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 18:45:04 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-bce76d9e-ab55-4efe-b276-000a1ad48f26 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] [instance: 85624c58-6c72-4490-8a3e-547953295ade] Found default for hw_disk_bus of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 18:45:04 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-bce76d9e-ab55-4efe-b276-000a1ad48f26 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] [instance: 85624c58-6c72-4490-8a3e-547953295ade] Found default for hw_input_bus of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 18:45:04 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-bce76d9e-ab55-4efe-b276-000a1ad48f26 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] [instance: 85624c58-6c72-4490-8a3e-547953295ade] Found default for hw_pointer_model of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 18:45:04 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-bce76d9e-ab55-4efe-b276-000a1ad48f26 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] [instance: 85624c58-6c72-4490-8a3e-547953295ade] Found default for hw_video_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 18:45:04 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-bce76d9e-ab55-4efe-b276-000a1ad48f26 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] [instance: 85624c58-6c72-4490-8a3e-547953295ade] Found default for hw_vif_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 18:45:04 user nova-compute[75216]: DEBUG nova.compute.manager [None req-a40e45ec-1b6c-470c-b24c-ef32df4b0617 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] [instance: d589d57e-de50-482a-843f-e8246b3d7528] Instance event wait completed in 0 seconds for  {{(pid=75216) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 18:45:04 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-a40e45ec-1b6c-470c-b24c-ef32df4b0617 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] [instance: d589d57e-de50-482a-843f-e8246b3d7528] Guest created on hypervisor {{(pid=75216) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 18:45:04 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: d589d57e-de50-482a-843f-e8246b3d7528] Instance spawned successfully.
Nov 13 18:45:04 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-a40e45ec-1b6c-470c-b24c-ef32df4b0617 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] [instance: d589d57e-de50-482a-843f-e8246b3d7528] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 18:45:04 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-a40e45ec-1b6c-470c-b24c-ef32df4b0617 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] [instance: d589d57e-de50-482a-843f-e8246b3d7528] Found default for hw_cdrom_bus of ide {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 18:45:04 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-a40e45ec-1b6c-470c-b24c-ef32df4b0617 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] [instance: d589d57e-de50-482a-843f-e8246b3d7528] Found default for hw_disk_bus of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 18:45:04 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-a40e45ec-1b6c-470c-b24c-ef32df4b0617 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] [instance: d589d57e-de50-482a-843f-e8246b3d7528] Found default for hw_input_bus of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 18:45:04 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-a40e45ec-1b6c-470c-b24c-ef32df4b0617 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] [instance: d589d57e-de50-482a-843f-e8246b3d7528] Found default for hw_pointer_model of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 18:45:04 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-a40e45ec-1b6c-470c-b24c-ef32df4b0617 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] [instance: d589d57e-de50-482a-843f-e8246b3d7528] Found default for hw_video_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 18:45:04 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-a40e45ec-1b6c-470c-b24c-ef32df4b0617 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] [instance: d589d57e-de50-482a-843f-e8246b3d7528] Found default for hw_vif_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 18:45:04 user nova-compute[75216]: INFO nova.compute.manager [None req-bce76d9e-ab55-4efe-b276-000a1ad48f26 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] [instance: 85624c58-6c72-4490-8a3e-547953295ade] Took 12.06 seconds to spawn the instance on the hypervisor.
Nov 13 18:45:04 user nova-compute[75216]: DEBUG nova.compute.manager [None req-bce76d9e-ab55-4efe-b276-000a1ad48f26 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] [instance: 85624c58-6c72-4490-8a3e-547953295ade] Checking state {{(pid=75216) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 18:45:04 user nova-compute[75216]: INFO nova.compute.manager [None req-a40e45ec-1b6c-470c-b24c-ef32df4b0617 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] [instance: d589d57e-de50-482a-843f-e8246b3d7528] Took 14.38 seconds to spawn the instance on the hypervisor.
Nov 13 18:45:04 user nova-compute[75216]: DEBUG nova.compute.manager [None req-a40e45ec-1b6c-470c-b24c-ef32df4b0617 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] [instance: d589d57e-de50-482a-843f-e8246b3d7528] Checking state {{(pid=75216) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 18:45:04 user nova-compute[75216]: INFO nova.compute.manager [None req-bce76d9e-ab55-4efe-b276-000a1ad48f26 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] [instance: 85624c58-6c72-4490-8a3e-547953295ade] Took 12.86 seconds to build instance.
Nov 13 18:45:04 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-bce76d9e-ab55-4efe-b276-000a1ad48f26 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Lock "85624c58-6c72-4490-8a3e-547953295ade" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.998s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:45:04 user nova-compute[75216]: INFO nova.compute.manager [None req-a40e45ec-1b6c-470c-b24c-ef32df4b0617 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] [instance: d589d57e-de50-482a-843f-e8246b3d7528] Took 15.72 seconds to build instance.
Nov 13 18:45:04 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a40e45ec-1b6c-470c-b24c-ef32df4b0617 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Lock "d589d57e-de50-482a-843f-e8246b3d7528" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.926s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:45:05 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:45:05 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:45:05 user nova-compute[75216]: DEBUG nova.compute.manager [req-9f2531f1-1e06-471e-8a11-d7f6a6d20102 req-244f7f63-be24-4b84-82f3-094c194078a7 service nova] [instance: a1a3e849-6570-4820-97c8-75468b5bea4f] Received event network-vif-plugged-3544d3e3-8dfa-4043-b225-77f690cd3760 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:45:05 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-9f2531f1-1e06-471e-8a11-d7f6a6d20102 req-244f7f63-be24-4b84-82f3-094c194078a7 service nova] Acquiring lock "a1a3e849-6570-4820-97c8-75468b5bea4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:45:05 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-9f2531f1-1e06-471e-8a11-d7f6a6d20102 req-244f7f63-be24-4b84-82f3-094c194078a7 service nova] Lock "a1a3e849-6570-4820-97c8-75468b5bea4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:45:05 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-9f2531f1-1e06-471e-8a11-d7f6a6d20102 req-244f7f63-be24-4b84-82f3-094c194078a7 service nova] Lock "a1a3e849-6570-4820-97c8-75468b5bea4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:45:05 user nova-compute[75216]: DEBUG nova.compute.manager [req-9f2531f1-1e06-471e-8a11-d7f6a6d20102 req-244f7f63-be24-4b84-82f3-094c194078a7 service nova] [instance: a1a3e849-6570-4820-97c8-75468b5bea4f] No waiting events found dispatching network-vif-plugged-3544d3e3-8dfa-4043-b225-77f690cd3760 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:45:05 user nova-compute[75216]: WARNING nova.compute.manager [req-9f2531f1-1e06-471e-8a11-d7f6a6d20102 req-244f7f63-be24-4b84-82f3-094c194078a7 service nova] [instance: a1a3e849-6570-4820-97c8-75468b5bea4f] Received unexpected event network-vif-plugged-3544d3e3-8dfa-4043-b225-77f690cd3760 for instance with vm_state active and task_state None.
Nov 13 18:45:05 user nova-compute[75216]: DEBUG nova.compute.manager [req-9f2531f1-1e06-471e-8a11-d7f6a6d20102 req-244f7f63-be24-4b84-82f3-094c194078a7 service nova] [instance: 85624c58-6c72-4490-8a3e-547953295ade] Received event network-vif-plugged-51ccc958-5ce8-4e1d-8d28-f10c5ac288bd {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:45:05 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-9f2531f1-1e06-471e-8a11-d7f6a6d20102 req-244f7f63-be24-4b84-82f3-094c194078a7 service nova] Acquiring lock "85624c58-6c72-4490-8a3e-547953295ade-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:45:05 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-9f2531f1-1e06-471e-8a11-d7f6a6d20102 req-244f7f63-be24-4b84-82f3-094c194078a7 service nova] Lock "85624c58-6c72-4490-8a3e-547953295ade-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:45:05 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-9f2531f1-1e06-471e-8a11-d7f6a6d20102 req-244f7f63-be24-4b84-82f3-094c194078a7 service nova] Lock "85624c58-6c72-4490-8a3e-547953295ade-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:45:05 user nova-compute[75216]: DEBUG nova.compute.manager [req-9f2531f1-1e06-471e-8a11-d7f6a6d20102 req-244f7f63-be24-4b84-82f3-094c194078a7 service nova] [instance: 85624c58-6c72-4490-8a3e-547953295ade] No waiting events found dispatching network-vif-plugged-51ccc958-5ce8-4e1d-8d28-f10c5ac288bd {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:45:05 user nova-compute[75216]: WARNING nova.compute.manager [req-9f2531f1-1e06-471e-8a11-d7f6a6d20102 req-244f7f63-be24-4b84-82f3-094c194078a7 service nova] [instance: 85624c58-6c72-4490-8a3e-547953295ade] Received unexpected event network-vif-plugged-51ccc958-5ce8-4e1d-8d28-f10c5ac288bd for instance with vm_state active and task_state None.
Nov 13 18:45:06 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:45:06 user nova-compute[75216]: DEBUG nova.compute.manager [None req-e02eca4f-180d-4b47-b6d8-392888b3a272 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] [instance: 9b078f75-57f2-495a-abd5-f8adf72db80b] Instance event wait completed in 0 seconds for  {{(pid=75216) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 18:45:06 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-e02eca4f-180d-4b47-b6d8-392888b3a272 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] [instance: 9b078f75-57f2-495a-abd5-f8adf72db80b] Guest created on hypervisor {{(pid=75216) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 18:45:07 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 9b078f75-57f2-495a-abd5-f8adf72db80b] Instance spawned successfully.
Nov 13 18:45:07 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-e02eca4f-180d-4b47-b6d8-392888b3a272 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] [instance: 9b078f75-57f2-495a-abd5-f8adf72db80b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 18:45:07 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-e02eca4f-180d-4b47-b6d8-392888b3a272 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] [instance: 9b078f75-57f2-495a-abd5-f8adf72db80b] Found default for hw_cdrom_bus of ide {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 18:45:07 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-e02eca4f-180d-4b47-b6d8-392888b3a272 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] [instance: 9b078f75-57f2-495a-abd5-f8adf72db80b] Found default for hw_disk_bus of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 18:45:07 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-e02eca4f-180d-4b47-b6d8-392888b3a272 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] [instance: 9b078f75-57f2-495a-abd5-f8adf72db80b] Found default for hw_input_bus of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 18:45:07 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-e02eca4f-180d-4b47-b6d8-392888b3a272 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] [instance: 9b078f75-57f2-495a-abd5-f8adf72db80b] Found default for hw_pointer_model of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 18:45:07 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-e02eca4f-180d-4b47-b6d8-392888b3a272 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] [instance: 9b078f75-57f2-495a-abd5-f8adf72db80b] Found default for hw_video_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 18:45:07 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-e02eca4f-180d-4b47-b6d8-392888b3a272 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] [instance: 9b078f75-57f2-495a-abd5-f8adf72db80b] Found default for hw_vif_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 18:45:07 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:45:07 user nova-compute[75216]: INFO nova.compute.manager [None req-e02eca4f-180d-4b47-b6d8-392888b3a272 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] [instance: 9b078f75-57f2-495a-abd5-f8adf72db80b] Took 12.28 seconds to spawn the instance on the hypervisor.
Nov 13 18:45:07 user nova-compute[75216]: DEBUG nova.compute.manager [None req-e02eca4f-180d-4b47-b6d8-392888b3a272 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] [instance: 9b078f75-57f2-495a-abd5-f8adf72db80b] Checking state {{(pid=75216) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 18:45:07 user nova-compute[75216]: INFO nova.compute.manager [None req-e02eca4f-180d-4b47-b6d8-392888b3a272 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] [instance: 9b078f75-57f2-495a-abd5-f8adf72db80b] Took 13.28 seconds to build instance.
Nov 13 18:45:07 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e02eca4f-180d-4b47-b6d8-392888b3a272 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] Lock "9b078f75-57f2-495a-abd5-f8adf72db80b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.419s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:45:07 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:45:07 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:45:07 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:45:07 user nova-compute[75216]: DEBUG nova.compute.manager [req-95834b42-3b6c-4624-aff5-6b2e4207d568 req-2e0103cb-52d1-4266-9ded-880d6cb8970d service nova] [instance: 85624c58-6c72-4490-8a3e-547953295ade] Received event network-vif-plugged-51ccc958-5ce8-4e1d-8d28-f10c5ac288bd {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:45:07 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-95834b42-3b6c-4624-aff5-6b2e4207d568 req-2e0103cb-52d1-4266-9ded-880d6cb8970d service nova] Acquiring lock "85624c58-6c72-4490-8a3e-547953295ade-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:45:07 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-95834b42-3b6c-4624-aff5-6b2e4207d568 req-2e0103cb-52d1-4266-9ded-880d6cb8970d service nova] Lock "85624c58-6c72-4490-8a3e-547953295ade-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:45:07 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-95834b42-3b6c-4624-aff5-6b2e4207d568 req-2e0103cb-52d1-4266-9ded-880d6cb8970d service nova] Lock "85624c58-6c72-4490-8a3e-547953295ade-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:45:07 user nova-compute[75216]: DEBUG nova.compute.manager [req-95834b42-3b6c-4624-aff5-6b2e4207d568 req-2e0103cb-52d1-4266-9ded-880d6cb8970d service nova] [instance: 85624c58-6c72-4490-8a3e-547953295ade] No waiting events found dispatching network-vif-plugged-51ccc958-5ce8-4e1d-8d28-f10c5ac288bd {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:45:07 user nova-compute[75216]: WARNING nova.compute.manager [req-95834b42-3b6c-4624-aff5-6b2e4207d568 req-2e0103cb-52d1-4266-9ded-880d6cb8970d service nova] [instance: 85624c58-6c72-4490-8a3e-547953295ade] Received unexpected event network-vif-plugged-51ccc958-5ce8-4e1d-8d28-f10c5ac288bd for instance with vm_state active and task_state None.
Nov 13 18:45:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:45:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:45:09 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:45:09 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:45:09 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:45:09 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:45:09 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:45:10 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:45:10 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:45:10 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:45:12 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:45:12 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:45:13 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:45:13 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-734e9cbf-763f-44af-835a-86f0aef47cb8 tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] Acquiring lock "83fda249-9d28-4cc2-aeb0-103ce4f1faa4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:45:13 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-734e9cbf-763f-44af-835a-86f0aef47cb8 tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] Lock "83fda249-9d28-4cc2-aeb0-103ce4f1faa4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:45:13 user nova-compute[75216]: DEBUG nova.compute.manager [None req-734e9cbf-763f-44af-835a-86f0aef47cb8 tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] [instance: 83fda249-9d28-4cc2-aeb0-103ce4f1faa4] Starting instance... {{(pid=75216) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 18:45:13 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-734e9cbf-763f-44af-835a-86f0aef47cb8 tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:45:13 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-734e9cbf-763f-44af-835a-86f0aef47cb8 tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:45:13 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-734e9cbf-763f-44af-835a-86f0aef47cb8 tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75216) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 18:45:13 user nova-compute[75216]: INFO nova.compute.claims [None req-734e9cbf-763f-44af-835a-86f0aef47cb8 tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] [instance: 83fda249-9d28-4cc2-aeb0-103ce4f1faa4] Claim successful on node user
Nov 13 18:45:14 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-734e9cbf-763f-44af-835a-86f0aef47cb8 tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 18:45:14 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-734e9cbf-763f-44af-835a-86f0aef47cb8 tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 18:45:14 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-734e9cbf-763f-44af-835a-86f0aef47cb8 tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.554s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:45:14 user nova-compute[75216]: DEBUG nova.compute.manager [None req-734e9cbf-763f-44af-835a-86f0aef47cb8 tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] [instance: 83fda249-9d28-4cc2-aeb0-103ce4f1faa4] Start building networks asynchronously for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 18:45:14 user nova-compute[75216]: DEBUG nova.compute.manager [None req-734e9cbf-763f-44af-835a-86f0aef47cb8 tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] [instance: 83fda249-9d28-4cc2-aeb0-103ce4f1faa4] Allocating IP information in the background. {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 18:45:14 user nova-compute[75216]: DEBUG nova.network.neutron [None req-734e9cbf-763f-44af-835a-86f0aef47cb8 tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] [instance: 83fda249-9d28-4cc2-aeb0-103ce4f1faa4] allocate_for_instance() {{(pid=75216) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 18:45:14 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-734e9cbf-763f-44af-835a-86f0aef47cb8 tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] [instance: 83fda249-9d28-4cc2-aeb0-103ce4f1faa4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 18:45:14 user nova-compute[75216]: DEBUG nova.compute.manager [None req-734e9cbf-763f-44af-835a-86f0aef47cb8 tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] [instance: 83fda249-9d28-4cc2-aeb0-103ce4f1faa4] Start building block device mappings for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 18:45:14 user nova-compute[75216]: DEBUG nova.compute.manager [None req-734e9cbf-763f-44af-835a-86f0aef47cb8 tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] [instance: 83fda249-9d28-4cc2-aeb0-103ce4f1faa4] Start spawning the instance on the hypervisor. {{(pid=75216) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 18:45:14 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-734e9cbf-763f-44af-835a-86f0aef47cb8 tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] [instance: 83fda249-9d28-4cc2-aeb0-103ce4f1faa4] Creating instance directory {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 18:45:14 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-734e9cbf-763f-44af-835a-86f0aef47cb8 tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] [instance: 83fda249-9d28-4cc2-aeb0-103ce4f1faa4] Creating image(s)
Nov 13 18:45:14 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-734e9cbf-763f-44af-835a-86f0aef47cb8 tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] Acquiring lock "/opt/stack/data/nova/instances/83fda249-9d28-4cc2-aeb0-103ce4f1faa4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:45:14 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-734e9cbf-763f-44af-835a-86f0aef47cb8 tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] Lock "/opt/stack/data/nova/instances/83fda249-9d28-4cc2-aeb0-103ce4f1faa4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:45:14 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-734e9cbf-763f-44af-835a-86f0aef47cb8 tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] Lock "/opt/stack/data/nova/instances/83fda249-9d28-4cc2-aeb0-103ce4f1faa4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:45:14 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-734e9cbf-763f-44af-835a-86f0aef47cb8 tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:45:14 user nova-compute[75216]: DEBUG nova.policy [None req-734e9cbf-763f-44af-835a-86f0aef47cb8 tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9328187f980b430f9f65420eec9f8c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d63d01c37774af48f4d3e49901802f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75216) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 18:45:15 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-734e9cbf-763f-44af-835a-86f0aef47cb8 tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json" returned: 0 in 0.257s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:45:15 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-734e9cbf-763f-44af-835a-86f0aef47cb8 tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] Acquiring lock "88c50a45bec9d6b0427462b3242b9b8e5f49c2b6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:45:15 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-734e9cbf-763f-44af-835a-86f0aef47cb8 tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] Lock "88c50a45bec9d6b0427462b3242b9b8e5f49c2b6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.004s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:45:15 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-734e9cbf-763f-44af-835a-86f0aef47cb8 tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:45:15 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-734e9cbf-763f-44af-835a-86f0aef47cb8 tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json" returned: 0 in 0.374s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:45:15 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-734e9cbf-763f-44af-835a-86f0aef47cb8 tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6,backing_fmt=raw /opt/stack/data/nova/instances/83fda249-9d28-4cc2-aeb0-103ce4f1faa4/disk 1073741824 {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:45:15 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-734e9cbf-763f-44af-835a-86f0aef47cb8 tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6,backing_fmt=raw /opt/stack/data/nova/instances/83fda249-9d28-4cc2-aeb0-103ce4f1faa4/disk 1073741824" returned: 0 in 0.097s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:45:15 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-734e9cbf-763f-44af-835a-86f0aef47cb8 tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] Lock "88c50a45bec9d6b0427462b3242b9b8e5f49c2b6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.480s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:45:15 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-734e9cbf-763f-44af-835a-86f0aef47cb8 tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:45:15 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-734e9cbf-763f-44af-835a-86f0aef47cb8 tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json" returned: 0 in 0.214s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:45:15 user nova-compute[75216]: DEBUG nova.virt.disk.api [None req-734e9cbf-763f-44af-835a-86f0aef47cb8 tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] Checking if we can resize image /opt/stack/data/nova/instances/83fda249-9d28-4cc2-aeb0-103ce4f1faa4/disk. size=1073741824 {{(pid=75216) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 18:45:15 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-734e9cbf-763f-44af-835a-86f0aef47cb8 tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83fda249-9d28-4cc2-aeb0-103ce4f1faa4/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:45:15 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-734e9cbf-763f-44af-835a-86f0aef47cb8 tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83fda249-9d28-4cc2-aeb0-103ce4f1faa4/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:45:15 user nova-compute[75216]: DEBUG nova.virt.disk.api [None req-734e9cbf-763f-44af-835a-86f0aef47cb8 tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] Cannot resize image /opt/stack/data/nova/instances/83fda249-9d28-4cc2-aeb0-103ce4f1faa4/disk to a smaller size. {{(pid=75216) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 18:45:15 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-734e9cbf-763f-44af-835a-86f0aef47cb8 tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] [instance: 83fda249-9d28-4cc2-aeb0-103ce4f1faa4] Created local disks {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 18:45:15 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-734e9cbf-763f-44af-835a-86f0aef47cb8 tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] [instance: 83fda249-9d28-4cc2-aeb0-103ce4f1faa4] Ensure instance console log exists: /opt/stack/data/nova/instances/83fda249-9d28-4cc2-aeb0-103ce4f1faa4/console.log {{(pid=75216) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 18:45:15 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-734e9cbf-763f-44af-835a-86f0aef47cb8 tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:45:15 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-734e9cbf-763f-44af-835a-86f0aef47cb8 tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:45:15 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-734e9cbf-763f-44af-835a-86f0aef47cb8 tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:45:16 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-178ecf48-75b0-44c8-9b01-af76f5de5a3d tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] Acquiring lock "872856e5-cdc4-444e-8835-55e36708d776" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:45:16 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-178ecf48-75b0-44c8-9b01-af76f5de5a3d tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] Lock "872856e5-cdc4-444e-8835-55e36708d776" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:45:16 user nova-compute[75216]: DEBUG nova.compute.manager [None req-178ecf48-75b0-44c8-9b01-af76f5de5a3d tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] [instance: 872856e5-cdc4-444e-8835-55e36708d776] Starting instance... {{(pid=75216) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 18:45:16 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-178ecf48-75b0-44c8-9b01-af76f5de5a3d tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:45:16 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-178ecf48-75b0-44c8-9b01-af76f5de5a3d tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:45:16 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-178ecf48-75b0-44c8-9b01-af76f5de5a3d tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75216) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 18:45:16 user nova-compute[75216]: INFO nova.compute.claims [None req-178ecf48-75b0-44c8-9b01-af76f5de5a3d tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] [instance: 872856e5-cdc4-444e-8835-55e36708d776] Claim successful on node user
Nov 13 18:45:16 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-178ecf48-75b0-44c8-9b01-af76f5de5a3d tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 18:45:16 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-178ecf48-75b0-44c8-9b01-af76f5de5a3d tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 18:45:16 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-178ecf48-75b0-44c8-9b01-af76f5de5a3d tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.576s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:45:16 user nova-compute[75216]: DEBUG nova.compute.manager [None req-178ecf48-75b0-44c8-9b01-af76f5de5a3d tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] [instance: 872856e5-cdc4-444e-8835-55e36708d776] Start building networks asynchronously for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 18:45:16 user nova-compute[75216]: DEBUG nova.compute.manager [None req-178ecf48-75b0-44c8-9b01-af76f5de5a3d tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] [instance: 872856e5-cdc4-444e-8835-55e36708d776] Allocating IP information in the background. {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 18:45:16 user nova-compute[75216]: DEBUG nova.network.neutron [None req-178ecf48-75b0-44c8-9b01-af76f5de5a3d tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] [instance: 872856e5-cdc4-444e-8835-55e36708d776] allocate_for_instance() {{(pid=75216) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 18:45:17 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-178ecf48-75b0-44c8-9b01-af76f5de5a3d tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] [instance: 872856e5-cdc4-444e-8835-55e36708d776] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 18:45:17 user nova-compute[75216]: DEBUG nova.compute.manager [None req-178ecf48-75b0-44c8-9b01-af76f5de5a3d tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] [instance: 872856e5-cdc4-444e-8835-55e36708d776] Start building block device mappings for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 18:45:17 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:45:17 user nova-compute[75216]: DEBUG nova.network.neutron [None req-734e9cbf-763f-44af-835a-86f0aef47cb8 tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] [instance: 83fda249-9d28-4cc2-aeb0-103ce4f1faa4] Successfully created port: 001a2459-5886-44be-aeb3-b2fb4ab71926 {{(pid=75216) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 18:45:17 user nova-compute[75216]: DEBUG nova.policy [None req-178ecf48-75b0-44c8-9b01-af76f5de5a3d tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '85d5c0c3293f41ec9adb01dceb492c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '462d302bb02243f89ec881369fcf7301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75216) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 18:45:17 user nova-compute[75216]: DEBUG nova.compute.manager [None req-178ecf48-75b0-44c8-9b01-af76f5de5a3d tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] [instance: 872856e5-cdc4-444e-8835-55e36708d776] Start spawning the instance on the hypervisor. {{(pid=75216) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 18:45:17 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-178ecf48-75b0-44c8-9b01-af76f5de5a3d tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] [instance: 872856e5-cdc4-444e-8835-55e36708d776] Creating instance directory {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 18:45:17 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-178ecf48-75b0-44c8-9b01-af76f5de5a3d tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] [instance: 872856e5-cdc4-444e-8835-55e36708d776] Creating image(s)
Nov 13 18:45:17 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-178ecf48-75b0-44c8-9b01-af76f5de5a3d tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] Acquiring lock "/opt/stack/data/nova/instances/872856e5-cdc4-444e-8835-55e36708d776/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:45:17 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-178ecf48-75b0-44c8-9b01-af76f5de5a3d tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] Lock "/opt/stack/data/nova/instances/872856e5-cdc4-444e-8835-55e36708d776/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:45:17 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-178ecf48-75b0-44c8-9b01-af76f5de5a3d tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] Lock "/opt/stack/data/nova/instances/872856e5-cdc4-444e-8835-55e36708d776/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:45:17 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-178ecf48-75b0-44c8-9b01-af76f5de5a3d tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:45:17 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-178ecf48-75b0-44c8-9b01-af76f5de5a3d tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json" returned: 0 in 0.198s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:45:17 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-178ecf48-75b0-44c8-9b01-af76f5de5a3d tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] Acquiring lock "88c50a45bec9d6b0427462b3242b9b8e5f49c2b6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:45:17 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-178ecf48-75b0-44c8-9b01-af76f5de5a3d tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] Lock "88c50a45bec9d6b0427462b3242b9b8e5f49c2b6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:45:17 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-178ecf48-75b0-44c8-9b01-af76f5de5a3d tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:45:17 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-178ecf48-75b0-44c8-9b01-af76f5de5a3d tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json" returned: 0 in 0.227s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:45:17 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-178ecf48-75b0-44c8-9b01-af76f5de5a3d tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6,backing_fmt=raw /opt/stack/data/nova/instances/872856e5-cdc4-444e-8835-55e36708d776/disk 1073741824 {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:45:17 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:45:17 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-178ecf48-75b0-44c8-9b01-af76f5de5a3d tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6,backing_fmt=raw /opt/stack/data/nova/instances/872856e5-cdc4-444e-8835-55e36708d776/disk 1073741824" returned: 0 in 0.091s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:45:17 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-178ecf48-75b0-44c8-9b01-af76f5de5a3d tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] Lock "88c50a45bec9d6b0427462b3242b9b8e5f49c2b6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.326s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:45:17 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-178ecf48-75b0-44c8-9b01-af76f5de5a3d tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:45:18 user nova-compute[75216]: DEBUG nova.network.neutron [None req-178ecf48-75b0-44c8-9b01-af76f5de5a3d tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] [instance: 872856e5-cdc4-444e-8835-55e36708d776] Successfully created port: 296cb77a-c087-4484-adf2-7fd703942e0d {{(pid=75216) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 18:45:18 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-178ecf48-75b0-44c8-9b01-af76f5de5a3d tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json" returned: 0 in 0.298s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:45:18 user nova-compute[75216]: DEBUG nova.virt.disk.api [None req-178ecf48-75b0-44c8-9b01-af76f5de5a3d tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] Checking if we can resize image /opt/stack/data/nova/instances/872856e5-cdc4-444e-8835-55e36708d776/disk. size=1073741824 {{(pid=75216) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 18:45:18 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-178ecf48-75b0-44c8-9b01-af76f5de5a3d tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/872856e5-cdc4-444e-8835-55e36708d776/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:45:18 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-178ecf48-75b0-44c8-9b01-af76f5de5a3d tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/872856e5-cdc4-444e-8835-55e36708d776/disk --force-share --output=json" returned: 0 in 0.289s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:45:18 user nova-compute[75216]: DEBUG nova.virt.disk.api [None req-178ecf48-75b0-44c8-9b01-af76f5de5a3d tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] Cannot resize image /opt/stack/data/nova/instances/872856e5-cdc4-444e-8835-55e36708d776/disk to a smaller size. {{(pid=75216) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 18:45:18 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-178ecf48-75b0-44c8-9b01-af76f5de5a3d tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] [instance: 872856e5-cdc4-444e-8835-55e36708d776] Created local disks {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 18:45:18 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-178ecf48-75b0-44c8-9b01-af76f5de5a3d tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] [instance: 872856e5-cdc4-444e-8835-55e36708d776] Ensure instance console log exists: /opt/stack/data/nova/instances/872856e5-cdc4-444e-8835-55e36708d776/console.log {{(pid=75216) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 18:45:18 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-178ecf48-75b0-44c8-9b01-af76f5de5a3d tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:45:18 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-178ecf48-75b0-44c8-9b01-af76f5de5a3d tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.007s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:45:18 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-178ecf48-75b0-44c8-9b01-af76f5de5a3d tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.004s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:45:18 user nova-compute[75216]: DEBUG nova.network.neutron [None req-734e9cbf-763f-44af-835a-86f0aef47cb8 tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] [instance: 83fda249-9d28-4cc2-aeb0-103ce4f1faa4] Successfully updated port: 001a2459-5886-44be-aeb3-b2fb4ab71926 {{(pid=75216) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 18:45:18 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-734e9cbf-763f-44af-835a-86f0aef47cb8 tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] Acquiring lock "refresh_cache-83fda249-9d28-4cc2-aeb0-103ce4f1faa4" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 18:45:18 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-734e9cbf-763f-44af-835a-86f0aef47cb8 tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] Acquired lock "refresh_cache-83fda249-9d28-4cc2-aeb0-103ce4f1faa4" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 18:45:18 user nova-compute[75216]: DEBUG nova.network.neutron [None req-734e9cbf-763f-44af-835a-86f0aef47cb8 tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] [instance: 83fda249-9d28-4cc2-aeb0-103ce4f1faa4] Building network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 18:45:18 user nova-compute[75216]: DEBUG nova.compute.manager [req-6876bb91-4061-4b26-9637-a428467df540 req-ee617b19-925c-418c-b9f9-497c6db7ebd8 service nova] [instance: 83fda249-9d28-4cc2-aeb0-103ce4f1faa4] Received event network-changed-001a2459-5886-44be-aeb3-b2fb4ab71926 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:45:18 user nova-compute[75216]: DEBUG nova.compute.manager [req-6876bb91-4061-4b26-9637-a428467df540 req-ee617b19-925c-418c-b9f9-497c6db7ebd8 service nova] [instance: 83fda249-9d28-4cc2-aeb0-103ce4f1faa4] Refreshing instance network info cache due to event network-changed-001a2459-5886-44be-aeb3-b2fb4ab71926. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 18:45:18 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-6876bb91-4061-4b26-9637-a428467df540 req-ee617b19-925c-418c-b9f9-497c6db7ebd8 service nova] Acquiring lock "refresh_cache-83fda249-9d28-4cc2-aeb0-103ce4f1faa4" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 18:45:18 user nova-compute[75216]: DEBUG nova.network.neutron [None req-734e9cbf-763f-44af-835a-86f0aef47cb8 tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] [instance: 83fda249-9d28-4cc2-aeb0-103ce4f1faa4] Instance cache missing network info. {{(pid=75216) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 18:45:19 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:45:19 user nova-compute[75216]: DEBUG nova.network.neutron [None req-734e9cbf-763f-44af-835a-86f0aef47cb8 tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] [instance: 83fda249-9d28-4cc2-aeb0-103ce4f1faa4] Updating instance_info_cache with network_info: [{"id": "001a2459-5886-44be-aeb3-b2fb4ab71926", "address": "fa:16:3e:ea:a2:8e", "network": {"id": "3e05e26f-bb3f-48d7-a8cf-8974b02b1745", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-600263470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d63d01c37774af48f4d3e49901802f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap001a2459-58", "ovs_interfaceid": "001a2459-5886-44be-aeb3-b2fb4ab71926", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 18:45:19 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-734e9cbf-763f-44af-835a-86f0aef47cb8 tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] Releasing lock "refresh_cache-83fda249-9d28-4cc2-aeb0-103ce4f1faa4" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 18:45:19 user nova-compute[75216]: DEBUG nova.compute.manager [None req-734e9cbf-763f-44af-835a-86f0aef47cb8 tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] [instance: 83fda249-9d28-4cc2-aeb0-103ce4f1faa4] Instance network_info: |[{"id": "001a2459-5886-44be-aeb3-b2fb4ab71926", "address": "fa:16:3e:ea:a2:8e", "network": {"id": "3e05e26f-bb3f-48d7-a8cf-8974b02b1745", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-600263470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d63d01c37774af48f4d3e49901802f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap001a2459-58", "ovs_interfaceid": "001a2459-5886-44be-aeb3-b2fb4ab71926", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 18:45:19 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-6876bb91-4061-4b26-9637-a428467df540 req-ee617b19-925c-418c-b9f9-497c6db7ebd8 service nova] Acquired lock "refresh_cache-83fda249-9d28-4cc2-aeb0-103ce4f1faa4" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 18:45:19 user nova-compute[75216]: DEBUG nova.network.neutron [req-6876bb91-4061-4b26-9637-a428467df540 req-ee617b19-925c-418c-b9f9-497c6db7ebd8 service nova] [instance: 83fda249-9d28-4cc2-aeb0-103ce4f1faa4] Refreshing network info cache for port 001a2459-5886-44be-aeb3-b2fb4ab71926 {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 18:45:19 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-734e9cbf-763f-44af-835a-86f0aef47cb8 tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] [instance: 83fda249-9d28-4cc2-aeb0-103ce4f1faa4] Start _get_guest_xml network_info=[{"id": "001a2459-5886-44be-aeb3-b2fb4ab71926", "address": "fa:16:3e:ea:a2:8e", "network": {"id": "3e05e26f-bb3f-48d7-a8cf-8974b02b1745", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-600263470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d63d01c37774af48f4d3e49901802f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap001a2459-58", "ovs_interfaceid": "001a2459-5886-44be-aeb3-b2fb4ab71926", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T18:41:06Z,direct_url=<?>,disk_format='qcow2',id=77bcb5ba-8510-41ec-a88d-96097bb431de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c465b7c26ec44582b6d1b7169536ecc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T18:41:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'guest_format': None, 'boot_index': 0, 'image_id': '77bcb5ba-8510-41ec-a88d-96097bb431de'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 18:45:19 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-734e9cbf-763f-44af-835a-86f0aef47cb8 tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 18:45:19 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-734e9cbf-763f-44af-835a-86f0aef47cb8 tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 18:45:19 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-734e9cbf-763f-44af-835a-86f0aef47cb8 tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 18:45:19 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-734e9cbf-763f-44af-835a-86f0aef47cb8 tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] CPU controller missing on host. {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 18:45:19 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-734e9cbf-763f-44af-835a-86f0aef47cb8 tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 18:45:19 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-734e9cbf-763f-44af-835a-86f0aef47cb8 tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] CPU controller found on host. {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 18:45:19 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-734e9cbf-763f-44af-835a-86f0aef47cb8 tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75216) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 18:45:19 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-734e9cbf-763f-44af-835a-86f0aef47cb8 tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T18:40:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T18:41:06Z,direct_url=<?>,disk_format='qcow2',id=77bcb5ba-8510-41ec-a88d-96097bb431de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c465b7c26ec44582b6d1b7169536ecc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T18:41:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 18:45:19 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-734e9cbf-763f-44af-835a-86f0aef47cb8 tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] Flavor limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 18:45:19 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-734e9cbf-763f-44af-835a-86f0aef47cb8 tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] Image limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 18:45:19 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-734e9cbf-763f-44af-835a-86f0aef47cb8 tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] Flavor pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 18:45:19 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-734e9cbf-763f-44af-835a-86f0aef47cb8 tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] Image pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 18:45:19 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-734e9cbf-763f-44af-835a-86f0aef47cb8 tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 18:45:19 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-734e9cbf-763f-44af-835a-86f0aef47cb8 tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 18:45:19 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-734e9cbf-763f-44af-835a-86f0aef47cb8 tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 18:45:19 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-734e9cbf-763f-44af-835a-86f0aef47cb8 tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] Got 1 possible topologies {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 18:45:19 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-734e9cbf-763f-44af-835a-86f0aef47cb8 tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 18:45:19 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-734e9cbf-763f-44af-835a-86f0aef47cb8 tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 18:45:19 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-734e9cbf-763f-44af-835a-86f0aef47cb8 tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T18:45:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1853317358',display_name='tempest-VolumesAdminNegativeTest-server-1853317358',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1853317358',id=6,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPlyOd+Qzgrkoc6K4VHy5EGS0XxO0NXm0cLoAg3Ce4zQw96sR95u6n2SqXekqvD63+hyK5YN1zygJDiPVXhUShgpdx9F4/x3gi2NmsXBdoMqxxJoyLAPD8XOmfkauPpHkA==',key_name='tempest-keypair-499332356',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7d63d01c37774af48f4d3e49901802f9',ramdisk_id='',reservation_id='r-w5zf5g8e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-999712097',owner_user_name='tempest-VolumesAdminNegativeTest-999712097-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T18:45:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9328187f980b430f9f65420eec9f8c98',uuid=83fda249-9d28-4cc2-aeb0-103ce4f1faa4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "001a2459-5886-44be-aeb3-b2fb4ab71926", "address": "fa:16:3e:ea:a2:8e", "network": {"id": "3e05e26f-bb3f-48d7-a8cf-8974b02b1745", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-600263470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d63d01c37774af48f4d3e49901802f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap001a2459-58", "ovs_interfaceid": "001a2459-5886-44be-aeb3-b2fb4ab71926", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75216) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 18:45:19 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-734e9cbf-763f-44af-835a-86f0aef47cb8 tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] Converting VIF {"id": "001a2459-5886-44be-aeb3-b2fb4ab71926", "address": "fa:16:3e:ea:a2:8e", "network": {"id": "3e05e26f-bb3f-48d7-a8cf-8974b02b1745", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-600263470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d63d01c37774af48f4d3e49901802f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap001a2459-58", "ovs_interfaceid": "001a2459-5886-44be-aeb3-b2fb4ab71926", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 18:45:19 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-734e9cbf-763f-44af-835a-86f0aef47cb8 tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:a2:8e,bridge_name='br-int',has_traffic_filtering=True,id=001a2459-5886-44be-aeb3-b2fb4ab71926,network=Network(3e05e26f-bb3f-48d7-a8cf-8974b02b1745),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap001a2459-58') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 18:45:19 user nova-compute[75216]: DEBUG nova.objects.instance [None req-734e9cbf-763f-44af-835a-86f0aef47cb8 tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] Lazy-loading 'pci_devices' on Instance uuid 83fda249-9d28-4cc2-aeb0-103ce4f1faa4 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 18:45:19 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-734e9cbf-763f-44af-835a-86f0aef47cb8 tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] [instance: 83fda249-9d28-4cc2-aeb0-103ce4f1faa4] End _get_guest_xml xml=<domain type="kvm">
Nov 13 18:45:19 user nova-compute[75216]:   <uuid>83fda249-9d28-4cc2-aeb0-103ce4f1faa4</uuid>
Nov 13 18:45:19 user nova-compute[75216]:   <name>instance-00000006</name>
Nov 13 18:45:19 user nova-compute[75216]:   <memory>524288</memory>
Nov 13 18:45:19 user nova-compute[75216]:   <vcpu>1</vcpu>
Nov 13 18:45:19 user nova-compute[75216]:   <metadata>
Nov 13 18:45:19 user nova-compute[75216]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 18:45:19 user nova-compute[75216]:       <nova:package version="0.0.0"/>
Nov 13 18:45:19 user nova-compute[75216]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1853317358</nova:name>
Nov 13 18:45:19 user nova-compute[75216]:       <nova:creationTime>2023-11-13 18:45:19</nova:creationTime>
Nov 13 18:45:19 user nova-compute[75216]:       <nova:flavor name="m1.tiny">
Nov 13 18:45:19 user nova-compute[75216]:         <nova:memory>512</nova:memory>
Nov 13 18:45:19 user nova-compute[75216]:         <nova:disk>1</nova:disk>
Nov 13 18:45:19 user nova-compute[75216]:         <nova:swap>0</nova:swap>
Nov 13 18:45:19 user nova-compute[75216]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 18:45:19 user nova-compute[75216]:         <nova:vcpus>1</nova:vcpus>
Nov 13 18:45:19 user nova-compute[75216]:       </nova:flavor>
Nov 13 18:45:19 user nova-compute[75216]:       <nova:owner>
Nov 13 18:45:19 user nova-compute[75216]:         <nova:user uuid="9328187f980b430f9f65420eec9f8c98">tempest-VolumesAdminNegativeTest-999712097-project-member</nova:user>
Nov 13 18:45:19 user nova-compute[75216]:         <nova:project uuid="7d63d01c37774af48f4d3e49901802f9">tempest-VolumesAdminNegativeTest-999712097</nova:project>
Nov 13 18:45:19 user nova-compute[75216]:       </nova:owner>
Nov 13 18:45:19 user nova-compute[75216]:       <nova:root type="image" uuid="77bcb5ba-8510-41ec-a88d-96097bb431de"/>
Nov 13 18:45:19 user nova-compute[75216]:       <nova:ports>
Nov 13 18:45:19 user nova-compute[75216]:         <nova:port uuid="001a2459-5886-44be-aeb3-b2fb4ab71926">
Nov 13 18:45:19 user nova-compute[75216]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 13 18:45:19 user nova-compute[75216]:         </nova:port>
Nov 13 18:45:19 user nova-compute[75216]:       </nova:ports>
Nov 13 18:45:19 user nova-compute[75216]:     </nova:instance>
Nov 13 18:45:19 user nova-compute[75216]:   </metadata>
Nov 13 18:45:19 user nova-compute[75216]:   <sysinfo type="smbios">
Nov 13 18:45:19 user nova-compute[75216]:     <system>
Nov 13 18:45:19 user nova-compute[75216]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 18:45:19 user nova-compute[75216]:       <entry name="product">OpenStack Nova</entry>
Nov 13 18:45:19 user nova-compute[75216]:       <entry name="version">0.0.0</entry>
Nov 13 18:45:19 user nova-compute[75216]:       <entry name="serial">83fda249-9d28-4cc2-aeb0-103ce4f1faa4</entry>
Nov 13 18:45:19 user nova-compute[75216]:       <entry name="uuid">83fda249-9d28-4cc2-aeb0-103ce4f1faa4</entry>
Nov 13 18:45:19 user nova-compute[75216]:       <entry name="family">Virtual Machine</entry>
Nov 13 18:45:19 user nova-compute[75216]:     </system>
Nov 13 18:45:19 user nova-compute[75216]:   </sysinfo>
Nov 13 18:45:19 user nova-compute[75216]:   <os>
Nov 13 18:45:19 user nova-compute[75216]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 18:45:19 user nova-compute[75216]:     <boot dev="hd"/>
Nov 13 18:45:19 user nova-compute[75216]:     <smbios mode="sysinfo"/>
Nov 13 18:45:19 user nova-compute[75216]:   </os>
Nov 13 18:45:19 user nova-compute[75216]:   <features>
Nov 13 18:45:19 user nova-compute[75216]:     <acpi/>
Nov 13 18:45:19 user nova-compute[75216]:     <apic/>
Nov 13 18:45:19 user nova-compute[75216]:     <vmcoreinfo/>
Nov 13 18:45:19 user nova-compute[75216]:   </features>
Nov 13 18:45:19 user nova-compute[75216]:   <clock offset="utc">
Nov 13 18:45:19 user nova-compute[75216]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 18:45:19 user nova-compute[75216]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 18:45:19 user nova-compute[75216]:     <timer name="hpet" present="no"/>
Nov 13 18:45:19 user nova-compute[75216]:   </clock>
Nov 13 18:45:19 user nova-compute[75216]:   <cpu mode="custom" match="exact">
Nov 13 18:45:19 user nova-compute[75216]:     <model>Nehalem</model>
Nov 13 18:45:19 user nova-compute[75216]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 18:45:19 user nova-compute[75216]:   </cpu>
Nov 13 18:45:19 user nova-compute[75216]:   <devices>
Nov 13 18:45:19 user nova-compute[75216]:     <disk type="file" device="disk">
Nov 13 18:45:19 user nova-compute[75216]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 18:45:19 user nova-compute[75216]:       <source file="/opt/stack/data/nova/instances/83fda249-9d28-4cc2-aeb0-103ce4f1faa4/disk"/>
Nov 13 18:45:19 user nova-compute[75216]:       <target dev="vda" bus="virtio"/>
Nov 13 18:45:19 user nova-compute[75216]:     </disk>
Nov 13 18:45:19 user nova-compute[75216]:     <interface type="ethernet">
Nov 13 18:45:19 user nova-compute[75216]:       <mac address="fa:16:3e:ea:a2:8e"/>
Nov 13 18:45:19 user nova-compute[75216]:       <model type="virtio"/>
Nov 13 18:45:19 user nova-compute[75216]:       <mtu size="1442"/>
Nov 13 18:45:19 user nova-compute[75216]:       <target dev="tap001a2459-58"/>
Nov 13 18:45:19 user nova-compute[75216]:     </interface>
Nov 13 18:45:19 user nova-compute[75216]:     <serial type="pty">
Nov 13 18:45:19 user nova-compute[75216]:       <log file="/opt/stack/data/nova/instances/83fda249-9d28-4cc2-aeb0-103ce4f1faa4/console.log" append="off"/>
Nov 13 18:45:19 user nova-compute[75216]:     </serial>
Nov 13 18:45:19 user nova-compute[75216]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 18:45:19 user nova-compute[75216]:     <video>
Nov 13 18:45:19 user nova-compute[75216]:       <model type="virtio"/>
Nov 13 18:45:19 user nova-compute[75216]:     </video>
Nov 13 18:45:19 user nova-compute[75216]:     <rng model="virtio">
Nov 13 18:45:19 user nova-compute[75216]:       <backend model="random">/dev/urandom</backend>
Nov 13 18:45:19 user nova-compute[75216]:     </rng>
Nov 13 18:45:19 user nova-compute[75216]:     <controller type="usb" index="0" model="none"/>
Nov 13 18:45:19 user nova-compute[75216]:     <memballoon model="virtio">
Nov 13 18:45:19 user nova-compute[75216]:       <stats period="10"/>
Nov 13 18:45:19 user nova-compute[75216]:     </memballoon>
Nov 13 18:45:19 user nova-compute[75216]:   </devices>
Nov 13 18:45:19 user nova-compute[75216]: </domain>
Nov 13 18:45:19 user nova-compute[75216]:  {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 18:45:19 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-734e9cbf-763f-44af-835a-86f0aef47cb8 tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T18:45:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1853317358',display_name='tempest-VolumesAdminNegativeTest-server-1853317358',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1853317358',id=6,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPlyOd+Qzgrkoc6K4VHy5EGS0XxO0NXm0cLoAg3Ce4zQw96sR95u6n2SqXekqvD63+hyK5YN1zygJDiPVXhUShgpdx9F4/x3gi2NmsXBdoMqxxJoyLAPD8XOmfkauPpHkA==',key_name='tempest-keypair-499332356',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7d63d01c37774af48f4d3e49901802f9',ramdisk_id='',reservation_id='r-w5zf5g8e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-999712097',owner_user_name='tempest-VolumesAdminNegativeTest-999712097-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T18:45:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9328187f980b430f9f65420eec9f8c98',uuid=83fda249-9d28-4cc2-aeb0-103ce4f1faa4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "001a2459-5886-44be-aeb3-b2fb4ab71926", "address": "fa:16:3e:ea:a2:8e", "network": {"id": "3e05e26f-bb3f-48d7-a8cf-8974b02b1745", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-600263470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d63d01c37774af48f4d3e49901802f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap001a2459-58", "ovs_interfaceid": "001a2459-5886-44be-aeb3-b2fb4ab71926", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 18:45:19 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-734e9cbf-763f-44af-835a-86f0aef47cb8 tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] Converting VIF {"id": "001a2459-5886-44be-aeb3-b2fb4ab71926", "address": "fa:16:3e:ea:a2:8e", "network": {"id": "3e05e26f-bb3f-48d7-a8cf-8974b02b1745", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-600263470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d63d01c37774af48f4d3e49901802f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap001a2459-58", "ovs_interfaceid": "001a2459-5886-44be-aeb3-b2fb4ab71926", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 18:45:19 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-734e9cbf-763f-44af-835a-86f0aef47cb8 tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:a2:8e,bridge_name='br-int',has_traffic_filtering=True,id=001a2459-5886-44be-aeb3-b2fb4ab71926,network=Network(3e05e26f-bb3f-48d7-a8cf-8974b02b1745),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap001a2459-58') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 18:45:19 user nova-compute[75216]: DEBUG os_vif [None req-734e9cbf-763f-44af-835a-86f0aef47cb8 tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:a2:8e,bridge_name='br-int',has_traffic_filtering=True,id=001a2459-5886-44be-aeb3-b2fb4ab71926,network=Network(3e05e26f-bb3f-48d7-a8cf-8974b02b1745),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap001a2459-58') {{(pid=75216) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 18:45:19 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:45:19 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:45:19 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 18:45:19 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:45:19 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '94924a66-d446-5425-91ab-83c63d0b018d', '_type': 'linux-noop'}}, row=False) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:45:19 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:45:19 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:45:19 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:45:19 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap001a2459-58, may_exist=True, interface_attrs={}) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:45:19 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap001a2459-58, col_values=(('qos', UUID('f04cfa0e-1461-4a48-8c8d-2c1a7e0c33c3')),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:45:19 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap001a2459-58, col_values=(('external_ids', {'iface-id': '001a2459-5886-44be-aeb3-b2fb4ab71926', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ea:a2:8e', 'vm-uuid': '83fda249-9d28-4cc2-aeb0-103ce4f1faa4'}),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:45:19 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:45:19 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:45:19 user nova-compute[75216]: INFO os_vif [None req-734e9cbf-763f-44af-835a-86f0aef47cb8 tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:a2:8e,bridge_name='br-int',has_traffic_filtering=True,id=001a2459-5886-44be-aeb3-b2fb4ab71926,network=Network(3e05e26f-bb3f-48d7-a8cf-8974b02b1745),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap001a2459-58')
Nov 13 18:45:20 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-734e9cbf-763f-44af-835a-86f0aef47cb8 tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 18:45:20 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-734e9cbf-763f-44af-835a-86f0aef47cb8 tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] No VIF found with MAC fa:16:3e:ea:a2:8e, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 18:45:20 user nova-compute[75216]: DEBUG nova.network.neutron [None req-178ecf48-75b0-44c8-9b01-af76f5de5a3d tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] [instance: 872856e5-cdc4-444e-8835-55e36708d776] Successfully updated port: 296cb77a-c087-4484-adf2-7fd703942e0d {{(pid=75216) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 18:45:20 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-178ecf48-75b0-44c8-9b01-af76f5de5a3d tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] Acquiring lock "refresh_cache-872856e5-cdc4-444e-8835-55e36708d776" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 18:45:20 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-178ecf48-75b0-44c8-9b01-af76f5de5a3d tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] Acquired lock "refresh_cache-872856e5-cdc4-444e-8835-55e36708d776" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 18:45:20 user nova-compute[75216]: DEBUG nova.network.neutron [None req-178ecf48-75b0-44c8-9b01-af76f5de5a3d tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] [instance: 872856e5-cdc4-444e-8835-55e36708d776] Building network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 18:45:20 user nova-compute[75216]: DEBUG nova.compute.manager [req-0897bdae-946a-4fbb-b085-565deca61e95 req-43391329-e40e-4a9e-890b-1888f6e88651 service nova] [instance: 872856e5-cdc4-444e-8835-55e36708d776] Received event network-changed-296cb77a-c087-4484-adf2-7fd703942e0d {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:45:20 user nova-compute[75216]: DEBUG nova.compute.manager [req-0897bdae-946a-4fbb-b085-565deca61e95 req-43391329-e40e-4a9e-890b-1888f6e88651 service nova] [instance: 872856e5-cdc4-444e-8835-55e36708d776] Refreshing instance network info cache due to event network-changed-296cb77a-c087-4484-adf2-7fd703942e0d. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 18:45:20 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-0897bdae-946a-4fbb-b085-565deca61e95 req-43391329-e40e-4a9e-890b-1888f6e88651 service nova] Acquiring lock "refresh_cache-872856e5-cdc4-444e-8835-55e36708d776" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 18:45:20 user nova-compute[75216]: DEBUG nova.network.neutron [None req-178ecf48-75b0-44c8-9b01-af76f5de5a3d tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] [instance: 872856e5-cdc4-444e-8835-55e36708d776] Instance cache missing network info. {{(pid=75216) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 18:45:20 user nova-compute[75216]: DEBUG nova.network.neutron [None req-178ecf48-75b0-44c8-9b01-af76f5de5a3d tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] [instance: 872856e5-cdc4-444e-8835-55e36708d776] Updating instance_info_cache with network_info: [{"id": "296cb77a-c087-4484-adf2-7fd703942e0d", "address": "fa:16:3e:86:fe:e9", "network": {"id": "14e06b65-d8b1-43d1-a1f3-03e6c82ecc39", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2042637446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "462d302bb02243f89ec881369fcf7301", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap296cb77a-c0", "ovs_interfaceid": "296cb77a-c087-4484-adf2-7fd703942e0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 18:45:20 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-178ecf48-75b0-44c8-9b01-af76f5de5a3d tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] Releasing lock "refresh_cache-872856e5-cdc4-444e-8835-55e36708d776" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 18:45:20 user nova-compute[75216]: DEBUG nova.compute.manager [None req-178ecf48-75b0-44c8-9b01-af76f5de5a3d tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] [instance: 872856e5-cdc4-444e-8835-55e36708d776] Instance network_info: |[{"id": "296cb77a-c087-4484-adf2-7fd703942e0d", "address": "fa:16:3e:86:fe:e9", "network": {"id": "14e06b65-d8b1-43d1-a1f3-03e6c82ecc39", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2042637446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "462d302bb02243f89ec881369fcf7301", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap296cb77a-c0", "ovs_interfaceid": "296cb77a-c087-4484-adf2-7fd703942e0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 18:45:20 user nova-compute[75216]: DEBUG nova.network.neutron [req-6876bb91-4061-4b26-9637-a428467df540 req-ee617b19-925c-418c-b9f9-497c6db7ebd8 service nova] [instance: 83fda249-9d28-4cc2-aeb0-103ce4f1faa4] Updated VIF entry in instance network info cache for port 001a2459-5886-44be-aeb3-b2fb4ab71926. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 18:45:20 user nova-compute[75216]: DEBUG nova.network.neutron [req-6876bb91-4061-4b26-9637-a428467df540 req-ee617b19-925c-418c-b9f9-497c6db7ebd8 service nova] [instance: 83fda249-9d28-4cc2-aeb0-103ce4f1faa4] Updating instance_info_cache with network_info: [{"id": "001a2459-5886-44be-aeb3-b2fb4ab71926", "address": "fa:16:3e:ea:a2:8e", "network": {"id": "3e05e26f-bb3f-48d7-a8cf-8974b02b1745", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-600263470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d63d01c37774af48f4d3e49901802f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap001a2459-58", "ovs_interfaceid": "001a2459-5886-44be-aeb3-b2fb4ab71926", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 18:45:20 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-0897bdae-946a-4fbb-b085-565deca61e95 req-43391329-e40e-4a9e-890b-1888f6e88651 service nova] Acquired lock "refresh_cache-872856e5-cdc4-444e-8835-55e36708d776" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 18:45:20 user nova-compute[75216]: DEBUG nova.network.neutron [req-0897bdae-946a-4fbb-b085-565deca61e95 req-43391329-e40e-4a9e-890b-1888f6e88651 service nova] [instance: 872856e5-cdc4-444e-8835-55e36708d776] Refreshing network info cache for port 296cb77a-c087-4484-adf2-7fd703942e0d {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 18:45:20 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-178ecf48-75b0-44c8-9b01-af76f5de5a3d tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] [instance: 872856e5-cdc4-444e-8835-55e36708d776] Start _get_guest_xml network_info=[{"id": "296cb77a-c087-4484-adf2-7fd703942e0d", "address": "fa:16:3e:86:fe:e9", "network": {"id": "14e06b65-d8b1-43d1-a1f3-03e6c82ecc39", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2042637446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "462d302bb02243f89ec881369fcf7301", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap296cb77a-c0", "ovs_interfaceid": "296cb77a-c087-4484-adf2-7fd703942e0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T18:41:06Z,direct_url=<?>,disk_format='qcow2',id=77bcb5ba-8510-41ec-a88d-96097bb431de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c465b7c26ec44582b6d1b7169536ecc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T18:41:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'guest_format': None, 'boot_index': 0, 'image_id': '77bcb5ba-8510-41ec-a88d-96097bb431de'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 18:45:20 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-6876bb91-4061-4b26-9637-a428467df540 req-ee617b19-925c-418c-b9f9-497c6db7ebd8 service nova] Releasing lock "refresh_cache-83fda249-9d28-4cc2-aeb0-103ce4f1faa4" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 18:45:21 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-178ecf48-75b0-44c8-9b01-af76f5de5a3d tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 18:45:21 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-178ecf48-75b0-44c8-9b01-af76f5de5a3d tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 18:45:21 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-178ecf48-75b0-44c8-9b01-af76f5de5a3d tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 18:45:21 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-178ecf48-75b0-44c8-9b01-af76f5de5a3d tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] CPU controller missing on host. {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 18:45:21 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-178ecf48-75b0-44c8-9b01-af76f5de5a3d tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 18:45:21 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-178ecf48-75b0-44c8-9b01-af76f5de5a3d tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] CPU controller found on host. {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 18:45:21 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-178ecf48-75b0-44c8-9b01-af76f5de5a3d tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75216) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 18:45:21 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-178ecf48-75b0-44c8-9b01-af76f5de5a3d tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T18:40:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T18:41:06Z,direct_url=<?>,disk_format='qcow2',id=77bcb5ba-8510-41ec-a88d-96097bb431de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c465b7c26ec44582b6d1b7169536ecc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T18:41:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 18:45:21 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-178ecf48-75b0-44c8-9b01-af76f5de5a3d tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] Flavor limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 18:45:21 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-178ecf48-75b0-44c8-9b01-af76f5de5a3d tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] Image limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 18:45:21 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-178ecf48-75b0-44c8-9b01-af76f5de5a3d tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] Flavor pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 18:45:21 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-178ecf48-75b0-44c8-9b01-af76f5de5a3d tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] Image pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 18:45:21 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-178ecf48-75b0-44c8-9b01-af76f5de5a3d tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 18:45:21 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-178ecf48-75b0-44c8-9b01-af76f5de5a3d tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 18:45:21 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-178ecf48-75b0-44c8-9b01-af76f5de5a3d tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 18:45:21 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-178ecf48-75b0-44c8-9b01-af76f5de5a3d tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] Got 1 possible topologies {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 18:45:21 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-178ecf48-75b0-44c8-9b01-af76f5de5a3d tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 18:45:21 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-178ecf48-75b0-44c8-9b01-af76f5de5a3d tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 18:45:21 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-178ecf48-75b0-44c8-9b01-af76f5de5a3d tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T18:45:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1869777560',display_name='tempest-TestVolumeSwap-server-1869777560',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1869777560',id=7,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNzwwoef1ZbrsFPrKPP4nqNUUInozLsiDXyu7XYjWtk1tyJvFx18YhtE8Us2TK+oD/Kadav8Y+h0nHYKbbfvPtX064TSnGRMOFBywFpyjdgXojfROppOsb6bW75Jx+xD9A==',key_name='tempest-keypair-1485195297',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='462d302bb02243f89ec881369fcf7301',ramdisk_id='',reservation_id='r-qob74pu4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-990658792',owner_user_name='tempest-TestVolumeSwap-990658792-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T18:45:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='85d5c0c3293f41ec9adb01dceb492c27',uuid=872856e5-cdc4-444e-8835-55e36708d776,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "296cb77a-c087-4484-adf2-7fd703942e0d", "address": "fa:16:3e:86:fe:e9", "network": {"id": "14e06b65-d8b1-43d1-a1f3-03e6c82ecc39", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2042637446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "462d302bb02243f89ec881369fcf7301", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap296cb77a-c0", "ovs_interfaceid": "296cb77a-c087-4484-adf2-7fd703942e0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75216) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 18:45:21 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-178ecf48-75b0-44c8-9b01-af76f5de5a3d tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] Converting VIF {"id": "296cb77a-c087-4484-adf2-7fd703942e0d", "address": "fa:16:3e:86:fe:e9", "network": {"id": "14e06b65-d8b1-43d1-a1f3-03e6c82ecc39", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2042637446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "462d302bb02243f89ec881369fcf7301", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap296cb77a-c0", "ovs_interfaceid": "296cb77a-c087-4484-adf2-7fd703942e0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 18:45:21 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-178ecf48-75b0-44c8-9b01-af76f5de5a3d tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:fe:e9,bridge_name='br-int',has_traffic_filtering=True,id=296cb77a-c087-4484-adf2-7fd703942e0d,network=Network(14e06b65-d8b1-43d1-a1f3-03e6c82ecc39),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap296cb77a-c0') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 18:45:21 user nova-compute[75216]: DEBUG nova.objects.instance [None req-178ecf48-75b0-44c8-9b01-af76f5de5a3d tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] Lazy-loading 'pci_devices' on Instance uuid 872856e5-cdc4-444e-8835-55e36708d776 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 18:45:21 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-178ecf48-75b0-44c8-9b01-af76f5de5a3d tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] [instance: 872856e5-cdc4-444e-8835-55e36708d776] End _get_guest_xml xml=<domain type="kvm">
Nov 13 18:45:21 user nova-compute[75216]:   <uuid>872856e5-cdc4-444e-8835-55e36708d776</uuid>
Nov 13 18:45:21 user nova-compute[75216]:   <name>instance-00000007</name>
Nov 13 18:45:21 user nova-compute[75216]:   <memory>524288</memory>
Nov 13 18:45:21 user nova-compute[75216]:   <vcpu>1</vcpu>
Nov 13 18:45:21 user nova-compute[75216]:   <metadata>
Nov 13 18:45:21 user nova-compute[75216]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 18:45:21 user nova-compute[75216]:       <nova:package version="0.0.0"/>
Nov 13 18:45:21 user nova-compute[75216]:       <nova:name>tempest-TestVolumeSwap-server-1869777560</nova:name>
Nov 13 18:45:21 user nova-compute[75216]:       <nova:creationTime>2023-11-13 18:45:21</nova:creationTime>
Nov 13 18:45:21 user nova-compute[75216]:       <nova:flavor name="m1.tiny">
Nov 13 18:45:21 user nova-compute[75216]:         <nova:memory>512</nova:memory>
Nov 13 18:45:21 user nova-compute[75216]:         <nova:disk>1</nova:disk>
Nov 13 18:45:21 user nova-compute[75216]:         <nova:swap>0</nova:swap>
Nov 13 18:45:21 user nova-compute[75216]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 18:45:21 user nova-compute[75216]:         <nova:vcpus>1</nova:vcpus>
Nov 13 18:45:21 user nova-compute[75216]:       </nova:flavor>
Nov 13 18:45:21 user nova-compute[75216]:       <nova:owner>
Nov 13 18:45:21 user nova-compute[75216]:         <nova:user uuid="85d5c0c3293f41ec9adb01dceb492c27">tempest-TestVolumeSwap-990658792-project-member</nova:user>
Nov 13 18:45:21 user nova-compute[75216]:         <nova:project uuid="462d302bb02243f89ec881369fcf7301">tempest-TestVolumeSwap-990658792</nova:project>
Nov 13 18:45:21 user nova-compute[75216]:       </nova:owner>
Nov 13 18:45:21 user nova-compute[75216]:       <nova:root type="image" uuid="77bcb5ba-8510-41ec-a88d-96097bb431de"/>
Nov 13 18:45:21 user nova-compute[75216]:       <nova:ports>
Nov 13 18:45:21 user nova-compute[75216]:         <nova:port uuid="296cb77a-c087-4484-adf2-7fd703942e0d">
Nov 13 18:45:21 user nova-compute[75216]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 13 18:45:21 user nova-compute[75216]:         </nova:port>
Nov 13 18:45:21 user nova-compute[75216]:       </nova:ports>
Nov 13 18:45:21 user nova-compute[75216]:     </nova:instance>
Nov 13 18:45:21 user nova-compute[75216]:   </metadata>
Nov 13 18:45:21 user nova-compute[75216]:   <sysinfo type="smbios">
Nov 13 18:45:21 user nova-compute[75216]:     <system>
Nov 13 18:45:21 user nova-compute[75216]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 18:45:21 user nova-compute[75216]:       <entry name="product">OpenStack Nova</entry>
Nov 13 18:45:21 user nova-compute[75216]:       <entry name="version">0.0.0</entry>
Nov 13 18:45:21 user nova-compute[75216]:       <entry name="serial">872856e5-cdc4-444e-8835-55e36708d776</entry>
Nov 13 18:45:21 user nova-compute[75216]:       <entry name="uuid">872856e5-cdc4-444e-8835-55e36708d776</entry>
Nov 13 18:45:21 user nova-compute[75216]:       <entry name="family">Virtual Machine</entry>
Nov 13 18:45:21 user nova-compute[75216]:     </system>
Nov 13 18:45:21 user nova-compute[75216]:   </sysinfo>
Nov 13 18:45:21 user nova-compute[75216]:   <os>
Nov 13 18:45:21 user nova-compute[75216]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 18:45:21 user nova-compute[75216]:     <boot dev="hd"/>
Nov 13 18:45:21 user nova-compute[75216]:     <smbios mode="sysinfo"/>
Nov 13 18:45:21 user nova-compute[75216]:   </os>
Nov 13 18:45:21 user nova-compute[75216]:   <features>
Nov 13 18:45:21 user nova-compute[75216]:     <acpi/>
Nov 13 18:45:21 user nova-compute[75216]:     <apic/>
Nov 13 18:45:21 user nova-compute[75216]:     <vmcoreinfo/>
Nov 13 18:45:21 user nova-compute[75216]:   </features>
Nov 13 18:45:21 user nova-compute[75216]:   <clock offset="utc">
Nov 13 18:45:21 user nova-compute[75216]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 18:45:21 user nova-compute[75216]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 18:45:21 user nova-compute[75216]:     <timer name="hpet" present="no"/>
Nov 13 18:45:21 user nova-compute[75216]:   </clock>
Nov 13 18:45:21 user nova-compute[75216]:   <cpu mode="custom" match="exact">
Nov 13 18:45:21 user nova-compute[75216]:     <model>Nehalem</model>
Nov 13 18:45:21 user nova-compute[75216]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 18:45:21 user nova-compute[75216]:   </cpu>
Nov 13 18:45:21 user nova-compute[75216]:   <devices>
Nov 13 18:45:21 user nova-compute[75216]:     <disk type="file" device="disk">
Nov 13 18:45:21 user nova-compute[75216]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 18:45:21 user nova-compute[75216]:       <source file="/opt/stack/data/nova/instances/872856e5-cdc4-444e-8835-55e36708d776/disk"/>
Nov 13 18:45:21 user nova-compute[75216]:       <target dev="vda" bus="virtio"/>
Nov 13 18:45:21 user nova-compute[75216]:     </disk>
Nov 13 18:45:21 user nova-compute[75216]:     <interface type="ethernet">
Nov 13 18:45:21 user nova-compute[75216]:       <mac address="fa:16:3e:86:fe:e9"/>
Nov 13 18:45:21 user nova-compute[75216]:       <model type="virtio"/>
Nov 13 18:45:21 user nova-compute[75216]:       <mtu size="1442"/>
Nov 13 18:45:21 user nova-compute[75216]:       <target dev="tap296cb77a-c0"/>
Nov 13 18:45:21 user nova-compute[75216]:     </interface>
Nov 13 18:45:21 user nova-compute[75216]:     <serial type="pty">
Nov 13 18:45:21 user nova-compute[75216]:       <log file="/opt/stack/data/nova/instances/872856e5-cdc4-444e-8835-55e36708d776/console.log" append="off"/>
Nov 13 18:45:21 user nova-compute[75216]:     </serial>
Nov 13 18:45:21 user nova-compute[75216]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 18:45:21 user nova-compute[75216]:     <video>
Nov 13 18:45:21 user nova-compute[75216]:       <model type="virtio"/>
Nov 13 18:45:21 user nova-compute[75216]:     </video>
Nov 13 18:45:21 user nova-compute[75216]:     <rng model="virtio">
Nov 13 18:45:21 user nova-compute[75216]:       <backend model="random">/dev/urandom</backend>
Nov 13 18:45:21 user nova-compute[75216]:     </rng>
Nov 13 18:45:21 user nova-compute[75216]:     <controller type="usb" index="0" model="none"/>
Nov 13 18:45:21 user nova-compute[75216]:     <memballoon model="virtio">
Nov 13 18:45:21 user nova-compute[75216]:       <stats period="10"/>
Nov 13 18:45:21 user nova-compute[75216]:     </memballoon>
Nov 13 18:45:21 user nova-compute[75216]:   </devices>
Nov 13 18:45:21 user nova-compute[75216]: </domain>
Nov 13 18:45:21 user nova-compute[75216]:  {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 18:45:21 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-178ecf48-75b0-44c8-9b01-af76f5de5a3d tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T18:45:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1869777560',display_name='tempest-TestVolumeSwap-server-1869777560',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1869777560',id=7,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNzwwoef1ZbrsFPrKPP4nqNUUInozLsiDXyu7XYjWtk1tyJvFx18YhtE8Us2TK+oD/Kadav8Y+h0nHYKbbfvPtX064TSnGRMOFBywFpyjdgXojfROppOsb6bW75Jx+xD9A==',key_name='tempest-keypair-1485195297',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='462d302bb02243f89ec881369fcf7301',ramdisk_id='',reservation_id='r-qob74pu4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-990658792',owner_user_name='tempest-TestVolumeSwap-990658792-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T18:45:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='85d5c0c3293f41ec9adb01dceb492c27',uuid=872856e5-cdc4-444e-8835-55e36708d776,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "296cb77a-c087-4484-adf2-7fd703942e0d", "address": "fa:16:3e:86:fe:e9", "network": {"id": "14e06b65-d8b1-43d1-a1f3-03e6c82ecc39", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2042637446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "462d302bb02243f89ec881369fcf7301", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap296cb77a-c0", "ovs_interfaceid": "296cb77a-c087-4484-adf2-7fd703942e0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 18:45:21 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-178ecf48-75b0-44c8-9b01-af76f5de5a3d tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] Converting VIF {"id": "296cb77a-c087-4484-adf2-7fd703942e0d", "address": "fa:16:3e:86:fe:e9", "network": {"id": "14e06b65-d8b1-43d1-a1f3-03e6c82ecc39", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2042637446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "462d302bb02243f89ec881369fcf7301", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap296cb77a-c0", "ovs_interfaceid": "296cb77a-c087-4484-adf2-7fd703942e0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 18:45:21 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-178ecf48-75b0-44c8-9b01-af76f5de5a3d tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:fe:e9,bridge_name='br-int',has_traffic_filtering=True,id=296cb77a-c087-4484-adf2-7fd703942e0d,network=Network(14e06b65-d8b1-43d1-a1f3-03e6c82ecc39),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap296cb77a-c0') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 18:45:21 user nova-compute[75216]: DEBUG os_vif [None req-178ecf48-75b0-44c8-9b01-af76f5de5a3d tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:fe:e9,bridge_name='br-int',has_traffic_filtering=True,id=296cb77a-c087-4484-adf2-7fd703942e0d,network=Network(14e06b65-d8b1-43d1-a1f3-03e6c82ecc39),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap296cb77a-c0') {{(pid=75216) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 18:45:21 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:45:21 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:45:21 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 18:45:21 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:45:21 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5da4d951-7567-50ed-8420-705038169372', '_type': 'linux-noop'}}, row=False) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:45:21 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:45:21 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:45:21 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:45:21 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap296cb77a-c0, may_exist=True, interface_attrs={}) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:45:21 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap296cb77a-c0, col_values=(('qos', UUID('0b1ca8df-64b4-442c-99f2-460185ac59d7')),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:45:21 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap296cb77a-c0, col_values=(('external_ids', {'iface-id': '296cb77a-c087-4484-adf2-7fd703942e0d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:86:fe:e9', 'vm-uuid': '872856e5-cdc4-444e-8835-55e36708d776'}),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:45:21 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:45:21 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:45:21 user nova-compute[75216]: INFO os_vif [None req-178ecf48-75b0-44c8-9b01-af76f5de5a3d tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:fe:e9,bridge_name='br-int',has_traffic_filtering=True,id=296cb77a-c087-4484-adf2-7fd703942e0d,network=Network(14e06b65-d8b1-43d1-a1f3-03e6c82ecc39),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap296cb77a-c0')
Nov 13 18:45:21 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-178ecf48-75b0-44c8-9b01-af76f5de5a3d tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 18:45:21 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-178ecf48-75b0-44c8-9b01-af76f5de5a3d tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] No VIF found with MAC fa:16:3e:86:fe:e9, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 18:45:22 user nova-compute[75216]: DEBUG nova.network.neutron [req-0897bdae-946a-4fbb-b085-565deca61e95 req-43391329-e40e-4a9e-890b-1888f6e88651 service nova] [instance: 872856e5-cdc4-444e-8835-55e36708d776] Updated VIF entry in instance network info cache for port 296cb77a-c087-4484-adf2-7fd703942e0d. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 18:45:22 user nova-compute[75216]: DEBUG nova.network.neutron [req-0897bdae-946a-4fbb-b085-565deca61e95 req-43391329-e40e-4a9e-890b-1888f6e88651 service nova] [instance: 872856e5-cdc4-444e-8835-55e36708d776] Updating instance_info_cache with network_info: [{"id": "296cb77a-c087-4484-adf2-7fd703942e0d", "address": "fa:16:3e:86:fe:e9", "network": {"id": "14e06b65-d8b1-43d1-a1f3-03e6c82ecc39", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2042637446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "462d302bb02243f89ec881369fcf7301", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap296cb77a-c0", "ovs_interfaceid": "296cb77a-c087-4484-adf2-7fd703942e0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 18:45:22 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-0897bdae-946a-4fbb-b085-565deca61e95 req-43391329-e40e-4a9e-890b-1888f6e88651 service nova] Releasing lock "refresh_cache-872856e5-cdc4-444e-8835-55e36708d776" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 18:45:22 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:45:22 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:45:22 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:45:22 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:45:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:45:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:45:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:45:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:45:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:45:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:45:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:45:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:45:24 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:45:24 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:45:24 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:45:25 user nova-compute[75216]: DEBUG nova.compute.manager [req-d3b8358e-f063-4397-a5e8-90a78c9aa35d req-e51cce35-591c-48ed-ac1c-e679262b7806 service nova] [instance: 83fda249-9d28-4cc2-aeb0-103ce4f1faa4] Received event network-vif-plugged-001a2459-5886-44be-aeb3-b2fb4ab71926 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:45:25 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-d3b8358e-f063-4397-a5e8-90a78c9aa35d req-e51cce35-591c-48ed-ac1c-e679262b7806 service nova] Acquiring lock "83fda249-9d28-4cc2-aeb0-103ce4f1faa4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:45:25 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-d3b8358e-f063-4397-a5e8-90a78c9aa35d req-e51cce35-591c-48ed-ac1c-e679262b7806 service nova] Lock "83fda249-9d28-4cc2-aeb0-103ce4f1faa4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:45:25 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-d3b8358e-f063-4397-a5e8-90a78c9aa35d req-e51cce35-591c-48ed-ac1c-e679262b7806 service nova] Lock "83fda249-9d28-4cc2-aeb0-103ce4f1faa4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:45:25 user nova-compute[75216]: DEBUG nova.compute.manager [req-d3b8358e-f063-4397-a5e8-90a78c9aa35d req-e51cce35-591c-48ed-ac1c-e679262b7806 service nova] [instance: 83fda249-9d28-4cc2-aeb0-103ce4f1faa4] No waiting events found dispatching network-vif-plugged-001a2459-5886-44be-aeb3-b2fb4ab71926 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:45:25 user nova-compute[75216]: WARNING nova.compute.manager [req-d3b8358e-f063-4397-a5e8-90a78c9aa35d req-e51cce35-591c-48ed-ac1c-e679262b7806 service nova] [instance: 83fda249-9d28-4cc2-aeb0-103ce4f1faa4] Received unexpected event network-vif-plugged-001a2459-5886-44be-aeb3-b2fb4ab71926 for instance with vm_state building and task_state spawning.
Nov 13 18:45:25 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-b891abdd-7c1f-4fa1-886c-41f06b6fac17 tempest-VolumesAssistedSnapshotsTest-1233733883 tempest-VolumesAssistedSnapshotsTest-1233733883-project-member] Acquiring lock "576e97b7-285a-451f-a80d-aaa321a79d3b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:45:25 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-b891abdd-7c1f-4fa1-886c-41f06b6fac17 tempest-VolumesAssistedSnapshotsTest-1233733883 tempest-VolumesAssistedSnapshotsTest-1233733883-project-member] Lock "576e97b7-285a-451f-a80d-aaa321a79d3b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:45:25 user nova-compute[75216]: DEBUG nova.compute.manager [None req-b891abdd-7c1f-4fa1-886c-41f06b6fac17 tempest-VolumesAssistedSnapshotsTest-1233733883 tempest-VolumesAssistedSnapshotsTest-1233733883-project-member] [instance: 576e97b7-285a-451f-a80d-aaa321a79d3b] Starting instance... {{(pid=75216) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 18:45:25 user nova-compute[75216]: DEBUG nova.compute.manager [None req-734e9cbf-763f-44af-835a-86f0aef47cb8 tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] [instance: 83fda249-9d28-4cc2-aeb0-103ce4f1faa4] Instance event wait completed in 0 seconds for  {{(pid=75216) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 18:45:25 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-734e9cbf-763f-44af-835a-86f0aef47cb8 tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] [instance: 83fda249-9d28-4cc2-aeb0-103ce4f1faa4] Guest created on hypervisor {{(pid=75216) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 18:45:25 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 83fda249-9d28-4cc2-aeb0-103ce4f1faa4] Instance spawned successfully.
Nov 13 18:45:25 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-734e9cbf-763f-44af-835a-86f0aef47cb8 tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] [instance: 83fda249-9d28-4cc2-aeb0-103ce4f1faa4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 18:45:26 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-734e9cbf-763f-44af-835a-86f0aef47cb8 tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] [instance: 83fda249-9d28-4cc2-aeb0-103ce4f1faa4] Found default for hw_cdrom_bus of ide {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 18:45:26 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-734e9cbf-763f-44af-835a-86f0aef47cb8 tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] [instance: 83fda249-9d28-4cc2-aeb0-103ce4f1faa4] Found default for hw_disk_bus of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 18:45:26 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-734e9cbf-763f-44af-835a-86f0aef47cb8 tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] [instance: 83fda249-9d28-4cc2-aeb0-103ce4f1faa4] Found default for hw_input_bus of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 18:45:26 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-734e9cbf-763f-44af-835a-86f0aef47cb8 tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] [instance: 83fda249-9d28-4cc2-aeb0-103ce4f1faa4] Found default for hw_pointer_model of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 18:45:26 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-734e9cbf-763f-44af-835a-86f0aef47cb8 tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] [instance: 83fda249-9d28-4cc2-aeb0-103ce4f1faa4] Found default for hw_video_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 18:45:26 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-734e9cbf-763f-44af-835a-86f0aef47cb8 tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] [instance: 83fda249-9d28-4cc2-aeb0-103ce4f1faa4] Found default for hw_vif_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 18:45:26 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-b891abdd-7c1f-4fa1-886c-41f06b6fac17 tempest-VolumesAssistedSnapshotsTest-1233733883 tempest-VolumesAssistedSnapshotsTest-1233733883-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:45:26 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-b891abdd-7c1f-4fa1-886c-41f06b6fac17 tempest-VolumesAssistedSnapshotsTest-1233733883 tempest-VolumesAssistedSnapshotsTest-1233733883-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:45:26 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-b891abdd-7c1f-4fa1-886c-41f06b6fac17 tempest-VolumesAssistedSnapshotsTest-1233733883 tempest-VolumesAssistedSnapshotsTest-1233733883-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75216) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 18:45:26 user nova-compute[75216]: INFO nova.compute.claims [None req-b891abdd-7c1f-4fa1-886c-41f06b6fac17 tempest-VolumesAssistedSnapshotsTest-1233733883 tempest-VolumesAssistedSnapshotsTest-1233733883-project-member] [instance: 576e97b7-285a-451f-a80d-aaa321a79d3b] Claim successful on node user
Nov 13 18:45:26 user nova-compute[75216]: INFO nova.compute.manager [None req-734e9cbf-763f-44af-835a-86f0aef47cb8 tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] [instance: 83fda249-9d28-4cc2-aeb0-103ce4f1faa4] Took 11.39 seconds to spawn the instance on the hypervisor.
Nov 13 18:45:26 user nova-compute[75216]: DEBUG nova.compute.manager [None req-734e9cbf-763f-44af-835a-86f0aef47cb8 tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] [instance: 83fda249-9d28-4cc2-aeb0-103ce4f1faa4] Checking state {{(pid=75216) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 18:45:26 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:45:26 user nova-compute[75216]: DEBUG nova.compute.manager [None req-178ecf48-75b0-44c8-9b01-af76f5de5a3d tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] [instance: 872856e5-cdc4-444e-8835-55e36708d776] Instance event wait completed in 0 seconds for  {{(pid=75216) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 18:45:26 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-178ecf48-75b0-44c8-9b01-af76f5de5a3d tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] [instance: 872856e5-cdc4-444e-8835-55e36708d776] Guest created on hypervisor {{(pid=75216) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 18:45:26 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 872856e5-cdc4-444e-8835-55e36708d776] Instance spawned successfully.
Nov 13 18:45:26 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-178ecf48-75b0-44c8-9b01-af76f5de5a3d tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] [instance: 872856e5-cdc4-444e-8835-55e36708d776] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 18:45:26 user nova-compute[75216]: INFO nova.compute.manager [None req-734e9cbf-763f-44af-835a-86f0aef47cb8 tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] [instance: 83fda249-9d28-4cc2-aeb0-103ce4f1faa4] Took 12.61 seconds to build instance.
Nov 13 18:45:26 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-178ecf48-75b0-44c8-9b01-af76f5de5a3d tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] [instance: 872856e5-cdc4-444e-8835-55e36708d776] Found default for hw_cdrom_bus of ide {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 18:45:26 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-178ecf48-75b0-44c8-9b01-af76f5de5a3d tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] [instance: 872856e5-cdc4-444e-8835-55e36708d776] Found default for hw_disk_bus of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 18:45:26 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-178ecf48-75b0-44c8-9b01-af76f5de5a3d tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] [instance: 872856e5-cdc4-444e-8835-55e36708d776] Found default for hw_input_bus of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 18:45:26 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-178ecf48-75b0-44c8-9b01-af76f5de5a3d tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] [instance: 872856e5-cdc4-444e-8835-55e36708d776] Found default for hw_pointer_model of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 18:45:26 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-178ecf48-75b0-44c8-9b01-af76f5de5a3d tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] [instance: 872856e5-cdc4-444e-8835-55e36708d776] Found default for hw_video_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 18:45:26 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-178ecf48-75b0-44c8-9b01-af76f5de5a3d tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] [instance: 872856e5-cdc4-444e-8835-55e36708d776] Found default for hw_vif_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 18:45:26 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-734e9cbf-763f-44af-835a-86f0aef47cb8 tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] Lock "83fda249-9d28-4cc2-aeb0-103ce4f1faa4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.910s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:45:26 user nova-compute[75216]: INFO nova.compute.manager [None req-178ecf48-75b0-44c8-9b01-af76f5de5a3d tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] [instance: 872856e5-cdc4-444e-8835-55e36708d776] Took 9.04 seconds to spawn the instance on the hypervisor.
Nov 13 18:45:26 user nova-compute[75216]: DEBUG nova.compute.manager [None req-178ecf48-75b0-44c8-9b01-af76f5de5a3d tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] [instance: 872856e5-cdc4-444e-8835-55e36708d776] Checking state {{(pid=75216) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 18:45:26 user nova-compute[75216]: INFO nova.compute.manager [None req-178ecf48-75b0-44c8-9b01-af76f5de5a3d tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] [instance: 872856e5-cdc4-444e-8835-55e36708d776] Took 10.21 seconds to build instance.
Nov 13 18:45:26 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-178ecf48-75b0-44c8-9b01-af76f5de5a3d tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] Lock "872856e5-cdc4-444e-8835-55e36708d776" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.345s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:45:26 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-b891abdd-7c1f-4fa1-886c-41f06b6fac17 tempest-VolumesAssistedSnapshotsTest-1233733883 tempest-VolumesAssistedSnapshotsTest-1233733883-project-member] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 18:45:26 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-b891abdd-7c1f-4fa1-886c-41f06b6fac17 tempest-VolumesAssistedSnapshotsTest-1233733883 tempest-VolumesAssistedSnapshotsTest-1233733883-project-member] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 18:45:26 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-b891abdd-7c1f-4fa1-886c-41f06b6fac17 tempest-VolumesAssistedSnapshotsTest-1233733883 tempest-VolumesAssistedSnapshotsTest-1233733883-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.534s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:45:26 user nova-compute[75216]: DEBUG nova.compute.manager [None req-b891abdd-7c1f-4fa1-886c-41f06b6fac17 tempest-VolumesAssistedSnapshotsTest-1233733883 tempest-VolumesAssistedSnapshotsTest-1233733883-project-member] [instance: 576e97b7-285a-451f-a80d-aaa321a79d3b] Start building networks asynchronously for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 18:45:26 user nova-compute[75216]: DEBUG nova.compute.manager [None req-b891abdd-7c1f-4fa1-886c-41f06b6fac17 tempest-VolumesAssistedSnapshotsTest-1233733883 tempest-VolumesAssistedSnapshotsTest-1233733883-project-member] [instance: 576e97b7-285a-451f-a80d-aaa321a79d3b] Allocating IP information in the background. {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 18:45:26 user nova-compute[75216]: DEBUG nova.network.neutron [None req-b891abdd-7c1f-4fa1-886c-41f06b6fac17 tempest-VolumesAssistedSnapshotsTest-1233733883 tempest-VolumesAssistedSnapshotsTest-1233733883-project-member] [instance: 576e97b7-285a-451f-a80d-aaa321a79d3b] allocate_for_instance() {{(pid=75216) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 18:45:26 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-b891abdd-7c1f-4fa1-886c-41f06b6fac17 tempest-VolumesAssistedSnapshotsTest-1233733883 tempest-VolumesAssistedSnapshotsTest-1233733883-project-member] [instance: 576e97b7-285a-451f-a80d-aaa321a79d3b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 18:45:26 user nova-compute[75216]: DEBUG nova.compute.manager [None req-b891abdd-7c1f-4fa1-886c-41f06b6fac17 tempest-VolumesAssistedSnapshotsTest-1233733883 tempest-VolumesAssistedSnapshotsTest-1233733883-project-member] [instance: 576e97b7-285a-451f-a80d-aaa321a79d3b] Start building block device mappings for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 18:45:26 user nova-compute[75216]: DEBUG nova.policy [None req-b891abdd-7c1f-4fa1-886c-41f06b6fac17 tempest-VolumesAssistedSnapshotsTest-1233733883 tempest-VolumesAssistedSnapshotsTest-1233733883-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '526a993a42884f82a75231be9aa332cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763712c69c7f45a8a0ff5cfdeb032baa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75216) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 18:45:26 user nova-compute[75216]: DEBUG nova.compute.manager [None req-b891abdd-7c1f-4fa1-886c-41f06b6fac17 tempest-VolumesAssistedSnapshotsTest-1233733883 tempest-VolumesAssistedSnapshotsTest-1233733883-project-member] [instance: 576e97b7-285a-451f-a80d-aaa321a79d3b] Start spawning the instance on the hypervisor. {{(pid=75216) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 18:45:26 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-b891abdd-7c1f-4fa1-886c-41f06b6fac17 tempest-VolumesAssistedSnapshotsTest-1233733883 tempest-VolumesAssistedSnapshotsTest-1233733883-project-member] [instance: 576e97b7-285a-451f-a80d-aaa321a79d3b] Creating instance directory {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 18:45:26 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-b891abdd-7c1f-4fa1-886c-41f06b6fac17 tempest-VolumesAssistedSnapshotsTest-1233733883 tempest-VolumesAssistedSnapshotsTest-1233733883-project-member] [instance: 576e97b7-285a-451f-a80d-aaa321a79d3b] Creating image(s)
Nov 13 18:45:26 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-b891abdd-7c1f-4fa1-886c-41f06b6fac17 tempest-VolumesAssistedSnapshotsTest-1233733883 tempest-VolumesAssistedSnapshotsTest-1233733883-project-member] Acquiring lock "/opt/stack/data/nova/instances/576e97b7-285a-451f-a80d-aaa321a79d3b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:45:26 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-b891abdd-7c1f-4fa1-886c-41f06b6fac17 tempest-VolumesAssistedSnapshotsTest-1233733883 tempest-VolumesAssistedSnapshotsTest-1233733883-project-member] Lock "/opt/stack/data/nova/instances/576e97b7-285a-451f-a80d-aaa321a79d3b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:45:26 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-b891abdd-7c1f-4fa1-886c-41f06b6fac17 tempest-VolumesAssistedSnapshotsTest-1233733883 tempest-VolumesAssistedSnapshotsTest-1233733883-project-member] Lock "/opt/stack/data/nova/instances/576e97b7-285a-451f-a80d-aaa321a79d3b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:45:26 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-b891abdd-7c1f-4fa1-886c-41f06b6fac17 tempest-VolumesAssistedSnapshotsTest-1233733883 tempest-VolumesAssistedSnapshotsTest-1233733883-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:45:27 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-b891abdd-7c1f-4fa1-886c-41f06b6fac17 tempest-VolumesAssistedSnapshotsTest-1233733883 tempest-VolumesAssistedSnapshotsTest-1233733883-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json" returned: 0 in 0.249s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:45:27 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-b891abdd-7c1f-4fa1-886c-41f06b6fac17 tempest-VolumesAssistedSnapshotsTest-1233733883 tempest-VolumesAssistedSnapshotsTest-1233733883-project-member] Acquiring lock "88c50a45bec9d6b0427462b3242b9b8e5f49c2b6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:45:27 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-b891abdd-7c1f-4fa1-886c-41f06b6fac17 tempest-VolumesAssistedSnapshotsTest-1233733883 tempest-VolumesAssistedSnapshotsTest-1233733883-project-member] Lock "88c50a45bec9d6b0427462b3242b9b8e5f49c2b6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.008s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:45:27 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-b891abdd-7c1f-4fa1-886c-41f06b6fac17 tempest-VolumesAssistedSnapshotsTest-1233733883 tempest-VolumesAssistedSnapshotsTest-1233733883-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:45:27 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-b891abdd-7c1f-4fa1-886c-41f06b6fac17 tempest-VolumesAssistedSnapshotsTest-1233733883 tempest-VolumesAssistedSnapshotsTest-1233733883-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json" returned: 0 in 0.239s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:45:27 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-b891abdd-7c1f-4fa1-886c-41f06b6fac17 tempest-VolumesAssistedSnapshotsTest-1233733883 tempest-VolumesAssistedSnapshotsTest-1233733883-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6,backing_fmt=raw /opt/stack/data/nova/instances/576e97b7-285a-451f-a80d-aaa321a79d3b/disk 1073741824 {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:45:27 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-b891abdd-7c1f-4fa1-886c-41f06b6fac17 tempest-VolumesAssistedSnapshotsTest-1233733883 tempest-VolumesAssistedSnapshotsTest-1233733883-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6,backing_fmt=raw /opt/stack/data/nova/instances/576e97b7-285a-451f-a80d-aaa321a79d3b/disk 1073741824" returned: 0 in 0.063s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:45:27 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-b891abdd-7c1f-4fa1-886c-41f06b6fac17 tempest-VolumesAssistedSnapshotsTest-1233733883 tempest-VolumesAssistedSnapshotsTest-1233733883-project-member] Lock "88c50a45bec9d6b0427462b3242b9b8e5f49c2b6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.312s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:45:27 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-b891abdd-7c1f-4fa1-886c-41f06b6fac17 tempest-VolumesAssistedSnapshotsTest-1233733883 tempest-VolumesAssistedSnapshotsTest-1233733883-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:45:27 user nova-compute[75216]: DEBUG nova.network.neutron [None req-b891abdd-7c1f-4fa1-886c-41f06b6fac17 tempest-VolumesAssistedSnapshotsTest-1233733883 tempest-VolumesAssistedSnapshotsTest-1233733883-project-member] [instance: 576e97b7-285a-451f-a80d-aaa321a79d3b] Successfully created port: af70d3c4-b668-4cfa-92fb-5bf17a903572 {{(pid=75216) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 18:45:27 user nova-compute[75216]: DEBUG nova.compute.manager [req-7ed811a4-260e-427a-b336-01baf4c3b776 req-249be178-327d-4707-891e-22aee5756d30 service nova] [instance: 83fda249-9d28-4cc2-aeb0-103ce4f1faa4] Received event network-vif-plugged-001a2459-5886-44be-aeb3-b2fb4ab71926 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:45:27 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-7ed811a4-260e-427a-b336-01baf4c3b776 req-249be178-327d-4707-891e-22aee5756d30 service nova] Acquiring lock "83fda249-9d28-4cc2-aeb0-103ce4f1faa4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:45:27 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-7ed811a4-260e-427a-b336-01baf4c3b776 req-249be178-327d-4707-891e-22aee5756d30 service nova] Lock "83fda249-9d28-4cc2-aeb0-103ce4f1faa4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:45:27 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-7ed811a4-260e-427a-b336-01baf4c3b776 req-249be178-327d-4707-891e-22aee5756d30 service nova] Lock "83fda249-9d28-4cc2-aeb0-103ce4f1faa4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:45:27 user nova-compute[75216]: DEBUG nova.compute.manager [req-7ed811a4-260e-427a-b336-01baf4c3b776 req-249be178-327d-4707-891e-22aee5756d30 service nova] [instance: 83fda249-9d28-4cc2-aeb0-103ce4f1faa4] No waiting events found dispatching network-vif-plugged-001a2459-5886-44be-aeb3-b2fb4ab71926 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:45:27 user nova-compute[75216]: WARNING nova.compute.manager [req-7ed811a4-260e-427a-b336-01baf4c3b776 req-249be178-327d-4707-891e-22aee5756d30 service nova] [instance: 83fda249-9d28-4cc2-aeb0-103ce4f1faa4] Received unexpected event network-vif-plugged-001a2459-5886-44be-aeb3-b2fb4ab71926 for instance with vm_state active and task_state None.
Nov 13 18:45:27 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-b891abdd-7c1f-4fa1-886c-41f06b6fac17 tempest-VolumesAssistedSnapshotsTest-1233733883 tempest-VolumesAssistedSnapshotsTest-1233733883-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json" returned: 0 in 0.202s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:45:27 user nova-compute[75216]: DEBUG nova.virt.disk.api [None req-b891abdd-7c1f-4fa1-886c-41f06b6fac17 tempest-VolumesAssistedSnapshotsTest-1233733883 tempest-VolumesAssistedSnapshotsTest-1233733883-project-member] Checking if we can resize image /opt/stack/data/nova/instances/576e97b7-285a-451f-a80d-aaa321a79d3b/disk. size=1073741824 {{(pid=75216) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 18:45:27 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-b891abdd-7c1f-4fa1-886c-41f06b6fac17 tempest-VolumesAssistedSnapshotsTest-1233733883 tempest-VolumesAssistedSnapshotsTest-1233733883-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/576e97b7-285a-451f-a80d-aaa321a79d3b/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:45:27 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:45:27 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-b891abdd-7c1f-4fa1-886c-41f06b6fac17 tempest-VolumesAssistedSnapshotsTest-1233733883 tempest-VolumesAssistedSnapshotsTest-1233733883-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/576e97b7-285a-451f-a80d-aaa321a79d3b/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:45:27 user nova-compute[75216]: DEBUG nova.virt.disk.api [None req-b891abdd-7c1f-4fa1-886c-41f06b6fac17 tempest-VolumesAssistedSnapshotsTest-1233733883 tempest-VolumesAssistedSnapshotsTest-1233733883-project-member] Cannot resize image /opt/stack/data/nova/instances/576e97b7-285a-451f-a80d-aaa321a79d3b/disk to a smaller size. {{(pid=75216) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 18:45:27 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-b891abdd-7c1f-4fa1-886c-41f06b6fac17 tempest-VolumesAssistedSnapshotsTest-1233733883 tempest-VolumesAssistedSnapshotsTest-1233733883-project-member] [instance: 576e97b7-285a-451f-a80d-aaa321a79d3b] Created local disks {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 18:45:27 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-b891abdd-7c1f-4fa1-886c-41f06b6fac17 tempest-VolumesAssistedSnapshotsTest-1233733883 tempest-VolumesAssistedSnapshotsTest-1233733883-project-member] [instance: 576e97b7-285a-451f-a80d-aaa321a79d3b] Ensure instance console log exists: /opt/stack/data/nova/instances/576e97b7-285a-451f-a80d-aaa321a79d3b/console.log {{(pid=75216) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 18:45:27 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-b891abdd-7c1f-4fa1-886c-41f06b6fac17 tempest-VolumesAssistedSnapshotsTest-1233733883 tempest-VolumesAssistedSnapshotsTest-1233733883-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:45:27 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-b891abdd-7c1f-4fa1-886c-41f06b6fac17 tempest-VolumesAssistedSnapshotsTest-1233733883 tempest-VolumesAssistedSnapshotsTest-1233733883-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:45:27 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-b891abdd-7c1f-4fa1-886c-41f06b6fac17 tempest-VolumesAssistedSnapshotsTest-1233733883 tempest-VolumesAssistedSnapshotsTest-1233733883-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:45:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:45:28 user nova-compute[75216]: DEBUG nova.network.neutron [None req-b891abdd-7c1f-4fa1-886c-41f06b6fac17 tempest-VolumesAssistedSnapshotsTest-1233733883 tempest-VolumesAssistedSnapshotsTest-1233733883-project-member] [instance: 576e97b7-285a-451f-a80d-aaa321a79d3b] Successfully updated port: af70d3c4-b668-4cfa-92fb-5bf17a903572 {{(pid=75216) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 18:45:29 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-b891abdd-7c1f-4fa1-886c-41f06b6fac17 tempest-VolumesAssistedSnapshotsTest-1233733883 tempest-VolumesAssistedSnapshotsTest-1233733883-project-member] Acquiring lock "refresh_cache-576e97b7-285a-451f-a80d-aaa321a79d3b" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 18:45:29 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-b891abdd-7c1f-4fa1-886c-41f06b6fac17 tempest-VolumesAssistedSnapshotsTest-1233733883 tempest-VolumesAssistedSnapshotsTest-1233733883-project-member] Acquired lock "refresh_cache-576e97b7-285a-451f-a80d-aaa321a79d3b" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 18:45:29 user nova-compute[75216]: DEBUG nova.network.neutron [None req-b891abdd-7c1f-4fa1-886c-41f06b6fac17 tempest-VolumesAssistedSnapshotsTest-1233733883 tempest-VolumesAssistedSnapshotsTest-1233733883-project-member] [instance: 576e97b7-285a-451f-a80d-aaa321a79d3b] Building network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 18:45:29 user nova-compute[75216]: DEBUG nova.compute.manager [req-be53e012-e9dd-4cd3-83ed-5190070f8c98 req-8f4a62d2-c1db-4355-8d30-3bf6018806df service nova] [instance: 576e97b7-285a-451f-a80d-aaa321a79d3b] Received event network-changed-af70d3c4-b668-4cfa-92fb-5bf17a903572 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:45:29 user nova-compute[75216]: DEBUG nova.compute.manager [req-be53e012-e9dd-4cd3-83ed-5190070f8c98 req-8f4a62d2-c1db-4355-8d30-3bf6018806df service nova] [instance: 576e97b7-285a-451f-a80d-aaa321a79d3b] Refreshing instance network info cache due to event network-changed-af70d3c4-b668-4cfa-92fb-5bf17a903572. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 18:45:29 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-be53e012-e9dd-4cd3-83ed-5190070f8c98 req-8f4a62d2-c1db-4355-8d30-3bf6018806df service nova] Acquiring lock "refresh_cache-576e97b7-285a-451f-a80d-aaa321a79d3b" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 18:45:29 user nova-compute[75216]: DEBUG nova.network.neutron [None req-b891abdd-7c1f-4fa1-886c-41f06b6fac17 tempest-VolumesAssistedSnapshotsTest-1233733883 tempest-VolumesAssistedSnapshotsTest-1233733883-project-member] [instance: 576e97b7-285a-451f-a80d-aaa321a79d3b] Instance cache missing network info. {{(pid=75216) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 18:45:29 user nova-compute[75216]: DEBUG nova.network.neutron [None req-b891abdd-7c1f-4fa1-886c-41f06b6fac17 tempest-VolumesAssistedSnapshotsTest-1233733883 tempest-VolumesAssistedSnapshotsTest-1233733883-project-member] [instance: 576e97b7-285a-451f-a80d-aaa321a79d3b] Updating instance_info_cache with network_info: [{"id": "af70d3c4-b668-4cfa-92fb-5bf17a903572", "address": "fa:16:3e:72:14:30", "network": {"id": "a5954c64-25ea-4c12-b852-ce2cf531689c", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1064303336-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "763712c69c7f45a8a0ff5cfdeb032baa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf70d3c4-b6", "ovs_interfaceid": "af70d3c4-b668-4cfa-92fb-5bf17a903572", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 18:45:29 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-b891abdd-7c1f-4fa1-886c-41f06b6fac17 tempest-VolumesAssistedSnapshotsTest-1233733883 tempest-VolumesAssistedSnapshotsTest-1233733883-project-member] Releasing lock "refresh_cache-576e97b7-285a-451f-a80d-aaa321a79d3b" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 18:45:29 user nova-compute[75216]: DEBUG nova.compute.manager [None req-b891abdd-7c1f-4fa1-886c-41f06b6fac17 tempest-VolumesAssistedSnapshotsTest-1233733883 tempest-VolumesAssistedSnapshotsTest-1233733883-project-member] [instance: 576e97b7-285a-451f-a80d-aaa321a79d3b] Instance network_info: |[{"id": "af70d3c4-b668-4cfa-92fb-5bf17a903572", "address": "fa:16:3e:72:14:30", "network": {"id": "a5954c64-25ea-4c12-b852-ce2cf531689c", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1064303336-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "763712c69c7f45a8a0ff5cfdeb032baa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf70d3c4-b6", "ovs_interfaceid": "af70d3c4-b668-4cfa-92fb-5bf17a903572", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 18:45:30 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-be53e012-e9dd-4cd3-83ed-5190070f8c98 req-8f4a62d2-c1db-4355-8d30-3bf6018806df service nova] Acquired lock "refresh_cache-576e97b7-285a-451f-a80d-aaa321a79d3b" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 18:45:30 user nova-compute[75216]: DEBUG nova.network.neutron [req-be53e012-e9dd-4cd3-83ed-5190070f8c98 req-8f4a62d2-c1db-4355-8d30-3bf6018806df service nova] [instance: 576e97b7-285a-451f-a80d-aaa321a79d3b] Refreshing network info cache for port af70d3c4-b668-4cfa-92fb-5bf17a903572 {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 18:45:30 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-b891abdd-7c1f-4fa1-886c-41f06b6fac17 tempest-VolumesAssistedSnapshotsTest-1233733883 tempest-VolumesAssistedSnapshotsTest-1233733883-project-member] [instance: 576e97b7-285a-451f-a80d-aaa321a79d3b] Start _get_guest_xml network_info=[{"id": "af70d3c4-b668-4cfa-92fb-5bf17a903572", "address": "fa:16:3e:72:14:30", "network": {"id": "a5954c64-25ea-4c12-b852-ce2cf531689c", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1064303336-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "763712c69c7f45a8a0ff5cfdeb032baa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf70d3c4-b6", "ovs_interfaceid": "af70d3c4-b668-4cfa-92fb-5bf17a903572", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T18:41:06Z,direct_url=<?>,disk_format='qcow2',id=77bcb5ba-8510-41ec-a88d-96097bb431de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c465b7c26ec44582b6d1b7169536ecc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T18:41:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'guest_format': None, 'boot_index': 0, 'image_id': '77bcb5ba-8510-41ec-a88d-96097bb431de'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 18:45:30 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-b891abdd-7c1f-4fa1-886c-41f06b6fac17 tempest-VolumesAssistedSnapshotsTest-1233733883 tempest-VolumesAssistedSnapshotsTest-1233733883-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 18:45:30 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-b891abdd-7c1f-4fa1-886c-41f06b6fac17 tempest-VolumesAssistedSnapshotsTest-1233733883 tempest-VolumesAssistedSnapshotsTest-1233733883-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 18:45:30 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-b891abdd-7c1f-4fa1-886c-41f06b6fac17 tempest-VolumesAssistedSnapshotsTest-1233733883 tempest-VolumesAssistedSnapshotsTest-1233733883-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 18:45:30 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-b891abdd-7c1f-4fa1-886c-41f06b6fac17 tempest-VolumesAssistedSnapshotsTest-1233733883 tempest-VolumesAssistedSnapshotsTest-1233733883-project-member] CPU controller missing on host. {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 18:45:30 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-b891abdd-7c1f-4fa1-886c-41f06b6fac17 tempest-VolumesAssistedSnapshotsTest-1233733883 tempest-VolumesAssistedSnapshotsTest-1233733883-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 18:45:30 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-b891abdd-7c1f-4fa1-886c-41f06b6fac17 tempest-VolumesAssistedSnapshotsTest-1233733883 tempest-VolumesAssistedSnapshotsTest-1233733883-project-member] CPU controller found on host. {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 18:45:30 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-b891abdd-7c1f-4fa1-886c-41f06b6fac17 tempest-VolumesAssistedSnapshotsTest-1233733883 tempest-VolumesAssistedSnapshotsTest-1233733883-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75216) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 18:45:30 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-b891abdd-7c1f-4fa1-886c-41f06b6fac17 tempest-VolumesAssistedSnapshotsTest-1233733883 tempest-VolumesAssistedSnapshotsTest-1233733883-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T18:40:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T18:41:06Z,direct_url=<?>,disk_format='qcow2',id=77bcb5ba-8510-41ec-a88d-96097bb431de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c465b7c26ec44582b6d1b7169536ecc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T18:41:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 18:45:30 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-b891abdd-7c1f-4fa1-886c-41f06b6fac17 tempest-VolumesAssistedSnapshotsTest-1233733883 tempest-VolumesAssistedSnapshotsTest-1233733883-project-member] Flavor limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 18:45:30 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-b891abdd-7c1f-4fa1-886c-41f06b6fac17 tempest-VolumesAssistedSnapshotsTest-1233733883 tempest-VolumesAssistedSnapshotsTest-1233733883-project-member] Image limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 18:45:30 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-b891abdd-7c1f-4fa1-886c-41f06b6fac17 tempest-VolumesAssistedSnapshotsTest-1233733883 tempest-VolumesAssistedSnapshotsTest-1233733883-project-member] Flavor pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 18:45:30 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-b891abdd-7c1f-4fa1-886c-41f06b6fac17 tempest-VolumesAssistedSnapshotsTest-1233733883 tempest-VolumesAssistedSnapshotsTest-1233733883-project-member] Image pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 18:45:30 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-b891abdd-7c1f-4fa1-886c-41f06b6fac17 tempest-VolumesAssistedSnapshotsTest-1233733883 tempest-VolumesAssistedSnapshotsTest-1233733883-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 18:45:30 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-b891abdd-7c1f-4fa1-886c-41f06b6fac17 tempest-VolumesAssistedSnapshotsTest-1233733883 tempest-VolumesAssistedSnapshotsTest-1233733883-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 18:45:30 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-b891abdd-7c1f-4fa1-886c-41f06b6fac17 tempest-VolumesAssistedSnapshotsTest-1233733883 tempest-VolumesAssistedSnapshotsTest-1233733883-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 18:45:30 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-b891abdd-7c1f-4fa1-886c-41f06b6fac17 tempest-VolumesAssistedSnapshotsTest-1233733883 tempest-VolumesAssistedSnapshotsTest-1233733883-project-member] Got 1 possible topologies {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 18:45:30 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-b891abdd-7c1f-4fa1-886c-41f06b6fac17 tempest-VolumesAssistedSnapshotsTest-1233733883 tempest-VolumesAssistedSnapshotsTest-1233733883-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 18:45:30 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-b891abdd-7c1f-4fa1-886c-41f06b6fac17 tempest-VolumesAssistedSnapshotsTest-1233733883 tempest-VolumesAssistedSnapshotsTest-1233733883-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 18:45:30 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-b891abdd-7c1f-4fa1-886c-41f06b6fac17 tempest-VolumesAssistedSnapshotsTest-1233733883 tempest-VolumesAssistedSnapshotsTest-1233733883-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T18:45:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1282536025',display_name='tempest-VolumesAssistedSnapshotsTest-server-1282536025',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1282536025',id=8,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGK5kwimrtPNgyWvXjn4c9bHpOstVwrHZDR8nIXsBYCG9sB8SFKEWbUEqIEonDSTs0cvkjqSa7vMx+RA1QEq1AzSMzYsMzjQsLKQ2JKNIguBs3Xjr0rx+XJoMLyIbTOF+A==',key_name='tempest-keypair-1703816178',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='763712c69c7f45a8a0ff5cfdeb032baa',ramdisk_id='',reservation_id='r-cpqnmsgq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1233733883',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1233733883-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T18:45:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='526a993a42884f82a75231be9aa332cf',uuid=576e97b7-285a-451f-a80d-aaa321a79d3b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "af70d3c4-b668-4cfa-92fb-5bf17a903572", "address": "fa:16:3e:72:14:30", "network": {"id": "a5954c64-25ea-4c12-b852-ce2cf531689c", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1064303336-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "763712c69c7f45a8a0ff5cfdeb032baa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf70d3c4-b6", "ovs_interfaceid": "af70d3c4-b668-4cfa-92fb-5bf17a903572", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75216) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 18:45:30 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-b891abdd-7c1f-4fa1-886c-41f06b6fac17 tempest-VolumesAssistedSnapshotsTest-1233733883 tempest-VolumesAssistedSnapshotsTest-1233733883-project-member] Converting VIF {"id": "af70d3c4-b668-4cfa-92fb-5bf17a903572", "address": "fa:16:3e:72:14:30", "network": {"id": "a5954c64-25ea-4c12-b852-ce2cf531689c", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1064303336-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "763712c69c7f45a8a0ff5cfdeb032baa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf70d3c4-b6", "ovs_interfaceid": "af70d3c4-b668-4cfa-92fb-5bf17a903572", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 18:45:30 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-b891abdd-7c1f-4fa1-886c-41f06b6fac17 tempest-VolumesAssistedSnapshotsTest-1233733883 tempest-VolumesAssistedSnapshotsTest-1233733883-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:14:30,bridge_name='br-int',has_traffic_filtering=True,id=af70d3c4-b668-4cfa-92fb-5bf17a903572,network=Network(a5954c64-25ea-4c12-b852-ce2cf531689c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf70d3c4-b6') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 18:45:30 user nova-compute[75216]: DEBUG nova.objects.instance [None req-b891abdd-7c1f-4fa1-886c-41f06b6fac17 tempest-VolumesAssistedSnapshotsTest-1233733883 tempest-VolumesAssistedSnapshotsTest-1233733883-project-member] Lazy-loading 'pci_devices' on Instance uuid 576e97b7-285a-451f-a80d-aaa321a79d3b {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 18:45:30 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-b891abdd-7c1f-4fa1-886c-41f06b6fac17 tempest-VolumesAssistedSnapshotsTest-1233733883 tempest-VolumesAssistedSnapshotsTest-1233733883-project-member] [instance: 576e97b7-285a-451f-a80d-aaa321a79d3b] End _get_guest_xml xml=<domain type="kvm">
Nov 13 18:45:30 user nova-compute[75216]:   <uuid>576e97b7-285a-451f-a80d-aaa321a79d3b</uuid>
Nov 13 18:45:30 user nova-compute[75216]:   <name>instance-00000008</name>
Nov 13 18:45:30 user nova-compute[75216]:   <memory>524288</memory>
Nov 13 18:45:30 user nova-compute[75216]:   <vcpu>1</vcpu>
Nov 13 18:45:30 user nova-compute[75216]:   <metadata>
Nov 13 18:45:30 user nova-compute[75216]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 18:45:30 user nova-compute[75216]:       <nova:package version="0.0.0"/>
Nov 13 18:45:30 user nova-compute[75216]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-1282536025</nova:name>
Nov 13 18:45:30 user nova-compute[75216]:       <nova:creationTime>2023-11-13 18:45:30</nova:creationTime>
Nov 13 18:45:30 user nova-compute[75216]:       <nova:flavor name="m1.tiny">
Nov 13 18:45:30 user nova-compute[75216]:         <nova:memory>512</nova:memory>
Nov 13 18:45:30 user nova-compute[75216]:         <nova:disk>1</nova:disk>
Nov 13 18:45:30 user nova-compute[75216]:         <nova:swap>0</nova:swap>
Nov 13 18:45:30 user nova-compute[75216]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 18:45:30 user nova-compute[75216]:         <nova:vcpus>1</nova:vcpus>
Nov 13 18:45:30 user nova-compute[75216]:       </nova:flavor>
Nov 13 18:45:30 user nova-compute[75216]:       <nova:owner>
Nov 13 18:45:30 user nova-compute[75216]:         <nova:user uuid="526a993a42884f82a75231be9aa332cf">tempest-VolumesAssistedSnapshotsTest-1233733883-project-member</nova:user>
Nov 13 18:45:30 user nova-compute[75216]:         <nova:project uuid="763712c69c7f45a8a0ff5cfdeb032baa">tempest-VolumesAssistedSnapshotsTest-1233733883</nova:project>
Nov 13 18:45:30 user nova-compute[75216]:       </nova:owner>
Nov 13 18:45:30 user nova-compute[75216]:       <nova:root type="image" uuid="77bcb5ba-8510-41ec-a88d-96097bb431de"/>
Nov 13 18:45:30 user nova-compute[75216]:       <nova:ports>
Nov 13 18:45:30 user nova-compute[75216]:         <nova:port uuid="af70d3c4-b668-4cfa-92fb-5bf17a903572">
Nov 13 18:45:30 user nova-compute[75216]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 13 18:45:30 user nova-compute[75216]:         </nova:port>
Nov 13 18:45:30 user nova-compute[75216]:       </nova:ports>
Nov 13 18:45:30 user nova-compute[75216]:     </nova:instance>
Nov 13 18:45:30 user nova-compute[75216]:   </metadata>
Nov 13 18:45:30 user nova-compute[75216]:   <sysinfo type="smbios">
Nov 13 18:45:30 user nova-compute[75216]:     <system>
Nov 13 18:45:30 user nova-compute[75216]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 18:45:30 user nova-compute[75216]:       <entry name="product">OpenStack Nova</entry>
Nov 13 18:45:30 user nova-compute[75216]:       <entry name="version">0.0.0</entry>
Nov 13 18:45:30 user nova-compute[75216]:       <entry name="serial">576e97b7-285a-451f-a80d-aaa321a79d3b</entry>
Nov 13 18:45:30 user nova-compute[75216]:       <entry name="uuid">576e97b7-285a-451f-a80d-aaa321a79d3b</entry>
Nov 13 18:45:30 user nova-compute[75216]:       <entry name="family">Virtual Machine</entry>
Nov 13 18:45:30 user nova-compute[75216]:     </system>
Nov 13 18:45:30 user nova-compute[75216]:   </sysinfo>
Nov 13 18:45:30 user nova-compute[75216]:   <os>
Nov 13 18:45:30 user nova-compute[75216]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 18:45:30 user nova-compute[75216]:     <boot dev="hd"/>
Nov 13 18:45:30 user nova-compute[75216]:     <smbios mode="sysinfo"/>
Nov 13 18:45:30 user nova-compute[75216]:   </os>
Nov 13 18:45:30 user nova-compute[75216]:   <features>
Nov 13 18:45:30 user nova-compute[75216]:     <acpi/>
Nov 13 18:45:30 user nova-compute[75216]:     <apic/>
Nov 13 18:45:30 user nova-compute[75216]:     <vmcoreinfo/>
Nov 13 18:45:30 user nova-compute[75216]:   </features>
Nov 13 18:45:30 user nova-compute[75216]:   <clock offset="utc">
Nov 13 18:45:30 user nova-compute[75216]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 18:45:30 user nova-compute[75216]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 18:45:30 user nova-compute[75216]:     <timer name="hpet" present="no"/>
Nov 13 18:45:30 user nova-compute[75216]:   </clock>
Nov 13 18:45:30 user nova-compute[75216]:   <cpu mode="custom" match="exact">
Nov 13 18:45:30 user nova-compute[75216]:     <model>Nehalem</model>
Nov 13 18:45:30 user nova-compute[75216]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 18:45:30 user nova-compute[75216]:   </cpu>
Nov 13 18:45:30 user nova-compute[75216]:   <devices>
Nov 13 18:45:30 user nova-compute[75216]:     <disk type="file" device="disk">
Nov 13 18:45:30 user nova-compute[75216]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 18:45:30 user nova-compute[75216]:       <source file="/opt/stack/data/nova/instances/576e97b7-285a-451f-a80d-aaa321a79d3b/disk"/>
Nov 13 18:45:30 user nova-compute[75216]:       <target dev="vda" bus="virtio"/>
Nov 13 18:45:30 user nova-compute[75216]:     </disk>
Nov 13 18:45:30 user nova-compute[75216]:     <interface type="ethernet">
Nov 13 18:45:30 user nova-compute[75216]:       <mac address="fa:16:3e:72:14:30"/>
Nov 13 18:45:30 user nova-compute[75216]:       <model type="virtio"/>
Nov 13 18:45:30 user nova-compute[75216]:       <mtu size="1442"/>
Nov 13 18:45:30 user nova-compute[75216]:       <target dev="tapaf70d3c4-b6"/>
Nov 13 18:45:30 user nova-compute[75216]:     </interface>
Nov 13 18:45:30 user nova-compute[75216]:     <serial type="pty">
Nov 13 18:45:30 user nova-compute[75216]:       <log file="/opt/stack/data/nova/instances/576e97b7-285a-451f-a80d-aaa321a79d3b/console.log" append="off"/>
Nov 13 18:45:30 user nova-compute[75216]:     </serial>
Nov 13 18:45:30 user nova-compute[75216]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 18:45:30 user nova-compute[75216]:     <video>
Nov 13 18:45:30 user nova-compute[75216]:       <model type="virtio"/>
Nov 13 18:45:30 user nova-compute[75216]:     </video>
Nov 13 18:45:30 user nova-compute[75216]:     <rng model="virtio">
Nov 13 18:45:30 user nova-compute[75216]:       <backend model="random">/dev/urandom</backend>
Nov 13 18:45:30 user nova-compute[75216]:     </rng>
Nov 13 18:45:30 user nova-compute[75216]:     <controller type="usb" index="0" model="none"/>
Nov 13 18:45:30 user nova-compute[75216]:     <memballoon model="virtio">
Nov 13 18:45:30 user nova-compute[75216]:       <stats period="10"/>
Nov 13 18:45:30 user nova-compute[75216]:     </memballoon>
Nov 13 18:45:30 user nova-compute[75216]:   </devices>
Nov 13 18:45:30 user nova-compute[75216]: </domain>
Nov 13 18:45:30 user nova-compute[75216]:  {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 18:45:30 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-b891abdd-7c1f-4fa1-886c-41f06b6fac17 tempest-VolumesAssistedSnapshotsTest-1233733883 tempest-VolumesAssistedSnapshotsTest-1233733883-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T18:45:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1282536025',display_name='tempest-VolumesAssistedSnapshotsTest-server-1282536025',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1282536025',id=8,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGK5kwimrtPNgyWvXjn4c9bHpOstVwrHZDR8nIXsBYCG9sB8SFKEWbUEqIEonDSTs0cvkjqSa7vMx+RA1QEq1AzSMzYsMzjQsLKQ2JKNIguBs3Xjr0rx+XJoMLyIbTOF+A==',key_name='tempest-keypair-1703816178',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='763712c69c7f45a8a0ff5cfdeb032baa',ramdisk_id='',reservation_id='r-cpqnmsgq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1233733883',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1233733883-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T18:45:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='526a993a42884f82a75231be9aa332cf',uuid=576e97b7-285a-451f-a80d-aaa321a79d3b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "af70d3c4-b668-4cfa-92fb-5bf17a903572", "address": "fa:16:3e:72:14:30", "network": {"id": "a5954c64-25ea-4c12-b852-ce2cf531689c", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1064303336-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "763712c69c7f45a8a0ff5cfdeb032baa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf70d3c4-b6", "ovs_interfaceid": "af70d3c4-b668-4cfa-92fb-5bf17a903572", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 18:45:30 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-b891abdd-7c1f-4fa1-886c-41f06b6fac17 tempest-VolumesAssistedSnapshotsTest-1233733883 tempest-VolumesAssistedSnapshotsTest-1233733883-project-member] Converting VIF {"id": "af70d3c4-b668-4cfa-92fb-5bf17a903572", "address": "fa:16:3e:72:14:30", "network": {"id": "a5954c64-25ea-4c12-b852-ce2cf531689c", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1064303336-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "763712c69c7f45a8a0ff5cfdeb032baa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf70d3c4-b6", "ovs_interfaceid": "af70d3c4-b668-4cfa-92fb-5bf17a903572", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 18:45:30 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-b891abdd-7c1f-4fa1-886c-41f06b6fac17 tempest-VolumesAssistedSnapshotsTest-1233733883 tempest-VolumesAssistedSnapshotsTest-1233733883-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:14:30,bridge_name='br-int',has_traffic_filtering=True,id=af70d3c4-b668-4cfa-92fb-5bf17a903572,network=Network(a5954c64-25ea-4c12-b852-ce2cf531689c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf70d3c4-b6') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 18:45:30 user nova-compute[75216]: DEBUG os_vif [None req-b891abdd-7c1f-4fa1-886c-41f06b6fac17 tempest-VolumesAssistedSnapshotsTest-1233733883 tempest-VolumesAssistedSnapshotsTest-1233733883-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:14:30,bridge_name='br-int',has_traffic_filtering=True,id=af70d3c4-b668-4cfa-92fb-5bf17a903572,network=Network(a5954c64-25ea-4c12-b852-ce2cf531689c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf70d3c4-b6') {{(pid=75216) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 18:45:30 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:45:30 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:45:30 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 18:45:30 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:45:30 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cccf23d3-ea96-5665-bd3a-e699cc0b49af', '_type': 'linux-noop'}}, row=False) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:45:30 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:45:30 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:45:30 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:45:30 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaf70d3c4-b6, may_exist=True, interface_attrs={}) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:45:30 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapaf70d3c4-b6, col_values=(('qos', UUID('1e760c75-96b9-4f48-b01f-215017d503fb')),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:45:30 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapaf70d3c4-b6, col_values=(('external_ids', {'iface-id': 'af70d3c4-b668-4cfa-92fb-5bf17a903572', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:72:14:30', 'vm-uuid': '576e97b7-285a-451f-a80d-aaa321a79d3b'}),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:45:30 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:45:30 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:45:30 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:45:30 user nova-compute[75216]: INFO os_vif [None req-b891abdd-7c1f-4fa1-886c-41f06b6fac17 tempest-VolumesAssistedSnapshotsTest-1233733883 tempest-VolumesAssistedSnapshotsTest-1233733883-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:14:30,bridge_name='br-int',has_traffic_filtering=True,id=af70d3c4-b668-4cfa-92fb-5bf17a903572,network=Network(a5954c64-25ea-4c12-b852-ce2cf531689c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf70d3c4-b6')
Nov 13 18:45:30 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-b891abdd-7c1f-4fa1-886c-41f06b6fac17 tempest-VolumesAssistedSnapshotsTest-1233733883 tempest-VolumesAssistedSnapshotsTest-1233733883-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 18:45:30 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-b891abdd-7c1f-4fa1-886c-41f06b6fac17 tempest-VolumesAssistedSnapshotsTest-1233733883 tempest-VolumesAssistedSnapshotsTest-1233733883-project-member] No VIF found with MAC fa:16:3e:72:14:30, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 18:45:30 user nova-compute[75216]: DEBUG nova.network.neutron [req-be53e012-e9dd-4cd3-83ed-5190070f8c98 req-8f4a62d2-c1db-4355-8d30-3bf6018806df service nova] [instance: 576e97b7-285a-451f-a80d-aaa321a79d3b] Updated VIF entry in instance network info cache for port af70d3c4-b668-4cfa-92fb-5bf17a903572. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 18:45:30 user nova-compute[75216]: DEBUG nova.network.neutron [req-be53e012-e9dd-4cd3-83ed-5190070f8c98 req-8f4a62d2-c1db-4355-8d30-3bf6018806df service nova] [instance: 576e97b7-285a-451f-a80d-aaa321a79d3b] Updating instance_info_cache with network_info: [{"id": "af70d3c4-b668-4cfa-92fb-5bf17a903572", "address": "fa:16:3e:72:14:30", "network": {"id": "a5954c64-25ea-4c12-b852-ce2cf531689c", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1064303336-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "763712c69c7f45a8a0ff5cfdeb032baa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf70d3c4-b6", "ovs_interfaceid": "af70d3c4-b668-4cfa-92fb-5bf17a903572", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 18:45:30 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-be53e012-e9dd-4cd3-83ed-5190070f8c98 req-8f4a62d2-c1db-4355-8d30-3bf6018806df service nova] Releasing lock "refresh_cache-576e97b7-285a-451f-a80d-aaa321a79d3b" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 18:45:31 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Acquiring lock "3274203b-a985-4f28-9b45-3f83509ae782" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:45:31 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Lock "3274203b-a985-4f28-9b45-3f83509ae782" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:45:31 user nova-compute[75216]: DEBUG nova.compute.manager [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] Starting instance... {{(pid=75216) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 18:45:31 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:45:31 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:45:31 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:45:31 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:45:31 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75216) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 18:45:31 user nova-compute[75216]: INFO nova.compute.claims [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] Claim successful on node user
Nov 13 18:45:31 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:45:32 user nova-compute[75216]: DEBUG nova.compute.manager [req-7be3ce83-1b4e-4510-88b5-ff0c6bf23cd6 req-34cdc8e7-8825-4ae3-b838-76038e3ae3f8 service nova] [instance: 576e97b7-285a-451f-a80d-aaa321a79d3b] Received event network-vif-plugged-af70d3c4-b668-4cfa-92fb-5bf17a903572 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:45:32 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-7be3ce83-1b4e-4510-88b5-ff0c6bf23cd6 req-34cdc8e7-8825-4ae3-b838-76038e3ae3f8 service nova] Acquiring lock "576e97b7-285a-451f-a80d-aaa321a79d3b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:45:32 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-7be3ce83-1b4e-4510-88b5-ff0c6bf23cd6 req-34cdc8e7-8825-4ae3-b838-76038e3ae3f8 service nova] Lock "576e97b7-285a-451f-a80d-aaa321a79d3b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:45:32 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-7be3ce83-1b4e-4510-88b5-ff0c6bf23cd6 req-34cdc8e7-8825-4ae3-b838-76038e3ae3f8 service nova] Lock "576e97b7-285a-451f-a80d-aaa321a79d3b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:45:32 user nova-compute[75216]: DEBUG nova.compute.manager [req-7be3ce83-1b4e-4510-88b5-ff0c6bf23cd6 req-34cdc8e7-8825-4ae3-b838-76038e3ae3f8 service nova] [instance: 576e97b7-285a-451f-a80d-aaa321a79d3b] No waiting events found dispatching network-vif-plugged-af70d3c4-b668-4cfa-92fb-5bf17a903572 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:45:32 user nova-compute[75216]: WARNING nova.compute.manager [req-7be3ce83-1b4e-4510-88b5-ff0c6bf23cd6 req-34cdc8e7-8825-4ae3-b838-76038e3ae3f8 service nova] [instance: 576e97b7-285a-451f-a80d-aaa321a79d3b] Received unexpected event network-vif-plugged-af70d3c4-b668-4cfa-92fb-5bf17a903572 for instance with vm_state building and task_state spawning.
Nov 13 18:45:32 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 18:45:32 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 18:45:32 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.828s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:45:32 user nova-compute[75216]: DEBUG nova.compute.manager [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] Start building networks asynchronously for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 18:45:32 user nova-compute[75216]: DEBUG nova.compute.manager [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] Allocating IP information in the background. {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 18:45:32 user nova-compute[75216]: DEBUG nova.network.neutron [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] allocate_for_instance() {{(pid=75216) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 18:45:32 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 18:45:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:45:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:45:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:45:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:45:32 user nova-compute[75216]: DEBUG nova.compute.manager [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] Start building block device mappings for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 18:45:33 user nova-compute[75216]: INFO nova.virt.block_device [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] Booting with volume de3d195d-b8b4-4c79-a150-813952c640e8 at /dev/vda
Nov 13 18:45:33 user nova-compute[75216]: DEBUG os_brick.utils [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 18:45:33 user nova-compute[75216]: INFO oslo.privsep.daemon [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmp9ia8mgi7/privsep.sock']
Nov 13 18:45:33 user sudo[85979]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmp9ia8mgi7/privsep.sock
Nov 13 18:45:33 user sudo[85979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 13 18:45:33 user nova-compute[75216]: DEBUG nova.policy [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2fd1904e6cdb4600a2e250aefdc0f0ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d0f284dd8d4cc88f04a729b1d5d38c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75216) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 18:45:33 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:45:34 user nova-compute[75216]: DEBUG nova.compute.manager [req-9016c819-120b-46a7-adb9-caaf709cfed9 req-ceafb4ce-5fd2-4cd2-b8e3-e48984a266f4 service nova] [instance: 576e97b7-285a-451f-a80d-aaa321a79d3b] Received event network-vif-plugged-af70d3c4-b668-4cfa-92fb-5bf17a903572 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:45:34 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-9016c819-120b-46a7-adb9-caaf709cfed9 req-ceafb4ce-5fd2-4cd2-b8e3-e48984a266f4 service nova] Acquiring lock "576e97b7-285a-451f-a80d-aaa321a79d3b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:45:34 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-9016c819-120b-46a7-adb9-caaf709cfed9 req-ceafb4ce-5fd2-4cd2-b8e3-e48984a266f4 service nova] Lock "576e97b7-285a-451f-a80d-aaa321a79d3b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:45:34 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-9016c819-120b-46a7-adb9-caaf709cfed9 req-ceafb4ce-5fd2-4cd2-b8e3-e48984a266f4 service nova] Lock "576e97b7-285a-451f-a80d-aaa321a79d3b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:45:34 user nova-compute[75216]: DEBUG nova.compute.manager [req-9016c819-120b-46a7-adb9-caaf709cfed9 req-ceafb4ce-5fd2-4cd2-b8e3-e48984a266f4 service nova] [instance: 576e97b7-285a-451f-a80d-aaa321a79d3b] No waiting events found dispatching network-vif-plugged-af70d3c4-b668-4cfa-92fb-5bf17a903572 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:45:34 user nova-compute[75216]: WARNING nova.compute.manager [req-9016c819-120b-46a7-adb9-caaf709cfed9 req-ceafb4ce-5fd2-4cd2-b8e3-e48984a266f4 service nova] [instance: 576e97b7-285a-451f-a80d-aaa321a79d3b] Received unexpected event network-vif-plugged-af70d3c4-b668-4cfa-92fb-5bf17a903572 for instance with vm_state building and task_state spawning.
Nov 13 18:45:34 user nova-compute[75216]: DEBUG nova.compute.manager [None req-b891abdd-7c1f-4fa1-886c-41f06b6fac17 tempest-VolumesAssistedSnapshotsTest-1233733883 tempest-VolumesAssistedSnapshotsTest-1233733883-project-member] [instance: 576e97b7-285a-451f-a80d-aaa321a79d3b] Instance event wait completed in 0 seconds for  {{(pid=75216) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 18:45:34 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-b891abdd-7c1f-4fa1-886c-41f06b6fac17 tempest-VolumesAssistedSnapshotsTest-1233733883 tempest-VolumesAssistedSnapshotsTest-1233733883-project-member] [instance: 576e97b7-285a-451f-a80d-aaa321a79d3b] Guest created on hypervisor {{(pid=75216) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 18:45:34 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 576e97b7-285a-451f-a80d-aaa321a79d3b] Instance spawned successfully.
Nov 13 18:45:34 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-b891abdd-7c1f-4fa1-886c-41f06b6fac17 tempest-VolumesAssistedSnapshotsTest-1233733883 tempest-VolumesAssistedSnapshotsTest-1233733883-project-member] [instance: 576e97b7-285a-451f-a80d-aaa321a79d3b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 18:45:34 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-b891abdd-7c1f-4fa1-886c-41f06b6fac17 tempest-VolumesAssistedSnapshotsTest-1233733883 tempest-VolumesAssistedSnapshotsTest-1233733883-project-member] [instance: 576e97b7-285a-451f-a80d-aaa321a79d3b] Found default for hw_cdrom_bus of ide {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 18:45:34 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-b891abdd-7c1f-4fa1-886c-41f06b6fac17 tempest-VolumesAssistedSnapshotsTest-1233733883 tempest-VolumesAssistedSnapshotsTest-1233733883-project-member] [instance: 576e97b7-285a-451f-a80d-aaa321a79d3b] Found default for hw_disk_bus of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 18:45:34 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-b891abdd-7c1f-4fa1-886c-41f06b6fac17 tempest-VolumesAssistedSnapshotsTest-1233733883 tempest-VolumesAssistedSnapshotsTest-1233733883-project-member] [instance: 576e97b7-285a-451f-a80d-aaa321a79d3b] Found default for hw_input_bus of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 18:45:34 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-b891abdd-7c1f-4fa1-886c-41f06b6fac17 tempest-VolumesAssistedSnapshotsTest-1233733883 tempest-VolumesAssistedSnapshotsTest-1233733883-project-member] [instance: 576e97b7-285a-451f-a80d-aaa321a79d3b] Found default for hw_pointer_model of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 18:45:34 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-b891abdd-7c1f-4fa1-886c-41f06b6fac17 tempest-VolumesAssistedSnapshotsTest-1233733883 tempest-VolumesAssistedSnapshotsTest-1233733883-project-member] [instance: 576e97b7-285a-451f-a80d-aaa321a79d3b] Found default for hw_video_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 18:45:34 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-b891abdd-7c1f-4fa1-886c-41f06b6fac17 tempest-VolumesAssistedSnapshotsTest-1233733883 tempest-VolumesAssistedSnapshotsTest-1233733883-project-member] [instance: 576e97b7-285a-451f-a80d-aaa321a79d3b] Found default for hw_vif_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 18:45:34 user nova-compute[75216]: DEBUG nova.compute.manager [req-b41bd004-419b-4e95-979f-fc88d8737e04 req-b888001f-5656-4550-bf8f-a04f9e762533 service nova] [instance: d589d57e-de50-482a-843f-e8246b3d7528] Received event network-vif-plugged-87426a6f-0164-4df3-aad0-becbbbfe8310 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:45:34 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-b41bd004-419b-4e95-979f-fc88d8737e04 req-b888001f-5656-4550-bf8f-a04f9e762533 service nova] Acquiring lock "d589d57e-de50-482a-843f-e8246b3d7528-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:45:34 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-b41bd004-419b-4e95-979f-fc88d8737e04 req-b888001f-5656-4550-bf8f-a04f9e762533 service nova] Lock "d589d57e-de50-482a-843f-e8246b3d7528-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:45:34 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-b41bd004-419b-4e95-979f-fc88d8737e04 req-b888001f-5656-4550-bf8f-a04f9e762533 service nova] Lock "d589d57e-de50-482a-843f-e8246b3d7528-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:45:34 user nova-compute[75216]: DEBUG nova.compute.manager [req-b41bd004-419b-4e95-979f-fc88d8737e04 req-b888001f-5656-4550-bf8f-a04f9e762533 service nova] [instance: d589d57e-de50-482a-843f-e8246b3d7528] No waiting events found dispatching network-vif-plugged-87426a6f-0164-4df3-aad0-becbbbfe8310 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:45:34 user nova-compute[75216]: WARNING nova.compute.manager [req-b41bd004-419b-4e95-979f-fc88d8737e04 req-b888001f-5656-4550-bf8f-a04f9e762533 service nova] [instance: d589d57e-de50-482a-843f-e8246b3d7528] Received unexpected event network-vif-plugged-87426a6f-0164-4df3-aad0-becbbbfe8310 for instance with vm_state active and task_state None.
Nov 13 18:45:34 user nova-compute[75216]: INFO nova.compute.manager [None req-b891abdd-7c1f-4fa1-886c-41f06b6fac17 tempest-VolumesAssistedSnapshotsTest-1233733883 tempest-VolumesAssistedSnapshotsTest-1233733883-project-member] [instance: 576e97b7-285a-451f-a80d-aaa321a79d3b] Took 7.82 seconds to spawn the instance on the hypervisor.
Nov 13 18:45:34 user nova-compute[75216]: DEBUG nova.compute.manager [None req-b891abdd-7c1f-4fa1-886c-41f06b6fac17 tempest-VolumesAssistedSnapshotsTest-1233733883 tempest-VolumesAssistedSnapshotsTest-1233733883-project-member] [instance: 576e97b7-285a-451f-a80d-aaa321a79d3b] Checking state {{(pid=75216) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 18:45:34 user nova-compute[75216]: INFO nova.compute.manager [None req-b891abdd-7c1f-4fa1-886c-41f06b6fac17 tempest-VolumesAssistedSnapshotsTest-1233733883 tempest-VolumesAssistedSnapshotsTest-1233733883-project-member] [instance: 576e97b7-285a-451f-a80d-aaa321a79d3b] Took 8.85 seconds to build instance.
Nov 13 18:45:34 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-b891abdd-7c1f-4fa1-886c-41f06b6fac17 tempest-VolumesAssistedSnapshotsTest-1233733883 tempest-VolumesAssistedSnapshotsTest-1233733883-project-member] Lock "576e97b7-285a-451f-a80d-aaa321a79d3b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.972s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:45:34 user nova-compute[75216]: DEBUG nova.network.neutron [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] Successfully created port: 217faeb3-4474-449c-ae9f-86e555ce7cd7 {{(pid=75216) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 18:45:35 user sudo[85979]: pam_unix(sudo:session): session closed for user root
Nov 13 18:45:35 user nova-compute[75216]: INFO oslo.privsep.daemon [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Spawned new privsep daemon via rootwrap
Nov 13 18:45:35 user nova-compute[75216]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 13 18:45:35 user nova-compute[75216]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 13 18:45:35 user nova-compute[75216]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Nov 13 18:45:35 user nova-compute[75216]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 85984
Nov 13 18:45:35 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[36028600-f526-4dbc-bcae-4ed59c25eff9]: (2,) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:45:35 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:45:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:45:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:45:35 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7614649-c020-421c-8a45-1518ab9b732e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aea6fcfe14b9\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:45:35 user nova-compute[75216]: WARNING os_brick.initiator.connectors.nvmeof [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Nov 13 18:45:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:45:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:45:35 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[245554a0-9b61-4d5c-bdcb-130c973c02c3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:45:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:45:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.028s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:45:35 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[80a50f43-1a8a-4d83-a731-70a53f3d9480]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:45:35 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[497f6965-35c8-4e76-9843-add0d56ae7f6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:45:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Running cmd (subprocess): nvme version {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:45:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] 'nvme version' failed. Not Retrying. {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 18:45:35 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.nvmeof [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] nvme not present on system {{(pid=75216) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 18:45:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:45:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 18:45:35 user nova-compute[75216]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 18:45:35 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2f20683-f867-46ec-b597-b5621c892e51]: (4, '') {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:45:35 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75216) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 18:45:35 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 18:45:35 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] LIGHTOS: no hostnqn found. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 18:45:35 user nova-compute[75216]: DEBUG os_brick.utils [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] <== get_connector_properties: return (2310ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aea6fcfe14b9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 18:45:35 user nova-compute[75216]: DEBUG nova.virt.block_device [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] Updating existing volume attachment record: 6d159eb5-b7fb-48c9-b4bf-7c1a51fccebb {{(pid=75216) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 18:45:35 user nova-compute[75216]: DEBUG nova.network.neutron [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] Successfully created port: 7aa7e71d-2c00-40fd-9d05-d108bcc807ec {{(pid=75216) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 18:45:36 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:45:36 user nova-compute[75216]: DEBUG nova.network.neutron [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] Successfully created port: 01772e53-e624-4728-beb1-929cc4165f21 {{(pid=75216) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 18:45:36 user nova-compute[75216]: DEBUG nova.compute.manager [req-c205a936-8266-4799-9ffb-705da785b408 req-8ed08c38-9fcc-456a-91c2-5dc90a5a5520 service nova] [instance: d589d57e-de50-482a-843f-e8246b3d7528] Received event network-vif-plugged-87426a6f-0164-4df3-aad0-becbbbfe8310 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:45:36 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-c205a936-8266-4799-9ffb-705da785b408 req-8ed08c38-9fcc-456a-91c2-5dc90a5a5520 service nova] Acquiring lock "d589d57e-de50-482a-843f-e8246b3d7528-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:45:36 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-c205a936-8266-4799-9ffb-705da785b408 req-8ed08c38-9fcc-456a-91c2-5dc90a5a5520 service nova] Lock "d589d57e-de50-482a-843f-e8246b3d7528-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:45:36 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-c205a936-8266-4799-9ffb-705da785b408 req-8ed08c38-9fcc-456a-91c2-5dc90a5a5520 service nova] Lock "d589d57e-de50-482a-843f-e8246b3d7528-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:45:36 user nova-compute[75216]: DEBUG nova.compute.manager [req-c205a936-8266-4799-9ffb-705da785b408 req-8ed08c38-9fcc-456a-91c2-5dc90a5a5520 service nova] [instance: d589d57e-de50-482a-843f-e8246b3d7528] No waiting events found dispatching network-vif-plugged-87426a6f-0164-4df3-aad0-becbbbfe8310 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:45:36 user nova-compute[75216]: WARNING nova.compute.manager [req-c205a936-8266-4799-9ffb-705da785b408 req-8ed08c38-9fcc-456a-91c2-5dc90a5a5520 service nova] [instance: d589d57e-de50-482a-843f-e8246b3d7528] Received unexpected event network-vif-plugged-87426a6f-0164-4df3-aad0-becbbbfe8310 for instance with vm_state active and task_state None.
Nov 13 18:45:37 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Acquiring lock "78605259-17bf-47da-86de-3c76ac1c5bfa" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:45:37 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Lock "78605259-17bf-47da-86de-3c76ac1c5bfa" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:45:37 user nova-compute[75216]: DEBUG nova.compute.manager [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Starting instance... {{(pid=75216) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 18:45:37 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:45:37 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:45:37 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75216) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 18:45:37 user nova-compute[75216]: INFO nova.compute.claims [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Claim successful on node user
Nov 13 18:45:37 user nova-compute[75216]: DEBUG nova.network.neutron [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] Successfully created port: 1bb4df6f-02b2-415b-9cea-fd8a7a04874c {{(pid=75216) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 18:45:37 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:45:37 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Cleaning up deleted instances {{(pid=75216) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 13 18:45:37 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] There are 0 instances to clean {{(pid=75216) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 13 18:45:37 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:45:37 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75216) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 13 18:45:37 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:45:37 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 18:45:37 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 18:45:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:45:37 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.624s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:45:37 user nova-compute[75216]: DEBUG nova.compute.manager [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Start building networks asynchronously for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 18:45:38 user nova-compute[75216]: DEBUG nova.network.neutron [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] Successfully created port: a07efcd3-59f4-452e-8fb7-8b8233ae235f {{(pid=75216) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 18:45:38 user nova-compute[75216]: DEBUG nova.compute.manager [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Allocating IP information in the background. {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 18:45:38 user nova-compute[75216]: DEBUG nova.network.neutron [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] allocate_for_instance() {{(pid=75216) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 18:45:38 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 18:45:38 user nova-compute[75216]: DEBUG nova.compute.manager [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Start building block device mappings for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 18:45:38 user nova-compute[75216]: INFO nova.virt.block_device [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Booting with volume ba1efeb5-724e-4415-a5ed-12ce8c9489bc at /dev/vda
Nov 13 18:45:38 user nova-compute[75216]: DEBUG nova.policy [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1ceef8ad05744447bcbf29460f62e32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046be82514bf4c3483f8b3b8f2299b96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75216) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 18:45:38 user nova-compute[75216]: DEBUG os_brick.utils [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 18:45:38 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:45:38 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:45:38 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[01c97a36-46b7-46fc-bc82-484d68c111cb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aea6fcfe14b9\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:45:38 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:45:38 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:45:38 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca6c835a-6bc5-437d-aedf-5101f68c7ee1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:45:38 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:45:38 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:45:38 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.052s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:45:38 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4dc14c4-744f-43df-803f-91805912fd65]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:45:38 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[50218c44-e5a9-4533-886b-10a958824fb9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:45:38 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Running cmd (subprocess): nvme version {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:45:38 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] 'nvme version' failed. Not Retrying. {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 18:45:38 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] nvme not present on system {{(pid=75216) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 18:45:38 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:45:38 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 18:45:38 user nova-compute[75216]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 18:45:38 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae58873d-5063-4578-a96c-0e1e97cbbf55]: (4, '') {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:45:38 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75216) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 18:45:38 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 18:45:38 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] LIGHTOS: no hostnqn found. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 18:45:38 user nova-compute[75216]: DEBUG os_brick.utils [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] <== get_connector_properties: return (178ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aea6fcfe14b9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 18:45:38 user nova-compute[75216]: DEBUG nova.virt.block_device [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Updating existing volume attachment record: 85a368e9-eeb4-4d52-90a8-969a387bcb58 {{(pid=75216) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 18:45:39 user nova-compute[75216]: DEBUG nova.network.neutron [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Successfully created port: 6b91caf7-7b72-41be-8cf7-96e728c0eae5 {{(pid=75216) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 18:45:39 user nova-compute[75216]: DEBUG nova.network.neutron [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] Successfully updated port: 217faeb3-4474-449c-ae9f-86e555ce7cd7 {{(pid=75216) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 18:45:39 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:45:39 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:45:39 user nova-compute[75216]: DEBUG nova.network.neutron [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Successfully created port: 5c412896-2c62-4248-a888-9b0612378259 {{(pid=75216) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 18:45:39 user nova-compute[75216]: DEBUG nova.compute.manager [req-5d89b6dd-3ee3-47e9-a2da-ec67434af28b req-e20bd3a5-3ddc-4683-9d79-882f9a0e8864 service nova] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] Received event network-changed-217faeb3-4474-449c-ae9f-86e555ce7cd7 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:45:39 user nova-compute[75216]: DEBUG nova.compute.manager [req-5d89b6dd-3ee3-47e9-a2da-ec67434af28b req-e20bd3a5-3ddc-4683-9d79-882f9a0e8864 service nova] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] Refreshing instance network info cache due to event network-changed-217faeb3-4474-449c-ae9f-86e555ce7cd7. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 18:45:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-5d89b6dd-3ee3-47e9-a2da-ec67434af28b req-e20bd3a5-3ddc-4683-9d79-882f9a0e8864 service nova] Acquiring lock "refresh_cache-3274203b-a985-4f28-9b45-3f83509ae782" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 18:45:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-5d89b6dd-3ee3-47e9-a2da-ec67434af28b req-e20bd3a5-3ddc-4683-9d79-882f9a0e8864 service nova] Acquired lock "refresh_cache-3274203b-a985-4f28-9b45-3f83509ae782" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 18:45:39 user nova-compute[75216]: DEBUG nova.network.neutron [req-5d89b6dd-3ee3-47e9-a2da-ec67434af28b req-e20bd3a5-3ddc-4683-9d79-882f9a0e8864 service nova] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] Refreshing network info cache for port 217faeb3-4474-449c-ae9f-86e555ce7cd7 {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 18:45:39 user nova-compute[75216]: DEBUG nova.network.neutron [req-5d89b6dd-3ee3-47e9-a2da-ec67434af28b req-e20bd3a5-3ddc-4683-9d79-882f9a0e8864 service nova] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] Instance cache missing network info. {{(pid=75216) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 18:45:40 user nova-compute[75216]: DEBUG nova.network.neutron [req-5d89b6dd-3ee3-47e9-a2da-ec67434af28b req-e20bd3a5-3ddc-4683-9d79-882f9a0e8864 service nova] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] Updating instance_info_cache with network_info: [] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 18:45:40 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-5d89b6dd-3ee3-47e9-a2da-ec67434af28b req-e20bd3a5-3ddc-4683-9d79-882f9a0e8864 service nova] Releasing lock "refresh_cache-3274203b-a985-4f28-9b45-3f83509ae782" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 18:45:40 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:45:40 user nova-compute[75216]: DEBUG nova.network.neutron [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Successfully created port: e4e34ea8-fb99-4a0e-8b65-a93933cc7d6b {{(pid=75216) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 18:45:40 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:45:40 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:45:40 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:45:40 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75216) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 18:45:40 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:45:40 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:45:40 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:45:40 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:45:40 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Auditing locally available compute resources for user (node: user) {{(pid=75216) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 18:45:40 user nova-compute[75216]: DEBUG nova.network.neutron [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] Successfully updated port: 9bed3978-d90d-4b90-b798-12413ea26a48 {{(pid=75216) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 18:45:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a3e849-6570-4820-97c8-75468b5bea4f/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:45:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a3e849-6570-4820-97c8-75468b5bea4f/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:45:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a3e849-6570-4820-97c8-75468b5bea4f/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:45:41 user nova-compute[75216]: DEBUG nova.network.neutron [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Successfully created port: 7b6ed148-b7c9-479b-9e2d-cfc0c3f6f93a {{(pid=75216) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 18:45:41 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a3e849-6570-4820-97c8-75468b5bea4f/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:45:41 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/347acafc-985e-4fa2-b286-07ea3b2e4033/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:45:41 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/347acafc-985e-4fa2-b286-07ea3b2e4033/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:45:41 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/347acafc-985e-4fa2-b286-07ea3b2e4033/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:45:41 user nova-compute[75216]: DEBUG nova.compute.manager [req-583a12e9-9b10-408a-b05e-add200cf269f req-37706ae7-dc18-4642-ac84-a57e73f3c755 service nova] [instance: 9b078f75-57f2-495a-abd5-f8adf72db80b] Received event network-vif-plugged-96bda2a6-53d1-4052-9230-4907fe60d70b {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:45:41 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-583a12e9-9b10-408a-b05e-add200cf269f req-37706ae7-dc18-4642-ac84-a57e73f3c755 service nova] Acquiring lock "9b078f75-57f2-495a-abd5-f8adf72db80b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:45:41 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-583a12e9-9b10-408a-b05e-add200cf269f req-37706ae7-dc18-4642-ac84-a57e73f3c755 service nova] Lock "9b078f75-57f2-495a-abd5-f8adf72db80b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:45:41 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-583a12e9-9b10-408a-b05e-add200cf269f req-37706ae7-dc18-4642-ac84-a57e73f3c755 service nova] Lock "9b078f75-57f2-495a-abd5-f8adf72db80b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:45:41 user nova-compute[75216]: DEBUG nova.compute.manager [req-583a12e9-9b10-408a-b05e-add200cf269f req-37706ae7-dc18-4642-ac84-a57e73f3c755 service nova] [instance: 9b078f75-57f2-495a-abd5-f8adf72db80b] No waiting events found dispatching network-vif-plugged-96bda2a6-53d1-4052-9230-4907fe60d70b {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:45:41 user nova-compute[75216]: WARNING nova.compute.manager [req-583a12e9-9b10-408a-b05e-add200cf269f req-37706ae7-dc18-4642-ac84-a57e73f3c755 service nova] [instance: 9b078f75-57f2-495a-abd5-f8adf72db80b] Received unexpected event network-vif-plugged-96bda2a6-53d1-4052-9230-4907fe60d70b for instance with vm_state active and task_state None.
Nov 13 18:45:41 user nova-compute[75216]: DEBUG nova.compute.manager [req-ba2db465-ccfa-4887-9c81-fe874f775b76 req-91c8b745-3d5c-429c-98e8-9b56659c93be service nova] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] Received event network-changed-9bed3978-d90d-4b90-b798-12413ea26a48 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:45:41 user nova-compute[75216]: DEBUG nova.compute.manager [req-ba2db465-ccfa-4887-9c81-fe874f775b76 req-91c8b745-3d5c-429c-98e8-9b56659c93be service nova] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] Refreshing instance network info cache due to event network-changed-9bed3978-d90d-4b90-b798-12413ea26a48. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 18:45:41 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-ba2db465-ccfa-4887-9c81-fe874f775b76 req-91c8b745-3d5c-429c-98e8-9b56659c93be service nova] Acquiring lock "refresh_cache-3274203b-a985-4f28-9b45-3f83509ae782" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 18:45:41 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-ba2db465-ccfa-4887-9c81-fe874f775b76 req-91c8b745-3d5c-429c-98e8-9b56659c93be service nova] Acquired lock "refresh_cache-3274203b-a985-4f28-9b45-3f83509ae782" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 18:45:41 user nova-compute[75216]: DEBUG nova.network.neutron [req-ba2db465-ccfa-4887-9c81-fe874f775b76 req-91c8b745-3d5c-429c-98e8-9b56659c93be service nova] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] Refreshing network info cache for port 9bed3978-d90d-4b90-b798-12413ea26a48 {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 18:45:41 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/347acafc-985e-4fa2-b286-07ea3b2e4033/disk --force-share --output=json" returned: 0 in 0.303s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:45:41 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83fda249-9d28-4cc2-aeb0-103ce4f1faa4/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:45:41 user nova-compute[75216]: DEBUG nova.network.neutron [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Successfully created port: 815d1175-2997-4d74-8f35-7ca982cf46aa {{(pid=75216) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 18:45:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:45:42 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83fda249-9d28-4cc2-aeb0-103ce4f1faa4/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:45:42 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83fda249-9d28-4cc2-aeb0-103ce4f1faa4/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:45:42 user nova-compute[75216]: DEBUG nova.network.neutron [req-ba2db465-ccfa-4887-9c81-fe874f775b76 req-91c8b745-3d5c-429c-98e8-9b56659c93be service nova] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] Instance cache missing network info. {{(pid=75216) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 18:45:42 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83fda249-9d28-4cc2-aeb0-103ce4f1faa4/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:45:42 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d589d57e-de50-482a-843f-e8246b3d7528/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:45:42 user nova-compute[75216]: DEBUG nova.network.neutron [req-ba2db465-ccfa-4887-9c81-fe874f775b76 req-91c8b745-3d5c-429c-98e8-9b56659c93be service nova] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] Updating instance_info_cache with network_info: [] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 18:45:42 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-ba2db465-ccfa-4887-9c81-fe874f775b76 req-91c8b745-3d5c-429c-98e8-9b56659c93be service nova] Releasing lock "refresh_cache-3274203b-a985-4f28-9b45-3f83509ae782" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 18:45:42 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d589d57e-de50-482a-843f-e8246b3d7528/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:45:42 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d589d57e-de50-482a-843f-e8246b3d7528/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:45:42 user nova-compute[75216]: DEBUG nova.network.neutron [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] Successfully updated port: 95a425c5-f994-4504-a94b-040103b2efa7 {{(pid=75216) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 18:45:42 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d589d57e-de50-482a-843f-e8246b3d7528/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:45:42 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b078f75-57f2-495a-abd5-f8adf72db80b/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:45:42 user nova-compute[75216]: DEBUG nova.network.neutron [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Successfully updated port: 6b91caf7-7b72-41be-8cf7-96e728c0eae5 {{(pid=75216) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 18:45:42 user nova-compute[75216]: DEBUG nova.compute.manager [req-84e77ff4-b7b5-4b9d-aad1-ba9c02eb78f7 req-584c178e-e30f-4796-b441-a7af90b2cdcf service nova] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Received event network-changed-6b91caf7-7b72-41be-8cf7-96e728c0eae5 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:45:42 user nova-compute[75216]: DEBUG nova.compute.manager [req-84e77ff4-b7b5-4b9d-aad1-ba9c02eb78f7 req-584c178e-e30f-4796-b441-a7af90b2cdcf service nova] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Refreshing instance network info cache due to event network-changed-6b91caf7-7b72-41be-8cf7-96e728c0eae5. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 18:45:42 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-84e77ff4-b7b5-4b9d-aad1-ba9c02eb78f7 req-584c178e-e30f-4796-b441-a7af90b2cdcf service nova] Acquiring lock "refresh_cache-78605259-17bf-47da-86de-3c76ac1c5bfa" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 18:45:42 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-84e77ff4-b7b5-4b9d-aad1-ba9c02eb78f7 req-584c178e-e30f-4796-b441-a7af90b2cdcf service nova] Acquired lock "refresh_cache-78605259-17bf-47da-86de-3c76ac1c5bfa" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 18:45:42 user nova-compute[75216]: DEBUG nova.network.neutron [req-84e77ff4-b7b5-4b9d-aad1-ba9c02eb78f7 req-584c178e-e30f-4796-b441-a7af90b2cdcf service nova] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Refreshing network info cache for port 6b91caf7-7b72-41be-8cf7-96e728c0eae5 {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 18:45:42 user nova-compute[75216]: DEBUG nova.network.neutron [req-84e77ff4-b7b5-4b9d-aad1-ba9c02eb78f7 req-584c178e-e30f-4796-b441-a7af90b2cdcf service nova] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Instance cache missing network info. {{(pid=75216) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 18:45:42 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:45:42 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b078f75-57f2-495a-abd5-f8adf72db80b/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:45:42 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b078f75-57f2-495a-abd5-f8adf72db80b/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:45:43 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b078f75-57f2-495a-abd5-f8adf72db80b/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:45:43 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/872856e5-cdc4-444e-8835-55e36708d776/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:45:43 user nova-compute[75216]: DEBUG nova.network.neutron [req-84e77ff4-b7b5-4b9d-aad1-ba9c02eb78f7 req-584c178e-e30f-4796-b441-a7af90b2cdcf service nova] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Updating instance_info_cache with network_info: [] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 18:45:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-84e77ff4-b7b5-4b9d-aad1-ba9c02eb78f7 req-584c178e-e30f-4796-b441-a7af90b2cdcf service nova] Releasing lock "refresh_cache-78605259-17bf-47da-86de-3c76ac1c5bfa" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 18:45:43 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/872856e5-cdc4-444e-8835-55e36708d776/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:45:43 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/872856e5-cdc4-444e-8835-55e36708d776/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:45:43 user nova-compute[75216]: DEBUG nova.network.neutron [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] Successfully updated port: 7aa7e71d-2c00-40fd-9d05-d108bcc807ec {{(pid=75216) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 18:45:43 user nova-compute[75216]: DEBUG nova.network.neutron [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Successfully updated port: 7c9f8c17-a293-4817-ae4f-3fab0a1076a6 {{(pid=75216) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 18:45:43 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/872856e5-cdc4-444e-8835-55e36708d776/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:45:43 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/576e97b7-285a-451f-a80d-aaa321a79d3b/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:45:43 user nova-compute[75216]: DEBUG nova.compute.manager [req-99f0b9fe-6c82-4765-a04d-3d50d171be20 req-372058a4-a063-4a7b-8c83-9b884e237b79 service nova] [instance: 9b078f75-57f2-495a-abd5-f8adf72db80b] Received event network-vif-plugged-96bda2a6-53d1-4052-9230-4907fe60d70b {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:45:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-99f0b9fe-6c82-4765-a04d-3d50d171be20 req-372058a4-a063-4a7b-8c83-9b884e237b79 service nova] Acquiring lock "9b078f75-57f2-495a-abd5-f8adf72db80b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:45:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-99f0b9fe-6c82-4765-a04d-3d50d171be20 req-372058a4-a063-4a7b-8c83-9b884e237b79 service nova] Lock "9b078f75-57f2-495a-abd5-f8adf72db80b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:45:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-99f0b9fe-6c82-4765-a04d-3d50d171be20 req-372058a4-a063-4a7b-8c83-9b884e237b79 service nova] Lock "9b078f75-57f2-495a-abd5-f8adf72db80b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:45:43 user nova-compute[75216]: DEBUG nova.compute.manager [req-99f0b9fe-6c82-4765-a04d-3d50d171be20 req-372058a4-a063-4a7b-8c83-9b884e237b79 service nova] [instance: 9b078f75-57f2-495a-abd5-f8adf72db80b] No waiting events found dispatching network-vif-plugged-96bda2a6-53d1-4052-9230-4907fe60d70b {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:45:43 user nova-compute[75216]: WARNING nova.compute.manager [req-99f0b9fe-6c82-4765-a04d-3d50d171be20 req-372058a4-a063-4a7b-8c83-9b884e237b79 service nova] [instance: 9b078f75-57f2-495a-abd5-f8adf72db80b] Received unexpected event network-vif-plugged-96bda2a6-53d1-4052-9230-4907fe60d70b for instance with vm_state active and task_state None.
Nov 13 18:45:43 user nova-compute[75216]: DEBUG nova.compute.manager [req-b85b86ac-fd1c-4b50-8cf5-ebdbebd66b09 req-7a5b339e-f584-4e4d-bf25-8c68d306d276 service nova] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] Received event network-changed-95a425c5-f994-4504-a94b-040103b2efa7 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:45:43 user nova-compute[75216]: DEBUG nova.compute.manager [req-b85b86ac-fd1c-4b50-8cf5-ebdbebd66b09 req-7a5b339e-f584-4e4d-bf25-8c68d306d276 service nova] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] Refreshing instance network info cache due to event network-changed-95a425c5-f994-4504-a94b-040103b2efa7. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 18:45:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-b85b86ac-fd1c-4b50-8cf5-ebdbebd66b09 req-7a5b339e-f584-4e4d-bf25-8c68d306d276 service nova] Acquiring lock "refresh_cache-3274203b-a985-4f28-9b45-3f83509ae782" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 18:45:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-b85b86ac-fd1c-4b50-8cf5-ebdbebd66b09 req-7a5b339e-f584-4e4d-bf25-8c68d306d276 service nova] Acquired lock "refresh_cache-3274203b-a985-4f28-9b45-3f83509ae782" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 18:45:43 user nova-compute[75216]: DEBUG nova.network.neutron [req-b85b86ac-fd1c-4b50-8cf5-ebdbebd66b09 req-7a5b339e-f584-4e4d-bf25-8c68d306d276 service nova] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] Refreshing network info cache for port 95a425c5-f994-4504-a94b-040103b2efa7 {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 18:45:43 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/576e97b7-285a-451f-a80d-aaa321a79d3b/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:45:43 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/576e97b7-285a-451f-a80d-aaa321a79d3b/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:45:43 user nova-compute[75216]: DEBUG nova.network.neutron [req-b85b86ac-fd1c-4b50-8cf5-ebdbebd66b09 req-7a5b339e-f584-4e4d-bf25-8c68d306d276 service nova] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] Instance cache missing network info. {{(pid=75216) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 18:45:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/576e97b7-285a-451f-a80d-aaa321a79d3b/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:45:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85624c58-6c72-4490-8a3e-547953295ade/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:45:44 user nova-compute[75216]: INFO nova.virt.block_device [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Booting with volume 0fc393f0-1356-404f-a87b-bed1fb91b924 at /dev/vdb
Nov 13 18:45:44 user nova-compute[75216]: DEBUG nova.network.neutron [req-b85b86ac-fd1c-4b50-8cf5-ebdbebd66b09 req-7a5b339e-f584-4e4d-bf25-8c68d306d276 service nova] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] Updating instance_info_cache with network_info: [] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 18:45:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85624c58-6c72-4490-8a3e-547953295ade/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:45:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85624c58-6c72-4490-8a3e-547953295ade/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:45:44 user nova-compute[75216]: DEBUG os_brick.utils [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 18:45:44 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-b85b86ac-fd1c-4b50-8cf5-ebdbebd66b09 req-7a5b339e-f584-4e4d-bf25-8c68d306d276 service nova] Releasing lock "refresh_cache-3274203b-a985-4f28-9b45-3f83509ae782" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 18:45:44 user nova-compute[75216]: DEBUG nova.compute.manager [req-b85b86ac-fd1c-4b50-8cf5-ebdbebd66b09 req-7a5b339e-f584-4e4d-bf25-8c68d306d276 service nova] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] Received event network-changed-7aa7e71d-2c00-40fd-9d05-d108bcc807ec {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:45:44 user nova-compute[75216]: DEBUG nova.compute.manager [req-b85b86ac-fd1c-4b50-8cf5-ebdbebd66b09 req-7a5b339e-f584-4e4d-bf25-8c68d306d276 service nova] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] Refreshing instance network info cache due to event network-changed-7aa7e71d-2c00-40fd-9d05-d108bcc807ec. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 18:45:44 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-b85b86ac-fd1c-4b50-8cf5-ebdbebd66b09 req-7a5b339e-f584-4e4d-bf25-8c68d306d276 service nova] Acquiring lock "refresh_cache-3274203b-a985-4f28-9b45-3f83509ae782" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 18:45:44 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-b85b86ac-fd1c-4b50-8cf5-ebdbebd66b09 req-7a5b339e-f584-4e4d-bf25-8c68d306d276 service nova] Acquired lock "refresh_cache-3274203b-a985-4f28-9b45-3f83509ae782" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 18:45:44 user nova-compute[75216]: DEBUG nova.network.neutron [req-b85b86ac-fd1c-4b50-8cf5-ebdbebd66b09 req-7a5b339e-f584-4e4d-bf25-8c68d306d276 service nova] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] Refreshing network info cache for port 7aa7e71d-2c00-40fd-9d05-d108bcc807ec {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 18:45:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:45:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:45:44 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[74bed237-8794-4828-a461-17b38d77de1f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aea6fcfe14b9\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:45:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:45:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:45:44 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbeaf35c-2b9c-459a-a4cd-d6c02ed630e8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:45:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:45:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:45:44 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd46b1eb-3e31-4304-9f40-e4b4839c7f04]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:45:44 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[21df18cb-b288-4c22-9f70-8ca0952e0e95]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:45:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Running cmd (subprocess): nvme version {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:45:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] 'nvme version' failed. Not Retrying. {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 18:45:44 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] nvme not present on system {{(pid=75216) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 18:45:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:45:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 18:45:44 user nova-compute[75216]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 18:45:44 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[da38e79a-9cf8-48c7-9b52-848914ccb7a3]: (4, '') {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:45:44 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75216) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 18:45:44 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 18:45:44 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] LIGHTOS: no hostnqn found. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 18:45:44 user nova-compute[75216]: DEBUG os_brick.utils [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aea6fcfe14b9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 18:45:44 user nova-compute[75216]: DEBUG nova.virt.block_device [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Updating existing volume attachment record: da9b4230-5af5-4ee7-8e26-6a30d438e6ff {{(pid=75216) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 18:45:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85624c58-6c72-4490-8a3e-547953295ade/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:45:44 user nova-compute[75216]: DEBUG nova.network.neutron [req-b85b86ac-fd1c-4b50-8cf5-ebdbebd66b09 req-7a5b339e-f584-4e4d-bf25-8c68d306d276 service nova] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] Instance cache missing network info. {{(pid=75216) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 18:45:44 user nova-compute[75216]: DEBUG nova.network.neutron [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] Successfully updated port: 01772e53-e624-4728-beb1-929cc4165f21 {{(pid=75216) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 18:45:45 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:45:45 user nova-compute[75216]: DEBUG nova.network.neutron [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Successfully updated port: c5b1d8e6-f202-4278-924c-abecf64f299c {{(pid=75216) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 18:45:45 user nova-compute[75216]: DEBUG nova.compute.manager [req-a3809965-f1e3-4a39-9563-b2b7984c186a req-6c791905-8799-45f9-808e-a2c8e7d6ed7f service nova] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Received event network-changed-7c9f8c17-a293-4817-ae4f-3fab0a1076a6 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:45:45 user nova-compute[75216]: DEBUG nova.compute.manager [req-a3809965-f1e3-4a39-9563-b2b7984c186a req-6c791905-8799-45f9-808e-a2c8e7d6ed7f service nova] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Refreshing instance network info cache due to event network-changed-7c9f8c17-a293-4817-ae4f-3fab0a1076a6. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 18:45:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-a3809965-f1e3-4a39-9563-b2b7984c186a req-6c791905-8799-45f9-808e-a2c8e7d6ed7f service nova] Acquiring lock "refresh_cache-78605259-17bf-47da-86de-3c76ac1c5bfa" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 18:45:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-a3809965-f1e3-4a39-9563-b2b7984c186a req-6c791905-8799-45f9-808e-a2c8e7d6ed7f service nova] Acquired lock "refresh_cache-78605259-17bf-47da-86de-3c76ac1c5bfa" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 18:45:45 user nova-compute[75216]: DEBUG nova.network.neutron [req-a3809965-f1e3-4a39-9563-b2b7984c186a req-6c791905-8799-45f9-808e-a2c8e7d6ed7f service nova] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Refreshing network info cache for port 7c9f8c17-a293-4817-ae4f-3fab0a1076a6 {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 18:45:45 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 18:45:45 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 18:45:45 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Hypervisor/Node resource view: name=user free_ram=7501MB free_disk=25.865150451660156GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=75216) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 18:45:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:45:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:45:45 user nova-compute[75216]: DEBUG nova.network.neutron [req-b85b86ac-fd1c-4b50-8cf5-ebdbebd66b09 req-7a5b339e-f584-4e4d-bf25-8c68d306d276 service nova] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] Updating instance_info_cache with network_info: [] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 18:45:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-b85b86ac-fd1c-4b50-8cf5-ebdbebd66b09 req-7a5b339e-f584-4e4d-bf25-8c68d306d276 service nova] Releasing lock "refresh_cache-3274203b-a985-4f28-9b45-3f83509ae782" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 18:45:45 user nova-compute[75216]: INFO nova.virt.block_device [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] Booting with volume 2a1a5e82-4f70-4668-94bd-4a842d826214 at /dev/vdb
Nov 13 18:45:45 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:45:45 user nova-compute[75216]: DEBUG nova.network.neutron [req-a3809965-f1e3-4a39-9563-b2b7984c186a req-6c791905-8799-45f9-808e-a2c8e7d6ed7f service nova] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Instance cache missing network info. {{(pid=75216) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 18:45:45 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance a1a3e849-6570-4820-97c8-75468b5bea4f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 18:45:45 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance 347acafc-985e-4fa2-b286-07ea3b2e4033 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 18:45:45 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance d589d57e-de50-482a-843f-e8246b3d7528 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 18:45:45 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance 85624c58-6c72-4490-8a3e-547953295ade actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 18:45:45 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance 9b078f75-57f2-495a-abd5-f8adf72db80b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 18:45:45 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance 83fda249-9d28-4cc2-aeb0-103ce4f1faa4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 18:45:45 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance 872856e5-cdc4-444e-8835-55e36708d776 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 18:45:45 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance 576e97b7-285a-451f-a80d-aaa321a79d3b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 18:45:45 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance 3274203b-a985-4f28-9b45-3f83509ae782 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 18:45:45 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance 78605259-17bf-47da-86de-3c76ac1c5bfa actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 18:45:45 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 18:45:45 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 18:45:45 user nova-compute[75216]: DEBUG os_brick.utils [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 18:45:45 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:45:45 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:45:45 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[144465eb-61fb-46af-9ad6-1abcaa1f9791]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aea6fcfe14b9\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:45:45 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:45:45 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:45:45 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[41506e49-de0d-4913-9949-003ef7d05527]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:45:45 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:45:45 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:45:45 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[95e73ae1-c54e-4f75-a803-28324056bdf3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:45:45 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8132c07-d2b6-405e-bf08-28744aa2cc47]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:45:45 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Running cmd (subprocess): nvme version {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:45:45 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] 'nvme version' failed. Not Retrying. {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 18:45:45 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.nvmeof [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] nvme not present on system {{(pid=75216) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 18:45:45 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:45:45 user nova-compute[75216]: DEBUG nova.network.neutron [req-a3809965-f1e3-4a39-9563-b2b7984c186a req-6c791905-8799-45f9-808e-a2c8e7d6ed7f service nova] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Updating instance_info_cache with network_info: [] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 18:45:45 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 18:45:45 user nova-compute[75216]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 18:45:45 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2e45bd1-4a51-4dc5-888b-ecb2119cb9a0]: (4, '') {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:45:45 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75216) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 18:45:45 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 18:45:45 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] LIGHTOS: no hostnqn found. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 18:45:45 user nova-compute[75216]: DEBUG os_brick.utils [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] <== get_connector_properties: return (148ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aea6fcfe14b9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 18:45:45 user nova-compute[75216]: DEBUG nova.virt.block_device [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] Updating existing volume attachment record: 118f1bc1-df35-4426-b671-a6d846058f16 {{(pid=75216) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 18:45:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-a3809965-f1e3-4a39-9563-b2b7984c186a req-6c791905-8799-45f9-808e-a2c8e7d6ed7f service nova] Releasing lock "refresh_cache-78605259-17bf-47da-86de-3c76ac1c5bfa" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 18:45:45 user nova-compute[75216]: DEBUG nova.compute.manager [req-a3809965-f1e3-4a39-9563-b2b7984c186a req-6c791905-8799-45f9-808e-a2c8e7d6ed7f service nova] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Received event network-changed-c5b1d8e6-f202-4278-924c-abecf64f299c {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:45:45 user nova-compute[75216]: DEBUG nova.compute.manager [req-a3809965-f1e3-4a39-9563-b2b7984c186a req-6c791905-8799-45f9-808e-a2c8e7d6ed7f service nova] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Refreshing instance network info cache due to event network-changed-c5b1d8e6-f202-4278-924c-abecf64f299c. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 18:45:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-a3809965-f1e3-4a39-9563-b2b7984c186a req-6c791905-8799-45f9-808e-a2c8e7d6ed7f service nova] Acquiring lock "refresh_cache-78605259-17bf-47da-86de-3c76ac1c5bfa" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 18:45:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-a3809965-f1e3-4a39-9563-b2b7984c186a req-6c791905-8799-45f9-808e-a2c8e7d6ed7f service nova] Acquired lock "refresh_cache-78605259-17bf-47da-86de-3c76ac1c5bfa" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 18:45:45 user nova-compute[75216]: DEBUG nova.network.neutron [req-a3809965-f1e3-4a39-9563-b2b7984c186a req-6c791905-8799-45f9-808e-a2c8e7d6ed7f service nova] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Refreshing network info cache for port c5b1d8e6-f202-4278-924c-abecf64f299c {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 18:45:45 user nova-compute[75216]: DEBUG nova.network.neutron [req-a3809965-f1e3-4a39-9563-b2b7984c186a req-6c791905-8799-45f9-808e-a2c8e7d6ed7f service nova] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Instance cache missing network info. {{(pid=75216) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 18:45:45 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 18:45:45 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 18:45:45 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Compute_service record updated for user:user {{(pid=75216) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 18:45:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.618s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:45:45 user nova-compute[75216]: DEBUG nova.network.neutron [req-a3809965-f1e3-4a39-9563-b2b7984c186a req-6c791905-8799-45f9-808e-a2c8e7d6ed7f service nova] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Updating instance_info_cache with network_info: [] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 18:45:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-a3809965-f1e3-4a39-9563-b2b7984c186a req-6c791905-8799-45f9-808e-a2c8e7d6ed7f service nova] Releasing lock "refresh_cache-78605259-17bf-47da-86de-3c76ac1c5bfa" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 18:45:45 user nova-compute[75216]: DEBUG nova.compute.manager [req-62634c0c-5f0a-4e4b-91ba-1abd7c8e9ad1 req-4f8bbf36-f0b7-4773-ac9d-ec20c1ed3708 service nova] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] Received event network-changed-01772e53-e624-4728-beb1-929cc4165f21 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:45:45 user nova-compute[75216]: DEBUG nova.compute.manager [req-62634c0c-5f0a-4e4b-91ba-1abd7c8e9ad1 req-4f8bbf36-f0b7-4773-ac9d-ec20c1ed3708 service nova] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] Refreshing instance network info cache due to event network-changed-01772e53-e624-4728-beb1-929cc4165f21. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 18:45:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-62634c0c-5f0a-4e4b-91ba-1abd7c8e9ad1 req-4f8bbf36-f0b7-4773-ac9d-ec20c1ed3708 service nova] Acquiring lock "refresh_cache-3274203b-a985-4f28-9b45-3f83509ae782" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 18:45:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-62634c0c-5f0a-4e4b-91ba-1abd7c8e9ad1 req-4f8bbf36-f0b7-4773-ac9d-ec20c1ed3708 service nova] Acquired lock "refresh_cache-3274203b-a985-4f28-9b45-3f83509ae782" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 18:45:45 user nova-compute[75216]: DEBUG nova.network.neutron [req-62634c0c-5f0a-4e4b-91ba-1abd7c8e9ad1 req-4f8bbf36-f0b7-4773-ac9d-ec20c1ed3708 service nova] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] Refreshing network info cache for port 01772e53-e624-4728-beb1-929cc4165f21 {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 18:45:45 user nova-compute[75216]: DEBUG nova.network.neutron [req-62634c0c-5f0a-4e4b-91ba-1abd7c8e9ad1 req-4f8bbf36-f0b7-4773-ac9d-ec20c1ed3708 service nova] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] Instance cache missing network info. {{(pid=75216) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 18:45:46 user nova-compute[75216]: DEBUG nova.network.neutron [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] Successfully updated port: 1bb4df6f-02b2-415b-9cea-fd8a7a04874c {{(pid=75216) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 18:45:46 user nova-compute[75216]: DEBUG nova.network.neutron [req-62634c0c-5f0a-4e4b-91ba-1abd7c8e9ad1 req-4f8bbf36-f0b7-4773-ac9d-ec20c1ed3708 service nova] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] Updating instance_info_cache with network_info: [] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 18:45:46 user nova-compute[75216]: DEBUG nova.network.neutron [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Successfully updated port: 5c412896-2c62-4248-a888-9b0612378259 {{(pid=75216) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 18:45:46 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-62634c0c-5f0a-4e4b-91ba-1abd7c8e9ad1 req-4f8bbf36-f0b7-4773-ac9d-ec20c1ed3708 service nova] Releasing lock "refresh_cache-3274203b-a985-4f28-9b45-3f83509ae782" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 18:45:46 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:45:46 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1eb91b5c-2b39-4aaa-9e19-cc7813574ff3 tempest-VolumesActionsTest-586345736 tempest-VolumesActionsTest-586345736-project-member] Acquiring lock "30ca36a3-ac49-44e4-a804-8940f7ef25b8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:45:46 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1eb91b5c-2b39-4aaa-9e19-cc7813574ff3 tempest-VolumesActionsTest-586345736 tempest-VolumesActionsTest-586345736-project-member] Lock "30ca36a3-ac49-44e4-a804-8940f7ef25b8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:45:46 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:45:46 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Starting heal instance info cache {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 18:45:46 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Rebuilding the list of instances to heal {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 13 18:45:46 user nova-compute[75216]: DEBUG nova.compute.manager [None req-1eb91b5c-2b39-4aaa-9e19-cc7813574ff3 tempest-VolumesActionsTest-586345736 tempest-VolumesActionsTest-586345736-project-member] [instance: 30ca36a3-ac49-44e4-a804-8940f7ef25b8] Starting instance... {{(pid=75216) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 18:45:46 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] Skipping network cache update for instance because it is Building. {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 13 18:45:46 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Skipping network cache update for instance because it is Building. {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 13 18:45:46 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1eb91b5c-2b39-4aaa-9e19-cc7813574ff3 tempest-VolumesActionsTest-586345736 tempest-VolumesActionsTest-586345736-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:45:46 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1eb91b5c-2b39-4aaa-9e19-cc7813574ff3 tempest-VolumesActionsTest-586345736 tempest-VolumesActionsTest-586345736-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:45:46 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-1eb91b5c-2b39-4aaa-9e19-cc7813574ff3 tempest-VolumesActionsTest-586345736 tempest-VolumesActionsTest-586345736-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75216) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 18:45:46 user nova-compute[75216]: INFO nova.compute.claims [None req-1eb91b5c-2b39-4aaa-9e19-cc7813574ff3 tempest-VolumesActionsTest-586345736 tempest-VolumesActionsTest-586345736-project-member] [instance: 30ca36a3-ac49-44e4-a804-8940f7ef25b8] Claim successful on node user
Nov 13 18:45:46 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "refresh_cache-a1a3e849-6570-4820-97c8-75468b5bea4f" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 18:45:46 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquired lock "refresh_cache-a1a3e849-6570-4820-97c8-75468b5bea4f" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 18:45:46 user nova-compute[75216]: DEBUG nova.network.neutron [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: a1a3e849-6570-4820-97c8-75468b5bea4f] Forcefully refreshing network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 18:45:46 user nova-compute[75216]: DEBUG nova.objects.instance [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lazy-loading 'info_cache' on Instance uuid a1a3e849-6570-4820-97c8-75468b5bea4f {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 18:45:46 user nova-compute[75216]: DEBUG nova.compute.manager [req-f2e531ff-13e5-465e-a1fa-3750fdb10496 req-553417ce-db9a-4dd9-92eb-41ff012941a9 service nova] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] Received event network-changed-1bb4df6f-02b2-415b-9cea-fd8a7a04874c {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:45:46 user nova-compute[75216]: DEBUG nova.compute.manager [req-f2e531ff-13e5-465e-a1fa-3750fdb10496 req-553417ce-db9a-4dd9-92eb-41ff012941a9 service nova] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] Refreshing instance network info cache due to event network-changed-1bb4df6f-02b2-415b-9cea-fd8a7a04874c. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 18:45:46 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-f2e531ff-13e5-465e-a1fa-3750fdb10496 req-553417ce-db9a-4dd9-92eb-41ff012941a9 service nova] Acquiring lock "refresh_cache-3274203b-a985-4f28-9b45-3f83509ae782" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 18:45:46 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-f2e531ff-13e5-465e-a1fa-3750fdb10496 req-553417ce-db9a-4dd9-92eb-41ff012941a9 service nova] Acquired lock "refresh_cache-3274203b-a985-4f28-9b45-3f83509ae782" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 18:45:46 user nova-compute[75216]: DEBUG nova.network.neutron [req-f2e531ff-13e5-465e-a1fa-3750fdb10496 req-553417ce-db9a-4dd9-92eb-41ff012941a9 service nova] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] Refreshing network info cache for port 1bb4df6f-02b2-415b-9cea-fd8a7a04874c {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 18:45:46 user nova-compute[75216]: DEBUG nova.network.neutron [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] Successfully updated port: a07efcd3-59f4-452e-8fb7-8b8233ae235f {{(pid=75216) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 18:45:46 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Acquiring lock "refresh_cache-3274203b-a985-4f28-9b45-3f83509ae782" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 18:45:47 user nova-compute[75216]: DEBUG nova.network.neutron [req-f2e531ff-13e5-465e-a1fa-3750fdb10496 req-553417ce-db9a-4dd9-92eb-41ff012941a9 service nova] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] Instance cache missing network info. {{(pid=75216) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 18:45:47 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-1eb91b5c-2b39-4aaa-9e19-cc7813574ff3 tempest-VolumesActionsTest-586345736 tempest-VolumesActionsTest-586345736-project-member] Refreshing inventories for resource provider d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 13 18:45:47 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-1eb91b5c-2b39-4aaa-9e19-cc7813574ff3 tempest-VolumesActionsTest-586345736 tempest-VolumesActionsTest-586345736-project-member] Updating ProviderTree inventory for provider d927e00d-5a8b-43f7-ac04-6437958fac1f from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 13 18:45:47 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-1eb91b5c-2b39-4aaa-9e19-cc7813574ff3 tempest-VolumesActionsTest-586345736 tempest-VolumesActionsTest-586345736-project-member] Updating inventory in ProviderTree for provider d927e00d-5a8b-43f7-ac04-6437958fac1f with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 13 18:45:47 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-1eb91b5c-2b39-4aaa-9e19-cc7813574ff3 tempest-VolumesActionsTest-586345736 tempest-VolumesActionsTest-586345736-project-member] Refreshing aggregate associations for resource provider d927e00d-5a8b-43f7-ac04-6437958fac1f, aggregates: None {{(pid=75216) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 13 18:45:47 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-1eb91b5c-2b39-4aaa-9e19-cc7813574ff3 tempest-VolumesActionsTest-586345736 tempest-VolumesActionsTest-586345736-project-member] Refreshing trait associations for resource provider d927e00d-5a8b-43f7-ac04-6437958fac1f, traits: COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_MMX {{(pid=75216) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 13 18:45:47 user nova-compute[75216]: DEBUG nova.network.neutron [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: a1a3e849-6570-4820-97c8-75468b5bea4f] Updating instance_info_cache with network_info: [{"id": "3544d3e3-8dfa-4043-b225-77f690cd3760", "address": "fa:16:3e:9e:b9:f7", "network": {"id": "d7a691f0-4495-40ad-a349-91b5dc9c635a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-961583097-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9b7e11038e54e368acd22d06e54a351", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3544d3e3-8d", "ovs_interfaceid": "3544d3e3-8dfa-4043-b225-77f690cd3760", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 18:45:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Releasing lock "refresh_cache-a1a3e849-6570-4820-97c8-75468b5bea4f" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 18:45:47 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: a1a3e849-6570-4820-97c8-75468b5bea4f] Updated the network info_cache for instance {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 18:45:47 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-1eb91b5c-2b39-4aaa-9e19-cc7813574ff3 tempest-VolumesActionsTest-586345736 tempest-VolumesActionsTest-586345736-project-member] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 18:45:47 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-1eb91b5c-2b39-4aaa-9e19-cc7813574ff3 tempest-VolumesActionsTest-586345736 tempest-VolumesActionsTest-586345736-project-member] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 18:45:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1eb91b5c-2b39-4aaa-9e19-cc7813574ff3 tempest-VolumesActionsTest-586345736 tempest-VolumesActionsTest-586345736-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.946s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:45:47 user nova-compute[75216]: DEBUG nova.compute.manager [None req-1eb91b5c-2b39-4aaa-9e19-cc7813574ff3 tempest-VolumesActionsTest-586345736 tempest-VolumesActionsTest-586345736-project-member] [instance: 30ca36a3-ac49-44e4-a804-8940f7ef25b8] Start building networks asynchronously for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 18:45:47 user nova-compute[75216]: DEBUG nova.compute.manager [None req-1eb91b5c-2b39-4aaa-9e19-cc7813574ff3 tempest-VolumesActionsTest-586345736 tempest-VolumesActionsTest-586345736-project-member] [instance: 30ca36a3-ac49-44e4-a804-8940f7ef25b8] Allocating IP information in the background. {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 18:45:47 user nova-compute[75216]: DEBUG nova.network.neutron [None req-1eb91b5c-2b39-4aaa-9e19-cc7813574ff3 tempest-VolumesActionsTest-586345736 tempest-VolumesActionsTest-586345736-project-member] [instance: 30ca36a3-ac49-44e4-a804-8940f7ef25b8] allocate_for_instance() {{(pid=75216) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 18:45:47 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-1eb91b5c-2b39-4aaa-9e19-cc7813574ff3 tempest-VolumesActionsTest-586345736 tempest-VolumesActionsTest-586345736-project-member] [instance: 30ca36a3-ac49-44e4-a804-8940f7ef25b8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 18:45:47 user nova-compute[75216]: DEBUG nova.compute.manager [None req-1eb91b5c-2b39-4aaa-9e19-cc7813574ff3 tempest-VolumesActionsTest-586345736 tempest-VolumesActionsTest-586345736-project-member] [instance: 30ca36a3-ac49-44e4-a804-8940f7ef25b8] Start building block device mappings for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 18:45:47 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:45:47 user nova-compute[75216]: DEBUG nova.compute.manager [req-a59baceb-3bcc-432b-84f9-1e3b9d6c8491 req-d3dd7c89-6e19-46b9-92cd-7a7c0a33ff09 service nova] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] Received event network-changed-a07efcd3-59f4-452e-8fb7-8b8233ae235f {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:45:47 user nova-compute[75216]: DEBUG nova.compute.manager [req-a59baceb-3bcc-432b-84f9-1e3b9d6c8491 req-d3dd7c89-6e19-46b9-92cd-7a7c0a33ff09 service nova] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] Refreshing instance network info cache due to event network-changed-a07efcd3-59f4-452e-8fb7-8b8233ae235f. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 18:45:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-a59baceb-3bcc-432b-84f9-1e3b9d6c8491 req-d3dd7c89-6e19-46b9-92cd-7a7c0a33ff09 service nova] Acquiring lock "refresh_cache-3274203b-a985-4f28-9b45-3f83509ae782" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 18:45:47 user nova-compute[75216]: DEBUG nova.policy [None req-1eb91b5c-2b39-4aaa-9e19-cc7813574ff3 tempest-VolumesActionsTest-586345736 tempest-VolumesActionsTest-586345736-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '838f3474d7d84930959d11f51fa03e17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986d2e55aab34f7e8e09b9619c492b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75216) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 18:45:47 user nova-compute[75216]: DEBUG nova.compute.manager [None req-1eb91b5c-2b39-4aaa-9e19-cc7813574ff3 tempest-VolumesActionsTest-586345736 tempest-VolumesActionsTest-586345736-project-member] [instance: 30ca36a3-ac49-44e4-a804-8940f7ef25b8] Start spawning the instance on the hypervisor. {{(pid=75216) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 18:45:47 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-1eb91b5c-2b39-4aaa-9e19-cc7813574ff3 tempest-VolumesActionsTest-586345736 tempest-VolumesActionsTest-586345736-project-member] [instance: 30ca36a3-ac49-44e4-a804-8940f7ef25b8] Creating instance directory {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 18:45:47 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-1eb91b5c-2b39-4aaa-9e19-cc7813574ff3 tempest-VolumesActionsTest-586345736 tempest-VolumesActionsTest-586345736-project-member] [instance: 30ca36a3-ac49-44e4-a804-8940f7ef25b8] Creating image(s)
Nov 13 18:45:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1eb91b5c-2b39-4aaa-9e19-cc7813574ff3 tempest-VolumesActionsTest-586345736 tempest-VolumesActionsTest-586345736-project-member] Acquiring lock "/opt/stack/data/nova/instances/30ca36a3-ac49-44e4-a804-8940f7ef25b8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:45:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1eb91b5c-2b39-4aaa-9e19-cc7813574ff3 tempest-VolumesActionsTest-586345736 tempest-VolumesActionsTest-586345736-project-member] Lock "/opt/stack/data/nova/instances/30ca36a3-ac49-44e4-a804-8940f7ef25b8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:45:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1eb91b5c-2b39-4aaa-9e19-cc7813574ff3 tempest-VolumesActionsTest-586345736 tempest-VolumesActionsTest-586345736-project-member] Lock "/opt/stack/data/nova/instances/30ca36a3-ac49-44e4-a804-8940f7ef25b8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:45:47 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-1eb91b5c-2b39-4aaa-9e19-cc7813574ff3 tempest-VolumesActionsTest-586345736 tempest-VolumesActionsTest-586345736-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:45:48 user nova-compute[75216]: DEBUG nova.network.neutron [req-f2e531ff-13e5-465e-a1fa-3750fdb10496 req-553417ce-db9a-4dd9-92eb-41ff012941a9 service nova] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] Updating instance_info_cache with network_info: [] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 18:45:48 user nova-compute[75216]: DEBUG nova.network.neutron [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Successfully updated port: e4e34ea8-fb99-4a0e-8b65-a93933cc7d6b {{(pid=75216) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 18:45:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-f2e531ff-13e5-465e-a1fa-3750fdb10496 req-553417ce-db9a-4dd9-92eb-41ff012941a9 service nova] Releasing lock "refresh_cache-3274203b-a985-4f28-9b45-3f83509ae782" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 18:45:48 user nova-compute[75216]: DEBUG nova.compute.manager [req-f2e531ff-13e5-465e-a1fa-3750fdb10496 req-553417ce-db9a-4dd9-92eb-41ff012941a9 service nova] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Received event network-changed-5c412896-2c62-4248-a888-9b0612378259 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:45:48 user nova-compute[75216]: DEBUG nova.compute.manager [req-f2e531ff-13e5-465e-a1fa-3750fdb10496 req-553417ce-db9a-4dd9-92eb-41ff012941a9 service nova] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Refreshing instance network info cache due to event network-changed-5c412896-2c62-4248-a888-9b0612378259. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 18:45:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-f2e531ff-13e5-465e-a1fa-3750fdb10496 req-553417ce-db9a-4dd9-92eb-41ff012941a9 service nova] Acquiring lock "refresh_cache-78605259-17bf-47da-86de-3c76ac1c5bfa" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 18:45:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-f2e531ff-13e5-465e-a1fa-3750fdb10496 req-553417ce-db9a-4dd9-92eb-41ff012941a9 service nova] Acquired lock "refresh_cache-78605259-17bf-47da-86de-3c76ac1c5bfa" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 18:45:48 user nova-compute[75216]: DEBUG nova.network.neutron [req-f2e531ff-13e5-465e-a1fa-3750fdb10496 req-553417ce-db9a-4dd9-92eb-41ff012941a9 service nova] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Refreshing network info cache for port 5c412896-2c62-4248-a888-9b0612378259 {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 18:45:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Acquired lock "refresh_cache-3274203b-a985-4f28-9b45-3f83509ae782" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 18:45:48 user nova-compute[75216]: DEBUG nova.network.neutron [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] Building network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 18:45:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-1eb91b5c-2b39-4aaa-9e19-cc7813574ff3 tempest-VolumesActionsTest-586345736 tempest-VolumesActionsTest-586345736-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json" returned: 0 in 0.215s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:45:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1eb91b5c-2b39-4aaa-9e19-cc7813574ff3 tempest-VolumesActionsTest-586345736 tempest-VolumesActionsTest-586345736-project-member] Acquiring lock "88c50a45bec9d6b0427462b3242b9b8e5f49c2b6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:45:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1eb91b5c-2b39-4aaa-9e19-cc7813574ff3 tempest-VolumesActionsTest-586345736 tempest-VolumesActionsTest-586345736-project-member] Lock "88c50a45bec9d6b0427462b3242b9b8e5f49c2b6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:45:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-1eb91b5c-2b39-4aaa-9e19-cc7813574ff3 tempest-VolumesActionsTest-586345736 tempest-VolumesActionsTest-586345736-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:45:48 user nova-compute[75216]: DEBUG nova.network.neutron [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] Instance cache missing network info. {{(pid=75216) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 18:45:48 user nova-compute[75216]: DEBUG nova.network.neutron [req-f2e531ff-13e5-465e-a1fa-3750fdb10496 req-553417ce-db9a-4dd9-92eb-41ff012941a9 service nova] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Instance cache missing network info. {{(pid=75216) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 18:45:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-1eb91b5c-2b39-4aaa-9e19-cc7813574ff3 tempest-VolumesActionsTest-586345736 tempest-VolumesActionsTest-586345736-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json" returned: 0 in 0.169s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:45:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-1eb91b5c-2b39-4aaa-9e19-cc7813574ff3 tempest-VolumesActionsTest-586345736 tempest-VolumesActionsTest-586345736-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6,backing_fmt=raw /opt/stack/data/nova/instances/30ca36a3-ac49-44e4-a804-8940f7ef25b8/disk 1073741824 {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:45:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-1eb91b5c-2b39-4aaa-9e19-cc7813574ff3 tempest-VolumesActionsTest-586345736 tempest-VolumesActionsTest-586345736-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6,backing_fmt=raw /opt/stack/data/nova/instances/30ca36a3-ac49-44e4-a804-8940f7ef25b8/disk 1073741824" returned: 0 in 0.073s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:45:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1eb91b5c-2b39-4aaa-9e19-cc7813574ff3 tempest-VolumesActionsTest-586345736 tempest-VolumesActionsTest-586345736-project-member] Lock "88c50a45bec9d6b0427462b3242b9b8e5f49c2b6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.248s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:45:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-1eb91b5c-2b39-4aaa-9e19-cc7813574ff3 tempest-VolumesActionsTest-586345736 tempest-VolumesActionsTest-586345736-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:45:48 user nova-compute[75216]: DEBUG nova.network.neutron [None req-1eb91b5c-2b39-4aaa-9e19-cc7813574ff3 tempest-VolumesActionsTest-586345736 tempest-VolumesActionsTest-586345736-project-member] [instance: 30ca36a3-ac49-44e4-a804-8940f7ef25b8] Successfully created port: 806f1a86-b973-4d62-9ad4-a5df9de18821 {{(pid=75216) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 18:45:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-1eb91b5c-2b39-4aaa-9e19-cc7813574ff3 tempest-VolumesActionsTest-586345736 tempest-VolumesActionsTest-586345736-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json" returned: 0 in 0.224s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:45:48 user nova-compute[75216]: DEBUG nova.virt.disk.api [None req-1eb91b5c-2b39-4aaa-9e19-cc7813574ff3 tempest-VolumesActionsTest-586345736 tempest-VolumesActionsTest-586345736-project-member] Checking if we can resize image /opt/stack/data/nova/instances/30ca36a3-ac49-44e4-a804-8940f7ef25b8/disk. size=1073741824 {{(pid=75216) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 18:45:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-1eb91b5c-2b39-4aaa-9e19-cc7813574ff3 tempest-VolumesActionsTest-586345736 tempest-VolumesActionsTest-586345736-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30ca36a3-ac49-44e4-a804-8940f7ef25b8/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:45:48 user nova-compute[75216]: DEBUG nova.network.neutron [req-f2e531ff-13e5-465e-a1fa-3750fdb10496 req-553417ce-db9a-4dd9-92eb-41ff012941a9 service nova] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Updating instance_info_cache with network_info: [] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 18:45:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-f2e531ff-13e5-465e-a1fa-3750fdb10496 req-553417ce-db9a-4dd9-92eb-41ff012941a9 service nova] Releasing lock "refresh_cache-78605259-17bf-47da-86de-3c76ac1c5bfa" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 18:45:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-1eb91b5c-2b39-4aaa-9e19-cc7813574ff3 tempest-VolumesActionsTest-586345736 tempest-VolumesActionsTest-586345736-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30ca36a3-ac49-44e4-a804-8940f7ef25b8/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:45:48 user nova-compute[75216]: DEBUG nova.virt.disk.api [None req-1eb91b5c-2b39-4aaa-9e19-cc7813574ff3 tempest-VolumesActionsTest-586345736 tempest-VolumesActionsTest-586345736-project-member] Cannot resize image /opt/stack/data/nova/instances/30ca36a3-ac49-44e4-a804-8940f7ef25b8/disk to a smaller size. {{(pid=75216) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 18:45:48 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-1eb91b5c-2b39-4aaa-9e19-cc7813574ff3 tempest-VolumesActionsTest-586345736 tempest-VolumesActionsTest-586345736-project-member] [instance: 30ca36a3-ac49-44e4-a804-8940f7ef25b8] Created local disks {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 18:45:48 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-1eb91b5c-2b39-4aaa-9e19-cc7813574ff3 tempest-VolumesActionsTest-586345736 tempest-VolumesActionsTest-586345736-project-member] [instance: 30ca36a3-ac49-44e4-a804-8940f7ef25b8] Ensure instance console log exists: /opt/stack/data/nova/instances/30ca36a3-ac49-44e4-a804-8940f7ef25b8/console.log {{(pid=75216) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 18:45:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1eb91b5c-2b39-4aaa-9e19-cc7813574ff3 tempest-VolumesActionsTest-586345736 tempest-VolumesActionsTest-586345736-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:45:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1eb91b5c-2b39-4aaa-9e19-cc7813574ff3 tempest-VolumesActionsTest-586345736 tempest-VolumesActionsTest-586345736-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:45:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1eb91b5c-2b39-4aaa-9e19-cc7813574ff3 tempest-VolumesActionsTest-586345736 tempest-VolumesActionsTest-586345736-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:45:48 user nova-compute[75216]: DEBUG nova.compute.manager [req-46a1ea65-98b7-4471-9a05-f832cc2b949e req-1b01760c-6b71-44db-addd-b3ca8a256ae9 service nova] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Received event network-changed-e4e34ea8-fb99-4a0e-8b65-a93933cc7d6b {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:45:48 user nova-compute[75216]: DEBUG nova.compute.manager [req-46a1ea65-98b7-4471-9a05-f832cc2b949e req-1b01760c-6b71-44db-addd-b3ca8a256ae9 service nova] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Refreshing instance network info cache due to event network-changed-e4e34ea8-fb99-4a0e-8b65-a93933cc7d6b. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 18:45:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-46a1ea65-98b7-4471-9a05-f832cc2b949e req-1b01760c-6b71-44db-addd-b3ca8a256ae9 service nova] Acquiring lock "refresh_cache-78605259-17bf-47da-86de-3c76ac1c5bfa" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 18:45:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-46a1ea65-98b7-4471-9a05-f832cc2b949e req-1b01760c-6b71-44db-addd-b3ca8a256ae9 service nova] Acquired lock "refresh_cache-78605259-17bf-47da-86de-3c76ac1c5bfa" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 18:45:48 user nova-compute[75216]: DEBUG nova.network.neutron [req-46a1ea65-98b7-4471-9a05-f832cc2b949e req-1b01760c-6b71-44db-addd-b3ca8a256ae9 service nova] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Refreshing network info cache for port e4e34ea8-fb99-4a0e-8b65-a93933cc7d6b {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 18:45:49 user nova-compute[75216]: DEBUG nova.network.neutron [req-46a1ea65-98b7-4471-9a05-f832cc2b949e req-1b01760c-6b71-44db-addd-b3ca8a256ae9 service nova] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Instance cache missing network info. {{(pid=75216) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 18:45:49 user nova-compute[75216]: DEBUG nova.network.neutron [None req-1eb91b5c-2b39-4aaa-9e19-cc7813574ff3 tempest-VolumesActionsTest-586345736 tempest-VolumesActionsTest-586345736-project-member] [instance: 30ca36a3-ac49-44e4-a804-8940f7ef25b8] Successfully updated port: 806f1a86-b973-4d62-9ad4-a5df9de18821 {{(pid=75216) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 18:45:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1eb91b5c-2b39-4aaa-9e19-cc7813574ff3 tempest-VolumesActionsTest-586345736 tempest-VolumesActionsTest-586345736-project-member] Acquiring lock "refresh_cache-30ca36a3-ac49-44e4-a804-8940f7ef25b8" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 18:45:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1eb91b5c-2b39-4aaa-9e19-cc7813574ff3 tempest-VolumesActionsTest-586345736 tempest-VolumesActionsTest-586345736-project-member] Acquired lock "refresh_cache-30ca36a3-ac49-44e4-a804-8940f7ef25b8" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 18:45:49 user nova-compute[75216]: DEBUG nova.network.neutron [None req-1eb91b5c-2b39-4aaa-9e19-cc7813574ff3 tempest-VolumesActionsTest-586345736 tempest-VolumesActionsTest-586345736-project-member] [instance: 30ca36a3-ac49-44e4-a804-8940f7ef25b8] Building network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 18:45:49 user nova-compute[75216]: DEBUG nova.compute.manager [req-024d46e3-0f73-4e73-b123-f23569ae29f6 req-49e99aed-b028-4b20-8a82-748e8abfa05a service nova] [instance: 872856e5-cdc4-444e-8835-55e36708d776] Received event network-vif-plugged-296cb77a-c087-4484-adf2-7fd703942e0d {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:45:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-024d46e3-0f73-4e73-b123-f23569ae29f6 req-49e99aed-b028-4b20-8a82-748e8abfa05a service nova] Acquiring lock "872856e5-cdc4-444e-8835-55e36708d776-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:45:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-024d46e3-0f73-4e73-b123-f23569ae29f6 req-49e99aed-b028-4b20-8a82-748e8abfa05a service nova] Lock "872856e5-cdc4-444e-8835-55e36708d776-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:45:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-024d46e3-0f73-4e73-b123-f23569ae29f6 req-49e99aed-b028-4b20-8a82-748e8abfa05a service nova] Lock "872856e5-cdc4-444e-8835-55e36708d776-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:45:49 user nova-compute[75216]: DEBUG nova.compute.manager [req-024d46e3-0f73-4e73-b123-f23569ae29f6 req-49e99aed-b028-4b20-8a82-748e8abfa05a service nova] [instance: 872856e5-cdc4-444e-8835-55e36708d776] No waiting events found dispatching network-vif-plugged-296cb77a-c087-4484-adf2-7fd703942e0d {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:45:49 user nova-compute[75216]: WARNING nova.compute.manager [req-024d46e3-0f73-4e73-b123-f23569ae29f6 req-49e99aed-b028-4b20-8a82-748e8abfa05a service nova] [instance: 872856e5-cdc4-444e-8835-55e36708d776] Received unexpected event network-vif-plugged-296cb77a-c087-4484-adf2-7fd703942e0d for instance with vm_state active and task_state None.
Nov 13 18:45:49 user nova-compute[75216]: DEBUG nova.network.neutron [None req-1eb91b5c-2b39-4aaa-9e19-cc7813574ff3 tempest-VolumesActionsTest-586345736 tempest-VolumesActionsTest-586345736-project-member] [instance: 30ca36a3-ac49-44e4-a804-8940f7ef25b8] Instance cache missing network info. {{(pid=75216) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 18:45:49 user nova-compute[75216]: DEBUG nova.network.neutron [req-46a1ea65-98b7-4471-9a05-f832cc2b949e req-1b01760c-6b71-44db-addd-b3ca8a256ae9 service nova] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Updating instance_info_cache with network_info: [] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 18:45:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-46a1ea65-98b7-4471-9a05-f832cc2b949e req-1b01760c-6b71-44db-addd-b3ca8a256ae9 service nova] Releasing lock "refresh_cache-78605259-17bf-47da-86de-3c76ac1c5bfa" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 18:45:49 user nova-compute[75216]: DEBUG nova.network.neutron [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Successfully updated port: 7b6ed148-b7c9-479b-9e2d-cfc0c3f6f93a {{(pid=75216) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 18:45:49 user nova-compute[75216]: INFO nova.virt.block_device [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Booting with volume e823c6a1-f7e2-495f-a5dc-6fdfd2b19cf0 at /dev/vdc
Nov 13 18:45:49 user nova-compute[75216]: DEBUG nova.network.neutron [None req-1eb91b5c-2b39-4aaa-9e19-cc7813574ff3 tempest-VolumesActionsTest-586345736 tempest-VolumesActionsTest-586345736-project-member] [instance: 30ca36a3-ac49-44e4-a804-8940f7ef25b8] Updating instance_info_cache with network_info: [{"id": "806f1a86-b973-4d62-9ad4-a5df9de18821", "address": "fa:16:3e:c9:a0:08", "network": {"id": "bcfd8798-68b4-454a-a3ad-9cad0d42ad8e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1666293979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "986d2e55aab34f7e8e09b9619c492b10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap806f1a86-b9", "ovs_interfaceid": "806f1a86-b973-4d62-9ad4-a5df9de18821", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 18:45:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1eb91b5c-2b39-4aaa-9e19-cc7813574ff3 tempest-VolumesActionsTest-586345736 tempest-VolumesActionsTest-586345736-project-member] Releasing lock "refresh_cache-30ca36a3-ac49-44e4-a804-8940f7ef25b8" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 18:45:49 user nova-compute[75216]: DEBUG nova.compute.manager [None req-1eb91b5c-2b39-4aaa-9e19-cc7813574ff3 tempest-VolumesActionsTest-586345736 tempest-VolumesActionsTest-586345736-project-member] [instance: 30ca36a3-ac49-44e4-a804-8940f7ef25b8] Instance network_info: |[{"id": "806f1a86-b973-4d62-9ad4-a5df9de18821", "address": "fa:16:3e:c9:a0:08", "network": {"id": "bcfd8798-68b4-454a-a3ad-9cad0d42ad8e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1666293979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "986d2e55aab34f7e8e09b9619c492b10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap806f1a86-b9", "ovs_interfaceid": "806f1a86-b973-4d62-9ad4-a5df9de18821", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 18:45:49 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-1eb91b5c-2b39-4aaa-9e19-cc7813574ff3 tempest-VolumesActionsTest-586345736 tempest-VolumesActionsTest-586345736-project-member] [instance: 30ca36a3-ac49-44e4-a804-8940f7ef25b8] Start _get_guest_xml network_info=[{"id": "806f1a86-b973-4d62-9ad4-a5df9de18821", "address": "fa:16:3e:c9:a0:08", "network": {"id": "bcfd8798-68b4-454a-a3ad-9cad0d42ad8e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1666293979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "986d2e55aab34f7e8e09b9619c492b10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap806f1a86-b9", "ovs_interfaceid": "806f1a86-b973-4d62-9ad4-a5df9de18821", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T18:41:06Z,direct_url=<?>,disk_format='qcow2',id=77bcb5ba-8510-41ec-a88d-96097bb431de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c465b7c26ec44582b6d1b7169536ecc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T18:41:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'guest_format': None, 'boot_index': 0, 'image_id': '77bcb5ba-8510-41ec-a88d-96097bb431de'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 18:45:49 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-1eb91b5c-2b39-4aaa-9e19-cc7813574ff3 tempest-VolumesActionsTest-586345736 tempest-VolumesActionsTest-586345736-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 18:45:49 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-1eb91b5c-2b39-4aaa-9e19-cc7813574ff3 tempest-VolumesActionsTest-586345736 tempest-VolumesActionsTest-586345736-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 18:45:49 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-1eb91b5c-2b39-4aaa-9e19-cc7813574ff3 tempest-VolumesActionsTest-586345736 tempest-VolumesActionsTest-586345736-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 18:45:49 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-1eb91b5c-2b39-4aaa-9e19-cc7813574ff3 tempest-VolumesActionsTest-586345736 tempest-VolumesActionsTest-586345736-project-member] CPU controller missing on host. {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 18:45:49 user nova-compute[75216]: DEBUG os_brick.utils [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 18:45:49 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-1eb91b5c-2b39-4aaa-9e19-cc7813574ff3 tempest-VolumesActionsTest-586345736 tempest-VolumesActionsTest-586345736-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 18:45:49 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-1eb91b5c-2b39-4aaa-9e19-cc7813574ff3 tempest-VolumesActionsTest-586345736 tempest-VolumesActionsTest-586345736-project-member] CPU controller found on host. {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 18:45:49 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-1eb91b5c-2b39-4aaa-9e19-cc7813574ff3 tempest-VolumesActionsTest-586345736 tempest-VolumesActionsTest-586345736-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75216) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 18:45:49 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-1eb91b5c-2b39-4aaa-9e19-cc7813574ff3 tempest-VolumesActionsTest-586345736 tempest-VolumesActionsTest-586345736-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T18:40:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T18:41:06Z,direct_url=<?>,disk_format='qcow2',id=77bcb5ba-8510-41ec-a88d-96097bb431de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c465b7c26ec44582b6d1b7169536ecc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T18:41:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 18:45:49 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-1eb91b5c-2b39-4aaa-9e19-cc7813574ff3 tempest-VolumesActionsTest-586345736 tempest-VolumesActionsTest-586345736-project-member] Flavor limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 18:45:49 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-1eb91b5c-2b39-4aaa-9e19-cc7813574ff3 tempest-VolumesActionsTest-586345736 tempest-VolumesActionsTest-586345736-project-member] Image limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 18:45:49 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-1eb91b5c-2b39-4aaa-9e19-cc7813574ff3 tempest-VolumesActionsTest-586345736 tempest-VolumesActionsTest-586345736-project-member] Flavor pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 18:45:49 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-1eb91b5c-2b39-4aaa-9e19-cc7813574ff3 tempest-VolumesActionsTest-586345736 tempest-VolumesActionsTest-586345736-project-member] Image pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 18:45:49 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-1eb91b5c-2b39-4aaa-9e19-cc7813574ff3 tempest-VolumesActionsTest-586345736 tempest-VolumesActionsTest-586345736-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 18:45:49 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-1eb91b5c-2b39-4aaa-9e19-cc7813574ff3 tempest-VolumesActionsTest-586345736 tempest-VolumesActionsTest-586345736-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 18:45:49 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-1eb91b5c-2b39-4aaa-9e19-cc7813574ff3 tempest-VolumesActionsTest-586345736 tempest-VolumesActionsTest-586345736-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 18:45:49 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-1eb91b5c-2b39-4aaa-9e19-cc7813574ff3 tempest-VolumesActionsTest-586345736 tempest-VolumesActionsTest-586345736-project-member] Got 1 possible topologies {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 18:45:49 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-1eb91b5c-2b39-4aaa-9e19-cc7813574ff3 tempest-VolumesActionsTest-586345736 tempest-VolumesActionsTest-586345736-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 18:45:49 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-1eb91b5c-2b39-4aaa-9e19-cc7813574ff3 tempest-VolumesActionsTest-586345736 tempest-VolumesActionsTest-586345736-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 18:45:49 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-1eb91b5c-2b39-4aaa-9e19-cc7813574ff3 tempest-VolumesActionsTest-586345736 tempest-VolumesActionsTest-586345736-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T18:45:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-691647798',display_name='tempest-VolumesActionsTest-instance-691647798',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-691647798',id=11,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='986d2e55aab34f7e8e09b9619c492b10',ramdisk_id='',reservation_id='r-3r111o7r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-586345736',owner_user_name='tempest-VolumesActionsTest-586345736-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T18:45:48Z,user_data=None,user_id='838f3474d7d84930959d11f51fa03e17',uuid=30ca36a3-ac49-44e4-a804-8940f7ef25b8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "806f1a86-b973-4d62-9ad4-a5df9de18821", "address": "fa:16:3e:c9:a0:08", "network": {"id": "bcfd8798-68b4-454a-a3ad-9cad0d42ad8e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1666293979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "986d2e55aab34f7e8e09b9619c492b10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap806f1a86-b9", "ovs_interfaceid": "806f1a86-b973-4d62-9ad4-a5df9de18821", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75216) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 18:45:49 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-1eb91b5c-2b39-4aaa-9e19-cc7813574ff3 tempest-VolumesActionsTest-586345736 tempest-VolumesActionsTest-586345736-project-member] Converting VIF {"id": "806f1a86-b973-4d62-9ad4-a5df9de18821", "address": "fa:16:3e:c9:a0:08", "network": {"id": "bcfd8798-68b4-454a-a3ad-9cad0d42ad8e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1666293979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "986d2e55aab34f7e8e09b9619c492b10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap806f1a86-b9", "ovs_interfaceid": "806f1a86-b973-4d62-9ad4-a5df9de18821", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 18:45:49 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-1eb91b5c-2b39-4aaa-9e19-cc7813574ff3 tempest-VolumesActionsTest-586345736 tempest-VolumesActionsTest-586345736-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:a0:08,bridge_name='br-int',has_traffic_filtering=True,id=806f1a86-b973-4d62-9ad4-a5df9de18821,network=Network(bcfd8798-68b4-454a-a3ad-9cad0d42ad8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap806f1a86-b9') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 18:45:49 user nova-compute[75216]: DEBUG nova.objects.instance [None req-1eb91b5c-2b39-4aaa-9e19-cc7813574ff3 tempest-VolumesActionsTest-586345736 tempest-VolumesActionsTest-586345736-project-member] Lazy-loading 'pci_devices' on Instance uuid 30ca36a3-ac49-44e4-a804-8940f7ef25b8 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 18:45:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:45:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:45:49 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b4dbc72-29ee-467b-a576-4533f7840d0f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aea6fcfe14b9\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:45:49 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-1eb91b5c-2b39-4aaa-9e19-cc7813574ff3 tempest-VolumesActionsTest-586345736 tempest-VolumesActionsTest-586345736-project-member] [instance: 30ca36a3-ac49-44e4-a804-8940f7ef25b8] End _get_guest_xml xml=<domain type="kvm">
Nov 13 18:45:49 user nova-compute[75216]:   <uuid>30ca36a3-ac49-44e4-a804-8940f7ef25b8</uuid>
Nov 13 18:45:49 user nova-compute[75216]:   <name>instance-0000000b</name>
Nov 13 18:45:49 user nova-compute[75216]:   <memory>524288</memory>
Nov 13 18:45:49 user nova-compute[75216]:   <vcpu>1</vcpu>
Nov 13 18:45:49 user nova-compute[75216]:   <metadata>
Nov 13 18:45:49 user nova-compute[75216]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 18:45:49 user nova-compute[75216]:       <nova:package version="0.0.0"/>
Nov 13 18:45:49 user nova-compute[75216]:       <nova:name>tempest-VolumesActionsTest-instance-691647798</nova:name>
Nov 13 18:45:49 user nova-compute[75216]:       <nova:creationTime>2023-11-13 18:45:49</nova:creationTime>
Nov 13 18:45:49 user nova-compute[75216]:       <nova:flavor name="m1.tiny">
Nov 13 18:45:49 user nova-compute[75216]:         <nova:memory>512</nova:memory>
Nov 13 18:45:49 user nova-compute[75216]:         <nova:disk>1</nova:disk>
Nov 13 18:45:49 user nova-compute[75216]:         <nova:swap>0</nova:swap>
Nov 13 18:45:49 user nova-compute[75216]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 18:45:49 user nova-compute[75216]:         <nova:vcpus>1</nova:vcpus>
Nov 13 18:45:49 user nova-compute[75216]:       </nova:flavor>
Nov 13 18:45:49 user nova-compute[75216]:       <nova:owner>
Nov 13 18:45:49 user nova-compute[75216]:         <nova:user uuid="838f3474d7d84930959d11f51fa03e17">tempest-VolumesActionsTest-586345736-project-member</nova:user>
Nov 13 18:45:49 user nova-compute[75216]:         <nova:project uuid="986d2e55aab34f7e8e09b9619c492b10">tempest-VolumesActionsTest-586345736</nova:project>
Nov 13 18:45:49 user nova-compute[75216]:       </nova:owner>
Nov 13 18:45:49 user nova-compute[75216]:       <nova:root type="image" uuid="77bcb5ba-8510-41ec-a88d-96097bb431de"/>
Nov 13 18:45:49 user nova-compute[75216]:       <nova:ports>
Nov 13 18:45:49 user nova-compute[75216]:         <nova:port uuid="806f1a86-b973-4d62-9ad4-a5df9de18821">
Nov 13 18:45:49 user nova-compute[75216]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 13 18:45:49 user nova-compute[75216]:         </nova:port>
Nov 13 18:45:49 user nova-compute[75216]:       </nova:ports>
Nov 13 18:45:49 user nova-compute[75216]:     </nova:instance>
Nov 13 18:45:49 user nova-compute[75216]:   </metadata>
Nov 13 18:45:49 user nova-compute[75216]:   <sysinfo type="smbios">
Nov 13 18:45:49 user nova-compute[75216]:     <system>
Nov 13 18:45:49 user nova-compute[75216]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 18:45:49 user nova-compute[75216]:       <entry name="product">OpenStack Nova</entry>
Nov 13 18:45:49 user nova-compute[75216]:       <entry name="version">0.0.0</entry>
Nov 13 18:45:49 user nova-compute[75216]:       <entry name="serial">30ca36a3-ac49-44e4-a804-8940f7ef25b8</entry>
Nov 13 18:45:49 user nova-compute[75216]:       <entry name="uuid">30ca36a3-ac49-44e4-a804-8940f7ef25b8</entry>
Nov 13 18:45:49 user nova-compute[75216]:       <entry name="family">Virtual Machine</entry>
Nov 13 18:45:49 user nova-compute[75216]:     </system>
Nov 13 18:45:49 user nova-compute[75216]:   </sysinfo>
Nov 13 18:45:49 user nova-compute[75216]:   <os>
Nov 13 18:45:49 user nova-compute[75216]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 18:45:49 user nova-compute[75216]:     <boot dev="hd"/>
Nov 13 18:45:49 user nova-compute[75216]:     <smbios mode="sysinfo"/>
Nov 13 18:45:49 user nova-compute[75216]:   </os>
Nov 13 18:45:49 user nova-compute[75216]:   <features>
Nov 13 18:45:49 user nova-compute[75216]:     <acpi/>
Nov 13 18:45:49 user nova-compute[75216]:     <apic/>
Nov 13 18:45:49 user nova-compute[75216]:     <vmcoreinfo/>
Nov 13 18:45:49 user nova-compute[75216]:   </features>
Nov 13 18:45:49 user nova-compute[75216]:   <clock offset="utc">
Nov 13 18:45:49 user nova-compute[75216]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 18:45:49 user nova-compute[75216]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 18:45:49 user nova-compute[75216]:     <timer name="hpet" present="no"/>
Nov 13 18:45:49 user nova-compute[75216]:   </clock>
Nov 13 18:45:49 user nova-compute[75216]:   <cpu mode="custom" match="exact">
Nov 13 18:45:49 user nova-compute[75216]:     <model>Nehalem</model>
Nov 13 18:45:49 user nova-compute[75216]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 18:45:49 user nova-compute[75216]:   </cpu>
Nov 13 18:45:49 user nova-compute[75216]:   <devices>
Nov 13 18:45:49 user nova-compute[75216]:     <disk type="file" device="disk">
Nov 13 18:45:49 user nova-compute[75216]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 18:45:49 user nova-compute[75216]:       <source file="/opt/stack/data/nova/instances/30ca36a3-ac49-44e4-a804-8940f7ef25b8/disk"/>
Nov 13 18:45:49 user nova-compute[75216]:       <target dev="vda" bus="virtio"/>
Nov 13 18:45:49 user nova-compute[75216]:     </disk>
Nov 13 18:45:49 user nova-compute[75216]:     <interface type="ethernet">
Nov 13 18:45:49 user nova-compute[75216]:       <mac address="fa:16:3e:c9:a0:08"/>
Nov 13 18:45:49 user nova-compute[75216]:       <model type="virtio"/>
Nov 13 18:45:49 user nova-compute[75216]:       <mtu size="1442"/>
Nov 13 18:45:49 user nova-compute[75216]:       <target dev="tap806f1a86-b9"/>
Nov 13 18:45:49 user nova-compute[75216]:     </interface>
Nov 13 18:45:49 user nova-compute[75216]:     <serial type="pty">
Nov 13 18:45:49 user nova-compute[75216]:       <log file="/opt/stack/data/nova/instances/30ca36a3-ac49-44e4-a804-8940f7ef25b8/console.log" append="off"/>
Nov 13 18:45:49 user nova-compute[75216]:     </serial>
Nov 13 18:45:49 user nova-compute[75216]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 18:45:49 user nova-compute[75216]:     <video>
Nov 13 18:45:49 user nova-compute[75216]:       <model type="virtio"/>
Nov 13 18:45:49 user nova-compute[75216]:     </video>
Nov 13 18:45:49 user nova-compute[75216]:     <rng model="virtio">
Nov 13 18:45:49 user nova-compute[75216]:       <backend model="random">/dev/urandom</backend>
Nov 13 18:45:49 user nova-compute[75216]:     </rng>
Nov 13 18:45:49 user nova-compute[75216]:     <controller type="usb" index="0" model="none"/>
Nov 13 18:45:49 user nova-compute[75216]:     <memballoon model="virtio">
Nov 13 18:45:49 user nova-compute[75216]:       <stats period="10"/>
Nov 13 18:45:49 user nova-compute[75216]:     </memballoon>
Nov 13 18:45:49 user nova-compute[75216]:   </devices>
Nov 13 18:45:49 user nova-compute[75216]: </domain>
Nov 13 18:45:49 user nova-compute[75216]:  {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 18:45:49 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-1eb91b5c-2b39-4aaa-9e19-cc7813574ff3 tempest-VolumesActionsTest-586345736 tempest-VolumesActionsTest-586345736-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T18:45:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-691647798',display_name='tempest-VolumesActionsTest-instance-691647798',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-691647798',id=11,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='986d2e55aab34f7e8e09b9619c492b10',ramdisk_id='',reservation_id='r-3r111o7r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-586345736',owner_user_name='tempest-VolumesActionsTest-586345736-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T18:45:48Z,user_data=None,user_id='838f3474d7d84930959d11f51fa03e17',uuid=30ca36a3-ac49-44e4-a804-8940f7ef25b8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "806f1a86-b973-4d62-9ad4-a5df9de18821", "address": "fa:16:3e:c9:a0:08", "network": {"id": "bcfd8798-68b4-454a-a3ad-9cad0d42ad8e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1666293979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "986d2e55aab34f7e8e09b9619c492b10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap806f1a86-b9", "ovs_interfaceid": "806f1a86-b973-4d62-9ad4-a5df9de18821", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 18:45:49 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-1eb91b5c-2b39-4aaa-9e19-cc7813574ff3 tempest-VolumesActionsTest-586345736 tempest-VolumesActionsTest-586345736-project-member] Converting VIF {"id": "806f1a86-b973-4d62-9ad4-a5df9de18821", "address": "fa:16:3e:c9:a0:08", "network": {"id": "bcfd8798-68b4-454a-a3ad-9cad0d42ad8e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1666293979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "986d2e55aab34f7e8e09b9619c492b10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap806f1a86-b9", "ovs_interfaceid": "806f1a86-b973-4d62-9ad4-a5df9de18821", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 18:45:49 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-1eb91b5c-2b39-4aaa-9e19-cc7813574ff3 tempest-VolumesActionsTest-586345736 tempest-VolumesActionsTest-586345736-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:a0:08,bridge_name='br-int',has_traffic_filtering=True,id=806f1a86-b973-4d62-9ad4-a5df9de18821,network=Network(bcfd8798-68b4-454a-a3ad-9cad0d42ad8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap806f1a86-b9') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 18:45:49 user nova-compute[75216]: DEBUG os_vif [None req-1eb91b5c-2b39-4aaa-9e19-cc7813574ff3 tempest-VolumesActionsTest-586345736 tempest-VolumesActionsTest-586345736-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:a0:08,bridge_name='br-int',has_traffic_filtering=True,id=806f1a86-b973-4d62-9ad4-a5df9de18821,network=Network(bcfd8798-68b4-454a-a3ad-9cad0d42ad8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap806f1a86-b9') {{(pid=75216) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 18:45:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:45:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:45:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 18:45:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:45:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:45:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1eafef1e-dad3-5091-ac32-6a7a5f81961a', '_type': 'linux-noop'}}, row=False) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:45:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:45:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:45:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:45:49 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a88ef6d-c03e-4dc7-9c63-7af3701058f5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:45:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:45:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:45:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap806f1a86-b9, may_exist=True, interface_attrs={}) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:45:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap806f1a86-b9, col_values=(('qos', UUID('33efe44a-9ff9-4e24-bd4b-5bcc75cf650c')),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:45:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap806f1a86-b9, col_values=(('external_ids', {'iface-id': '806f1a86-b973-4d62-9ad4-a5df9de18821', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c9:a0:08', 'vm-uuid': '30ca36a3-ac49-44e4-a804-8940f7ef25b8'}),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:45:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:45:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:45:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:45:49 user nova-compute[75216]: INFO os_vif [None req-1eb91b5c-2b39-4aaa-9e19-cc7813574ff3 tempest-VolumesActionsTest-586345736 tempest-VolumesActionsTest-586345736-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:a0:08,bridge_name='br-int',has_traffic_filtering=True,id=806f1a86-b973-4d62-9ad4-a5df9de18821,network=Network(bcfd8798-68b4-454a-a3ad-9cad0d42ad8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap806f1a86-b9')
Nov 13 18:45:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:45:49 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[21c1d6f0-5ad2-477b-a4e9-29d81b282131]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:45:49 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b916fbf-39f8-4eed-b923-a59b4ef2bb5b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:45:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Running cmd (subprocess): nvme version {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:45:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] 'nvme version' failed. Not Retrying. {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 18:45:49 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] nvme not present on system {{(pid=75216) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 18:45:50 user nova-compute[75216]: DEBUG nova.compute.manager [req-961a4bd8-1c06-4fb1-8898-156fa5f611be req-98b1d15e-1613-449d-bd89-46d7d0898216 service nova] [instance: 30ca36a3-ac49-44e4-a804-8940f7ef25b8] Received event network-changed-806f1a86-b973-4d62-9ad4-a5df9de18821 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:45:50 user nova-compute[75216]: DEBUG nova.compute.manager [req-961a4bd8-1c06-4fb1-8898-156fa5f611be req-98b1d15e-1613-449d-bd89-46d7d0898216 service nova] [instance: 30ca36a3-ac49-44e4-a804-8940f7ef25b8] Refreshing instance network info cache due to event network-changed-806f1a86-b973-4d62-9ad4-a5df9de18821. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 18:45:50 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-961a4bd8-1c06-4fb1-8898-156fa5f611be req-98b1d15e-1613-449d-bd89-46d7d0898216 service nova] Acquiring lock "refresh_cache-30ca36a3-ac49-44e4-a804-8940f7ef25b8" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 18:45:50 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-961a4bd8-1c06-4fb1-8898-156fa5f611be req-98b1d15e-1613-449d-bd89-46d7d0898216 service nova] Acquired lock "refresh_cache-30ca36a3-ac49-44e4-a804-8940f7ef25b8" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 18:45:50 user nova-compute[75216]: DEBUG nova.network.neutron [req-961a4bd8-1c06-4fb1-8898-156fa5f611be req-98b1d15e-1613-449d-bd89-46d7d0898216 service nova] [instance: 30ca36a3-ac49-44e4-a804-8940f7ef25b8] Refreshing network info cache for port 806f1a86-b973-4d62-9ad4-a5df9de18821 {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 18:45:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:45:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 18:45:50 user nova-compute[75216]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 18:45:50 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[c96c1fde-1b1c-449e-ba55-1383f89dc667]: (4, '') {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:45:50 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75216) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 18:45:50 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 18:45:50 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] LIGHTOS: no hostnqn found. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 18:45:50 user nova-compute[75216]: DEBUG os_brick.utils [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] <== get_connector_properties: return (211ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aea6fcfe14b9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 18:45:50 user nova-compute[75216]: DEBUG nova.virt.block_device [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Updating existing volume attachment record: f79d4cf0-74bc-4ad8-b117-435a2f5f0670 {{(pid=75216) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 18:45:50 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-1eb91b5c-2b39-4aaa-9e19-cc7813574ff3 tempest-VolumesActionsTest-586345736 tempest-VolumesActionsTest-586345736-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 18:45:50 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-1eb91b5c-2b39-4aaa-9e19-cc7813574ff3 tempest-VolumesActionsTest-586345736 tempest-VolumesActionsTest-586345736-project-member] No VIF found with MAC fa:16:3e:c9:a0:08, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 18:45:50 user nova-compute[75216]: DEBUG nova.network.neutron [req-961a4bd8-1c06-4fb1-8898-156fa5f611be req-98b1d15e-1613-449d-bd89-46d7d0898216 service nova] [instance: 30ca36a3-ac49-44e4-a804-8940f7ef25b8] Updated VIF entry in instance network info cache for port 806f1a86-b973-4d62-9ad4-a5df9de18821. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 18:45:50 user nova-compute[75216]: DEBUG nova.network.neutron [req-961a4bd8-1c06-4fb1-8898-156fa5f611be req-98b1d15e-1613-449d-bd89-46d7d0898216 service nova] [instance: 30ca36a3-ac49-44e4-a804-8940f7ef25b8] Updating instance_info_cache with network_info: [{"id": "806f1a86-b973-4d62-9ad4-a5df9de18821", "address": "fa:16:3e:c9:a0:08", "network": {"id": "bcfd8798-68b4-454a-a3ad-9cad0d42ad8e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1666293979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "986d2e55aab34f7e8e09b9619c492b10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap806f1a86-b9", "ovs_interfaceid": "806f1a86-b973-4d62-9ad4-a5df9de18821", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 18:45:50 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-961a4bd8-1c06-4fb1-8898-156fa5f611be req-98b1d15e-1613-449d-bd89-46d7d0898216 service nova] Releasing lock "refresh_cache-30ca36a3-ac49-44e4-a804-8940f7ef25b8" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 18:45:50 user nova-compute[75216]: DEBUG nova.network.neutron [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Successfully updated port: 815d1175-2997-4d74-8f35-7ca982cf46aa {{(pid=75216) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 18:45:50 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Acquiring lock "refresh_cache-78605259-17bf-47da-86de-3c76ac1c5bfa" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 18:45:50 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Acquired lock "refresh_cache-78605259-17bf-47da-86de-3c76ac1c5bfa" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 18:45:50 user nova-compute[75216]: DEBUG nova.network.neutron [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Building network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 18:45:50 user nova-compute[75216]: INFO nova.virt.block_device [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] Booting with volume 52f4339a-6a47-4877-b041-9c27d7be2e94 at /dev/vdc
Nov 13 18:45:50 user nova-compute[75216]: DEBUG nova.network.neutron [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Instance cache missing network info. {{(pid=75216) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 18:45:50 user nova-compute[75216]: DEBUG os_brick.utils [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 18:45:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:45:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:45:50 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[e42b9685-7f52-4b94-865d-f3395e7d1373]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aea6fcfe14b9\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:45:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:45:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.024s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:45:50 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[d72a326d-506f-4be4-9270-929e2e21ca99]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:45:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:45:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:45:50 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[c498a2db-3bcb-49d9-86d3-b4a8ade06213]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:45:50 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[2be961b3-bb26-4cee-8d1c-3a6570606f20]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:45:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Running cmd (subprocess): nvme version {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:45:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] 'nvme version' failed. Not Retrying. {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 18:45:50 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.nvmeof [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] nvme not present on system {{(pid=75216) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 18:45:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:45:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 18:45:50 user nova-compute[75216]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 18:45:50 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c752592-a895-4621-bd69-3dd54805cbbc]: (4, '') {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:45:50 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75216) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 18:45:50 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 18:45:51 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] LIGHTOS: no hostnqn found. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 18:45:51 user nova-compute[75216]: DEBUG os_brick.utils [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] <== get_connector_properties: return (162ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aea6fcfe14b9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 18:45:51 user nova-compute[75216]: DEBUG nova.virt.block_device [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] Updating existing volume attachment record: c7c0bccd-2288-4c4d-874c-52fbfe5002a2 {{(pid=75216) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 18:45:51 user nova-compute[75216]: DEBUG nova.compute.manager [req-40ca07fc-a19f-47e4-bea9-2104e2fd69d6 req-e11871c8-05a2-4d96-8e35-2ba8cc10ec68 service nova] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Received event network-changed-7b6ed148-b7c9-479b-9e2d-cfc0c3f6f93a {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:45:51 user nova-compute[75216]: DEBUG nova.compute.manager [req-40ca07fc-a19f-47e4-bea9-2104e2fd69d6 req-e11871c8-05a2-4d96-8e35-2ba8cc10ec68 service nova] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Refreshing instance network info cache due to event network-changed-7b6ed148-b7c9-479b-9e2d-cfc0c3f6f93a. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 18:45:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-40ca07fc-a19f-47e4-bea9-2104e2fd69d6 req-e11871c8-05a2-4d96-8e35-2ba8cc10ec68 service nova] Acquiring lock "refresh_cache-78605259-17bf-47da-86de-3c76ac1c5bfa" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 18:45:51 user nova-compute[75216]: DEBUG nova.network.neutron [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] Updating instance_info_cache with network_info: [{"id": "217faeb3-4474-449c-ae9f-86e555ce7cd7", "address": "fa:16:3e:49:58:83", "network": {"id": "804f3c05-e540-4bae-a58f-682133e0c762", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-619032523-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8d0f284dd8d4cc88f04a729b1d5d38c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap217faeb3-44", "ovs_interfaceid": "217faeb3-4474-449c-ae9f-86e555ce7cd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9bed3978-d90d-4b90-b798-12413ea26a48", "address": "fa:16:3e:17:08:ae", "network": {"id": "590b5147-c33a-45bd-a502-8fd41408064d", "bridge": "br-int", "label": "tempest-device-tagging-net1-904391500", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a8d0f284dd8d4cc88f04a729b1d5d38c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bed3978-d9", "ovs_interfaceid": "9bed3978-d90d-4b90-b798-12413ea26a48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "95a425c5-f994-4504-a94b-040103b2efa7", "address": "fa:16:3e:02:ea:af", "network": {"id": "590b5147-c33a-45bd-a502-8fd41408064d", "bridge": "br-int", "label": "tempest-device-tagging-net1-904391500", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.40", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a8d0f284dd8d4cc88f04a729b1d5d38c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95a425c5-f9", "ovs_interfaceid": "95a425c5-f994-4504-a94b-040103b2efa7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7aa7e71d-2c00-40fd-9d05-d108bcc807ec", "address": "fa:16:3e:73:99:8a", "network": {"id": "590b5147-c33a-45bd-a502-8fd41408064d", "bridge": "br-int", "label": "tempest-device-tagging-net1-904391500", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.98", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a8d0f284dd8d4cc88f04a729b1d5d38c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7aa7e71d-2c", "ovs_interfaceid": "7aa7e71d-2c00-40fd-9d05-d108bcc807ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "01772e53-e624-4728-beb1-929cc4165f21", "address": "fa:16:3e:a7:a0:fe", "network": {"id": "590b5147-c33a-45bd-a502-8fd41408064d", "bridge": "br-int", "label": "tempest-device-tagging-net1-904391500", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a8d0f284dd8d4cc88f04a729b1d5d38c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01772e53-e6", "ovs_interfaceid": "01772e53-e624-4728-beb1-929cc4165f21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1bb4df6f-02b2-415b-9cea-fd8a7a04874c", "address": "fa:16:3e:cb:71:3b", "network": {"id": "f82e0fd1-978f-4b08-8480-709765208ef9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1203652186", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a8d0f284dd8d4cc88f04a729b1d5d38c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bb4df6f-02", "ovs_interfaceid": "1bb4df6f-02b2-415b-9cea-fd8a7a04874c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a07efcd3-59f4-452e-8fb7-8b8233ae235f", "address": "fa:16:3e:6c:cb:eb", "network": {"id": "f82e0fd1-978f-4b08-8480-709765208ef9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1203652186", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a8d0f284dd8d4cc88f04a729b1d5d38c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa07efcd3-59", "ovs_interfaceid": "a07efcd3-59f4-452e-8fb7-8b8233ae235f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 18:45:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Releasing lock "refresh_cache-3274203b-a985-4f28-9b45-3f83509ae782" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 18:45:51 user nova-compute[75216]: DEBUG nova.compute.manager [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] Instance network_info: |[{"id": "217faeb3-4474-449c-ae9f-86e555ce7cd7", "address": "fa:16:3e:49:58:83", "network": {"id": "804f3c05-e540-4bae-a58f-682133e0c762", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-619032523-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8d0f284dd8d4cc88f04a729b1d5d38c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap217faeb3-44", "ovs_interfaceid": "217faeb3-4474-449c-ae9f-86e555ce7cd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9bed3978-d90d-4b90-b798-12413ea26a48", "address": "fa:16:3e:17:08:ae", "network": {"id": "590b5147-c33a-45bd-a502-8fd41408064d", "bridge": "br-int", "label": "tempest-device-tagging-net1-904391500", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a8d0f284dd8d4cc88f04a729b1d5d38c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bed3978-d9", "ovs_interfaceid": "9bed3978-d90d-4b90-b798-12413ea26a48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "95a425c5-f994-4504-a94b-040103b2efa7", "address": "fa:16:3e:02:ea:af", "network": {"id": "590b5147-c33a-45bd-a502-8fd41408064d", "bridge": "br-int", "label": "tempest-device-tagging-net1-904391500", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.40", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a8d0f284dd8d4cc88f04a729b1d5d38c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95a425c5-f9", "ovs_interfaceid": "95a425c5-f994-4504-a94b-040103b2efa7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7aa7e71d-2c00-40fd-9d05-d108bcc807ec", "address": "fa:16:3e:73:99:8a", "network": {"id": "590b5147-c33a-45bd-a502-8fd41408064d", "bridge": "br-int", "label": "tempest-device-tagging-net1-904391500", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.98", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a8d0f284dd8d4cc88f04a729b1d5d38c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7aa7e71d-2c", "ovs_interfaceid": "7aa7e71d-2c00-40fd-9d05-d108bcc807ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "01772e53-e624-4728-beb1-929cc4165f21", "address": "fa:16:3e:a7:a0:fe", "network": {"id": "590b5147-c33a-45bd-a502-8fd41408064d", "bridge": "br-int", "label": "tempest-device-tagging-net1-904391500", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a8d0f284dd8d4cc88f04a729b1d5d38c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01772e53-e6", "ovs_interfaceid": "01772e53-e624-4728-beb1-929cc4165f21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1bb4df6f-02b2-415b-9cea-fd8a7a04874c", "address": "fa:16:3e:cb:71:3b", "network": {"id": "f82e0fd1-978f-4b08-8480-709765208ef9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1203652186", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a8d0f284dd8d4cc88f04a729b1d5d38c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bb4df6f-02", "ovs_interfaceid": "1bb4df6f-02b2-415b-9cea-fd8a7a04874c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a07efcd3-59f4-452e-8fb7-8b8233ae235f", "address": "fa:16:3e:6c:cb:eb", "network": {"id": "f82e0fd1-978f-4b08-8480-709765208ef9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1203652186", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a8d0f284dd8d4cc88f04a729b1d5d38c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa07efcd3-59", "ovs_interfaceid": "a07efcd3-59f4-452e-8fb7-8b8233ae235f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 18:45:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-a59baceb-3bcc-432b-84f9-1e3b9d6c8491 req-d3dd7c89-6e19-46b9-92cd-7a7c0a33ff09 service nova] Acquired lock "refresh_cache-3274203b-a985-4f28-9b45-3f83509ae782" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 18:45:51 user nova-compute[75216]: DEBUG nova.network.neutron [req-a59baceb-3bcc-432b-84f9-1e3b9d6c8491 req-d3dd7c89-6e19-46b9-92cd-7a7c0a33ff09 service nova] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] Refreshing network info cache for port a07efcd3-59f4-452e-8fb7-8b8233ae235f {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 18:45:51 user nova-compute[75216]: DEBUG nova.compute.manager [req-2bd6a11a-1007-4f85-af10-e7a83ec2c093 req-2666a1c3-57f0-49fc-becc-5a51a14aede3 service nova] [instance: 872856e5-cdc4-444e-8835-55e36708d776] Received event network-vif-plugged-296cb77a-c087-4484-adf2-7fd703942e0d {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:45:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-2bd6a11a-1007-4f85-af10-e7a83ec2c093 req-2666a1c3-57f0-49fc-becc-5a51a14aede3 service nova] Acquiring lock "872856e5-cdc4-444e-8835-55e36708d776-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:45:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-2bd6a11a-1007-4f85-af10-e7a83ec2c093 req-2666a1c3-57f0-49fc-becc-5a51a14aede3 service nova] Lock "872856e5-cdc4-444e-8835-55e36708d776-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:45:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-2bd6a11a-1007-4f85-af10-e7a83ec2c093 req-2666a1c3-57f0-49fc-becc-5a51a14aede3 service nova] Lock "872856e5-cdc4-444e-8835-55e36708d776-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:45:51 user nova-compute[75216]: DEBUG nova.compute.manager [req-2bd6a11a-1007-4f85-af10-e7a83ec2c093 req-2666a1c3-57f0-49fc-becc-5a51a14aede3 service nova] [instance: 872856e5-cdc4-444e-8835-55e36708d776] No waiting events found dispatching network-vif-plugged-296cb77a-c087-4484-adf2-7fd703942e0d {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:45:51 user nova-compute[75216]: WARNING nova.compute.manager [req-2bd6a11a-1007-4f85-af10-e7a83ec2c093 req-2666a1c3-57f0-49fc-becc-5a51a14aede3 service nova] [instance: 872856e5-cdc4-444e-8835-55e36708d776] Received unexpected event network-vif-plugged-296cb77a-c087-4484-adf2-7fd703942e0d for instance with vm_state active and task_state None.
Nov 13 18:45:51 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:45:51 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:45:51 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:45:51 user nova-compute[75216]: DEBUG nova.network.neutron [req-a59baceb-3bcc-432b-84f9-1e3b9d6c8491 req-d3dd7c89-6e19-46b9-92cd-7a7c0a33ff09 service nova] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] Updated VIF entry in instance network info cache for port a07efcd3-59f4-452e-8fb7-8b8233ae235f. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 18:45:51 user nova-compute[75216]: DEBUG nova.network.neutron [req-a59baceb-3bcc-432b-84f9-1e3b9d6c8491 req-d3dd7c89-6e19-46b9-92cd-7a7c0a33ff09 service nova] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] Updating instance_info_cache with network_info: [{"id": "217faeb3-4474-449c-ae9f-86e555ce7cd7", "address": "fa:16:3e:49:58:83", "network": {"id": "804f3c05-e540-4bae-a58f-682133e0c762", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-619032523-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8d0f284dd8d4cc88f04a729b1d5d38c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap217faeb3-44", "ovs_interfaceid": "217faeb3-4474-449c-ae9f-86e555ce7cd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9bed3978-d90d-4b90-b798-12413ea26a48", "address": "fa:16:3e:17:08:ae", "network": {"id": "590b5147-c33a-45bd-a502-8fd41408064d", "bridge": "br-int", "label": "tempest-device-tagging-net1-904391500", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a8d0f284dd8d4cc88f04a729b1d5d38c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bed3978-d9", "ovs_interfaceid": "9bed3978-d90d-4b90-b798-12413ea26a48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "95a425c5-f994-4504-a94b-040103b2efa7", "address": "fa:16:3e:02:ea:af", "network": {"id": "590b5147-c33a-45bd-a502-8fd41408064d", "bridge": "br-int", "label": "tempest-device-tagging-net1-904391500", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.40", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a8d0f284dd8d4cc88f04a729b1d5d38c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95a425c5-f9", "ovs_interfaceid": "95a425c5-f994-4504-a94b-040103b2efa7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7aa7e71d-2c00-40fd-9d05-d108bcc807ec", "address": "fa:16:3e:73:99:8a", "network": {"id": "590b5147-c33a-45bd-a502-8fd41408064d", "bridge": "br-int", "label": "tempest-device-tagging-net1-904391500", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.98", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a8d0f284dd8d4cc88f04a729b1d5d38c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7aa7e71d-2c", "ovs_interfaceid": "7aa7e71d-2c00-40fd-9d05-d108bcc807ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "01772e53-e624-4728-beb1-929cc4165f21", "address": "fa:16:3e:a7:a0:fe", "network": {"id": "590b5147-c33a-45bd-a502-8fd41408064d", "bridge": "br-int", "label": "tempest-device-tagging-net1-904391500", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a8d0f284dd8d4cc88f04a729b1d5d38c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01772e53-e6", "ovs_interfaceid": "01772e53-e624-4728-beb1-929cc4165f21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1bb4df6f-02b2-415b-9cea-fd8a7a04874c", "address": "fa:16:3e:cb:71:3b", "network": {"id": "f82e0fd1-978f-4b08-8480-709765208ef9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1203652186", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a8d0f284dd8d4cc88f04a729b1d5d38c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bb4df6f-02", "ovs_interfaceid": "1bb4df6f-02b2-415b-9cea-fd8a7a04874c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a07efcd3-59f4-452e-8fb7-8b8233ae235f", "address": "fa:16:3e:6c:cb:eb", "network": {"id": "f82e0fd1-978f-4b08-8480-709765208ef9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1203652186", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a8d0f284dd8d4cc88f04a729b1d5d38c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa07efcd3-59", "ovs_interfaceid": "a07efcd3-59f4-452e-8fb7-8b8233ae235f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 18:45:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-a59baceb-3bcc-432b-84f9-1e3b9d6c8491 req-d3dd7c89-6e19-46b9-92cd-7a7c0a33ff09 service nova] Releasing lock "refresh_cache-3274203b-a985-4f28-9b45-3f83509ae782" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 18:45:52 user nova-compute[75216]: DEBUG nova.compute.manager [req-1f737629-d61c-4d0f-bea0-1a0b3cd77ece req-3c52a6e0-2c90-4dae-92de-5de16b55367b service nova] [instance: 30ca36a3-ac49-44e4-a804-8940f7ef25b8] Received event network-vif-plugged-806f1a86-b973-4d62-9ad4-a5df9de18821 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:45:52 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-1f737629-d61c-4d0f-bea0-1a0b3cd77ece req-3c52a6e0-2c90-4dae-92de-5de16b55367b service nova] Acquiring lock "30ca36a3-ac49-44e4-a804-8940f7ef25b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:45:52 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-1f737629-d61c-4d0f-bea0-1a0b3cd77ece req-3c52a6e0-2c90-4dae-92de-5de16b55367b service nova] Lock "30ca36a3-ac49-44e4-a804-8940f7ef25b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:45:52 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-1f737629-d61c-4d0f-bea0-1a0b3cd77ece req-3c52a6e0-2c90-4dae-92de-5de16b55367b service nova] Lock "30ca36a3-ac49-44e4-a804-8940f7ef25b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:45:52 user nova-compute[75216]: DEBUG nova.compute.manager [req-1f737629-d61c-4d0f-bea0-1a0b3cd77ece req-3c52a6e0-2c90-4dae-92de-5de16b55367b service nova] [instance: 30ca36a3-ac49-44e4-a804-8940f7ef25b8] No waiting events found dispatching network-vif-plugged-806f1a86-b973-4d62-9ad4-a5df9de18821 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:45:52 user nova-compute[75216]: WARNING nova.compute.manager [req-1f737629-d61c-4d0f-bea0-1a0b3cd77ece req-3c52a6e0-2c90-4dae-92de-5de16b55367b service nova] [instance: 30ca36a3-ac49-44e4-a804-8940f7ef25b8] Received unexpected event network-vif-plugged-806f1a86-b973-4d62-9ad4-a5df9de18821 for instance with vm_state building and task_state spawning.
Nov 13 18:45:52 user nova-compute[75216]: DEBUG nova.compute.manager [req-1f737629-d61c-4d0f-bea0-1a0b3cd77ece req-3c52a6e0-2c90-4dae-92de-5de16b55367b service nova] [instance: 30ca36a3-ac49-44e4-a804-8940f7ef25b8] Received event network-vif-plugged-806f1a86-b973-4d62-9ad4-a5df9de18821 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:45:52 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-1f737629-d61c-4d0f-bea0-1a0b3cd77ece req-3c52a6e0-2c90-4dae-92de-5de16b55367b service nova] Acquiring lock "30ca36a3-ac49-44e4-a804-8940f7ef25b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:45:52 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-1f737629-d61c-4d0f-bea0-1a0b3cd77ece req-3c52a6e0-2c90-4dae-92de-5de16b55367b service nova] Lock "30ca36a3-ac49-44e4-a804-8940f7ef25b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:45:52 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-1f737629-d61c-4d0f-bea0-1a0b3cd77ece req-3c52a6e0-2c90-4dae-92de-5de16b55367b service nova] Lock "30ca36a3-ac49-44e4-a804-8940f7ef25b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:45:52 user nova-compute[75216]: DEBUG nova.compute.manager [req-1f737629-d61c-4d0f-bea0-1a0b3cd77ece req-3c52a6e0-2c90-4dae-92de-5de16b55367b service nova] [instance: 30ca36a3-ac49-44e4-a804-8940f7ef25b8] No waiting events found dispatching network-vif-plugged-806f1a86-b973-4d62-9ad4-a5df9de18821 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:45:52 user nova-compute[75216]: WARNING nova.compute.manager [req-1f737629-d61c-4d0f-bea0-1a0b3cd77ece req-3c52a6e0-2c90-4dae-92de-5de16b55367b service nova] [instance: 30ca36a3-ac49-44e4-a804-8940f7ef25b8] Received unexpected event network-vif-plugged-806f1a86-b973-4d62-9ad4-a5df9de18821 for instance with vm_state building and task_state spawning.
Nov 13 18:45:52 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:45:52 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:45:52 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:45:53 user nova-compute[75216]: DEBUG nova.network.neutron [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Updating instance_info_cache with network_info: [{"id": "6b91caf7-7b72-41be-8cf7-96e728c0eae5", "address": "fa:16:3e:22:29:78", "network": {"id": "65bd62c0-ccfd-486a-a4e4-eafe4e4f587f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-92675676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "046be82514bf4c3483f8b3b8f2299b96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b91caf7-7b", "ovs_interfaceid": "6b91caf7-7b72-41be-8cf7-96e728c0eae5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7c9f8c17-a293-4817-ae4f-3fab0a1076a6", "address": "fa:16:3e:bc:93:0e", "network": {"id": "badd6fc4-dc5e-4623-b319-4969f674705f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1322270738", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.246", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "046be82514bf4c3483f8b3b8f2299b96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c9f8c17-a2", "ovs_interfaceid": "7c9f8c17-a293-4817-ae4f-3fab0a1076a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c5b1d8e6-f202-4278-924c-abecf64f299c", "address": "fa:16:3e:a1:c9:75", "network": {"id": "badd6fc4-dc5e-4623-b319-4969f674705f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1322270738", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.53", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "046be82514bf4c3483f8b3b8f2299b96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5b1d8e6-f2", "ovs_interfaceid": "c5b1d8e6-f202-4278-924c-abecf64f299c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5c412896-2c62-4248-a888-9b0612378259", "address": "fa:16:3e:47:55:1a", "network": {"id": "badd6fc4-dc5e-4623-b319-4969f674705f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1322270738", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "046be82514bf4c3483f8b3b8f2299b96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c412896-2c", "ovs_interfaceid": "5c412896-2c62-4248-a888-9b0612378259", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e4e34ea8-fb99-4a0e-8b65-a93933cc7d6b", "address": "fa:16:3e:a8:83:c9", "network": {"id": "badd6fc4-dc5e-4623-b319-4969f674705f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1322270738", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "046be82514bf4c3483f8b3b8f2299b96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4e34ea8-fb", "ovs_interfaceid": "e4e34ea8-fb99-4a0e-8b65-a93933cc7d6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7b6ed148-b7c9-479b-9e2d-cfc0c3f6f93a", "address": "fa:16:3e:e4:db:d9", "network": {"id": "debccb89-bf2d-40a9-b114-b1bb2e913648", "bridge": "br-int", "label": "tempest-device-tagging-net2-185988930", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "046be82514bf4c3483f8b3b8f2299b96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b6ed148-b7", "ovs_interfaceid": "7b6ed148-b7c9-479b-9e2d-cfc0c3f6f93a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "815d1175-2997-4d74-8f35-7ca982cf46aa", "address": "fa:16:3e:2c:4b:72", "network": {"id": "debccb89-bf2d-40a9-b114-b1bb2e913648", "bridge": "br-int", "label": "tempest-device-tagging-net2-185988930", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "046be82514bf4c3483f8b3b8f2299b96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap815d1175-29", "ovs_interfaceid": "815d1175-2997-4d74-8f35-7ca982cf46aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 18:45:53 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Releasing lock "refresh_cache-78605259-17bf-47da-86de-3c76ac1c5bfa" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 18:45:53 user nova-compute[75216]: DEBUG nova.compute.manager [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Instance network_info: |[{"id": "6b91caf7-7b72-41be-8cf7-96e728c0eae5", "address": "fa:16:3e:22:29:78", "network": {"id": "65bd62c0-ccfd-486a-a4e4-eafe4e4f587f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-92675676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "046be82514bf4c3483f8b3b8f2299b96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b91caf7-7b", "ovs_interfaceid": "6b91caf7-7b72-41be-8cf7-96e728c0eae5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7c9f8c17-a293-4817-ae4f-3fab0a1076a6", "address": "fa:16:3e:bc:93:0e", "network": {"id": "badd6fc4-dc5e-4623-b319-4969f674705f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1322270738", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.246", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "046be82514bf4c3483f8b3b8f2299b96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c9f8c17-a2", "ovs_interfaceid": "7c9f8c17-a293-4817-ae4f-3fab0a1076a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c5b1d8e6-f202-4278-924c-abecf64f299c", "address": "fa:16:3e:a1:c9:75", "network": {"id": "badd6fc4-dc5e-4623-b319-4969f674705f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1322270738", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.53", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "046be82514bf4c3483f8b3b8f2299b96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5b1d8e6-f2", "ovs_interfaceid": "c5b1d8e6-f202-4278-924c-abecf64f299c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5c412896-2c62-4248-a888-9b0612378259", "address": "fa:16:3e:47:55:1a", "network": {"id": "badd6fc4-dc5e-4623-b319-4969f674705f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1322270738", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "046be82514bf4c3483f8b3b8f2299b96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c412896-2c", "ovs_interfaceid": "5c412896-2c62-4248-a888-9b0612378259", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e4e34ea8-fb99-4a0e-8b65-a93933cc7d6b", "address": "fa:16:3e:a8:83:c9", "network": {"id": "badd6fc4-dc5e-4623-b319-4969f674705f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1322270738", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "046be82514bf4c3483f8b3b8f2299b96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4e34ea8-fb", "ovs_interfaceid": "e4e34ea8-fb99-4a0e-8b65-a93933cc7d6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7b6ed148-b7c9-479b-9e2d-cfc0c3f6f93a", "address": "fa:16:3e:e4:db:d9", "network": {"id": "debccb89-bf2d-40a9-b114-b1bb2e913648", "bridge": "br-int", "label": "tempest-device-tagging-net2-185988930", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "046be82514bf4c3483f8b3b8f2299b96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b6ed148-b7", "ovs_interfaceid": "7b6ed148-b7c9-479b-9e2d-cfc0c3f6f93a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "815d1175-2997-4d74-8f35-7ca982cf46aa", "address": "fa:16:3e:2c:4b:72", "network": {"id": "debccb89-bf2d-40a9-b114-b1bb2e913648", "bridge": "br-int", "label": "tempest-device-tagging-net2-185988930", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "046be82514bf4c3483f8b3b8f2299b96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap815d1175-29", "ovs_interfaceid": "815d1175-2997-4d74-8f35-7ca982cf46aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 18:45:53 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-40ca07fc-a19f-47e4-bea9-2104e2fd69d6 req-e11871c8-05a2-4d96-8e35-2ba8cc10ec68 service nova] Acquired lock "refresh_cache-78605259-17bf-47da-86de-3c76ac1c5bfa" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 18:45:53 user nova-compute[75216]: DEBUG nova.network.neutron [req-40ca07fc-a19f-47e4-bea9-2104e2fd69d6 req-e11871c8-05a2-4d96-8e35-2ba8cc10ec68 service nova] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Refreshing network info cache for port 7b6ed148-b7c9-479b-9e2d-cfc0c3f6f93a {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 18:45:53 user nova-compute[75216]: DEBUG nova.network.neutron [req-40ca07fc-a19f-47e4-bea9-2104e2fd69d6 req-e11871c8-05a2-4d96-8e35-2ba8cc10ec68 service nova] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Updated VIF entry in instance network info cache for port 7b6ed148-b7c9-479b-9e2d-cfc0c3f6f93a. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 18:45:53 user nova-compute[75216]: DEBUG nova.network.neutron [req-40ca07fc-a19f-47e4-bea9-2104e2fd69d6 req-e11871c8-05a2-4d96-8e35-2ba8cc10ec68 service nova] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Updating instance_info_cache with network_info: [{"id": "6b91caf7-7b72-41be-8cf7-96e728c0eae5", "address": "fa:16:3e:22:29:78", "network": {"id": "65bd62c0-ccfd-486a-a4e4-eafe4e4f587f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-92675676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "046be82514bf4c3483f8b3b8f2299b96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b91caf7-7b", "ovs_interfaceid": "6b91caf7-7b72-41be-8cf7-96e728c0eae5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7c9f8c17-a293-4817-ae4f-3fab0a1076a6", "address": "fa:16:3e:bc:93:0e", "network": {"id": "badd6fc4-dc5e-4623-b319-4969f674705f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1322270738", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.246", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "046be82514bf4c3483f8b3b8f2299b96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c9f8c17-a2", "ovs_interfaceid": "7c9f8c17-a293-4817-ae4f-3fab0a1076a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c5b1d8e6-f202-4278-924c-abecf64f299c", "address": "fa:16:3e:a1:c9:75", "network": {"id": "badd6fc4-dc5e-4623-b319-4969f674705f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1322270738", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.53", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "046be82514bf4c3483f8b3b8f2299b96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5b1d8e6-f2", "ovs_interfaceid": "c5b1d8e6-f202-4278-924c-abecf64f299c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5c412896-2c62-4248-a888-9b0612378259", "address": "fa:16:3e:47:55:1a", "network": {"id": "badd6fc4-dc5e-4623-b319-4969f674705f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1322270738", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "046be82514bf4c3483f8b3b8f2299b96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c412896-2c", "ovs_interfaceid": "5c412896-2c62-4248-a888-9b0612378259", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e4e34ea8-fb99-4a0e-8b65-a93933cc7d6b", "address": "fa:16:3e:a8:83:c9", "network": {"id": "badd6fc4-dc5e-4623-b319-4969f674705f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1322270738", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "046be82514bf4c3483f8b3b8f2299b96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4e34ea8-fb", "ovs_interfaceid": "e4e34ea8-fb99-4a0e-8b65-a93933cc7d6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7b6ed148-b7c9-479b-9e2d-cfc0c3f6f93a", "address": "fa:16:3e:e4:db:d9", "network": {"id": "debccb89-bf2d-40a9-b114-b1bb2e913648", "bridge": "br-int", "label": "tempest-device-tagging-net2-185988930", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "046be82514bf4c3483f8b3b8f2299b96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b6ed148-b7", "ovs_interfaceid": "7b6ed148-b7c9-479b-9e2d-cfc0c3f6f93a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "815d1175-2997-4d74-8f35-7ca982cf46aa", "address": "fa:16:3e:2c:4b:72", "network": {"id": "debccb89-bf2d-40a9-b114-b1bb2e913648", "bridge": "br-int", "label": "tempest-device-tagging-net2-185988930", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "046be82514bf4c3483f8b3b8f2299b96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap815d1175-29", "ovs_interfaceid": "815d1175-2997-4d74-8f35-7ca982cf46aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 18:45:53 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-40ca07fc-a19f-47e4-bea9-2104e2fd69d6 req-e11871c8-05a2-4d96-8e35-2ba8cc10ec68 service nova] Releasing lock "refresh_cache-78605259-17bf-47da-86de-3c76ac1c5bfa" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 18:45:53 user nova-compute[75216]: DEBUG nova.compute.manager [req-40ca07fc-a19f-47e4-bea9-2104e2fd69d6 req-e11871c8-05a2-4d96-8e35-2ba8cc10ec68 service nova] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Received event network-changed-815d1175-2997-4d74-8f35-7ca982cf46aa {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:45:53 user nova-compute[75216]: DEBUG nova.compute.manager [req-40ca07fc-a19f-47e4-bea9-2104e2fd69d6 req-e11871c8-05a2-4d96-8e35-2ba8cc10ec68 service nova] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Refreshing instance network info cache due to event network-changed-815d1175-2997-4d74-8f35-7ca982cf46aa. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 18:45:53 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-40ca07fc-a19f-47e4-bea9-2104e2fd69d6 req-e11871c8-05a2-4d96-8e35-2ba8cc10ec68 service nova] Acquiring lock "refresh_cache-78605259-17bf-47da-86de-3c76ac1c5bfa" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 18:45:53 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-40ca07fc-a19f-47e4-bea9-2104e2fd69d6 req-e11871c8-05a2-4d96-8e35-2ba8cc10ec68 service nova] Acquired lock "refresh_cache-78605259-17bf-47da-86de-3c76ac1c5bfa" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 18:45:53 user nova-compute[75216]: DEBUG nova.network.neutron [req-40ca07fc-a19f-47e4-bea9-2104e2fd69d6 req-e11871c8-05a2-4d96-8e35-2ba8cc10ec68 service nova] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Refreshing network info cache for port 815d1175-2997-4d74-8f35-7ca982cf46aa {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 18:45:53 user nova-compute[75216]: DEBUG nova.compute.manager [None req-1eb91b5c-2b39-4aaa-9e19-cc7813574ff3 tempest-VolumesActionsTest-586345736 tempest-VolumesActionsTest-586345736-project-member] [instance: 30ca36a3-ac49-44e4-a804-8940f7ef25b8] Instance event wait completed in 0 seconds for  {{(pid=75216) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 18:45:53 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-1eb91b5c-2b39-4aaa-9e19-cc7813574ff3 tempest-VolumesActionsTest-586345736 tempest-VolumesActionsTest-586345736-project-member] [instance: 30ca36a3-ac49-44e4-a804-8940f7ef25b8] Guest created on hypervisor {{(pid=75216) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 18:45:53 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 30ca36a3-ac49-44e4-a804-8940f7ef25b8] Instance spawned successfully.
Nov 13 18:45:53 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-1eb91b5c-2b39-4aaa-9e19-cc7813574ff3 tempest-VolumesActionsTest-586345736 tempest-VolumesActionsTest-586345736-project-member] [instance: 30ca36a3-ac49-44e4-a804-8940f7ef25b8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 18:45:53 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-1eb91b5c-2b39-4aaa-9e19-cc7813574ff3 tempest-VolumesActionsTest-586345736 tempest-VolumesActionsTest-586345736-project-member] [instance: 30ca36a3-ac49-44e4-a804-8940f7ef25b8] Found default for hw_cdrom_bus of ide {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 18:45:53 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-1eb91b5c-2b39-4aaa-9e19-cc7813574ff3 tempest-VolumesActionsTest-586345736 tempest-VolumesActionsTest-586345736-project-member] [instance: 30ca36a3-ac49-44e4-a804-8940f7ef25b8] Found default for hw_disk_bus of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 18:45:53 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-1eb91b5c-2b39-4aaa-9e19-cc7813574ff3 tempest-VolumesActionsTest-586345736 tempest-VolumesActionsTest-586345736-project-member] [instance: 30ca36a3-ac49-44e4-a804-8940f7ef25b8] Found default for hw_input_bus of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 18:45:53 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-1eb91b5c-2b39-4aaa-9e19-cc7813574ff3 tempest-VolumesActionsTest-586345736 tempest-VolumesActionsTest-586345736-project-member] [instance: 30ca36a3-ac49-44e4-a804-8940f7ef25b8] Found default for hw_pointer_model of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 18:45:53 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-1eb91b5c-2b39-4aaa-9e19-cc7813574ff3 tempest-VolumesActionsTest-586345736 tempest-VolumesActionsTest-586345736-project-member] [instance: 30ca36a3-ac49-44e4-a804-8940f7ef25b8] Found default for hw_video_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 18:45:53 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-1eb91b5c-2b39-4aaa-9e19-cc7813574ff3 tempest-VolumesActionsTest-586345736 tempest-VolumesActionsTest-586345736-project-member] [instance: 30ca36a3-ac49-44e4-a804-8940f7ef25b8] Found default for hw_vif_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 18:45:53 user nova-compute[75216]: INFO nova.compute.manager [None req-1eb91b5c-2b39-4aaa-9e19-cc7813574ff3 tempest-VolumesActionsTest-586345736 tempest-VolumesActionsTest-586345736-project-member] [instance: 30ca36a3-ac49-44e4-a804-8940f7ef25b8] Took 5.94 seconds to spawn the instance on the hypervisor.
Nov 13 18:45:53 user nova-compute[75216]: DEBUG nova.compute.manager [None req-1eb91b5c-2b39-4aaa-9e19-cc7813574ff3 tempest-VolumesActionsTest-586345736 tempest-VolumesActionsTest-586345736-project-member] [instance: 30ca36a3-ac49-44e4-a804-8940f7ef25b8] Checking state {{(pid=75216) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 18:45:54 user nova-compute[75216]: INFO nova.compute.manager [None req-1eb91b5c-2b39-4aaa-9e19-cc7813574ff3 tempest-VolumesActionsTest-586345736 tempest-VolumesActionsTest-586345736-project-member] [instance: 30ca36a3-ac49-44e4-a804-8940f7ef25b8] Took 7.30 seconds to build instance.
Nov 13 18:45:54 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1eb91b5c-2b39-4aaa-9e19-cc7813574ff3 tempest-VolumesActionsTest-586345736 tempest-VolumesActionsTest-586345736-project-member] Lock "30ca36a3-ac49-44e4-a804-8940f7ef25b8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.445s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:45:54 user nova-compute[75216]: DEBUG nova.network.neutron [req-40ca07fc-a19f-47e4-bea9-2104e2fd69d6 req-e11871c8-05a2-4d96-8e35-2ba8cc10ec68 service nova] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Updated VIF entry in instance network info cache for port 815d1175-2997-4d74-8f35-7ca982cf46aa. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 18:45:54 user nova-compute[75216]: DEBUG nova.network.neutron [req-40ca07fc-a19f-47e4-bea9-2104e2fd69d6 req-e11871c8-05a2-4d96-8e35-2ba8cc10ec68 service nova] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Updating instance_info_cache with network_info: [{"id": "6b91caf7-7b72-41be-8cf7-96e728c0eae5", "address": "fa:16:3e:22:29:78", "network": {"id": "65bd62c0-ccfd-486a-a4e4-eafe4e4f587f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-92675676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "046be82514bf4c3483f8b3b8f2299b96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b91caf7-7b", "ovs_interfaceid": "6b91caf7-7b72-41be-8cf7-96e728c0eae5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7c9f8c17-a293-4817-ae4f-3fab0a1076a6", "address": "fa:16:3e:bc:93:0e", "network": {"id": "badd6fc4-dc5e-4623-b319-4969f674705f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1322270738", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.246", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "046be82514bf4c3483f8b3b8f2299b96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c9f8c17-a2", "ovs_interfaceid": "7c9f8c17-a293-4817-ae4f-3fab0a1076a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c5b1d8e6-f202-4278-924c-abecf64f299c", "address": "fa:16:3e:a1:c9:75", "network": {"id": "badd6fc4-dc5e-4623-b319-4969f674705f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1322270738", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.53", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "046be82514bf4c3483f8b3b8f2299b96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5b1d8e6-f2", "ovs_interfaceid": "c5b1d8e6-f202-4278-924c-abecf64f299c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5c412896-2c62-4248-a888-9b0612378259", "address": "fa:16:3e:47:55:1a", "network": {"id": "badd6fc4-dc5e-4623-b319-4969f674705f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1322270738", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "046be82514bf4c3483f8b3b8f2299b96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c412896-2c", "ovs_interfaceid": "5c412896-2c62-4248-a888-9b0612378259", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e4e34ea8-fb99-4a0e-8b65-a93933cc7d6b", "address": "fa:16:3e:a8:83:c9", "network": {"id": "badd6fc4-dc5e-4623-b319-4969f674705f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1322270738", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "046be82514bf4c3483f8b3b8f2299b96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4e34ea8-fb", "ovs_interfaceid": "e4e34ea8-fb99-4a0e-8b65-a93933cc7d6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7b6ed148-b7c9-479b-9e2d-cfc0c3f6f93a", "address": "fa:16:3e:e4:db:d9", "network": {"id": "debccb89-bf2d-40a9-b114-b1bb2e913648", "bridge": "br-int", "label": "tempest-device-tagging-net2-185988930", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "046be82514bf4c3483f8b3b8f2299b96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b6ed148-b7", "ovs_interfaceid": "7b6ed148-b7c9-479b-9e2d-cfc0c3f6f93a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "815d1175-2997-4d74-8f35-7ca982cf46aa", "address": "fa:16:3e:2c:4b:72", "network": {"id": "debccb89-bf2d-40a9-b114-b1bb2e913648", "bridge": "br-int", "label": "tempest-device-tagging-net2-185988930", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "046be82514bf4c3483f8b3b8f2299b96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap815d1175-29", "ovs_interfaceid": "815d1175-2997-4d74-8f35-7ca982cf46aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 18:45:54 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-40ca07fc-a19f-47e4-bea9-2104e2fd69d6 req-e11871c8-05a2-4d96-8e35-2ba8cc10ec68 service nova] Releasing lock "refresh_cache-78605259-17bf-47da-86de-3c76ac1c5bfa" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 18:45:54 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:45:57 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:45:59 user nova-compute[75216]: DEBUG nova.compute.manager [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Start spawning the instance on the hypervisor. {{(pid=75216) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 18:45:59 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Creating instance directory {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 18:45:59 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Creating image(s)
Nov 13 18:45:59 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Did not create local disks {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 13 18:45:59 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Ensure instance console log exists: /opt/stack/data/nova/instances/78605259-17bf-47da-86de-3c76ac1c5bfa/console.log {{(pid=75216) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 18:45:59 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:45:59 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:45:59 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:45:59 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Start _get_guest_xml network_info=[{"id": "6b91caf7-7b72-41be-8cf7-96e728c0eae5", "address": "fa:16:3e:22:29:78", "network": {"id": "65bd62c0-ccfd-486a-a4e4-eafe4e4f587f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-92675676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "046be82514bf4c3483f8b3b8f2299b96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b91caf7-7b", "ovs_interfaceid": "6b91caf7-7b72-41be-8cf7-96e728c0eae5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7c9f8c17-a293-4817-ae4f-3fab0a1076a6", "address": "fa:16:3e:bc:93:0e", "network": {"id": "badd6fc4-dc5e-4623-b319-4969f674705f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1322270738", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.246", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "046be82514bf4c3483f8b3b8f2299b96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c9f8c17-a2", "ovs_interfaceid": "7c9f8c17-a293-4817-ae4f-3fab0a1076a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c5b1d8e6-f202-4278-924c-abecf64f299c", "address": "fa:16:3e:a1:c9:75", "network": {"id": "badd6fc4-dc5e-4623-b319-4969f674705f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1322270738", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.53", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "046be82514bf4c3483f8b3b8f2299b96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5b1d8e6-f2", "ovs_interfaceid": "c5b1d8e6-f202-4278-924c-abecf64f299c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5c412896-2c62-4248-a888-9b0612378259", "address": "fa:16:3e:47:55:1a", "network": {"id": "badd6fc4-dc5e-4623-b319-4969f674705f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1322270738", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "046be82514bf4c3483f8b3b8f2299b96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c412896-2c", "ovs_interfaceid": "5c412896-2c62-4248-a888-9b0612378259", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e4e34ea8-fb99-4a0e-8b65-a93933cc7d6b", "address": "fa:16:3e:a8:83:c9", "network": {"id": "badd6fc4-dc5e-4623-b319-4969f674705f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1322270738", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "046be82514bf4c3483f8b3b8f2299b96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4e34ea8-fb", "ovs_interfaceid": "e4e34ea8-fb99-4a0e-8b65-a93933cc7d6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7b6ed148-b7c9-479b-9e2d-cfc0c3f6f93a", "address": "fa:16:3e:e4:db:d9", "network": {"id": "debccb89-bf2d-40a9-b114-b1bb2e913648", "bridge": "br-int", "label": "tempest-device-tagging-net2-185988930", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "046be82514bf4c3483f8b3b8f2299b96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b6ed148-b7", "ovs_interfaceid": "7b6ed148-b7c9-479b-9e2d-cfc0c3f6f93a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "815d1175-2997-4d74-8f35-7ca982cf46aa", "address": "fa:16:3e:2c:4b:72", "network": {"id": "debccb89-bf2d-40a9-b114-b1bb2e913648", "bridge": "br-int", "label": "tempest-device-tagging-net2-185988930", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "046be82514bf4c3483f8b3b8f2299b96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap815d1175-29", "ovs_interfaceid": "815d1175-2997-4d74-8f35-7ca982cf46aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T18:41:06Z,direct_url=<?>,disk_format='qcow2',id=77bcb5ba-8510-41ec-a88d-96097bb431de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c465b7c26ec44582b6d1b7169536ecc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T18:41:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ba1efeb5-724e-4415-a5ed-12ce8c9489bc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rIfKXvbA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '78605259-17bf-47da-86de-3c76ac1c5bfa', 'attached_at': '', 'detached_at': '', 'volume_id': 'ba1efeb5-724e-4415-a5ed-12ce8c9489bc', 'serial': 'ba1efeb5-724e-4415-a5ed-12ce8c9489bc'}, 'attachment_id': '85a368e9-eeb4-4d52-90a8-969a387bcb58', 'guest_format': None, 'mount_device': '/dev/vda', 'delete_on_termination': False, 'boot_index': 0, 'volume_type': None}, {'device_type': 'disk', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0fc393f0-1356-404f-a87b-bed1fb91b924', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZsBVjobt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '78605259-17bf-47da-86de-3c76ac1c5bfa', 'attached_at': '', 'detached_at': '', 'volume_id': '0fc393f0-1356-404f-a87b-bed1fb91b924', 'serial': '0fc393f0-1356-404f-a87b-bed1fb91b924'}, 'attachment_id': 'da9b4230-5af5-4ee7-8e26-6a30d438e6ff', 'guest_format': None, 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'boot_index': 1, 'volume_type': None}, {'device_type': 'disk', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e823c6a1-f7e2-495f-a5dc-6fdfd2b19cf0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'egXpiAOk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '78605259-17bf-47da-86de-3c76ac1c5bfa', 'attached_at': '', 'detached_at': '', 'volume_id': 'e823c6a1-f7e2-495f-a5dc-6fdfd2b19cf0', 'serial': 'e823c6a1-f7e2-495f-a5dc-6fdfd2b19cf0'}, 'attachment_id': 'f79d4cf0-74bc-4ad8-b117-435a2f5f0670', 'guest_format': None, 'mount_device': '/dev/vdc', 'delete_on_termination': False, 'boot_index': 2, 'volume_type': None} {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 18:45:59 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 18:45:59 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 18:45:59 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 18:45:59 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] CPU controller missing on host. {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 18:45:59 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 18:45:59 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] CPU controller found on host. {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 18:45:59 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75216) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 18:45:59 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T18:40:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T18:41:06Z,direct_url=<?>,disk_format='qcow2',id=77bcb5ba-8510-41ec-a88d-96097bb431de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c465b7c26ec44582b6d1b7169536ecc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T18:41:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 18:45:59 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Flavor limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 18:45:59 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Image limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 18:45:59 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Flavor pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 18:45:59 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Image pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 18:45:59 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 18:45:59 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 18:45:59 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 18:45:59 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Got 1 possible topologies {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 18:45:59 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 18:45:59 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 18:45:59 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:45:59 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:45:59 user nova-compute[75216]: DEBUG os_brick.initiator.connector [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Factory for ISCSI on None {{(pid=75216) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Nov 13 18:45:59 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.007s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:45:59 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Calling os-brick to attach iSCSI Volume {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 18:45:59 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3a8669e40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ba1efeb5-724e-4415-a5ed-12ce8c9489bc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rIfKXvbA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 18:45:59 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 18:45:59 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 18:45:59 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 18:45:59 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 18:45:59 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ba1efeb5-724e-4415-a5ed-12ce8c9489bc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 18:45:59 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ba1efeb5-724e-4415-a5ed-12ce8c9489bc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 18:45:59 user nova-compute[75216]: INFO os_brick.initiator.connectors.iscsi [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 18:45:59 user nova-compute[75216]: DEBUG nova.compute.manager [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] Start spawning the instance on the hypervisor. {{(pid=75216) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 18:45:59 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] Creating instance directory {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 18:45:59 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] Creating image(s)
Nov 13 18:45:59 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] Did not create local disks {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 13 18:45:59 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] Ensure instance console log exists: /opt/stack/data/nova/instances/3274203b-a985-4f28-9b45-3f83509ae782/console.log {{(pid=75216) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 18:45:59 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:45:59 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:45:59 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:45:59 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] Start _get_guest_xml network_info=[{"id": "217faeb3-4474-449c-ae9f-86e555ce7cd7", "address": "fa:16:3e:49:58:83", "network": {"id": "804f3c05-e540-4bae-a58f-682133e0c762", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-619032523-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8d0f284dd8d4cc88f04a729b1d5d38c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap217faeb3-44", "ovs_interfaceid": "217faeb3-4474-449c-ae9f-86e555ce7cd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9bed3978-d90d-4b90-b798-12413ea26a48", "address": "fa:16:3e:17:08:ae", "network": {"id": "590b5147-c33a-45bd-a502-8fd41408064d", "bridge": "br-int", "label": "tempest-device-tagging-net1-904391500", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a8d0f284dd8d4cc88f04a729b1d5d38c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bed3978-d9", "ovs_interfaceid": "9bed3978-d90d-4b90-b798-12413ea26a48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "95a425c5-f994-4504-a94b-040103b2efa7", "address": "fa:16:3e:02:ea:af", "network": {"id": "590b5147-c33a-45bd-a502-8fd41408064d", "bridge": "br-int", "label": "tempest-device-tagging-net1-904391500", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.40", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a8d0f284dd8d4cc88f04a729b1d5d38c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95a425c5-f9", "ovs_interfaceid": "95a425c5-f994-4504-a94b-040103b2efa7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7aa7e71d-2c00-40fd-9d05-d108bcc807ec", "address": "fa:16:3e:73:99:8a", "network": {"id": "590b5147-c33a-45bd-a502-8fd41408064d", "bridge": "br-int", "label": "tempest-device-tagging-net1-904391500", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.98", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a8d0f284dd8d4cc88f04a729b1d5d38c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7aa7e71d-2c", "ovs_interfaceid": "7aa7e71d-2c00-40fd-9d05-d108bcc807ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "01772e53-e624-4728-beb1-929cc4165f21", "address": "fa:16:3e:a7:a0:fe", "network": {"id": "590b5147-c33a-45bd-a502-8fd41408064d", "bridge": "br-int", "label": "tempest-device-tagging-net1-904391500", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a8d0f284dd8d4cc88f04a729b1d5d38c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01772e53-e6", "ovs_interfaceid": "01772e53-e624-4728-beb1-929cc4165f21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1bb4df6f-02b2-415b-9cea-fd8a7a04874c", "address": "fa:16:3e:cb:71:3b", "network": {"id": "f82e0fd1-978f-4b08-8480-709765208ef9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1203652186", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a8d0f284dd8d4cc88f04a729b1d5d38c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bb4df6f-02", "ovs_interfaceid": "1bb4df6f-02b2-415b-9cea-fd8a7a04874c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a07efcd3-59f4-452e-8fb7-8b8233ae235f", "address": "fa:16:3e:6c:cb:eb", "network": {"id": "f82e0fd1-978f-4b08-8480-709765208ef9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1203652186", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a8d0f284dd8d4cc88f04a729b1d5d38c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa07efcd3-59", "ovs_interfaceid": "a07efcd3-59f4-452e-8fb7-8b8233ae235f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T18:41:06Z,direct_url=<?>,disk_format='qcow2',id=77bcb5ba-8510-41ec-a88d-96097bb431de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c465b7c26ec44582b6d1b7169536ecc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T18:41:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:de3d195d-b8b4-4c79-a150-813952c640e8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WTBrHnmk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3274203b-a985-4f28-9b45-3f83509ae782', 'attached_at': '', 'detached_at': '', 'volume_id': 'de3d195d-b8b4-4c79-a150-813952c640e8', 'serial': 'de3d195d-b8b4-4c79-a150-813952c640e8'}, 'attachment_id': '6d159eb5-b7fb-48c9-b4bf-7c1a51fccebb', 'guest_format': None, 'mount_device': '/dev/vda', 'delete_on_termination': False, 'boot_index': 0, 'volume_type': None}, {'device_type': 'disk', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2a1a5e82-4f70-4668-94bd-4a842d826214', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DYBgeCvJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3274203b-a985-4f28-9b45-3f83509ae782', 'attached_at': '', 'detached_at': '', 'volume_id': '2a1a5e82-4f70-4668-94bd-4a842d826214', 'serial': '2a1a5e82-4f70-4668-94bd-4a842d826214'}, 'attachment_id': '118f1bc1-df35-4426-b671-a6d846058f16', 'guest_format': None, 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'boot_index': 1, 'volume_type': None}, {'device_type': 'disk', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:52f4339a-6a47-4877-b041-9c27d7be2e94', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EoteNJdj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3274203b-a985-4f28-9b45-3f83509ae782', 'attached_at': '', 'detached_at': '', 'volume_id': '52f4339a-6a47-4877-b041-9c27d7be2e94', 'serial': '52f4339a-6a47-4877-b041-9c27d7be2e94'}, 'attachment_id': 'c7c0bccd-2288-4c4d-874c-52fbfe5002a2', 'guest_format': None, 'mount_device': '/dev/vdc', 'delete_on_termination': False, 'boot_index': 2, 'volume_type': None} {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 18:45:59 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba1efeb5-724e-4415-a5ed-12ce8c9489bc -p 172.16.0.220:3260 {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:45:59 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba1efeb5-724e-4415-a5ed-12ce8c9489bc -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:45:59 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4ea4aac-542f-4df6-958f-33318bdb1572]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:45:59 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 18:45:59 user nova-compute[75216]:  {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:45:59 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba1efeb5-724e-4415-a5ed-12ce8c9489bc -p 172.16.0.220:3260 --interface default --op new {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:45:59 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 18:45:59 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 18:45:59 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 18:45:59 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] CPU controller missing on host. {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 18:45:59 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 18:45:59 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] CPU controller found on host. {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 18:45:59 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75216) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 18:45:59 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T18:40:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T18:41:06Z,direct_url=<?>,disk_format='qcow2',id=77bcb5ba-8510-41ec-a88d-96097bb431de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c465b7c26ec44582b6d1b7169536ecc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T18:41:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 18:45:59 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Flavor limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 18:45:59 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Image limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 18:45:59 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Flavor pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 18:45:59 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Image pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 18:45:59 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 18:45:59 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 18:45:59 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 18:45:59 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Got 1 possible topologies {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 18:45:59 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 18:45:59 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 18:45:59 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] Calling os-brick to attach iSCSI Volume {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 18:45:59 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3a8669e40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:de3d195d-b8b4-4c79-a150-813952c640e8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WTBrHnmk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 18:45:59 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 18:45:59 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 18:45:59 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba1efeb5-724e-4415-a5ed-12ce8c9489bc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:45:59 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a7b6388-3419-40eb-8c71-1ce978d21644]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ba1efeb5-724e-4415-a5ed-12ce8c9489bc] added\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:45:59 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ba1efeb5-724e-4415-a5ed-12ce8c9489bc] added
Nov 13 18:45:59 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:45:59 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba1efeb5-724e-4415-a5ed-12ce8c9489bc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:45:59 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:45:59 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba1efeb5-724e-4415-a5ed-12ce8c9489bc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.128s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:45:59 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[47a0fe02-9b81-40a1-9083-3645e56b8f3b]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:45:59 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:45:59 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba1efeb5-724e-4415-a5ed-12ce8c9489bc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:45:59 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba1efeb5-724e-4415-a5ed-12ce8c9489bc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:46:00 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6b6bc27-a598-4838-b71e-87f461f55786]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:46:00 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:46:00 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba1efeb5-724e-4415-a5ed-12ce8c9489bc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rIfKXvbA {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:46:00 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba1efeb5-724e-4415-a5ed-12ce8c9489bc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rIfKXvbA" returned: 0 in 0.083s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:46:00 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[18360f76-018b-448d-b2af-5479b06acd44]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:46:00 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rIfKXvbA'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:46:00 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba1efeb5-724e-4415-a5ed-12ce8c9489bc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:46:00 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba1efeb5-724e-4415-a5ed-12ce8c9489bc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.058s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:46:00 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f1d32a0-1830-4de8-b369-f0b9ffe0d50d]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:46:00 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:46:00 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:46:00 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:46:00 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[c21e4f30-96f3-47e0-a06a-ec0155054e49]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:46:00 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 13 18:46:00 user nova-compute[75216]:  {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 18:46:00 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 13 18:46:00 user nova-compute[75216]:  {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 18:46:00 user nova-compute[75216]: WARNING os_brick.initiator.connectors.iscsi [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 13 18:46:00 user nova-compute[75216]: 
Nov 13 18:46:00 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba1efeb5-724e-4415-a5ed-12ce8c9489bc -p 172.16.0.220:3260 --login {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:46:00 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba1efeb5-724e-4415-a5ed-12ce8c9489bc -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:46:00 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[99325af5-87ce-4e74-ad45-f62a983c2ff5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ba1efeb5-724e-4415-a5ed-12ce8c9489bc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ba1efeb5-724e-4415-a5ed-12ce8c9489bc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:46:00 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ba1efeb5-724e-4415-a5ed-12ce8c9489bc, portal: 172.16.0.220,3260]
Nov 13 18:46:00 user nova-compute[75216]: Login to [iface: default, target: iqn.2010-10.org.openstack:ba1efeb5-724e-4415-a5ed-12ce8c9489bc, portal: 172.16.0.220,3260] successful.
Nov 13 18:46:00 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:46:00 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba1efeb5-724e-4415-a5ed-12ce8c9489bc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:46:00 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba1efeb5-724e-4415-a5ed-12ce8c9489bc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:46:00 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[a81d4789-f5c7-40d7-867c-1f671a5e286e]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:46:00 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:46:00 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:46:00 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:46:00 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7ff54cd-dece-4d9b-8b7b-4466922cc2bf]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba1efeb5-724e-4415-a5ed-12ce8c9489bc (non-flash)\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:46:00 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba1efeb5-724e-4415-a5ed-12ce8c9489bc (non-flash)
Nov 13 18:46:00 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 18:46:00 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba1efeb5-724e-4415-a5ed-12ce8c9489bc (non-flash)
Nov 13 18:46:00 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 18:46:00 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ba1efeb5-724e-4415-a5ed-12ce8c9489bc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.502s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 18:46:00 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Connected to 172.16.0.220:3260 {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 18:46:00 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=75216) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 18:46:00 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75216) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 18:46:00 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:46:00 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:46:00 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[b82d9b72-8c5a-49ad-814f-83cb3a627425]: (4, ('- - 0', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:46:00 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75216) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 18:46:00 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:ba1efeb5-724e-4415-a5ed-12ce8c9489bc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rIfKXvbA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 18:46:00 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:01 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.537s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 18:46:01 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] <== connect_volume: return (1539ms) {'type': 'block', 'scsi_wwn': '26239306131643833', 'path': '/dev/sdb'} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 18:46:01 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26239306131643833', 'path': '/dev/sdb'} {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 18:46:01 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.467s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 18:46:01 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 18:46:01 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:de3d195d-b8b4-4c79-a150-813952c640e8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 18:46:01 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:de3d195d-b8b4-4c79-a150-813952c640e8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 18:46:01 user nova-compute[75216]: INFO os_brick.initiator.connectors.iscsi [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 18:46:01 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de3d195d-b8b4-4c79-a150-813952c640e8 -p 172.16.0.220:3260 {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:46:01 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de3d195d-b8b4-4c79-a150-813952c640e8 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:46:01 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[93adf5ff-79aa-4a9c-b02a-82e0a3d35b74]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:46:01 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 18:46:01 user nova-compute[75216]:  {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:46:01 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de3d195d-b8b4-4c79-a150-813952c640e8 -p 172.16.0.220:3260 --interface default --op new {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:46:01 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Calling os-brick to attach iSCSI Volume {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 18:46:01 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3a8669e40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0fc393f0-1356-404f-a87b-bed1fb91b924', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZsBVjobt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 18:46:01 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 18:46:01 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 18:46:01 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de3d195d-b8b4-4c79-a150-813952c640e8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:46:01 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebfe2268-1502-4019-9756-759552a1ae02]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:de3d195d-b8b4-4c79-a150-813952c640e8] added\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:46:01 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:de3d195d-b8b4-4c79-a150-813952c640e8] added
Nov 13 18:46:01 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:46:01 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de3d195d-b8b4-4c79-a150-813952c640e8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:46:01 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de3d195d-b8b4-4c79-a150-813952c640e8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:46:01 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[f72a93f2-a8ed-4af8-b433-a09eb33f4ae5]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:46:01 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:46:01 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de3d195d-b8b4-4c79-a150-813952c640e8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:46:01 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de3d195d-b8b4-4c79-a150-813952c640e8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:46:01 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d45e3b4-27b1-4e96-a062-714d1f0dbac9]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:46:01 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:46:01 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de3d195d-b8b4-4c79-a150-813952c640e8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WTBrHnmk {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:46:01 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de3d195d-b8b4-4c79-a150-813952c640e8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WTBrHnmk" returned: 0 in 0.017s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:46:01 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2b64319-7f08-45e2-b40b-cbf6489721e8]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:46:01 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WTBrHnmk'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:46:01 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de3d195d-b8b4-4c79-a150-813952c640e8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:46:01 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de3d195d-b8b4-4c79-a150-813952c640e8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:46:01 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[75a585c9-ac01-4d5e-82c3-a509bdb6e5be]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:46:01 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:46:01 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:46:01 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:46:01 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[f085a32a-9c69-4846-aa1e-834cfda3c04e]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba1efeb5-724e-4415-a5ed-12ce8c9489bc (non-flash)\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:46:01 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba1efeb5-724e-4415-a5ed-12ce8c9489bc (non-flash)
Nov 13 18:46:01 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 18:46:01 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba1efeb5-724e-4415-a5ed-12ce8c9489bc (non-flash)
Nov 13 18:46:01 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 18:46:01 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de3d195d-b8b4-4c79-a150-813952c640e8 -p 172.16.0.220:3260 --login {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:46:01 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de3d195d-b8b4-4c79-a150-813952c640e8 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:46:01 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c01637c-0032-44b4-98ec-67c61f2e8bca]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:de3d195d-b8b4-4c79-a150-813952c640e8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:de3d195d-b8b4-4c79-a150-813952c640e8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:46:01 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:de3d195d-b8b4-4c79-a150-813952c640e8, portal: 172.16.0.220,3260]
Nov 13 18:46:01 user nova-compute[75216]: Login to [iface: default, target: iqn.2010-10.org.openstack:de3d195d-b8b4-4c79-a150-813952c640e8, portal: 172.16.0.220,3260] successful.
Nov 13 18:46:01 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:46:01 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de3d195d-b8b4-4c79-a150-813952c640e8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:46:01 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de3d195d-b8b4-4c79-a150-813952c640e8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:46:01 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[29e499dc-397b-41d2-b1f4-79c741b1ef50]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:46:01 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:46:01 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:46:01 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:46:01 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ee8aa19-06d4-4206-9f3d-96ec40f6cde7]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba1efeb5-724e-4415-a5ed-12ce8c9489bc (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3d195d-b8b4-4c79-a150-813952c640e8 (non-flash)\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:46:01 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba1efeb5-724e-4415-a5ed-12ce8c9489bc (non-flash)
Nov 13 18:46:01 user nova-compute[75216]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3d195d-b8b4-4c79-a150-813952c640e8 (non-flash)
Nov 13 18:46:01 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 18:46:01 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba1efeb5-724e-4415-a5ed-12ce8c9489bc (non-flash)
Nov 13 18:46:01 user nova-compute[75216]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3d195d-b8b4-4c79-a150-813952c640e8 (non-flash)
Nov 13 18:46:01 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 18:46:01 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:de3d195d-b8b4-4c79-a150-813952c640e8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.288s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 18:46:01 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Connected to 172.16.0.220:3260 {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 18:46:01 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=75216) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 18:46:01 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75216) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 18:46:01 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:46:01 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:46:01 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7859af8-3bbb-4719-99de-2429f40d0f9c]: (4, ('- - 0', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:46:01 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75216) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 18:46:01 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:de3d195d-b8b4-4c79-a150-813952c640e8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WTBrHnmk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 18:46:02 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:02 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.321s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 18:46:02 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] <== connect_volume: return (2789ms) {'type': 'block', 'scsi_wwn': '23535363633396136', 'path': '/dev/sdc'} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 18:46:02 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23535363633396136', 'path': '/dev/sdc'} {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 18:46:02 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.289s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 18:46:02 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 18:46:02 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0fc393f0-1356-404f-a87b-bed1fb91b924" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 18:46:02 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0fc393f0-1356-404f-a87b-bed1fb91b924" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 18:46:02 user nova-compute[75216]: INFO os_brick.initiator.connectors.iscsi [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 18:46:02 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fc393f0-1356-404f-a87b-bed1fb91b924 -p 172.16.0.220:3260 {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:46:02 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fc393f0-1356-404f-a87b-bed1fb91b924 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:46:02 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f8e9f4b-d91d-4299-a1e3-1a0e13c9be59]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:46:02 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 18:46:02 user nova-compute[75216]:  {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:46:02 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fc393f0-1356-404f-a87b-bed1fb91b924 -p 172.16.0.220:3260 --interface default --op new {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:46:02 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] Calling os-brick to attach iSCSI Volume {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 18:46:02 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3a8669e40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2a1a5e82-4f70-4668-94bd-4a842d826214', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DYBgeCvJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 18:46:02 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 18:46:02 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 18:46:02 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fc393f0-1356-404f-a87b-bed1fb91b924 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.031s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:46:02 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[fde706e1-2b7b-41ff-82f8-e9482951af52]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0fc393f0-1356-404f-a87b-bed1fb91b924] added\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:46:02 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0fc393f0-1356-404f-a87b-bed1fb91b924] added
Nov 13 18:46:02 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:46:02 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fc393f0-1356-404f-a87b-bed1fb91b924 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:46:02 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fc393f0-1356-404f-a87b-bed1fb91b924 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:46:02 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb92b291-5144-43bd-b605-7772142761b2]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:46:02 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:46:02 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fc393f0-1356-404f-a87b-bed1fb91b924 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:46:02 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fc393f0-1356-404f-a87b-bed1fb91b924 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:46:02 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5d483f2-0a1a-4964-a466-068638b11f34]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:46:02 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:46:02 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fc393f0-1356-404f-a87b-bed1fb91b924 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZsBVjobt {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:46:02 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fc393f0-1356-404f-a87b-bed1fb91b924 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZsBVjobt" returned: 0 in 0.022s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:46:02 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e9a2903-0727-4fc2-a2b2-f89e870d5aef]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:46:02 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZsBVjobt'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:46:02 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fc393f0-1356-404f-a87b-bed1fb91b924 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:46:02 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fc393f0-1356-404f-a87b-bed1fb91b924 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.031s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:46:02 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[1216f62b-e842-4f12-9484-abf910640336]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:46:02 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:46:02 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:46:02 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:46:02 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8f4dcd4-fb6b-4c7d-80f5-7f0dbc1fe6d9]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba1efeb5-724e-4415-a5ed-12ce8c9489bc (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3d195d-b8b4-4c79-a150-813952c640e8 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:594a4406-01d6-4dc2-bfaf-c202774cfc8d (non-flash)\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:46:02 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba1efeb5-724e-4415-a5ed-12ce8c9489bc (non-flash)
Nov 13 18:46:02 user nova-compute[75216]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3d195d-b8b4-4c79-a150-813952c640e8 (non-flash)
Nov 13 18:46:02 user nova-compute[75216]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:594a4406-01d6-4dc2-bfaf-c202774cfc8d (non-flash)
Nov 13 18:46:02 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 18:46:02 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba1efeb5-724e-4415-a5ed-12ce8c9489bc (non-flash)
Nov 13 18:46:02 user nova-compute[75216]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3d195d-b8b4-4c79-a150-813952c640e8 (non-flash)
Nov 13 18:46:02 user nova-compute[75216]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:594a4406-01d6-4dc2-bfaf-c202774cfc8d (non-flash)
Nov 13 18:46:02 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 18:46:02 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fc393f0-1356-404f-a87b-bed1fb91b924 -p 172.16.0.220:3260 --login {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:46:02 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:02 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fc393f0-1356-404f-a87b-bed1fb91b924 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:46:02 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf6be544-a209-4d21-8796-426454670962]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0fc393f0-1356-404f-a87b-bed1fb91b924, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0fc393f0-1356-404f-a87b-bed1fb91b924, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:46:02 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0fc393f0-1356-404f-a87b-bed1fb91b924, portal: 172.16.0.220,3260]
Nov 13 18:46:02 user nova-compute[75216]: Login to [iface: default, target: iqn.2010-10.org.openstack:0fc393f0-1356-404f-a87b-bed1fb91b924, portal: 172.16.0.220,3260] successful.
Nov 13 18:46:02 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:46:02 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fc393f0-1356-404f-a87b-bed1fb91b924 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:46:02 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fc393f0-1356-404f-a87b-bed1fb91b924 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:46:02 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[198763b8-badf-4af2-a470-876771950313]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:46:02 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:46:02 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:46:02 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:46:02 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[b588280a-3513-4409-81e7-b46bc35230bf]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba1efeb5-724e-4415-a5ed-12ce8c9489bc (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3d195d-b8b4-4c79-a150-813952c640e8 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:594a4406-01d6-4dc2-bfaf-c202774cfc8d (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fc393f0-1356-404f-a87b-bed1fb91b924 (non-flash)\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:46:02 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba1efeb5-724e-4415-a5ed-12ce8c9489bc (non-flash)
Nov 13 18:46:02 user nova-compute[75216]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3d195d-b8b4-4c79-a150-813952c640e8 (non-flash)
Nov 13 18:46:02 user nova-compute[75216]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:594a4406-01d6-4dc2-bfaf-c202774cfc8d (non-flash)
Nov 13 18:46:02 user nova-compute[75216]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fc393f0-1356-404f-a87b-bed1fb91b924 (non-flash)
Nov 13 18:46:02 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 18:46:02 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba1efeb5-724e-4415-a5ed-12ce8c9489bc (non-flash)
Nov 13 18:46:02 user nova-compute[75216]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3d195d-b8b4-4c79-a150-813952c640e8 (non-flash)
Nov 13 18:46:02 user nova-compute[75216]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:594a4406-01d6-4dc2-bfaf-c202774cfc8d (non-flash)
Nov 13 18:46:02 user nova-compute[75216]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fc393f0-1356-404f-a87b-bed1fb91b924 (non-flash)
Nov 13 18:46:02 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 18:46:02 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0fc393f0-1356-404f-a87b-bed1fb91b924" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.347s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 18:46:02 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Connected to 172.16.0.220:3260 {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 18:46:02 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=75216) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 18:46:02 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75216) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 18:46:02 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:46:03 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.043s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:46:03 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[38f8429e-aecb-440e-848b-d3d560c3c7bc]: (4, ('- - 0', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:46:03 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75216) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 18:46:03 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:0fc393f0-1356-404f-a87b-bed1fb91b924', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZsBVjobt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 18:46:04 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.412s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 18:46:04 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] <== connect_volume: return (2702ms) {'type': 'block', 'scsi_wwn': '23139623639656237', 'path': '/dev/sde'} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 18:46:04 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23139623639656237', 'path': '/dev/sde'} {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 18:46:04 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.372s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 18:46:04 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 18:46:04 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2a1a5e82-4f70-4668-94bd-4a842d826214" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 18:46:04 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2a1a5e82-4f70-4668-94bd-4a842d826214" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 18:46:04 user nova-compute[75216]: INFO os_brick.initiator.connectors.iscsi [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 18:46:04 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a1a5e82-4f70-4668-94bd-4a842d826214 -p 172.16.0.220:3260 {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:46:04 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a1a5e82-4f70-4668-94bd-4a842d826214 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:46:04 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[34a7ac8d-ec29-42fd-a0f6-077b48bbdedb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:46:04 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 18:46:04 user nova-compute[75216]:  {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:46:04 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a1a5e82-4f70-4668-94bd-4a842d826214 -p 172.16.0.220:3260 --interface default --op new {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:46:04 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Calling os-brick to attach iSCSI Volume {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 18:46:04 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3a8669e40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e823c6a1-f7e2-495f-a5dc-6fdfd2b19cf0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'egXpiAOk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 18:46:04 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 18:46:04 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 18:46:04 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a1a5e82-4f70-4668-94bd-4a842d826214 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:46:04 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[40046dfe-e1b4-4c52-9e68-43b2fc874429]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2a1a5e82-4f70-4668-94bd-4a842d826214] added\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:46:04 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2a1a5e82-4f70-4668-94bd-4a842d826214] added
Nov 13 18:46:04 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:46:04 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a1a5e82-4f70-4668-94bd-4a842d826214 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:46:04 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a1a5e82-4f70-4668-94bd-4a842d826214 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:46:04 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b4e6a13-956e-4282-9458-fb332d814872]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:46:04 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:46:04 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a1a5e82-4f70-4668-94bd-4a842d826214 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:46:04 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a1a5e82-4f70-4668-94bd-4a842d826214 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:46:04 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[62132125-0c52-42e9-b572-c4e0414b7fc0]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:46:04 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:46:04 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a1a5e82-4f70-4668-94bd-4a842d826214 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DYBgeCvJ {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:46:04 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a1a5e82-4f70-4668-94bd-4a842d826214 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DYBgeCvJ" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:46:04 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f75ceab-4f88-4166-b955-026aa2ed4d54]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:46:04 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DYBgeCvJ'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:46:04 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a1a5e82-4f70-4668-94bd-4a842d826214 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:46:04 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a1a5e82-4f70-4668-94bd-4a842d826214 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:46:04 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[f89ed619-92e7-4e53-944f-1424554ca4bc]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:46:04 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:46:04 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:46:04 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:46:04 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb4b9e71-abcb-45bd-b2ff-be187b2d0f7d]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba1efeb5-724e-4415-a5ed-12ce8c9489bc (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3d195d-b8b4-4c79-a150-813952c640e8 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:594a4406-01d6-4dc2-bfaf-c202774cfc8d (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fc393f0-1356-404f-a87b-bed1fb91b924 (non-flash)\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:46:04 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba1efeb5-724e-4415-a5ed-12ce8c9489bc (non-flash)
Nov 13 18:46:04 user nova-compute[75216]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3d195d-b8b4-4c79-a150-813952c640e8 (non-flash)
Nov 13 18:46:04 user nova-compute[75216]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:594a4406-01d6-4dc2-bfaf-c202774cfc8d (non-flash)
Nov 13 18:46:04 user nova-compute[75216]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fc393f0-1356-404f-a87b-bed1fb91b924 (non-flash)
Nov 13 18:46:04 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 18:46:04 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba1efeb5-724e-4415-a5ed-12ce8c9489bc (non-flash)
Nov 13 18:46:04 user nova-compute[75216]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3d195d-b8b4-4c79-a150-813952c640e8 (non-flash)
Nov 13 18:46:04 user nova-compute[75216]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:594a4406-01d6-4dc2-bfaf-c202774cfc8d (non-flash)
Nov 13 18:46:04 user nova-compute[75216]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fc393f0-1356-404f-a87b-bed1fb91b924 (non-flash)
Nov 13 18:46:04 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 18:46:04 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a1a5e82-4f70-4668-94bd-4a842d826214 -p 172.16.0.220:3260 --login {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:46:04 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a1a5e82-4f70-4668-94bd-4a842d826214 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:46:04 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[f31212ff-26bd-47d1-88c8-dd08e0b67e0f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2a1a5e82-4f70-4668-94bd-4a842d826214, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2a1a5e82-4f70-4668-94bd-4a842d826214, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:46:04 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2a1a5e82-4f70-4668-94bd-4a842d826214, portal: 172.16.0.220,3260]
Nov 13 18:46:04 user nova-compute[75216]: Login to [iface: default, target: iqn.2010-10.org.openstack:2a1a5e82-4f70-4668-94bd-4a842d826214, portal: 172.16.0.220,3260] successful.
Nov 13 18:46:04 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:46:04 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a1a5e82-4f70-4668-94bd-4a842d826214 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:46:04 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a1a5e82-4f70-4668-94bd-4a842d826214 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:46:04 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[656dc284-9edf-4141-b256-442c60ab5d71]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:46:04 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:46:04 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:46:04 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:46:04 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[a03a0a3a-6229-46c7-b73d-6789dfbbb5bc]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba1efeb5-724e-4415-a5ed-12ce8c9489bc (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3d195d-b8b4-4c79-a150-813952c640e8 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:594a4406-01d6-4dc2-bfaf-c202774cfc8d (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fc393f0-1356-404f-a87b-bed1fb91b924 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a1a5e82-4f70-4668-94bd-4a842d826214 (non-flash)\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:46:04 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba1efeb5-724e-4415-a5ed-12ce8c9489bc (non-flash)
Nov 13 18:46:04 user nova-compute[75216]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3d195d-b8b4-4c79-a150-813952c640e8 (non-flash)
Nov 13 18:46:04 user nova-compute[75216]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:594a4406-01d6-4dc2-bfaf-c202774cfc8d (non-flash)
Nov 13 18:46:04 user nova-compute[75216]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fc393f0-1356-404f-a87b-bed1fb91b924 (non-flash)
Nov 13 18:46:04 user nova-compute[75216]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a1a5e82-4f70-4668-94bd-4a842d826214 (non-flash)
Nov 13 18:46:04 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 18:46:04 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba1efeb5-724e-4415-a5ed-12ce8c9489bc (non-flash)
Nov 13 18:46:04 user nova-compute[75216]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3d195d-b8b4-4c79-a150-813952c640e8 (non-flash)
Nov 13 18:46:04 user nova-compute[75216]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:594a4406-01d6-4dc2-bfaf-c202774cfc8d (non-flash)
Nov 13 18:46:04 user nova-compute[75216]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fc393f0-1356-404f-a87b-bed1fb91b924 (non-flash)
Nov 13 18:46:04 user nova-compute[75216]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a1a5e82-4f70-4668-94bd-4a842d826214 (non-flash)
Nov 13 18:46:04 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 18:46:04 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2a1a5e82-4f70-4668-94bd-4a842d826214" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.283s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 18:46:04 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Connected to 172.16.0.220:3260 {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 18:46:04 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] HCTL ('37', '-', '-', 0) found on session 6 with lun 0 {{(pid=75216) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 18:46:04 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75216) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 18:46:04 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:46:04 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.015s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:46:04 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c6ea49a-6f00-498e-90ed-a4f45b2b4200]: (4, ('- - 0', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:46:04 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75216) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 18:46:04 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:2a1a5e82-4f70-4668-94bd-4a842d826214', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DYBgeCvJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 18:46:04 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:05 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.315s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 18:46:05 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] <== connect_volume: return (2688ms) {'type': 'block', 'scsi_wwn': '23738633339336666', 'path': '/dev/sdf'} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 18:46:05 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23738633339336666', 'path': '/dev/sdf'} {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 18:46:05 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.276s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 18:46:05 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 18:46:05 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e823c6a1-f7e2-495f-a5dc-6fdfd2b19cf0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 18:46:05 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e823c6a1-f7e2-495f-a5dc-6fdfd2b19cf0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 18:46:05 user nova-compute[75216]: INFO os_brick.initiator.connectors.iscsi [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 18:46:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e823c6a1-f7e2-495f-a5dc-6fdfd2b19cf0 -p 172.16.0.220:3260 {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:46:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e823c6a1-f7e2-495f-a5dc-6fdfd2b19cf0 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:46:05 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[b42deb33-0cce-4782-96f4-2a45c11147ff]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:46:05 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 18:46:05 user nova-compute[75216]:  {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:46:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e823c6a1-f7e2-495f-a5dc-6fdfd2b19cf0 -p 172.16.0.220:3260 --interface default --op new {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:46:05 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] Calling os-brick to attach iSCSI Volume {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 18:46:05 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3a8669e40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:52f4339a-6a47-4877-b041-9c27d7be2e94', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EoteNJdj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 18:46:05 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 18:46:05 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 18:46:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e823c6a1-f7e2-495f-a5dc-6fdfd2b19cf0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:46:05 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a343755-c3df-4bac-b1ff-d0e053218ee8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e823c6a1-f7e2-495f-a5dc-6fdfd2b19cf0] added\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:46:05 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e823c6a1-f7e2-495f-a5dc-6fdfd2b19cf0] added
Nov 13 18:46:05 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:46:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e823c6a1-f7e2-495f-a5dc-6fdfd2b19cf0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:46:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e823c6a1-f7e2-495f-a5dc-6fdfd2b19cf0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:46:05 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[582c549b-0636-46a0-890b-150a2e3aa14d]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:46:05 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:46:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e823c6a1-f7e2-495f-a5dc-6fdfd2b19cf0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:46:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e823c6a1-f7e2-495f-a5dc-6fdfd2b19cf0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:46:05 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b5ead99-03b6-48b2-90b5-2098c6e99415]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:46:05 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:46:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e823c6a1-f7e2-495f-a5dc-6fdfd2b19cf0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v egXpiAOk {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:46:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e823c6a1-f7e2-495f-a5dc-6fdfd2b19cf0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v egXpiAOk" returned: 0 in 0.021s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:46:05 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f42216e-5eb3-4c12-99bc-66113186c709]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:46:05 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'egXpiAOk'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:46:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e823c6a1-f7e2-495f-a5dc-6fdfd2b19cf0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:46:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e823c6a1-f7e2-495f-a5dc-6fdfd2b19cf0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:46:05 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bf7894c-9947-432c-893d-6b5264807857]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:46:05 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:46:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:46:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:46:05 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[58027111-4b16-402e-b13b-8e88a7573fc7]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba1efeb5-724e-4415-a5ed-12ce8c9489bc (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3d195d-b8b4-4c79-a150-813952c640e8 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:594a4406-01d6-4dc2-bfaf-c202774cfc8d (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fc393f0-1356-404f-a87b-bed1fb91b924 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a1a5e82-4f70-4668-94bd-4a842d826214 (non-flash)\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:46:05 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba1efeb5-724e-4415-a5ed-12ce8c9489bc (non-flash)
Nov 13 18:46:05 user nova-compute[75216]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3d195d-b8b4-4c79-a150-813952c640e8 (non-flash)
Nov 13 18:46:05 user nova-compute[75216]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:594a4406-01d6-4dc2-bfaf-c202774cfc8d (non-flash)
Nov 13 18:46:05 user nova-compute[75216]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fc393f0-1356-404f-a87b-bed1fb91b924 (non-flash)
Nov 13 18:46:05 user nova-compute[75216]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a1a5e82-4f70-4668-94bd-4a842d826214 (non-flash)
Nov 13 18:46:05 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 18:46:05 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba1efeb5-724e-4415-a5ed-12ce8c9489bc (non-flash)
Nov 13 18:46:05 user nova-compute[75216]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3d195d-b8b4-4c79-a150-813952c640e8 (non-flash)
Nov 13 18:46:05 user nova-compute[75216]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:594a4406-01d6-4dc2-bfaf-c202774cfc8d (non-flash)
Nov 13 18:46:05 user nova-compute[75216]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fc393f0-1356-404f-a87b-bed1fb91b924 (non-flash)
Nov 13 18:46:05 user nova-compute[75216]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a1a5e82-4f70-4668-94bd-4a842d826214 (non-flash)
Nov 13 18:46:05 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 18:46:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e823c6a1-f7e2-495f-a5dc-6fdfd2b19cf0 -p 172.16.0.220:3260 --login {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:46:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e823c6a1-f7e2-495f-a5dc-6fdfd2b19cf0 -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:46:05 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5a9f555-143e-474e-b7e9-d1971c0ce915]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e823c6a1-f7e2-495f-a5dc-6fdfd2b19cf0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e823c6a1-f7e2-495f-a5dc-6fdfd2b19cf0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:46:05 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e823c6a1-f7e2-495f-a5dc-6fdfd2b19cf0, portal: 172.16.0.220,3260]
Nov 13 18:46:05 user nova-compute[75216]: Login to [iface: default, target: iqn.2010-10.org.openstack:e823c6a1-f7e2-495f-a5dc-6fdfd2b19cf0, portal: 172.16.0.220,3260] successful.
Nov 13 18:46:05 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:46:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e823c6a1-f7e2-495f-a5dc-6fdfd2b19cf0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:46:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e823c6a1-f7e2-495f-a5dc-6fdfd2b19cf0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:46:05 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[30a980e6-1249-432d-ac26-0a42806efd36]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:46:05 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:46:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:46:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:46:05 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4a15950-5f89-4022-adb5-c96067fd5eb1]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba1efeb5-724e-4415-a5ed-12ce8c9489bc (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3d195d-b8b4-4c79-a150-813952c640e8 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:594a4406-01d6-4dc2-bfaf-c202774cfc8d (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fc393f0-1356-404f-a87b-bed1fb91b924 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a1a5e82-4f70-4668-94bd-4a842d826214 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e823c6a1-f7e2-495f-a5dc-6fdfd2b19cf0 (non-flash)\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:46:05 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba1efeb5-724e-4415-a5ed-12ce8c9489bc (non-flash)
Nov 13 18:46:05 user nova-compute[75216]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3d195d-b8b4-4c79-a150-813952c640e8 (non-flash)
Nov 13 18:46:05 user nova-compute[75216]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:594a4406-01d6-4dc2-bfaf-c202774cfc8d (non-flash)
Nov 13 18:46:05 user nova-compute[75216]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fc393f0-1356-404f-a87b-bed1fb91b924 (non-flash)
Nov 13 18:46:05 user nova-compute[75216]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a1a5e82-4f70-4668-94bd-4a842d826214 (non-flash)
Nov 13 18:46:05 user nova-compute[75216]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e823c6a1-f7e2-495f-a5dc-6fdfd2b19cf0 (non-flash)
Nov 13 18:46:05 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 18:46:05 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba1efeb5-724e-4415-a5ed-12ce8c9489bc (non-flash)
Nov 13 18:46:05 user nova-compute[75216]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3d195d-b8b4-4c79-a150-813952c640e8 (non-flash)
Nov 13 18:46:05 user nova-compute[75216]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:594a4406-01d6-4dc2-bfaf-c202774cfc8d (non-flash)
Nov 13 18:46:05 user nova-compute[75216]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fc393f0-1356-404f-a87b-bed1fb91b924 (non-flash)
Nov 13 18:46:05 user nova-compute[75216]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a1a5e82-4f70-4668-94bd-4a842d826214 (non-flash)
Nov 13 18:46:05 user nova-compute[75216]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e823c6a1-f7e2-495f-a5dc-6fdfd2b19cf0 (non-flash)
Nov 13 18:46:05 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 18:46:05 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e823c6a1-f7e2-495f-a5dc-6fdfd2b19cf0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.311s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 18:46:05 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Connected to 172.16.0.220:3260 {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 18:46:05 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] HCTL ('38', '-', '-', 0) found on session 7 with lun 0 {{(pid=75216) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 18:46:05 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75216) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 18:46:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:46:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.019s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:46:05 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[4603e435-1bd2-46d8-bef1-d24b3335693b]: (4, ('- - 0', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:46:05 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Searching for a device in session 7 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75216) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 18:46:05 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:e823c6a1-f7e2-495f-a5dc-6fdfd2b19cf0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'egXpiAOk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 18:46:06 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:06 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.348s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 18:46:06 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] <== connect_volume: return (2625ms) {'type': 'block', 'scsi_wwn': '23136366239626230', 'path': '/dev/sdg'} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 18:46:06 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23136366239626230', 'path': '/dev/sdg'} {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 18:46:06 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.323s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 18:46:06 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 18:46:06 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:52f4339a-6a47-4877-b041-9c27d7be2e94" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 18:46:06 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:52f4339a-6a47-4877-b041-9c27d7be2e94" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 18:46:06 user nova-compute[75216]: INFO os_brick.initiator.connectors.iscsi [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 18:46:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52f4339a-6a47-4877-b041-9c27d7be2e94 -p 172.16.0.220:3260 {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:46:06 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T18:45:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1463949560',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1463949560',id=10,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJx1T0XvsP0KOjgfjqi1q2on3nFgwBDJFjn7Y8e88Ig7TPicxUto3+yVPGSHigorr0YsRdHzdX17JooejloMPwKeQjFAdOrZNu9nCzVwcWfb8i+XfefIuuJFu8o61w00DA==',key_name='tempest-keypair-103032790',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='046be82514bf4c3483f8b3b8f2299b96',ramdisk_id='',reservation_id='r-k6do0zkd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1270684031',owner_user_name='tempest-TaggedBootDevicesTest-1270684031-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T18:45:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1ceef8ad05744447bcbf29460f62e32a',uuid=78605259-17bf-47da-86de-3c76ac1c5bfa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6b91caf7-7b72-41be-8cf7-96e728c0eae5", "address": "fa:16:3e:22:29:78", "network": {"id": "65bd62c0-ccfd-486a-a4e4-eafe4e4f587f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-92675676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "046be82514bf4c3483f8b3b8f2299b96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b91caf7-7b", "ovs_interfaceid": "6b91caf7-7b72-41be-8cf7-96e728c0eae5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75216) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 18:46:06 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Converting VIF {"id": "6b91caf7-7b72-41be-8cf7-96e728c0eae5", "address": "fa:16:3e:22:29:78", "network": {"id": "65bd62c0-ccfd-486a-a4e4-eafe4e4f587f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-92675676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "046be82514bf4c3483f8b3b8f2299b96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b91caf7-7b", "ovs_interfaceid": "6b91caf7-7b72-41be-8cf7-96e728c0eae5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 18:46:06 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:29:78,bridge_name='br-int',has_traffic_filtering=True,id=6b91caf7-7b72-41be-8cf7-96e728c0eae5,network=Network(65bd62c0-ccfd-486a-a4e4-eafe4e4f587f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b91caf7-7b') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 18:46:06 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T18:45:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1463949560',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1463949560',id=10,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJx1T0XvsP0KOjgfjqi1q2on3nFgwBDJFjn7Y8e88Ig7TPicxUto3+yVPGSHigorr0YsRdHzdX17JooejloMPwKeQjFAdOrZNu9nCzVwcWfb8i+XfefIuuJFu8o61w00DA==',key_name='tempest-keypair-103032790',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='046be82514bf4c3483f8b3b8f2299b96',ramdisk_id='',reservation_id='r-k6do0zkd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1270684031',owner_user_name='tempest-TaggedBootDevicesTest-1270684031-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T18:45:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1ceef8ad05744447bcbf29460f62e32a',uuid=78605259-17bf-47da-86de-3c76ac1c5bfa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7c9f8c17-a293-4817-ae4f-3fab0a1076a6", "address": "fa:16:3e:bc:93:0e", "network": {"id": "badd6fc4-dc5e-4623-b319-4969f674705f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1322270738", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.246", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "046be82514bf4c3483f8b3b8f2299b96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c9f8c17-a2", "ovs_interfaceid": "7c9f8c17-a293-4817-ae4f-3fab0a1076a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75216) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 18:46:06 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Converting VIF {"id": "7c9f8c17-a293-4817-ae4f-3fab0a1076a6", "address": "fa:16:3e:bc:93:0e", "network": {"id": "badd6fc4-dc5e-4623-b319-4969f674705f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1322270738", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.246", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "046be82514bf4c3483f8b3b8f2299b96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c9f8c17-a2", "ovs_interfaceid": "7c9f8c17-a293-4817-ae4f-3fab0a1076a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 18:46:06 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:93:0e,bridge_name='br-int',has_traffic_filtering=True,id=7c9f8c17-a293-4817-ae4f-3fab0a1076a6,network=Network(badd6fc4-dc5e-4623-b319-4969f674705f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7c9f8c17-a2') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 18:46:06 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T18:45:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1463949560',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1463949560',id=10,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJx1T0XvsP0KOjgfjqi1q2on3nFgwBDJFjn7Y8e88Ig7TPicxUto3+yVPGSHigorr0YsRdHzdX17JooejloMPwKeQjFAdOrZNu9nCzVwcWfb8i+XfefIuuJFu8o61w00DA==',key_name='tempest-keypair-103032790',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='046be82514bf4c3483f8b3b8f2299b96',ramdisk_id='',reservation_id='r-k6do0zkd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1270684031',owner_user_name='tempest-TaggedBootDevicesTest-1270684031-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T18:45:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1ceef8ad05744447bcbf29460f62e32a',uuid=78605259-17bf-47da-86de-3c76ac1c5bfa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c5b1d8e6-f202-4278-924c-abecf64f299c", "address": "fa:16:3e:a1:c9:75", "network": {"id": "badd6fc4-dc5e-4623-b319-4969f674705f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1322270738", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.53", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "046be82514bf4c3483f8b3b8f2299b96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5b1d8e6-f2", "ovs_interfaceid": "c5b1d8e6-f202-4278-924c-abecf64f299c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75216) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 18:46:06 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Converting VIF {"id": "c5b1d8e6-f202-4278-924c-abecf64f299c", "address": "fa:16:3e:a1:c9:75", "network": {"id": "badd6fc4-dc5e-4623-b319-4969f674705f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1322270738", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.53", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "046be82514bf4c3483f8b3b8f2299b96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5b1d8e6-f2", "ovs_interfaceid": "c5b1d8e6-f202-4278-924c-abecf64f299c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 18:46:06 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:c9:75,bridge_name='br-int',has_traffic_filtering=True,id=c5b1d8e6-f202-4278-924c-abecf64f299c,network=Network(badd6fc4-dc5e-4623-b319-4969f674705f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc5b1d8e6-f2') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 18:46:06 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T18:45:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1463949560',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1463949560',id=10,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJx1T0XvsP0KOjgfjqi1q2on3nFgwBDJFjn7Y8e88Ig7TPicxUto3+yVPGSHigorr0YsRdHzdX17JooejloMPwKeQjFAdOrZNu9nCzVwcWfb8i+XfefIuuJFu8o61w00DA==',key_name='tempest-keypair-103032790',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='046be82514bf4c3483f8b3b8f2299b96',ramdisk_id='',reservation_id='r-k6do0zkd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1270684031',owner_user_name='tempest-TaggedBootDevicesTest-1270684031-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T18:45:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1ceef8ad05744447bcbf29460f62e32a',uuid=78605259-17bf-47da-86de-3c76ac1c5bfa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5c412896-2c62-4248-a888-9b0612378259", "address": "fa:16:3e:47:55:1a", "network": {"id": "badd6fc4-dc5e-4623-b319-4969f674705f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1322270738", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "046be82514bf4c3483f8b3b8f2299b96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c412896-2c", "ovs_interfaceid": "5c412896-2c62-4248-a888-9b0612378259", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75216) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 18:46:06 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Converting VIF {"id": "5c412896-2c62-4248-a888-9b0612378259", "address": "fa:16:3e:47:55:1a", "network": {"id": "badd6fc4-dc5e-4623-b319-4969f674705f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1322270738", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "046be82514bf4c3483f8b3b8f2299b96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c412896-2c", "ovs_interfaceid": "5c412896-2c62-4248-a888-9b0612378259", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 18:46:06 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:55:1a,bridge_name='br-int',has_traffic_filtering=True,id=5c412896-2c62-4248-a888-9b0612378259,network=Network(badd6fc4-dc5e-4623-b319-4969f674705f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c412896-2c') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 18:46:06 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T18:45:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1463949560',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1463949560',id=10,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJx1T0XvsP0KOjgfjqi1q2on3nFgwBDJFjn7Y8e88Ig7TPicxUto3+yVPGSHigorr0YsRdHzdX17JooejloMPwKeQjFAdOrZNu9nCzVwcWfb8i+XfefIuuJFu8o61w00DA==',key_name='tempest-keypair-103032790',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='046be82514bf4c3483f8b3b8f2299b96',ramdisk_id='',reservation_id='r-k6do0zkd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1270684031',owner_user_name='tempest-TaggedBootDevicesTest-1270684031-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T18:45:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1ceef8ad05744447bcbf29460f62e32a',uuid=78605259-17bf-47da-86de-3c76ac1c5bfa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e4e34ea8-fb99-4a0e-8b65-a93933cc7d6b", "address": "fa:16:3e:a8:83:c9", "network": {"id": "badd6fc4-dc5e-4623-b319-4969f674705f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1322270738", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "046be82514bf4c3483f8b3b8f2299b96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4e34ea8-fb", "ovs_interfaceid": "e4e34ea8-fb99-4a0e-8b65-a93933cc7d6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75216) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 18:46:06 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Converting VIF {"id": "e4e34ea8-fb99-4a0e-8b65-a93933cc7d6b", "address": "fa:16:3e:a8:83:c9", "network": {"id": "badd6fc4-dc5e-4623-b319-4969f674705f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1322270738", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "046be82514bf4c3483f8b3b8f2299b96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4e34ea8-fb", "ovs_interfaceid": "e4e34ea8-fb99-4a0e-8b65-a93933cc7d6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 18:46:06 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:83:c9,bridge_name='br-int',has_traffic_filtering=True,id=e4e34ea8-fb99-4a0e-8b65-a93933cc7d6b,network=Network(badd6fc4-dc5e-4623-b319-4969f674705f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4e34ea8-fb') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 18:46:06 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T18:45:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1463949560',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1463949560',id=10,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJx1T0XvsP0KOjgfjqi1q2on3nFgwBDJFjn7Y8e88Ig7TPicxUto3+yVPGSHigorr0YsRdHzdX17JooejloMPwKeQjFAdOrZNu9nCzVwcWfb8i+XfefIuuJFu8o61w00DA==',key_name='tempest-keypair-103032790',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='046be82514bf4c3483f8b3b8f2299b96',ramdisk_id='',reservation_id='r-k6do0zkd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1270684031',owner_user_name='tempest-TaggedBootDevicesTest-1270684031-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T18:45:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1ceef8ad05744447bcbf29460f62e32a',uuid=78605259-17bf-47da-86de-3c76ac1c5bfa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7b6ed148-b7c9-479b-9e2d-cfc0c3f6f93a", "address": "fa:16:3e:e4:db:d9", "network": {"id": "debccb89-bf2d-40a9-b114-b1bb2e913648", "bridge": "br-int", "label": "tempest-device-tagging-net2-185988930", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "046be82514bf4c3483f8b3b8f2299b96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b6ed148-b7", "ovs_interfaceid": "7b6ed148-b7c9-479b-9e2d-cfc0c3f6f93a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75216) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 18:46:06 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Converting VIF {"id": "7b6ed148-b7c9-479b-9e2d-cfc0c3f6f93a", "address": "fa:16:3e:e4:db:d9", "network": {"id": "debccb89-bf2d-40a9-b114-b1bb2e913648", "bridge": "br-int", "label": "tempest-device-tagging-net2-185988930", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "046be82514bf4c3483f8b3b8f2299b96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b6ed148-b7", "ovs_interfaceid": "7b6ed148-b7c9-479b-9e2d-cfc0c3f6f93a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 18:46:06 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:db:d9,bridge_name='br-int',has_traffic_filtering=True,id=7b6ed148-b7c9-479b-9e2d-cfc0c3f6f93a,network=Network(debccb89-bf2d-40a9-b114-b1bb2e913648),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b6ed148-b7') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 18:46:06 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T18:45:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1463949560',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1463949560',id=10,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJx1T0XvsP0KOjgfjqi1q2on3nFgwBDJFjn7Y8e88Ig7TPicxUto3+yVPGSHigorr0YsRdHzdX17JooejloMPwKeQjFAdOrZNu9nCzVwcWfb8i+XfefIuuJFu8o61w00DA==',key_name='tempest-keypair-103032790',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='046be82514bf4c3483f8b3b8f2299b96',ramdisk_id='',reservation_id='r-k6do0zkd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1270684031',owner_user_name='tempest-TaggedBootDevicesTest-1270684031-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T18:45:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1ceef8ad05744447bcbf29460f62e32a',uuid=78605259-17bf-47da-86de-3c76ac1c5bfa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "815d1175-2997-4d74-8f35-7ca982cf46aa", "address": "fa:16:3e:2c:4b:72", "network": {"id": "debccb89-bf2d-40a9-b114-b1bb2e913648", "bridge": "br-int", "label": "tempest-device-tagging-net2-185988930", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "046be82514bf4c3483f8b3b8f2299b96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap815d1175-29", "ovs_interfaceid": "815d1175-2997-4d74-8f35-7ca982cf46aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75216) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 18:46:06 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Converting VIF {"id": "815d1175-2997-4d74-8f35-7ca982cf46aa", "address": "fa:16:3e:2c:4b:72", "network": {"id": "debccb89-bf2d-40a9-b114-b1bb2e913648", "bridge": "br-int", "label": "tempest-device-tagging-net2-185988930", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "046be82514bf4c3483f8b3b8f2299b96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap815d1175-29", "ovs_interfaceid": "815d1175-2997-4d74-8f35-7ca982cf46aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 18:46:06 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2c:4b:72,bridge_name='br-int',has_traffic_filtering=True,id=815d1175-2997-4d74-8f35-7ca982cf46aa,network=Network(debccb89-bf2d-40a9-b114-b1bb2e913648),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap815d1175-29') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 18:46:06 user nova-compute[75216]: DEBUG nova.objects.instance [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Lazy-loading 'pci_devices' on Instance uuid 78605259-17bf-47da-86de-3c76ac1c5bfa {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 18:46:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52f4339a-6a47-4877-b041-9c27d7be2e94 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:46:06 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[7646384e-4ba3-4d89-860b-8a0e5953474d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:46:06 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 18:46:06 user nova-compute[75216]:  {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:46:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52f4339a-6a47-4877-b041-9c27d7be2e94 -p 172.16.0.220:3260 --interface default --op new {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:46:06 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] End _get_guest_xml xml=<domain type="kvm">
Nov 13 18:46:06 user nova-compute[75216]:   <uuid>78605259-17bf-47da-86de-3c76ac1c5bfa</uuid>
Nov 13 18:46:06 user nova-compute[75216]:   <name>instance-0000000a</name>
Nov 13 18:46:06 user nova-compute[75216]:   <memory>524288</memory>
Nov 13 18:46:06 user nova-compute[75216]:   <vcpu>1</vcpu>
Nov 13 18:46:06 user nova-compute[75216]:   <metadata>
Nov 13 18:46:06 user nova-compute[75216]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 18:46:06 user nova-compute[75216]:       <nova:package version="0.0.0"/>
Nov 13 18:46:06 user nova-compute[75216]:       <nova:name>tempest-device-tagging-server-1463949560</nova:name>
Nov 13 18:46:06 user nova-compute[75216]:       <nova:creationTime>2023-11-13 18:45:59</nova:creationTime>
Nov 13 18:46:06 user nova-compute[75216]:       <nova:flavor name="m1.tiny">
Nov 13 18:46:06 user nova-compute[75216]:         <nova:memory>512</nova:memory>
Nov 13 18:46:06 user nova-compute[75216]:         <nova:disk>1</nova:disk>
Nov 13 18:46:06 user nova-compute[75216]:         <nova:swap>0</nova:swap>
Nov 13 18:46:06 user nova-compute[75216]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 18:46:06 user nova-compute[75216]:         <nova:vcpus>1</nova:vcpus>
Nov 13 18:46:06 user nova-compute[75216]:       </nova:flavor>
Nov 13 18:46:06 user nova-compute[75216]:       <nova:owner>
Nov 13 18:46:06 user nova-compute[75216]:         <nova:user uuid="1ceef8ad05744447bcbf29460f62e32a">tempest-TaggedBootDevicesTest-1270684031-project-member</nova:user>
Nov 13 18:46:06 user nova-compute[75216]:         <nova:project uuid="046be82514bf4c3483f8b3b8f2299b96">tempest-TaggedBootDevicesTest-1270684031</nova:project>
Nov 13 18:46:06 user nova-compute[75216]:       </nova:owner>
Nov 13 18:46:06 user nova-compute[75216]:       <nova:root type="image" uuid="77bcb5ba-8510-41ec-a88d-96097bb431de"/>
Nov 13 18:46:06 user nova-compute[75216]:       <nova:ports>
Nov 13 18:46:06 user nova-compute[75216]:         <nova:port uuid="6b91caf7-7b72-41be-8cf7-96e728c0eae5">
Nov 13 18:46:06 user nova-compute[75216]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 13 18:46:06 user nova-compute[75216]:         </nova:port>
Nov 13 18:46:06 user nova-compute[75216]:         <nova:port uuid="7c9f8c17-a293-4817-ae4f-3fab0a1076a6">
Nov 13 18:46:06 user nova-compute[75216]:           <nova:ip type="fixed" address="10.1.1.246" ipVersion="4"/>
Nov 13 18:46:06 user nova-compute[75216]:         </nova:port>
Nov 13 18:46:06 user nova-compute[75216]:         <nova:port uuid="c5b1d8e6-f202-4278-924c-abecf64f299c">
Nov 13 18:46:06 user nova-compute[75216]:           <nova:ip type="fixed" address="10.1.1.53" ipVersion="4"/>
Nov 13 18:46:06 user nova-compute[75216]:         </nova:port>
Nov 13 18:46:06 user nova-compute[75216]:         <nova:port uuid="5c412896-2c62-4248-a888-9b0612378259">
Nov 13 18:46:06 user nova-compute[75216]:           <nova:ip type="fixed" address="10.1.1.12" ipVersion="4"/>
Nov 13 18:46:06 user nova-compute[75216]:         </nova:port>
Nov 13 18:46:06 user nova-compute[75216]:         <nova:port uuid="e4e34ea8-fb99-4a0e-8b65-a93933cc7d6b">
Nov 13 18:46:06 user nova-compute[75216]:           <nova:ip type="fixed" address="10.1.1.219" ipVersion="4"/>
Nov 13 18:46:06 user nova-compute[75216]:         </nova:port>
Nov 13 18:46:06 user nova-compute[75216]:         <nova:port uuid="7b6ed148-b7c9-479b-9e2d-cfc0c3f6f93a">
Nov 13 18:46:06 user nova-compute[75216]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 13 18:46:06 user nova-compute[75216]:         </nova:port>
Nov 13 18:46:06 user nova-compute[75216]:         <nova:port uuid="815d1175-2997-4d74-8f35-7ca982cf46aa">
Nov 13 18:46:06 user nova-compute[75216]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 13 18:46:06 user nova-compute[75216]:         </nova:port>
Nov 13 18:46:06 user nova-compute[75216]:       </nova:ports>
Nov 13 18:46:06 user nova-compute[75216]:     </nova:instance>
Nov 13 18:46:06 user nova-compute[75216]:   </metadata>
Nov 13 18:46:06 user nova-compute[75216]:   <sysinfo type="smbios">
Nov 13 18:46:06 user nova-compute[75216]:     <system>
Nov 13 18:46:06 user nova-compute[75216]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 18:46:06 user nova-compute[75216]:       <entry name="product">OpenStack Nova</entry>
Nov 13 18:46:06 user nova-compute[75216]:       <entry name="version">0.0.0</entry>
Nov 13 18:46:06 user nova-compute[75216]:       <entry name="serial">78605259-17bf-47da-86de-3c76ac1c5bfa</entry>
Nov 13 18:46:06 user nova-compute[75216]:       <entry name="uuid">78605259-17bf-47da-86de-3c76ac1c5bfa</entry>
Nov 13 18:46:06 user nova-compute[75216]:       <entry name="family">Virtual Machine</entry>
Nov 13 18:46:06 user nova-compute[75216]:     </system>
Nov 13 18:46:06 user nova-compute[75216]:   </sysinfo>
Nov 13 18:46:06 user nova-compute[75216]:   <os>
Nov 13 18:46:06 user nova-compute[75216]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 18:46:06 user nova-compute[75216]:     <boot dev="hd"/>
Nov 13 18:46:06 user nova-compute[75216]:     <smbios mode="sysinfo"/>
Nov 13 18:46:06 user nova-compute[75216]:   </os>
Nov 13 18:46:06 user nova-compute[75216]:   <features>
Nov 13 18:46:06 user nova-compute[75216]:     <acpi/>
Nov 13 18:46:06 user nova-compute[75216]:     <apic/>
Nov 13 18:46:06 user nova-compute[75216]:     <vmcoreinfo/>
Nov 13 18:46:06 user nova-compute[75216]:   </features>
Nov 13 18:46:06 user nova-compute[75216]:   <clock offset="utc">
Nov 13 18:46:06 user nova-compute[75216]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 18:46:06 user nova-compute[75216]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 18:46:06 user nova-compute[75216]:     <timer name="hpet" present="no"/>
Nov 13 18:46:06 user nova-compute[75216]:   </clock>
Nov 13 18:46:06 user nova-compute[75216]:   <cpu mode="custom" match="exact">
Nov 13 18:46:06 user nova-compute[75216]:     <model>Nehalem</model>
Nov 13 18:46:06 user nova-compute[75216]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 18:46:06 user nova-compute[75216]:   </cpu>
Nov 13 18:46:06 user nova-compute[75216]:   <devices>
Nov 13 18:46:06 user nova-compute[75216]:     <disk type="file" device="cdrom">
Nov 13 18:46:06 user nova-compute[75216]:       <driver name="qemu" type="raw" cache="none"/>
Nov 13 18:46:06 user nova-compute[75216]:       <source file="/opt/stack/data/nova/instances/78605259-17bf-47da-86de-3c76ac1c5bfa/disk.config"/>
Nov 13 18:46:06 user nova-compute[75216]:       <target dev="hda" bus="ide"/>
Nov 13 18:46:06 user nova-compute[75216]:     </disk>
Nov 13 18:46:06 user nova-compute[75216]:     <disk type="block" device="disk">
Nov 13 18:46:06 user nova-compute[75216]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 18:46:06 user nova-compute[75216]:       <source dev="/dev/sdb"/>
Nov 13 18:46:06 user nova-compute[75216]:       <target dev="vda" bus="virtio"/>
Nov 13 18:46:06 user nova-compute[75216]:       <serial>ba1efeb5-724e-4415-a5ed-12ce8c9489bc</serial>
Nov 13 18:46:06 user nova-compute[75216]:     </disk>
Nov 13 18:46:06 user nova-compute[75216]:     <disk type="block" device="disk">
Nov 13 18:46:06 user nova-compute[75216]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 18:46:06 user nova-compute[75216]:       <source dev="/dev/sde"/>
Nov 13 18:46:06 user nova-compute[75216]:       <target dev="vdb" bus="virtio"/>
Nov 13 18:46:06 user nova-compute[75216]:       <serial>0fc393f0-1356-404f-a87b-bed1fb91b924</serial>
Nov 13 18:46:06 user nova-compute[75216]:     </disk>
Nov 13 18:46:06 user nova-compute[75216]:     <disk type="block" device="disk">
Nov 13 18:46:06 user nova-compute[75216]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 18:46:06 user nova-compute[75216]:       <source dev="/dev/sdg"/>
Nov 13 18:46:06 user nova-compute[75216]:       <target dev="vdc" bus="virtio"/>
Nov 13 18:46:06 user nova-compute[75216]:       <serial>e823c6a1-f7e2-495f-a5dc-6fdfd2b19cf0</serial>
Nov 13 18:46:06 user nova-compute[75216]:     </disk>
Nov 13 18:46:06 user nova-compute[75216]:     <interface type="ethernet">
Nov 13 18:46:06 user nova-compute[75216]:       <mac address="fa:16:3e:22:29:78"/>
Nov 13 18:46:06 user nova-compute[75216]:       <model type="virtio"/>
Nov 13 18:46:06 user nova-compute[75216]:       <mtu size="1442"/>
Nov 13 18:46:06 user nova-compute[75216]:       <target dev="tap6b91caf7-7b"/>
Nov 13 18:46:06 user nova-compute[75216]:     </interface>
Nov 13 18:46:06 user nova-compute[75216]:     <interface type="ethernet">
Nov 13 18:46:06 user nova-compute[75216]:       <mac address="fa:16:3e:bc:93:0e"/>
Nov 13 18:46:06 user nova-compute[75216]:       <model type="virtio"/>
Nov 13 18:46:06 user nova-compute[75216]:       <mtu size="1442"/>
Nov 13 18:46:06 user nova-compute[75216]:       <target dev="tap7c9f8c17-a2"/>
Nov 13 18:46:06 user nova-compute[75216]:     </interface>
Nov 13 18:46:06 user nova-compute[75216]:     <interface type="ethernet">
Nov 13 18:46:06 user nova-compute[75216]:       <mac address="fa:16:3e:a1:c9:75"/>
Nov 13 18:46:06 user nova-compute[75216]:       <model type="virtio"/>
Nov 13 18:46:06 user nova-compute[75216]:       <mtu size="1442"/>
Nov 13 18:46:06 user nova-compute[75216]:       <target dev="tapc5b1d8e6-f2"/>
Nov 13 18:46:06 user nova-compute[75216]:     </interface>
Nov 13 18:46:06 user nova-compute[75216]:     <interface type="ethernet">
Nov 13 18:46:06 user nova-compute[75216]:       <mac address="fa:16:3e:47:55:1a"/>
Nov 13 18:46:06 user nova-compute[75216]:       <model type="virtio"/>
Nov 13 18:46:06 user nova-compute[75216]:       <mtu size="1442"/>
Nov 13 18:46:06 user nova-compute[75216]:       <target dev="tap5c412896-2c"/>
Nov 13 18:46:06 user nova-compute[75216]:     </interface>
Nov 13 18:46:06 user nova-compute[75216]:     <interface type="ethernet">
Nov 13 18:46:06 user nova-compute[75216]:       <mac address="fa:16:3e:a8:83:c9"/>
Nov 13 18:46:06 user nova-compute[75216]:       <model type="virtio"/>
Nov 13 18:46:06 user nova-compute[75216]:       <mtu size="1442"/>
Nov 13 18:46:06 user nova-compute[75216]:       <target dev="tape4e34ea8-fb"/>
Nov 13 18:46:06 user nova-compute[75216]:     </interface>
Nov 13 18:46:06 user nova-compute[75216]:     <interface type="ethernet">
Nov 13 18:46:06 user nova-compute[75216]:       <mac address="fa:16:3e:e4:db:d9"/>
Nov 13 18:46:06 user nova-compute[75216]:       <model type="virtio"/>
Nov 13 18:46:06 user nova-compute[75216]:       <mtu size="1442"/>
Nov 13 18:46:06 user nova-compute[75216]:       <target dev="tap7b6ed148-b7"/>
Nov 13 18:46:06 user nova-compute[75216]:     </interface>
Nov 13 18:46:06 user nova-compute[75216]:     <interface type="ethernet">
Nov 13 18:46:06 user nova-compute[75216]:       <mac address="fa:16:3e:2c:4b:72"/>
Nov 13 18:46:06 user nova-compute[75216]:       <model type="virtio"/>
Nov 13 18:46:06 user nova-compute[75216]:       <mtu size="1442"/>
Nov 13 18:46:06 user nova-compute[75216]:       <target dev="tap815d1175-29"/>
Nov 13 18:46:06 user nova-compute[75216]:     </interface>
Nov 13 18:46:06 user nova-compute[75216]:     <serial type="pty">
Nov 13 18:46:06 user nova-compute[75216]:       <log file="/opt/stack/data/nova/instances/78605259-17bf-47da-86de-3c76ac1c5bfa/console.log" append="off"/>
Nov 13 18:46:06 user nova-compute[75216]:     </serial>
Nov 13 18:46:06 user nova-compute[75216]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 18:46:06 user nova-compute[75216]:     <video>
Nov 13 18:46:06 user nova-compute[75216]:       <model type="virtio"/>
Nov 13 18:46:06 user nova-compute[75216]:     </video>
Nov 13 18:46:06 user nova-compute[75216]:     <rng model="virtio">
Nov 13 18:46:06 user nova-compute[75216]:       <backend model="random">/dev/urandom</backend>
Nov 13 18:46:06 user nova-compute[75216]:     </rng>
Nov 13 18:46:06 user nova-compute[75216]:     <controller type="usb" index="0" model="none"/>
Nov 13 18:46:06 user nova-compute[75216]:     <memballoon model="virtio">
Nov 13 18:46:06 user nova-compute[75216]:       <stats period="10"/>
Nov 13 18:46:06 user nova-compute[75216]:     </memballoon>
Nov 13 18:46:06 user nova-compute[75216]:   </devices>
Nov 13 18:46:06 user nova-compute[75216]: </domain>
Nov 13 18:46:06 user nova-compute[75216]:  {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 18:46:06 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T18:45:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1463949560',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1463949560',id=10,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJx1T0XvsP0KOjgfjqi1q2on3nFgwBDJFjn7Y8e88Ig7TPicxUto3+yVPGSHigorr0YsRdHzdX17JooejloMPwKeQjFAdOrZNu9nCzVwcWfb8i+XfefIuuJFu8o61w00DA==',key_name='tempest-keypair-103032790',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='046be82514bf4c3483f8b3b8f2299b96',ramdisk_id='',reservation_id='r-k6do0zkd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1270684031',owner_user_name='tempest-TaggedBootDevicesTest-1270684031-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T18:45:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1ceef8ad05744447bcbf29460f62e32a',uuid=78605259-17bf-47da-86de-3c76ac1c5bfa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6b91caf7-7b72-41be-8cf7-96e728c0eae5", "address": "fa:16:3e:22:29:78", "network": {"id": "65bd62c0-ccfd-486a-a4e4-eafe4e4f587f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-92675676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "046be82514bf4c3483f8b3b8f2299b96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b91caf7-7b", "ovs_interfaceid": "6b91caf7-7b72-41be-8cf7-96e728c0eae5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 18:46:06 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Converting VIF {"id": "6b91caf7-7b72-41be-8cf7-96e728c0eae5", "address": "fa:16:3e:22:29:78", "network": {"id": "65bd62c0-ccfd-486a-a4e4-eafe4e4f587f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-92675676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "046be82514bf4c3483f8b3b8f2299b96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b91caf7-7b", "ovs_interfaceid": "6b91caf7-7b72-41be-8cf7-96e728c0eae5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 18:46:06 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:29:78,bridge_name='br-int',has_traffic_filtering=True,id=6b91caf7-7b72-41be-8cf7-96e728c0eae5,network=Network(65bd62c0-ccfd-486a-a4e4-eafe4e4f587f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b91caf7-7b') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 18:46:06 user nova-compute[75216]: DEBUG os_vif [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:29:78,bridge_name='br-int',has_traffic_filtering=True,id=6b91caf7-7b72-41be-8cf7-96e728c0eae5,network=Network(65bd62c0-ccfd-486a-a4e4-eafe4e4f587f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b91caf7-7b') {{(pid=75216) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 18:46:06 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:06 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:46:06 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 18:46:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52f4339a-6a47-4877-b041-9c27d7be2e94 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:46:06 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[2de82b8c-0811-4e9c-b6df-78d06ce07e54]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:52f4339a-6a47-4877-b041-9c27d7be2e94] added\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:46:06 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:06 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '01785f74-6f0d-52aa-9295-de7e25e14b44', '_type': 'linux-noop'}}, row=False) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:46:06 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:52f4339a-6a47-4877-b041-9c27d7be2e94] added
Nov 13 18:46:06 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:46:06 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52f4339a-6a47-4877-b041-9c27d7be2e94 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:46:06 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:46:06 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:06 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6b91caf7-7b, may_exist=True, interface_attrs={}) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:46:06 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6b91caf7-7b, col_values=(('qos', UUID('ba539905-93a1-4cee-93dd-12c83a79b3da')),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:46:06 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6b91caf7-7b, col_values=(('external_ids', {'iface-id': '6b91caf7-7b72-41be-8cf7-96e728c0eae5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:22:29:78', 'vm-uuid': '78605259-17bf-47da-86de-3c76ac1c5bfa'}),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:46:06 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:06 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:46:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52f4339a-6a47-4877-b041-9c27d7be2e94 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:46:06 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[c03c7838-6bd8-4cfd-8934-9ff2c998d93c]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:46:06 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:46:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52f4339a-6a47-4877-b041-9c27d7be2e94 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:46:06 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:06 user nova-compute[75216]: INFO os_vif [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:29:78,bridge_name='br-int',has_traffic_filtering=True,id=6b91caf7-7b72-41be-8cf7-96e728c0eae5,network=Network(65bd62c0-ccfd-486a-a4e4-eafe4e4f587f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b91caf7-7b')
Nov 13 18:46:06 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T18:45:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1463949560',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1463949560',id=10,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJx1T0XvsP0KOjgfjqi1q2on3nFgwBDJFjn7Y8e88Ig7TPicxUto3+yVPGSHigorr0YsRdHzdX17JooejloMPwKeQjFAdOrZNu9nCzVwcWfb8i+XfefIuuJFu8o61w00DA==',key_name='tempest-keypair-103032790',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='046be82514bf4c3483f8b3b8f2299b96',ramdisk_id='',reservation_id='r-k6do0zkd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1270684031',owner_user_name='tempest-TaggedBootDevicesTest-1270684031-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T18:45:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1ceef8ad05744447bcbf29460f62e32a',uuid=78605259-17bf-47da-86de-3c76ac1c5bfa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7c9f8c17-a293-4817-ae4f-3fab0a1076a6", "address": "fa:16:3e:bc:93:0e", "network": {"id": "badd6fc4-dc5e-4623-b319-4969f674705f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1322270738", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.246", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "046be82514bf4c3483f8b3b8f2299b96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c9f8c17-a2", "ovs_interfaceid": "7c9f8c17-a293-4817-ae4f-3fab0a1076a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75216) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 18:46:06 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Converting VIF {"id": "7c9f8c17-a293-4817-ae4f-3fab0a1076a6", "address": "fa:16:3e:bc:93:0e", "network": {"id": "badd6fc4-dc5e-4623-b319-4969f674705f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1322270738", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.246", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "046be82514bf4c3483f8b3b8f2299b96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c9f8c17-a2", "ovs_interfaceid": "7c9f8c17-a293-4817-ae4f-3fab0a1076a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 18:46:06 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:93:0e,bridge_name='br-int',has_traffic_filtering=True,id=7c9f8c17-a293-4817-ae4f-3fab0a1076a6,network=Network(badd6fc4-dc5e-4623-b319-4969f674705f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7c9f8c17-a2') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 18:46:06 user nova-compute[75216]: DEBUG os_vif [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:93:0e,bridge_name='br-int',has_traffic_filtering=True,id=7c9f8c17-a293-4817-ae4f-3fab0a1076a6,network=Network(badd6fc4-dc5e-4623-b319-4969f674705f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7c9f8c17-a2') {{(pid=75216) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 18:46:06 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:06 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:46:06 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 18:46:06 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:06 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2daed30f-9f66-5f5b-8f87-3b3ec413f0ae', '_type': 'linux-noop'}}, row=False) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:46:06 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:06 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:46:06 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52f4339a-6a47-4877-b041-9c27d7be2e94 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:46:06 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[92b715f0-4682-4778-988c-d20dd6422315]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:46:06 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:46:06 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:06 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7c9f8c17-a2, may_exist=True, interface_attrs={}) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:46:06 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7c9f8c17-a2, col_values=(('qos', UUID('eb5e71b3-e499-4baa-a45b-4fd41a6d8744')),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:46:06 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7c9f8c17-a2, col_values=(('external_ids', {'iface-id': '7c9f8c17-a293-4817-ae4f-3fab0a1076a6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bc:93:0e', 'vm-uuid': '78605259-17bf-47da-86de-3c76ac1c5bfa'}),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:46:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52f4339a-6a47-4877-b041-9c27d7be2e94 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EoteNJdj {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:46:06 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:06 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:46:06 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:06 user nova-compute[75216]: INFO os_vif [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:93:0e,bridge_name='br-int',has_traffic_filtering=True,id=7c9f8c17-a293-4817-ae4f-3fab0a1076a6,network=Network(badd6fc4-dc5e-4623-b319-4969f674705f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7c9f8c17-a2')
Nov 13 18:46:06 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T18:45:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1463949560',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1463949560',id=10,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJx1T0XvsP0KOjgfjqi1q2on3nFgwBDJFjn7Y8e88Ig7TPicxUto3+yVPGSHigorr0YsRdHzdX17JooejloMPwKeQjFAdOrZNu9nCzVwcWfb8i+XfefIuuJFu8o61w00DA==',key_name='tempest-keypair-103032790',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='046be82514bf4c3483f8b3b8f2299b96',ramdisk_id='',reservation_id='r-k6do0zkd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1270684031',owner_user_name='tempest-TaggedBootDevicesTest-1270684031-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T18:45:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1ceef8ad05744447bcbf29460f62e32a',uuid=78605259-17bf-47da-86de-3c76ac1c5bfa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c5b1d8e6-f202-4278-924c-abecf64f299c", "address": "fa:16:3e:a1:c9:75", "network": {"id": "badd6fc4-dc5e-4623-b319-4969f674705f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1322270738", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.53", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "046be82514bf4c3483f8b3b8f2299b96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5b1d8e6-f2", "ovs_interfaceid": "c5b1d8e6-f202-4278-924c-abecf64f299c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75216) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 18:46:06 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Converting VIF {"id": "c5b1d8e6-f202-4278-924c-abecf64f299c", "address": "fa:16:3e:a1:c9:75", "network": {"id": "badd6fc4-dc5e-4623-b319-4969f674705f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1322270738", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.53", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "046be82514bf4c3483f8b3b8f2299b96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5b1d8e6-f2", "ovs_interfaceid": "c5b1d8e6-f202-4278-924c-abecf64f299c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 18:46:06 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:c9:75,bridge_name='br-int',has_traffic_filtering=True,id=c5b1d8e6-f202-4278-924c-abecf64f299c,network=Network(badd6fc4-dc5e-4623-b319-4969f674705f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc5b1d8e6-f2') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 18:46:06 user nova-compute[75216]: DEBUG os_vif [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:c9:75,bridge_name='br-int',has_traffic_filtering=True,id=c5b1d8e6-f202-4278-924c-abecf64f299c,network=Network(badd6fc4-dc5e-4623-b319-4969f674705f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc5b1d8e6-f2') {{(pid=75216) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 18:46:06 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:06 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:46:06 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 18:46:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52f4339a-6a47-4877-b041-9c27d7be2e94 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EoteNJdj" returned: 0 in 0.025s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:46:06 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[226d782f-3319-43be-805c-3c15dd9c85a2]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:46:06 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EoteNJdj'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:46:06 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:06 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'eaa7f73b-e573-5943-a2e1-677f96942133', '_type': 'linux-noop'}}, row=False) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:46:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52f4339a-6a47-4877-b041-9c27d7be2e94 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:46:06 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:06 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:46:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52f4339a-6a47-4877-b041-9c27d7be2e94 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:46:06 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed3f7155-992e-44b0-8fff-d0c51a94e363]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:46:06 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:46:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:46:06 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:06 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:06 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc5b1d8e6-f2, may_exist=True, interface_attrs={}) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:46:06 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc5b1d8e6-f2, col_values=(('qos', UUID('3f8366a4-49e1-4c60-91de-ba6ae3b6308e')),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:46:06 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc5b1d8e6-f2, col_values=(('external_ids', {'iface-id': 'c5b1d8e6-f202-4278-924c-abecf64f299c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a1:c9:75', 'vm-uuid': '78605259-17bf-47da-86de-3c76ac1c5bfa'}),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:46:06 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:06 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:46:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:46:06 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5444cbf-34e7-4e6d-81df-6630b9463e64]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba1efeb5-724e-4415-a5ed-12ce8c9489bc (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3d195d-b8b4-4c79-a150-813952c640e8 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fc393f0-1356-404f-a87b-bed1fb91b924 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a1a5e82-4f70-4668-94bd-4a842d826214 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e823c6a1-f7e2-495f-a5dc-6fdfd2b19cf0 (non-flash)\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:46:06 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba1efeb5-724e-4415-a5ed-12ce8c9489bc (non-flash)
Nov 13 18:46:06 user nova-compute[75216]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3d195d-b8b4-4c79-a150-813952c640e8 (non-flash)
Nov 13 18:46:06 user nova-compute[75216]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fc393f0-1356-404f-a87b-bed1fb91b924 (non-flash)
Nov 13 18:46:06 user nova-compute[75216]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a1a5e82-4f70-4668-94bd-4a842d826214 (non-flash)
Nov 13 18:46:06 user nova-compute[75216]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e823c6a1-f7e2-495f-a5dc-6fdfd2b19cf0 (non-flash)
Nov 13 18:46:06 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 18:46:06 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba1efeb5-724e-4415-a5ed-12ce8c9489bc (non-flash)
Nov 13 18:46:06 user nova-compute[75216]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3d195d-b8b4-4c79-a150-813952c640e8 (non-flash)
Nov 13 18:46:06 user nova-compute[75216]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fc393f0-1356-404f-a87b-bed1fb91b924 (non-flash)
Nov 13 18:46:06 user nova-compute[75216]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a1a5e82-4f70-4668-94bd-4a842d826214 (non-flash)
Nov 13 18:46:06 user nova-compute[75216]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e823c6a1-f7e2-495f-a5dc-6fdfd2b19cf0 (non-flash)
Nov 13 18:46:06 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 18:46:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52f4339a-6a47-4877-b041-9c27d7be2e94 -p 172.16.0.220:3260 --login {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:46:06 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:06 user nova-compute[75216]: INFO os_vif [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:c9:75,bridge_name='br-int',has_traffic_filtering=True,id=c5b1d8e6-f202-4278-924c-abecf64f299c,network=Network(badd6fc4-dc5e-4623-b319-4969f674705f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc5b1d8e6-f2')
Nov 13 18:46:06 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T18:45:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1463949560',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1463949560',id=10,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJx1T0XvsP0KOjgfjqi1q2on3nFgwBDJFjn7Y8e88Ig7TPicxUto3+yVPGSHigorr0YsRdHzdX17JooejloMPwKeQjFAdOrZNu9nCzVwcWfb8i+XfefIuuJFu8o61w00DA==',key_name='tempest-keypair-103032790',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='046be82514bf4c3483f8b3b8f2299b96',ramdisk_id='',reservation_id='r-k6do0zkd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1270684031',owner_user_name='tempest-TaggedBootDevicesTest-1270684031-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T18:45:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1ceef8ad05744447bcbf29460f62e32a',uuid=78605259-17bf-47da-86de-3c76ac1c5bfa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5c412896-2c62-4248-a888-9b0612378259", "address": "fa:16:3e:47:55:1a", "network": {"id": "badd6fc4-dc5e-4623-b319-4969f674705f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1322270738", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "046be82514bf4c3483f8b3b8f2299b96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c412896-2c", "ovs_interfaceid": "5c412896-2c62-4248-a888-9b0612378259", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 18:46:06 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Converting VIF {"id": "5c412896-2c62-4248-a888-9b0612378259", "address": "fa:16:3e:47:55:1a", "network": {"id": "badd6fc4-dc5e-4623-b319-4969f674705f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1322270738", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "046be82514bf4c3483f8b3b8f2299b96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c412896-2c", "ovs_interfaceid": "5c412896-2c62-4248-a888-9b0612378259", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 18:46:07 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:55:1a,bridge_name='br-int',has_traffic_filtering=True,id=5c412896-2c62-4248-a888-9b0612378259,network=Network(badd6fc4-dc5e-4623-b319-4969f674705f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c412896-2c') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 18:46:07 user nova-compute[75216]: DEBUG os_vif [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:55:1a,bridge_name='br-int',has_traffic_filtering=True,id=5c412896-2c62-4248-a888-9b0612378259,network=Network(badd6fc4-dc5e-4623-b319-4969f674705f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c412896-2c') {{(pid=75216) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 18:46:07 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:07 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:46:07 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 18:46:07 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:07 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fd65e560-3408-5031-af42-95240d6dcd67', '_type': 'linux-noop'}}, row=False) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:46:07 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:07 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:46:07 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52f4339a-6a47-4877-b041-9c27d7be2e94 -p 172.16.0.220:3260 --login" returned: 0 in 0.090s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:46:07 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bc8ed58-cda8-44ee-9480-72f42330aa9c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:52f4339a-6a47-4877-b041-9c27d7be2e94, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:52f4339a-6a47-4877-b041-9c27d7be2e94, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:46:07 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:52f4339a-6a47-4877-b041-9c27d7be2e94, portal: 172.16.0.220,3260]
Nov 13 18:46:07 user nova-compute[75216]: Login to [iface: default, target: iqn.2010-10.org.openstack:52f4339a-6a47-4877-b041-9c27d7be2e94, portal: 172.16.0.220,3260] successful.
Nov 13 18:46:07 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:46:07 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:07 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52f4339a-6a47-4877-b041-9c27d7be2e94 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:46:07 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:07 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5c412896-2c, may_exist=True, interface_attrs={}) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:46:07 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5c412896-2c, col_values=(('qos', UUID('97ecc007-d461-418e-8497-68e9596be15b')),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:46:07 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5c412896-2c, col_values=(('external_ids', {'iface-id': '5c412896-2c62-4248-a888-9b0612378259', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:47:55:1a', 'vm-uuid': '78605259-17bf-47da-86de-3c76ac1c5bfa'}),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:46:07 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:07 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:46:07 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52f4339a-6a47-4877-b041-9c27d7be2e94 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:46:07 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[264850dc-9e68-4ecd-8f4d-db88e2d590b7]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:46:07 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:46:07 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:46:07 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:07 user nova-compute[75216]: INFO os_vif [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:55:1a,bridge_name='br-int',has_traffic_filtering=True,id=5c412896-2c62-4248-a888-9b0612378259,network=Network(badd6fc4-dc5e-4623-b319-4969f674705f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c412896-2c')
Nov 13 18:46:07 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T18:45:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1463949560',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1463949560',id=10,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJx1T0XvsP0KOjgfjqi1q2on3nFgwBDJFjn7Y8e88Ig7TPicxUto3+yVPGSHigorr0YsRdHzdX17JooejloMPwKeQjFAdOrZNu9nCzVwcWfb8i+XfefIuuJFu8o61w00DA==',key_name='tempest-keypair-103032790',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='046be82514bf4c3483f8b3b8f2299b96',ramdisk_id='',reservation_id='r-k6do0zkd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1270684031',owner_user_name='tempest-TaggedBootDevicesTest-1270684031-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T18:45:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1ceef8ad05744447bcbf29460f62e32a',uuid=78605259-17bf-47da-86de-3c76ac1c5bfa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e4e34ea8-fb99-4a0e-8b65-a93933cc7d6b", "address": "fa:16:3e:a8:83:c9", "network": {"id": "badd6fc4-dc5e-4623-b319-4969f674705f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1322270738", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "046be82514bf4c3483f8b3b8f2299b96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4e34ea8-fb", "ovs_interfaceid": "e4e34ea8-fb99-4a0e-8b65-a93933cc7d6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 18:46:07 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Converting VIF {"id": "e4e34ea8-fb99-4a0e-8b65-a93933cc7d6b", "address": "fa:16:3e:a8:83:c9", "network": {"id": "badd6fc4-dc5e-4623-b319-4969f674705f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1322270738", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "046be82514bf4c3483f8b3b8f2299b96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4e34ea8-fb", "ovs_interfaceid": "e4e34ea8-fb99-4a0e-8b65-a93933cc7d6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 18:46:07 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:83:c9,bridge_name='br-int',has_traffic_filtering=True,id=e4e34ea8-fb99-4a0e-8b65-a93933cc7d6b,network=Network(badd6fc4-dc5e-4623-b319-4969f674705f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4e34ea8-fb') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 18:46:07 user nova-compute[75216]: DEBUG os_vif [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:83:c9,bridge_name='br-int',has_traffic_filtering=True,id=e4e34ea8-fb99-4a0e-8b65-a93933cc7d6b,network=Network(badd6fc4-dc5e-4623-b319-4969f674705f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4e34ea8-fb') {{(pid=75216) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 18:46:07 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:46:07 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[7df60e2e-8cb0-4412-a762-f18e88c9187a]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba1efeb5-724e-4415-a5ed-12ce8c9489bc (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3d195d-b8b4-4c79-a150-813952c640e8 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fc393f0-1356-404f-a87b-bed1fb91b924 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a1a5e82-4f70-4668-94bd-4a842d826214 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e823c6a1-f7e2-495f-a5dc-6fdfd2b19cf0 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52f4339a-6a47-4877-b041-9c27d7be2e94 (non-flash)\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:46:07 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:07 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:46:07 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 18:46:07 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba1efeb5-724e-4415-a5ed-12ce8c9489bc (non-flash)
Nov 13 18:46:07 user nova-compute[75216]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3d195d-b8b4-4c79-a150-813952c640e8 (non-flash)
Nov 13 18:46:07 user nova-compute[75216]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fc393f0-1356-404f-a87b-bed1fb91b924 (non-flash)
Nov 13 18:46:07 user nova-compute[75216]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a1a5e82-4f70-4668-94bd-4a842d826214 (non-flash)
Nov 13 18:46:07 user nova-compute[75216]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e823c6a1-f7e2-495f-a5dc-6fdfd2b19cf0 (non-flash)
Nov 13 18:46:07 user nova-compute[75216]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52f4339a-6a47-4877-b041-9c27d7be2e94 (non-flash)
Nov 13 18:46:07 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 18:46:07 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba1efeb5-724e-4415-a5ed-12ce8c9489bc (non-flash)
Nov 13 18:46:07 user nova-compute[75216]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3d195d-b8b4-4c79-a150-813952c640e8 (non-flash)
Nov 13 18:46:07 user nova-compute[75216]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fc393f0-1356-404f-a87b-bed1fb91b924 (non-flash)
Nov 13 18:46:07 user nova-compute[75216]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a1a5e82-4f70-4668-94bd-4a842d826214 (non-flash)
Nov 13 18:46:07 user nova-compute[75216]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e823c6a1-f7e2-495f-a5dc-6fdfd2b19cf0 (non-flash)
Nov 13 18:46:07 user nova-compute[75216]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52f4339a-6a47-4877-b041-9c27d7be2e94 (non-flash)
Nov 13 18:46:07 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 18:46:07 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:52f4339a-6a47-4877-b041-9c27d7be2e94" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.386s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 18:46:07 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Connected to 172.16.0.220:3260 {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 18:46:07 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] HCTL ('35', '-', '-', 0) found on session 8 with lun 0 {{(pid=75216) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 18:46:07 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75216) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 18:46:07 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:46:07 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:07 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5d6dd912-7666-5e7f-89ce-888d4873e21a', '_type': 'linux-noop'}}, row=False) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:46:07 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:07 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:46:07 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:46:07 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[40b1b0b5-8684-4fc8-a5e5-79c2c890cd38]: (4, ('- - 0', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:46:07 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Searching for a device in session 8 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75216) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 18:46:07 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:52f4339a-6a47-4877-b041-9c27d7be2e94', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EoteNJdj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 18:46:07 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:07 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:07 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape4e34ea8-fb, may_exist=True, interface_attrs={}) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:46:07 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape4e34ea8-fb, col_values=(('qos', UUID('1c15d167-526b-4d42-a007-075295d0390f')),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:46:07 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape4e34ea8-fb, col_values=(('external_ids', {'iface-id': 'e4e34ea8-fb99-4a0e-8b65-a93933cc7d6b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a8:83:c9', 'vm-uuid': '78605259-17bf-47da-86de-3c76ac1c5bfa'}),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:46:07 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:07 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:46:07 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:07 user nova-compute[75216]: INFO os_vif [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:83:c9,bridge_name='br-int',has_traffic_filtering=True,id=e4e34ea8-fb99-4a0e-8b65-a93933cc7d6b,network=Network(badd6fc4-dc5e-4623-b319-4969f674705f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4e34ea8-fb')
Nov 13 18:46:07 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T18:45:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1463949560',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1463949560',id=10,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJx1T0XvsP0KOjgfjqi1q2on3nFgwBDJFjn7Y8e88Ig7TPicxUto3+yVPGSHigorr0YsRdHzdX17JooejloMPwKeQjFAdOrZNu9nCzVwcWfb8i+XfefIuuJFu8o61w00DA==',key_name='tempest-keypair-103032790',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='046be82514bf4c3483f8b3b8f2299b96',ramdisk_id='',reservation_id='r-k6do0zkd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1270684031',owner_user_name='tempest-TaggedBootDevicesTest-1270684031-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T18:45:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1ceef8ad05744447bcbf29460f62e32a',uuid=78605259-17bf-47da-86de-3c76ac1c5bfa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7b6ed148-b7c9-479b-9e2d-cfc0c3f6f93a", "address": "fa:16:3e:e4:db:d9", "network": {"id": "debccb89-bf2d-40a9-b114-b1bb2e913648", "bridge": "br-int", "label": "tempest-device-tagging-net2-185988930", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "046be82514bf4c3483f8b3b8f2299b96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b6ed148-b7", "ovs_interfaceid": "7b6ed148-b7c9-479b-9e2d-cfc0c3f6f93a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 18:46:07 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Converting VIF {"id": "7b6ed148-b7c9-479b-9e2d-cfc0c3f6f93a", "address": "fa:16:3e:e4:db:d9", "network": {"id": "debccb89-bf2d-40a9-b114-b1bb2e913648", "bridge": "br-int", "label": "tempest-device-tagging-net2-185988930", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "046be82514bf4c3483f8b3b8f2299b96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b6ed148-b7", "ovs_interfaceid": "7b6ed148-b7c9-479b-9e2d-cfc0c3f6f93a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 18:46:07 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:db:d9,bridge_name='br-int',has_traffic_filtering=True,id=7b6ed148-b7c9-479b-9e2d-cfc0c3f6f93a,network=Network(debccb89-bf2d-40a9-b114-b1bb2e913648),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b6ed148-b7') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 18:46:07 user nova-compute[75216]: DEBUG os_vif [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:db:d9,bridge_name='br-int',has_traffic_filtering=True,id=7b6ed148-b7c9-479b-9e2d-cfc0c3f6f93a,network=Network(debccb89-bf2d-40a9-b114-b1bb2e913648),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b6ed148-b7') {{(pid=75216) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 18:46:07 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:07 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:46:07 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 18:46:07 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:07 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '89bd83be-5c25-53c4-bc04-bc1ba64d20cc', '_type': 'linux-noop'}}, row=False) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:46:07 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:07 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:46:07 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:07 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:07 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7b6ed148-b7, may_exist=True, interface_attrs={}) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:46:07 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7b6ed148-b7, col_values=(('qos', UUID('f85a1d8f-32b4-4d5f-8a90-ab85771aee84')),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:46:07 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7b6ed148-b7, col_values=(('external_ids', {'iface-id': '7b6ed148-b7c9-479b-9e2d-cfc0c3f6f93a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e4:db:d9', 'vm-uuid': '78605259-17bf-47da-86de-3c76ac1c5bfa'}),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:46:07 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:46:07 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:07 user nova-compute[75216]: INFO os_vif [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:db:d9,bridge_name='br-int',has_traffic_filtering=True,id=7b6ed148-b7c9-479b-9e2d-cfc0c3f6f93a,network=Network(debccb89-bf2d-40a9-b114-b1bb2e913648),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b6ed148-b7')
Nov 13 18:46:07 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T18:45:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1463949560',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1463949560',id=10,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJx1T0XvsP0KOjgfjqi1q2on3nFgwBDJFjn7Y8e88Ig7TPicxUto3+yVPGSHigorr0YsRdHzdX17JooejloMPwKeQjFAdOrZNu9nCzVwcWfb8i+XfefIuuJFu8o61w00DA==',key_name='tempest-keypair-103032790',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='046be82514bf4c3483f8b3b8f2299b96',ramdisk_id='',reservation_id='r-k6do0zkd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1270684031',owner_user_name='tempest-TaggedBootDevicesTest-1270684031-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T18:45:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1ceef8ad05744447bcbf29460f62e32a',uuid=78605259-17bf-47da-86de-3c76ac1c5bfa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "815d1175-2997-4d74-8f35-7ca982cf46aa", "address": "fa:16:3e:2c:4b:72", "network": {"id": "debccb89-bf2d-40a9-b114-b1bb2e913648", "bridge": "br-int", "label": "tempest-device-tagging-net2-185988930", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "046be82514bf4c3483f8b3b8f2299b96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap815d1175-29", "ovs_interfaceid": "815d1175-2997-4d74-8f35-7ca982cf46aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 18:46:07 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Converting VIF {"id": "815d1175-2997-4d74-8f35-7ca982cf46aa", "address": "fa:16:3e:2c:4b:72", "network": {"id": "debccb89-bf2d-40a9-b114-b1bb2e913648", "bridge": "br-int", "label": "tempest-device-tagging-net2-185988930", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "046be82514bf4c3483f8b3b8f2299b96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap815d1175-29", "ovs_interfaceid": "815d1175-2997-4d74-8f35-7ca982cf46aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 18:46:07 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2c:4b:72,bridge_name='br-int',has_traffic_filtering=True,id=815d1175-2997-4d74-8f35-7ca982cf46aa,network=Network(debccb89-bf2d-40a9-b114-b1bb2e913648),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap815d1175-29') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 18:46:07 user nova-compute[75216]: DEBUG os_vif [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2c:4b:72,bridge_name='br-int',has_traffic_filtering=True,id=815d1175-2997-4d74-8f35-7ca982cf46aa,network=Network(debccb89-bf2d-40a9-b114-b1bb2e913648),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap815d1175-29') {{(pid=75216) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 18:46:07 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:07 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:46:07 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 18:46:07 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:07 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c1b90935-12c2-55b4-be07-a514741a9451', '_type': 'linux-noop'}}, row=False) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:46:07 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:07 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:46:07 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:07 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:07 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap815d1175-29, may_exist=True, interface_attrs={}) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:46:07 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap815d1175-29, col_values=(('qos', UUID('91bca6c5-db18-4e97-bbd3-1f128634a75e')),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:46:07 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap815d1175-29, col_values=(('external_ids', {'iface-id': '815d1175-2997-4d74-8f35-7ca982cf46aa', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2c:4b:72', 'vm-uuid': '78605259-17bf-47da-86de-3c76ac1c5bfa'}),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:46:07 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:07 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:46:07 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:07 user nova-compute[75216]: INFO os_vif [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2c:4b:72,bridge_name='br-int',has_traffic_filtering=True,id=815d1175-2997-4d74-8f35-7ca982cf46aa,network=Network(debccb89-bf2d-40a9-b114-b1bb2e913648),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap815d1175-29')
Nov 13 18:46:07 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] No BDM found with device name hda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 18:46:07 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 18:46:07 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] No VIF found with MAC fa:16:3e:22:29:78, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 18:46:07 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] No VIF found with MAC fa:16:3e:a8:83:c9, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 18:46:07 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Using config drive
Nov 13 18:46:07 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Creating config drive at /opt/stack/data/nova/instances/78605259-17bf-47da-86de-3c76ac1c5bfa/disk.config
Nov 13 18:46:07 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/78605259-17bf-47da-86de-3c76ac1c5bfa/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpo207dyt4 {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:46:07 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:07 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/78605259-17bf-47da-86de-3c76ac1c5bfa/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpo207dyt4" returned: 0 in 0.057s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:46:08 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.427s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 18:46:08 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] <== connect_volume: return (2751ms) {'type': 'block', 'scsi_wwn': '23663633633303433', 'path': '/dev/sdd'} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 18:46:08 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23663633633303433', 'path': '/dev/sdd'} {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 18:46:08 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T18:45:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-835191015',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-835191015',id=9,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEhfcD46zss7ONQ1SY+r8F1CQFXVOm5N4z75azo3v6RrQS7/wvwfpVFyai5x8zqx3fdjrh60HyXnAzyj7itmyT24OjHnNNB9Ltm77zsQMNNIJ86VCYN8lCciAo2iDKAK3g==',key_name='tempest-keypair-557064356',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a8d0f284dd8d4cc88f04a729b1d5d38c',ramdisk_id='',reservation_id='r-7thq8eg2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1999686773',owner_user_name='tempest-TaggedBootDevicesTest_v242-1999686773-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T18:45:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2fd1904e6cdb4600a2e250aefdc0f0ce',uuid=3274203b-a985-4f28-9b45-3f83509ae782,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "217faeb3-4474-449c-ae9f-86e555ce7cd7", "address": "fa:16:3e:49:58:83", "network": {"id": "804f3c05-e540-4bae-a58f-682133e0c762", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-619032523-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8d0f284dd8d4cc88f04a729b1d5d38c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap217faeb3-44", "ovs_interfaceid": "217faeb3-4474-449c-ae9f-86e555ce7cd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75216) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 18:46:08 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Converting VIF {"id": "217faeb3-4474-449c-ae9f-86e555ce7cd7", "address": "fa:16:3e:49:58:83", "network": {"id": "804f3c05-e540-4bae-a58f-682133e0c762", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-619032523-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8d0f284dd8d4cc88f04a729b1d5d38c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap217faeb3-44", "ovs_interfaceid": "217faeb3-4474-449c-ae9f-86e555ce7cd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 18:46:08 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:58:83,bridge_name='br-int',has_traffic_filtering=True,id=217faeb3-4474-449c-ae9f-86e555ce7cd7,network=Network(804f3c05-e540-4bae-a58f-682133e0c762),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap217faeb3-44') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 18:46:08 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T18:45:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-835191015',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-835191015',id=9,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEhfcD46zss7ONQ1SY+r8F1CQFXVOm5N4z75azo3v6RrQS7/wvwfpVFyai5x8zqx3fdjrh60HyXnAzyj7itmyT24OjHnNNB9Ltm77zsQMNNIJ86VCYN8lCciAo2iDKAK3g==',key_name='tempest-keypair-557064356',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a8d0f284dd8d4cc88f04a729b1d5d38c',ramdisk_id='',reservation_id='r-7thq8eg2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1999686773',owner_user_name='tempest-TaggedBootDevicesTest_v242-1999686773-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T18:45:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2fd1904e6cdb4600a2e250aefdc0f0ce',uuid=3274203b-a985-4f28-9b45-3f83509ae782,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9bed3978-d90d-4b90-b798-12413ea26a48", "address": "fa:16:3e:17:08:ae", "network": {"id": "590b5147-c33a-45bd-a502-8fd41408064d", "bridge": "br-int", "label": "tempest-device-tagging-net1-904391500", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a8d0f284dd8d4cc88f04a729b1d5d38c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bed3978-d9", "ovs_interfaceid": "9bed3978-d90d-4b90-b798-12413ea26a48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75216) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 18:46:08 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Converting VIF {"id": "9bed3978-d90d-4b90-b798-12413ea26a48", "address": "fa:16:3e:17:08:ae", "network": {"id": "590b5147-c33a-45bd-a502-8fd41408064d", "bridge": "br-int", "label": "tempest-device-tagging-net1-904391500", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a8d0f284dd8d4cc88f04a729b1d5d38c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bed3978-d9", "ovs_interfaceid": "9bed3978-d90d-4b90-b798-12413ea26a48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 18:46:08 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:08:ae,bridge_name='br-int',has_traffic_filtering=True,id=9bed3978-d90d-4b90-b798-12413ea26a48,network=Network(590b5147-c33a-45bd-a502-8fd41408064d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9bed3978-d9') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 18:46:08 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T18:45:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-835191015',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-835191015',id=9,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEhfcD46zss7ONQ1SY+r8F1CQFXVOm5N4z75azo3v6RrQS7/wvwfpVFyai5x8zqx3fdjrh60HyXnAzyj7itmyT24OjHnNNB9Ltm77zsQMNNIJ86VCYN8lCciAo2iDKAK3g==',key_name='tempest-keypair-557064356',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a8d0f284dd8d4cc88f04a729b1d5d38c',ramdisk_id='',reservation_id='r-7thq8eg2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1999686773',owner_user_name='tempest-TaggedBootDevicesTest_v242-1999686773-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T18:45:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2fd1904e6cdb4600a2e250aefdc0f0ce',uuid=3274203b-a985-4f28-9b45-3f83509ae782,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "95a425c5-f994-4504-a94b-040103b2efa7", "address": "fa:16:3e:02:ea:af", "network": {"id": "590b5147-c33a-45bd-a502-8fd41408064d", "bridge": "br-int", "label": "tempest-device-tagging-net1-904391500", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.40", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a8d0f284dd8d4cc88f04a729b1d5d38c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95a425c5-f9", "ovs_interfaceid": "95a425c5-f994-4504-a94b-040103b2efa7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75216) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 18:46:08 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Converting VIF {"id": "95a425c5-f994-4504-a94b-040103b2efa7", "address": "fa:16:3e:02:ea:af", "network": {"id": "590b5147-c33a-45bd-a502-8fd41408064d", "bridge": "br-int", "label": "tempest-device-tagging-net1-904391500", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.40", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a8d0f284dd8d4cc88f04a729b1d5d38c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95a425c5-f9", "ovs_interfaceid": "95a425c5-f994-4504-a94b-040103b2efa7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 18:46:08 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:ea:af,bridge_name='br-int',has_traffic_filtering=True,id=95a425c5-f994-4504-a94b-040103b2efa7,network=Network(590b5147-c33a-45bd-a502-8fd41408064d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap95a425c5-f9') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 18:46:08 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T18:45:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-835191015',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-835191015',id=9,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEhfcD46zss7ONQ1SY+r8F1CQFXVOm5N4z75azo3v6RrQS7/wvwfpVFyai5x8zqx3fdjrh60HyXnAzyj7itmyT24OjHnNNB9Ltm77zsQMNNIJ86VCYN8lCciAo2iDKAK3g==',key_name='tempest-keypair-557064356',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a8d0f284dd8d4cc88f04a729b1d5d38c',ramdisk_id='',reservation_id='r-7thq8eg2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1999686773',owner_user_name='tempest-TaggedBootDevicesTest_v242-1999686773-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T18:45:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2fd1904e6cdb4600a2e250aefdc0f0ce',uuid=3274203b-a985-4f28-9b45-3f83509ae782,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7aa7e71d-2c00-40fd-9d05-d108bcc807ec", "address": "fa:16:3e:73:99:8a", "network": {"id": "590b5147-c33a-45bd-a502-8fd41408064d", "bridge": "br-int", "label": "tempest-device-tagging-net1-904391500", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.98", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a8d0f284dd8d4cc88f04a729b1d5d38c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7aa7e71d-2c", "ovs_interfaceid": "7aa7e71d-2c00-40fd-9d05-d108bcc807ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75216) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 18:46:08 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Converting VIF {"id": "7aa7e71d-2c00-40fd-9d05-d108bcc807ec", "address": "fa:16:3e:73:99:8a", "network": {"id": "590b5147-c33a-45bd-a502-8fd41408064d", "bridge": "br-int", "label": "tempest-device-tagging-net1-904391500", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.98", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a8d0f284dd8d4cc88f04a729b1d5d38c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7aa7e71d-2c", "ovs_interfaceid": "7aa7e71d-2c00-40fd-9d05-d108bcc807ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 18:46:08 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:99:8a,bridge_name='br-int',has_traffic_filtering=True,id=7aa7e71d-2c00-40fd-9d05-d108bcc807ec,network=Network(590b5147-c33a-45bd-a502-8fd41408064d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7aa7e71d-2c') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 18:46:08 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T18:45:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-835191015',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-835191015',id=9,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEhfcD46zss7ONQ1SY+r8F1CQFXVOm5N4z75azo3v6RrQS7/wvwfpVFyai5x8zqx3fdjrh60HyXnAzyj7itmyT24OjHnNNB9Ltm77zsQMNNIJ86VCYN8lCciAo2iDKAK3g==',key_name='tempest-keypair-557064356',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a8d0f284dd8d4cc88f04a729b1d5d38c',ramdisk_id='',reservation_id='r-7thq8eg2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1999686773',owner_user_name='tempest-TaggedBootDevicesTest_v242-1999686773-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T18:45:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2fd1904e6cdb4600a2e250aefdc0f0ce',uuid=3274203b-a985-4f28-9b45-3f83509ae782,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "01772e53-e624-4728-beb1-929cc4165f21", "address": "fa:16:3e:a7:a0:fe", "network": {"id": "590b5147-c33a-45bd-a502-8fd41408064d", "bridge": "br-int", "label": "tempest-device-tagging-net1-904391500", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a8d0f284dd8d4cc88f04a729b1d5d38c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01772e53-e6", "ovs_interfaceid": "01772e53-e624-4728-beb1-929cc4165f21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75216) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 18:46:08 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Converting VIF {"id": "01772e53-e624-4728-beb1-929cc4165f21", "address": "fa:16:3e:a7:a0:fe", "network": {"id": "590b5147-c33a-45bd-a502-8fd41408064d", "bridge": "br-int", "label": "tempest-device-tagging-net1-904391500", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a8d0f284dd8d4cc88f04a729b1d5d38c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01772e53-e6", "ovs_interfaceid": "01772e53-e624-4728-beb1-929cc4165f21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 18:46:08 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:a0:fe,bridge_name='br-int',has_traffic_filtering=True,id=01772e53-e624-4728-beb1-929cc4165f21,network=Network(590b5147-c33a-45bd-a502-8fd41408064d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01772e53-e6') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 18:46:08 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T18:45:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-835191015',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-835191015',id=9,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEhfcD46zss7ONQ1SY+r8F1CQFXVOm5N4z75azo3v6RrQS7/wvwfpVFyai5x8zqx3fdjrh60HyXnAzyj7itmyT24OjHnNNB9Ltm77zsQMNNIJ86VCYN8lCciAo2iDKAK3g==',key_name='tempest-keypair-557064356',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a8d0f284dd8d4cc88f04a729b1d5d38c',ramdisk_id='',reservation_id='r-7thq8eg2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1999686773',owner_user_name='tempest-TaggedBootDevicesTest_v242-1999686773-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T18:45:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2fd1904e6cdb4600a2e250aefdc0f0ce',uuid=3274203b-a985-4f28-9b45-3f83509ae782,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1bb4df6f-02b2-415b-9cea-fd8a7a04874c", "address": "fa:16:3e:cb:71:3b", "network": {"id": "f82e0fd1-978f-4b08-8480-709765208ef9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1203652186", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a8d0f284dd8d4cc88f04a729b1d5d38c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bb4df6f-02", "ovs_interfaceid": "1bb4df6f-02b2-415b-9cea-fd8a7a04874c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75216) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 18:46:08 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Converting VIF {"id": "1bb4df6f-02b2-415b-9cea-fd8a7a04874c", "address": "fa:16:3e:cb:71:3b", "network": {"id": "f82e0fd1-978f-4b08-8480-709765208ef9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1203652186", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a8d0f284dd8d4cc88f04a729b1d5d38c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bb4df6f-02", "ovs_interfaceid": "1bb4df6f-02b2-415b-9cea-fd8a7a04874c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 18:46:08 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:71:3b,bridge_name='br-int',has_traffic_filtering=True,id=1bb4df6f-02b2-415b-9cea-fd8a7a04874c,network=Network(f82e0fd1-978f-4b08-8480-709765208ef9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bb4df6f-02') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 18:46:08 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T18:45:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-835191015',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-835191015',id=9,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEhfcD46zss7ONQ1SY+r8F1CQFXVOm5N4z75azo3v6RrQS7/wvwfpVFyai5x8zqx3fdjrh60HyXnAzyj7itmyT24OjHnNNB9Ltm77zsQMNNIJ86VCYN8lCciAo2iDKAK3g==',key_name='tempest-keypair-557064356',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a8d0f284dd8d4cc88f04a729b1d5d38c',ramdisk_id='',reservation_id='r-7thq8eg2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1999686773',owner_user_name='tempest-TaggedBootDevicesTest_v242-1999686773-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T18:45:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2fd1904e6cdb4600a2e250aefdc0f0ce',uuid=3274203b-a985-4f28-9b45-3f83509ae782,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a07efcd3-59f4-452e-8fb7-8b8233ae235f", "address": "fa:16:3e:6c:cb:eb", "network": {"id": "f82e0fd1-978f-4b08-8480-709765208ef9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1203652186", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a8d0f284dd8d4cc88f04a729b1d5d38c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa07efcd3-59", "ovs_interfaceid": "a07efcd3-59f4-452e-8fb7-8b8233ae235f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75216) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 18:46:08 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Converting VIF {"id": "a07efcd3-59f4-452e-8fb7-8b8233ae235f", "address": "fa:16:3e:6c:cb:eb", "network": {"id": "f82e0fd1-978f-4b08-8480-709765208ef9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1203652186", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a8d0f284dd8d4cc88f04a729b1d5d38c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa07efcd3-59", "ovs_interfaceid": "a07efcd3-59f4-452e-8fb7-8b8233ae235f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 18:46:08 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:cb:eb,bridge_name='br-int',has_traffic_filtering=True,id=a07efcd3-59f4-452e-8fb7-8b8233ae235f,network=Network(f82e0fd1-978f-4b08-8480-709765208ef9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa07efcd3-59') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 18:46:08 user nova-compute[75216]: DEBUG nova.objects.instance [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Lazy-loading 'pci_devices' on Instance uuid 3274203b-a985-4f28-9b45-3f83509ae782 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 18:46:08 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] End _get_guest_xml xml=<domain type="kvm">
Nov 13 18:46:08 user nova-compute[75216]:   <uuid>3274203b-a985-4f28-9b45-3f83509ae782</uuid>
Nov 13 18:46:08 user nova-compute[75216]:   <name>instance-00000009</name>
Nov 13 18:46:08 user nova-compute[75216]:   <memory>524288</memory>
Nov 13 18:46:08 user nova-compute[75216]:   <vcpu>1</vcpu>
Nov 13 18:46:08 user nova-compute[75216]:   <metadata>
Nov 13 18:46:08 user nova-compute[75216]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 18:46:08 user nova-compute[75216]:       <nova:package version="0.0.0"/>
Nov 13 18:46:08 user nova-compute[75216]:       <nova:name>tempest-device-tagging-server-835191015</nova:name>
Nov 13 18:46:08 user nova-compute[75216]:       <nova:creationTime>2023-11-13 18:45:59</nova:creationTime>
Nov 13 18:46:08 user nova-compute[75216]:       <nova:flavor name="m1.tiny">
Nov 13 18:46:08 user nova-compute[75216]:         <nova:memory>512</nova:memory>
Nov 13 18:46:08 user nova-compute[75216]:         <nova:disk>1</nova:disk>
Nov 13 18:46:08 user nova-compute[75216]:         <nova:swap>0</nova:swap>
Nov 13 18:46:08 user nova-compute[75216]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 18:46:08 user nova-compute[75216]:         <nova:vcpus>1</nova:vcpus>
Nov 13 18:46:08 user nova-compute[75216]:       </nova:flavor>
Nov 13 18:46:08 user nova-compute[75216]:       <nova:owner>
Nov 13 18:46:08 user nova-compute[75216]:         <nova:user uuid="2fd1904e6cdb4600a2e250aefdc0f0ce">tempest-TaggedBootDevicesTest_v242-1999686773-project-member</nova:user>
Nov 13 18:46:08 user nova-compute[75216]:         <nova:project uuid="a8d0f284dd8d4cc88f04a729b1d5d38c">tempest-TaggedBootDevicesTest_v242-1999686773</nova:project>
Nov 13 18:46:08 user nova-compute[75216]:       </nova:owner>
Nov 13 18:46:08 user nova-compute[75216]:       <nova:root type="image" uuid="77bcb5ba-8510-41ec-a88d-96097bb431de"/>
Nov 13 18:46:08 user nova-compute[75216]:       <nova:ports>
Nov 13 18:46:08 user nova-compute[75216]:         <nova:port uuid="217faeb3-4474-449c-ae9f-86e555ce7cd7">
Nov 13 18:46:08 user nova-compute[75216]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 13 18:46:08 user nova-compute[75216]:         </nova:port>
Nov 13 18:46:08 user nova-compute[75216]:         <nova:port uuid="9bed3978-d90d-4b90-b798-12413ea26a48">
Nov 13 18:46:08 user nova-compute[75216]:           <nova:ip type="fixed" address="10.1.1.66" ipVersion="4"/>
Nov 13 18:46:08 user nova-compute[75216]:         </nova:port>
Nov 13 18:46:08 user nova-compute[75216]:         <nova:port uuid="95a425c5-f994-4504-a94b-040103b2efa7">
Nov 13 18:46:08 user nova-compute[75216]:           <nova:ip type="fixed" address="10.1.1.40" ipVersion="4"/>
Nov 13 18:46:08 user nova-compute[75216]:         </nova:port>
Nov 13 18:46:08 user nova-compute[75216]:         <nova:port uuid="7aa7e71d-2c00-40fd-9d05-d108bcc807ec">
Nov 13 18:46:08 user nova-compute[75216]:           <nova:ip type="fixed" address="10.1.1.98" ipVersion="4"/>
Nov 13 18:46:08 user nova-compute[75216]:         </nova:port>
Nov 13 18:46:08 user nova-compute[75216]:         <nova:port uuid="01772e53-e624-4728-beb1-929cc4165f21">
Nov 13 18:46:08 user nova-compute[75216]:           <nova:ip type="fixed" address="10.1.1.158" ipVersion="4"/>
Nov 13 18:46:08 user nova-compute[75216]:         </nova:port>
Nov 13 18:46:08 user nova-compute[75216]:         <nova:port uuid="1bb4df6f-02b2-415b-9cea-fd8a7a04874c">
Nov 13 18:46:08 user nova-compute[75216]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 13 18:46:08 user nova-compute[75216]:         </nova:port>
Nov 13 18:46:08 user nova-compute[75216]:         <nova:port uuid="a07efcd3-59f4-452e-8fb7-8b8233ae235f">
Nov 13 18:46:08 user nova-compute[75216]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 13 18:46:08 user nova-compute[75216]:         </nova:port>
Nov 13 18:46:08 user nova-compute[75216]:       </nova:ports>
Nov 13 18:46:08 user nova-compute[75216]:     </nova:instance>
Nov 13 18:46:08 user nova-compute[75216]:   </metadata>
Nov 13 18:46:08 user nova-compute[75216]:   <sysinfo type="smbios">
Nov 13 18:46:08 user nova-compute[75216]:     <system>
Nov 13 18:46:08 user nova-compute[75216]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 18:46:08 user nova-compute[75216]:       <entry name="product">OpenStack Nova</entry>
Nov 13 18:46:08 user nova-compute[75216]:       <entry name="version">0.0.0</entry>
Nov 13 18:46:08 user nova-compute[75216]:       <entry name="serial">3274203b-a985-4f28-9b45-3f83509ae782</entry>
Nov 13 18:46:08 user nova-compute[75216]:       <entry name="uuid">3274203b-a985-4f28-9b45-3f83509ae782</entry>
Nov 13 18:46:08 user nova-compute[75216]:       <entry name="family">Virtual Machine</entry>
Nov 13 18:46:08 user nova-compute[75216]:     </system>
Nov 13 18:46:08 user nova-compute[75216]:   </sysinfo>
Nov 13 18:46:08 user nova-compute[75216]:   <os>
Nov 13 18:46:08 user nova-compute[75216]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 18:46:08 user nova-compute[75216]:     <boot dev="hd"/>
Nov 13 18:46:08 user nova-compute[75216]:     <smbios mode="sysinfo"/>
Nov 13 18:46:08 user nova-compute[75216]:   </os>
Nov 13 18:46:08 user nova-compute[75216]:   <features>
Nov 13 18:46:08 user nova-compute[75216]:     <acpi/>
Nov 13 18:46:08 user nova-compute[75216]:     <apic/>
Nov 13 18:46:08 user nova-compute[75216]:     <vmcoreinfo/>
Nov 13 18:46:08 user nova-compute[75216]:   </features>
Nov 13 18:46:08 user nova-compute[75216]:   <clock offset="utc">
Nov 13 18:46:08 user nova-compute[75216]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 18:46:08 user nova-compute[75216]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 18:46:08 user nova-compute[75216]:     <timer name="hpet" present="no"/>
Nov 13 18:46:08 user nova-compute[75216]:   </clock>
Nov 13 18:46:08 user nova-compute[75216]:   <cpu mode="custom" match="exact">
Nov 13 18:46:08 user nova-compute[75216]:     <model>Nehalem</model>
Nov 13 18:46:08 user nova-compute[75216]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 18:46:08 user nova-compute[75216]:   </cpu>
Nov 13 18:46:08 user nova-compute[75216]:   <devices>
Nov 13 18:46:08 user nova-compute[75216]:     <disk type="file" device="cdrom">
Nov 13 18:46:08 user nova-compute[75216]:       <driver name="qemu" type="raw" cache="none"/>
Nov 13 18:46:08 user nova-compute[75216]:       <source file="/opt/stack/data/nova/instances/3274203b-a985-4f28-9b45-3f83509ae782/disk.config"/>
Nov 13 18:46:08 user nova-compute[75216]:       <target dev="hda" bus="ide"/>
Nov 13 18:46:08 user nova-compute[75216]:     </disk>
Nov 13 18:46:08 user nova-compute[75216]:     <disk type="block" device="disk">
Nov 13 18:46:08 user nova-compute[75216]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 18:46:08 user nova-compute[75216]:       <source dev="/dev/sdc"/>
Nov 13 18:46:08 user nova-compute[75216]:       <target dev="vda" bus="virtio"/>
Nov 13 18:46:08 user nova-compute[75216]:       <serial>de3d195d-b8b4-4c79-a150-813952c640e8</serial>
Nov 13 18:46:08 user nova-compute[75216]:     </disk>
Nov 13 18:46:08 user nova-compute[75216]:     <disk type="block" device="disk">
Nov 13 18:46:08 user nova-compute[75216]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 18:46:08 user nova-compute[75216]:       <source dev="/dev/sdf"/>
Nov 13 18:46:08 user nova-compute[75216]:       <target dev="vdb" bus="virtio"/>
Nov 13 18:46:08 user nova-compute[75216]:       <serial>2a1a5e82-4f70-4668-94bd-4a842d826214</serial>
Nov 13 18:46:08 user nova-compute[75216]:     </disk>
Nov 13 18:46:08 user nova-compute[75216]:     <disk type="block" device="disk">
Nov 13 18:46:08 user nova-compute[75216]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 18:46:08 user nova-compute[75216]:       <source dev="/dev/sdd"/>
Nov 13 18:46:08 user nova-compute[75216]:       <target dev="vdc" bus="virtio"/>
Nov 13 18:46:08 user nova-compute[75216]:       <serial>52f4339a-6a47-4877-b041-9c27d7be2e94</serial>
Nov 13 18:46:08 user nova-compute[75216]:     </disk>
Nov 13 18:46:08 user nova-compute[75216]:     <interface type="ethernet">
Nov 13 18:46:08 user nova-compute[75216]:       <mac address="fa:16:3e:49:58:83"/>
Nov 13 18:46:08 user nova-compute[75216]:       <model type="virtio"/>
Nov 13 18:46:08 user nova-compute[75216]:       <mtu size="1442"/>
Nov 13 18:46:08 user nova-compute[75216]:       <target dev="tap217faeb3-44"/>
Nov 13 18:46:08 user nova-compute[75216]:     </interface>
Nov 13 18:46:08 user nova-compute[75216]:     <interface type="ethernet">
Nov 13 18:46:08 user nova-compute[75216]:       <mac address="fa:16:3e:17:08:ae"/>
Nov 13 18:46:08 user nova-compute[75216]:       <model type="virtio"/>
Nov 13 18:46:08 user nova-compute[75216]:       <mtu size="1442"/>
Nov 13 18:46:08 user nova-compute[75216]:       <target dev="tap9bed3978-d9"/>
Nov 13 18:46:08 user nova-compute[75216]:     </interface>
Nov 13 18:46:08 user nova-compute[75216]:     <interface type="ethernet">
Nov 13 18:46:08 user nova-compute[75216]:       <mac address="fa:16:3e:02:ea:af"/>
Nov 13 18:46:08 user nova-compute[75216]:       <model type="virtio"/>
Nov 13 18:46:08 user nova-compute[75216]:       <mtu size="1442"/>
Nov 13 18:46:08 user nova-compute[75216]:       <target dev="tap95a425c5-f9"/>
Nov 13 18:46:08 user nova-compute[75216]:     </interface>
Nov 13 18:46:08 user nova-compute[75216]:     <interface type="ethernet">
Nov 13 18:46:08 user nova-compute[75216]:       <mac address="fa:16:3e:73:99:8a"/>
Nov 13 18:46:08 user nova-compute[75216]:       <model type="virtio"/>
Nov 13 18:46:08 user nova-compute[75216]:       <mtu size="1442"/>
Nov 13 18:46:08 user nova-compute[75216]:       <target dev="tap7aa7e71d-2c"/>
Nov 13 18:46:08 user nova-compute[75216]:     </interface>
Nov 13 18:46:08 user nova-compute[75216]:     <interface type="ethernet">
Nov 13 18:46:08 user nova-compute[75216]:       <mac address="fa:16:3e:a7:a0:fe"/>
Nov 13 18:46:08 user nova-compute[75216]:       <model type="virtio"/>
Nov 13 18:46:08 user nova-compute[75216]:       <mtu size="1442"/>
Nov 13 18:46:08 user nova-compute[75216]:       <target dev="tap01772e53-e6"/>
Nov 13 18:46:08 user nova-compute[75216]:     </interface>
Nov 13 18:46:08 user nova-compute[75216]:     <interface type="ethernet">
Nov 13 18:46:08 user nova-compute[75216]:       <mac address="fa:16:3e:cb:71:3b"/>
Nov 13 18:46:08 user nova-compute[75216]:       <model type="virtio"/>
Nov 13 18:46:08 user nova-compute[75216]:       <mtu size="1442"/>
Nov 13 18:46:08 user nova-compute[75216]:       <target dev="tap1bb4df6f-02"/>
Nov 13 18:46:08 user nova-compute[75216]:     </interface>
Nov 13 18:46:08 user nova-compute[75216]:     <interface type="ethernet">
Nov 13 18:46:08 user nova-compute[75216]:       <mac address="fa:16:3e:6c:cb:eb"/>
Nov 13 18:46:08 user nova-compute[75216]:       <model type="virtio"/>
Nov 13 18:46:08 user nova-compute[75216]:       <mtu size="1442"/>
Nov 13 18:46:08 user nova-compute[75216]:       <target dev="tapa07efcd3-59"/>
Nov 13 18:46:08 user nova-compute[75216]:     </interface>
Nov 13 18:46:08 user nova-compute[75216]:     <serial type="pty">
Nov 13 18:46:08 user nova-compute[75216]:       <log file="/opt/stack/data/nova/instances/3274203b-a985-4f28-9b45-3f83509ae782/console.log" append="off"/>
Nov 13 18:46:08 user nova-compute[75216]:     </serial>
Nov 13 18:46:08 user nova-compute[75216]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 18:46:08 user nova-compute[75216]:     <video>
Nov 13 18:46:08 user nova-compute[75216]:       <model type="virtio"/>
Nov 13 18:46:08 user nova-compute[75216]:     </video>
Nov 13 18:46:08 user nova-compute[75216]:     <rng model="virtio">
Nov 13 18:46:08 user nova-compute[75216]:       <backend model="random">/dev/urandom</backend>
Nov 13 18:46:08 user nova-compute[75216]:     </rng>
Nov 13 18:46:08 user nova-compute[75216]:     <controller type="usb" index="0" model="none"/>
Nov 13 18:46:08 user nova-compute[75216]:     <memballoon model="virtio">
Nov 13 18:46:08 user nova-compute[75216]:       <stats period="10"/>
Nov 13 18:46:08 user nova-compute[75216]:     </memballoon>
Nov 13 18:46:08 user nova-compute[75216]:   </devices>
Nov 13 18:46:08 user nova-compute[75216]: </domain>
Nov 13 18:46:08 user nova-compute[75216]:  {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 18:46:08 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T18:45:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-835191015',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-835191015',id=9,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEhfcD46zss7ONQ1SY+r8F1CQFXVOm5N4z75azo3v6RrQS7/wvwfpVFyai5x8zqx3fdjrh60HyXnAzyj7itmyT24OjHnNNB9Ltm77zsQMNNIJ86VCYN8lCciAo2iDKAK3g==',key_name='tempest-keypair-557064356',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a8d0f284dd8d4cc88f04a729b1d5d38c',ramdisk_id='',reservation_id='r-7thq8eg2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1999686773',owner_user_name='tempest-TaggedBootDevicesTest_v242-1999686773-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T18:45:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2fd1904e6cdb4600a2e250aefdc0f0ce',uuid=3274203b-a985-4f28-9b45-3f83509ae782,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "217faeb3-4474-449c-ae9f-86e555ce7cd7", "address": "fa:16:3e:49:58:83", "network": {"id": "804f3c05-e540-4bae-a58f-682133e0c762", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-619032523-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8d0f284dd8d4cc88f04a729b1d5d38c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap217faeb3-44", "ovs_interfaceid": "217faeb3-4474-449c-ae9f-86e555ce7cd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 18:46:08 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Converting VIF {"id": "217faeb3-4474-449c-ae9f-86e555ce7cd7", "address": "fa:16:3e:49:58:83", "network": {"id": "804f3c05-e540-4bae-a58f-682133e0c762", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-619032523-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8d0f284dd8d4cc88f04a729b1d5d38c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap217faeb3-44", "ovs_interfaceid": "217faeb3-4474-449c-ae9f-86e555ce7cd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 18:46:08 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:58:83,bridge_name='br-int',has_traffic_filtering=True,id=217faeb3-4474-449c-ae9f-86e555ce7cd7,network=Network(804f3c05-e540-4bae-a58f-682133e0c762),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap217faeb3-44') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 18:46:08 user nova-compute[75216]: DEBUG os_vif [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:58:83,bridge_name='br-int',has_traffic_filtering=True,id=217faeb3-4474-449c-ae9f-86e555ce7cd7,network=Network(804f3c05-e540-4bae-a58f-682133e0c762),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap217faeb3-44') {{(pid=75216) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 18:46:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:46:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 18:46:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '00719bca-8903-5af4-b837-b80984b7f309', '_type': 'linux-noop'}}, row=False) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:46:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:46:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap217faeb3-44, may_exist=True, interface_attrs={}) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:46:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap217faeb3-44, col_values=(('qos', UUID('b4ead642-b55d-4fe2-926b-dc7723f37c51')),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:46:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap217faeb3-44, col_values=(('external_ids', {'iface-id': '217faeb3-4474-449c-ae9f-86e555ce7cd7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:49:58:83', 'vm-uuid': '3274203b-a985-4f28-9b45-3f83509ae782'}),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:46:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:46:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:08 user nova-compute[75216]: INFO os_vif [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:58:83,bridge_name='br-int',has_traffic_filtering=True,id=217faeb3-4474-449c-ae9f-86e555ce7cd7,network=Network(804f3c05-e540-4bae-a58f-682133e0c762),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap217faeb3-44')
Nov 13 18:46:08 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T18:45:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-835191015',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-835191015',id=9,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEhfcD46zss7ONQ1SY+r8F1CQFXVOm5N4z75azo3v6RrQS7/wvwfpVFyai5x8zqx3fdjrh60HyXnAzyj7itmyT24OjHnNNB9Ltm77zsQMNNIJ86VCYN8lCciAo2iDKAK3g==',key_name='tempest-keypair-557064356',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a8d0f284dd8d4cc88f04a729b1d5d38c',ramdisk_id='',reservation_id='r-7thq8eg2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1999686773',owner_user_name='tempest-TaggedBootDevicesTest_v242-1999686773-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T18:45:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2fd1904e6cdb4600a2e250aefdc0f0ce',uuid=3274203b-a985-4f28-9b45-3f83509ae782,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9bed3978-d90d-4b90-b798-12413ea26a48", "address": "fa:16:3e:17:08:ae", "network": {"id": "590b5147-c33a-45bd-a502-8fd41408064d", "bridge": "br-int", "label": "tempest-device-tagging-net1-904391500", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a8d0f284dd8d4cc88f04a729b1d5d38c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bed3978-d9", "ovs_interfaceid": "9bed3978-d90d-4b90-b798-12413ea26a48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75216) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 18:46:08 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Converting VIF {"id": "9bed3978-d90d-4b90-b798-12413ea26a48", "address": "fa:16:3e:17:08:ae", "network": {"id": "590b5147-c33a-45bd-a502-8fd41408064d", "bridge": "br-int", "label": "tempest-device-tagging-net1-904391500", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a8d0f284dd8d4cc88f04a729b1d5d38c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bed3978-d9", "ovs_interfaceid": "9bed3978-d90d-4b90-b798-12413ea26a48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 18:46:08 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:08:ae,bridge_name='br-int',has_traffic_filtering=True,id=9bed3978-d90d-4b90-b798-12413ea26a48,network=Network(590b5147-c33a-45bd-a502-8fd41408064d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9bed3978-d9') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 18:46:08 user nova-compute[75216]: DEBUG os_vif [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:08:ae,bridge_name='br-int',has_traffic_filtering=True,id=9bed3978-d90d-4b90-b798-12413ea26a48,network=Network(590b5147-c33a-45bd-a502-8fd41408064d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9bed3978-d9') {{(pid=75216) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 18:46:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:46:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 18:46:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ba491a1f-621c-5770-97f2-b221d9e68082', '_type': 'linux-noop'}}, row=False) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:46:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:46:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9bed3978-d9, may_exist=True, interface_attrs={}) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:46:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9bed3978-d9, col_values=(('qos', UUID('61eae569-e7b9-4c30-bce6-3f8ddfd27a57')),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:46:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9bed3978-d9, col_values=(('external_ids', {'iface-id': '9bed3978-d90d-4b90-b798-12413ea26a48', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:17:08:ae', 'vm-uuid': '3274203b-a985-4f28-9b45-3f83509ae782'}),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:46:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:46:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:08 user nova-compute[75216]: INFO os_vif [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:08:ae,bridge_name='br-int',has_traffic_filtering=True,id=9bed3978-d90d-4b90-b798-12413ea26a48,network=Network(590b5147-c33a-45bd-a502-8fd41408064d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9bed3978-d9')
Nov 13 18:46:08 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T18:45:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-835191015',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-835191015',id=9,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEhfcD46zss7ONQ1SY+r8F1CQFXVOm5N4z75azo3v6RrQS7/wvwfpVFyai5x8zqx3fdjrh60HyXnAzyj7itmyT24OjHnNNB9Ltm77zsQMNNIJ86VCYN8lCciAo2iDKAK3g==',key_name='tempest-keypair-557064356',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a8d0f284dd8d4cc88f04a729b1d5d38c',ramdisk_id='',reservation_id='r-7thq8eg2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1999686773',owner_user_name='tempest-TaggedBootDevicesTest_v242-1999686773-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T18:45:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2fd1904e6cdb4600a2e250aefdc0f0ce',uuid=3274203b-a985-4f28-9b45-3f83509ae782,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "95a425c5-f994-4504-a94b-040103b2efa7", "address": "fa:16:3e:02:ea:af", "network": {"id": "590b5147-c33a-45bd-a502-8fd41408064d", "bridge": "br-int", "label": "tempest-device-tagging-net1-904391500", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.40", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a8d0f284dd8d4cc88f04a729b1d5d38c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95a425c5-f9", "ovs_interfaceid": "95a425c5-f994-4504-a94b-040103b2efa7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75216) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 18:46:08 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Converting VIF {"id": "95a425c5-f994-4504-a94b-040103b2efa7", "address": "fa:16:3e:02:ea:af", "network": {"id": "590b5147-c33a-45bd-a502-8fd41408064d", "bridge": "br-int", "label": "tempest-device-tagging-net1-904391500", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.40", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a8d0f284dd8d4cc88f04a729b1d5d38c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95a425c5-f9", "ovs_interfaceid": "95a425c5-f994-4504-a94b-040103b2efa7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 18:46:08 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:ea:af,bridge_name='br-int',has_traffic_filtering=True,id=95a425c5-f994-4504-a94b-040103b2efa7,network=Network(590b5147-c33a-45bd-a502-8fd41408064d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap95a425c5-f9') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 18:46:08 user nova-compute[75216]: DEBUG os_vif [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:ea:af,bridge_name='br-int',has_traffic_filtering=True,id=95a425c5-f994-4504-a94b-040103b2efa7,network=Network(590b5147-c33a-45bd-a502-8fd41408064d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap95a425c5-f9') {{(pid=75216) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 18:46:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:46:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 18:46:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '07afa0a9-33a8-5c86-bd5d-a1f3a9a9e95a', '_type': 'linux-noop'}}, row=False) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:46:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:46:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap95a425c5-f9, may_exist=True, interface_attrs={}) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:46:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap95a425c5-f9, col_values=(('qos', UUID('11a584cd-dd6d-4b9c-8ff7-766f4cc6b24b')),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:46:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap95a425c5-f9, col_values=(('external_ids', {'iface-id': '95a425c5-f994-4504-a94b-040103b2efa7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:02:ea:af', 'vm-uuid': '3274203b-a985-4f28-9b45-3f83509ae782'}),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:46:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:46:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:08 user nova-compute[75216]: INFO os_vif [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:ea:af,bridge_name='br-int',has_traffic_filtering=True,id=95a425c5-f994-4504-a94b-040103b2efa7,network=Network(590b5147-c33a-45bd-a502-8fd41408064d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap95a425c5-f9')
Nov 13 18:46:08 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T18:45:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-835191015',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-835191015',id=9,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEhfcD46zss7ONQ1SY+r8F1CQFXVOm5N4z75azo3v6RrQS7/wvwfpVFyai5x8zqx3fdjrh60HyXnAzyj7itmyT24OjHnNNB9Ltm77zsQMNNIJ86VCYN8lCciAo2iDKAK3g==',key_name='tempest-keypair-557064356',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a8d0f284dd8d4cc88f04a729b1d5d38c',ramdisk_id='',reservation_id='r-7thq8eg2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1999686773',owner_user_name='tempest-TaggedBootDevicesTest_v242-1999686773-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T18:45:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2fd1904e6cdb4600a2e250aefdc0f0ce',uuid=3274203b-a985-4f28-9b45-3f83509ae782,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7aa7e71d-2c00-40fd-9d05-d108bcc807ec", "address": "fa:16:3e:73:99:8a", "network": {"id": "590b5147-c33a-45bd-a502-8fd41408064d", "bridge": "br-int", "label": "tempest-device-tagging-net1-904391500", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.98", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a8d0f284dd8d4cc88f04a729b1d5d38c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7aa7e71d-2c", "ovs_interfaceid": "7aa7e71d-2c00-40fd-9d05-d108bcc807ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 18:46:08 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Converting VIF {"id": "7aa7e71d-2c00-40fd-9d05-d108bcc807ec", "address": "fa:16:3e:73:99:8a", "network": {"id": "590b5147-c33a-45bd-a502-8fd41408064d", "bridge": "br-int", "label": "tempest-device-tagging-net1-904391500", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.98", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a8d0f284dd8d4cc88f04a729b1d5d38c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7aa7e71d-2c", "ovs_interfaceid": "7aa7e71d-2c00-40fd-9d05-d108bcc807ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 18:46:08 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:99:8a,bridge_name='br-int',has_traffic_filtering=True,id=7aa7e71d-2c00-40fd-9d05-d108bcc807ec,network=Network(590b5147-c33a-45bd-a502-8fd41408064d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7aa7e71d-2c') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 18:46:08 user nova-compute[75216]: DEBUG os_vif [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:99:8a,bridge_name='br-int',has_traffic_filtering=True,id=7aa7e71d-2c00-40fd-9d05-d108bcc807ec,network=Network(590b5147-c33a-45bd-a502-8fd41408064d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7aa7e71d-2c') {{(pid=75216) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 18:46:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:46:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 18:46:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '976200f5-27e1-5d3a-a791-3804af1a6073', '_type': 'linux-noop'}}, row=False) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:46:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:46:09 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:09 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:09 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7aa7e71d-2c, may_exist=True, interface_attrs={}) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:46:09 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7aa7e71d-2c, col_values=(('qos', UUID('209f9bc3-a531-41da-bbf0-65d1c473f39e')),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:46:09 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7aa7e71d-2c, col_values=(('external_ids', {'iface-id': '7aa7e71d-2c00-40fd-9d05-d108bcc807ec', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:73:99:8a', 'vm-uuid': '3274203b-a985-4f28-9b45-3f83509ae782'}),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:46:09 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:09 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:46:09 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:09 user nova-compute[75216]: INFO os_vif [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:99:8a,bridge_name='br-int',has_traffic_filtering=True,id=7aa7e71d-2c00-40fd-9d05-d108bcc807ec,network=Network(590b5147-c33a-45bd-a502-8fd41408064d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7aa7e71d-2c')
Nov 13 18:46:09 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T18:45:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-835191015',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-835191015',id=9,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEhfcD46zss7ONQ1SY+r8F1CQFXVOm5N4z75azo3v6RrQS7/wvwfpVFyai5x8zqx3fdjrh60HyXnAzyj7itmyT24OjHnNNB9Ltm77zsQMNNIJ86VCYN8lCciAo2iDKAK3g==',key_name='tempest-keypair-557064356',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a8d0f284dd8d4cc88f04a729b1d5d38c',ramdisk_id='',reservation_id='r-7thq8eg2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1999686773',owner_user_name='tempest-TaggedBootDevicesTest_v242-1999686773-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T18:45:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2fd1904e6cdb4600a2e250aefdc0f0ce',uuid=3274203b-a985-4f28-9b45-3f83509ae782,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "01772e53-e624-4728-beb1-929cc4165f21", "address": "fa:16:3e:a7:a0:fe", "network": {"id": "590b5147-c33a-45bd-a502-8fd41408064d", "bridge": "br-int", "label": "tempest-device-tagging-net1-904391500", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a8d0f284dd8d4cc88f04a729b1d5d38c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01772e53-e6", "ovs_interfaceid": "01772e53-e624-4728-beb1-929cc4165f21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 18:46:09 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Converting VIF {"id": "01772e53-e624-4728-beb1-929cc4165f21", "address": "fa:16:3e:a7:a0:fe", "network": {"id": "590b5147-c33a-45bd-a502-8fd41408064d", "bridge": "br-int", "label": "tempest-device-tagging-net1-904391500", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a8d0f284dd8d4cc88f04a729b1d5d38c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01772e53-e6", "ovs_interfaceid": "01772e53-e624-4728-beb1-929cc4165f21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 18:46:09 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:a0:fe,bridge_name='br-int',has_traffic_filtering=True,id=01772e53-e624-4728-beb1-929cc4165f21,network=Network(590b5147-c33a-45bd-a502-8fd41408064d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01772e53-e6') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 18:46:09 user nova-compute[75216]: DEBUG os_vif [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:a0:fe,bridge_name='br-int',has_traffic_filtering=True,id=01772e53-e624-4728-beb1-929cc4165f21,network=Network(590b5147-c33a-45bd-a502-8fd41408064d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01772e53-e6') {{(pid=75216) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 18:46:09 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:09 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:46:09 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 18:46:09 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:09 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '56e31305-4e26-54e3-bc0f-7d2e865f0b66', '_type': 'linux-noop'}}, row=False) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:46:09 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:09 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:46:09 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:09 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:09 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap01772e53-e6, may_exist=True, interface_attrs={}) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:46:09 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap01772e53-e6, col_values=(('qos', UUID('3b9d1723-c6e6-4776-bbfa-b71a55e5a524')),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:46:09 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap01772e53-e6, col_values=(('external_ids', {'iface-id': '01772e53-e624-4728-beb1-929cc4165f21', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a7:a0:fe', 'vm-uuid': '3274203b-a985-4f28-9b45-3f83509ae782'}),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:46:09 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:09 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:46:09 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:09 user nova-compute[75216]: INFO os_vif [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:a0:fe,bridge_name='br-int',has_traffic_filtering=True,id=01772e53-e624-4728-beb1-929cc4165f21,network=Network(590b5147-c33a-45bd-a502-8fd41408064d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01772e53-e6')
Nov 13 18:46:09 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T18:45:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-835191015',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-835191015',id=9,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEhfcD46zss7ONQ1SY+r8F1CQFXVOm5N4z75azo3v6RrQS7/wvwfpVFyai5x8zqx3fdjrh60HyXnAzyj7itmyT24OjHnNNB9Ltm77zsQMNNIJ86VCYN8lCciAo2iDKAK3g==',key_name='tempest-keypair-557064356',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a8d0f284dd8d4cc88f04a729b1d5d38c',ramdisk_id='',reservation_id='r-7thq8eg2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1999686773',owner_user_name='tempest-TaggedBootDevicesTest_v242-1999686773-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T18:45:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2fd1904e6cdb4600a2e250aefdc0f0ce',uuid=3274203b-a985-4f28-9b45-3f83509ae782,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1bb4df6f-02b2-415b-9cea-fd8a7a04874c", "address": "fa:16:3e:cb:71:3b", "network": {"id": "f82e0fd1-978f-4b08-8480-709765208ef9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1203652186", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a8d0f284dd8d4cc88f04a729b1d5d38c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bb4df6f-02", "ovs_interfaceid": "1bb4df6f-02b2-415b-9cea-fd8a7a04874c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 18:46:09 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Converting VIF {"id": "1bb4df6f-02b2-415b-9cea-fd8a7a04874c", "address": "fa:16:3e:cb:71:3b", "network": {"id": "f82e0fd1-978f-4b08-8480-709765208ef9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1203652186", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a8d0f284dd8d4cc88f04a729b1d5d38c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bb4df6f-02", "ovs_interfaceid": "1bb4df6f-02b2-415b-9cea-fd8a7a04874c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 18:46:09 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:71:3b,bridge_name='br-int',has_traffic_filtering=True,id=1bb4df6f-02b2-415b-9cea-fd8a7a04874c,network=Network(f82e0fd1-978f-4b08-8480-709765208ef9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bb4df6f-02') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 18:46:09 user nova-compute[75216]: DEBUG os_vif [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:71:3b,bridge_name='br-int',has_traffic_filtering=True,id=1bb4df6f-02b2-415b-9cea-fd8a7a04874c,network=Network(f82e0fd1-978f-4b08-8480-709765208ef9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bb4df6f-02') {{(pid=75216) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 18:46:09 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:09 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:46:09 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 18:46:09 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:09 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fa87e2b6-99d9-5cfd-b462-a63bd5a3743f', '_type': 'linux-noop'}}, row=False) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:46:09 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:09 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:46:09 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:09 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:09 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:09 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:09 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1bb4df6f-02, may_exist=True, interface_attrs={}) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:46:09 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1bb4df6f-02, col_values=(('qos', UUID('92096f21-3f13-4469-834b-b91a0dfc90ec')),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:46:09 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1bb4df6f-02, col_values=(('external_ids', {'iface-id': '1bb4df6f-02b2-415b-9cea-fd8a7a04874c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cb:71:3b', 'vm-uuid': '3274203b-a985-4f28-9b45-3f83509ae782'}),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:46:09 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:09 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:46:09 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:09 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:09 user nova-compute[75216]: INFO os_vif [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:71:3b,bridge_name='br-int',has_traffic_filtering=True,id=1bb4df6f-02b2-415b-9cea-fd8a7a04874c,network=Network(f82e0fd1-978f-4b08-8480-709765208ef9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bb4df6f-02')
Nov 13 18:46:09 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T18:45:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-835191015',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-835191015',id=9,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEhfcD46zss7ONQ1SY+r8F1CQFXVOm5N4z75azo3v6RrQS7/wvwfpVFyai5x8zqx3fdjrh60HyXnAzyj7itmyT24OjHnNNB9Ltm77zsQMNNIJ86VCYN8lCciAo2iDKAK3g==',key_name='tempest-keypair-557064356',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a8d0f284dd8d4cc88f04a729b1d5d38c',ramdisk_id='',reservation_id='r-7thq8eg2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1999686773',owner_user_name='tempest-TaggedBootDevicesTest_v242-1999686773-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T18:45:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2fd1904e6cdb4600a2e250aefdc0f0ce',uuid=3274203b-a985-4f28-9b45-3f83509ae782,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a07efcd3-59f4-452e-8fb7-8b8233ae235f", "address": "fa:16:3e:6c:cb:eb", "network": {"id": "f82e0fd1-978f-4b08-8480-709765208ef9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1203652186", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a8d0f284dd8d4cc88f04a729b1d5d38c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa07efcd3-59", "ovs_interfaceid": "a07efcd3-59f4-452e-8fb7-8b8233ae235f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 18:46:09 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Converting VIF {"id": "a07efcd3-59f4-452e-8fb7-8b8233ae235f", "address": "fa:16:3e:6c:cb:eb", "network": {"id": "f82e0fd1-978f-4b08-8480-709765208ef9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1203652186", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a8d0f284dd8d4cc88f04a729b1d5d38c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa07efcd3-59", "ovs_interfaceid": "a07efcd3-59f4-452e-8fb7-8b8233ae235f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 18:46:09 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:cb:eb,bridge_name='br-int',has_traffic_filtering=True,id=a07efcd3-59f4-452e-8fb7-8b8233ae235f,network=Network(f82e0fd1-978f-4b08-8480-709765208ef9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa07efcd3-59') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 18:46:09 user nova-compute[75216]: DEBUG os_vif [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:cb:eb,bridge_name='br-int',has_traffic_filtering=True,id=a07efcd3-59f4-452e-8fb7-8b8233ae235f,network=Network(f82e0fd1-978f-4b08-8480-709765208ef9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa07efcd3-59') {{(pid=75216) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 18:46:09 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:09 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:46:09 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 18:46:09 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:09 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'de81b935-b21b-59e4-988b-24de8ca11cde', '_type': 'linux-noop'}}, row=False) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:46:09 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:09 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:46:09 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:09 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:10 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:10 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:10 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:10 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:10 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa07efcd3-59, may_exist=True, interface_attrs={}) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:46:10 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa07efcd3-59, col_values=(('qos', UUID('ce0149df-acc9-4120-87c4-414b100e4126')),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:46:10 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa07efcd3-59, col_values=(('external_ids', {'iface-id': 'a07efcd3-59f4-452e-8fb7-8b8233ae235f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6c:cb:eb', 'vm-uuid': '3274203b-a985-4f28-9b45-3f83509ae782'}),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:46:10 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:10 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:46:10 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:10 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:10 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:10 user nova-compute[75216]: INFO os_vif [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:cb:eb,bridge_name='br-int',has_traffic_filtering=True,id=a07efcd3-59f4-452e-8fb7-8b8233ae235f,network=Network(f82e0fd1-978f-4b08-8480-709765208ef9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa07efcd3-59')
Nov 13 18:46:10 user nova-compute[75216]: DEBUG nova.compute.manager [req-eacb960f-afa6-4c32-a9cf-80dec26203f1 req-d189c50b-d7bb-4c21-a12f-2e772b6d4a3b service nova] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Received event network-vif-plugged-7c9f8c17-a293-4817-ae4f-3fab0a1076a6 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:46:10 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-eacb960f-afa6-4c32-a9cf-80dec26203f1 req-d189c50b-d7bb-4c21-a12f-2e772b6d4a3b service nova] Acquiring lock "78605259-17bf-47da-86de-3c76ac1c5bfa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:46:10 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-eacb960f-afa6-4c32-a9cf-80dec26203f1 req-d189c50b-d7bb-4c21-a12f-2e772b6d4a3b service nova] Lock "78605259-17bf-47da-86de-3c76ac1c5bfa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:46:10 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-eacb960f-afa6-4c32-a9cf-80dec26203f1 req-d189c50b-d7bb-4c21-a12f-2e772b6d4a3b service nova] Lock "78605259-17bf-47da-86de-3c76ac1c5bfa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:46:10 user nova-compute[75216]: DEBUG nova.compute.manager [req-eacb960f-afa6-4c32-a9cf-80dec26203f1 req-d189c50b-d7bb-4c21-a12f-2e772b6d4a3b service nova] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] No waiting events found dispatching network-vif-plugged-7c9f8c17-a293-4817-ae4f-3fab0a1076a6 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:46:10 user nova-compute[75216]: WARNING nova.compute.manager [req-eacb960f-afa6-4c32-a9cf-80dec26203f1 req-d189c50b-d7bb-4c21-a12f-2e772b6d4a3b service nova] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Received unexpected event network-vif-plugged-7c9f8c17-a293-4817-ae4f-3fab0a1076a6 for instance with vm_state building and task_state spawning.
Nov 13 18:46:10 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:10 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] No BDM found with device name hda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 18:46:10 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 18:46:10 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] No VIF found with MAC fa:16:3e:49:58:83, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 18:46:10 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] No VIF found with MAC fa:16:3e:a7:a0:fe, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 18:46:10 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] Using config drive
Nov 13 18:46:10 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:10 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:10 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:10 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] Creating config drive at /opt/stack/data/nova/instances/3274203b-a985-4f28-9b45-3f83509ae782/disk.config
Nov 13 18:46:10 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/3274203b-a985-4f28-9b45-3f83509ae782/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp4z2ywxsv {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:46:10 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:10 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/3274203b-a985-4f28-9b45-3f83509ae782/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp4z2ywxsv" returned: 0 in 0.053s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:46:10 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:11 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:11 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:11 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:11 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:11 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:11 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:11 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:11 user nova-compute[75216]: DEBUG nova.compute.manager [req-535786f6-1760-4d66-a0c6-84d050774b4f req-c71e361d-3fe5-4ff6-bb8e-0dfdfb57de43 service nova] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Received event network-vif-plugged-7b6ed148-b7c9-479b-9e2d-cfc0c3f6f93a {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:46:11 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-535786f6-1760-4d66-a0c6-84d050774b4f req-c71e361d-3fe5-4ff6-bb8e-0dfdfb57de43 service nova] Acquiring lock "78605259-17bf-47da-86de-3c76ac1c5bfa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:46:11 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-535786f6-1760-4d66-a0c6-84d050774b4f req-c71e361d-3fe5-4ff6-bb8e-0dfdfb57de43 service nova] Lock "78605259-17bf-47da-86de-3c76ac1c5bfa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:46:11 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-535786f6-1760-4d66-a0c6-84d050774b4f req-c71e361d-3fe5-4ff6-bb8e-0dfdfb57de43 service nova] Lock "78605259-17bf-47da-86de-3c76ac1c5bfa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:46:11 user nova-compute[75216]: DEBUG nova.compute.manager [req-535786f6-1760-4d66-a0c6-84d050774b4f req-c71e361d-3fe5-4ff6-bb8e-0dfdfb57de43 service nova] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] No waiting events found dispatching network-vif-plugged-7b6ed148-b7c9-479b-9e2d-cfc0c3f6f93a {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:46:11 user nova-compute[75216]: WARNING nova.compute.manager [req-535786f6-1760-4d66-a0c6-84d050774b4f req-c71e361d-3fe5-4ff6-bb8e-0dfdfb57de43 service nova] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Received unexpected event network-vif-plugged-7b6ed148-b7c9-479b-9e2d-cfc0c3f6f93a for instance with vm_state building and task_state spawning.
Nov 13 18:46:11 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:11 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:11 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:11 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:11 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:12 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:12 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:12 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:12 user nova-compute[75216]: DEBUG nova.compute.manager [req-9c000ac7-40d7-4a87-a987-5f897c1dad4a req-91ec6fd1-fa5c-4f6f-99a9-d1c6c89c5929 service nova] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Received event network-vif-plugged-7c9f8c17-a293-4817-ae4f-3fab0a1076a6 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:46:12 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-9c000ac7-40d7-4a87-a987-5f897c1dad4a req-91ec6fd1-fa5c-4f6f-99a9-d1c6c89c5929 service nova] Acquiring lock "78605259-17bf-47da-86de-3c76ac1c5bfa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:46:12 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-9c000ac7-40d7-4a87-a987-5f897c1dad4a req-91ec6fd1-fa5c-4f6f-99a9-d1c6c89c5929 service nova] Lock "78605259-17bf-47da-86de-3c76ac1c5bfa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:46:12 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-9c000ac7-40d7-4a87-a987-5f897c1dad4a req-91ec6fd1-fa5c-4f6f-99a9-d1c6c89c5929 service nova] Lock "78605259-17bf-47da-86de-3c76ac1c5bfa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:46:12 user nova-compute[75216]: DEBUG nova.compute.manager [req-9c000ac7-40d7-4a87-a987-5f897c1dad4a req-91ec6fd1-fa5c-4f6f-99a9-d1c6c89c5929 service nova] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] No waiting events found dispatching network-vif-plugged-7c9f8c17-a293-4817-ae4f-3fab0a1076a6 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:46:12 user nova-compute[75216]: WARNING nova.compute.manager [req-9c000ac7-40d7-4a87-a987-5f897c1dad4a req-91ec6fd1-fa5c-4f6f-99a9-d1c6c89c5929 service nova] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Received unexpected event network-vif-plugged-7c9f8c17-a293-4817-ae4f-3fab0a1076a6 for instance with vm_state building and task_state spawning.
Nov 13 18:46:12 user nova-compute[75216]: DEBUG nova.compute.manager [req-9c000ac7-40d7-4a87-a987-5f897c1dad4a req-91ec6fd1-fa5c-4f6f-99a9-d1c6c89c5929 service nova] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Received event network-vif-plugged-c5b1d8e6-f202-4278-924c-abecf64f299c {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:46:12 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-9c000ac7-40d7-4a87-a987-5f897c1dad4a req-91ec6fd1-fa5c-4f6f-99a9-d1c6c89c5929 service nova] Acquiring lock "78605259-17bf-47da-86de-3c76ac1c5bfa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:46:12 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-9c000ac7-40d7-4a87-a987-5f897c1dad4a req-91ec6fd1-fa5c-4f6f-99a9-d1c6c89c5929 service nova] Lock "78605259-17bf-47da-86de-3c76ac1c5bfa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:46:12 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-9c000ac7-40d7-4a87-a987-5f897c1dad4a req-91ec6fd1-fa5c-4f6f-99a9-d1c6c89c5929 service nova] Lock "78605259-17bf-47da-86de-3c76ac1c5bfa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:46:12 user nova-compute[75216]: DEBUG nova.compute.manager [req-9c000ac7-40d7-4a87-a987-5f897c1dad4a req-91ec6fd1-fa5c-4f6f-99a9-d1c6c89c5929 service nova] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] No waiting events found dispatching network-vif-plugged-c5b1d8e6-f202-4278-924c-abecf64f299c {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:46:12 user nova-compute[75216]: WARNING nova.compute.manager [req-9c000ac7-40d7-4a87-a987-5f897c1dad4a req-91ec6fd1-fa5c-4f6f-99a9-d1c6c89c5929 service nova] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Received unexpected event network-vif-plugged-c5b1d8e6-f202-4278-924c-abecf64f299c for instance with vm_state building and task_state spawning.
Nov 13 18:46:12 user nova-compute[75216]: DEBUG nova.compute.manager [req-9c000ac7-40d7-4a87-a987-5f897c1dad4a req-91ec6fd1-fa5c-4f6f-99a9-d1c6c89c5929 service nova] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Received event network-vif-plugged-c5b1d8e6-f202-4278-924c-abecf64f299c {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:46:12 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-9c000ac7-40d7-4a87-a987-5f897c1dad4a req-91ec6fd1-fa5c-4f6f-99a9-d1c6c89c5929 service nova] Acquiring lock "78605259-17bf-47da-86de-3c76ac1c5bfa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:46:12 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-9c000ac7-40d7-4a87-a987-5f897c1dad4a req-91ec6fd1-fa5c-4f6f-99a9-d1c6c89c5929 service nova] Lock "78605259-17bf-47da-86de-3c76ac1c5bfa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:46:12 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-9c000ac7-40d7-4a87-a987-5f897c1dad4a req-91ec6fd1-fa5c-4f6f-99a9-d1c6c89c5929 service nova] Lock "78605259-17bf-47da-86de-3c76ac1c5bfa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:46:12 user nova-compute[75216]: DEBUG nova.compute.manager [req-9c000ac7-40d7-4a87-a987-5f897c1dad4a req-91ec6fd1-fa5c-4f6f-99a9-d1c6c89c5929 service nova] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] No waiting events found dispatching network-vif-plugged-c5b1d8e6-f202-4278-924c-abecf64f299c {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:46:12 user nova-compute[75216]: WARNING nova.compute.manager [req-9c000ac7-40d7-4a87-a987-5f897c1dad4a req-91ec6fd1-fa5c-4f6f-99a9-d1c6c89c5929 service nova] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Received unexpected event network-vif-plugged-c5b1d8e6-f202-4278-924c-abecf64f299c for instance with vm_state building and task_state spawning.
Nov 13 18:46:12 user nova-compute[75216]: DEBUG nova.compute.manager [req-9c000ac7-40d7-4a87-a987-5f897c1dad4a req-91ec6fd1-fa5c-4f6f-99a9-d1c6c89c5929 service nova] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Received event network-vif-plugged-e4e34ea8-fb99-4a0e-8b65-a93933cc7d6b {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:46:12 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-9c000ac7-40d7-4a87-a987-5f897c1dad4a req-91ec6fd1-fa5c-4f6f-99a9-d1c6c89c5929 service nova] Acquiring lock "78605259-17bf-47da-86de-3c76ac1c5bfa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:46:12 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-9c000ac7-40d7-4a87-a987-5f897c1dad4a req-91ec6fd1-fa5c-4f6f-99a9-d1c6c89c5929 service nova] Lock "78605259-17bf-47da-86de-3c76ac1c5bfa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:46:12 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-9c000ac7-40d7-4a87-a987-5f897c1dad4a req-91ec6fd1-fa5c-4f6f-99a9-d1c6c89c5929 service nova] Lock "78605259-17bf-47da-86de-3c76ac1c5bfa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:46:12 user nova-compute[75216]: DEBUG nova.compute.manager [req-9c000ac7-40d7-4a87-a987-5f897c1dad4a req-91ec6fd1-fa5c-4f6f-99a9-d1c6c89c5929 service nova] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] No waiting events found dispatching network-vif-plugged-e4e34ea8-fb99-4a0e-8b65-a93933cc7d6b {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:46:12 user nova-compute[75216]: WARNING nova.compute.manager [req-9c000ac7-40d7-4a87-a987-5f897c1dad4a req-91ec6fd1-fa5c-4f6f-99a9-d1c6c89c5929 service nova] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Received unexpected event network-vif-plugged-e4e34ea8-fb99-4a0e-8b65-a93933cc7d6b for instance with vm_state building and task_state spawning.
Nov 13 18:46:12 user nova-compute[75216]: DEBUG nova.compute.manager [req-9c000ac7-40d7-4a87-a987-5f897c1dad4a req-91ec6fd1-fa5c-4f6f-99a9-d1c6c89c5929 service nova] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Received event network-vif-plugged-e4e34ea8-fb99-4a0e-8b65-a93933cc7d6b {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:46:12 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-9c000ac7-40d7-4a87-a987-5f897c1dad4a req-91ec6fd1-fa5c-4f6f-99a9-d1c6c89c5929 service nova] Acquiring lock "78605259-17bf-47da-86de-3c76ac1c5bfa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:46:12 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-9c000ac7-40d7-4a87-a987-5f897c1dad4a req-91ec6fd1-fa5c-4f6f-99a9-d1c6c89c5929 service nova] Lock "78605259-17bf-47da-86de-3c76ac1c5bfa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:46:12 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-9c000ac7-40d7-4a87-a987-5f897c1dad4a req-91ec6fd1-fa5c-4f6f-99a9-d1c6c89c5929 service nova] Lock "78605259-17bf-47da-86de-3c76ac1c5bfa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:46:12 user nova-compute[75216]: DEBUG nova.compute.manager [req-9c000ac7-40d7-4a87-a987-5f897c1dad4a req-91ec6fd1-fa5c-4f6f-99a9-d1c6c89c5929 service nova] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] No waiting events found dispatching network-vif-plugged-e4e34ea8-fb99-4a0e-8b65-a93933cc7d6b {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:46:12 user nova-compute[75216]: WARNING nova.compute.manager [req-9c000ac7-40d7-4a87-a987-5f897c1dad4a req-91ec6fd1-fa5c-4f6f-99a9-d1c6c89c5929 service nova] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Received unexpected event network-vif-plugged-e4e34ea8-fb99-4a0e-8b65-a93933cc7d6b for instance with vm_state building and task_state spawning.
Nov 13 18:46:12 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:12 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:12 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:12 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:12 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:13 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:13 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:13 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:13 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:13 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:13 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:13 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:13 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:13 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:13 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:13 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:13 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:13 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:13 user nova-compute[75216]: DEBUG nova.compute.manager [req-681aaa48-8b85-4f44-9df7-318f50e8a131 req-ea781a63-3e7c-4841-8778-9e14e6556e2e service nova] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Received event network-vif-plugged-7b6ed148-b7c9-479b-9e2d-cfc0c3f6f93a {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:46:13 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-681aaa48-8b85-4f44-9df7-318f50e8a131 req-ea781a63-3e7c-4841-8778-9e14e6556e2e service nova] Acquiring lock "78605259-17bf-47da-86de-3c76ac1c5bfa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:46:13 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-681aaa48-8b85-4f44-9df7-318f50e8a131 req-ea781a63-3e7c-4841-8778-9e14e6556e2e service nova] Lock "78605259-17bf-47da-86de-3c76ac1c5bfa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:46:13 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-681aaa48-8b85-4f44-9df7-318f50e8a131 req-ea781a63-3e7c-4841-8778-9e14e6556e2e service nova] Lock "78605259-17bf-47da-86de-3c76ac1c5bfa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:46:13 user nova-compute[75216]: DEBUG nova.compute.manager [req-681aaa48-8b85-4f44-9df7-318f50e8a131 req-ea781a63-3e7c-4841-8778-9e14e6556e2e service nova] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] No waiting events found dispatching network-vif-plugged-7b6ed148-b7c9-479b-9e2d-cfc0c3f6f93a {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:46:13 user nova-compute[75216]: WARNING nova.compute.manager [req-681aaa48-8b85-4f44-9df7-318f50e8a131 req-ea781a63-3e7c-4841-8778-9e14e6556e2e service nova] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Received unexpected event network-vif-plugged-7b6ed148-b7c9-479b-9e2d-cfc0c3f6f93a for instance with vm_state building and task_state spawning.
Nov 13 18:46:13 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:13 user nova-compute[75216]: DEBUG nova.compute.manager [req-de74b25c-bdef-4d6c-994a-c409dead8a29 req-93409338-eb54-4848-a7f8-4b4b43147bfc service nova] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Received event network-vif-plugged-6b91caf7-7b72-41be-8cf7-96e728c0eae5 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:46:13 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-de74b25c-bdef-4d6c-994a-c409dead8a29 req-93409338-eb54-4848-a7f8-4b4b43147bfc service nova] Acquiring lock "78605259-17bf-47da-86de-3c76ac1c5bfa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:46:13 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-de74b25c-bdef-4d6c-994a-c409dead8a29 req-93409338-eb54-4848-a7f8-4b4b43147bfc service nova] Lock "78605259-17bf-47da-86de-3c76ac1c5bfa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:46:13 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-de74b25c-bdef-4d6c-994a-c409dead8a29 req-93409338-eb54-4848-a7f8-4b4b43147bfc service nova] Lock "78605259-17bf-47da-86de-3c76ac1c5bfa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:46:13 user nova-compute[75216]: DEBUG nova.compute.manager [req-de74b25c-bdef-4d6c-994a-c409dead8a29 req-93409338-eb54-4848-a7f8-4b4b43147bfc service nova] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] No waiting events found dispatching network-vif-plugged-6b91caf7-7b72-41be-8cf7-96e728c0eae5 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:46:13 user nova-compute[75216]: WARNING nova.compute.manager [req-de74b25c-bdef-4d6c-994a-c409dead8a29 req-93409338-eb54-4848-a7f8-4b4b43147bfc service nova] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Received unexpected event network-vif-plugged-6b91caf7-7b72-41be-8cf7-96e728c0eae5 for instance with vm_state building and task_state spawning.
Nov 13 18:46:13 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:13 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:13 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:14 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-4b01bdf3-0102-404c-9c93-081df61329bb tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] Acquiring lock "a3bcf65e-bd5b-4350-a222-5f4522418a67" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:46:14 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-4b01bdf3-0102-404c-9c93-081df61329bb tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] Lock "a3bcf65e-bd5b-4350-a222-5f4522418a67" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:46:14 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:14 user nova-compute[75216]: DEBUG nova.compute.manager [None req-4b01bdf3-0102-404c-9c93-081df61329bb tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] [instance: a3bcf65e-bd5b-4350-a222-5f4522418a67] Starting instance... {{(pid=75216) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 18:46:14 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:14 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:14 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:14 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:14 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:14 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-4b01bdf3-0102-404c-9c93-081df61329bb tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:46:14 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-4b01bdf3-0102-404c-9c93-081df61329bb tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:46:14 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-4b01bdf3-0102-404c-9c93-081df61329bb tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75216) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 18:46:14 user nova-compute[75216]: INFO nova.compute.claims [None req-4b01bdf3-0102-404c-9c93-081df61329bb tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] [instance: a3bcf65e-bd5b-4350-a222-5f4522418a67] Claim successful on node user
Nov 13 18:46:14 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:14 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:14 user nova-compute[75216]: DEBUG nova.compute.manager [req-e9b5be37-e8b5-4fcd-9ab7-edb76698291a req-d658a694-b5dc-4e50-8bad-93fc061c497d service nova] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] Received event network-vif-plugged-217faeb3-4474-449c-ae9f-86e555ce7cd7 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:46:14 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-e9b5be37-e8b5-4fcd-9ab7-edb76698291a req-d658a694-b5dc-4e50-8bad-93fc061c497d service nova] Acquiring lock "3274203b-a985-4f28-9b45-3f83509ae782-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:46:14 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-e9b5be37-e8b5-4fcd-9ab7-edb76698291a req-d658a694-b5dc-4e50-8bad-93fc061c497d service nova] Lock "3274203b-a985-4f28-9b45-3f83509ae782-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:46:14 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-e9b5be37-e8b5-4fcd-9ab7-edb76698291a req-d658a694-b5dc-4e50-8bad-93fc061c497d service nova] Lock "3274203b-a985-4f28-9b45-3f83509ae782-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:46:14 user nova-compute[75216]: DEBUG nova.compute.manager [req-e9b5be37-e8b5-4fcd-9ab7-edb76698291a req-d658a694-b5dc-4e50-8bad-93fc061c497d service nova] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] No waiting events found dispatching network-vif-plugged-217faeb3-4474-449c-ae9f-86e555ce7cd7 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:46:14 user nova-compute[75216]: WARNING nova.compute.manager [req-e9b5be37-e8b5-4fcd-9ab7-edb76698291a req-d658a694-b5dc-4e50-8bad-93fc061c497d service nova] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] Received unexpected event network-vif-plugged-217faeb3-4474-449c-ae9f-86e555ce7cd7 for instance with vm_state building and task_state spawning.
Nov 13 18:46:14 user nova-compute[75216]: DEBUG nova.compute.manager [req-e9b5be37-e8b5-4fcd-9ab7-edb76698291a req-d658a694-b5dc-4e50-8bad-93fc061c497d service nova] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] Received event network-vif-plugged-217faeb3-4474-449c-ae9f-86e555ce7cd7 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:46:14 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-e9b5be37-e8b5-4fcd-9ab7-edb76698291a req-d658a694-b5dc-4e50-8bad-93fc061c497d service nova] Acquiring lock "3274203b-a985-4f28-9b45-3f83509ae782-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:46:14 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-e9b5be37-e8b5-4fcd-9ab7-edb76698291a req-d658a694-b5dc-4e50-8bad-93fc061c497d service nova] Lock "3274203b-a985-4f28-9b45-3f83509ae782-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:46:14 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-e9b5be37-e8b5-4fcd-9ab7-edb76698291a req-d658a694-b5dc-4e50-8bad-93fc061c497d service nova] Lock "3274203b-a985-4f28-9b45-3f83509ae782-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:46:14 user nova-compute[75216]: DEBUG nova.compute.manager [req-e9b5be37-e8b5-4fcd-9ab7-edb76698291a req-d658a694-b5dc-4e50-8bad-93fc061c497d service nova] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] No waiting events found dispatching network-vif-plugged-217faeb3-4474-449c-ae9f-86e555ce7cd7 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:46:14 user nova-compute[75216]: WARNING nova.compute.manager [req-e9b5be37-e8b5-4fcd-9ab7-edb76698291a req-d658a694-b5dc-4e50-8bad-93fc061c497d service nova] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] Received unexpected event network-vif-plugged-217faeb3-4474-449c-ae9f-86e555ce7cd7 for instance with vm_state building and task_state spawning.
Nov 13 18:46:14 user nova-compute[75216]: DEBUG nova.compute.manager [req-e9b5be37-e8b5-4fcd-9ab7-edb76698291a req-d658a694-b5dc-4e50-8bad-93fc061c497d service nova] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] Received event network-vif-plugged-9bed3978-d90d-4b90-b798-12413ea26a48 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:46:14 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-e9b5be37-e8b5-4fcd-9ab7-edb76698291a req-d658a694-b5dc-4e50-8bad-93fc061c497d service nova] Acquiring lock "3274203b-a985-4f28-9b45-3f83509ae782-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:46:14 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-e9b5be37-e8b5-4fcd-9ab7-edb76698291a req-d658a694-b5dc-4e50-8bad-93fc061c497d service nova] Lock "3274203b-a985-4f28-9b45-3f83509ae782-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:46:14 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-e9b5be37-e8b5-4fcd-9ab7-edb76698291a req-d658a694-b5dc-4e50-8bad-93fc061c497d service nova] Lock "3274203b-a985-4f28-9b45-3f83509ae782-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:46:14 user nova-compute[75216]: DEBUG nova.compute.manager [req-e9b5be37-e8b5-4fcd-9ab7-edb76698291a req-d658a694-b5dc-4e50-8bad-93fc061c497d service nova] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] No waiting events found dispatching network-vif-plugged-9bed3978-d90d-4b90-b798-12413ea26a48 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:46:14 user nova-compute[75216]: WARNING nova.compute.manager [req-e9b5be37-e8b5-4fcd-9ab7-edb76698291a req-d658a694-b5dc-4e50-8bad-93fc061c497d service nova] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] Received unexpected event network-vif-plugged-9bed3978-d90d-4b90-b798-12413ea26a48 for instance with vm_state building and task_state spawning.
Nov 13 18:46:14 user nova-compute[75216]: DEBUG nova.compute.manager [req-e9b5be37-e8b5-4fcd-9ab7-edb76698291a req-d658a694-b5dc-4e50-8bad-93fc061c497d service nova] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] Received event network-vif-plugged-9bed3978-d90d-4b90-b798-12413ea26a48 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:46:14 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-e9b5be37-e8b5-4fcd-9ab7-edb76698291a req-d658a694-b5dc-4e50-8bad-93fc061c497d service nova] Acquiring lock "3274203b-a985-4f28-9b45-3f83509ae782-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:46:14 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-e9b5be37-e8b5-4fcd-9ab7-edb76698291a req-d658a694-b5dc-4e50-8bad-93fc061c497d service nova] Lock "3274203b-a985-4f28-9b45-3f83509ae782-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:46:14 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-e9b5be37-e8b5-4fcd-9ab7-edb76698291a req-d658a694-b5dc-4e50-8bad-93fc061c497d service nova] Lock "3274203b-a985-4f28-9b45-3f83509ae782-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:46:14 user nova-compute[75216]: DEBUG nova.compute.manager [req-e9b5be37-e8b5-4fcd-9ab7-edb76698291a req-d658a694-b5dc-4e50-8bad-93fc061c497d service nova] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] No waiting events found dispatching network-vif-plugged-9bed3978-d90d-4b90-b798-12413ea26a48 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:46:14 user nova-compute[75216]: WARNING nova.compute.manager [req-e9b5be37-e8b5-4fcd-9ab7-edb76698291a req-d658a694-b5dc-4e50-8bad-93fc061c497d service nova] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] Received unexpected event network-vif-plugged-9bed3978-d90d-4b90-b798-12413ea26a48 for instance with vm_state building and task_state spawning.
Nov 13 18:46:14 user nova-compute[75216]: DEBUG nova.compute.manager [req-e9b5be37-e8b5-4fcd-9ab7-edb76698291a req-d658a694-b5dc-4e50-8bad-93fc061c497d service nova] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] Received event network-vif-plugged-95a425c5-f994-4504-a94b-040103b2efa7 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:46:14 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-e9b5be37-e8b5-4fcd-9ab7-edb76698291a req-d658a694-b5dc-4e50-8bad-93fc061c497d service nova] Acquiring lock "3274203b-a985-4f28-9b45-3f83509ae782-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:46:14 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-e9b5be37-e8b5-4fcd-9ab7-edb76698291a req-d658a694-b5dc-4e50-8bad-93fc061c497d service nova] Lock "3274203b-a985-4f28-9b45-3f83509ae782-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:46:14 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-e9b5be37-e8b5-4fcd-9ab7-edb76698291a req-d658a694-b5dc-4e50-8bad-93fc061c497d service nova] Lock "3274203b-a985-4f28-9b45-3f83509ae782-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:46:14 user nova-compute[75216]: DEBUG nova.compute.manager [req-e9b5be37-e8b5-4fcd-9ab7-edb76698291a req-d658a694-b5dc-4e50-8bad-93fc061c497d service nova] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] No waiting events found dispatching network-vif-plugged-95a425c5-f994-4504-a94b-040103b2efa7 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:46:14 user nova-compute[75216]: WARNING nova.compute.manager [req-e9b5be37-e8b5-4fcd-9ab7-edb76698291a req-d658a694-b5dc-4e50-8bad-93fc061c497d service nova] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] Received unexpected event network-vif-plugged-95a425c5-f994-4504-a94b-040103b2efa7 for instance with vm_state building and task_state spawning.
Nov 13 18:46:14 user nova-compute[75216]: DEBUG nova.compute.manager [req-e9b5be37-e8b5-4fcd-9ab7-edb76698291a req-d658a694-b5dc-4e50-8bad-93fc061c497d service nova] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] Received event network-vif-plugged-95a425c5-f994-4504-a94b-040103b2efa7 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:46:14 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-e9b5be37-e8b5-4fcd-9ab7-edb76698291a req-d658a694-b5dc-4e50-8bad-93fc061c497d service nova] Acquiring lock "3274203b-a985-4f28-9b45-3f83509ae782-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:46:14 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-e9b5be37-e8b5-4fcd-9ab7-edb76698291a req-d658a694-b5dc-4e50-8bad-93fc061c497d service nova] Lock "3274203b-a985-4f28-9b45-3f83509ae782-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:46:14 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-e9b5be37-e8b5-4fcd-9ab7-edb76698291a req-d658a694-b5dc-4e50-8bad-93fc061c497d service nova] Lock "3274203b-a985-4f28-9b45-3f83509ae782-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:46:14 user nova-compute[75216]: DEBUG nova.compute.manager [req-e9b5be37-e8b5-4fcd-9ab7-edb76698291a req-d658a694-b5dc-4e50-8bad-93fc061c497d service nova] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] No waiting events found dispatching network-vif-plugged-95a425c5-f994-4504-a94b-040103b2efa7 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:46:14 user nova-compute[75216]: WARNING nova.compute.manager [req-e9b5be37-e8b5-4fcd-9ab7-edb76698291a req-d658a694-b5dc-4e50-8bad-93fc061c497d service nova] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] Received unexpected event network-vif-plugged-95a425c5-f994-4504-a94b-040103b2efa7 for instance with vm_state building and task_state spawning.
Nov 13 18:46:14 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:14 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:14 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:14 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:14 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:15 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-4b01bdf3-0102-404c-9c93-081df61329bb tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 18:46:15 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-4b01bdf3-0102-404c-9c93-081df61329bb tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 18:46:15 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:15 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-4b01bdf3-0102-404c-9c93-081df61329bb tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.730s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:46:15 user nova-compute[75216]: DEBUG nova.compute.manager [None req-4b01bdf3-0102-404c-9c93-081df61329bb tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] [instance: a3bcf65e-bd5b-4350-a222-5f4522418a67] Start building networks asynchronously for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 18:46:15 user nova-compute[75216]: DEBUG nova.compute.manager [None req-4b01bdf3-0102-404c-9c93-081df61329bb tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] [instance: a3bcf65e-bd5b-4350-a222-5f4522418a67] Allocating IP information in the background. {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 18:46:15 user nova-compute[75216]: DEBUG nova.network.neutron [None req-4b01bdf3-0102-404c-9c93-081df61329bb tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] [instance: a3bcf65e-bd5b-4350-a222-5f4522418a67] allocate_for_instance() {{(pid=75216) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 18:46:15 user nova-compute[75216]: DEBUG nova.compute.manager [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Instance event wait completed in 0 seconds for  {{(pid=75216) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 18:46:15 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Guest created on hypervisor {{(pid=75216) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 18:46:15 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Instance spawned successfully.
Nov 13 18:46:15 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 18:46:15 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Found default for hw_cdrom_bus of ide {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 18:46:15 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Found default for hw_disk_bus of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 18:46:15 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Found default for hw_input_bus of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 18:46:15 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Found default for hw_pointer_model of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 18:46:15 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Found default for hw_video_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 18:46:15 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Found default for hw_vif_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 18:46:15 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-4b01bdf3-0102-404c-9c93-081df61329bb tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] [instance: a3bcf65e-bd5b-4350-a222-5f4522418a67] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 18:46:15 user nova-compute[75216]: DEBUG nova.compute.manager [None req-4b01bdf3-0102-404c-9c93-081df61329bb tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] [instance: a3bcf65e-bd5b-4350-a222-5f4522418a67] Start building block device mappings for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 18:46:15 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:15 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:15 user nova-compute[75216]: DEBUG nova.policy [None req-4b01bdf3-0102-404c-9c93-081df61329bb tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '59c263be93a143c3878bec0c4ae626af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2601440dcec64a86a539dbdddafc7a5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75216) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 18:46:15 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:15 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:15 user nova-compute[75216]: INFO nova.virt.block_device [None req-4b01bdf3-0102-404c-9c93-081df61329bb tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] [instance: a3bcf65e-bd5b-4350-a222-5f4522418a67] Booting with volume 84c721c0-dd26-494a-a193-5b302250edac at /dev/vda
Nov 13 18:46:15 user nova-compute[75216]: INFO nova.compute.manager [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Took 15.81 seconds to spawn the instance on the hypervisor.
Nov 13 18:46:15 user nova-compute[75216]: DEBUG nova.compute.manager [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Checking state {{(pid=75216) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 18:46:15 user nova-compute[75216]: DEBUG os_brick.utils [None req-4b01bdf3-0102-404c-9c93-081df61329bb tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 18:46:15 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:46:15 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:46:15 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[c44aa18d-64b7-4f7f-ab30-bdd427efd18f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aea6fcfe14b9\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:46:15 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:46:15 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:46:15 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[c63bc9f8-b7f0-4863-9263-abb27a14b3d9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:46:15 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:46:15 user nova-compute[75216]: INFO nova.compute.manager [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Took 38.40 seconds to build instance.
Nov 13 18:46:15 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:46:15 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b29ac8d-a4ff-49cf-b475-7a83f6bf715f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:46:15 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[282af7e5-9e37-4dc6-ba12-8a3ad5bb8db7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:46:15 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-4b01bdf3-0102-404c-9c93-081df61329bb tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] Running cmd (subprocess): nvme version {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:46:15 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-4b01bdf3-0102-404c-9c93-081df61329bb tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] 'nvme version' failed. Not Retrying. {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 18:46:15 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4b01bdf3-0102-404c-9c93-081df61329bb tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] nvme not present on system {{(pid=75216) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 18:46:15 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f3b927cf-b992-4724-b2e2-a4a23c1bc221 tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Lock "78605259-17bf-47da-86de-3c76ac1c5bfa" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 38.618s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:46:15 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:46:15 user nova-compute[75216]: DEBUG nova.compute.manager [req-e991819f-fd89-4857-a2f3-07c578baeb63 req-ba39047a-d069-4204-b519-41540fd25689 service nova] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] Received event network-vif-plugged-1bb4df6f-02b2-415b-9cea-fd8a7a04874c {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:46:15 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-e991819f-fd89-4857-a2f3-07c578baeb63 req-ba39047a-d069-4204-b519-41540fd25689 service nova] Acquiring lock "3274203b-a985-4f28-9b45-3f83509ae782-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:46:15 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-e991819f-fd89-4857-a2f3-07c578baeb63 req-ba39047a-d069-4204-b519-41540fd25689 service nova] Lock "3274203b-a985-4f28-9b45-3f83509ae782-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:46:15 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-e991819f-fd89-4857-a2f3-07c578baeb63 req-ba39047a-d069-4204-b519-41540fd25689 service nova] Lock "3274203b-a985-4f28-9b45-3f83509ae782-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:46:15 user nova-compute[75216]: DEBUG nova.compute.manager [req-e991819f-fd89-4857-a2f3-07c578baeb63 req-ba39047a-d069-4204-b519-41540fd25689 service nova] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] No waiting events found dispatching network-vif-plugged-1bb4df6f-02b2-415b-9cea-fd8a7a04874c {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:46:15 user nova-compute[75216]: WARNING nova.compute.manager [req-e991819f-fd89-4857-a2f3-07c578baeb63 req-ba39047a-d069-4204-b519-41540fd25689 service nova] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] Received unexpected event network-vif-plugged-1bb4df6f-02b2-415b-9cea-fd8a7a04874c for instance with vm_state building and task_state spawning.
Nov 13 18:46:15 user nova-compute[75216]: DEBUG nova.compute.manager [req-e991819f-fd89-4857-a2f3-07c578baeb63 req-ba39047a-d069-4204-b519-41540fd25689 service nova] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] Received event network-vif-plugged-1bb4df6f-02b2-415b-9cea-fd8a7a04874c {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:46:15 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-e991819f-fd89-4857-a2f3-07c578baeb63 req-ba39047a-d069-4204-b519-41540fd25689 service nova] Acquiring lock "3274203b-a985-4f28-9b45-3f83509ae782-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:46:15 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-e991819f-fd89-4857-a2f3-07c578baeb63 req-ba39047a-d069-4204-b519-41540fd25689 service nova] Lock "3274203b-a985-4f28-9b45-3f83509ae782-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:46:15 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-e991819f-fd89-4857-a2f3-07c578baeb63 req-ba39047a-d069-4204-b519-41540fd25689 service nova] Lock "3274203b-a985-4f28-9b45-3f83509ae782-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:46:15 user nova-compute[75216]: DEBUG nova.compute.manager [req-e991819f-fd89-4857-a2f3-07c578baeb63 req-ba39047a-d069-4204-b519-41540fd25689 service nova] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] No waiting events found dispatching network-vif-plugged-1bb4df6f-02b2-415b-9cea-fd8a7a04874c {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:46:15 user nova-compute[75216]: WARNING nova.compute.manager [req-e991819f-fd89-4857-a2f3-07c578baeb63 req-ba39047a-d069-4204-b519-41540fd25689 service nova] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] Received unexpected event network-vif-plugged-1bb4df6f-02b2-415b-9cea-fd8a7a04874c for instance with vm_state building and task_state spawning.
Nov 13 18:46:15 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 18:46:15 user nova-compute[75216]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 18:46:15 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[98c273a0-8bdb-435b-8a93-71a400226d63]: (4, '') {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:46:15 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-4b01bdf3-0102-404c-9c93-081df61329bb tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75216) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 18:46:15 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-4b01bdf3-0102-404c-9c93-081df61329bb tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 18:46:15 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-4b01bdf3-0102-404c-9c93-081df61329bb tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] LIGHTOS: no hostnqn found. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 18:46:15 user nova-compute[75216]: DEBUG os_brick.utils [None req-4b01bdf3-0102-404c-9c93-081df61329bb tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] <== get_connector_properties: return (176ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aea6fcfe14b9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 18:46:15 user nova-compute[75216]: DEBUG nova.virt.block_device [None req-4b01bdf3-0102-404c-9c93-081df61329bb tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] [instance: a3bcf65e-bd5b-4350-a222-5f4522418a67] Updating existing volume attachment record: 952536e8-0db8-4020-a446-93c469825693 {{(pid=75216) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 18:46:15 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:15 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:16 user nova-compute[75216]: DEBUG nova.compute.manager [req-f8aac44c-ffaa-4660-88d6-c24b5f359a8f req-72ba5f0e-3709-440d-8da7-67ba41e7f182 service nova] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Received event network-vif-plugged-6b91caf7-7b72-41be-8cf7-96e728c0eae5 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:46:16 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-f8aac44c-ffaa-4660-88d6-c24b5f359a8f req-72ba5f0e-3709-440d-8da7-67ba41e7f182 service nova] Acquiring lock "78605259-17bf-47da-86de-3c76ac1c5bfa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:46:16 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-f8aac44c-ffaa-4660-88d6-c24b5f359a8f req-72ba5f0e-3709-440d-8da7-67ba41e7f182 service nova] Lock "78605259-17bf-47da-86de-3c76ac1c5bfa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:46:16 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-f8aac44c-ffaa-4660-88d6-c24b5f359a8f req-72ba5f0e-3709-440d-8da7-67ba41e7f182 service nova] Lock "78605259-17bf-47da-86de-3c76ac1c5bfa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:46:16 user nova-compute[75216]: DEBUG nova.compute.manager [req-f8aac44c-ffaa-4660-88d6-c24b5f359a8f req-72ba5f0e-3709-440d-8da7-67ba41e7f182 service nova] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] No waiting events found dispatching network-vif-plugged-6b91caf7-7b72-41be-8cf7-96e728c0eae5 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:46:16 user nova-compute[75216]: WARNING nova.compute.manager [req-f8aac44c-ffaa-4660-88d6-c24b5f359a8f req-72ba5f0e-3709-440d-8da7-67ba41e7f182 service nova] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Received unexpected event network-vif-plugged-6b91caf7-7b72-41be-8cf7-96e728c0eae5 for instance with vm_state active and task_state None.
Nov 13 18:46:16 user nova-compute[75216]: DEBUG nova.compute.manager [req-f8aac44c-ffaa-4660-88d6-c24b5f359a8f req-72ba5f0e-3709-440d-8da7-67ba41e7f182 service nova] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Received event network-vif-plugged-5c412896-2c62-4248-a888-9b0612378259 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:46:16 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-f8aac44c-ffaa-4660-88d6-c24b5f359a8f req-72ba5f0e-3709-440d-8da7-67ba41e7f182 service nova] Acquiring lock "78605259-17bf-47da-86de-3c76ac1c5bfa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:46:16 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-f8aac44c-ffaa-4660-88d6-c24b5f359a8f req-72ba5f0e-3709-440d-8da7-67ba41e7f182 service nova] Lock "78605259-17bf-47da-86de-3c76ac1c5bfa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:46:16 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-f8aac44c-ffaa-4660-88d6-c24b5f359a8f req-72ba5f0e-3709-440d-8da7-67ba41e7f182 service nova] Lock "78605259-17bf-47da-86de-3c76ac1c5bfa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:46:16 user nova-compute[75216]: DEBUG nova.compute.manager [req-f8aac44c-ffaa-4660-88d6-c24b5f359a8f req-72ba5f0e-3709-440d-8da7-67ba41e7f182 service nova] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] No waiting events found dispatching network-vif-plugged-5c412896-2c62-4248-a888-9b0612378259 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:46:16 user nova-compute[75216]: WARNING nova.compute.manager [req-f8aac44c-ffaa-4660-88d6-c24b5f359a8f req-72ba5f0e-3709-440d-8da7-67ba41e7f182 service nova] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Received unexpected event network-vif-plugged-5c412896-2c62-4248-a888-9b0612378259 for instance with vm_state active and task_state None.
Nov 13 18:46:16 user nova-compute[75216]: DEBUG nova.compute.manager [req-f8aac44c-ffaa-4660-88d6-c24b5f359a8f req-72ba5f0e-3709-440d-8da7-67ba41e7f182 service nova] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Received event network-vif-plugged-5c412896-2c62-4248-a888-9b0612378259 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:46:16 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-f8aac44c-ffaa-4660-88d6-c24b5f359a8f req-72ba5f0e-3709-440d-8da7-67ba41e7f182 service nova] Acquiring lock "78605259-17bf-47da-86de-3c76ac1c5bfa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:46:16 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-f8aac44c-ffaa-4660-88d6-c24b5f359a8f req-72ba5f0e-3709-440d-8da7-67ba41e7f182 service nova] Lock "78605259-17bf-47da-86de-3c76ac1c5bfa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:46:16 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-f8aac44c-ffaa-4660-88d6-c24b5f359a8f req-72ba5f0e-3709-440d-8da7-67ba41e7f182 service nova] Lock "78605259-17bf-47da-86de-3c76ac1c5bfa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:46:16 user nova-compute[75216]: DEBUG nova.compute.manager [req-f8aac44c-ffaa-4660-88d6-c24b5f359a8f req-72ba5f0e-3709-440d-8da7-67ba41e7f182 service nova] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] No waiting events found dispatching network-vif-plugged-5c412896-2c62-4248-a888-9b0612378259 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:46:16 user nova-compute[75216]: WARNING nova.compute.manager [req-f8aac44c-ffaa-4660-88d6-c24b5f359a8f req-72ba5f0e-3709-440d-8da7-67ba41e7f182 service nova] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Received unexpected event network-vif-plugged-5c412896-2c62-4248-a888-9b0612378259 for instance with vm_state active and task_state None.
Nov 13 18:46:16 user nova-compute[75216]: DEBUG nova.compute.manager [req-f8aac44c-ffaa-4660-88d6-c24b5f359a8f req-72ba5f0e-3709-440d-8da7-67ba41e7f182 service nova] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Received event network-vif-plugged-815d1175-2997-4d74-8f35-7ca982cf46aa {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:46:16 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-f8aac44c-ffaa-4660-88d6-c24b5f359a8f req-72ba5f0e-3709-440d-8da7-67ba41e7f182 service nova] Acquiring lock "78605259-17bf-47da-86de-3c76ac1c5bfa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:46:16 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-f8aac44c-ffaa-4660-88d6-c24b5f359a8f req-72ba5f0e-3709-440d-8da7-67ba41e7f182 service nova] Lock "78605259-17bf-47da-86de-3c76ac1c5bfa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:46:16 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-f8aac44c-ffaa-4660-88d6-c24b5f359a8f req-72ba5f0e-3709-440d-8da7-67ba41e7f182 service nova] Lock "78605259-17bf-47da-86de-3c76ac1c5bfa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:46:16 user nova-compute[75216]: DEBUG nova.compute.manager [req-f8aac44c-ffaa-4660-88d6-c24b5f359a8f req-72ba5f0e-3709-440d-8da7-67ba41e7f182 service nova] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] No waiting events found dispatching network-vif-plugged-815d1175-2997-4d74-8f35-7ca982cf46aa {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:46:16 user nova-compute[75216]: WARNING nova.compute.manager [req-f8aac44c-ffaa-4660-88d6-c24b5f359a8f req-72ba5f0e-3709-440d-8da7-67ba41e7f182 service nova] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Received unexpected event network-vif-plugged-815d1175-2997-4d74-8f35-7ca982cf46aa for instance with vm_state active and task_state None.
Nov 13 18:46:16 user nova-compute[75216]: DEBUG nova.compute.manager [req-f8aac44c-ffaa-4660-88d6-c24b5f359a8f req-72ba5f0e-3709-440d-8da7-67ba41e7f182 service nova] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Received event network-vif-plugged-815d1175-2997-4d74-8f35-7ca982cf46aa {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:46:16 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-f8aac44c-ffaa-4660-88d6-c24b5f359a8f req-72ba5f0e-3709-440d-8da7-67ba41e7f182 service nova] Acquiring lock "78605259-17bf-47da-86de-3c76ac1c5bfa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:46:16 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-f8aac44c-ffaa-4660-88d6-c24b5f359a8f req-72ba5f0e-3709-440d-8da7-67ba41e7f182 service nova] Lock "78605259-17bf-47da-86de-3c76ac1c5bfa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:46:16 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-f8aac44c-ffaa-4660-88d6-c24b5f359a8f req-72ba5f0e-3709-440d-8da7-67ba41e7f182 service nova] Lock "78605259-17bf-47da-86de-3c76ac1c5bfa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:46:16 user nova-compute[75216]: DEBUG nova.compute.manager [req-f8aac44c-ffaa-4660-88d6-c24b5f359a8f req-72ba5f0e-3709-440d-8da7-67ba41e7f182 service nova] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] No waiting events found dispatching network-vif-plugged-815d1175-2997-4d74-8f35-7ca982cf46aa {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:46:16 user nova-compute[75216]: WARNING nova.compute.manager [req-f8aac44c-ffaa-4660-88d6-c24b5f359a8f req-72ba5f0e-3709-440d-8da7-67ba41e7f182 service nova] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Received unexpected event network-vif-plugged-815d1175-2997-4d74-8f35-7ca982cf46aa for instance with vm_state active and task_state None.
Nov 13 18:46:16 user nova-compute[75216]: DEBUG nova.compute.manager [req-f8aac44c-ffaa-4660-88d6-c24b5f359a8f req-72ba5f0e-3709-440d-8da7-67ba41e7f182 service nova] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] Received event network-vif-plugged-7aa7e71d-2c00-40fd-9d05-d108bcc807ec {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:46:16 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-f8aac44c-ffaa-4660-88d6-c24b5f359a8f req-72ba5f0e-3709-440d-8da7-67ba41e7f182 service nova] Acquiring lock "3274203b-a985-4f28-9b45-3f83509ae782-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:46:16 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-f8aac44c-ffaa-4660-88d6-c24b5f359a8f req-72ba5f0e-3709-440d-8da7-67ba41e7f182 service nova] Lock "3274203b-a985-4f28-9b45-3f83509ae782-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:46:16 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-f8aac44c-ffaa-4660-88d6-c24b5f359a8f req-72ba5f0e-3709-440d-8da7-67ba41e7f182 service nova] Lock "3274203b-a985-4f28-9b45-3f83509ae782-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:46:16 user nova-compute[75216]: DEBUG nova.compute.manager [req-f8aac44c-ffaa-4660-88d6-c24b5f359a8f req-72ba5f0e-3709-440d-8da7-67ba41e7f182 service nova] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] No waiting events found dispatching network-vif-plugged-7aa7e71d-2c00-40fd-9d05-d108bcc807ec {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:46:16 user nova-compute[75216]: WARNING nova.compute.manager [req-f8aac44c-ffaa-4660-88d6-c24b5f359a8f req-72ba5f0e-3709-440d-8da7-67ba41e7f182 service nova] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] Received unexpected event network-vif-plugged-7aa7e71d-2c00-40fd-9d05-d108bcc807ec for instance with vm_state building and task_state spawning.
Nov 13 18:46:16 user nova-compute[75216]: DEBUG nova.compute.manager [req-f8aac44c-ffaa-4660-88d6-c24b5f359a8f req-72ba5f0e-3709-440d-8da7-67ba41e7f182 service nova] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] Received event network-vif-plugged-7aa7e71d-2c00-40fd-9d05-d108bcc807ec {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:46:16 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-f8aac44c-ffaa-4660-88d6-c24b5f359a8f req-72ba5f0e-3709-440d-8da7-67ba41e7f182 service nova] Acquiring lock "3274203b-a985-4f28-9b45-3f83509ae782-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:46:16 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-f8aac44c-ffaa-4660-88d6-c24b5f359a8f req-72ba5f0e-3709-440d-8da7-67ba41e7f182 service nova] Lock "3274203b-a985-4f28-9b45-3f83509ae782-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:46:16 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-f8aac44c-ffaa-4660-88d6-c24b5f359a8f req-72ba5f0e-3709-440d-8da7-67ba41e7f182 service nova] Lock "3274203b-a985-4f28-9b45-3f83509ae782-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:46:16 user nova-compute[75216]: DEBUG nova.compute.manager [req-f8aac44c-ffaa-4660-88d6-c24b5f359a8f req-72ba5f0e-3709-440d-8da7-67ba41e7f182 service nova] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] No waiting events found dispatching network-vif-plugged-7aa7e71d-2c00-40fd-9d05-d108bcc807ec {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:46:16 user nova-compute[75216]: WARNING nova.compute.manager [req-f8aac44c-ffaa-4660-88d6-c24b5f359a8f req-72ba5f0e-3709-440d-8da7-67ba41e7f182 service nova] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] Received unexpected event network-vif-plugged-7aa7e71d-2c00-40fd-9d05-d108bcc807ec for instance with vm_state building and task_state spawning.
Nov 13 18:46:16 user nova-compute[75216]: DEBUG nova.compute.manager [req-f8aac44c-ffaa-4660-88d6-c24b5f359a8f req-72ba5f0e-3709-440d-8da7-67ba41e7f182 service nova] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] Received event network-vif-plugged-01772e53-e624-4728-beb1-929cc4165f21 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:46:16 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-f8aac44c-ffaa-4660-88d6-c24b5f359a8f req-72ba5f0e-3709-440d-8da7-67ba41e7f182 service nova] Acquiring lock "3274203b-a985-4f28-9b45-3f83509ae782-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:46:16 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-f8aac44c-ffaa-4660-88d6-c24b5f359a8f req-72ba5f0e-3709-440d-8da7-67ba41e7f182 service nova] Lock "3274203b-a985-4f28-9b45-3f83509ae782-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:46:16 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-f8aac44c-ffaa-4660-88d6-c24b5f359a8f req-72ba5f0e-3709-440d-8da7-67ba41e7f182 service nova] Lock "3274203b-a985-4f28-9b45-3f83509ae782-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:46:16 user nova-compute[75216]: DEBUG nova.compute.manager [req-f8aac44c-ffaa-4660-88d6-c24b5f359a8f req-72ba5f0e-3709-440d-8da7-67ba41e7f182 service nova] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] No waiting events found dispatching network-vif-plugged-01772e53-e624-4728-beb1-929cc4165f21 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:46:16 user nova-compute[75216]: WARNING nova.compute.manager [req-f8aac44c-ffaa-4660-88d6-c24b5f359a8f req-72ba5f0e-3709-440d-8da7-67ba41e7f182 service nova] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] Received unexpected event network-vif-plugged-01772e53-e624-4728-beb1-929cc4165f21 for instance with vm_state building and task_state spawning.
Nov 13 18:46:16 user nova-compute[75216]: DEBUG nova.compute.manager [req-f8aac44c-ffaa-4660-88d6-c24b5f359a8f req-72ba5f0e-3709-440d-8da7-67ba41e7f182 service nova] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] Received event network-vif-plugged-01772e53-e624-4728-beb1-929cc4165f21 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:46:16 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-f8aac44c-ffaa-4660-88d6-c24b5f359a8f req-72ba5f0e-3709-440d-8da7-67ba41e7f182 service nova] Acquiring lock "3274203b-a985-4f28-9b45-3f83509ae782-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:46:16 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-f8aac44c-ffaa-4660-88d6-c24b5f359a8f req-72ba5f0e-3709-440d-8da7-67ba41e7f182 service nova] Lock "3274203b-a985-4f28-9b45-3f83509ae782-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:46:16 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-f8aac44c-ffaa-4660-88d6-c24b5f359a8f req-72ba5f0e-3709-440d-8da7-67ba41e7f182 service nova] Lock "3274203b-a985-4f28-9b45-3f83509ae782-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:46:16 user nova-compute[75216]: DEBUG nova.compute.manager [req-f8aac44c-ffaa-4660-88d6-c24b5f359a8f req-72ba5f0e-3709-440d-8da7-67ba41e7f182 service nova] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] No waiting events found dispatching network-vif-plugged-01772e53-e624-4728-beb1-929cc4165f21 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:46:16 user nova-compute[75216]: WARNING nova.compute.manager [req-f8aac44c-ffaa-4660-88d6-c24b5f359a8f req-72ba5f0e-3709-440d-8da7-67ba41e7f182 service nova] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] Received unexpected event network-vif-plugged-01772e53-e624-4728-beb1-929cc4165f21 for instance with vm_state building and task_state spawning.
Nov 13 18:46:16 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:16 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:16 user nova-compute[75216]: DEBUG nova.network.neutron [None req-4b01bdf3-0102-404c-9c93-081df61329bb tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] [instance: a3bcf65e-bd5b-4350-a222-5f4522418a67] Successfully created port: c4ac5376-d559-4365-b2ce-d827fecd2d1a {{(pid=75216) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 18:46:16 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:16 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:16 user nova-compute[75216]: DEBUG nova.compute.manager [req-5759d987-ebb9-4ede-90b1-f849c72dad88 req-28fc2d80-7ebf-456a-9993-9a59984fe66c service nova] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] Received event network-vif-plugged-a07efcd3-59f4-452e-8fb7-8b8233ae235f {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:46:16 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-5759d987-ebb9-4ede-90b1-f849c72dad88 req-28fc2d80-7ebf-456a-9993-9a59984fe66c service nova] Acquiring lock "3274203b-a985-4f28-9b45-3f83509ae782-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:46:16 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-5759d987-ebb9-4ede-90b1-f849c72dad88 req-28fc2d80-7ebf-456a-9993-9a59984fe66c service nova] Lock "3274203b-a985-4f28-9b45-3f83509ae782-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:46:16 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-5759d987-ebb9-4ede-90b1-f849c72dad88 req-28fc2d80-7ebf-456a-9993-9a59984fe66c service nova] Lock "3274203b-a985-4f28-9b45-3f83509ae782-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:46:16 user nova-compute[75216]: DEBUG nova.compute.manager [req-5759d987-ebb9-4ede-90b1-f849c72dad88 req-28fc2d80-7ebf-456a-9993-9a59984fe66c service nova] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] No waiting events found dispatching network-vif-plugged-a07efcd3-59f4-452e-8fb7-8b8233ae235f {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:46:16 user nova-compute[75216]: WARNING nova.compute.manager [req-5759d987-ebb9-4ede-90b1-f849c72dad88 req-28fc2d80-7ebf-456a-9993-9a59984fe66c service nova] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] Received unexpected event network-vif-plugged-a07efcd3-59f4-452e-8fb7-8b8233ae235f for instance with vm_state building and task_state spawning.
Nov 13 18:46:16 user nova-compute[75216]: DEBUG nova.compute.manager [req-5759d987-ebb9-4ede-90b1-f849c72dad88 req-28fc2d80-7ebf-456a-9993-9a59984fe66c service nova] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] Received event network-vif-plugged-a07efcd3-59f4-452e-8fb7-8b8233ae235f {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:46:16 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-5759d987-ebb9-4ede-90b1-f849c72dad88 req-28fc2d80-7ebf-456a-9993-9a59984fe66c service nova] Acquiring lock "3274203b-a985-4f28-9b45-3f83509ae782-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:46:16 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-5759d987-ebb9-4ede-90b1-f849c72dad88 req-28fc2d80-7ebf-456a-9993-9a59984fe66c service nova] Lock "3274203b-a985-4f28-9b45-3f83509ae782-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:46:16 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-5759d987-ebb9-4ede-90b1-f849c72dad88 req-28fc2d80-7ebf-456a-9993-9a59984fe66c service nova] Lock "3274203b-a985-4f28-9b45-3f83509ae782-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:46:16 user nova-compute[75216]: DEBUG nova.compute.manager [req-5759d987-ebb9-4ede-90b1-f849c72dad88 req-28fc2d80-7ebf-456a-9993-9a59984fe66c service nova] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] No waiting events found dispatching network-vif-plugged-a07efcd3-59f4-452e-8fb7-8b8233ae235f {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:46:16 user nova-compute[75216]: WARNING nova.compute.manager [req-5759d987-ebb9-4ede-90b1-f849c72dad88 req-28fc2d80-7ebf-456a-9993-9a59984fe66c service nova] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] Received unexpected event network-vif-plugged-a07efcd3-59f4-452e-8fb7-8b8233ae235f for instance with vm_state building and task_state spawning.
Nov 13 18:46:16 user nova-compute[75216]: DEBUG nova.network.neutron [None req-4b01bdf3-0102-404c-9c93-081df61329bb tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] [instance: a3bcf65e-bd5b-4350-a222-5f4522418a67] Successfully updated port: c4ac5376-d559-4365-b2ce-d827fecd2d1a {{(pid=75216) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 18:46:17 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-4b01bdf3-0102-404c-9c93-081df61329bb tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] Acquiring lock "refresh_cache-a3bcf65e-bd5b-4350-a222-5f4522418a67" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 18:46:17 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-4b01bdf3-0102-404c-9c93-081df61329bb tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] Acquired lock "refresh_cache-a3bcf65e-bd5b-4350-a222-5f4522418a67" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 18:46:17 user nova-compute[75216]: DEBUG nova.network.neutron [None req-4b01bdf3-0102-404c-9c93-081df61329bb tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] [instance: a3bcf65e-bd5b-4350-a222-5f4522418a67] Building network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 18:46:17 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:17 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:17 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:17 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:17 user nova-compute[75216]: DEBUG nova.network.neutron [None req-4b01bdf3-0102-404c-9c93-081df61329bb tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] [instance: a3bcf65e-bd5b-4350-a222-5f4522418a67] Instance cache missing network info. {{(pid=75216) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 18:46:17 user nova-compute[75216]: DEBUG nova.compute.manager [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] Instance event wait completed in 0 seconds for  {{(pid=75216) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 18:46:17 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] Guest created on hypervisor {{(pid=75216) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 18:46:17 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] Instance spawned successfully.
Nov 13 18:46:17 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 18:46:17 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] Found default for hw_cdrom_bus of ide {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 18:46:17 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] Found default for hw_disk_bus of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 18:46:17 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] Found default for hw_input_bus of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 18:46:17 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] Found default for hw_pointer_model of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 18:46:17 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] Found default for hw_video_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 18:46:17 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] Found default for hw_vif_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 18:46:17 user nova-compute[75216]: DEBUG nova.network.neutron [None req-4b01bdf3-0102-404c-9c93-081df61329bb tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] [instance: a3bcf65e-bd5b-4350-a222-5f4522418a67] Updating instance_info_cache with network_info: [{"id": "c4ac5376-d559-4365-b2ce-d827fecd2d1a", "address": "fa:16:3e:f7:06:79", "network": {"id": "4f264ec8-b112-4549-aa16-029824a0fcb4", "bridge": "br-int", "label": "tempest-TestShelveInstance-1108623968-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2601440dcec64a86a539dbdddafc7a5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4ac5376-d5", "ovs_interfaceid": "c4ac5376-d559-4365-b2ce-d827fecd2d1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 18:46:17 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-4b01bdf3-0102-404c-9c93-081df61329bb tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] Releasing lock "refresh_cache-a3bcf65e-bd5b-4350-a222-5f4522418a67" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 18:46:17 user nova-compute[75216]: DEBUG nova.compute.manager [None req-4b01bdf3-0102-404c-9c93-081df61329bb tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] [instance: a3bcf65e-bd5b-4350-a222-5f4522418a67] Instance network_info: |[{"id": "c4ac5376-d559-4365-b2ce-d827fecd2d1a", "address": "fa:16:3e:f7:06:79", "network": {"id": "4f264ec8-b112-4549-aa16-029824a0fcb4", "bridge": "br-int", "label": "tempest-TestShelveInstance-1108623968-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2601440dcec64a86a539dbdddafc7a5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4ac5376-d5", "ovs_interfaceid": "c4ac5376-d559-4365-b2ce-d827fecd2d1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 18:46:17 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:17 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:17 user nova-compute[75216]: INFO nova.compute.manager [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] Took 17.64 seconds to spawn the instance on the hypervisor.
Nov 13 18:46:17 user nova-compute[75216]: DEBUG nova.compute.manager [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] Checking state {{(pid=75216) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 18:46:17 user nova-compute[75216]: INFO nova.compute.manager [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] Took 45.88 seconds to build instance.
Nov 13 18:46:17 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-653b09f9-cb17-4090-a2f9-4fc43aa2a7fb tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Lock "3274203b-a985-4f28-9b45-3f83509ae782" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 46.230s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:46:17 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:18 user nova-compute[75216]: DEBUG nova.compute.manager [req-f956bb50-2dc1-435d-a548-4e7bf30562b2 req-e31ac093-3243-4667-9a17-3793e3108c35 service nova] [instance: a3bcf65e-bd5b-4350-a222-5f4522418a67] Received event network-changed-c4ac5376-d559-4365-b2ce-d827fecd2d1a {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:46:18 user nova-compute[75216]: DEBUG nova.compute.manager [req-f956bb50-2dc1-435d-a548-4e7bf30562b2 req-e31ac093-3243-4667-9a17-3793e3108c35 service nova] [instance: a3bcf65e-bd5b-4350-a222-5f4522418a67] Refreshing instance network info cache due to event network-changed-c4ac5376-d559-4365-b2ce-d827fecd2d1a. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 18:46:18 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-f956bb50-2dc1-435d-a548-4e7bf30562b2 req-e31ac093-3243-4667-9a17-3793e3108c35 service nova] Acquiring lock "refresh_cache-a3bcf65e-bd5b-4350-a222-5f4522418a67" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 18:46:18 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-f956bb50-2dc1-435d-a548-4e7bf30562b2 req-e31ac093-3243-4667-9a17-3793e3108c35 service nova] Acquired lock "refresh_cache-a3bcf65e-bd5b-4350-a222-5f4522418a67" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 18:46:18 user nova-compute[75216]: DEBUG nova.network.neutron [req-f956bb50-2dc1-435d-a548-4e7bf30562b2 req-e31ac093-3243-4667-9a17-3793e3108c35 service nova] [instance: a3bcf65e-bd5b-4350-a222-5f4522418a67] Refreshing network info cache for port c4ac5376-d559-4365-b2ce-d827fecd2d1a {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 18:46:19 user nova-compute[75216]: DEBUG nova.network.neutron [req-f956bb50-2dc1-435d-a548-4e7bf30562b2 req-e31ac093-3243-4667-9a17-3793e3108c35 service nova] [instance: a3bcf65e-bd5b-4350-a222-5f4522418a67] Updated VIF entry in instance network info cache for port c4ac5376-d559-4365-b2ce-d827fecd2d1a. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 18:46:19 user nova-compute[75216]: DEBUG nova.network.neutron [req-f956bb50-2dc1-435d-a548-4e7bf30562b2 req-e31ac093-3243-4667-9a17-3793e3108c35 service nova] [instance: a3bcf65e-bd5b-4350-a222-5f4522418a67] Updating instance_info_cache with network_info: [{"id": "c4ac5376-d559-4365-b2ce-d827fecd2d1a", "address": "fa:16:3e:f7:06:79", "network": {"id": "4f264ec8-b112-4549-aa16-029824a0fcb4", "bridge": "br-int", "label": "tempest-TestShelveInstance-1108623968-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2601440dcec64a86a539dbdddafc7a5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4ac5376-d5", "ovs_interfaceid": "c4ac5376-d559-4365-b2ce-d827fecd2d1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 18:46:19 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-f956bb50-2dc1-435d-a548-4e7bf30562b2 req-e31ac093-3243-4667-9a17-3793e3108c35 service nova] Releasing lock "refresh_cache-a3bcf65e-bd5b-4350-a222-5f4522418a67" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 18:46:20 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:20 user nova-compute[75216]: DEBUG nova.compute.manager [None req-4b01bdf3-0102-404c-9c93-081df61329bb tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] [instance: a3bcf65e-bd5b-4350-a222-5f4522418a67] Start spawning the instance on the hypervisor. {{(pid=75216) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 18:46:20 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-4b01bdf3-0102-404c-9c93-081df61329bb tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] [instance: a3bcf65e-bd5b-4350-a222-5f4522418a67] Creating instance directory {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 18:46:20 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-4b01bdf3-0102-404c-9c93-081df61329bb tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] [instance: a3bcf65e-bd5b-4350-a222-5f4522418a67] Creating image(s)
Nov 13 18:46:20 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-4b01bdf3-0102-404c-9c93-081df61329bb tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] [instance: a3bcf65e-bd5b-4350-a222-5f4522418a67] Did not create local disks {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 13 18:46:20 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-4b01bdf3-0102-404c-9c93-081df61329bb tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] [instance: a3bcf65e-bd5b-4350-a222-5f4522418a67] Ensure instance console log exists: /opt/stack/data/nova/instances/a3bcf65e-bd5b-4350-a222-5f4522418a67/console.log {{(pid=75216) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 18:46:20 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-4b01bdf3-0102-404c-9c93-081df61329bb tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:46:20 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-4b01bdf3-0102-404c-9c93-081df61329bb tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:46:20 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-4b01bdf3-0102-404c-9c93-081df61329bb tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:46:20 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-4b01bdf3-0102-404c-9c93-081df61329bb tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] [instance: a3bcf65e-bd5b-4350-a222-5f4522418a67] Start _get_guest_xml network_info=[{"id": "c4ac5376-d559-4365-b2ce-d827fecd2d1a", "address": "fa:16:3e:f7:06:79", "network": {"id": "4f264ec8-b112-4549-aa16-029824a0fcb4", "bridge": "br-int", "label": "tempest-TestShelveInstance-1108623968-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2601440dcec64a86a539dbdddafc7a5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4ac5376-d5", "ovs_interfaceid": "c4ac5376-d559-4365-b2ce-d827fecd2d1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OGxHvBQW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a3bcf65e-bd5b-4350-a222-5f4522418a67', 'attached_at': '', 'detached_at': '', 'volume_id': '84c721c0-dd26-494a-a193-5b302250edac', 'serial': '84c721c0-dd26-494a-a193-5b302250edac'}, 'attachment_id': '952536e8-0db8-4020-a446-93c469825693', 'guest_format': None, 'mount_device': '/dev/vda', 'delete_on_termination': True, 'boot_index': 0, 'volume_type': None} {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 18:46:20 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-4b01bdf3-0102-404c-9c93-081df61329bb tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 18:46:20 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-4b01bdf3-0102-404c-9c93-081df61329bb tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 18:46:20 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-4b01bdf3-0102-404c-9c93-081df61329bb tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 18:46:20 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-4b01bdf3-0102-404c-9c93-081df61329bb tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] CPU controller missing on host. {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 18:46:20 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-4b01bdf3-0102-404c-9c93-081df61329bb tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 18:46:20 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-4b01bdf3-0102-404c-9c93-081df61329bb tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] CPU controller found on host. {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 18:46:20 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-4b01bdf3-0102-404c-9c93-081df61329bb tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75216) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 18:46:20 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-4b01bdf3-0102-404c-9c93-081df61329bb tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T18:40:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 18:46:20 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-4b01bdf3-0102-404c-9c93-081df61329bb tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] Flavor limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 18:46:20 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-4b01bdf3-0102-404c-9c93-081df61329bb tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] Image limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 18:46:20 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-4b01bdf3-0102-404c-9c93-081df61329bb tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] Flavor pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 18:46:20 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-4b01bdf3-0102-404c-9c93-081df61329bb tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] Image pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 18:46:20 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-4b01bdf3-0102-404c-9c93-081df61329bb tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 18:46:20 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-4b01bdf3-0102-404c-9c93-081df61329bb tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 18:46:20 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-4b01bdf3-0102-404c-9c93-081df61329bb tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 18:46:20 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-4b01bdf3-0102-404c-9c93-081df61329bb tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] Got 1 possible topologies {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 18:46:20 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-4b01bdf3-0102-404c-9c93-081df61329bb tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 18:46:20 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-4b01bdf3-0102-404c-9c93-081df61329bb tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 18:46:20 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b01bdf3-0102-404c-9c93-081df61329bb tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] [instance: a3bcf65e-bd5b-4350-a222-5f4522418a67] Calling os-brick to attach iSCSI Volume {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 18:46:20 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b01bdf3-0102-404c-9c93-081df61329bb tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3a8669e40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OGxHvBQW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 18:46:20 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-4b01bdf3-0102-404c-9c93-081df61329bb tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 18:46:20 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-4b01bdf3-0102-404c-9c93-081df61329bb tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 18:46:20 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-4b01bdf3-0102-404c-9c93-081df61329bb tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 18:46:20 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-4b01bdf3-0102-404c-9c93-081df61329bb tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 18:46:20 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-4b01bdf3-0102-404c-9c93-081df61329bb tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 18:46:20 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-4b01bdf3-0102-404c-9c93-081df61329bb tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 18:46:20 user nova-compute[75216]: INFO os_brick.initiator.connectors.iscsi [None req-4b01bdf3-0102-404c-9c93-081df61329bb tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 18:46:20 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac -p 172.16.0.220:3260 {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:46:20 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:46:20 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0c9897d-0947-42df-9fb2-5d784bc787a9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:46:20 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b01bdf3-0102-404c-9c93-081df61329bb tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 18:46:20 user nova-compute[75216]:  {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:46:20 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac -p 172.16.0.220:3260 --interface default --op new {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:46:20 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:46:20 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d965c98-7e1f-4b43-9cac-a11c14db5abf]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac] added\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:46:20 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b01bdf3-0102-404c-9c93-081df61329bb tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac] added
Nov 13 18:46:20 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:46:20 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:46:20 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:46:20 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f54e70f-4c13-45cb-8719-66a9e1b2cba7]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:46:20 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b01bdf3-0102-404c-9c93-081df61329bb tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:46:20 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:46:20 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:46:20 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[99c79dc0-45c6-4f3c-a721-4925000c7a81]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:46:20 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b01bdf3-0102-404c-9c93-081df61329bb tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:46:20 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OGxHvBQW {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:46:20 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OGxHvBQW" returned: 0 in 0.019s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:46:20 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf5c12c5-d268-4c99-a7fb-29fef33d6e15]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:46:20 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b01bdf3-0102-404c-9c93-081df61329bb tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OGxHvBQW'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:46:20 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:46:20 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:46:20 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8ba209f-919a-4fd1-8487-e5290f70797b]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:46:20 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b01bdf3-0102-404c-9c93-081df61329bb tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:46:20 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:46:20 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:46:20 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[30be5ec3-da72-417c-a0eb-ed6146480bc5]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba1efeb5-724e-4415-a5ed-12ce8c9489bc (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3d195d-b8b4-4c79-a150-813952c640e8 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fc393f0-1356-404f-a87b-bed1fb91b924 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a1a5e82-4f70-4668-94bd-4a842d826214 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e823c6a1-f7e2-495f-a5dc-6fdfd2b19cf0 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52f4339a-6a47-4877-b041-9c27d7be2e94 (non-flash)\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:46:20 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b01bdf3-0102-404c-9c93-081df61329bb tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba1efeb5-724e-4415-a5ed-12ce8c9489bc (non-flash)
Nov 13 18:46:20 user nova-compute[75216]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3d195d-b8b4-4c79-a150-813952c640e8 (non-flash)
Nov 13 18:46:20 user nova-compute[75216]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fc393f0-1356-404f-a87b-bed1fb91b924 (non-flash)
Nov 13 18:46:20 user nova-compute[75216]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a1a5e82-4f70-4668-94bd-4a842d826214 (non-flash)
Nov 13 18:46:20 user nova-compute[75216]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e823c6a1-f7e2-495f-a5dc-6fdfd2b19cf0 (non-flash)
Nov 13 18:46:20 user nova-compute[75216]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52f4339a-6a47-4877-b041-9c27d7be2e94 (non-flash)
Nov 13 18:46:20 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 18:46:20 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b01bdf3-0102-404c-9c93-081df61329bb tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba1efeb5-724e-4415-a5ed-12ce8c9489bc (non-flash)
Nov 13 18:46:20 user nova-compute[75216]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3d195d-b8b4-4c79-a150-813952c640e8 (non-flash)
Nov 13 18:46:20 user nova-compute[75216]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fc393f0-1356-404f-a87b-bed1fb91b924 (non-flash)
Nov 13 18:46:20 user nova-compute[75216]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a1a5e82-4f70-4668-94bd-4a842d826214 (non-flash)
Nov 13 18:46:20 user nova-compute[75216]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e823c6a1-f7e2-495f-a5dc-6fdfd2b19cf0 (non-flash)
Nov 13 18:46:20 user nova-compute[75216]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52f4339a-6a47-4877-b041-9c27d7be2e94 (non-flash)
Nov 13 18:46:20 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 18:46:20 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac -p 172.16.0.220:3260 --login {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:46:21 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac -p 172.16.0.220:3260 --login" returned: 0 in 0.090s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:46:21 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[89c0111a-4353-4484-ab44-2304dbd75149]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:46:21 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b01bdf3-0102-404c-9c93-081df61329bb tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac, portal: 172.16.0.220,3260]
Nov 13 18:46:21 user nova-compute[75216]: Login to [iface: default, target: iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac, portal: 172.16.0.220,3260] successful.
Nov 13 18:46:21 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:46:21 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:46:21 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:46:21 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc2f95b5-bce8-4947-98c1-b6ee33d46d3f]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:46:21 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b01bdf3-0102-404c-9c93-081df61329bb tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:46:21 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:46:21 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:46:21 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[886904d3-5bb8-473a-b984-c14b94447240]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba1efeb5-724e-4415-a5ed-12ce8c9489bc (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3d195d-b8b4-4c79-a150-813952c640e8 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fc393f0-1356-404f-a87b-bed1fb91b924 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a1a5e82-4f70-4668-94bd-4a842d826214 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e823c6a1-f7e2-495f-a5dc-6fdfd2b19cf0 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52f4339a-6a47-4877-b041-9c27d7be2e94 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac (non-flash)\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:46:21 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b01bdf3-0102-404c-9c93-081df61329bb tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba1efeb5-724e-4415-a5ed-12ce8c9489bc (non-flash)
Nov 13 18:46:21 user nova-compute[75216]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3d195d-b8b4-4c79-a150-813952c640e8 (non-flash)
Nov 13 18:46:21 user nova-compute[75216]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fc393f0-1356-404f-a87b-bed1fb91b924 (non-flash)
Nov 13 18:46:21 user nova-compute[75216]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a1a5e82-4f70-4668-94bd-4a842d826214 (non-flash)
Nov 13 18:46:21 user nova-compute[75216]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e823c6a1-f7e2-495f-a5dc-6fdfd2b19cf0 (non-flash)
Nov 13 18:46:21 user nova-compute[75216]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52f4339a-6a47-4877-b041-9c27d7be2e94 (non-flash)
Nov 13 18:46:21 user nova-compute[75216]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac (non-flash)
Nov 13 18:46:21 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 18:46:21 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b01bdf3-0102-404c-9c93-081df61329bb tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba1efeb5-724e-4415-a5ed-12ce8c9489bc (non-flash)
Nov 13 18:46:21 user nova-compute[75216]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3d195d-b8b4-4c79-a150-813952c640e8 (non-flash)
Nov 13 18:46:21 user nova-compute[75216]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fc393f0-1356-404f-a87b-bed1fb91b924 (non-flash)
Nov 13 18:46:21 user nova-compute[75216]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a1a5e82-4f70-4668-94bd-4a842d826214 (non-flash)
Nov 13 18:46:21 user nova-compute[75216]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e823c6a1-f7e2-495f-a5dc-6fdfd2b19cf0 (non-flash)
Nov 13 18:46:21 user nova-compute[75216]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52f4339a-6a47-4877-b041-9c27d7be2e94 (non-flash)
Nov 13 18:46:21 user nova-compute[75216]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac (non-flash)
Nov 13 18:46:21 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 18:46:21 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-4b01bdf3-0102-404c-9c93-081df61329bb tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.339s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 18:46:21 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b01bdf3-0102-404c-9c93-081df61329bb tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] Connected to 172.16.0.220:3260 {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 18:46:21 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-4b01bdf3-0102-404c-9c93-081df61329bb tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] HCTL ('39', '-', '-', 0) found on session 9 with lun 0 {{(pid=75216) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 18:46:21 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-4b01bdf3-0102-404c-9c93-081df61329bb tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=75216) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 18:46:21 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:46:21 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.022s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:46:21 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3ba842f-2763-4600-aa77-f57a02253466]: (4, ('- - 0', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:46:21 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-4b01bdf3-0102-404c-9c93-081df61329bb tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] Searching for a device in session 9 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=75216) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 18:46:21 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b01bdf3-0102-404c-9c93-081df61329bb tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OGxHvBQW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 18:46:22 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-4b01bdf3-0102-404c-9c93-081df61329bb tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.384s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 18:46:22 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b01bdf3-0102-404c-9c93-081df61329bb tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] <== connect_volume: return (1387ms) {'type': 'block', 'scsi_wwn': '23632343936363665', 'path': '/dev/sdh'} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 18:46:22 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b01bdf3-0102-404c-9c93-081df61329bb tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] [instance: a3bcf65e-bd5b-4350-a222-5f4522418a67] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23632343936363665', 'path': '/dev/sdh'} {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 18:46:22 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-4b01bdf3-0102-404c-9c93-081df61329bb tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T18:46:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-87869039',display_name='tempest-TestShelveInstance-server-87869039',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-87869039',id=12,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPf0Z5pKlRRYrkYQFZZ0LACxhlQS1FSX42rZOPJMyvxKGvcaboPCfNe3ktO1Wd/Ubb0iNMpYVdQ715G8FRIzu5wlnhJ6jeanXKJe8TuPRmnvCmt4lh2Ehwnc7Gc7HtYc2Q==',key_name='tempest-TestShelveInstance-2022745159',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2601440dcec64a86a539dbdddafc7a5d',ramdisk_id='',reservation_id='r-x2eeit0j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-55051446',owner_user_name='tempest-TestShelveInstance-55051446-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T18:46:15Z,user_data=None,user_id='59c263be93a143c3878bec0c4ae626af',uuid=a3bcf65e-bd5b-4350-a222-5f4522418a67,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c4ac5376-d559-4365-b2ce-d827fecd2d1a", "address": "fa:16:3e:f7:06:79", "network": {"id": "4f264ec8-b112-4549-aa16-029824a0fcb4", "bridge": "br-int", "label": "tempest-TestShelveInstance-1108623968-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2601440dcec64a86a539dbdddafc7a5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4ac5376-d5", "ovs_interfaceid": "c4ac5376-d559-4365-b2ce-d827fecd2d1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75216) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 18:46:22 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-4b01bdf3-0102-404c-9c93-081df61329bb tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] Converting VIF {"id": "c4ac5376-d559-4365-b2ce-d827fecd2d1a", "address": "fa:16:3e:f7:06:79", "network": {"id": "4f264ec8-b112-4549-aa16-029824a0fcb4", "bridge": "br-int", "label": "tempest-TestShelveInstance-1108623968-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2601440dcec64a86a539dbdddafc7a5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4ac5376-d5", "ovs_interfaceid": "c4ac5376-d559-4365-b2ce-d827fecd2d1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 18:46:22 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-4b01bdf3-0102-404c-9c93-081df61329bb tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:06:79,bridge_name='br-int',has_traffic_filtering=True,id=c4ac5376-d559-4365-b2ce-d827fecd2d1a,network=Network(4f264ec8-b112-4549-aa16-029824a0fcb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4ac5376-d5') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 18:46:22 user nova-compute[75216]: DEBUG nova.objects.instance [None req-4b01bdf3-0102-404c-9c93-081df61329bb tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] Lazy-loading 'pci_devices' on Instance uuid a3bcf65e-bd5b-4350-a222-5f4522418a67 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 18:46:22 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-4b01bdf3-0102-404c-9c93-081df61329bb tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] [instance: a3bcf65e-bd5b-4350-a222-5f4522418a67] End _get_guest_xml xml=<domain type="kvm">
Nov 13 18:46:22 user nova-compute[75216]:   <uuid>a3bcf65e-bd5b-4350-a222-5f4522418a67</uuid>
Nov 13 18:46:22 user nova-compute[75216]:   <name>instance-0000000c</name>
Nov 13 18:46:22 user nova-compute[75216]:   <memory>524288</memory>
Nov 13 18:46:22 user nova-compute[75216]:   <vcpu>1</vcpu>
Nov 13 18:46:22 user nova-compute[75216]:   <metadata>
Nov 13 18:46:22 user nova-compute[75216]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 18:46:22 user nova-compute[75216]:       <nova:package version="0.0.0"/>
Nov 13 18:46:22 user nova-compute[75216]:       <nova:name>tempest-TestShelveInstance-server-87869039</nova:name>
Nov 13 18:46:22 user nova-compute[75216]:       <nova:creationTime>2023-11-13 18:46:20</nova:creationTime>
Nov 13 18:46:22 user nova-compute[75216]:       <nova:flavor name="m1.tiny">
Nov 13 18:46:22 user nova-compute[75216]:         <nova:memory>512</nova:memory>
Nov 13 18:46:22 user nova-compute[75216]:         <nova:disk>1</nova:disk>
Nov 13 18:46:22 user nova-compute[75216]:         <nova:swap>0</nova:swap>
Nov 13 18:46:22 user nova-compute[75216]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 18:46:22 user nova-compute[75216]:         <nova:vcpus>1</nova:vcpus>
Nov 13 18:46:22 user nova-compute[75216]:       </nova:flavor>
Nov 13 18:46:22 user nova-compute[75216]:       <nova:owner>
Nov 13 18:46:22 user nova-compute[75216]:         <nova:user uuid="59c263be93a143c3878bec0c4ae626af">tempest-TestShelveInstance-55051446-project-member</nova:user>
Nov 13 18:46:22 user nova-compute[75216]:         <nova:project uuid="2601440dcec64a86a539dbdddafc7a5d">tempest-TestShelveInstance-55051446</nova:project>
Nov 13 18:46:22 user nova-compute[75216]:       </nova:owner>
Nov 13 18:46:22 user nova-compute[75216]:       <nova:ports>
Nov 13 18:46:22 user nova-compute[75216]:         <nova:port uuid="c4ac5376-d559-4365-b2ce-d827fecd2d1a">
Nov 13 18:46:22 user nova-compute[75216]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 13 18:46:22 user nova-compute[75216]:         </nova:port>
Nov 13 18:46:22 user nova-compute[75216]:       </nova:ports>
Nov 13 18:46:22 user nova-compute[75216]:     </nova:instance>
Nov 13 18:46:22 user nova-compute[75216]:   </metadata>
Nov 13 18:46:22 user nova-compute[75216]:   <sysinfo type="smbios">
Nov 13 18:46:22 user nova-compute[75216]:     <system>
Nov 13 18:46:22 user nova-compute[75216]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 18:46:22 user nova-compute[75216]:       <entry name="product">OpenStack Nova</entry>
Nov 13 18:46:22 user nova-compute[75216]:       <entry name="version">0.0.0</entry>
Nov 13 18:46:22 user nova-compute[75216]:       <entry name="serial">a3bcf65e-bd5b-4350-a222-5f4522418a67</entry>
Nov 13 18:46:22 user nova-compute[75216]:       <entry name="uuid">a3bcf65e-bd5b-4350-a222-5f4522418a67</entry>
Nov 13 18:46:22 user nova-compute[75216]:       <entry name="family">Virtual Machine</entry>
Nov 13 18:46:22 user nova-compute[75216]:     </system>
Nov 13 18:46:22 user nova-compute[75216]:   </sysinfo>
Nov 13 18:46:22 user nova-compute[75216]:   <os>
Nov 13 18:46:22 user nova-compute[75216]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 18:46:22 user nova-compute[75216]:     <boot dev="hd"/>
Nov 13 18:46:22 user nova-compute[75216]:     <smbios mode="sysinfo"/>
Nov 13 18:46:22 user nova-compute[75216]:   </os>
Nov 13 18:46:22 user nova-compute[75216]:   <features>
Nov 13 18:46:22 user nova-compute[75216]:     <acpi/>
Nov 13 18:46:22 user nova-compute[75216]:     <apic/>
Nov 13 18:46:22 user nova-compute[75216]:     <vmcoreinfo/>
Nov 13 18:46:22 user nova-compute[75216]:   </features>
Nov 13 18:46:22 user nova-compute[75216]:   <clock offset="utc">
Nov 13 18:46:22 user nova-compute[75216]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 18:46:22 user nova-compute[75216]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 18:46:22 user nova-compute[75216]:     <timer name="hpet" present="no"/>
Nov 13 18:46:22 user nova-compute[75216]:   </clock>
Nov 13 18:46:22 user nova-compute[75216]:   <cpu mode="custom" match="exact">
Nov 13 18:46:22 user nova-compute[75216]:     <model>Nehalem</model>
Nov 13 18:46:22 user nova-compute[75216]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 18:46:22 user nova-compute[75216]:   </cpu>
Nov 13 18:46:22 user nova-compute[75216]:   <devices>
Nov 13 18:46:22 user nova-compute[75216]:     <disk type="block" device="disk">
Nov 13 18:46:22 user nova-compute[75216]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 18:46:22 user nova-compute[75216]:       <source dev="/dev/sdh"/>
Nov 13 18:46:22 user nova-compute[75216]:       <target dev="vda" bus="virtio"/>
Nov 13 18:46:22 user nova-compute[75216]:       <serial>84c721c0-dd26-494a-a193-5b302250edac</serial>
Nov 13 18:46:22 user nova-compute[75216]:     </disk>
Nov 13 18:46:22 user nova-compute[75216]:     <interface type="ethernet">
Nov 13 18:46:22 user nova-compute[75216]:       <mac address="fa:16:3e:f7:06:79"/>
Nov 13 18:46:22 user nova-compute[75216]:       <model type="virtio"/>
Nov 13 18:46:22 user nova-compute[75216]:       <mtu size="1442"/>
Nov 13 18:46:22 user nova-compute[75216]:       <target dev="tapc4ac5376-d5"/>
Nov 13 18:46:22 user nova-compute[75216]:     </interface>
Nov 13 18:46:22 user nova-compute[75216]:     <serial type="pty">
Nov 13 18:46:22 user nova-compute[75216]:       <log file="/opt/stack/data/nova/instances/a3bcf65e-bd5b-4350-a222-5f4522418a67/console.log" append="off"/>
Nov 13 18:46:22 user nova-compute[75216]:     </serial>
Nov 13 18:46:22 user nova-compute[75216]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 18:46:22 user nova-compute[75216]:     <video>
Nov 13 18:46:22 user nova-compute[75216]:       <model type="virtio"/>
Nov 13 18:46:22 user nova-compute[75216]:     </video>
Nov 13 18:46:22 user nova-compute[75216]:     <rng model="virtio">
Nov 13 18:46:22 user nova-compute[75216]:       <backend model="random">/dev/urandom</backend>
Nov 13 18:46:22 user nova-compute[75216]:     </rng>
Nov 13 18:46:22 user nova-compute[75216]:     <controller type="usb" index="0" model="none"/>
Nov 13 18:46:22 user nova-compute[75216]:     <memballoon model="virtio">
Nov 13 18:46:22 user nova-compute[75216]:       <stats period="10"/>
Nov 13 18:46:22 user nova-compute[75216]:     </memballoon>
Nov 13 18:46:22 user nova-compute[75216]:   </devices>
Nov 13 18:46:22 user nova-compute[75216]: </domain>
Nov 13 18:46:22 user nova-compute[75216]:  {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 18:46:22 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-4b01bdf3-0102-404c-9c93-081df61329bb tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T18:46:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-87869039',display_name='tempest-TestShelveInstance-server-87869039',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-87869039',id=12,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPf0Z5pKlRRYrkYQFZZ0LACxhlQS1FSX42rZOPJMyvxKGvcaboPCfNe3ktO1Wd/Ubb0iNMpYVdQ715G8FRIzu5wlnhJ6jeanXKJe8TuPRmnvCmt4lh2Ehwnc7Gc7HtYc2Q==',key_name='tempest-TestShelveInstance-2022745159',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2601440dcec64a86a539dbdddafc7a5d',ramdisk_id='',reservation_id='r-x2eeit0j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-55051446',owner_user_name='tempest-TestShelveInstance-55051446-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T18:46:15Z,user_data=None,user_id='59c263be93a143c3878bec0c4ae626af',uuid=a3bcf65e-bd5b-4350-a222-5f4522418a67,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c4ac5376-d559-4365-b2ce-d827fecd2d1a", "address": "fa:16:3e:f7:06:79", "network": {"id": "4f264ec8-b112-4549-aa16-029824a0fcb4", "bridge": "br-int", "label": "tempest-TestShelveInstance-1108623968-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2601440dcec64a86a539dbdddafc7a5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4ac5376-d5", "ovs_interfaceid": "c4ac5376-d559-4365-b2ce-d827fecd2d1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 18:46:22 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-4b01bdf3-0102-404c-9c93-081df61329bb tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] Converting VIF {"id": "c4ac5376-d559-4365-b2ce-d827fecd2d1a", "address": "fa:16:3e:f7:06:79", "network": {"id": "4f264ec8-b112-4549-aa16-029824a0fcb4", "bridge": "br-int", "label": "tempest-TestShelveInstance-1108623968-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2601440dcec64a86a539dbdddafc7a5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4ac5376-d5", "ovs_interfaceid": "c4ac5376-d559-4365-b2ce-d827fecd2d1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 18:46:22 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-4b01bdf3-0102-404c-9c93-081df61329bb tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:06:79,bridge_name='br-int',has_traffic_filtering=True,id=c4ac5376-d559-4365-b2ce-d827fecd2d1a,network=Network(4f264ec8-b112-4549-aa16-029824a0fcb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4ac5376-d5') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 18:46:22 user nova-compute[75216]: DEBUG os_vif [None req-4b01bdf3-0102-404c-9c93-081df61329bb tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:06:79,bridge_name='br-int',has_traffic_filtering=True,id=c4ac5376-d559-4365-b2ce-d827fecd2d1a,network=Network(4f264ec8-b112-4549-aa16-029824a0fcb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4ac5376-d5') {{(pid=75216) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 18:46:22 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:22 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:46:22 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 18:46:22 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:22 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b686b00d-0d44-5961-b5c7-a3ff7421f5c3', '_type': 'linux-noop'}}, row=False) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:46:22 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:22 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:22 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:22 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc4ac5376-d5, may_exist=True, interface_attrs={}) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:46:22 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc4ac5376-d5, col_values=(('qos', UUID('3b39900c-08f6-4c14-a4dd-f00129556ffb')),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:46:22 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc4ac5376-d5, col_values=(('external_ids', {'iface-id': 'c4ac5376-d559-4365-b2ce-d827fecd2d1a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f7:06:79', 'vm-uuid': 'a3bcf65e-bd5b-4350-a222-5f4522418a67'}),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:46:22 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:22 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:46:22 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:22 user nova-compute[75216]: INFO os_vif [None req-4b01bdf3-0102-404c-9c93-081df61329bb tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:06:79,bridge_name='br-int',has_traffic_filtering=True,id=c4ac5376-d559-4365-b2ce-d827fecd2d1a,network=Network(4f264ec8-b112-4549-aa16-029824a0fcb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4ac5376-d5')
Nov 13 18:46:22 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-4b01bdf3-0102-404c-9c93-081df61329bb tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 18:46:22 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-4b01bdf3-0102-404c-9c93-081df61329bb tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] No VIF found with MAC fa:16:3e:f7:06:79, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 18:46:22 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:24 user nova-compute[75216]: DEBUG nova.compute.manager [req-366347d7-351e-4a23-b183-a7bdc5acc993 req-fc12e6da-738a-4dcd-9925-9d6c774657e9 service nova] [instance: a3bcf65e-bd5b-4350-a222-5f4522418a67] Received event network-vif-plugged-c4ac5376-d559-4365-b2ce-d827fecd2d1a {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:46:24 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-366347d7-351e-4a23-b183-a7bdc5acc993 req-fc12e6da-738a-4dcd-9925-9d6c774657e9 service nova] Acquiring lock "a3bcf65e-bd5b-4350-a222-5f4522418a67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:46:24 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-366347d7-351e-4a23-b183-a7bdc5acc993 req-fc12e6da-738a-4dcd-9925-9d6c774657e9 service nova] Lock "a3bcf65e-bd5b-4350-a222-5f4522418a67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:46:24 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-366347d7-351e-4a23-b183-a7bdc5acc993 req-fc12e6da-738a-4dcd-9925-9d6c774657e9 service nova] Lock "a3bcf65e-bd5b-4350-a222-5f4522418a67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:46:24 user nova-compute[75216]: DEBUG nova.compute.manager [req-366347d7-351e-4a23-b183-a7bdc5acc993 req-fc12e6da-738a-4dcd-9925-9d6c774657e9 service nova] [instance: a3bcf65e-bd5b-4350-a222-5f4522418a67] No waiting events found dispatching network-vif-plugged-c4ac5376-d559-4365-b2ce-d827fecd2d1a {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:46:24 user nova-compute[75216]: WARNING nova.compute.manager [req-366347d7-351e-4a23-b183-a7bdc5acc993 req-fc12e6da-738a-4dcd-9925-9d6c774657e9 service nova] [instance: a3bcf65e-bd5b-4350-a222-5f4522418a67] Received unexpected event network-vif-plugged-c4ac5376-d559-4365-b2ce-d827fecd2d1a for instance with vm_state building and task_state spawning.
Nov 13 18:46:24 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:24 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:24 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:26 user nova-compute[75216]: DEBUG nova.compute.manager [None req-4b01bdf3-0102-404c-9c93-081df61329bb tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] [instance: a3bcf65e-bd5b-4350-a222-5f4522418a67] Instance event wait completed in 0 seconds for  {{(pid=75216) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 18:46:26 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-4b01bdf3-0102-404c-9c93-081df61329bb tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] [instance: a3bcf65e-bd5b-4350-a222-5f4522418a67] Guest created on hypervisor {{(pid=75216) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 18:46:26 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: a3bcf65e-bd5b-4350-a222-5f4522418a67] Instance spawned successfully.
Nov 13 18:46:26 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-4b01bdf3-0102-404c-9c93-081df61329bb tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] [instance: a3bcf65e-bd5b-4350-a222-5f4522418a67] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 18:46:26 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-4b01bdf3-0102-404c-9c93-081df61329bb tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] [instance: a3bcf65e-bd5b-4350-a222-5f4522418a67] Found default for hw_cdrom_bus of ide {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 18:46:26 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-4b01bdf3-0102-404c-9c93-081df61329bb tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] [instance: a3bcf65e-bd5b-4350-a222-5f4522418a67] Found default for hw_disk_bus of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 18:46:26 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-4b01bdf3-0102-404c-9c93-081df61329bb tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] [instance: a3bcf65e-bd5b-4350-a222-5f4522418a67] Found default for hw_input_bus of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 18:46:26 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-4b01bdf3-0102-404c-9c93-081df61329bb tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] [instance: a3bcf65e-bd5b-4350-a222-5f4522418a67] Found default for hw_pointer_model of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 18:46:26 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-4b01bdf3-0102-404c-9c93-081df61329bb tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] [instance: a3bcf65e-bd5b-4350-a222-5f4522418a67] Found default for hw_video_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 18:46:26 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-4b01bdf3-0102-404c-9c93-081df61329bb tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] [instance: a3bcf65e-bd5b-4350-a222-5f4522418a67] Found default for hw_vif_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 18:46:26 user nova-compute[75216]: DEBUG nova.compute.manager [req-84f67d7e-b7eb-45dc-a627-46c81cf356ea req-348d4c75-9e84-4caa-8d75-259e4cb427c7 service nova] [instance: a3bcf65e-bd5b-4350-a222-5f4522418a67] Received event network-vif-plugged-c4ac5376-d559-4365-b2ce-d827fecd2d1a {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:46:26 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-84f67d7e-b7eb-45dc-a627-46c81cf356ea req-348d4c75-9e84-4caa-8d75-259e4cb427c7 service nova] Acquiring lock "a3bcf65e-bd5b-4350-a222-5f4522418a67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:46:26 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-84f67d7e-b7eb-45dc-a627-46c81cf356ea req-348d4c75-9e84-4caa-8d75-259e4cb427c7 service nova] Lock "a3bcf65e-bd5b-4350-a222-5f4522418a67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:46:26 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-84f67d7e-b7eb-45dc-a627-46c81cf356ea req-348d4c75-9e84-4caa-8d75-259e4cb427c7 service nova] Lock "a3bcf65e-bd5b-4350-a222-5f4522418a67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:46:26 user nova-compute[75216]: DEBUG nova.compute.manager [req-84f67d7e-b7eb-45dc-a627-46c81cf356ea req-348d4c75-9e84-4caa-8d75-259e4cb427c7 service nova] [instance: a3bcf65e-bd5b-4350-a222-5f4522418a67] No waiting events found dispatching network-vif-plugged-c4ac5376-d559-4365-b2ce-d827fecd2d1a {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:46:26 user nova-compute[75216]: WARNING nova.compute.manager [req-84f67d7e-b7eb-45dc-a627-46c81cf356ea req-348d4c75-9e84-4caa-8d75-259e4cb427c7 service nova] [instance: a3bcf65e-bd5b-4350-a222-5f4522418a67] Received unexpected event network-vif-plugged-c4ac5376-d559-4365-b2ce-d827fecd2d1a for instance with vm_state building and task_state spawning.
Nov 13 18:46:26 user nova-compute[75216]: INFO nova.compute.manager [None req-4b01bdf3-0102-404c-9c93-081df61329bb tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] [instance: a3bcf65e-bd5b-4350-a222-5f4522418a67] Took 5.59 seconds to spawn the instance on the hypervisor.
Nov 13 18:46:26 user nova-compute[75216]: DEBUG nova.compute.manager [None req-4b01bdf3-0102-404c-9c93-081df61329bb tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] [instance: a3bcf65e-bd5b-4350-a222-5f4522418a67] Checking state {{(pid=75216) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 18:46:26 user nova-compute[75216]: INFO nova.compute.manager [None req-4b01bdf3-0102-404c-9c93-081df61329bb tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] [instance: a3bcf65e-bd5b-4350-a222-5f4522418a67] Took 11.98 seconds to build instance.
Nov 13 18:46:26 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-4b01bdf3-0102-404c-9c93-081df61329bb tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] Lock "a3bcf65e-bd5b-4350-a222-5f4522418a67" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.174s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:46:27 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:27 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:33 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:35 user nova-compute[75216]: DEBUG nova.compute.manager [req-6d78a642-472b-4272-b171-45a1a7ef16e4 req-120d783f-f921-4a13-858a-13eff43c300c service nova] [instance: a1a3e849-6570-4820-97c8-75468b5bea4f] Received event network-changed-3544d3e3-8dfa-4043-b225-77f690cd3760 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:46:35 user nova-compute[75216]: DEBUG nova.compute.manager [req-6d78a642-472b-4272-b171-45a1a7ef16e4 req-120d783f-f921-4a13-858a-13eff43c300c service nova] [instance: a1a3e849-6570-4820-97c8-75468b5bea4f] Refreshing instance network info cache due to event network-changed-3544d3e3-8dfa-4043-b225-77f690cd3760. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 18:46:35 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-6d78a642-472b-4272-b171-45a1a7ef16e4 req-120d783f-f921-4a13-858a-13eff43c300c service nova] Acquiring lock "refresh_cache-a1a3e849-6570-4820-97c8-75468b5bea4f" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 18:46:35 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-6d78a642-472b-4272-b171-45a1a7ef16e4 req-120d783f-f921-4a13-858a-13eff43c300c service nova] Acquired lock "refresh_cache-a1a3e849-6570-4820-97c8-75468b5bea4f" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 18:46:35 user nova-compute[75216]: DEBUG nova.network.neutron [req-6d78a642-472b-4272-b171-45a1a7ef16e4 req-120d783f-f921-4a13-858a-13eff43c300c service nova] [instance: a1a3e849-6570-4820-97c8-75468b5bea4f] Refreshing network info cache for port 3544d3e3-8dfa-4043-b225-77f690cd3760 {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 18:46:36 user nova-compute[75216]: DEBUG nova.network.neutron [req-6d78a642-472b-4272-b171-45a1a7ef16e4 req-120d783f-f921-4a13-858a-13eff43c300c service nova] [instance: a1a3e849-6570-4820-97c8-75468b5bea4f] Updated VIF entry in instance network info cache for port 3544d3e3-8dfa-4043-b225-77f690cd3760. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 18:46:36 user nova-compute[75216]: DEBUG nova.network.neutron [req-6d78a642-472b-4272-b171-45a1a7ef16e4 req-120d783f-f921-4a13-858a-13eff43c300c service nova] [instance: a1a3e849-6570-4820-97c8-75468b5bea4f] Updating instance_info_cache with network_info: [{"id": "3544d3e3-8dfa-4043-b225-77f690cd3760", "address": "fa:16:3e:9e:b9:f7", "network": {"id": "d7a691f0-4495-40ad-a349-91b5dc9c635a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-961583097-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9b7e11038e54e368acd22d06e54a351", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3544d3e3-8d", "ovs_interfaceid": "3544d3e3-8dfa-4043-b225-77f690cd3760", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 18:46:36 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-6d78a642-472b-4272-b171-45a1a7ef16e4 req-120d783f-f921-4a13-858a-13eff43c300c service nova] Releasing lock "refresh_cache-a1a3e849-6570-4820-97c8-75468b5bea4f" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 18:46:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:38 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-26025c09-bff6-4b63-a9a2-60d4c8389a3d tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] Acquiring lock "347acafc-985e-4fa2-b286-07ea3b2e4033" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:46:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-26025c09-bff6-4b63-a9a2-60d4c8389a3d tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] Lock "347acafc-985e-4fa2-b286-07ea3b2e4033" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:46:39 user nova-compute[75216]: DEBUG nova.objects.instance [None req-26025c09-bff6-4b63-a9a2-60d4c8389a3d tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] Lazy-loading 'flavor' on Instance uuid 347acafc-985e-4fa2-b286-07ea3b2e4033 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 18:46:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-26025c09-bff6-4b63-a9a2-60d4c8389a3d tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] Lock "347acafc-985e-4fa2-b286-07ea3b2e4033" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.088s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:46:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-26025c09-bff6-4b63-a9a2-60d4c8389a3d tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] Acquiring lock "347acafc-985e-4fa2-b286-07ea3b2e4033" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:46:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-26025c09-bff6-4b63-a9a2-60d4c8389a3d tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] Lock "347acafc-985e-4fa2-b286-07ea3b2e4033" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:46:39 user nova-compute[75216]: INFO nova.compute.manager [None req-26025c09-bff6-4b63-a9a2-60d4c8389a3d tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] [instance: 347acafc-985e-4fa2-b286-07ea3b2e4033] Attaching volume b3869a39-70d8-46c9-89a6-4cb8a2173cdd to /dev/vdb
Nov 13 18:46:39 user nova-compute[75216]: DEBUG os_brick.utils [None req-26025c09-bff6-4b63-a9a2-60d4c8389a3d tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 18:46:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:46:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:46:39 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[81c13045-464f-4f02-9536-a88b06ed9da6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aea6fcfe14b9\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:46:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:46:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.027s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:46:39 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2162a7e-3779-4c65-b187-939c233253e1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:46:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:46:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:46:39 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f40960c-b145-45fe-a1c0-6ee9a61e24ee]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:46:39 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b464cba-3d34-4656-97d4-861a9976e151]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:46:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-26025c09-bff6-4b63-a9a2-60d4c8389a3d tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] Running cmd (subprocess): nvme version {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:46:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-26025c09-bff6-4b63-a9a2-60d4c8389a3d tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] 'nvme version' failed. Not Retrying. {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 18:46:39 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.nvmeof [None req-26025c09-bff6-4b63-a9a2-60d4c8389a3d tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] nvme not present on system {{(pid=75216) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 18:46:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:46:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 18:46:39 user nova-compute[75216]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 18:46:39 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[362e16aa-f37b-4ea5-8e61-c55c62d37179]: (4, '') {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:46:39 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-26025c09-bff6-4b63-a9a2-60d4c8389a3d tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75216) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 18:46:39 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-26025c09-bff6-4b63-a9a2-60d4c8389a3d tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 18:46:39 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-26025c09-bff6-4b63-a9a2-60d4c8389a3d tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] LIGHTOS: no hostnqn found. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 18:46:39 user nova-compute[75216]: DEBUG os_brick.utils [None req-26025c09-bff6-4b63-a9a2-60d4c8389a3d tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aea6fcfe14b9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 18:46:39 user nova-compute[75216]: DEBUG nova.virt.block_device [None req-26025c09-bff6-4b63-a9a2-60d4c8389a3d tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] [instance: 347acafc-985e-4fa2-b286-07ea3b2e4033] Updating existing volume attachment record: 6b0570d0-746b-4f8b-ad11-f2550c61e4cf {{(pid=75216) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 18:46:40 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:46:40 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:46:40 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:46:40 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:46:41 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:46:41 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:46:41 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:46:41 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75216) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 18:46:41 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:46:41 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:46:41 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:46:41 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:46:41 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Auditing locally available compute resources for user (node: user) {{(pid=75216) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 18:46:41 user nova-compute[75216]: INFO nova.compute.manager [None req-e19e5e49-3c78-4f45-a4fd-2ccbeadc5cd8 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] [instance: 85624c58-6c72-4490-8a3e-547953295ade] Rescuing
Nov 13 18:46:41 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e19e5e49-3c78-4f45-a4fd-2ccbeadc5cd8 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Acquiring lock "refresh_cache-85624c58-6c72-4490-8a3e-547953295ade" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 18:46:41 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e19e5e49-3c78-4f45-a4fd-2ccbeadc5cd8 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Acquired lock "refresh_cache-85624c58-6c72-4490-8a3e-547953295ade" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 18:46:41 user nova-compute[75216]: DEBUG nova.network.neutron [None req-e19e5e49-3c78-4f45-a4fd-2ccbeadc5cd8 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] [instance: 85624c58-6c72-4490-8a3e-547953295ade] Building network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 18:46:41 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 18:46:41 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 18:46:41 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 18:46:41 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 18:46:41 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a3e849-6570-4820-97c8-75468b5bea4f/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:46:42 user nova-compute[75216]: DEBUG nova.network.neutron [None req-e19e5e49-3c78-4f45-a4fd-2ccbeadc5cd8 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] [instance: 85624c58-6c72-4490-8a3e-547953295ade] Updating instance_info_cache with network_info: [{"id": "51ccc958-5ce8-4e1d-8d28-f10c5ac288bd", "address": "fa:16:3e:f4:a4:79", "network": {"id": "6d182db1-03b5-4d1b-86cf-b9367921b7b0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1877006951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2efafc26c47c4050bd367c47469999fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51ccc958-5c", "ovs_interfaceid": "51ccc958-5ce8-4e1d-8d28-f10c5ac288bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 18:46:42 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e19e5e49-3c78-4f45-a4fd-2ccbeadc5cd8 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Releasing lock "refresh_cache-85624c58-6c72-4490-8a3e-547953295ade" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 18:46:42 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a3e849-6570-4820-97c8-75468b5bea4f/disk --force-share --output=json" returned: 0 in 0.298s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:46:42 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a3e849-6570-4820-97c8-75468b5bea4f/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:46:42 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:42 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a3e849-6570-4820-97c8-75468b5bea4f/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:46:42 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/347acafc-985e-4fa2-b286-07ea3b2e4033/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:46:42 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:42 user nova-compute[75216]: DEBUG nova.compute.manager [req-927bd25a-58ed-46ee-87d8-f4d1b0fa888f req-5cdd5eb8-ba68-49cb-97f5-2b3b07f372b5 service nova] [instance: 85624c58-6c72-4490-8a3e-547953295ade] Received event network-vif-unplugged-51ccc958-5ce8-4e1d-8d28-f10c5ac288bd {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:46:42 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-927bd25a-58ed-46ee-87d8-f4d1b0fa888f req-5cdd5eb8-ba68-49cb-97f5-2b3b07f372b5 service nova] Acquiring lock "85624c58-6c72-4490-8a3e-547953295ade-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:46:42 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-927bd25a-58ed-46ee-87d8-f4d1b0fa888f req-5cdd5eb8-ba68-49cb-97f5-2b3b07f372b5 service nova] Lock "85624c58-6c72-4490-8a3e-547953295ade-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:46:42 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-927bd25a-58ed-46ee-87d8-f4d1b0fa888f req-5cdd5eb8-ba68-49cb-97f5-2b3b07f372b5 service nova] Lock "85624c58-6c72-4490-8a3e-547953295ade-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:46:42 user nova-compute[75216]: DEBUG nova.compute.manager [req-927bd25a-58ed-46ee-87d8-f4d1b0fa888f req-5cdd5eb8-ba68-49cb-97f5-2b3b07f372b5 service nova] [instance: 85624c58-6c72-4490-8a3e-547953295ade] No waiting events found dispatching network-vif-unplugged-51ccc958-5ce8-4e1d-8d28-f10c5ac288bd {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:46:42 user nova-compute[75216]: WARNING nova.compute.manager [req-927bd25a-58ed-46ee-87d8-f4d1b0fa888f req-5cdd5eb8-ba68-49cb-97f5-2b3b07f372b5 service nova] [instance: 85624c58-6c72-4490-8a3e-547953295ade] Received unexpected event network-vif-unplugged-51ccc958-5ce8-4e1d-8d28-f10c5ac288bd for instance with vm_state active and task_state rescuing.
Nov 13 18:46:42 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/347acafc-985e-4fa2-b286-07ea3b2e4033/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:46:42 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/347acafc-985e-4fa2-b286-07ea3b2e4033/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:46:42 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:42 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:46:42 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:42 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/347acafc-985e-4fa2-b286-07ea3b2e4033/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:46:42 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83fda249-9d28-4cc2-aeb0-103ce4f1faa4/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:46:42 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83fda249-9d28-4cc2-aeb0-103ce4f1faa4/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:46:42 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83fda249-9d28-4cc2-aeb0-103ce4f1faa4/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:46:42 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 85624c58-6c72-4490-8a3e-547953295ade] Instance destroyed successfully.
Nov 13 18:46:43 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-e19e5e49-3c78-4f45-a4fd-2ccbeadc5cd8 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] [instance: 85624c58-6c72-4490-8a3e-547953295ade] Attempting rescue
Nov 13 18:46:43 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-e19e5e49-3c78-4f45-a4fd-2ccbeadc5cd8 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75216) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 13 18:46:43 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-e19e5e49-3c78-4f45-a4fd-2ccbeadc5cd8 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] [instance: 85624c58-6c72-4490-8a3e-547953295ade] Instance directory exists: not creating {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 13 18:46:43 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-e19e5e49-3c78-4f45-a4fd-2ccbeadc5cd8 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] [instance: 85624c58-6c72-4490-8a3e-547953295ade] Creating image(s)
Nov 13 18:46:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e19e5e49-3c78-4f45-a4fd-2ccbeadc5cd8 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Acquiring lock "/opt/stack/data/nova/instances/85624c58-6c72-4490-8a3e-547953295ade/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:46:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e19e5e49-3c78-4f45-a4fd-2ccbeadc5cd8 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Lock "/opt/stack/data/nova/instances/85624c58-6c72-4490-8a3e-547953295ade/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:46:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e19e5e49-3c78-4f45-a4fd-2ccbeadc5cd8 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Lock "/opt/stack/data/nova/instances/85624c58-6c72-4490-8a3e-547953295ade/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:46:43 user nova-compute[75216]: DEBUG nova.objects.instance [None req-e19e5e49-3c78-4f45-a4fd-2ccbeadc5cd8 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Lazy-loading 'trusted_certs' on Instance uuid 85624c58-6c72-4490-8a3e-547953295ade {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 18:46:43 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e19e5e49-3c78-4f45-a4fd-2ccbeadc5cd8 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Acquiring lock "88c50a45bec9d6b0427462b3242b9b8e5f49c2b6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:46:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e19e5e49-3c78-4f45-a4fd-2ccbeadc5cd8 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Lock "88c50a45bec9d6b0427462b3242b9b8e5f49c2b6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:46:43 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-e19e5e49-3c78-4f45-a4fd-2ccbeadc5cd8 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:46:43 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83fda249-9d28-4cc2-aeb0-103ce4f1faa4/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:46:43 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d589d57e-de50-482a-843f-e8246b3d7528/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:46:43 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-e19e5e49-3c78-4f45-a4fd-2ccbeadc5cd8 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json" returned: 0 in 0.205s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:46:43 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-e19e5e49-3c78-4f45-a4fd-2ccbeadc5cd8 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6,backing_fmt=raw /opt/stack/data/nova/instances/85624c58-6c72-4490-8a3e-547953295ade/disk.rescue {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:46:43 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d589d57e-de50-482a-843f-e8246b3d7528/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:46:43 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d589d57e-de50-482a-843f-e8246b3d7528/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:46:43 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-e19e5e49-3c78-4f45-a4fd-2ccbeadc5cd8 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6,backing_fmt=raw /opt/stack/data/nova/instances/85624c58-6c72-4490-8a3e-547953295ade/disk.rescue" returned: 0 in 0.068s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:46:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e19e5e49-3c78-4f45-a4fd-2ccbeadc5cd8 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Lock "88c50a45bec9d6b0427462b3242b9b8e5f49c2b6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.279s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:46:43 user nova-compute[75216]: DEBUG nova.objects.instance [None req-e19e5e49-3c78-4f45-a4fd-2ccbeadc5cd8 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Lazy-loading 'migration_context' on Instance uuid 85624c58-6c72-4490-8a3e-547953295ade {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 18:46:43 user nova-compute[75216]: DEBUG nova.objects.base [None req-e19e5e49-3c78-4f45-a4fd-2ccbeadc5cd8 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Object Instance<85624c58-6c72-4490-8a3e-547953295ade> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75216) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 18:46:43 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-e19e5e49-3c78-4f45-a4fd-2ccbeadc5cd8 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] [instance: 85624c58-6c72-4490-8a3e-547953295ade] Created local disks {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 18:46:43 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-e19e5e49-3c78-4f45-a4fd-2ccbeadc5cd8 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] [instance: 85624c58-6c72-4490-8a3e-547953295ade] Start _get_guest_xml network_info=[{"id": "51ccc958-5ce8-4e1d-8d28-f10c5ac288bd", "address": "fa:16:3e:f4:a4:79", "network": {"id": "6d182db1-03b5-4d1b-86cf-b9367921b7b0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1877006951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1877006951-network", "vif_mac": "fa:16:3e:f4:a4:79"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2efafc26c47c4050bd367c47469999fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51ccc958-5c", "ovs_interfaceid": "51ccc958-5ce8-4e1d-8d28-f10c5ac288bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T18:41:06Z,direct_url=<?>,disk_format='qcow2',id=77bcb5ba-8510-41ec-a88d-96097bb431de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c465b7c26ec44582b6d1b7169536ecc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T18:41:07Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '77bcb5ba-8510-41ec-a88d-96097bb431de', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 18:46:43 user nova-compute[75216]: DEBUG nova.objects.instance [None req-e19e5e49-3c78-4f45-a4fd-2ccbeadc5cd8 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Lazy-loading 'resources' on Instance uuid 85624c58-6c72-4490-8a3e-547953295ade {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 18:46:43 user nova-compute[75216]: DEBUG nova.objects.base [None req-e19e5e49-3c78-4f45-a4fd-2ccbeadc5cd8 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Object Instance<85624c58-6c72-4490-8a3e-547953295ade> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75216) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 18:46:43 user nova-compute[75216]: DEBUG nova.objects.instance [None req-e19e5e49-3c78-4f45-a4fd-2ccbeadc5cd8 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Lazy-loading 'numa_topology' on Instance uuid 85624c58-6c72-4490-8a3e-547953295ade {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 18:46:43 user nova-compute[75216]: DEBUG nova.objects.base [None req-e19e5e49-3c78-4f45-a4fd-2ccbeadc5cd8 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Object Instance<85624c58-6c72-4490-8a3e-547953295ade> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75216) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 18:46:43 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-e19e5e49-3c78-4f45-a4fd-2ccbeadc5cd8 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 18:46:43 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-e19e5e49-3c78-4f45-a4fd-2ccbeadc5cd8 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 18:46:43 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-e19e5e49-3c78-4f45-a4fd-2ccbeadc5cd8 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 18:46:43 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-e19e5e49-3c78-4f45-a4fd-2ccbeadc5cd8 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] CPU controller missing on host. {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 18:46:43 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-e19e5e49-3c78-4f45-a4fd-2ccbeadc5cd8 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 18:46:43 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-e19e5e49-3c78-4f45-a4fd-2ccbeadc5cd8 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] CPU controller found on host. {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 18:46:43 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-e19e5e49-3c78-4f45-a4fd-2ccbeadc5cd8 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75216) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 18:46:43 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-e19e5e49-3c78-4f45-a4fd-2ccbeadc5cd8 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T18:40:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T18:41:06Z,direct_url=<?>,disk_format='qcow2',id=77bcb5ba-8510-41ec-a88d-96097bb431de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c465b7c26ec44582b6d1b7169536ecc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T18:41:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 18:46:43 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-e19e5e49-3c78-4f45-a4fd-2ccbeadc5cd8 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Flavor limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 18:46:43 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-e19e5e49-3c78-4f45-a4fd-2ccbeadc5cd8 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Image limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 18:46:43 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-e19e5e49-3c78-4f45-a4fd-2ccbeadc5cd8 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Flavor pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 18:46:43 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-e19e5e49-3c78-4f45-a4fd-2ccbeadc5cd8 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Image pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 18:46:43 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-e19e5e49-3c78-4f45-a4fd-2ccbeadc5cd8 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 18:46:43 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-e19e5e49-3c78-4f45-a4fd-2ccbeadc5cd8 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 18:46:43 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-e19e5e49-3c78-4f45-a4fd-2ccbeadc5cd8 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 18:46:43 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-e19e5e49-3c78-4f45-a4fd-2ccbeadc5cd8 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Got 1 possible topologies {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 18:46:43 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-e19e5e49-3c78-4f45-a4fd-2ccbeadc5cd8 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 18:46:43 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-e19e5e49-3c78-4f45-a4fd-2ccbeadc5cd8 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 18:46:43 user nova-compute[75216]: DEBUG nova.objects.instance [None req-e19e5e49-3c78-4f45-a4fd-2ccbeadc5cd8 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Lazy-loading 'vcpu_model' on Instance uuid 85624c58-6c72-4490-8a3e-547953295ade {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 18:46:43 user nova-compute[75216]: DEBUG nova.objects.base [None req-e19e5e49-3c78-4f45-a4fd-2ccbeadc5cd8 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Object Instance<85624c58-6c72-4490-8a3e-547953295ade> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75216) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 18:46:43 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-e19e5e49-3c78-4f45-a4fd-2ccbeadc5cd8 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T18:44:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1814419203',display_name='tempest-ServerRescueNegativeTestJSON-server-1814419203',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1814419203',id=4,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-13T18:45:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2efafc26c47c4050bd367c47469999fb',ramdisk_id='',reservation_id='r-s9cus3mx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-165310019',owner_user_name='tempest-ServerRescueNegativeTestJSON-165310019-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T18:45:05Z,user_data=None,user_id='3587565f5b56450e95f2bd572d7e4f88',uuid=85624c58-6c72-4490-8a3e-547953295ade,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "51ccc958-5ce8-4e1d-8d28-f10c5ac288bd", "address": "fa:16:3e:f4:a4:79", "network": {"id": "6d182db1-03b5-4d1b-86cf-b9367921b7b0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1877006951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1877006951-network", "vif_mac": "fa:16:3e:f4:a4:79"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2efafc26c47c4050bd367c47469999fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51ccc958-5c", "ovs_interfaceid": "51ccc958-5ce8-4e1d-8d28-f10c5ac288bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75216) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 18:46:43 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-e19e5e49-3c78-4f45-a4fd-2ccbeadc5cd8 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Converting VIF {"id": "51ccc958-5ce8-4e1d-8d28-f10c5ac288bd", "address": "fa:16:3e:f4:a4:79", "network": {"id": "6d182db1-03b5-4d1b-86cf-b9367921b7b0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1877006951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1877006951-network", "vif_mac": "fa:16:3e:f4:a4:79"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2efafc26c47c4050bd367c47469999fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51ccc958-5c", "ovs_interfaceid": "51ccc958-5ce8-4e1d-8d28-f10c5ac288bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 18:46:43 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-e19e5e49-3c78-4f45-a4fd-2ccbeadc5cd8 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f4:a4:79,bridge_name='br-int',has_traffic_filtering=True,id=51ccc958-5ce8-4e1d-8d28-f10c5ac288bd,network=Network(6d182db1-03b5-4d1b-86cf-b9367921b7b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51ccc958-5c') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 18:46:43 user nova-compute[75216]: DEBUG nova.objects.instance [None req-e19e5e49-3c78-4f45-a4fd-2ccbeadc5cd8 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Lazy-loading 'pci_devices' on Instance uuid 85624c58-6c72-4490-8a3e-547953295ade {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 18:46:43 user nova-compute[75216]: DEBUG nova.objects.base [None req-e19e5e49-3c78-4f45-a4fd-2ccbeadc5cd8 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Object Instance<85624c58-6c72-4490-8a3e-547953295ade> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75216) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 18:46:43 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-e19e5e49-3c78-4f45-a4fd-2ccbeadc5cd8 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] [instance: 85624c58-6c72-4490-8a3e-547953295ade] End _get_guest_xml xml=<domain type="kvm">
Nov 13 18:46:43 user nova-compute[75216]:   <uuid>85624c58-6c72-4490-8a3e-547953295ade</uuid>
Nov 13 18:46:43 user nova-compute[75216]:   <name>instance-00000004</name>
Nov 13 18:46:43 user nova-compute[75216]:   <memory>524288</memory>
Nov 13 18:46:43 user nova-compute[75216]:   <vcpu>1</vcpu>
Nov 13 18:46:43 user nova-compute[75216]:   <metadata>
Nov 13 18:46:43 user nova-compute[75216]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 18:46:43 user nova-compute[75216]:       <nova:package version="0.0.0"/>
Nov 13 18:46:43 user nova-compute[75216]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1814419203</nova:name>
Nov 13 18:46:43 user nova-compute[75216]:       <nova:creationTime>2023-11-13 18:46:43</nova:creationTime>
Nov 13 18:46:43 user nova-compute[75216]:       <nova:flavor name="m1.tiny">
Nov 13 18:46:43 user nova-compute[75216]:         <nova:memory>512</nova:memory>
Nov 13 18:46:43 user nova-compute[75216]:         <nova:disk>1</nova:disk>
Nov 13 18:46:43 user nova-compute[75216]:         <nova:swap>0</nova:swap>
Nov 13 18:46:43 user nova-compute[75216]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 18:46:43 user nova-compute[75216]:         <nova:vcpus>1</nova:vcpus>
Nov 13 18:46:43 user nova-compute[75216]:       </nova:flavor>
Nov 13 18:46:43 user nova-compute[75216]:       <nova:owner>
Nov 13 18:46:43 user nova-compute[75216]:         <nova:user uuid="3587565f5b56450e95f2bd572d7e4f88">tempest-ServerRescueNegativeTestJSON-165310019-project-member</nova:user>
Nov 13 18:46:43 user nova-compute[75216]:         <nova:project uuid="2efafc26c47c4050bd367c47469999fb">tempest-ServerRescueNegativeTestJSON-165310019</nova:project>
Nov 13 18:46:43 user nova-compute[75216]:       </nova:owner>
Nov 13 18:46:43 user nova-compute[75216]:       <nova:root type="image" uuid="77bcb5ba-8510-41ec-a88d-96097bb431de"/>
Nov 13 18:46:43 user nova-compute[75216]:       <nova:ports>
Nov 13 18:46:43 user nova-compute[75216]:         <nova:port uuid="51ccc958-5ce8-4e1d-8d28-f10c5ac288bd">
Nov 13 18:46:43 user nova-compute[75216]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 13 18:46:43 user nova-compute[75216]:         </nova:port>
Nov 13 18:46:43 user nova-compute[75216]:       </nova:ports>
Nov 13 18:46:43 user nova-compute[75216]:     </nova:instance>
Nov 13 18:46:43 user nova-compute[75216]:   </metadata>
Nov 13 18:46:43 user nova-compute[75216]:   <sysinfo type="smbios">
Nov 13 18:46:43 user nova-compute[75216]:     <system>
Nov 13 18:46:43 user nova-compute[75216]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 18:46:43 user nova-compute[75216]:       <entry name="product">OpenStack Nova</entry>
Nov 13 18:46:43 user nova-compute[75216]:       <entry name="version">0.0.0</entry>
Nov 13 18:46:43 user nova-compute[75216]:       <entry name="serial">85624c58-6c72-4490-8a3e-547953295ade</entry>
Nov 13 18:46:43 user nova-compute[75216]:       <entry name="uuid">85624c58-6c72-4490-8a3e-547953295ade</entry>
Nov 13 18:46:43 user nova-compute[75216]:       <entry name="family">Virtual Machine</entry>
Nov 13 18:46:43 user nova-compute[75216]:     </system>
Nov 13 18:46:43 user nova-compute[75216]:   </sysinfo>
Nov 13 18:46:43 user nova-compute[75216]:   <os>
Nov 13 18:46:43 user nova-compute[75216]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 18:46:43 user nova-compute[75216]:     <smbios mode="sysinfo"/>
Nov 13 18:46:43 user nova-compute[75216]:   </os>
Nov 13 18:46:43 user nova-compute[75216]:   <features>
Nov 13 18:46:43 user nova-compute[75216]:     <acpi/>
Nov 13 18:46:43 user nova-compute[75216]:     <apic/>
Nov 13 18:46:43 user nova-compute[75216]:     <vmcoreinfo/>
Nov 13 18:46:43 user nova-compute[75216]:   </features>
Nov 13 18:46:43 user nova-compute[75216]:   <clock offset="utc">
Nov 13 18:46:43 user nova-compute[75216]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 18:46:43 user nova-compute[75216]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 18:46:43 user nova-compute[75216]:     <timer name="hpet" present="no"/>
Nov 13 18:46:43 user nova-compute[75216]:   </clock>
Nov 13 18:46:43 user nova-compute[75216]:   <cpu mode="custom" match="exact">
Nov 13 18:46:43 user nova-compute[75216]:     <model>Nehalem</model>
Nov 13 18:46:43 user nova-compute[75216]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 18:46:43 user nova-compute[75216]:   </cpu>
Nov 13 18:46:43 user nova-compute[75216]:   <devices>
Nov 13 18:46:43 user nova-compute[75216]:     <disk type="file" device="disk">
Nov 13 18:46:43 user nova-compute[75216]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 18:46:43 user nova-compute[75216]:       <source file="/opt/stack/data/nova/instances/85624c58-6c72-4490-8a3e-547953295ade/disk.rescue"/>
Nov 13 18:46:43 user nova-compute[75216]:       <target dev="vda" bus="virtio"/>
Nov 13 18:46:43 user nova-compute[75216]:     </disk>
Nov 13 18:46:43 user nova-compute[75216]:     <disk type="file" device="disk">
Nov 13 18:46:43 user nova-compute[75216]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 18:46:43 user nova-compute[75216]:       <source file="/opt/stack/data/nova/instances/85624c58-6c72-4490-8a3e-547953295ade/disk"/>
Nov 13 18:46:43 user nova-compute[75216]:       <target dev="vdb" bus="virtio"/>
Nov 13 18:46:43 user nova-compute[75216]:     </disk>
Nov 13 18:46:43 user nova-compute[75216]:     <interface type="ethernet">
Nov 13 18:46:43 user nova-compute[75216]:       <mac address="fa:16:3e:f4:a4:79"/>
Nov 13 18:46:43 user nova-compute[75216]:       <model type="virtio"/>
Nov 13 18:46:43 user nova-compute[75216]:       <mtu size="1442"/>
Nov 13 18:46:43 user nova-compute[75216]:       <target dev="tap51ccc958-5c"/>
Nov 13 18:46:43 user nova-compute[75216]:     </interface>
Nov 13 18:46:43 user nova-compute[75216]:     <serial type="pty">
Nov 13 18:46:43 user nova-compute[75216]:       <log file="/opt/stack/data/nova/instances/85624c58-6c72-4490-8a3e-547953295ade/console.log" append="off"/>
Nov 13 18:46:43 user nova-compute[75216]:     </serial>
Nov 13 18:46:43 user nova-compute[75216]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 18:46:43 user nova-compute[75216]:     <video>
Nov 13 18:46:43 user nova-compute[75216]:       <model type="virtio"/>
Nov 13 18:46:43 user nova-compute[75216]:     </video>
Nov 13 18:46:43 user nova-compute[75216]:     <rng model="virtio">
Nov 13 18:46:43 user nova-compute[75216]:       <backend model="random">/dev/urandom</backend>
Nov 13 18:46:43 user nova-compute[75216]:     </rng>
Nov 13 18:46:43 user nova-compute[75216]:     <controller type="usb" index="0" model="none"/>
Nov 13 18:46:43 user nova-compute[75216]:     <memballoon model="virtio">
Nov 13 18:46:43 user nova-compute[75216]:       <stats period="10"/>
Nov 13 18:46:43 user nova-compute[75216]:     </memballoon>
Nov 13 18:46:43 user nova-compute[75216]:   </devices>
Nov 13 18:46:43 user nova-compute[75216]: </domain>
Nov 13 18:46:43 user nova-compute[75216]:  {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 18:46:43 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 85624c58-6c72-4490-8a3e-547953295ade] Instance destroyed successfully.
Nov 13 18:46:43 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d589d57e-de50-482a-843f-e8246b3d7528/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:46:43 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b078f75-57f2-495a-abd5-f8adf72db80b/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:46:43 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-e19e5e49-3c78-4f45-a4fd-2ccbeadc5cd8 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 18:46:43 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-e19e5e49-3c78-4f45-a4fd-2ccbeadc5cd8 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 18:46:43 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-e19e5e49-3c78-4f45-a4fd-2ccbeadc5cd8 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] No VIF found with MAC fa:16:3e:f4:a4:79, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 18:46:43 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b078f75-57f2-495a-abd5-f8adf72db80b/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:46:43 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b078f75-57f2-495a-abd5-f8adf72db80b/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:46:43 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b078f75-57f2-495a-abd5-f8adf72db80b/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:46:43 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/872856e5-cdc4-444e-8835-55e36708d776/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:46:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/872856e5-cdc4-444e-8835-55e36708d776/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:46:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/872856e5-cdc4-444e-8835-55e36708d776/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:46:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/872856e5-cdc4-444e-8835-55e36708d776/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:46:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/576e97b7-285a-451f-a80d-aaa321a79d3b/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:46:44 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-26025c09-bff6-4b63-a9a2-60d4c8389a3d tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] [instance: 347acafc-985e-4fa2-b286-07ea3b2e4033] Calling os-brick to attach iSCSI Volume {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 18:46:44 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-26025c09-bff6-4b63-a9a2-60d4c8389a3d tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3a8669e40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b3869a39-70d8-46c9-89a6-4cb8a2173cdd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ObLisENY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 18:46:44 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-26025c09-bff6-4b63-a9a2-60d4c8389a3d tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 18:46:44 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-26025c09-bff6-4b63-a9a2-60d4c8389a3d tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 18:46:44 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-26025c09-bff6-4b63-a9a2-60d4c8389a3d tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 18:46:44 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-26025c09-bff6-4b63-a9a2-60d4c8389a3d tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 18:46:44 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-26025c09-bff6-4b63-a9a2-60d4c8389a3d tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b3869a39-70d8-46c9-89a6-4cb8a2173cdd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 18:46:44 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-26025c09-bff6-4b63-a9a2-60d4c8389a3d tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b3869a39-70d8-46c9-89a6-4cb8a2173cdd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 18:46:44 user nova-compute[75216]: INFO os_brick.initiator.connectors.iscsi [None req-26025c09-bff6-4b63-a9a2-60d4c8389a3d tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 18:46:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3869a39-70d8-46c9-89a6-4cb8a2173cdd -p 172.16.0.220:3260 {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:46:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3869a39-70d8-46c9-89a6-4cb8a2173cdd -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:46:44 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[664c1270-a987-4cd1-925f-cd3636b06793]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:46:44 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-26025c09-bff6-4b63-a9a2-60d4c8389a3d tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 18:46:44 user nova-compute[75216]:  {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:46:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3869a39-70d8-46c9-89a6-4cb8a2173cdd -p 172.16.0.220:3260 --interface default --op new {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:46:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3869a39-70d8-46c9-89a6-4cb8a2173cdd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.028s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:46:44 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d08da1d-c87d-4279-9fb2-9508d36eddc9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b3869a39-70d8-46c9-89a6-4cb8a2173cdd] added\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:46:44 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-26025c09-bff6-4b63-a9a2-60d4c8389a3d tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b3869a39-70d8-46c9-89a6-4cb8a2173cdd] added
Nov 13 18:46:44 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:46:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3869a39-70d8-46c9-89a6-4cb8a2173cdd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:46:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3869a39-70d8-46c9-89a6-4cb8a2173cdd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:46:44 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[78eafd17-16e2-4415-8f53-08d113ec19f0]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:46:44 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-26025c09-bff6-4b63-a9a2-60d4c8389a3d tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:46:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/576e97b7-285a-451f-a80d-aaa321a79d3b/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:46:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/576e97b7-285a-451f-a80d-aaa321a79d3b/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:46:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3869a39-70d8-46c9-89a6-4cb8a2173cdd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:46:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3869a39-70d8-46c9-89a6-4cb8a2173cdd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:46:44 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1f59326-2b23-4093-88a4-f017ebcc5882]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:46:44 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-26025c09-bff6-4b63-a9a2-60d4c8389a3d tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:46:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3869a39-70d8-46c9-89a6-4cb8a2173cdd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ObLisENY {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:46:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3869a39-70d8-46c9-89a6-4cb8a2173cdd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ObLisENY" returned: 0 in 0.017s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:46:44 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc76ea09-6df8-4621-a211-d14591e2478d]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:46:44 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-26025c09-bff6-4b63-a9a2-60d4c8389a3d tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ObLisENY'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:46:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3869a39-70d8-46c9-89a6-4cb8a2173cdd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:46:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3869a39-70d8-46c9-89a6-4cb8a2173cdd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:46:44 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[df4ed3ab-b200-4c88-8853-a5d16dc69477]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:46:44 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-26025c09-bff6-4b63-a9a2-60d4c8389a3d tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:46:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:46:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:46:44 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2332674-f7b6-42b6-a67a-05487c111e43]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba1efeb5-724e-4415-a5ed-12ce8c9489bc (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3d195d-b8b4-4c79-a150-813952c640e8 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fc393f0-1356-404f-a87b-bed1fb91b924 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a1a5e82-4f70-4668-94bd-4a842d826214 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e823c6a1-f7e2-495f-a5dc-6fdfd2b19cf0 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52f4339a-6a47-4877-b041-9c27d7be2e94 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac (non-flash)\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:46:44 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-26025c09-bff6-4b63-a9a2-60d4c8389a3d tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba1efeb5-724e-4415-a5ed-12ce8c9489bc (non-flash)
Nov 13 18:46:44 user nova-compute[75216]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3d195d-b8b4-4c79-a150-813952c640e8 (non-flash)
Nov 13 18:46:44 user nova-compute[75216]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fc393f0-1356-404f-a87b-bed1fb91b924 (non-flash)
Nov 13 18:46:44 user nova-compute[75216]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a1a5e82-4f70-4668-94bd-4a842d826214 (non-flash)
Nov 13 18:46:44 user nova-compute[75216]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e823c6a1-f7e2-495f-a5dc-6fdfd2b19cf0 (non-flash)
Nov 13 18:46:44 user nova-compute[75216]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52f4339a-6a47-4877-b041-9c27d7be2e94 (non-flash)
Nov 13 18:46:44 user nova-compute[75216]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac (non-flash)
Nov 13 18:46:44 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 18:46:44 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-26025c09-bff6-4b63-a9a2-60d4c8389a3d tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba1efeb5-724e-4415-a5ed-12ce8c9489bc (non-flash)
Nov 13 18:46:44 user nova-compute[75216]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3d195d-b8b4-4c79-a150-813952c640e8 (non-flash)
Nov 13 18:46:44 user nova-compute[75216]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fc393f0-1356-404f-a87b-bed1fb91b924 (non-flash)
Nov 13 18:46:44 user nova-compute[75216]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a1a5e82-4f70-4668-94bd-4a842d826214 (non-flash)
Nov 13 18:46:44 user nova-compute[75216]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e823c6a1-f7e2-495f-a5dc-6fdfd2b19cf0 (non-flash)
Nov 13 18:46:44 user nova-compute[75216]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52f4339a-6a47-4877-b041-9c27d7be2e94 (non-flash)
Nov 13 18:46:44 user nova-compute[75216]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac (non-flash)
Nov 13 18:46:44 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 18:46:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3869a39-70d8-46c9-89a6-4cb8a2173cdd -p 172.16.0.220:3260 --login {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:46:44 user nova-compute[75216]: DEBUG nova.compute.manager [req-5db3b6d1-b383-477e-a3d0-6035fe6973b3 req-bc2e9ada-2db6-47cb-b453-1ad86b296746 service nova] [instance: 85624c58-6c72-4490-8a3e-547953295ade] Received event network-vif-plugged-51ccc958-5ce8-4e1d-8d28-f10c5ac288bd {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:46:44 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-5db3b6d1-b383-477e-a3d0-6035fe6973b3 req-bc2e9ada-2db6-47cb-b453-1ad86b296746 service nova] Acquiring lock "85624c58-6c72-4490-8a3e-547953295ade-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:46:44 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-5db3b6d1-b383-477e-a3d0-6035fe6973b3 req-bc2e9ada-2db6-47cb-b453-1ad86b296746 service nova] Lock "85624c58-6c72-4490-8a3e-547953295ade-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:46:44 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-5db3b6d1-b383-477e-a3d0-6035fe6973b3 req-bc2e9ada-2db6-47cb-b453-1ad86b296746 service nova] Lock "85624c58-6c72-4490-8a3e-547953295ade-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:46:44 user nova-compute[75216]: DEBUG nova.compute.manager [req-5db3b6d1-b383-477e-a3d0-6035fe6973b3 req-bc2e9ada-2db6-47cb-b453-1ad86b296746 service nova] [instance: 85624c58-6c72-4490-8a3e-547953295ade] No waiting events found dispatching network-vif-plugged-51ccc958-5ce8-4e1d-8d28-f10c5ac288bd {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:46:44 user nova-compute[75216]: WARNING nova.compute.manager [req-5db3b6d1-b383-477e-a3d0-6035fe6973b3 req-bc2e9ada-2db6-47cb-b453-1ad86b296746 service nova] [instance: 85624c58-6c72-4490-8a3e-547953295ade] Received unexpected event network-vif-plugged-51ccc958-5ce8-4e1d-8d28-f10c5ac288bd for instance with vm_state active and task_state rescuing.
Nov 13 18:46:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/576e97b7-285a-451f-a80d-aaa321a79d3b/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:46:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3869a39-70d8-46c9-89a6-4cb8a2173cdd -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:46:44 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[c453370e-0f79-4899-b355-01a9b79f125c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b3869a39-70d8-46c9-89a6-4cb8a2173cdd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b3869a39-70d8-46c9-89a6-4cb8a2173cdd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:46:44 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-26025c09-bff6-4b63-a9a2-60d4c8389a3d tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b3869a39-70d8-46c9-89a6-4cb8a2173cdd, portal: 172.16.0.220,3260]
Nov 13 18:46:44 user nova-compute[75216]: Login to [iface: default, target: iqn.2010-10.org.openstack:b3869a39-70d8-46c9-89a6-4cb8a2173cdd, portal: 172.16.0.220,3260] successful.
Nov 13 18:46:44 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:46:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3869a39-70d8-46c9-89a6-4cb8a2173cdd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:46:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3869a39-70d8-46c9-89a6-4cb8a2173cdd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:46:44 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[2672fcf2-a2d6-4324-a788-e33ed9a4a267]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:46:44 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-26025c09-bff6-4b63-a9a2-60d4c8389a3d tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:46:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:46:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:46:44 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[53fa2aa3-bd58-41d9-8be3-c41b0da75e1b]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3869a39-70d8-46c9-89a6-4cb8a2173cdd (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba1efeb5-724e-4415-a5ed-12ce8c9489bc (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3d195d-b8b4-4c79-a150-813952c640e8 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fc393f0-1356-404f-a87b-bed1fb91b924 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a1a5e82-4f70-4668-94bd-4a842d826214 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e823c6a1-f7e2-495f-a5dc-6fdfd2b19cf0 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52f4339a-6a47-4877-b041-9c27d7be2e94 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac (non-flash)\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:46:44 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-26025c09-bff6-4b63-a9a2-60d4c8389a3d tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3869a39-70d8-46c9-89a6-4cb8a2173cdd (non-flash)
Nov 13 18:46:44 user nova-compute[75216]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba1efeb5-724e-4415-a5ed-12ce8c9489bc (non-flash)
Nov 13 18:46:44 user nova-compute[75216]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3d195d-b8b4-4c79-a150-813952c640e8 (non-flash)
Nov 13 18:46:44 user nova-compute[75216]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fc393f0-1356-404f-a87b-bed1fb91b924 (non-flash)
Nov 13 18:46:44 user nova-compute[75216]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a1a5e82-4f70-4668-94bd-4a842d826214 (non-flash)
Nov 13 18:46:44 user nova-compute[75216]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e823c6a1-f7e2-495f-a5dc-6fdfd2b19cf0 (non-flash)
Nov 13 18:46:44 user nova-compute[75216]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52f4339a-6a47-4877-b041-9c27d7be2e94 (non-flash)
Nov 13 18:46:44 user nova-compute[75216]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac (non-flash)
Nov 13 18:46:44 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 18:46:44 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-26025c09-bff6-4b63-a9a2-60d4c8389a3d tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3869a39-70d8-46c9-89a6-4cb8a2173cdd (non-flash)
Nov 13 18:46:44 user nova-compute[75216]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba1efeb5-724e-4415-a5ed-12ce8c9489bc (non-flash)
Nov 13 18:46:44 user nova-compute[75216]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3d195d-b8b4-4c79-a150-813952c640e8 (non-flash)
Nov 13 18:46:44 user nova-compute[75216]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fc393f0-1356-404f-a87b-bed1fb91b924 (non-flash)
Nov 13 18:46:44 user nova-compute[75216]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a1a5e82-4f70-4668-94bd-4a842d826214 (non-flash)
Nov 13 18:46:44 user nova-compute[75216]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e823c6a1-f7e2-495f-a5dc-6fdfd2b19cf0 (non-flash)
Nov 13 18:46:44 user nova-compute[75216]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52f4339a-6a47-4877-b041-9c27d7be2e94 (non-flash)
Nov 13 18:46:44 user nova-compute[75216]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac (non-flash)
Nov 13 18:46:44 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 18:46:44 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-26025c09-bff6-4b63-a9a2-60d4c8389a3d tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b3869a39-70d8-46c9-89a6-4cb8a2173cdd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.342s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 18:46:44 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-26025c09-bff6-4b63-a9a2-60d4c8389a3d tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] Connected to 172.16.0.220:3260 {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 18:46:44 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-26025c09-bff6-4b63-a9a2-60d4c8389a3d tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] HCTL ('40', '-', '-', 0) found on session 10 with lun 0 {{(pid=75216) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 18:46:44 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-26025c09-bff6-4b63-a9a2-60d4c8389a3d tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=75216) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 18:46:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:46:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.024s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:46:44 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[0868d06e-5ce3-4277-8ab9-542e474bba4d]: (4, ('- - 0', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:46:44 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-26025c09-bff6-4b63-a9a2-60d4c8389a3d tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] Searching for a device in session 10 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=75216) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 18:46:44 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-26025c09-bff6-4b63-a9a2-60d4c8389a3d tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:b3869a39-70d8-46c9-89a6-4cb8a2173cdd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ObLisENY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 18:46:44 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:44 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:44 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:44 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:45 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:45 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85624c58-6c72-4490-8a3e-547953295ade/disk.rescue --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:46:45 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85624c58-6c72-4490-8a3e-547953295ade/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:46:45 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85624c58-6c72-4490-8a3e-547953295ade/disk.rescue --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:46:45 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85624c58-6c72-4490-8a3e-547953295ade/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:46:45 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-26025c09-bff6-4b63-a9a2-60d4c8389a3d tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.389s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 18:46:45 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-26025c09-bff6-4b63-a9a2-60d4c8389a3d tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] <== connect_volume: return (1392ms) {'type': 'block', 'scsi_wwn': '26438633433396236', 'path': '/dev/sdi'} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 18:46:45 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-26025c09-bff6-4b63-a9a2-60d4c8389a3d tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] [instance: 347acafc-985e-4fa2-b286-07ea3b2e4033] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26438633433396236', 'path': '/dev/sdi'} {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 18:46:45 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85624c58-6c72-4490-8a3e-547953295ade/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:46:45 user nova-compute[75216]: DEBUG nova.objects.instance [None req-26025c09-bff6-4b63-a9a2-60d4c8389a3d tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] Lazy-loading 'flavor' on Instance uuid 347acafc-985e-4fa2-b286-07ea3b2e4033 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 18:46:45 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-26025c09-bff6-4b63-a9a2-60d4c8389a3d tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] attach device xml: <disk type="block" device="disk">
Nov 13 18:46:45 user nova-compute[75216]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 18:46:45 user nova-compute[75216]:   <source dev="/dev/sdi"/>
Nov 13 18:46:45 user nova-compute[75216]:   <target dev="vdb" bus="virtio"/>
Nov 13 18:46:45 user nova-compute[75216]:   <serial>b3869a39-70d8-46c9-89a6-4cb8a2173cdd</serial>
Nov 13 18:46:45 user nova-compute[75216]: </disk>
Nov 13 18:46:45 user nova-compute[75216]:  {{(pid=75216) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 13 18:46:45 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85624c58-6c72-4490-8a3e-547953295ade/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:46:45 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85624c58-6c72-4490-8a3e-547953295ade/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:46:46 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85624c58-6c72-4490-8a3e-547953295ade/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:46:46 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 18:46:46 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 18:46:46 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 18:46:46 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30ca36a3-ac49-44e4-a804-8940f7ef25b8/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:46:46 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-26025c09-bff6-4b63-a9a2-60d4c8389a3d tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 18:46:46 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-26025c09-bff6-4b63-a9a2-60d4c8389a3d tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 18:46:46 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-26025c09-bff6-4b63-a9a2-60d4c8389a3d tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] No VIF found with MAC fa:16:3e:d9:96:c6, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 18:46:46 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30ca36a3-ac49-44e4-a804-8940f7ef25b8/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:46:46 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30ca36a3-ac49-44e4-a804-8940f7ef25b8/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:46:46 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-26025c09-bff6-4b63-a9a2-60d4c8389a3d tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] Lock "347acafc-985e-4fa2-b286-07ea3b2e4033" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.696s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:46:46 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30ca36a3-ac49-44e4-a804-8940f7ef25b8/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:46:47 user nova-compute[75216]: DEBUG nova.compute.manager [req-b175a70b-2c72-4923-b131-502ae242dc85 req-d1ab39e4-2020-406c-a866-16b65f7375b5 service nova] [instance: 85624c58-6c72-4490-8a3e-547953295ade] Received event network-vif-plugged-51ccc958-5ce8-4e1d-8d28-f10c5ac288bd {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:46:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-b175a70b-2c72-4923-b131-502ae242dc85 req-d1ab39e4-2020-406c-a866-16b65f7375b5 service nova] Acquiring lock "85624c58-6c72-4490-8a3e-547953295ade-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:46:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-b175a70b-2c72-4923-b131-502ae242dc85 req-d1ab39e4-2020-406c-a866-16b65f7375b5 service nova] Lock "85624c58-6c72-4490-8a3e-547953295ade-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:46:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-b175a70b-2c72-4923-b131-502ae242dc85 req-d1ab39e4-2020-406c-a866-16b65f7375b5 service nova] Lock "85624c58-6c72-4490-8a3e-547953295ade-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:46:47 user nova-compute[75216]: DEBUG nova.compute.manager [req-b175a70b-2c72-4923-b131-502ae242dc85 req-d1ab39e4-2020-406c-a866-16b65f7375b5 service nova] [instance: 85624c58-6c72-4490-8a3e-547953295ade] No waiting events found dispatching network-vif-plugged-51ccc958-5ce8-4e1d-8d28-f10c5ac288bd {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:46:47 user nova-compute[75216]: WARNING nova.compute.manager [req-b175a70b-2c72-4923-b131-502ae242dc85 req-d1ab39e4-2020-406c-a866-16b65f7375b5 service nova] [instance: 85624c58-6c72-4490-8a3e-547953295ade] Received unexpected event network-vif-plugged-51ccc958-5ce8-4e1d-8d28-f10c5ac288bd for instance with vm_state active and task_state rescuing.
Nov 13 18:46:47 user nova-compute[75216]: DEBUG nova.compute.manager [req-b175a70b-2c72-4923-b131-502ae242dc85 req-d1ab39e4-2020-406c-a866-16b65f7375b5 service nova] [instance: 9b078f75-57f2-495a-abd5-f8adf72db80b] Received event network-changed-96bda2a6-53d1-4052-9230-4907fe60d70b {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:46:47 user nova-compute[75216]: DEBUG nova.compute.manager [req-b175a70b-2c72-4923-b131-502ae242dc85 req-d1ab39e4-2020-406c-a866-16b65f7375b5 service nova] [instance: 9b078f75-57f2-495a-abd5-f8adf72db80b] Refreshing instance network info cache due to event network-changed-96bda2a6-53d1-4052-9230-4907fe60d70b. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 18:46:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-b175a70b-2c72-4923-b131-502ae242dc85 req-d1ab39e4-2020-406c-a866-16b65f7375b5 service nova] Acquiring lock "refresh_cache-9b078f75-57f2-495a-abd5-f8adf72db80b" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 18:46:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-b175a70b-2c72-4923-b131-502ae242dc85 req-d1ab39e4-2020-406c-a866-16b65f7375b5 service nova] Acquired lock "refresh_cache-9b078f75-57f2-495a-abd5-f8adf72db80b" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 18:46:47 user nova-compute[75216]: DEBUG nova.network.neutron [req-b175a70b-2c72-4923-b131-502ae242dc85 req-d1ab39e4-2020-406c-a866-16b65f7375b5 service nova] [instance: 9b078f75-57f2-495a-abd5-f8adf72db80b] Refreshing network info cache for port 96bda2a6-53d1-4052-9230-4907fe60d70b {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 18:46:47 user nova-compute[75216]: DEBUG nova.compute.manager [None req-e19e5e49-3c78-4f45-a4fd-2ccbeadc5cd8 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] [instance: 85624c58-6c72-4490-8a3e-547953295ade] Checking state {{(pid=75216) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 18:46:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c0abb425-6c3f-4aa4-b788-59868bc88697 tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] Acquiring lock "347acafc-985e-4fa2-b286-07ea3b2e4033" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:46:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c0abb425-6c3f-4aa4-b788-59868bc88697 tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] Lock "347acafc-985e-4fa2-b286-07ea3b2e4033" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:46:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c0abb425-6c3f-4aa4-b788-59868bc88697 tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] Acquiring lock "347acafc-985e-4fa2-b286-07ea3b2e4033-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:46:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c0abb425-6c3f-4aa4-b788-59868bc88697 tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] Lock "347acafc-985e-4fa2-b286-07ea3b2e4033-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:46:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c0abb425-6c3f-4aa4-b788-59868bc88697 tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] Lock "347acafc-985e-4fa2-b286-07ea3b2e4033-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:46:47 user nova-compute[75216]: INFO nova.compute.manager [None req-c0abb425-6c3f-4aa4-b788-59868bc88697 tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] [instance: 347acafc-985e-4fa2-b286-07ea3b2e4033] Terminating instance
Nov 13 18:46:47 user nova-compute[75216]: DEBUG nova.compute.manager [None req-c0abb425-6c3f-4aa4-b788-59868bc88697 tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] [instance: 347acafc-985e-4fa2-b286-07ea3b2e4033] Start destroying the instance on the hypervisor. {{(pid=75216) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 18:46:47 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 18:46:47 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 18:46:47 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Hypervisor/Node resource view: name=user free_ram=6670MB free_disk=25.726943969726562GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75216) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 18:46:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:46:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:46:47 user nova-compute[75216]: DEBUG nova.compute.manager [None req-202ca1c2-84c5-44d7-a824-4089a883793b tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] [instance: 9b078f75-57f2-495a-abd5-f8adf72db80b] Checking state {{(pid=75216) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 18:46:47 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:47 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:47 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:47 user nova-compute[75216]: INFO nova.compute.manager [None req-202ca1c2-84c5-44d7-a824-4089a883793b tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] [instance: 9b078f75-57f2-495a-abd5-f8adf72db80b] instance snapshotting
Nov 13 18:46:47 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:47 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:47 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-202ca1c2-84c5-44d7-a824-4089a883793b tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] [instance: 9b078f75-57f2-495a-abd5-f8adf72db80b] Beginning live snapshot process
Nov 13 18:46:47 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance a1a3e849-6570-4820-97c8-75468b5bea4f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 18:46:47 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance 347acafc-985e-4fa2-b286-07ea3b2e4033 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 18:46:47 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance d589d57e-de50-482a-843f-e8246b3d7528 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 18:46:47 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance 85624c58-6c72-4490-8a3e-547953295ade actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 18:46:47 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance 9b078f75-57f2-495a-abd5-f8adf72db80b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 18:46:47 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance 83fda249-9d28-4cc2-aeb0-103ce4f1faa4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 18:46:47 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance 872856e5-cdc4-444e-8835-55e36708d776 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 18:46:47 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance 576e97b7-285a-451f-a80d-aaa321a79d3b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 18:46:47 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance 3274203b-a985-4f28-9b45-3f83509ae782 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 18:46:47 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance 78605259-17bf-47da-86de-3c76ac1c5bfa actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 18:46:47 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance 30ca36a3-ac49-44e4-a804-8940f7ef25b8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 18:46:47 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance a3bcf65e-bd5b-4350-a222-5f4522418a67 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 18:46:47 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 18:46:47 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 18:46:47 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-202ca1c2-84c5-44d7-a824-4089a883793b tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b078f75-57f2-495a-abd5-f8adf72db80b/disk --force-share --output=json -f qcow2 {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:46:47 user nova-compute[75216]: DEBUG nova.compute.manager [req-496adc8d-d44c-408c-a5de-7b903d9afa1c req-0d153ed9-1ec2-4bd4-b128-f24fa1725472 service nova] [instance: 347acafc-985e-4fa2-b286-07ea3b2e4033] Received event network-vif-unplugged-b7cb649d-2a7c-4b50-9844-8a96f99b5b11 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:46:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-496adc8d-d44c-408c-a5de-7b903d9afa1c req-0d153ed9-1ec2-4bd4-b128-f24fa1725472 service nova] Acquiring lock "347acafc-985e-4fa2-b286-07ea3b2e4033-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:46:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-496adc8d-d44c-408c-a5de-7b903d9afa1c req-0d153ed9-1ec2-4bd4-b128-f24fa1725472 service nova] Lock "347acafc-985e-4fa2-b286-07ea3b2e4033-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:46:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-496adc8d-d44c-408c-a5de-7b903d9afa1c req-0d153ed9-1ec2-4bd4-b128-f24fa1725472 service nova] Lock "347acafc-985e-4fa2-b286-07ea3b2e4033-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:46:47 user nova-compute[75216]: DEBUG nova.compute.manager [req-496adc8d-d44c-408c-a5de-7b903d9afa1c req-0d153ed9-1ec2-4bd4-b128-f24fa1725472 service nova] [instance: 347acafc-985e-4fa2-b286-07ea3b2e4033] No waiting events found dispatching network-vif-unplugged-b7cb649d-2a7c-4b50-9844-8a96f99b5b11 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:46:47 user nova-compute[75216]: DEBUG nova.compute.manager [req-496adc8d-d44c-408c-a5de-7b903d9afa1c req-0d153ed9-1ec2-4bd4-b128-f24fa1725472 service nova] [instance: 347acafc-985e-4fa2-b286-07ea3b2e4033] Received event network-vif-unplugged-b7cb649d-2a7c-4b50-9844-8a96f99b5b11 for instance with task_state deleting. {{(pid=75216) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 18:46:48 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-202ca1c2-84c5-44d7-a824-4089a883793b tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b078f75-57f2-495a-abd5-f8adf72db80b/disk --force-share --output=json -f qcow2" returned: 0 in 0.189s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:46:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-202ca1c2-84c5-44d7-a824-4089a883793b tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b078f75-57f2-495a-abd5-f8adf72db80b/disk --force-share --output=json -f qcow2 {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:46:48 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 18:46:48 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 18:46:48 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:48 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:48 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Compute_service record updated for user:user {{(pid=75216) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 18:46:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.810s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:46:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-202ca1c2-84c5-44d7-a824-4089a883793b tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b078f75-57f2-495a-abd5-f8adf72db80b/disk --force-share --output=json -f qcow2" returned: 0 in 0.195s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:46:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-202ca1c2-84c5-44d7-a824-4089a883793b tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:46:48 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 347acafc-985e-4fa2-b286-07ea3b2e4033] Instance destroyed successfully.
Nov 13 18:46:48 user nova-compute[75216]: DEBUG nova.objects.instance [None req-c0abb425-6c3f-4aa4-b788-59868bc88697 tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] Lazy-loading 'resources' on Instance uuid 347acafc-985e-4fa2-b286-07ea3b2e4033 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 18:46:48 user nova-compute[75216]: DEBUG nova.network.neutron [req-b175a70b-2c72-4923-b131-502ae242dc85 req-d1ab39e4-2020-406c-a866-16b65f7375b5 service nova] [instance: 9b078f75-57f2-495a-abd5-f8adf72db80b] Updated VIF entry in instance network info cache for port 96bda2a6-53d1-4052-9230-4907fe60d70b. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 18:46:48 user nova-compute[75216]: DEBUG nova.network.neutron [req-b175a70b-2c72-4923-b131-502ae242dc85 req-d1ab39e4-2020-406c-a866-16b65f7375b5 service nova] [instance: 9b078f75-57f2-495a-abd5-f8adf72db80b] Updating instance_info_cache with network_info: [{"id": "96bda2a6-53d1-4052-9230-4907fe60d70b", "address": "fa:16:3e:30:88:c4", "network": {"id": "eac74a7f-b8a0-4653-82a9-1113186e7682", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1781360101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e76353a038ca478598ddd984f4503e34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96bda2a6-53", "ovs_interfaceid": "96bda2a6-53d1-4052-9230-4907fe60d70b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 18:46:48 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-c0abb425-6c3f-4aa4-b788-59868bc88697 tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T18:44:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-930083321',display_name='tempest-DeleteServersTestJSON-server-930083321',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-930083321',id=2,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-13T18:45:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0588e8e737314d708edb0d3488e7e00a',ramdisk_id='',reservation_id='r-wj8v3ufv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-2025775619',owner_user_name='tempest-DeleteServersTestJSON-2025775619-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T18:45:04Z,user_data=None,user_id='878aab34a341495994029578e54a1060',uuid=347acafc-985e-4fa2-b286-07ea3b2e4033,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b7cb649d-2a7c-4b50-9844-8a96f99b5b11", "address": "fa:16:3e:d9:96:c6", "network": {"id": "69e4937e-3ba3-452c-ab80-f1a08296f50e", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-546345250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0588e8e737314d708edb0d3488e7e00a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7cb649d-2a", "ovs_interfaceid": "b7cb649d-2a7c-4b50-9844-8a96f99b5b11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 18:46:48 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-c0abb425-6c3f-4aa4-b788-59868bc88697 tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] Converting VIF {"id": "b7cb649d-2a7c-4b50-9844-8a96f99b5b11", "address": "fa:16:3e:d9:96:c6", "network": {"id": "69e4937e-3ba3-452c-ab80-f1a08296f50e", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-546345250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0588e8e737314d708edb0d3488e7e00a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7cb649d-2a", "ovs_interfaceid": "b7cb649d-2a7c-4b50-9844-8a96f99b5b11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 18:46:48 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-c0abb425-6c3f-4aa4-b788-59868bc88697 tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:96:c6,bridge_name='br-int',has_traffic_filtering=True,id=b7cb649d-2a7c-4b50-9844-8a96f99b5b11,network=Network(69e4937e-3ba3-452c-ab80-f1a08296f50e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7cb649d-2a') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 18:46:48 user nova-compute[75216]: DEBUG os_vif [None req-c0abb425-6c3f-4aa4-b788-59868bc88697 tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:96:c6,bridge_name='br-int',has_traffic_filtering=True,id=b7cb649d-2a7c-4b50-9844-8a96f99b5b11,network=Network(69e4937e-3ba3-452c-ab80-f1a08296f50e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7cb649d-2a') {{(pid=75216) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 18:46:48 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:48 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb7cb649d-2a, bridge=br-int, if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:46:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-b175a70b-2c72-4923-b131-502ae242dc85 req-d1ab39e4-2020-406c-a866-16b65f7375b5 service nova] Releasing lock "refresh_cache-9b078f75-57f2-495a-abd5-f8adf72db80b" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 18:46:48 user nova-compute[75216]: DEBUG nova.compute.manager [req-b175a70b-2c72-4923-b131-502ae242dc85 req-d1ab39e4-2020-406c-a866-16b65f7375b5 service nova] [instance: 85624c58-6c72-4490-8a3e-547953295ade] Received event network-vif-plugged-51ccc958-5ce8-4e1d-8d28-f10c5ac288bd {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:46:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-b175a70b-2c72-4923-b131-502ae242dc85 req-d1ab39e4-2020-406c-a866-16b65f7375b5 service nova] Acquiring lock "85624c58-6c72-4490-8a3e-547953295ade-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:46:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-b175a70b-2c72-4923-b131-502ae242dc85 req-d1ab39e4-2020-406c-a866-16b65f7375b5 service nova] Lock "85624c58-6c72-4490-8a3e-547953295ade-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:46:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-b175a70b-2c72-4923-b131-502ae242dc85 req-d1ab39e4-2020-406c-a866-16b65f7375b5 service nova] Lock "85624c58-6c72-4490-8a3e-547953295ade-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:46:48 user nova-compute[75216]: DEBUG nova.compute.manager [req-b175a70b-2c72-4923-b131-502ae242dc85 req-d1ab39e4-2020-406c-a866-16b65f7375b5 service nova] [instance: 85624c58-6c72-4490-8a3e-547953295ade] No waiting events found dispatching network-vif-plugged-51ccc958-5ce8-4e1d-8d28-f10c5ac288bd {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:46:48 user nova-compute[75216]: WARNING nova.compute.manager [req-b175a70b-2c72-4923-b131-502ae242dc85 req-d1ab39e4-2020-406c-a866-16b65f7375b5 service nova] [instance: 85624c58-6c72-4490-8a3e-547953295ade] Received unexpected event network-vif-plugged-51ccc958-5ce8-4e1d-8d28-f10c5ac288bd for instance with vm_state active and task_state rescuing.
Nov 13 18:46:48 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:48 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:46:48 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:48 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2b08b011-b4e5-4be8-9ac8-fef101bd4815) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:46:48 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:48 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:46:48 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:48 user nova-compute[75216]: INFO os_vif [None req-c0abb425-6c3f-4aa4-b788-59868bc88697 tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:96:c6,bridge_name='br-int',has_traffic_filtering=True,id=b7cb649d-2a7c-4b50-9844-8a96f99b5b11,network=Network(69e4937e-3ba3-452c-ab80-f1a08296f50e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7cb649d-2a')
Nov 13 18:46:48 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0abb425-6c3f-4aa4-b788-59868bc88697 tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] [instance: 347acafc-985e-4fa2-b286-07ea3b2e4033] calling os-brick to detach iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 18:46:48 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0abb425-6c3f-4aa4-b788-59868bc88697 tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3a8669e40>, {'target_iqn': 'iqn.2010-10.org.openstack:b3869a39-70d8-46c9-89a6-4cb8a2173cdd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ObLisENY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': True}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 18:46:48 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-c0abb425-6c3f-4aa4-b788-59868bc88697 tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 18:46:48 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-c0abb425-6c3f-4aa4-b788-59868bc88697 tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 18:46:48 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-c0abb425-6c3f-4aa4-b788-59868bc88697 tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 18:46:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:46:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:46:48 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[aae74eb2-94b7-41a2-ba96-797d0ae38b22]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2a1a5e82-4f70-4668-94bd-4a842d826214\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0fc393f0-1356-404f-a87b-bed1fb91b924\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b3869a39-70d8-46c9-89a6-4cb8a2173cdd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:de3d195d-b8b4-4c79-a150-813952c640e8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:52f4339a-6a47-4877-b041-9c27d7be2e94\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e823c6a1-f7e2-495f-a5dc-6fdfd2b19cf0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ba1efeb5-724e-4415-a5ed-12ce8c9489bc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:46:48 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0abb425-6c3f-4aa4-b788-59868bc88697 tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 18:46:48 user nova-compute[75216]: No targets found.
Nov 13 18:46:48 user nova-compute[75216]: iSNS:
Nov 13 18:46:48 user nova-compute[75216]: No targets found.
Nov 13 18:46:48 user nova-compute[75216]: STATIC:
Nov 13 18:46:48 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:2a1a5e82-4f70-4668-94bd-4a842d826214
Nov 13 18:46:48 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 18:46:48 user nova-compute[75216]:                 Iface Name: default
Nov 13 18:46:48 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:0fc393f0-1356-404f-a87b-bed1fb91b924
Nov 13 18:46:48 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 18:46:48 user nova-compute[75216]:                 Iface Name: default
Nov 13 18:46:48 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac
Nov 13 18:46:48 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 18:46:48 user nova-compute[75216]:                 Iface Name: default
Nov 13 18:46:48 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:b3869a39-70d8-46c9-89a6-4cb8a2173cdd
Nov 13 18:46:48 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 18:46:48 user nova-compute[75216]:                 Iface Name: default
Nov 13 18:46:48 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:de3d195d-b8b4-4c79-a150-813952c640e8
Nov 13 18:46:48 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 18:46:48 user nova-compute[75216]:                 Iface Name: default
Nov 13 18:46:48 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:52f4339a-6a47-4877-b041-9c27d7be2e94
Nov 13 18:46:48 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 18:46:48 user nova-compute[75216]:                 Iface Name: default
Nov 13 18:46:48 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:e823c6a1-f7e2-495f-a5dc-6fdfd2b19cf0
Nov 13 18:46:48 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 18:46:48 user nova-compute[75216]:                 Iface Name: default
Nov 13 18:46:48 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:ba1efeb5-724e-4415-a5ed-12ce8c9489bc
Nov 13 18:46:48 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 18:46:48 user nova-compute[75216]:                 Iface Name: default
Nov 13 18:46:48 user nova-compute[75216]: FIRMWARE:
Nov 13 18:46:48 user nova-compute[75216]: No targets found.
Nov 13 18:46:48 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 18:46:48 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0abb425-6c3f-4aa4-b788-59868bc88697 tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 18:46:48 user nova-compute[75216]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 18:46:48 user nova-compute[75216]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75216) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 18:46:48 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0abb425-6c3f-4aa4-b788-59868bc88697 tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b3869a39-70d8-46c9-89a6-4cb8a2173cdd', 0)] {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 18:46:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:46:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:46:48 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[735efc7e-cf00-418c-83ae-3d1b0d33a213]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0fc393f0-1356-404f-a87b-bed1fb91b924\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2a1a5e82-4f70-4668-94bd-4a842d826214\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:52f4339a-6a47-4877-b041-9c27d7be2e94\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b3869a39-70d8-46c9-89a6-4cb8a2173cdd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba1efeb5-724e-4415-a5ed-12ce8c9489bc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:de3d195d-b8b4-4c79-a150-813952c640e8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e823c6a1-f7e2-495f-a5dc-6fdfd2b19cf0\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:46:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:46:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-202ca1c2-84c5-44d7-a824-4089a883793b tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json" returned: 0 in 0.208s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:46:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-202ca1c2-84c5-44d7-a824-4089a883793b tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp2n9zd64v/d9cf2871078942e88ecbc4363fcbe5d4.delta 1073741824 {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:46:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:46:48 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[03a07833-4c8b-483c-b4df-376ac4f24995]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3869a39-70d8-46c9-89a6-4cb8a2173cdd (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba1efeb5-724e-4415-a5ed-12ce8c9489bc (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3d195d-b8b4-4c79-a150-813952c640e8 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fc393f0-1356-404f-a87b-bed1fb91b924 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a1a5e82-4f70-4668-94bd-4a842d826214 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e823c6a1-f7e2-495f-a5dc-6fdfd2b19cf0 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52f4339a-6a47-4877-b041-9c27d7be2e94 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac (non-flash)\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:46:48 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0abb425-6c3f-4aa4-b788-59868bc88697 tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3869a39-70d8-46c9-89a6-4cb8a2173cdd (non-flash)
Nov 13 18:46:48 user nova-compute[75216]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba1efeb5-724e-4415-a5ed-12ce8c9489bc (non-flash)
Nov 13 18:46:48 user nova-compute[75216]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3d195d-b8b4-4c79-a150-813952c640e8 (non-flash)
Nov 13 18:46:48 user nova-compute[75216]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fc393f0-1356-404f-a87b-bed1fb91b924 (non-flash)
Nov 13 18:46:48 user nova-compute[75216]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a1a5e82-4f70-4668-94bd-4a842d826214 (non-flash)
Nov 13 18:46:48 user nova-compute[75216]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e823c6a1-f7e2-495f-a5dc-6fdfd2b19cf0 (non-flash)
Nov 13 18:46:48 user nova-compute[75216]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52f4339a-6a47-4877-b041-9c27d7be2e94 (non-flash)
Nov 13 18:46:48 user nova-compute[75216]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac (non-flash)
Nov 13 18:46:48 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 18:46:48 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0abb425-6c3f-4aa4-b788-59868bc88697 tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3869a39-70d8-46c9-89a6-4cb8a2173cdd (non-flash)
Nov 13 18:46:48 user nova-compute[75216]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba1efeb5-724e-4415-a5ed-12ce8c9489bc (non-flash)
Nov 13 18:46:48 user nova-compute[75216]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3d195d-b8b4-4c79-a150-813952c640e8 (non-flash)
Nov 13 18:46:48 user nova-compute[75216]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fc393f0-1356-404f-a87b-bed1fb91b924 (non-flash)
Nov 13 18:46:48 user nova-compute[75216]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a1a5e82-4f70-4668-94bd-4a842d826214 (non-flash)
Nov 13 18:46:48 user nova-compute[75216]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e823c6a1-f7e2-495f-a5dc-6fdfd2b19cf0 (non-flash)
Nov 13 18:46:48 user nova-compute[75216]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52f4339a-6a47-4877-b041-9c27d7be2e94 (non-flash)
Nov 13 18:46:48 user nova-compute[75216]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac (non-flash)
Nov 13 18:46:48 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 18:46:48 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0abb425-6c3f-4aa4-b788-59868bc88697 tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe3c00ec5e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b3869a39-70d8-46c9-89a6-4cb8a2173cdd'): ({'sdi'}, set())}) {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 18:46:48 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-c0abb425-6c3f-4aa4-b788-59868bc88697 tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] Removing single pathed devices sdi {{(pid=75216) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 18:46:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-202ca1c2-84c5-44d7-a824-4089a883793b tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp2n9zd64v/d9cf2871078942e88ecbc4363fcbe5d4.delta 1073741824" returned: 0 in 0.055s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:46:48 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-202ca1c2-84c5-44d7-a824-4089a883793b tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] [instance: 9b078f75-57f2-495a-abd5-f8adf72db80b] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 13 18:46:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:46:48 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-202ca1c2-84c5-44d7-a824-4089a883793b tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] Checking UEFI support for host arch (x86_64) {{(pid=75216) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Nov 13 18:46:48 user nova-compute[75216]: INFO nova.virt.libvirt.host [None req-202ca1c2-84c5-44d7-a824-4089a883793b tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] UEFI support detected
Nov 13 18:46:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:46:48 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[c03fbe8d-e020-4e4d-b6b8-b84f5b918dbf]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:46:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:46:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.020s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:46:48 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[35f418db-da8d-42fe-82ce-8c81c4d6f3f7]: (4, ('ok\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:46:48 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-c0abb425-6c3f-4aa4-b788-59868bc88697 tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] Flushing IO for device /dev/sdi {{(pid=75216) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 18:46:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:46:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.012s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:46:48 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[d01829f6-63e8-44c6-ae5f-94eda45aeabf]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:46:48 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-c0abb425-6c3f-4aa4-b788-59868bc88697 tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=75216) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 18:46:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:46:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.031s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:46:48 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[71b8045d-75e6-4f56-acca-35db62c9ab20]: (4, ('1', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:46:48 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-c0abb425-6c3f-4aa4-b788-59868bc88697 tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 18:46:48 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-c0abb425-6c3f-4aa4-b788-59868bc88697 tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] SCSI volumes sdi have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 18:46:48 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0abb425-6c3f-4aa4-b788-59868bc88697 tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b3869a39-70d8-46c9-89a6-4cb8a2173cdd')] {{(pid=75216) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 18:46:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3869a39-70d8-46c9-89a6-4cb8a2173cdd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:46:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3869a39-70d8-46c9-89a6-4cb8a2173cdd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:46:48 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[aba6b876-ad38-4832-9f14-43acdd68c026]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:46:48 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0abb425-6c3f-4aa4-b788-59868bc88697 tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:46:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3869a39-70d8-46c9-89a6-4cb8a2173cdd -p 172.16.0.220:3260 --logout {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:46:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3869a39-70d8-46c9-89a6-4cb8a2173cdd -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:46:48 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6480197-0286-434a-91ef-adf23d60ba8f]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:b3869a39-70d8-46c9-89a6-4cb8a2173cdd, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:b3869a39-70d8-46c9-89a6-4cb8a2173cdd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:46:48 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0abb425-6c3f-4aa4-b788-59868bc88697 tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:b3869a39-70d8-46c9-89a6-4cb8a2173cdd, portal: 172.16.0.220,3260]
Nov 13 18:46:48 user nova-compute[75216]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:b3869a39-70d8-46c9-89a6-4cb8a2173cdd, portal: 172.16.0.220,3260] successful.
Nov 13 18:46:48 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:46:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3869a39-70d8-46c9-89a6-4cb8a2173cdd -p 172.16.0.220:3260 --op delete {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:46:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3869a39-70d8-46c9-89a6-4cb8a2173cdd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:46:48 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[056b519e-1b11-464a-a0e4-b66784462c87]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:46:48 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0abb425-6c3f-4aa4-b788-59868bc88697 tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:46:48 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-c0abb425-6c3f-4aa4-b788-59868bc88697 tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.369s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 18:46:48 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0abb425-6c3f-4aa4-b788-59868bc88697 tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] <== disconnect_volume: return (370ms) None {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 18:46:48 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0abb425-6c3f-4aa4-b788-59868bc88697 tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] [instance: 347acafc-985e-4fa2-b286-07ea3b2e4033] Disconnected iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 18:46:48 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-c0abb425-6c3f-4aa4-b788-59868bc88697 tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] [instance: 347acafc-985e-4fa2-b286-07ea3b2e4033] Deleting instance files /opt/stack/data/nova/instances/347acafc-985e-4fa2-b286-07ea3b2e4033_del
Nov 13 18:46:48 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-c0abb425-6c3f-4aa4-b788-59868bc88697 tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] [instance: 347acafc-985e-4fa2-b286-07ea3b2e4033] Deletion of /opt/stack/data/nova/instances/347acafc-985e-4fa2-b286-07ea3b2e4033_del complete
Nov 13 18:46:48 user nova-compute[75216]: INFO nova.compute.manager [None req-c0abb425-6c3f-4aa4-b788-59868bc88697 tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] [instance: 347acafc-985e-4fa2-b286-07ea3b2e4033] Took 1.40 seconds to destroy the instance on the hypervisor.
Nov 13 18:46:48 user nova-compute[75216]: DEBUG oslo.service.loopingcall [None req-c0abb425-6c3f-4aa4-b788-59868bc88697 tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75216) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 18:46:48 user nova-compute[75216]: DEBUG nova.compute.manager [-] [instance: 347acafc-985e-4fa2-b286-07ea3b2e4033] Deallocating network for instance {{(pid=75216) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 18:46:48 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: 347acafc-985e-4fa2-b286-07ea3b2e4033] deallocate_for_instance() {{(pid=75216) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 18:46:49 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:46:49 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Starting heal instance info cache {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 18:46:49 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: 347acafc-985e-4fa2-b286-07ea3b2e4033] Skipping network cache update for instance because it is being deleted. {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9971}}
Nov 13 18:46:49 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-202ca1c2-84c5-44d7-a824-4089a883793b tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75216) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 13 18:46:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "refresh_cache-d589d57e-de50-482a-843f-e8246b3d7528" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 18:46:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquired lock "refresh_cache-d589d57e-de50-482a-843f-e8246b3d7528" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 18:46:49 user nova-compute[75216]: DEBUG nova.network.neutron [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: d589d57e-de50-482a-843f-e8246b3d7528] Forcefully refreshing network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 18:46:49 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: 347acafc-985e-4fa2-b286-07ea3b2e4033] Updating instance_info_cache with network_info: [] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 18:46:49 user nova-compute[75216]: INFO nova.compute.manager [-] [instance: 347acafc-985e-4fa2-b286-07ea3b2e4033] Took 0.71 seconds to deallocate network for instance.
Nov 13 18:46:49 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-202ca1c2-84c5-44d7-a824-4089a883793b tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] COPY block job progress, current cursor: 25034752 final cursor: 75497472 {{(pid=75216) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 13 18:46:49 user nova-compute[75216]: DEBUG nova.compute.manager [req-212d65f8-443d-4645-b401-d0289cd8886f req-7bf100fb-6798-4c6f-b513-461cc158ac80 service nova] [instance: 347acafc-985e-4fa2-b286-07ea3b2e4033] Received event network-vif-plugged-b7cb649d-2a7c-4b50-9844-8a96f99b5b11 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:46:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-212d65f8-443d-4645-b401-d0289cd8886f req-7bf100fb-6798-4c6f-b513-461cc158ac80 service nova] Acquiring lock "347acafc-985e-4fa2-b286-07ea3b2e4033-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:46:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-212d65f8-443d-4645-b401-d0289cd8886f req-7bf100fb-6798-4c6f-b513-461cc158ac80 service nova] Lock "347acafc-985e-4fa2-b286-07ea3b2e4033-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:46:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-212d65f8-443d-4645-b401-d0289cd8886f req-7bf100fb-6798-4c6f-b513-461cc158ac80 service nova] Lock "347acafc-985e-4fa2-b286-07ea3b2e4033-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:46:49 user nova-compute[75216]: DEBUG nova.compute.manager [req-212d65f8-443d-4645-b401-d0289cd8886f req-7bf100fb-6798-4c6f-b513-461cc158ac80 service nova] [instance: 347acafc-985e-4fa2-b286-07ea3b2e4033] No waiting events found dispatching network-vif-plugged-b7cb649d-2a7c-4b50-9844-8a96f99b5b11 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:46:49 user nova-compute[75216]: WARNING nova.compute.manager [req-212d65f8-443d-4645-b401-d0289cd8886f req-7bf100fb-6798-4c6f-b513-461cc158ac80 service nova] [instance: 347acafc-985e-4fa2-b286-07ea3b2e4033] Received unexpected event network-vif-plugged-b7cb649d-2a7c-4b50-9844-8a96f99b5b11 for instance with vm_state active and task_state deleting.
Nov 13 18:46:49 user nova-compute[75216]: DEBUG nova.compute.manager [req-212d65f8-443d-4645-b401-d0289cd8886f req-7bf100fb-6798-4c6f-b513-461cc158ac80 service nova] [instance: 347acafc-985e-4fa2-b286-07ea3b2e4033] Received event network-vif-deleted-b7cb649d-2a7c-4b50-9844-8a96f99b5b11 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:46:50 user nova-compute[75216]: DEBUG nova.network.neutron [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: d589d57e-de50-482a-843f-e8246b3d7528] Updating instance_info_cache with network_info: [{"id": "87426a6f-0164-4df3-aad0-becbbbfe8310", "address": "fa:16:3e:64:4d:81", "network": {"id": "6d182db1-03b5-4d1b-86cf-b9367921b7b0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1877006951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2efafc26c47c4050bd367c47469999fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87426a6f-01", "ovs_interfaceid": "87426a6f-0164-4df3-aad0-becbbbfe8310", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 18:46:50 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Releasing lock "refresh_cache-d589d57e-de50-482a-843f-e8246b3d7528" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 18:46:50 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: d589d57e-de50-482a-843f-e8246b3d7528] Updated the network info_cache for instance {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 18:46:50 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:46:50 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-202ca1c2-84c5-44d7-a824-4089a883793b tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75216) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 13 18:46:50 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-202ca1c2-84c5-44d7-a824-4089a883793b tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] [instance: 9b078f75-57f2-495a-abd5-f8adf72db80b] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 13 18:46:50 user nova-compute[75216]: INFO nova.compute.manager [None req-c0abb425-6c3f-4aa4-b788-59868bc88697 tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] [instance: 347acafc-985e-4fa2-b286-07ea3b2e4033] Took 0.84 seconds to detach 1 volumes for instance.
Nov 13 18:46:50 user nova-compute[75216]: DEBUG nova.privsep.utils [None req-202ca1c2-84c5-44d7-a824-4089a883793b tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75216) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 13 18:46:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-202ca1c2-84c5-44d7-a824-4089a883793b tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp2n9zd64v/d9cf2871078942e88ecbc4363fcbe5d4.delta /opt/stack/data/nova/instances/snapshots/tmp2n9zd64v/d9cf2871078942e88ecbc4363fcbe5d4 {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:46:50 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c0abb425-6c3f-4aa4-b788-59868bc88697 tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:46:50 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c0abb425-6c3f-4aa4-b788-59868bc88697 tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:46:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-202ca1c2-84c5-44d7-a824-4089a883793b tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp2n9zd64v/d9cf2871078942e88ecbc4363fcbe5d4.delta /opt/stack/data/nova/instances/snapshots/tmp2n9zd64v/d9cf2871078942e88ecbc4363fcbe5d4" returned: 0 in 0.417s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:46:50 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-202ca1c2-84c5-44d7-a824-4089a883793b tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] [instance: 9b078f75-57f2-495a-abd5-f8adf72db80b] Snapshot extracted, beginning image upload
Nov 13 18:46:50 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-c0abb425-6c3f-4aa4-b788-59868bc88697 tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 18:46:50 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-c0abb425-6c3f-4aa4-b788-59868bc88697 tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 18:46:50 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c0abb425-6c3f-4aa4-b788-59868bc88697 tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.413s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:46:51 user nova-compute[75216]: INFO nova.scheduler.client.report [None req-c0abb425-6c3f-4aa4-b788-59868bc88697 tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] Deleted allocations for instance 347acafc-985e-4fa2-b286-07ea3b2e4033
Nov 13 18:46:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c0abb425-6c3f-4aa4-b788-59868bc88697 tempest-DeleteServersTestJSON-2025775619 tempest-DeleteServersTestJSON-2025775619-project-member] Lock "347acafc-985e-4fa2-b286-07ea3b2e4033" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.671s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:46:53 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:53 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:53 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-202ca1c2-84c5-44d7-a824-4089a883793b tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] [instance: 9b078f75-57f2-495a-abd5-f8adf72db80b] Snapshot image upload complete
Nov 13 18:46:53 user nova-compute[75216]: INFO nova.compute.manager [None req-202ca1c2-84c5-44d7-a824-4089a883793b tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] [instance: 9b078f75-57f2-495a-abd5-f8adf72db80b] Took 6.04 seconds to snapshot the instance on the hypervisor.
Nov 13 18:46:58 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:46:58 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:47:03 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:47:03 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:47:04 user nova-compute[75216]: DEBUG nova.compute.manager [req-51fca85b-2acc-4796-a9a0-29a128387896 req-7457c10d-9762-462f-a254-da3afa41bc5a service nova] [instance: 83fda249-9d28-4cc2-aeb0-103ce4f1faa4] Received event network-changed-001a2459-5886-44be-aeb3-b2fb4ab71926 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:47:04 user nova-compute[75216]: DEBUG nova.compute.manager [req-51fca85b-2acc-4796-a9a0-29a128387896 req-7457c10d-9762-462f-a254-da3afa41bc5a service nova] [instance: 83fda249-9d28-4cc2-aeb0-103ce4f1faa4] Refreshing instance network info cache due to event network-changed-001a2459-5886-44be-aeb3-b2fb4ab71926. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 18:47:04 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-51fca85b-2acc-4796-a9a0-29a128387896 req-7457c10d-9762-462f-a254-da3afa41bc5a service nova] Acquiring lock "refresh_cache-83fda249-9d28-4cc2-aeb0-103ce4f1faa4" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 18:47:04 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-51fca85b-2acc-4796-a9a0-29a128387896 req-7457c10d-9762-462f-a254-da3afa41bc5a service nova] Acquired lock "refresh_cache-83fda249-9d28-4cc2-aeb0-103ce4f1faa4" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 18:47:04 user nova-compute[75216]: DEBUG nova.network.neutron [req-51fca85b-2acc-4796-a9a0-29a128387896 req-7457c10d-9762-462f-a254-da3afa41bc5a service nova] [instance: 83fda249-9d28-4cc2-aeb0-103ce4f1faa4] Refreshing network info cache for port 001a2459-5886-44be-aeb3-b2fb4ab71926 {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 18:47:04 user nova-compute[75216]: DEBUG nova.network.neutron [req-51fca85b-2acc-4796-a9a0-29a128387896 req-7457c10d-9762-462f-a254-da3afa41bc5a service nova] [instance: 83fda249-9d28-4cc2-aeb0-103ce4f1faa4] Updated VIF entry in instance network info cache for port 001a2459-5886-44be-aeb3-b2fb4ab71926. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 18:47:04 user nova-compute[75216]: DEBUG nova.network.neutron [req-51fca85b-2acc-4796-a9a0-29a128387896 req-7457c10d-9762-462f-a254-da3afa41bc5a service nova] [instance: 83fda249-9d28-4cc2-aeb0-103ce4f1faa4] Updating instance_info_cache with network_info: [{"id": "001a2459-5886-44be-aeb3-b2fb4ab71926", "address": "fa:16:3e:ea:a2:8e", "network": {"id": "3e05e26f-bb3f-48d7-a8cf-8974b02b1745", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-600263470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d63d01c37774af48f4d3e49901802f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap001a2459-58", "ovs_interfaceid": "001a2459-5886-44be-aeb3-b2fb4ab71926", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 18:47:04 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-51fca85b-2acc-4796-a9a0-29a128387896 req-7457c10d-9762-462f-a254-da3afa41bc5a service nova] Releasing lock "refresh_cache-83fda249-9d28-4cc2-aeb0-103ce4f1faa4" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 18:47:05 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-057b1ae8-0a00-4f77-b2bb-bfc45b9d7d1e tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] Acquiring lock "83fda249-9d28-4cc2-aeb0-103ce4f1faa4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:47:05 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-057b1ae8-0a00-4f77-b2bb-bfc45b9d7d1e tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] Lock "83fda249-9d28-4cc2-aeb0-103ce4f1faa4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:47:05 user nova-compute[75216]: DEBUG nova.objects.instance [None req-057b1ae8-0a00-4f77-b2bb-bfc45b9d7d1e tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] Lazy-loading 'flavor' on Instance uuid 83fda249-9d28-4cc2-aeb0-103ce4f1faa4 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 18:47:05 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-057b1ae8-0a00-4f77-b2bb-bfc45b9d7d1e tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] Lock "83fda249-9d28-4cc2-aeb0-103ce4f1faa4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.074s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:47:06 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-057b1ae8-0a00-4f77-b2bb-bfc45b9d7d1e tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] Acquiring lock "83fda249-9d28-4cc2-aeb0-103ce4f1faa4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:47:06 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-057b1ae8-0a00-4f77-b2bb-bfc45b9d7d1e tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] Lock "83fda249-9d28-4cc2-aeb0-103ce4f1faa4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:47:06 user nova-compute[75216]: INFO nova.compute.manager [None req-057b1ae8-0a00-4f77-b2bb-bfc45b9d7d1e tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] [instance: 83fda249-9d28-4cc2-aeb0-103ce4f1faa4] Attaching volume aafa167c-c8ba-4509-88dc-33b3a07e940a to /dev/vdb
Nov 13 18:47:06 user nova-compute[75216]: DEBUG os_brick.utils [None req-057b1ae8-0a00-4f77-b2bb-bfc45b9d7d1e tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 18:47:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:06 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[977396ca-8fa4-489f-a792-cb26b9ffc458]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aea6fcfe14b9\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:06 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[79a6195d-d898-43b0-8a6b-753efd370c5c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:06 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[609310ef-3479-44d1-8c68-cdf6da4fbba4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:06 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1122cb6-f3fe-4bdb-aa0c-9a4c52c9358b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-057b1ae8-0a00-4f77-b2bb-bfc45b9d7d1e tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] Running cmd (subprocess): nvme version {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-057b1ae8-0a00-4f77-b2bb-bfc45b9d7d1e tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] 'nvme version' failed. Not Retrying. {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 18:47:06 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.nvmeof [None req-057b1ae8-0a00-4f77-b2bb-bfc45b9d7d1e tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] nvme not present on system {{(pid=75216) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 18:47:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 18:47:06 user nova-compute[75216]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 18:47:06 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[3450f0d3-79e8-41d5-bce8-8e0f69944338]: (4, '') {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:06 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-057b1ae8-0a00-4f77-b2bb-bfc45b9d7d1e tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75216) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 18:47:06 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-057b1ae8-0a00-4f77-b2bb-bfc45b9d7d1e tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 18:47:06 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-057b1ae8-0a00-4f77-b2bb-bfc45b9d7d1e tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] LIGHTOS: no hostnqn found. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 18:47:06 user nova-compute[75216]: DEBUG os_brick.utils [None req-057b1ae8-0a00-4f77-b2bb-bfc45b9d7d1e tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] <== get_connector_properties: return (111ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aea6fcfe14b9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 18:47:06 user nova-compute[75216]: DEBUG nova.virt.block_device [None req-057b1ae8-0a00-4f77-b2bb-bfc45b9d7d1e tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] [instance: 83fda249-9d28-4cc2-aeb0-103ce4f1faa4] Updating existing volume attachment record: f4142c01-2f0f-4837-982a-30fb637221ba {{(pid=75216) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 18:47:07 user nova-compute[75216]: DEBUG nova.compute.manager [req-f1bef734-34c8-4370-8030-1400f48fe957 req-0c3a6ba0-92f2-433d-b256-081e98cce017 service nova] [instance: 872856e5-cdc4-444e-8835-55e36708d776] Received event network-changed-296cb77a-c087-4484-adf2-7fd703942e0d {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:47:07 user nova-compute[75216]: DEBUG nova.compute.manager [req-f1bef734-34c8-4370-8030-1400f48fe957 req-0c3a6ba0-92f2-433d-b256-081e98cce017 service nova] [instance: 872856e5-cdc4-444e-8835-55e36708d776] Refreshing instance network info cache due to event network-changed-296cb77a-c087-4484-adf2-7fd703942e0d. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 18:47:07 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-f1bef734-34c8-4370-8030-1400f48fe957 req-0c3a6ba0-92f2-433d-b256-081e98cce017 service nova] Acquiring lock "refresh_cache-872856e5-cdc4-444e-8835-55e36708d776" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 18:47:07 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-f1bef734-34c8-4370-8030-1400f48fe957 req-0c3a6ba0-92f2-433d-b256-081e98cce017 service nova] Acquired lock "refresh_cache-872856e5-cdc4-444e-8835-55e36708d776" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 18:47:07 user nova-compute[75216]: DEBUG nova.network.neutron [req-f1bef734-34c8-4370-8030-1400f48fe957 req-0c3a6ba0-92f2-433d-b256-081e98cce017 service nova] [instance: 872856e5-cdc4-444e-8835-55e36708d776] Refreshing network info cache for port 296cb77a-c087-4484-adf2-7fd703942e0d {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 18:47:07 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c496a636-f826-4f6b-972e-d0973e5fbbb3 tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] Acquiring lock "872856e5-cdc4-444e-8835-55e36708d776" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:47:07 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c496a636-f826-4f6b-972e-d0973e5fbbb3 tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] Lock "872856e5-cdc4-444e-8835-55e36708d776" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:47:07 user nova-compute[75216]: DEBUG nova.objects.instance [None req-c496a636-f826-4f6b-972e-d0973e5fbbb3 tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] Lazy-loading 'flavor' on Instance uuid 872856e5-cdc4-444e-8835-55e36708d776 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 18:47:07 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c496a636-f826-4f6b-972e-d0973e5fbbb3 tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] Lock "872856e5-cdc4-444e-8835-55e36708d776" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.087s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:47:07 user nova-compute[75216]: DEBUG nova.network.neutron [req-f1bef734-34c8-4370-8030-1400f48fe957 req-0c3a6ba0-92f2-433d-b256-081e98cce017 service nova] [instance: 872856e5-cdc4-444e-8835-55e36708d776] Updated VIF entry in instance network info cache for port 296cb77a-c087-4484-adf2-7fd703942e0d. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 18:47:07 user nova-compute[75216]: DEBUG nova.network.neutron [req-f1bef734-34c8-4370-8030-1400f48fe957 req-0c3a6ba0-92f2-433d-b256-081e98cce017 service nova] [instance: 872856e5-cdc4-444e-8835-55e36708d776] Updating instance_info_cache with network_info: [{"id": "296cb77a-c087-4484-adf2-7fd703942e0d", "address": "fa:16:3e:86:fe:e9", "network": {"id": "14e06b65-d8b1-43d1-a1f3-03e6c82ecc39", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2042637446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "462d302bb02243f89ec881369fcf7301", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap296cb77a-c0", "ovs_interfaceid": "296cb77a-c087-4484-adf2-7fd703942e0d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 18:47:07 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-f1bef734-34c8-4370-8030-1400f48fe957 req-0c3a6ba0-92f2-433d-b256-081e98cce017 service nova] Releasing lock "refresh_cache-872856e5-cdc4-444e-8835-55e36708d776" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 18:47:07 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c496a636-f826-4f6b-972e-d0973e5fbbb3 tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] Acquiring lock "872856e5-cdc4-444e-8835-55e36708d776" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:47:07 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c496a636-f826-4f6b-972e-d0973e5fbbb3 tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] Lock "872856e5-cdc4-444e-8835-55e36708d776" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:47:07 user nova-compute[75216]: INFO nova.compute.manager [None req-c496a636-f826-4f6b-972e-d0973e5fbbb3 tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] [instance: 872856e5-cdc4-444e-8835-55e36708d776] Attaching volume f530e526-b4b9-405c-8bde-111e34095cc4 to /dev/vdb
Nov 13 18:47:07 user nova-compute[75216]: DEBUG os_brick.utils [None req-c496a636-f826-4f6b-972e-d0973e5fbbb3 tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 18:47:07 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:07 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:07 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[54c39abb-bf98-4460-a111-a2dafd0f99c8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aea6fcfe14b9\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:07 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:07 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:07 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7406afc-3fc6-4279-be6e-5ef713dadd3d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:07 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:07 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.013s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:07 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1c26e7d-e2bd-4e9d-a66c-415f16c60cdc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:07 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c17f6a3-59f6-4005-8803-032bc56c704b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:07 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-c496a636-f826-4f6b-972e-d0973e5fbbb3 tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] Running cmd (subprocess): nvme version {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:07 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-c496a636-f826-4f6b-972e-d0973e5fbbb3 tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] 'nvme version' failed. Not Retrying. {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 18:47:07 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c496a636-f826-4f6b-972e-d0973e5fbbb3 tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] nvme not present on system {{(pid=75216) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 18:47:07 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:07 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 18:47:07 user nova-compute[75216]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 18:47:07 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[92dd084b-6c9f-4d75-8223-184acbadd2e5]: (4, '') {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:07 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-c496a636-f826-4f6b-972e-d0973e5fbbb3 tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75216) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 18:47:07 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-c496a636-f826-4f6b-972e-d0973e5fbbb3 tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 18:47:07 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-c496a636-f826-4f6b-972e-d0973e5fbbb3 tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] LIGHTOS: no hostnqn found. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 18:47:07 user nova-compute[75216]: DEBUG os_brick.utils [None req-c496a636-f826-4f6b-972e-d0973e5fbbb3 tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aea6fcfe14b9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 18:47:07 user nova-compute[75216]: DEBUG nova.virt.block_device [None req-c496a636-f826-4f6b-972e-d0973e5fbbb3 tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] [instance: 872856e5-cdc4-444e-8835-55e36708d776] Updating existing volume attachment record: 09de973e-cbc7-4014-a63f-f72e67065dbe {{(pid=75216) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 18:47:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:47:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:47:10 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-057b1ae8-0a00-4f77-b2bb-bfc45b9d7d1e tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] [instance: 83fda249-9d28-4cc2-aeb0-103ce4f1faa4] Calling os-brick to attach iSCSI Volume {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 18:47:10 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-057b1ae8-0a00-4f77-b2bb-bfc45b9d7d1e tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3a8669e40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:aafa167c-c8ba-4509-88dc-33b3a07e940a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EdrGSLqo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 18:47:10 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-057b1ae8-0a00-4f77-b2bb-bfc45b9d7d1e tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 18:47:10 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-057b1ae8-0a00-4f77-b2bb-bfc45b9d7d1e tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 18:47:10 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-057b1ae8-0a00-4f77-b2bb-bfc45b9d7d1e tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 18:47:10 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-057b1ae8-0a00-4f77-b2bb-bfc45b9d7d1e tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 18:47:10 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-057b1ae8-0a00-4f77-b2bb-bfc45b9d7d1e tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aafa167c-c8ba-4509-88dc-33b3a07e940a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 18:47:10 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-057b1ae8-0a00-4f77-b2bb-bfc45b9d7d1e tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aafa167c-c8ba-4509-88dc-33b3a07e940a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 18:47:10 user nova-compute[75216]: INFO os_brick.initiator.connectors.iscsi [None req-057b1ae8-0a00-4f77-b2bb-bfc45b9d7d1e tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 18:47:10 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aafa167c-c8ba-4509-88dc-33b3a07e940a -p 172.16.0.220:3260 {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:10 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aafa167c-c8ba-4509-88dc-33b3a07e940a -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:10 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b96a73e-54ec-4ae4-b728-1f19ce3c9f76]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:10 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-057b1ae8-0a00-4f77-b2bb-bfc45b9d7d1e tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 18:47:10 user nova-compute[75216]:  {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:47:10 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aafa167c-c8ba-4509-88dc-33b3a07e940a -p 172.16.0.220:3260 --interface default --op new {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:10 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aafa167c-c8ba-4509-88dc-33b3a07e940a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:10 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2040cac-1cb6-40e1-bd5f-e6366a484db3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aafa167c-c8ba-4509-88dc-33b3a07e940a] added\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:10 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-057b1ae8-0a00-4f77-b2bb-bfc45b9d7d1e tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aafa167c-c8ba-4509-88dc-33b3a07e940a] added
Nov 13 18:47:10 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:47:10 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aafa167c-c8ba-4509-88dc-33b3a07e940a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:10 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aafa167c-c8ba-4509-88dc-33b3a07e940a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:10 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[1121dccf-9408-44ac-8524-d5e4e56272b9]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:10 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-057b1ae8-0a00-4f77-b2bb-bfc45b9d7d1e tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:47:10 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aafa167c-c8ba-4509-88dc-33b3a07e940a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:10 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aafa167c-c8ba-4509-88dc-33b3a07e940a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:10 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[18e084d5-dfab-417f-8bef-fe72a003a7f9]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:10 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-057b1ae8-0a00-4f77-b2bb-bfc45b9d7d1e tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:47:10 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aafa167c-c8ba-4509-88dc-33b3a07e940a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EdrGSLqo {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:10 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aafa167c-c8ba-4509-88dc-33b3a07e940a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EdrGSLqo" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:10 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[550c6633-d918-4256-9883-979c014bcd74]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:10 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-057b1ae8-0a00-4f77-b2bb-bfc45b9d7d1e tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EdrGSLqo'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:47:10 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aafa167c-c8ba-4509-88dc-33b3a07e940a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:10 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aafa167c-c8ba-4509-88dc-33b3a07e940a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:10 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b879d81-4588-4183-889e-33446917a9a9]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:10 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-057b1ae8-0a00-4f77-b2bb-bfc45b9d7d1e tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:47:10 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:10 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:10 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[23e7382a-9d38-4da9-9a9d-c8417363f8bb]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba1efeb5-724e-4415-a5ed-12ce8c9489bc (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3d195d-b8b4-4c79-a150-813952c640e8 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fc393f0-1356-404f-a87b-bed1fb91b924 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a1a5e82-4f70-4668-94bd-4a842d826214 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e823c6a1-f7e2-495f-a5dc-6fdfd2b19cf0 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52f4339a-6a47-4877-b041-9c27d7be2e94 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac (non-flash)\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:10 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-057b1ae8-0a00-4f77-b2bb-bfc45b9d7d1e tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba1efeb5-724e-4415-a5ed-12ce8c9489bc (non-flash)
Nov 13 18:47:10 user nova-compute[75216]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3d195d-b8b4-4c79-a150-813952c640e8 (non-flash)
Nov 13 18:47:10 user nova-compute[75216]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fc393f0-1356-404f-a87b-bed1fb91b924 (non-flash)
Nov 13 18:47:10 user nova-compute[75216]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a1a5e82-4f70-4668-94bd-4a842d826214 (non-flash)
Nov 13 18:47:10 user nova-compute[75216]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e823c6a1-f7e2-495f-a5dc-6fdfd2b19cf0 (non-flash)
Nov 13 18:47:10 user nova-compute[75216]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52f4339a-6a47-4877-b041-9c27d7be2e94 (non-flash)
Nov 13 18:47:10 user nova-compute[75216]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac (non-flash)
Nov 13 18:47:10 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 18:47:10 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-057b1ae8-0a00-4f77-b2bb-bfc45b9d7d1e tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba1efeb5-724e-4415-a5ed-12ce8c9489bc (non-flash)
Nov 13 18:47:10 user nova-compute[75216]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3d195d-b8b4-4c79-a150-813952c640e8 (non-flash)
Nov 13 18:47:10 user nova-compute[75216]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fc393f0-1356-404f-a87b-bed1fb91b924 (non-flash)
Nov 13 18:47:10 user nova-compute[75216]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a1a5e82-4f70-4668-94bd-4a842d826214 (non-flash)
Nov 13 18:47:10 user nova-compute[75216]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e823c6a1-f7e2-495f-a5dc-6fdfd2b19cf0 (non-flash)
Nov 13 18:47:10 user nova-compute[75216]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52f4339a-6a47-4877-b041-9c27d7be2e94 (non-flash)
Nov 13 18:47:10 user nova-compute[75216]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac (non-flash)
Nov 13 18:47:10 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 18:47:10 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aafa167c-c8ba-4509-88dc-33b3a07e940a -p 172.16.0.220:3260 --login {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:10 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aafa167c-c8ba-4509-88dc-33b3a07e940a -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:10 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a3e36d2-cf7c-4a88-ad10-c79a2d9b1da4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:aafa167c-c8ba-4509-88dc-33b3a07e940a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:aafa167c-c8ba-4509-88dc-33b3a07e940a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:10 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-057b1ae8-0a00-4f77-b2bb-bfc45b9d7d1e tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:aafa167c-c8ba-4509-88dc-33b3a07e940a, portal: 172.16.0.220,3260]
Nov 13 18:47:10 user nova-compute[75216]: Login to [iface: default, target: iqn.2010-10.org.openstack:aafa167c-c8ba-4509-88dc-33b3a07e940a, portal: 172.16.0.220,3260] successful.
Nov 13 18:47:10 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:47:10 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aafa167c-c8ba-4509-88dc-33b3a07e940a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:10 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aafa167c-c8ba-4509-88dc-33b3a07e940a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:10 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[00b81d09-f9c4-4217-980d-5ede921b0397]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:10 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-057b1ae8-0a00-4f77-b2bb-bfc45b9d7d1e tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:47:10 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:10 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:10 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[797421b5-395e-4038-b70a-d4d61ffc6abf]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aafa167c-c8ba-4509-88dc-33b3a07e940a (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba1efeb5-724e-4415-a5ed-12ce8c9489bc (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3d195d-b8b4-4c79-a150-813952c640e8 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fc393f0-1356-404f-a87b-bed1fb91b924 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a1a5e82-4f70-4668-94bd-4a842d826214 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e823c6a1-f7e2-495f-a5dc-6fdfd2b19cf0 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52f4339a-6a47-4877-b041-9c27d7be2e94 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac (non-flash)\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:10 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-057b1ae8-0a00-4f77-b2bb-bfc45b9d7d1e tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aafa167c-c8ba-4509-88dc-33b3a07e940a (non-flash)
Nov 13 18:47:10 user nova-compute[75216]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba1efeb5-724e-4415-a5ed-12ce8c9489bc (non-flash)
Nov 13 18:47:10 user nova-compute[75216]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3d195d-b8b4-4c79-a150-813952c640e8 (non-flash)
Nov 13 18:47:10 user nova-compute[75216]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fc393f0-1356-404f-a87b-bed1fb91b924 (non-flash)
Nov 13 18:47:10 user nova-compute[75216]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a1a5e82-4f70-4668-94bd-4a842d826214 (non-flash)
Nov 13 18:47:10 user nova-compute[75216]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e823c6a1-f7e2-495f-a5dc-6fdfd2b19cf0 (non-flash)
Nov 13 18:47:10 user nova-compute[75216]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52f4339a-6a47-4877-b041-9c27d7be2e94 (non-flash)
Nov 13 18:47:10 user nova-compute[75216]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac (non-flash)
Nov 13 18:47:10 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 18:47:10 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-057b1ae8-0a00-4f77-b2bb-bfc45b9d7d1e tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aafa167c-c8ba-4509-88dc-33b3a07e940a (non-flash)
Nov 13 18:47:10 user nova-compute[75216]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba1efeb5-724e-4415-a5ed-12ce8c9489bc (non-flash)
Nov 13 18:47:10 user nova-compute[75216]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3d195d-b8b4-4c79-a150-813952c640e8 (non-flash)
Nov 13 18:47:10 user nova-compute[75216]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fc393f0-1356-404f-a87b-bed1fb91b924 (non-flash)
Nov 13 18:47:10 user nova-compute[75216]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a1a5e82-4f70-4668-94bd-4a842d826214 (non-flash)
Nov 13 18:47:10 user nova-compute[75216]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e823c6a1-f7e2-495f-a5dc-6fdfd2b19cf0 (non-flash)
Nov 13 18:47:10 user nova-compute[75216]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52f4339a-6a47-4877-b041-9c27d7be2e94 (non-flash)
Nov 13 18:47:10 user nova-compute[75216]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac (non-flash)
Nov 13 18:47:10 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 18:47:10 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-057b1ae8-0a00-4f77-b2bb-bfc45b9d7d1e tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aafa167c-c8ba-4509-88dc-33b3a07e940a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.302s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 18:47:10 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-057b1ae8-0a00-4f77-b2bb-bfc45b9d7d1e tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] Connected to 172.16.0.220:3260 {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 18:47:10 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-057b1ae8-0a00-4f77-b2bb-bfc45b9d7d1e tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] HCTL ('40', '-', '-', 0) found on session 11 with lun 0 {{(pid=75216) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 18:47:10 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-057b1ae8-0a00-4f77-b2bb-bfc45b9d7d1e tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=75216) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 18:47:10 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:10 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.016s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:10 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[c14b4d78-73de-4d28-a72c-f3191edfa88e]: (4, ('- - 0', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:10 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-057b1ae8-0a00-4f77-b2bb-bfc45b9d7d1e tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] Searching for a device in session 11 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=75216) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 18:47:10 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-057b1ae8-0a00-4f77-b2bb-bfc45b9d7d1e tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:aafa167c-c8ba-4509-88dc-33b3a07e940a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EdrGSLqo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 18:47:11 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-057b1ae8-0a00-4f77-b2bb-bfc45b9d7d1e tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.342s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 18:47:11 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-057b1ae8-0a00-4f77-b2bb-bfc45b9d7d1e tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] <== connect_volume: return (1343ms) {'type': 'block', 'scsi_wwn': '23938653337373632', 'path': '/dev/sdi'} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 18:47:11 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-057b1ae8-0a00-4f77-b2bb-bfc45b9d7d1e tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] [instance: 83fda249-9d28-4cc2-aeb0-103ce4f1faa4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23938653337373632', 'path': '/dev/sdi'} {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 18:47:11 user nova-compute[75216]: DEBUG nova.objects.instance [None req-057b1ae8-0a00-4f77-b2bb-bfc45b9d7d1e tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] Lazy-loading 'flavor' on Instance uuid 83fda249-9d28-4cc2-aeb0-103ce4f1faa4 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 18:47:11 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-057b1ae8-0a00-4f77-b2bb-bfc45b9d7d1e tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] attach device xml: <disk type="block" device="disk">
Nov 13 18:47:11 user nova-compute[75216]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 18:47:11 user nova-compute[75216]:   <source dev="/dev/sdi"/>
Nov 13 18:47:11 user nova-compute[75216]:   <target dev="vdb" bus="virtio"/>
Nov 13 18:47:11 user nova-compute[75216]:   <serial>aafa167c-c8ba-4509-88dc-33b3a07e940a</serial>
Nov 13 18:47:11 user nova-compute[75216]: </disk>
Nov 13 18:47:11 user nova-compute[75216]:  {{(pid=75216) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 13 18:47:12 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c496a636-f826-4f6b-972e-d0973e5fbbb3 tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] [instance: 872856e5-cdc4-444e-8835-55e36708d776] Calling os-brick to attach iSCSI Volume {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 18:47:12 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-c496a636-f826-4f6b-972e-d0973e5fbbb3 tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3a8669e40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f530e526-b4b9-405c-8bde-111e34095cc4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ReFEXBsZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 18:47:12 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-c496a636-f826-4f6b-972e-d0973e5fbbb3 tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 18:47:12 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-c496a636-f826-4f6b-972e-d0973e5fbbb3 tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 18:47:12 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-c496a636-f826-4f6b-972e-d0973e5fbbb3 tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 18:47:12 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-c496a636-f826-4f6b-972e-d0973e5fbbb3 tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 18:47:12 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-c496a636-f826-4f6b-972e-d0973e5fbbb3 tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f530e526-b4b9-405c-8bde-111e34095cc4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 18:47:12 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-c496a636-f826-4f6b-972e-d0973e5fbbb3 tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f530e526-b4b9-405c-8bde-111e34095cc4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 18:47:12 user nova-compute[75216]: INFO os_brick.initiator.connectors.iscsi [None req-c496a636-f826-4f6b-972e-d0973e5fbbb3 tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 18:47:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f530e526-b4b9-405c-8bde-111e34095cc4 -p 172.16.0.220:3260 {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f530e526-b4b9-405c-8bde-111e34095cc4 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:12 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[847223f6-bae5-4b19-9eac-ce26b755894e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:12 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-c496a636-f826-4f6b-972e-d0973e5fbbb3 tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 18:47:12 user nova-compute[75216]:  {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:47:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f530e526-b4b9-405c-8bde-111e34095cc4 -p 172.16.0.220:3260 --interface default --op new {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f530e526-b4b9-405c-8bde-111e34095cc4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:12 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[60ca3c59-b2e3-4fae-b9fb-64a400d57db9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f530e526-b4b9-405c-8bde-111e34095cc4] added\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:12 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-c496a636-f826-4f6b-972e-d0973e5fbbb3 tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f530e526-b4b9-405c-8bde-111e34095cc4] added
Nov 13 18:47:12 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:47:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f530e526-b4b9-405c-8bde-111e34095cc4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f530e526-b4b9-405c-8bde-111e34095cc4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:12 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[663ec58c-a199-447a-bef4-e7cdb1ec1363]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:12 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-c496a636-f826-4f6b-972e-d0973e5fbbb3 tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:47:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f530e526-b4b9-405c-8bde-111e34095cc4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f530e526-b4b9-405c-8bde-111e34095cc4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:12 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2ab5feb-09e2-4d12-a8df-06020ca5a83f]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:12 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-c496a636-f826-4f6b-972e-d0973e5fbbb3 tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:47:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f530e526-b4b9-405c-8bde-111e34095cc4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ReFEXBsZ {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:12 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-057b1ae8-0a00-4f77-b2bb-bfc45b9d7d1e tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 18:47:12 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-057b1ae8-0a00-4f77-b2bb-bfc45b9d7d1e tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 18:47:12 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-057b1ae8-0a00-4f77-b2bb-bfc45b9d7d1e tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] No VIF found with MAC fa:16:3e:ea:a2:8e, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 18:47:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f530e526-b4b9-405c-8bde-111e34095cc4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ReFEXBsZ" returned: 0 in 0.020s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:12 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dae9d57-13fa-4450-934c-1ce7a5df14de]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:12 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-c496a636-f826-4f6b-972e-d0973e5fbbb3 tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ReFEXBsZ'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:47:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f530e526-b4b9-405c-8bde-111e34095cc4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f530e526-b4b9-405c-8bde-111e34095cc4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:12 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3323b0b-cdc4-43b5-9e9b-bf7ab39c6af9]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:12 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-c496a636-f826-4f6b-972e-d0973e5fbbb3 tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:47:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:12 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[2805bafc-9193-4daf-bc06-c10eba75e639]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aafa167c-c8ba-4509-88dc-33b3a07e940a (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba1efeb5-724e-4415-a5ed-12ce8c9489bc (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3d195d-b8b4-4c79-a150-813952c640e8 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fc393f0-1356-404f-a87b-bed1fb91b924 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a1a5e82-4f70-4668-94bd-4a842d826214 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e823c6a1-f7e2-495f-a5dc-6fdfd2b19cf0 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52f4339a-6a47-4877-b041-9c27d7be2e94 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac (non-flash)\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:12 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-c496a636-f826-4f6b-972e-d0973e5fbbb3 tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aafa167c-c8ba-4509-88dc-33b3a07e940a (non-flash)
Nov 13 18:47:12 user nova-compute[75216]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba1efeb5-724e-4415-a5ed-12ce8c9489bc (non-flash)
Nov 13 18:47:12 user nova-compute[75216]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3d195d-b8b4-4c79-a150-813952c640e8 (non-flash)
Nov 13 18:47:12 user nova-compute[75216]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fc393f0-1356-404f-a87b-bed1fb91b924 (non-flash)
Nov 13 18:47:12 user nova-compute[75216]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a1a5e82-4f70-4668-94bd-4a842d826214 (non-flash)
Nov 13 18:47:12 user nova-compute[75216]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e823c6a1-f7e2-495f-a5dc-6fdfd2b19cf0 (non-flash)
Nov 13 18:47:12 user nova-compute[75216]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52f4339a-6a47-4877-b041-9c27d7be2e94 (non-flash)
Nov 13 18:47:12 user nova-compute[75216]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac (non-flash)
Nov 13 18:47:12 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 18:47:12 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-c496a636-f826-4f6b-972e-d0973e5fbbb3 tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aafa167c-c8ba-4509-88dc-33b3a07e940a (non-flash)
Nov 13 18:47:12 user nova-compute[75216]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba1efeb5-724e-4415-a5ed-12ce8c9489bc (non-flash)
Nov 13 18:47:12 user nova-compute[75216]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3d195d-b8b4-4c79-a150-813952c640e8 (non-flash)
Nov 13 18:47:12 user nova-compute[75216]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fc393f0-1356-404f-a87b-bed1fb91b924 (non-flash)
Nov 13 18:47:12 user nova-compute[75216]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a1a5e82-4f70-4668-94bd-4a842d826214 (non-flash)
Nov 13 18:47:12 user nova-compute[75216]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e823c6a1-f7e2-495f-a5dc-6fdfd2b19cf0 (non-flash)
Nov 13 18:47:12 user nova-compute[75216]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52f4339a-6a47-4877-b041-9c27d7be2e94 (non-flash)
Nov 13 18:47:12 user nova-compute[75216]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac (non-flash)
Nov 13 18:47:12 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 18:47:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f530e526-b4b9-405c-8bde-111e34095cc4 -p 172.16.0.220:3260 --login {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:12 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-057b1ae8-0a00-4f77-b2bb-bfc45b9d7d1e tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] Lock "83fda249-9d28-4cc2-aeb0-103ce4f1faa4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.322s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:47:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f530e526-b4b9-405c-8bde-111e34095cc4 -p 172.16.0.220:3260 --login" returned: 0 in 0.102s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:12 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[adc770e4-9e41-4983-9356-fc5dabce2516]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f530e526-b4b9-405c-8bde-111e34095cc4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f530e526-b4b9-405c-8bde-111e34095cc4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:12 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-c496a636-f826-4f6b-972e-d0973e5fbbb3 tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f530e526-b4b9-405c-8bde-111e34095cc4, portal: 172.16.0.220,3260]
Nov 13 18:47:12 user nova-compute[75216]: Login to [iface: default, target: iqn.2010-10.org.openstack:f530e526-b4b9-405c-8bde-111e34095cc4, portal: 172.16.0.220,3260] successful.
Nov 13 18:47:12 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:47:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f530e526-b4b9-405c-8bde-111e34095cc4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f530e526-b4b9-405c-8bde-111e34095cc4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:12 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2bdc060-d92a-4d5d-97e9-7eaf37c8b9f5]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:12 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-c496a636-f826-4f6b-972e-d0973e5fbbb3 tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:47:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:12 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d8b6717-42e7-4726-8d35-7bf8e9e6d0f7]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aafa167c-c8ba-4509-88dc-33b3a07e940a (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530e526-b4b9-405c-8bde-111e34095cc4 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba1efeb5-724e-4415-a5ed-12ce8c9489bc (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3d195d-b8b4-4c79-a150-813952c640e8 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fc393f0-1356-404f-a87b-bed1fb91b924 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a1a5e82-4f70-4668-94bd-4a842d826214 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e823c6a1-f7e2-495f-a5dc-6fdfd2b19cf0 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52f4339a-6a47-4877-b041-9c27d7be2e94 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac (non-flash)\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:12 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-c496a636-f826-4f6b-972e-d0973e5fbbb3 tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aafa167c-c8ba-4509-88dc-33b3a07e940a (non-flash)
Nov 13 18:47:12 user nova-compute[75216]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530e526-b4b9-405c-8bde-111e34095cc4 (non-flash)
Nov 13 18:47:12 user nova-compute[75216]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba1efeb5-724e-4415-a5ed-12ce8c9489bc (non-flash)
Nov 13 18:47:12 user nova-compute[75216]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3d195d-b8b4-4c79-a150-813952c640e8 (non-flash)
Nov 13 18:47:12 user nova-compute[75216]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fc393f0-1356-404f-a87b-bed1fb91b924 (non-flash)
Nov 13 18:47:12 user nova-compute[75216]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a1a5e82-4f70-4668-94bd-4a842d826214 (non-flash)
Nov 13 18:47:12 user nova-compute[75216]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e823c6a1-f7e2-495f-a5dc-6fdfd2b19cf0 (non-flash)
Nov 13 18:47:12 user nova-compute[75216]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52f4339a-6a47-4877-b041-9c27d7be2e94 (non-flash)
Nov 13 18:47:12 user nova-compute[75216]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac (non-flash)
Nov 13 18:47:12 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 18:47:12 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-c496a636-f826-4f6b-972e-d0973e5fbbb3 tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aafa167c-c8ba-4509-88dc-33b3a07e940a (non-flash)
Nov 13 18:47:12 user nova-compute[75216]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530e526-b4b9-405c-8bde-111e34095cc4 (non-flash)
Nov 13 18:47:12 user nova-compute[75216]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba1efeb5-724e-4415-a5ed-12ce8c9489bc (non-flash)
Nov 13 18:47:12 user nova-compute[75216]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3d195d-b8b4-4c79-a150-813952c640e8 (non-flash)
Nov 13 18:47:12 user nova-compute[75216]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fc393f0-1356-404f-a87b-bed1fb91b924 (non-flash)
Nov 13 18:47:12 user nova-compute[75216]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a1a5e82-4f70-4668-94bd-4a842d826214 (non-flash)
Nov 13 18:47:12 user nova-compute[75216]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e823c6a1-f7e2-495f-a5dc-6fdfd2b19cf0 (non-flash)
Nov 13 18:47:12 user nova-compute[75216]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52f4339a-6a47-4877-b041-9c27d7be2e94 (non-flash)
Nov 13 18:47:12 user nova-compute[75216]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac (non-flash)
Nov 13 18:47:12 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 18:47:12 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-c496a636-f826-4f6b-972e-d0973e5fbbb3 tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f530e526-b4b9-405c-8bde-111e34095cc4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.367s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 18:47:12 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-c496a636-f826-4f6b-972e-d0973e5fbbb3 tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] Connected to 172.16.0.220:3260 {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 18:47:12 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-c496a636-f826-4f6b-972e-d0973e5fbbb3 tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] HCTL ('41', '-', '-', 0) found on session 12 with lun 0 {{(pid=75216) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 18:47:12 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-c496a636-f826-4f6b-972e-d0973e5fbbb3 tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] Scanning host 41 c: -, t: -, l: 0) {{(pid=75216) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 18:47:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.017s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:12 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f44ccd2-18e9-4585-95e5-d38672a4e5d9]: (4, ('- - 0', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:12 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-c496a636-f826-4f6b-972e-d0973e5fbbb3 tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] Searching for a device in session 12 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=75216) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 18:47:12 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-c496a636-f826-4f6b-972e-d0973e5fbbb3 tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] Connected to sdj using {'target_iqn': 'iqn.2010-10.org.openstack:f530e526-b4b9-405c-8bde-111e34095cc4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ReFEXBsZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 18:47:13 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:47:13 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-0107ddb3-b970-4740-974c-4f7655c19bda tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] Acquiring lock "83fda249-9d28-4cc2-aeb0-103ce4f1faa4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:47:13 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-0107ddb3-b970-4740-974c-4f7655c19bda tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] Lock "83fda249-9d28-4cc2-aeb0-103ce4f1faa4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:47:13 user nova-compute[75216]: INFO nova.compute.manager [None req-0107ddb3-b970-4740-974c-4f7655c19bda tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] [instance: 83fda249-9d28-4cc2-aeb0-103ce4f1faa4] Detaching volume aafa167c-c8ba-4509-88dc-33b3a07e940a
Nov 13 18:47:13 user nova-compute[75216]: INFO nova.virt.block_device [None req-0107ddb3-b970-4740-974c-4f7655c19bda tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] [instance: 83fda249-9d28-4cc2-aeb0-103ce4f1faa4] Attempting to driver detach volume aafa167c-c8ba-4509-88dc-33b3a07e940a from mountpoint /dev/vdb
Nov 13 18:47:13 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-0107ddb3-b970-4740-974c-4f7655c19bda tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] Attempting to detach device vdb from instance 83fda249-9d28-4cc2-aeb0-103ce4f1faa4 from the persistent domain config. {{(pid=75216) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 13 18:47:13 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-0107ddb3-b970-4740-974c-4f7655c19bda tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 18:47:13 user nova-compute[75216]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 18:47:13 user nova-compute[75216]:   <source dev="/dev/sdi"/>
Nov 13 18:47:13 user nova-compute[75216]:   <target dev="vdb" bus="virtio"/>
Nov 13 18:47:13 user nova-compute[75216]:   <serial>aafa167c-c8ba-4509-88dc-33b3a07e940a</serial>
Nov 13 18:47:13 user nova-compute[75216]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 18:47:13 user nova-compute[75216]: </disk>
Nov 13 18:47:13 user nova-compute[75216]:  {{(pid=75216) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 18:47:13 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-0107ddb3-b970-4740-974c-4f7655c19bda tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] Successfully detached device vdb from instance 83fda249-9d28-4cc2-aeb0-103ce4f1faa4 from the persistent domain config.
Nov 13 18:47:13 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-0107ddb3-b970-4740-974c-4f7655c19bda tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 83fda249-9d28-4cc2-aeb0-103ce4f1faa4 from the live domain config. {{(pid=75216) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 13 18:47:13 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-0107ddb3-b970-4740-974c-4f7655c19bda tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 18:47:13 user nova-compute[75216]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 18:47:13 user nova-compute[75216]:   <source dev="/dev/sdi"/>
Nov 13 18:47:13 user nova-compute[75216]:   <target dev="vdb" bus="virtio"/>
Nov 13 18:47:13 user nova-compute[75216]:   <serial>aafa167c-c8ba-4509-88dc-33b3a07e940a</serial>
Nov 13 18:47:13 user nova-compute[75216]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 18:47:13 user nova-compute[75216]: </disk>
Nov 13 18:47:13 user nova-compute[75216]:  {{(pid=75216) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 18:47:13 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:47:13 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-c496a636-f826-4f6b-972e-d0973e5fbbb3 tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.412s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 18:47:13 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-c496a636-f826-4f6b-972e-d0973e5fbbb3 tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] <== connect_volume: return (1414ms) {'type': 'block', 'scsi_wwn': '26236636366626336', 'path': '/dev/sdj'} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 18:47:13 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c496a636-f826-4f6b-972e-d0973e5fbbb3 tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] [instance: 872856e5-cdc4-444e-8835-55e36708d776] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26236636366626336', 'path': '/dev/sdj'} {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 18:47:13 user nova-compute[75216]: DEBUG nova.objects.instance [None req-c496a636-f826-4f6b-972e-d0973e5fbbb3 tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] Lazy-loading 'flavor' on Instance uuid 872856e5-cdc4-444e-8835-55e36708d776 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 18:47:13 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-c496a636-f826-4f6b-972e-d0973e5fbbb3 tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] attach device xml: <disk type="block" device="disk">
Nov 13 18:47:13 user nova-compute[75216]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 18:47:13 user nova-compute[75216]:   <source dev="/dev/sdj"/>
Nov 13 18:47:13 user nova-compute[75216]:   <target dev="vdb" bus="virtio"/>
Nov 13 18:47:13 user nova-compute[75216]:   <serial>f530e526-b4b9-405c-8bde-111e34095cc4</serial>
Nov 13 18:47:13 user nova-compute[75216]: </disk>
Nov 13 18:47:13 user nova-compute[75216]:  {{(pid=75216) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 13 18:47:13 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-0107ddb3-b970-4740-974c-4f7655c19bda tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 83fda249-9d28-4cc2-aeb0-103ce4f1faa4 {{(pid=75216) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 13 18:47:14 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-c496a636-f826-4f6b-972e-d0973e5fbbb3 tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 18:47:14 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-c496a636-f826-4f6b-972e-d0973e5fbbb3 tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 18:47:14 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-c496a636-f826-4f6b-972e-d0973e5fbbb3 tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] No VIF found with MAC fa:16:3e:86:fe:e9, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 18:47:14 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c496a636-f826-4f6b-972e-d0973e5fbbb3 tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] Lock "872856e5-cdc4-444e-8835-55e36708d776" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.564s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:47:15 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-2604b626-9a5a-4682-a29c-8a1e6eb2aaa5 tempest-TestVolumeSwap-1274447143 tempest-TestVolumeSwap-1274447143-project-admin] Acquiring lock "872856e5-cdc4-444e-8835-55e36708d776" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:47:15 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-2604b626-9a5a-4682-a29c-8a1e6eb2aaa5 tempest-TestVolumeSwap-1274447143 tempest-TestVolumeSwap-1274447143-project-admin] Lock "872856e5-cdc4-444e-8835-55e36708d776" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:47:15 user nova-compute[75216]: DEBUG os_brick.utils [None req-2604b626-9a5a-4682-a29c-8a1e6eb2aaa5 tempest-TestVolumeSwap-1274447143 tempest-TestVolumeSwap-1274447143-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 18:47:15 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:15 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:15 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[cce0f019-0bc1-4a63-99fe-378a775df623]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aea6fcfe14b9\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:15 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:15 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:15 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5529266-4c22-45bd-b11e-246a63c15c72]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:15 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:15 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:15 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a25f2ad-695d-4c89-ac1c-6cce4976cbd5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:15 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[b46e5d52-60f7-41fc-95a2-f26365766fca]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:15 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-2604b626-9a5a-4682-a29c-8a1e6eb2aaa5 tempest-TestVolumeSwap-1274447143 tempest-TestVolumeSwap-1274447143-project-admin] Running cmd (subprocess): nvme version {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:15 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-2604b626-9a5a-4682-a29c-8a1e6eb2aaa5 tempest-TestVolumeSwap-1274447143 tempest-TestVolumeSwap-1274447143-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 18:47:15 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2604b626-9a5a-4682-a29c-8a1e6eb2aaa5 tempest-TestVolumeSwap-1274447143 tempest-TestVolumeSwap-1274447143-project-admin] nvme not present on system {{(pid=75216) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 18:47:15 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:15 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 18:47:15 user nova-compute[75216]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 18:47:15 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[4065495f-59be-4c38-aec2-bd0cbadee43b]: (4, '') {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:15 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-2604b626-9a5a-4682-a29c-8a1e6eb2aaa5 tempest-TestVolumeSwap-1274447143 tempest-TestVolumeSwap-1274447143-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75216) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 18:47:15 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-2604b626-9a5a-4682-a29c-8a1e6eb2aaa5 tempest-TestVolumeSwap-1274447143 tempest-TestVolumeSwap-1274447143-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 18:47:15 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-2604b626-9a5a-4682-a29c-8a1e6eb2aaa5 tempest-TestVolumeSwap-1274447143 tempest-TestVolumeSwap-1274447143-project-admin] LIGHTOS: no hostnqn found. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 18:47:15 user nova-compute[75216]: DEBUG os_brick.utils [None req-2604b626-9a5a-4682-a29c-8a1e6eb2aaa5 tempest-TestVolumeSwap-1274447143 tempest-TestVolumeSwap-1274447143-project-admin] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aea6fcfe14b9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 18:47:15 user nova-compute[75216]: INFO nova.compute.manager [None req-2604b626-9a5a-4682-a29c-8a1e6eb2aaa5 tempest-TestVolumeSwap-1274447143 tempest-TestVolumeSwap-1274447143-project-admin] [instance: 872856e5-cdc4-444e-8835-55e36708d776] Swapping volume f530e526-b4b9-405c-8bde-111e34095cc4 for 4cd9ea8a-0fbb-4dd4-b11c-fd661086e803
Nov 13 18:47:16 user nova-compute[75216]: DEBUG nova.compute.manager [req-e991cd13-98f3-41a9-b6a1-eed56d2d3300 req-1b3a9ae8-be0f-47b5-a380-f479852a8070 service nova] [instance: 576e97b7-285a-451f-a80d-aaa321a79d3b] Received event network-changed-af70d3c4-b668-4cfa-92fb-5bf17a903572 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:47:16 user nova-compute[75216]: DEBUG nova.compute.manager [req-e991cd13-98f3-41a9-b6a1-eed56d2d3300 req-1b3a9ae8-be0f-47b5-a380-f479852a8070 service nova] [instance: 576e97b7-285a-451f-a80d-aaa321a79d3b] Refreshing instance network info cache due to event network-changed-af70d3c4-b668-4cfa-92fb-5bf17a903572. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 18:47:16 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-e991cd13-98f3-41a9-b6a1-eed56d2d3300 req-1b3a9ae8-be0f-47b5-a380-f479852a8070 service nova] Acquiring lock "refresh_cache-576e97b7-285a-451f-a80d-aaa321a79d3b" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 18:47:16 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-e991cd13-98f3-41a9-b6a1-eed56d2d3300 req-1b3a9ae8-be0f-47b5-a380-f479852a8070 service nova] Acquired lock "refresh_cache-576e97b7-285a-451f-a80d-aaa321a79d3b" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 18:47:16 user nova-compute[75216]: DEBUG nova.network.neutron [req-e991cd13-98f3-41a9-b6a1-eed56d2d3300 req-1b3a9ae8-be0f-47b5-a380-f479852a8070 service nova] [instance: 576e97b7-285a-451f-a80d-aaa321a79d3b] Refreshing network info cache for port af70d3c4-b668-4cfa-92fb-5bf17a903572 {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 18:47:16 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-9b27a627-93fb-47df-ad0b-5347be77730d tempest-VolumesAssistedSnapshotsTest-1584726322 tempest-VolumesAssistedSnapshotsTest-1584726322-project-admin] Acquiring lock "576e97b7-285a-451f-a80d-aaa321a79d3b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:47:16 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-9b27a627-93fb-47df-ad0b-5347be77730d tempest-VolumesAssistedSnapshotsTest-1584726322 tempest-VolumesAssistedSnapshotsTest-1584726322-project-admin] Lock "576e97b7-285a-451f-a80d-aaa321a79d3b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:47:17 user nova-compute[75216]: DEBUG nova.objects.instance [None req-9b27a627-93fb-47df-ad0b-5347be77730d tempest-VolumesAssistedSnapshotsTest-1584726322 tempest-VolumesAssistedSnapshotsTest-1584726322-project-admin] Lazy-loading 'flavor' on Instance uuid 576e97b7-285a-451f-a80d-aaa321a79d3b {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 18:47:17 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-9b27a627-93fb-47df-ad0b-5347be77730d tempest-VolumesAssistedSnapshotsTest-1584726322 tempest-VolumesAssistedSnapshotsTest-1584726322-project-admin] Lock "576e97b7-285a-451f-a80d-aaa321a79d3b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.085s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:47:17 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-9b27a627-93fb-47df-ad0b-5347be77730d tempest-VolumesAssistedSnapshotsTest-1584726322 tempest-VolumesAssistedSnapshotsTest-1584726322-project-admin] Acquiring lock "576e97b7-285a-451f-a80d-aaa321a79d3b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:47:17 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-9b27a627-93fb-47df-ad0b-5347be77730d tempest-VolumesAssistedSnapshotsTest-1584726322 tempest-VolumesAssistedSnapshotsTest-1584726322-project-admin] Lock "576e97b7-285a-451f-a80d-aaa321a79d3b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:47:17 user nova-compute[75216]: INFO nova.compute.manager [None req-9b27a627-93fb-47df-ad0b-5347be77730d tempest-VolumesAssistedSnapshotsTest-1584726322 tempest-VolumesAssistedSnapshotsTest-1584726322-project-admin] [instance: 576e97b7-285a-451f-a80d-aaa321a79d3b] Attaching volume d72e8803-2ded-42f6-858f-803c16c2d2a4 to /dev/vdb
Nov 13 18:47:17 user nova-compute[75216]: DEBUG os_brick.utils [None req-9b27a627-93fb-47df-ad0b-5347be77730d tempest-VolumesAssistedSnapshotsTest-1584726322 tempest-VolumesAssistedSnapshotsTest-1584726322-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 18:47:17 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:17 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:17 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[c23b218f-0fe1-447d-a025-ea52130a3c3c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aea6fcfe14b9\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:17 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:17 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:17 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[14eba21b-d228-4d15-9e9c-036e99512511]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:17 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:17 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:17 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[0baa9fdb-79ec-497d-a437-d49e396a4ec1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:17 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2eb62ff-1936-4e49-9bd8-ab9aed4485a0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:17 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-9b27a627-93fb-47df-ad0b-5347be77730d tempest-VolumesAssistedSnapshotsTest-1584726322 tempest-VolumesAssistedSnapshotsTest-1584726322-project-admin] Running cmd (subprocess): nvme version {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:17 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-9b27a627-93fb-47df-ad0b-5347be77730d tempest-VolumesAssistedSnapshotsTest-1584726322 tempest-VolumesAssistedSnapshotsTest-1584726322-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 18:47:17 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9b27a627-93fb-47df-ad0b-5347be77730d tempest-VolumesAssistedSnapshotsTest-1584726322 tempest-VolumesAssistedSnapshotsTest-1584726322-project-admin] nvme not present on system {{(pid=75216) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 18:47:17 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:17 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 18:47:17 user nova-compute[75216]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 18:47:17 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd4f1681-88c9-4648-b001-3a58133cf314]: (4, '') {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:17 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-9b27a627-93fb-47df-ad0b-5347be77730d tempest-VolumesAssistedSnapshotsTest-1584726322 tempest-VolumesAssistedSnapshotsTest-1584726322-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75216) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 18:47:17 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-9b27a627-93fb-47df-ad0b-5347be77730d tempest-VolumesAssistedSnapshotsTest-1584726322 tempest-VolumesAssistedSnapshotsTest-1584726322-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 18:47:17 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-9b27a627-93fb-47df-ad0b-5347be77730d tempest-VolumesAssistedSnapshotsTest-1584726322 tempest-VolumesAssistedSnapshotsTest-1584726322-project-admin] LIGHTOS: no hostnqn found. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 18:47:17 user nova-compute[75216]: DEBUG os_brick.utils [None req-9b27a627-93fb-47df-ad0b-5347be77730d tempest-VolumesAssistedSnapshotsTest-1584726322 tempest-VolumesAssistedSnapshotsTest-1584726322-project-admin] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aea6fcfe14b9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 18:47:17 user nova-compute[75216]: DEBUG nova.virt.block_device [None req-9b27a627-93fb-47df-ad0b-5347be77730d tempest-VolumesAssistedSnapshotsTest-1584726322 tempest-VolumesAssistedSnapshotsTest-1584726322-project-admin] [instance: 576e97b7-285a-451f-a80d-aaa321a79d3b] Updating existing volume attachment record: b3b79036-ea91-4e83-b8a1-b60a91196448 {{(pid=75216) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 18:47:17 user nova-compute[75216]: DEBUG nova.network.neutron [req-e991cd13-98f3-41a9-b6a1-eed56d2d3300 req-1b3a9ae8-be0f-47b5-a380-f479852a8070 service nova] [instance: 576e97b7-285a-451f-a80d-aaa321a79d3b] Updated VIF entry in instance network info cache for port af70d3c4-b668-4cfa-92fb-5bf17a903572. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 18:47:17 user nova-compute[75216]: DEBUG nova.network.neutron [req-e991cd13-98f3-41a9-b6a1-eed56d2d3300 req-1b3a9ae8-be0f-47b5-a380-f479852a8070 service nova] [instance: 576e97b7-285a-451f-a80d-aaa321a79d3b] Updating instance_info_cache with network_info: [{"id": "af70d3c4-b668-4cfa-92fb-5bf17a903572", "address": "fa:16:3e:72:14:30", "network": {"id": "a5954c64-25ea-4c12-b852-ce2cf531689c", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1064303336-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "763712c69c7f45a8a0ff5cfdeb032baa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf70d3c4-b6", "ovs_interfaceid": "af70d3c4-b668-4cfa-92fb-5bf17a903572", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 18:47:17 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-e991cd13-98f3-41a9-b6a1-eed56d2d3300 req-1b3a9ae8-be0f-47b5-a380-f479852a8070 service nova] Releasing lock "refresh_cache-576e97b7-285a-451f-a80d-aaa321a79d3b" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 18:47:18 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:47:18 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:47:20 user nova-compute[75216]: DEBUG nova.compute.manager [None req-2604b626-9a5a-4682-a29c-8a1e6eb2aaa5 tempest-TestVolumeSwap-1274447143 tempest-TestVolumeSwap-1274447143-project-admin] [instance: 872856e5-cdc4-444e-8835-55e36708d776] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4cd9ea8a-0fbb-4dd4-b11c-fd661086e803', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DbhNcyvG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '872856e5-cdc4-444e-8835-55e36708d776', 'attached_at': '', 'detached_at': '', 'volume_id': '4cd9ea8a-0fbb-4dd4-b11c-fd661086e803', 'serial': '4cd9ea8a-0fbb-4dd4-b11c-fd661086e803'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f530e526-b4b9-405c-8bde-111e34095cc4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ReFEXBsZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, 'status': 'reserved', 'instance': '872856e5-cdc4-444e-8835-55e36708d776', 'attached_at': '', 'detached_at': '', 'volume_id': 'f530e526-b4b9-405c-8bde-111e34095cc4', 'serial'} {{(pid=75216) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 13 18:47:20 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2604b626-9a5a-4682-a29c-8a1e6eb2aaa5 tempest-TestVolumeSwap-1274447143 tempest-TestVolumeSwap-1274447143-project-admin] [instance: 872856e5-cdc4-444e-8835-55e36708d776] Calling os-brick to attach iSCSI Volume {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 18:47:20 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-2604b626-9a5a-4682-a29c-8a1e6eb2aaa5 tempest-TestVolumeSwap-1274447143 tempest-TestVolumeSwap-1274447143-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3a8669e40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4cd9ea8a-0fbb-4dd4-b11c-fd661086e803', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DbhNcyvG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 18:47:20 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-2604b626-9a5a-4682-a29c-8a1e6eb2aaa5 tempest-TestVolumeSwap-1274447143 tempest-TestVolumeSwap-1274447143-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 18:47:20 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-2604b626-9a5a-4682-a29c-8a1e6eb2aaa5 tempest-TestVolumeSwap-1274447143 tempest-TestVolumeSwap-1274447143-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 18:47:20 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-2604b626-9a5a-4682-a29c-8a1e6eb2aaa5 tempest-TestVolumeSwap-1274447143 tempest-TestVolumeSwap-1274447143-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 18:47:20 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-2604b626-9a5a-4682-a29c-8a1e6eb2aaa5 tempest-TestVolumeSwap-1274447143 tempest-TestVolumeSwap-1274447143-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 18:47:20 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-2604b626-9a5a-4682-a29c-8a1e6eb2aaa5 tempest-TestVolumeSwap-1274447143 tempest-TestVolumeSwap-1274447143-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4cd9ea8a-0fbb-4dd4-b11c-fd661086e803" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 18:47:20 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-2604b626-9a5a-4682-a29c-8a1e6eb2aaa5 tempest-TestVolumeSwap-1274447143 tempest-TestVolumeSwap-1274447143-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4cd9ea8a-0fbb-4dd4-b11c-fd661086e803" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 18:47:20 user nova-compute[75216]: INFO os_brick.initiator.connectors.iscsi [None req-2604b626-9a5a-4682-a29c-8a1e6eb2aaa5 tempest-TestVolumeSwap-1274447143 tempest-TestVolumeSwap-1274447143-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 18:47:20 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4cd9ea8a-0fbb-4dd4-b11c-fd661086e803 -p 172.16.0.220:3260 {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:20 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4cd9ea8a-0fbb-4dd4-b11c-fd661086e803 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:20 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[05d6138b-5745-4029-a99a-dac243f5a2ca]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:20 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-2604b626-9a5a-4682-a29c-8a1e6eb2aaa5 tempest-TestVolumeSwap-1274447143 tempest-TestVolumeSwap-1274447143-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 18:47:20 user nova-compute[75216]:  {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:47:20 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4cd9ea8a-0fbb-4dd4-b11c-fd661086e803 -p 172.16.0.220:3260 --interface default --op new {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:20 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4cd9ea8a-0fbb-4dd4-b11c-fd661086e803 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:20 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[d888ddfb-4976-4360-a8c6-f33fc7ec52b9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4cd9ea8a-0fbb-4dd4-b11c-fd661086e803] added\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:20 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-2604b626-9a5a-4682-a29c-8a1e6eb2aaa5 tempest-TestVolumeSwap-1274447143 tempest-TestVolumeSwap-1274447143-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4cd9ea8a-0fbb-4dd4-b11c-fd661086e803] added
Nov 13 18:47:20 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:47:20 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4cd9ea8a-0fbb-4dd4-b11c-fd661086e803 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:20 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4cd9ea8a-0fbb-4dd4-b11c-fd661086e803 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:20 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[050e9c5c-4bb2-4837-a612-d2fb3f404ecf]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:20 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-2604b626-9a5a-4682-a29c-8a1e6eb2aaa5 tempest-TestVolumeSwap-1274447143 tempest-TestVolumeSwap-1274447143-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:47:20 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4cd9ea8a-0fbb-4dd4-b11c-fd661086e803 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:20 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4cd9ea8a-0fbb-4dd4-b11c-fd661086e803 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:20 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d1c31f1-05b1-48c7-94dc-f08495fe1809]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:20 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-2604b626-9a5a-4682-a29c-8a1e6eb2aaa5 tempest-TestVolumeSwap-1274447143 tempest-TestVolumeSwap-1274447143-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:47:20 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4cd9ea8a-0fbb-4dd4-b11c-fd661086e803 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DbhNcyvG {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:20 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4cd9ea8a-0fbb-4dd4-b11c-fd661086e803 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DbhNcyvG" returned: 0 in 0.022s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:20 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f9191b1-d323-4a97-8ea8-182c585fd52f]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:20 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-2604b626-9a5a-4682-a29c-8a1e6eb2aaa5 tempest-TestVolumeSwap-1274447143 tempest-TestVolumeSwap-1274447143-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DbhNcyvG'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:47:20 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4cd9ea8a-0fbb-4dd4-b11c-fd661086e803 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:20 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4cd9ea8a-0fbb-4dd4-b11c-fd661086e803 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:20 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cffd8b7-5e98-479f-a364-0e356351584a]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:20 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-2604b626-9a5a-4682-a29c-8a1e6eb2aaa5 tempest-TestVolumeSwap-1274447143 tempest-TestVolumeSwap-1274447143-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:47:20 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:20 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:20 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b41eeb2-e3f4-408c-859e-cd458096a18b]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aafa167c-c8ba-4509-88dc-33b3a07e940a (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530e526-b4b9-405c-8bde-111e34095cc4 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba1efeb5-724e-4415-a5ed-12ce8c9489bc (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3d195d-b8b4-4c79-a150-813952c640e8 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fc393f0-1356-404f-a87b-bed1fb91b924 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a1a5e82-4f70-4668-94bd-4a842d826214 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e823c6a1-f7e2-495f-a5dc-6fdfd2b19cf0 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52f4339a-6a47-4877-b041-9c27d7be2e94 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac (non-flash)\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:20 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-2604b626-9a5a-4682-a29c-8a1e6eb2aaa5 tempest-TestVolumeSwap-1274447143 tempest-TestVolumeSwap-1274447143-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aafa167c-c8ba-4509-88dc-33b3a07e940a (non-flash)
Nov 13 18:47:20 user nova-compute[75216]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530e526-b4b9-405c-8bde-111e34095cc4 (non-flash)
Nov 13 18:47:20 user nova-compute[75216]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba1efeb5-724e-4415-a5ed-12ce8c9489bc (non-flash)
Nov 13 18:47:20 user nova-compute[75216]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3d195d-b8b4-4c79-a150-813952c640e8 (non-flash)
Nov 13 18:47:20 user nova-compute[75216]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fc393f0-1356-404f-a87b-bed1fb91b924 (non-flash)
Nov 13 18:47:20 user nova-compute[75216]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a1a5e82-4f70-4668-94bd-4a842d826214 (non-flash)
Nov 13 18:47:20 user nova-compute[75216]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e823c6a1-f7e2-495f-a5dc-6fdfd2b19cf0 (non-flash)
Nov 13 18:47:20 user nova-compute[75216]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52f4339a-6a47-4877-b041-9c27d7be2e94 (non-flash)
Nov 13 18:47:20 user nova-compute[75216]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac (non-flash)
Nov 13 18:47:20 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 18:47:20 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-2604b626-9a5a-4682-a29c-8a1e6eb2aaa5 tempest-TestVolumeSwap-1274447143 tempest-TestVolumeSwap-1274447143-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aafa167c-c8ba-4509-88dc-33b3a07e940a (non-flash)
Nov 13 18:47:20 user nova-compute[75216]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530e526-b4b9-405c-8bde-111e34095cc4 (non-flash)
Nov 13 18:47:20 user nova-compute[75216]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba1efeb5-724e-4415-a5ed-12ce8c9489bc (non-flash)
Nov 13 18:47:20 user nova-compute[75216]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3d195d-b8b4-4c79-a150-813952c640e8 (non-flash)
Nov 13 18:47:20 user nova-compute[75216]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fc393f0-1356-404f-a87b-bed1fb91b924 (non-flash)
Nov 13 18:47:20 user nova-compute[75216]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a1a5e82-4f70-4668-94bd-4a842d826214 (non-flash)
Nov 13 18:47:20 user nova-compute[75216]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e823c6a1-f7e2-495f-a5dc-6fdfd2b19cf0 (non-flash)
Nov 13 18:47:20 user nova-compute[75216]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52f4339a-6a47-4877-b041-9c27d7be2e94 (non-flash)
Nov 13 18:47:20 user nova-compute[75216]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac (non-flash)
Nov 13 18:47:20 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 18:47:20 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4cd9ea8a-0fbb-4dd4-b11c-fd661086e803 -p 172.16.0.220:3260 --login {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:20 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4cd9ea8a-0fbb-4dd4-b11c-fd661086e803 -p 172.16.0.220:3260 --login" returned: 0 in 0.107s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:20 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2356291-e73c-45d8-bc15-1a1102d609af]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4cd9ea8a-0fbb-4dd4-b11c-fd661086e803, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4cd9ea8a-0fbb-4dd4-b11c-fd661086e803, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:20 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-2604b626-9a5a-4682-a29c-8a1e6eb2aaa5 tempest-TestVolumeSwap-1274447143 tempest-TestVolumeSwap-1274447143-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4cd9ea8a-0fbb-4dd4-b11c-fd661086e803, portal: 172.16.0.220,3260]
Nov 13 18:47:20 user nova-compute[75216]: Login to [iface: default, target: iqn.2010-10.org.openstack:4cd9ea8a-0fbb-4dd4-b11c-fd661086e803, portal: 172.16.0.220,3260] successful.
Nov 13 18:47:20 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:47:20 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4cd9ea8a-0fbb-4dd4-b11c-fd661086e803 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:20 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4cd9ea8a-0fbb-4dd4-b11c-fd661086e803 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:20 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6e92144-ec2d-4447-bea9-48b5ded40168]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:20 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-2604b626-9a5a-4682-a29c-8a1e6eb2aaa5 tempest-TestVolumeSwap-1274447143 tempest-TestVolumeSwap-1274447143-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:47:20 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:20 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:20 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[11a76959-c6f0-41ae-9de1-27af3186b1af]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aafa167c-c8ba-4509-88dc-33b3a07e940a (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530e526-b4b9-405c-8bde-111e34095cc4 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cd9ea8a-0fbb-4dd4-b11c-fd661086e803 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba1efeb5-724e-4415-a5ed-12ce8c9489bc (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3d195d-b8b4-4c79-a150-813952c640e8 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fc393f0-1356-404f-a87b-bed1fb91b924 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a1a5e82-4f70-4668-94bd-4a842d826214 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e823c6a1-f7e2-495f-a5dc-6fdfd2b19cf0 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52f4339a-6a47-4877-b041-9c27d7be2e94 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac (non-flash)\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:20 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-2604b626-9a5a-4682-a29c-8a1e6eb2aaa5 tempest-TestVolumeSwap-1274447143 tempest-TestVolumeSwap-1274447143-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aafa167c-c8ba-4509-88dc-33b3a07e940a (non-flash)
Nov 13 18:47:20 user nova-compute[75216]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530e526-b4b9-405c-8bde-111e34095cc4 (non-flash)
Nov 13 18:47:20 user nova-compute[75216]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cd9ea8a-0fbb-4dd4-b11c-fd661086e803 (non-flash)
Nov 13 18:47:20 user nova-compute[75216]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba1efeb5-724e-4415-a5ed-12ce8c9489bc (non-flash)
Nov 13 18:47:20 user nova-compute[75216]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3d195d-b8b4-4c79-a150-813952c640e8 (non-flash)
Nov 13 18:47:20 user nova-compute[75216]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fc393f0-1356-404f-a87b-bed1fb91b924 (non-flash)
Nov 13 18:47:20 user nova-compute[75216]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a1a5e82-4f70-4668-94bd-4a842d826214 (non-flash)
Nov 13 18:47:20 user nova-compute[75216]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e823c6a1-f7e2-495f-a5dc-6fdfd2b19cf0 (non-flash)
Nov 13 18:47:20 user nova-compute[75216]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52f4339a-6a47-4877-b041-9c27d7be2e94 (non-flash)
Nov 13 18:47:20 user nova-compute[75216]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac (non-flash)
Nov 13 18:47:20 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 18:47:20 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-2604b626-9a5a-4682-a29c-8a1e6eb2aaa5 tempest-TestVolumeSwap-1274447143 tempest-TestVolumeSwap-1274447143-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aafa167c-c8ba-4509-88dc-33b3a07e940a (non-flash)
Nov 13 18:47:20 user nova-compute[75216]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530e526-b4b9-405c-8bde-111e34095cc4 (non-flash)
Nov 13 18:47:20 user nova-compute[75216]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cd9ea8a-0fbb-4dd4-b11c-fd661086e803 (non-flash)
Nov 13 18:47:20 user nova-compute[75216]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba1efeb5-724e-4415-a5ed-12ce8c9489bc (non-flash)
Nov 13 18:47:20 user nova-compute[75216]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3d195d-b8b4-4c79-a150-813952c640e8 (non-flash)
Nov 13 18:47:20 user nova-compute[75216]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fc393f0-1356-404f-a87b-bed1fb91b924 (non-flash)
Nov 13 18:47:20 user nova-compute[75216]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a1a5e82-4f70-4668-94bd-4a842d826214 (non-flash)
Nov 13 18:47:20 user nova-compute[75216]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e823c6a1-f7e2-495f-a5dc-6fdfd2b19cf0 (non-flash)
Nov 13 18:47:20 user nova-compute[75216]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52f4339a-6a47-4877-b041-9c27d7be2e94 (non-flash)
Nov 13 18:47:20 user nova-compute[75216]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac (non-flash)
Nov 13 18:47:20 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 18:47:20 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-2604b626-9a5a-4682-a29c-8a1e6eb2aaa5 tempest-TestVolumeSwap-1274447143 tempest-TestVolumeSwap-1274447143-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4cd9ea8a-0fbb-4dd4-b11c-fd661086e803" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.372s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 18:47:20 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-2604b626-9a5a-4682-a29c-8a1e6eb2aaa5 tempest-TestVolumeSwap-1274447143 tempest-TestVolumeSwap-1274447143-project-admin] Connected to 172.16.0.220:3260 {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 18:47:20 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-2604b626-9a5a-4682-a29c-8a1e6eb2aaa5 tempest-TestVolumeSwap-1274447143 tempest-TestVolumeSwap-1274447143-project-admin] HCTL ('42', '-', '-', 0) found on session 13 with lun 0 {{(pid=75216) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 18:47:20 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-2604b626-9a5a-4682-a29c-8a1e6eb2aaa5 tempest-TestVolumeSwap-1274447143 tempest-TestVolumeSwap-1274447143-project-admin] Scanning host 42 c: -, t: -, l: 0) {{(pid=75216) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 18:47:20 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host42/scan {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:20 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host42/scan" returned: 0 in 0.016s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:20 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab4a8f34-be9d-4f5d-8553-ad523d820e05]: (4, ('- - 0', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:20 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-2604b626-9a5a-4682-a29c-8a1e6eb2aaa5 tempest-TestVolumeSwap-1274447143 tempest-TestVolumeSwap-1274447143-project-admin] Searching for a device in session 13 and hctl ['42', '*', '*', 0] yield: sdk {{(pid=75216) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 18:47:20 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-2604b626-9a5a-4682-a29c-8a1e6eb2aaa5 tempest-TestVolumeSwap-1274447143 tempest-TestVolumeSwap-1274447143-project-admin] Connected to sdk using {'target_iqn': 'iqn.2010-10.org.openstack:4cd9ea8a-0fbb-4dd4-b11c-fd661086e803', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DbhNcyvG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 18:47:21 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-2604b626-9a5a-4682-a29c-8a1e6eb2aaa5 tempest-TestVolumeSwap-1274447143 tempest-TestVolumeSwap-1274447143-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.410s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 18:47:21 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-2604b626-9a5a-4682-a29c-8a1e6eb2aaa5 tempest-TestVolumeSwap-1274447143 tempest-TestVolumeSwap-1274447143-project-admin] <== connect_volume: return (1412ms) {'type': 'block', 'scsi_wwn': '23734333739343239', 'path': '/dev/sdk'} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 18:47:21 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2604b626-9a5a-4682-a29c-8a1e6eb2aaa5 tempest-TestVolumeSwap-1274447143 tempest-TestVolumeSwap-1274447143-project-admin] [instance: 872856e5-cdc4-444e-8835-55e36708d776] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23734333739343239', 'path': '/dev/sdk'} {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 18:47:21 user nova-compute[75216]: DEBUG nova.objects.instance [None req-2604b626-9a5a-4682-a29c-8a1e6eb2aaa5 tempest-TestVolumeSwap-1274447143 tempest-TestVolumeSwap-1274447143-project-admin] Lazy-loading 'flavor' on Instance uuid 872856e5-cdc4-444e-8835-55e36708d776 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 18:47:21 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b27a627-93fb-47df-ad0b-5347be77730d tempest-VolumesAssistedSnapshotsTest-1584726322 tempest-VolumesAssistedSnapshotsTest-1584726322-project-admin] [instance: 576e97b7-285a-451f-a80d-aaa321a79d3b] Calling os-brick to attach iSCSI Volume {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 18:47:21 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b27a627-93fb-47df-ad0b-5347be77730d tempest-VolumesAssistedSnapshotsTest-1584726322 tempest-VolumesAssistedSnapshotsTest-1584726322-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3a8669e40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d72e8803-2ded-42f6-858f-803c16c2d2a4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gKToYrIR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 18:47:21 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-9b27a627-93fb-47df-ad0b-5347be77730d tempest-VolumesAssistedSnapshotsTest-1584726322 tempest-VolumesAssistedSnapshotsTest-1584726322-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 18:47:21 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-9b27a627-93fb-47df-ad0b-5347be77730d tempest-VolumesAssistedSnapshotsTest-1584726322 tempest-VolumesAssistedSnapshotsTest-1584726322-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 18:47:21 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-9b27a627-93fb-47df-ad0b-5347be77730d tempest-VolumesAssistedSnapshotsTest-1584726322 tempest-VolumesAssistedSnapshotsTest-1584726322-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 18:47:21 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-9b27a627-93fb-47df-ad0b-5347be77730d tempest-VolumesAssistedSnapshotsTest-1584726322 tempest-VolumesAssistedSnapshotsTest-1584726322-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 18:47:21 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-9b27a627-93fb-47df-ad0b-5347be77730d tempest-VolumesAssistedSnapshotsTest-1584726322 tempest-VolumesAssistedSnapshotsTest-1584726322-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d72e8803-2ded-42f6-858f-803c16c2d2a4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 18:47:21 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-9b27a627-93fb-47df-ad0b-5347be77730d tempest-VolumesAssistedSnapshotsTest-1584726322 tempest-VolumesAssistedSnapshotsTest-1584726322-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d72e8803-2ded-42f6-858f-803c16c2d2a4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 18:47:21 user nova-compute[75216]: INFO os_brick.initiator.connectors.iscsi [None req-9b27a627-93fb-47df-ad0b-5347be77730d tempest-VolumesAssistedSnapshotsTest-1584726322 tempest-VolumesAssistedSnapshotsTest-1584726322-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 18:47:21 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d72e8803-2ded-42f6-858f-803c16c2d2a4 -p 172.16.0.220:3260 {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:21 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d72e8803-2ded-42f6-858f-803c16c2d2a4 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:21 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[328b933f-04ae-49f9-b4da-1bfb77310d10]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:21 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b27a627-93fb-47df-ad0b-5347be77730d tempest-VolumesAssistedSnapshotsTest-1584726322 tempest-VolumesAssistedSnapshotsTest-1584726322-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 18:47:21 user nova-compute[75216]:  {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:47:21 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d72e8803-2ded-42f6-858f-803c16c2d2a4 -p 172.16.0.220:3260 --interface default --op new {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:21 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d72e8803-2ded-42f6-858f-803c16c2d2a4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:21 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[3337149b-8996-40af-83c1-5c72aef8ea2e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d72e8803-2ded-42f6-858f-803c16c2d2a4] added\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:21 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b27a627-93fb-47df-ad0b-5347be77730d tempest-VolumesAssistedSnapshotsTest-1584726322 tempest-VolumesAssistedSnapshotsTest-1584726322-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d72e8803-2ded-42f6-858f-803c16c2d2a4] added
Nov 13 18:47:21 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:47:21 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d72e8803-2ded-42f6-858f-803c16c2d2a4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:21 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d72e8803-2ded-42f6-858f-803c16c2d2a4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:21 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[2716e55d-3669-4558-bf6c-4ba15674fa9c]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:21 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b27a627-93fb-47df-ad0b-5347be77730d tempest-VolumesAssistedSnapshotsTest-1584726322 tempest-VolumesAssistedSnapshotsTest-1584726322-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:47:21 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d72e8803-2ded-42f6-858f-803c16c2d2a4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:21 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d72e8803-2ded-42f6-858f-803c16c2d2a4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:21 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[57778e4d-9f34-4189-88c0-9ac9c07498b9]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:21 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b27a627-93fb-47df-ad0b-5347be77730d tempest-VolumesAssistedSnapshotsTest-1584726322 tempest-VolumesAssistedSnapshotsTest-1584726322-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:47:21 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d72e8803-2ded-42f6-858f-803c16c2d2a4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gKToYrIR {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:21 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d72e8803-2ded-42f6-858f-803c16c2d2a4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gKToYrIR" returned: 0 in 0.020s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:21 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfd7eafc-feb0-4652-8018-b8d95b6cef33]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:21 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b27a627-93fb-47df-ad0b-5347be77730d tempest-VolumesAssistedSnapshotsTest-1584726322 tempest-VolumesAssistedSnapshotsTest-1584726322-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gKToYrIR'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:47:21 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d72e8803-2ded-42f6-858f-803c16c2d2a4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:21 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d72e8803-2ded-42f6-858f-803c16c2d2a4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:21 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[d69fd29d-da5a-4ee3-bcd9-ee9cf73c08c4]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:21 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b27a627-93fb-47df-ad0b-5347be77730d tempest-VolumesAssistedSnapshotsTest-1584726322 tempest-VolumesAssistedSnapshotsTest-1584726322-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:47:21 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:21 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:21 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[f976a521-ee68-4461-adb0-9e99ef7e2270]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aafa167c-c8ba-4509-88dc-33b3a07e940a (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530e526-b4b9-405c-8bde-111e34095cc4 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cd9ea8a-0fbb-4dd4-b11c-fd661086e803 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba1efeb5-724e-4415-a5ed-12ce8c9489bc (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3d195d-b8b4-4c79-a150-813952c640e8 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fc393f0-1356-404f-a87b-bed1fb91b924 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a1a5e82-4f70-4668-94bd-4a842d826214 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e823c6a1-f7e2-495f-a5dc-6fdfd2b19cf0 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52f4339a-6a47-4877-b041-9c27d7be2e94 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac (non-flash)\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:21 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b27a627-93fb-47df-ad0b-5347be77730d tempest-VolumesAssistedSnapshotsTest-1584726322 tempest-VolumesAssistedSnapshotsTest-1584726322-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aafa167c-c8ba-4509-88dc-33b3a07e940a (non-flash)
Nov 13 18:47:21 user nova-compute[75216]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530e526-b4b9-405c-8bde-111e34095cc4 (non-flash)
Nov 13 18:47:21 user nova-compute[75216]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cd9ea8a-0fbb-4dd4-b11c-fd661086e803 (non-flash)
Nov 13 18:47:21 user nova-compute[75216]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba1efeb5-724e-4415-a5ed-12ce8c9489bc (non-flash)
Nov 13 18:47:21 user nova-compute[75216]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3d195d-b8b4-4c79-a150-813952c640e8 (non-flash)
Nov 13 18:47:21 user nova-compute[75216]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fc393f0-1356-404f-a87b-bed1fb91b924 (non-flash)
Nov 13 18:47:21 user nova-compute[75216]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a1a5e82-4f70-4668-94bd-4a842d826214 (non-flash)
Nov 13 18:47:21 user nova-compute[75216]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e823c6a1-f7e2-495f-a5dc-6fdfd2b19cf0 (non-flash)
Nov 13 18:47:21 user nova-compute[75216]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52f4339a-6a47-4877-b041-9c27d7be2e94 (non-flash)
Nov 13 18:47:21 user nova-compute[75216]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac (non-flash)
Nov 13 18:47:21 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 18:47:21 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b27a627-93fb-47df-ad0b-5347be77730d tempest-VolumesAssistedSnapshotsTest-1584726322 tempest-VolumesAssistedSnapshotsTest-1584726322-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aafa167c-c8ba-4509-88dc-33b3a07e940a (non-flash)
Nov 13 18:47:21 user nova-compute[75216]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530e526-b4b9-405c-8bde-111e34095cc4 (non-flash)
Nov 13 18:47:21 user nova-compute[75216]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cd9ea8a-0fbb-4dd4-b11c-fd661086e803 (non-flash)
Nov 13 18:47:21 user nova-compute[75216]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba1efeb5-724e-4415-a5ed-12ce8c9489bc (non-flash)
Nov 13 18:47:21 user nova-compute[75216]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3d195d-b8b4-4c79-a150-813952c640e8 (non-flash)
Nov 13 18:47:21 user nova-compute[75216]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fc393f0-1356-404f-a87b-bed1fb91b924 (non-flash)
Nov 13 18:47:21 user nova-compute[75216]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a1a5e82-4f70-4668-94bd-4a842d826214 (non-flash)
Nov 13 18:47:21 user nova-compute[75216]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e823c6a1-f7e2-495f-a5dc-6fdfd2b19cf0 (non-flash)
Nov 13 18:47:21 user nova-compute[75216]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52f4339a-6a47-4877-b041-9c27d7be2e94 (non-flash)
Nov 13 18:47:21 user nova-compute[75216]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac (non-flash)
Nov 13 18:47:21 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 18:47:21 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d72e8803-2ded-42f6-858f-803c16c2d2a4 -p 172.16.0.220:3260 --login {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:22 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d72e8803-2ded-42f6-858f-803c16c2d2a4 -p 172.16.0.220:3260 --login" returned: 0 in 0.200s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:22 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[cde41a89-125b-4d6c-b968-a3fe5e3fadaf]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d72e8803-2ded-42f6-858f-803c16c2d2a4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d72e8803-2ded-42f6-858f-803c16c2d2a4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:22 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b27a627-93fb-47df-ad0b-5347be77730d tempest-VolumesAssistedSnapshotsTest-1584726322 tempest-VolumesAssistedSnapshotsTest-1584726322-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d72e8803-2ded-42f6-858f-803c16c2d2a4, portal: 172.16.0.220,3260]
Nov 13 18:47:22 user nova-compute[75216]: Login to [iface: default, target: iqn.2010-10.org.openstack:d72e8803-2ded-42f6-858f-803c16c2d2a4, portal: 172.16.0.220,3260] successful.
Nov 13 18:47:22 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:47:22 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d72e8803-2ded-42f6-858f-803c16c2d2a4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:22 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d72e8803-2ded-42f6-858f-803c16c2d2a4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:22 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[60b6ec41-24c2-4fa1-964c-252ebe0df0a6]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:22 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b27a627-93fb-47df-ad0b-5347be77730d tempest-VolumesAssistedSnapshotsTest-1584726322 tempest-VolumesAssistedSnapshotsTest-1584726322-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:47:22 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-2604b626-9a5a-4682-a29c-8a1e6eb2aaa5 tempest-TestVolumeSwap-1274447143 tempest-TestVolumeSwap-1274447143-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=75216) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 13 18:47:22 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:22 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:22 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7f86d07-60bb-48b0-8346-a9d9bb24348f]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aafa167c-c8ba-4509-88dc-33b3a07e940a (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530e526-b4b9-405c-8bde-111e34095cc4 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cd9ea8a-0fbb-4dd4-b11c-fd661086e803 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d72e8803-2ded-42f6-858f-803c16c2d2a4 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba1efeb5-724e-4415-a5ed-12ce8c9489bc (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3d195d-b8b4-4c79-a150-813952c640e8 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fc393f0-1356-404f-a87b-bed1fb91b924 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a1a5e82-4f70-4668-94bd-4a842d826214 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e823c6a1-f7e2-495f-a5dc-6fdfd2b19cf0 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52f4339a-6a47-4877-b041-9c27d7be2e94 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac (non-flash)\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:22 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b27a627-93fb-47df-ad0b-5347be77730d tempest-VolumesAssistedSnapshotsTest-1584726322 tempest-VolumesAssistedSnapshotsTest-1584726322-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aafa167c-c8ba-4509-88dc-33b3a07e940a (non-flash)
Nov 13 18:47:22 user nova-compute[75216]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530e526-b4b9-405c-8bde-111e34095cc4 (non-flash)
Nov 13 18:47:22 user nova-compute[75216]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cd9ea8a-0fbb-4dd4-b11c-fd661086e803 (non-flash)
Nov 13 18:47:22 user nova-compute[75216]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d72e8803-2ded-42f6-858f-803c16c2d2a4 (non-flash)
Nov 13 18:47:22 user nova-compute[75216]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba1efeb5-724e-4415-a5ed-12ce8c9489bc (non-flash)
Nov 13 18:47:22 user nova-compute[75216]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3d195d-b8b4-4c79-a150-813952c640e8 (non-flash)
Nov 13 18:47:22 user nova-compute[75216]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fc393f0-1356-404f-a87b-bed1fb91b924 (non-flash)
Nov 13 18:47:22 user nova-compute[75216]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a1a5e82-4f70-4668-94bd-4a842d826214 (non-flash)
Nov 13 18:47:22 user nova-compute[75216]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e823c6a1-f7e2-495f-a5dc-6fdfd2b19cf0 (non-flash)
Nov 13 18:47:22 user nova-compute[75216]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52f4339a-6a47-4877-b041-9c27d7be2e94 (non-flash)
Nov 13 18:47:22 user nova-compute[75216]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac (non-flash)
Nov 13 18:47:22 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 18:47:22 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b27a627-93fb-47df-ad0b-5347be77730d tempest-VolumesAssistedSnapshotsTest-1584726322 tempest-VolumesAssistedSnapshotsTest-1584726322-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aafa167c-c8ba-4509-88dc-33b3a07e940a (non-flash)
Nov 13 18:47:22 user nova-compute[75216]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530e526-b4b9-405c-8bde-111e34095cc4 (non-flash)
Nov 13 18:47:22 user nova-compute[75216]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cd9ea8a-0fbb-4dd4-b11c-fd661086e803 (non-flash)
Nov 13 18:47:22 user nova-compute[75216]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d72e8803-2ded-42f6-858f-803c16c2d2a4 (non-flash)
Nov 13 18:47:22 user nova-compute[75216]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba1efeb5-724e-4415-a5ed-12ce8c9489bc (non-flash)
Nov 13 18:47:22 user nova-compute[75216]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3d195d-b8b4-4c79-a150-813952c640e8 (non-flash)
Nov 13 18:47:22 user nova-compute[75216]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fc393f0-1356-404f-a87b-bed1fb91b924 (non-flash)
Nov 13 18:47:22 user nova-compute[75216]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a1a5e82-4f70-4668-94bd-4a842d826214 (non-flash)
Nov 13 18:47:22 user nova-compute[75216]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e823c6a1-f7e2-495f-a5dc-6fdfd2b19cf0 (non-flash)
Nov 13 18:47:22 user nova-compute[75216]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52f4339a-6a47-4877-b041-9c27d7be2e94 (non-flash)
Nov 13 18:47:22 user nova-compute[75216]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac (non-flash)
Nov 13 18:47:22 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 18:47:22 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-9b27a627-93fb-47df-ad0b-5347be77730d tempest-VolumesAssistedSnapshotsTest-1584726322 tempest-VolumesAssistedSnapshotsTest-1584726322-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d72e8803-2ded-42f6-858f-803c16c2d2a4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.458s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 18:47:22 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b27a627-93fb-47df-ad0b-5347be77730d tempest-VolumesAssistedSnapshotsTest-1584726322 tempest-VolumesAssistedSnapshotsTest-1584726322-project-admin] Connected to 172.16.0.220:3260 {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 18:47:22 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-9b27a627-93fb-47df-ad0b-5347be77730d tempest-VolumesAssistedSnapshotsTest-1584726322 tempest-VolumesAssistedSnapshotsTest-1584726322-project-admin] HCTL ('43', '-', '-', 0) found on session 14 with lun 0 {{(pid=75216) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 18:47:22 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-9b27a627-93fb-47df-ad0b-5347be77730d tempest-VolumesAssistedSnapshotsTest-1584726322 tempest-VolumesAssistedSnapshotsTest-1584726322-project-admin] Scanning host 43 c: -, t: -, l: 0) {{(pid=75216) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 18:47:22 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host43/scan {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:22 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host43/scan" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:22 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[aee79da4-4e47-4c15-b439-8219e44e7ce7]: (4, ('- - 0', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:22 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-9b27a627-93fb-47df-ad0b-5347be77730d tempest-VolumesAssistedSnapshotsTest-1584726322 tempest-VolumesAssistedSnapshotsTest-1584726322-project-admin] Searching for a device in session 14 and hctl ['43', '*', '*', 0] yield: sdl {{(pid=75216) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 18:47:22 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b27a627-93fb-47df-ad0b-5347be77730d tempest-VolumesAssistedSnapshotsTest-1584726322 tempest-VolumesAssistedSnapshotsTest-1584726322-project-admin] Connected to sdl using {'target_iqn': 'iqn.2010-10.org.openstack:d72e8803-2ded-42f6-858f-803c16c2d2a4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gKToYrIR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 18:47:22 user nova-compute[75216]: DEBUG nova.compute.manager [req-9bf7c62e-def8-411f-b1d5-6fad44fc9e23 req-63d7a2cd-35ed-44a8-8b9c-6b7ca3dc74a0 service nova] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] Received event network-changed-217faeb3-4474-449c-ae9f-86e555ce7cd7 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:47:22 user nova-compute[75216]: DEBUG nova.compute.manager [req-9bf7c62e-def8-411f-b1d5-6fad44fc9e23 req-63d7a2cd-35ed-44a8-8b9c-6b7ca3dc74a0 service nova] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] Refreshing instance network info cache due to event network-changed-217faeb3-4474-449c-ae9f-86e555ce7cd7. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 18:47:22 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-9bf7c62e-def8-411f-b1d5-6fad44fc9e23 req-63d7a2cd-35ed-44a8-8b9c-6b7ca3dc74a0 service nova] Acquiring lock "refresh_cache-3274203b-a985-4f28-9b45-3f83509ae782" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 18:47:22 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-9bf7c62e-def8-411f-b1d5-6fad44fc9e23 req-63d7a2cd-35ed-44a8-8b9c-6b7ca3dc74a0 service nova] Acquired lock "refresh_cache-3274203b-a985-4f28-9b45-3f83509ae782" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 18:47:22 user nova-compute[75216]: DEBUG nova.network.neutron [req-9bf7c62e-def8-411f-b1d5-6fad44fc9e23 req-63d7a2cd-35ed-44a8-8b9c-6b7ca3dc74a0 service nova] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] Refreshing network info cache for port 217faeb3-4474-449c-ae9f-86e555ce7cd7 {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 18:47:22 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-2604b626-9a5a-4682-a29c-8a1e6eb2aaa5 tempest-TestVolumeSwap-1274447143 tempest-TestVolumeSwap-1274447143-project-admin] COPY block job progress, current cursor: 140509184 final cursor: 1073741824 {{(pid=75216) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 13 18:47:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:47:23 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-2604b626-9a5a-4682-a29c-8a1e6eb2aaa5 tempest-TestVolumeSwap-1274447143 tempest-TestVolumeSwap-1274447143-project-admin] COPY block job progress, current cursor: 325058560 final cursor: 1073741824 {{(pid=75216) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 13 18:47:23 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-9b27a627-93fb-47df-ad0b-5347be77730d tempest-VolumesAssistedSnapshotsTest-1584726322 tempest-VolumesAssistedSnapshotsTest-1584726322-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.501s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 18:47:23 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b27a627-93fb-47df-ad0b-5347be77730d tempest-VolumesAssistedSnapshotsTest-1584726322 tempest-VolumesAssistedSnapshotsTest-1584726322-project-admin] <== connect_volume: return (1502ms) {'type': 'block', 'scsi_wwn': '23735363465333266', 'path': '/dev/sdl'} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 18:47:23 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b27a627-93fb-47df-ad0b-5347be77730d tempest-VolumesAssistedSnapshotsTest-1584726322 tempest-VolumesAssistedSnapshotsTest-1584726322-project-admin] [instance: 576e97b7-285a-451f-a80d-aaa321a79d3b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23735363465333266', 'path': '/dev/sdl'} {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 18:47:23 user nova-compute[75216]: DEBUG nova.objects.instance [None req-9b27a627-93fb-47df-ad0b-5347be77730d tempest-VolumesAssistedSnapshotsTest-1584726322 tempest-VolumesAssistedSnapshotsTest-1584726322-project-admin] Lazy-loading 'flavor' on Instance uuid 576e97b7-285a-451f-a80d-aaa321a79d3b {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 18:47:23 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-9b27a627-93fb-47df-ad0b-5347be77730d tempest-VolumesAssistedSnapshotsTest-1584726322 tempest-VolumesAssistedSnapshotsTest-1584726322-project-admin] attach device xml: <disk type="block" device="disk">
Nov 13 18:47:23 user nova-compute[75216]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 18:47:23 user nova-compute[75216]:   <source dev="/dev/sdl"/>
Nov 13 18:47:23 user nova-compute[75216]:   <target dev="vdb" bus="virtio"/>
Nov 13 18:47:23 user nova-compute[75216]:   <serial>d72e8803-2ded-42f6-858f-803c16c2d2a4</serial>
Nov 13 18:47:23 user nova-compute[75216]: </disk>
Nov 13 18:47:23 user nova-compute[75216]:  {{(pid=75216) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 13 18:47:23 user nova-compute[75216]: DEBUG nova.network.neutron [req-9bf7c62e-def8-411f-b1d5-6fad44fc9e23 req-63d7a2cd-35ed-44a8-8b9c-6b7ca3dc74a0 service nova] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] Updated VIF entry in instance network info cache for port 217faeb3-4474-449c-ae9f-86e555ce7cd7. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 18:47:23 user nova-compute[75216]: DEBUG nova.network.neutron [req-9bf7c62e-def8-411f-b1d5-6fad44fc9e23 req-63d7a2cd-35ed-44a8-8b9c-6b7ca3dc74a0 service nova] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] Updating instance_info_cache with network_info: [{"id": "217faeb3-4474-449c-ae9f-86e555ce7cd7", "address": "fa:16:3e:49:58:83", "network": {"id": "804f3c05-e540-4bae-a58f-682133e0c762", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-619032523-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8d0f284dd8d4cc88f04a729b1d5d38c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap217faeb3-44", "ovs_interfaceid": "217faeb3-4474-449c-ae9f-86e555ce7cd7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9bed3978-d90d-4b90-b798-12413ea26a48", "address": "fa:16:3e:17:08:ae", "network": {"id": "590b5147-c33a-45bd-a502-8fd41408064d", "bridge": "br-int", "label": "tempest-device-tagging-net1-904391500", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a8d0f284dd8d4cc88f04a729b1d5d38c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bed3978-d9", "ovs_interfaceid": "9bed3978-d90d-4b90-b798-12413ea26a48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "95a425c5-f994-4504-a94b-040103b2efa7", "address": "fa:16:3e:02:ea:af", "network": {"id": "590b5147-c33a-45bd-a502-8fd41408064d", "bridge": "br-int", "label": "tempest-device-tagging-net1-904391500", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.40", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a8d0f284dd8d4cc88f04a729b1d5d38c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95a425c5-f9", "ovs_interfaceid": "95a425c5-f994-4504-a94b-040103b2efa7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7aa7e71d-2c00-40fd-9d05-d108bcc807ec", "address": "fa:16:3e:73:99:8a", "network": {"id": "590b5147-c33a-45bd-a502-8fd41408064d", "bridge": "br-int", "label": "tempest-device-tagging-net1-904391500", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.98", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a8d0f284dd8d4cc88f04a729b1d5d38c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7aa7e71d-2c", "ovs_interfaceid": "7aa7e71d-2c00-40fd-9d05-d108bcc807ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "01772e53-e624-4728-beb1-929cc4165f21", "address": "fa:16:3e:a7:a0:fe", "network": {"id": "590b5147-c33a-45bd-a502-8fd41408064d", "bridge": "br-int", "label": "tempest-device-tagging-net1-904391500", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a8d0f284dd8d4cc88f04a729b1d5d38c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01772e53-e6", "ovs_interfaceid": "01772e53-e624-4728-beb1-929cc4165f21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1bb4df6f-02b2-415b-9cea-fd8a7a04874c", "address": "fa:16:3e:cb:71:3b", "network": {"id": "f82e0fd1-978f-4b08-8480-709765208ef9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1203652186", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a8d0f284dd8d4cc88f04a729b1d5d38c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bb4df6f-02", "ovs_interfaceid": "1bb4df6f-02b2-415b-9cea-fd8a7a04874c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a07efcd3-59f4-452e-8fb7-8b8233ae235f", "address": "fa:16:3e:6c:cb:eb", "network": {"id": "f82e0fd1-978f-4b08-8480-709765208ef9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1203652186", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a8d0f284dd8d4cc88f04a729b1d5d38c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa07efcd3-59", "ovs_interfaceid": "a07efcd3-59f4-452e-8fb7-8b8233ae235f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 18:47:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:47:23 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-9bf7c62e-def8-411f-b1d5-6fad44fc9e23 req-63d7a2cd-35ed-44a8-8b9c-6b7ca3dc74a0 service nova] Releasing lock "refresh_cache-3274203b-a985-4f28-9b45-3f83509ae782" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 18:47:23 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-2604b626-9a5a-4682-a29c-8a1e6eb2aaa5 tempest-TestVolumeSwap-1274447143 tempest-TestVolumeSwap-1274447143-project-admin] COPY block job progress, current cursor: 488636416 final cursor: 1073741824 {{(pid=75216) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 13 18:47:23 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-9b27a627-93fb-47df-ad0b-5347be77730d tempest-VolumesAssistedSnapshotsTest-1584726322 tempest-VolumesAssistedSnapshotsTest-1584726322-project-admin] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 18:47:23 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-9b27a627-93fb-47df-ad0b-5347be77730d tempest-VolumesAssistedSnapshotsTest-1584726322 tempest-VolumesAssistedSnapshotsTest-1584726322-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 18:47:23 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-9b27a627-93fb-47df-ad0b-5347be77730d tempest-VolumesAssistedSnapshotsTest-1584726322 tempest-VolumesAssistedSnapshotsTest-1584726322-project-admin] No VIF found with MAC fa:16:3e:72:14:30, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 18:47:23 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-9b27a627-93fb-47df-ad0b-5347be77730d tempest-VolumesAssistedSnapshotsTest-1584726322 tempest-VolumesAssistedSnapshotsTest-1584726322-project-admin] Lock "576e97b7-285a-451f-a80d-aaa321a79d3b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.716s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:47:24 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-2604b626-9a5a-4682-a29c-8a1e6eb2aaa5 tempest-TestVolumeSwap-1274447143 tempest-TestVolumeSwap-1274447143-project-admin] COPY block job progress, current cursor: 610271232 final cursor: 1073741824 {{(pid=75216) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 13 18:47:24 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-2604b626-9a5a-4682-a29c-8a1e6eb2aaa5 tempest-TestVolumeSwap-1274447143 tempest-TestVolumeSwap-1274447143-project-admin] COPY block job progress, current cursor: 808452096 final cursor: 1073741824 {{(pid=75216) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 13 18:47:25 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-1989197a-3c60-43f4-bd47-7b97dc9d035b tempest-VolumesAssistedSnapshotsTest-1044178100 tempest-VolumesAssistedSnapshotsTest-1044178100-project] [instance: 576e97b7-285a-451f-a80d-aaa321a79d3b] volume_snapshot_create: create_info: {'snapshot_id': '8a1e223a-a7c6-4300-8035-f7e79e8e9225', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=75216) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3576}}
Nov 13 18:47:25 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-1989197a-3c60-43f4-bd47-7b97dc9d035b tempest-VolumesAssistedSnapshotsTest-1044178100 tempest-VolumesAssistedSnapshotsTest-1044178100-project] [instance: 576e97b7-285a-451f-a80d-aaa321a79d3b] snap xml: <domainsnapshot>
Nov 13 18:47:25 user nova-compute[75216]:   <disks>
Nov 13 18:47:25 user nova-compute[75216]:     <disk name="/dev/sdl" snapshot="external" type="file">
Nov 13 18:47:25 user nova-compute[75216]:       <source file="/dev/new_file"/>
Nov 13 18:47:25 user nova-compute[75216]:     </disk>
Nov 13 18:47:25 user nova-compute[75216]:     <disk name="vda" snapshot="no"/>
Nov 13 18:47:25 user nova-compute[75216]:   </disks>
Nov 13 18:47:25 user nova-compute[75216]: </domainsnapshot>
Nov 13 18:47:25 user nova-compute[75216]:  {{(pid=75216) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3517}}
Nov 13 18:47:25 user nova-compute[75216]: DEBUG nova.objects.instance [None req-1989197a-3c60-43f4-bd47-7b97dc9d035b tempest-VolumesAssistedSnapshotsTest-1044178100 tempest-VolumesAssistedSnapshotsTest-1044178100-project] Lazy-loading 'system_metadata' on Instance uuid 576e97b7-285a-451f-a80d-aaa321a79d3b {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 18:47:25 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-1989197a-3c60-43f4-bd47-7b97dc9d035b tempest-VolumesAssistedSnapshotsTest-1044178100 tempest-VolumesAssistedSnapshotsTest-1044178100-project] [instance: 576e97b7-285a-451f-a80d-aaa321a79d3b] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 13 18:47:25 user nova-compute[75216]: ERROR nova.virt.libvirt.driver [None req-1989197a-3c60-43f4-bd47-7b97dc9d035b tempest-VolumesAssistedSnapshotsTest-1044178100 tempest-VolumesAssistedSnapshotsTest-1044178100-project] [instance: 576e97b7-285a-451f-a80d-aaa321a79d3b] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 13 18:47:25 user nova-compute[75216]: ERROR nova.virt.libvirt.driver [instance: 576e97b7-285a-451f-a80d-aaa321a79d3b] Traceback (most recent call last):
Nov 13 18:47:25 user nova-compute[75216]: ERROR nova.virt.libvirt.driver [instance: 576e97b7-285a-451f-a80d-aaa321a79d3b]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 13 18:47:25 user nova-compute[75216]: ERROR nova.virt.libvirt.driver [instance: 576e97b7-285a-451f-a80d-aaa321a79d3b]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 13 18:47:25 user nova-compute[75216]: ERROR nova.virt.libvirt.driver [instance: 576e97b7-285a-451f-a80d-aaa321a79d3b]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 13 18:47:25 user nova-compute[75216]: ERROR nova.virt.libvirt.driver [instance: 576e97b7-285a-451f-a80d-aaa321a79d3b]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 13 18:47:25 user nova-compute[75216]: ERROR nova.virt.libvirt.driver [instance: 576e97b7-285a-451f-a80d-aaa321a79d3b]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 13 18:47:25 user nova-compute[75216]: ERROR nova.virt.libvirt.driver [instance: 576e97b7-285a-451f-a80d-aaa321a79d3b]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 13 18:47:25 user nova-compute[75216]: ERROR nova.virt.libvirt.driver [instance: 576e97b7-285a-451f-a80d-aaa321a79d3b]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 13 18:47:25 user nova-compute[75216]: ERROR nova.virt.libvirt.driver [instance: 576e97b7-285a-451f-a80d-aaa321a79d3b]     rv = execute(f, *args, **kwargs)
Nov 13 18:47:25 user nova-compute[75216]: ERROR nova.virt.libvirt.driver [instance: 576e97b7-285a-451f-a80d-aaa321a79d3b]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 13 18:47:25 user nova-compute[75216]: ERROR nova.virt.libvirt.driver [instance: 576e97b7-285a-451f-a80d-aaa321a79d3b]     six.reraise(c, e, tb)
Nov 13 18:47:25 user nova-compute[75216]: ERROR nova.virt.libvirt.driver [instance: 576e97b7-285a-451f-a80d-aaa321a79d3b]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 13 18:47:25 user nova-compute[75216]: ERROR nova.virt.libvirt.driver [instance: 576e97b7-285a-451f-a80d-aaa321a79d3b]     raise value
Nov 13 18:47:25 user nova-compute[75216]: ERROR nova.virt.libvirt.driver [instance: 576e97b7-285a-451f-a80d-aaa321a79d3b]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 13 18:47:25 user nova-compute[75216]: ERROR nova.virt.libvirt.driver [instance: 576e97b7-285a-451f-a80d-aaa321a79d3b]     rv = meth(*args, **kwargs)
Nov 13 18:47:25 user nova-compute[75216]: ERROR nova.virt.libvirt.driver [instance: 576e97b7-285a-451f-a80d-aaa321a79d3b]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 13 18:47:25 user nova-compute[75216]: ERROR nova.virt.libvirt.driver [instance: 576e97b7-285a-451f-a80d-aaa321a79d3b]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 13 18:47:25 user nova-compute[75216]: ERROR nova.virt.libvirt.driver [instance: 576e97b7-285a-451f-a80d-aaa321a79d3b] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 13 18:47:25 user nova-compute[75216]: ERROR nova.virt.libvirt.driver [instance: 576e97b7-285a-451f-a80d-aaa321a79d3b] 
Nov 13 18:47:25 user nova-compute[75216]: ERROR nova.virt.libvirt.driver [None req-1989197a-3c60-43f4-bd47-7b97dc9d035b tempest-VolumesAssistedSnapshotsTest-1044178100 tempest-VolumesAssistedSnapshotsTest-1044178100-project] [instance: 576e97b7-285a-451f-a80d-aaa321a79d3b] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 13 18:47:25 user nova-compute[75216]: ERROR nova.virt.libvirt.driver [instance: 576e97b7-285a-451f-a80d-aaa321a79d3b] Traceback (most recent call last):
Nov 13 18:47:25 user nova-compute[75216]: ERROR nova.virt.libvirt.driver [instance: 576e97b7-285a-451f-a80d-aaa321a79d3b]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 13 18:47:25 user nova-compute[75216]: ERROR nova.virt.libvirt.driver [instance: 576e97b7-285a-451f-a80d-aaa321a79d3b]     self._volume_snapshot_create(context, instance, guest,
Nov 13 18:47:25 user nova-compute[75216]: ERROR nova.virt.libvirt.driver [instance: 576e97b7-285a-451f-a80d-aaa321a79d3b]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 13 18:47:25 user nova-compute[75216]: ERROR nova.virt.libvirt.driver [instance: 576e97b7-285a-451f-a80d-aaa321a79d3b]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 13 18:47:25 user nova-compute[75216]: ERROR nova.virt.libvirt.driver [instance: 576e97b7-285a-451f-a80d-aaa321a79d3b]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 13 18:47:25 user nova-compute[75216]: ERROR nova.virt.libvirt.driver [instance: 576e97b7-285a-451f-a80d-aaa321a79d3b]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 13 18:47:25 user nova-compute[75216]: ERROR nova.virt.libvirt.driver [instance: 576e97b7-285a-451f-a80d-aaa321a79d3b]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 13 18:47:25 user nova-compute[75216]: ERROR nova.virt.libvirt.driver [instance: 576e97b7-285a-451f-a80d-aaa321a79d3b]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 13 18:47:25 user nova-compute[75216]: ERROR nova.virt.libvirt.driver [instance: 576e97b7-285a-451f-a80d-aaa321a79d3b]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 13 18:47:25 user nova-compute[75216]: ERROR nova.virt.libvirt.driver [instance: 576e97b7-285a-451f-a80d-aaa321a79d3b]     rv = execute(f, *args, **kwargs)
Nov 13 18:47:25 user nova-compute[75216]: ERROR nova.virt.libvirt.driver [instance: 576e97b7-285a-451f-a80d-aaa321a79d3b]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 13 18:47:25 user nova-compute[75216]: ERROR nova.virt.libvirt.driver [instance: 576e97b7-285a-451f-a80d-aaa321a79d3b]     six.reraise(c, e, tb)
Nov 13 18:47:25 user nova-compute[75216]: ERROR nova.virt.libvirt.driver [instance: 576e97b7-285a-451f-a80d-aaa321a79d3b]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 13 18:47:25 user nova-compute[75216]: ERROR nova.virt.libvirt.driver [instance: 576e97b7-285a-451f-a80d-aaa321a79d3b]     raise value
Nov 13 18:47:25 user nova-compute[75216]: ERROR nova.virt.libvirt.driver [instance: 576e97b7-285a-451f-a80d-aaa321a79d3b]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 13 18:47:25 user nova-compute[75216]: ERROR nova.virt.libvirt.driver [instance: 576e97b7-285a-451f-a80d-aaa321a79d3b]     rv = meth(*args, **kwargs)
Nov 13 18:47:25 user nova-compute[75216]: ERROR nova.virt.libvirt.driver [instance: 576e97b7-285a-451f-a80d-aaa321a79d3b]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 13 18:47:25 user nova-compute[75216]: ERROR nova.virt.libvirt.driver [instance: 576e97b7-285a-451f-a80d-aaa321a79d3b]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 13 18:47:25 user nova-compute[75216]: ERROR nova.virt.libvirt.driver [instance: 576e97b7-285a-451f-a80d-aaa321a79d3b] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 13 18:47:25 user nova-compute[75216]: ERROR nova.virt.libvirt.driver [instance: 576e97b7-285a-451f-a80d-aaa321a79d3b] 
Nov 13 18:47:25 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-15422dd8-a97b-4cc3-a221-6c4ab3c844b6 tempest-VolumesAssistedSnapshotsTest-1044178100 tempest-VolumesAssistedSnapshotsTest-1044178100-project] [instance: 576e97b7-285a-451f-a80d-aaa321a79d3b] volume_snapshot_delete: delete_info: {'volume_id': 'd72e8803-2ded-42f6-858f-803c16c2d2a4'} {{(pid=75216) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3677}}
Nov 13 18:47:25 user nova-compute[75216]: ERROR nova.virt.libvirt.driver [None req-15422dd8-a97b-4cc3-a221-6c4ab3c844b6 tempest-VolumesAssistedSnapshotsTest-1044178100 tempest-VolumesAssistedSnapshotsTest-1044178100-project] [instance: 576e97b7-285a-451f-a80d-aaa321a79d3b] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Nov 13 18:47:25 user nova-compute[75216]: ERROR nova.virt.libvirt.driver [instance: 576e97b7-285a-451f-a80d-aaa321a79d3b] Traceback (most recent call last):
Nov 13 18:47:25 user nova-compute[75216]: ERROR nova.virt.libvirt.driver [instance: 576e97b7-285a-451f-a80d-aaa321a79d3b]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 13 18:47:25 user nova-compute[75216]: ERROR nova.virt.libvirt.driver [instance: 576e97b7-285a-451f-a80d-aaa321a79d3b]     self._volume_snapshot_delete(context, instance, volume_id,
Nov 13 18:47:25 user nova-compute[75216]: ERROR nova.virt.libvirt.driver [instance: 576e97b7-285a-451f-a80d-aaa321a79d3b]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 13 18:47:25 user nova-compute[75216]: ERROR nova.virt.libvirt.driver [instance: 576e97b7-285a-451f-a80d-aaa321a79d3b]     if delete_info['type'] != 'qcow2':
Nov 13 18:47:25 user nova-compute[75216]: ERROR nova.virt.libvirt.driver [instance: 576e97b7-285a-451f-a80d-aaa321a79d3b] KeyError: 'type'
Nov 13 18:47:25 user nova-compute[75216]: ERROR nova.virt.libvirt.driver [instance: 576e97b7-285a-451f-a80d-aaa321a79d3b] 
Nov 13 18:47:25 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-2604b626-9a5a-4682-a29c-8a1e6eb2aaa5 tempest-TestVolumeSwap-1274447143 tempest-TestVolumeSwap-1274447143-project-admin] COPY block job progress, current cursor: 941621248 final cursor: 1073741824 {{(pid=75216) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 13 18:47:25 user nova-compute[75216]: ERROR nova.virt.libvirt.driver [None req-1989197a-3c60-43f4-bd47-7b97dc9d035b tempest-VolumesAssistedSnapshotsTest-1044178100 tempest-VolumesAssistedSnapshotsTest-1044178100-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot 8a1e223a-a7c6-4300-8035-f7e79e8e9225 could not be found.
Nov 13 18:47:25 user nova-compute[75216]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 13 18:47:25 user nova-compute[75216]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 13 18:47:25 user nova-compute[75216]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Nov 13 18:47:25 user nova-compute[75216]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 13 18:47:25 user nova-compute[75216]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 13 18:47:25 user nova-compute[75216]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 13 18:47:25 user nova-compute[75216]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 13 18:47:25 user nova-compute[75216]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 13 18:47:25 user nova-compute[75216]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 13 18:47:25 user nova-compute[75216]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 13 18:47:25 user nova-compute[75216]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Nov 13 18:47:25 user nova-compute[75216]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 13 18:47:25 user nova-compute[75216]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Nov 13 18:47:25 user nova-compute[75216]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 13 18:47:25 user nova-compute[75216]: ERROR nova.virt.libvirt.driver     raise value
Nov 13 18:47:25 user nova-compute[75216]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 13 18:47:25 user nova-compute[75216]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Nov 13 18:47:25 user nova-compute[75216]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 13 18:47:25 user nova-compute[75216]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 13 18:47:25 user nova-compute[75216]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 13 18:47:25 user nova-compute[75216]: ERROR nova.virt.libvirt.driver 
Nov 13 18:47:25 user nova-compute[75216]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 13 18:47:25 user nova-compute[75216]: ERROR nova.virt.libvirt.driver 
Nov 13 18:47:25 user nova-compute[75216]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 13 18:47:25 user nova-compute[75216]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 13 18:47:25 user nova-compute[75216]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 13 18:47:25 user nova-compute[75216]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 13 18:47:25 user nova-compute[75216]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 13 18:47:25 user nova-compute[75216]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 13 18:47:25 user nova-compute[75216]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 13 18:47:25 user nova-compute[75216]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 13 18:47:25 user nova-compute[75216]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 13 18:47:25 user nova-compute[75216]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 13 18:47:25 user nova-compute[75216]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 13 18:47:25 user nova-compute[75216]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 13 18:47:25 user nova-compute[75216]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 13 18:47:25 user nova-compute[75216]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 13 18:47:25 user nova-compute[75216]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 13 18:47:25 user nova-compute[75216]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot 8a1e223a-a7c6-4300-8035-f7e79e8e9225 could not be found. (HTTP 404) (Request-ID: req-205ebb1c-e90b-4ff4-8407-730d861877c6)
Nov 13 18:47:25 user nova-compute[75216]: ERROR nova.virt.libvirt.driver 
Nov 13 18:47:25 user nova-compute[75216]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 13 18:47:25 user nova-compute[75216]: ERROR nova.virt.libvirt.driver 
Nov 13 18:47:25 user nova-compute[75216]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 13 18:47:25 user nova-compute[75216]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 13 18:47:25 user nova-compute[75216]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 13 18:47:25 user nova-compute[75216]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 13 18:47:25 user nova-compute[75216]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 13 18:47:25 user nova-compute[75216]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 13 18:47:25 user nova-compute[75216]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 13 18:47:25 user nova-compute[75216]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 13 18:47:25 user nova-compute[75216]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 13 18:47:25 user nova-compute[75216]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 13 18:47:25 user nova-compute[75216]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 13 18:47:25 user nova-compute[75216]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 13 18:47:25 user nova-compute[75216]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 13 18:47:25 user nova-compute[75216]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 13 18:47:25 user nova-compute[75216]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 13 18:47:25 user nova-compute[75216]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 13 18:47:25 user nova-compute[75216]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 13 18:47:25 user nova-compute[75216]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 13 18:47:25 user nova-compute[75216]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 13 18:47:25 user nova-compute[75216]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 13 18:47:25 user nova-compute[75216]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 13 18:47:25 user nova-compute[75216]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 13 18:47:25 user nova-compute[75216]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 13 18:47:25 user nova-compute[75216]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot 8a1e223a-a7c6-4300-8035-f7e79e8e9225 could not be found.
Nov 13 18:47:25 user nova-compute[75216]: ERROR nova.virt.libvirt.driver 
Nov 13 18:47:25 user nova-compute[75216]: ERROR nova.virt.libvirt.driver [None req-15422dd8-a97b-4cc3-a221-6c4ab3c844b6 tempest-VolumesAssistedSnapshotsTest-1044178100 tempest-VolumesAssistedSnapshotsTest-1044178100-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 13 18:47:25 user nova-compute[75216]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 13 18:47:25 user nova-compute[75216]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 13 18:47:25 user nova-compute[75216]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Nov 13 18:47:25 user nova-compute[75216]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 13 18:47:25 user nova-compute[75216]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Nov 13 18:47:25 user nova-compute[75216]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Nov 13 18:47:25 user nova-compute[75216]: ERROR nova.virt.libvirt.driver 
Nov 13 18:47:25 user nova-compute[75216]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 13 18:47:25 user nova-compute[75216]: ERROR nova.virt.libvirt.driver 
Nov 13 18:47:25 user nova-compute[75216]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 13 18:47:25 user nova-compute[75216]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 13 18:47:25 user nova-compute[75216]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 13 18:47:25 user nova-compute[75216]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 13 18:47:25 user nova-compute[75216]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 13 18:47:25 user nova-compute[75216]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 13 18:47:25 user nova-compute[75216]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 13 18:47:25 user nova-compute[75216]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 13 18:47:25 user nova-compute[75216]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 13 18:47:25 user nova-compute[75216]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 13 18:47:25 user nova-compute[75216]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 13 18:47:25 user nova-compute[75216]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 13 18:47:25 user nova-compute[75216]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 13 18:47:25 user nova-compute[75216]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 13 18:47:25 user nova-compute[75216]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 13 18:47:25 user nova-compute[75216]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-a391ad5f-ec88-43c8-8700-e5eb3ab264bd)
Nov 13 18:47:25 user nova-compute[75216]: ERROR nova.virt.libvirt.driver 
Nov 13 18:47:25 user nova-compute[75216]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 13 18:47:25 user nova-compute[75216]: ERROR nova.virt.libvirt.driver 
Nov 13 18:47:25 user nova-compute[75216]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 13 18:47:25 user nova-compute[75216]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 13 18:47:25 user nova-compute[75216]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 13 18:47:25 user nova-compute[75216]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 13 18:47:25 user nova-compute[75216]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 13 18:47:25 user nova-compute[75216]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 13 18:47:25 user nova-compute[75216]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 13 18:47:25 user nova-compute[75216]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 13 18:47:25 user nova-compute[75216]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 13 18:47:25 user nova-compute[75216]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 13 18:47:25 user nova-compute[75216]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 13 18:47:25 user nova-compute[75216]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 13 18:47:25 user nova-compute[75216]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 13 18:47:25 user nova-compute[75216]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 13 18:47:25 user nova-compute[75216]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 13 18:47:25 user nova-compute[75216]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 13 18:47:25 user nova-compute[75216]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 13 18:47:25 user nova-compute[75216]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 13 18:47:25 user nova-compute[75216]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 13 18:47:25 user nova-compute[75216]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 13 18:47:25 user nova-compute[75216]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 13 18:47:25 user nova-compute[75216]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 13 18:47:25 user nova-compute[75216]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 13 18:47:25 user nova-compute[75216]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 13 18:47:25 user nova-compute[75216]: ERROR nova.virt.libvirt.driver 
Nov 13 18:47:25 user nova-compute[75216]: ERROR oslo_messaging.rpc.server [None req-1989197a-3c60-43f4-bd47-7b97dc9d035b tempest-VolumesAssistedSnapshotsTest-1044178100 tempest-VolumesAssistedSnapshotsTest-1044178100-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 13 18:47:25 user nova-compute[75216]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 13 18:47:25 user nova-compute[75216]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 13 18:47:25 user nova-compute[75216]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 13 18:47:25 user nova-compute[75216]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 13 18:47:25 user nova-compute[75216]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 13 18:47:25 user nova-compute[75216]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 13 18:47:25 user nova-compute[75216]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 13 18:47:25 user nova-compute[75216]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 13 18:47:25 user nova-compute[75216]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 13 18:47:25 user nova-compute[75216]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 13 18:47:25 user nova-compute[75216]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 13 18:47:25 user nova-compute[75216]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 13 18:47:25 user nova-compute[75216]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 13 18:47:25 user nova-compute[75216]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 13 18:47:25 user nova-compute[75216]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 13 18:47:25 user nova-compute[75216]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 13 18:47:25 user nova-compute[75216]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 13 18:47:25 user nova-compute[75216]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4505, in volume_snapshot_create
Nov 13 18:47:25 user nova-compute[75216]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Nov 13 18:47:25 user nova-compute[75216]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3597, in volume_snapshot_create
Nov 13 18:47:25 user nova-compute[75216]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 13 18:47:25 user nova-compute[75216]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 13 18:47:25 user nova-compute[75216]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 13 18:47:25 user nova-compute[75216]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 13 18:47:25 user nova-compute[75216]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 13 18:47:25 user nova-compute[75216]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 13 18:47:25 user nova-compute[75216]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Nov 13 18:47:25 user nova-compute[75216]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 13 18:47:25 user nova-compute[75216]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 13 18:47:25 user nova-compute[75216]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 13 18:47:25 user nova-compute[75216]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 13 18:47:25 user nova-compute[75216]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 13 18:47:25 user nova-compute[75216]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 13 18:47:25 user nova-compute[75216]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 13 18:47:25 user nova-compute[75216]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Nov 13 18:47:25 user nova-compute[75216]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 13 18:47:25 user nova-compute[75216]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Nov 13 18:47:25 user nova-compute[75216]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 13 18:47:25 user nova-compute[75216]: ERROR oslo_messaging.rpc.server     raise value
Nov 13 18:47:25 user nova-compute[75216]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 13 18:47:25 user nova-compute[75216]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Nov 13 18:47:25 user nova-compute[75216]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 13 18:47:25 user nova-compute[75216]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 13 18:47:25 user nova-compute[75216]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 13 18:47:25 user nova-compute[75216]: ERROR oslo_messaging.rpc.server 
Nov 13 18:47:25 user nova-compute[75216]: ERROR oslo_messaging.rpc.server [None req-15422dd8-a97b-4cc3-a221-6c4ab3c844b6 tempest-VolumesAssistedSnapshotsTest-1044178100 tempest-VolumesAssistedSnapshotsTest-1044178100-project] Exception during message handling: KeyError: 'type'
Nov 13 18:47:25 user nova-compute[75216]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 13 18:47:25 user nova-compute[75216]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 13 18:47:25 user nova-compute[75216]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 13 18:47:25 user nova-compute[75216]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 13 18:47:25 user nova-compute[75216]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 13 18:47:25 user nova-compute[75216]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 13 18:47:25 user nova-compute[75216]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 13 18:47:25 user nova-compute[75216]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 13 18:47:25 user nova-compute[75216]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 13 18:47:25 user nova-compute[75216]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 13 18:47:25 user nova-compute[75216]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 13 18:47:25 user nova-compute[75216]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 13 18:47:25 user nova-compute[75216]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 13 18:47:25 user nova-compute[75216]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 13 18:47:25 user nova-compute[75216]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 13 18:47:25 user nova-compute[75216]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 13 18:47:25 user nova-compute[75216]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 13 18:47:25 user nova-compute[75216]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4517, in volume_snapshot_delete
Nov 13 18:47:25 user nova-compute[75216]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Nov 13 18:47:25 user nova-compute[75216]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3853, in volume_snapshot_delete
Nov 13 18:47:25 user nova-compute[75216]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 13 18:47:25 user nova-compute[75216]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 13 18:47:25 user nova-compute[75216]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 13 18:47:25 user nova-compute[75216]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 13 18:47:25 user nova-compute[75216]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 13 18:47:25 user nova-compute[75216]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 13 18:47:25 user nova-compute[75216]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Nov 13 18:47:25 user nova-compute[75216]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 13 18:47:25 user nova-compute[75216]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Nov 13 18:47:25 user nova-compute[75216]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Nov 13 18:47:25 user nova-compute[75216]: ERROR oslo_messaging.rpc.server 
Nov 13 18:47:25 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-62a20587-5b7d-41eb-b545-9e475c72da58 tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Acquiring lock "3274203b-a985-4f28-9b45-3f83509ae782" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:47:25 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-62a20587-5b7d-41eb-b545-9e475c72da58 tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Lock "3274203b-a985-4f28-9b45-3f83509ae782" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:47:25 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-62a20587-5b7d-41eb-b545-9e475c72da58 tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Acquiring lock "3274203b-a985-4f28-9b45-3f83509ae782-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:47:25 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-62a20587-5b7d-41eb-b545-9e475c72da58 tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Lock "3274203b-a985-4f28-9b45-3f83509ae782-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:47:25 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-62a20587-5b7d-41eb-b545-9e475c72da58 tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Lock "3274203b-a985-4f28-9b45-3f83509ae782-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:47:25 user nova-compute[75216]: INFO nova.compute.manager [None req-62a20587-5b7d-41eb-b545-9e475c72da58 tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] Terminating instance
Nov 13 18:47:25 user nova-compute[75216]: DEBUG nova.compute.manager [None req-62a20587-5b7d-41eb-b545-9e475c72da58 tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] Start destroying the instance on the hypervisor. {{(pid=75216) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 18:47:25 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-5048db89-ee71-4f4d-9186-23c2bc140106 tempest-VolumesAssistedSnapshotsTest-1584726322 tempest-VolumesAssistedSnapshotsTest-1584726322-project-admin] Acquiring lock "576e97b7-285a-451f-a80d-aaa321a79d3b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:47:25 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-5048db89-ee71-4f4d-9186-23c2bc140106 tempest-VolumesAssistedSnapshotsTest-1584726322 tempest-VolumesAssistedSnapshotsTest-1584726322-project-admin] Lock "576e97b7-285a-451f-a80d-aaa321a79d3b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:47:25 user nova-compute[75216]: INFO nova.compute.manager [None req-5048db89-ee71-4f4d-9186-23c2bc140106 tempest-VolumesAssistedSnapshotsTest-1584726322 tempest-VolumesAssistedSnapshotsTest-1584726322-project-admin] [instance: 576e97b7-285a-451f-a80d-aaa321a79d3b] Detaching volume d72e8803-2ded-42f6-858f-803c16c2d2a4
Nov 13 18:47:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:47:25 user nova-compute[75216]: INFO nova.virt.block_device [None req-5048db89-ee71-4f4d-9186-23c2bc140106 tempest-VolumesAssistedSnapshotsTest-1584726322 tempest-VolumesAssistedSnapshotsTest-1584726322-project-admin] [instance: 576e97b7-285a-451f-a80d-aaa321a79d3b] Attempting to driver detach volume d72e8803-2ded-42f6-858f-803c16c2d2a4 from mountpoint /dev/vdb
Nov 13 18:47:25 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-2604b626-9a5a-4682-a29c-8a1e6eb2aaa5 tempest-TestVolumeSwap-1274447143 tempest-TestVolumeSwap-1274447143-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=75216) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 13 18:47:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:47:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:47:25 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-5048db89-ee71-4f4d-9186-23c2bc140106 tempest-VolumesAssistedSnapshotsTest-1584726322 tempest-VolumesAssistedSnapshotsTest-1584726322-project-admin] Attempting to detach device vdb from instance 576e97b7-285a-451f-a80d-aaa321a79d3b from the persistent domain config. {{(pid=75216) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 13 18:47:25 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-5048db89-ee71-4f4d-9186-23c2bc140106 tempest-VolumesAssistedSnapshotsTest-1584726322 tempest-VolumesAssistedSnapshotsTest-1584726322-project-admin] detach device xml: <disk type="block" device="disk">
Nov 13 18:47:25 user nova-compute[75216]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 18:47:25 user nova-compute[75216]:   <source dev="/dev/sdl"/>
Nov 13 18:47:25 user nova-compute[75216]:   <target dev="vdb" bus="virtio"/>
Nov 13 18:47:25 user nova-compute[75216]:   <serial>d72e8803-2ded-42f6-858f-803c16c2d2a4</serial>
Nov 13 18:47:25 user nova-compute[75216]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 18:47:25 user nova-compute[75216]: </disk>
Nov 13 18:47:25 user nova-compute[75216]:  {{(pid=75216) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 18:47:25 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-5048db89-ee71-4f4d-9186-23c2bc140106 tempest-VolumesAssistedSnapshotsTest-1584726322 tempest-VolumesAssistedSnapshotsTest-1584726322-project-admin] Successfully detached device vdb from instance 576e97b7-285a-451f-a80d-aaa321a79d3b from the persistent domain config.
Nov 13 18:47:25 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-5048db89-ee71-4f4d-9186-23c2bc140106 tempest-VolumesAssistedSnapshotsTest-1584726322 tempest-VolumesAssistedSnapshotsTest-1584726322-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 576e97b7-285a-451f-a80d-aaa321a79d3b from the live domain config. {{(pid=75216) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 13 18:47:25 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-5048db89-ee71-4f4d-9186-23c2bc140106 tempest-VolumesAssistedSnapshotsTest-1584726322 tempest-VolumesAssistedSnapshotsTest-1584726322-project-admin] detach device xml: <disk type="block" device="disk">
Nov 13 18:47:25 user nova-compute[75216]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 18:47:25 user nova-compute[75216]:   <source dev="/dev/sdl"/>
Nov 13 18:47:25 user nova-compute[75216]:   <target dev="vdb" bus="virtio"/>
Nov 13 18:47:25 user nova-compute[75216]:   <serial>d72e8803-2ded-42f6-858f-803c16c2d2a4</serial>
Nov 13 18:47:25 user nova-compute[75216]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 18:47:25 user nova-compute[75216]: </disk>
Nov 13 18:47:25 user nova-compute[75216]:  {{(pid=75216) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 18:47:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:47:25 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2604b626-9a5a-4682-a29c-8a1e6eb2aaa5 tempest-TestVolumeSwap-1274447143 tempest-TestVolumeSwap-1274447143-project-admin] [instance: 872856e5-cdc4-444e-8835-55e36708d776] calling os-brick to detach iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 18:47:25 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-2604b626-9a5a-4682-a29c-8a1e6eb2aaa5 tempest-TestVolumeSwap-1274447143 tempest-TestVolumeSwap-1274447143-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3a8669e40>, {'target_iqn': 'iqn.2010-10.org.openstack:f530e526-b4b9-405c-8bde-111e34095cc4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ReFEXBsZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, None), 'kwargs': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 18:47:25 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-2604b626-9a5a-4682-a29c-8a1e6eb2aaa5 tempest-TestVolumeSwap-1274447143 tempest-TestVolumeSwap-1274447143-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 18:47:25 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-2604b626-9a5a-4682-a29c-8a1e6eb2aaa5 tempest-TestVolumeSwap-1274447143 tempest-TestVolumeSwap-1274447143-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 18:47:25 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-2604b626-9a5a-4682-a29c-8a1e6eb2aaa5 tempest-TestVolumeSwap-1274447143 tempest-TestVolumeSwap-1274447143-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 18:47:25 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:47:25 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:25 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[43685f4a-ec02-417a-95c4-135e82638e0f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f530e526-b4b9-405c-8bde-111e34095cc4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d72e8803-2ded-42f6-858f-803c16c2d2a4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2a1a5e82-4f70-4668-94bd-4a842d826214\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0fc393f0-1356-404f-a87b-bed1fb91b924\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4cd9ea8a-0fbb-4dd4-b11c-fd661086e803\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:de3d195d-b8b4-4c79-a150-813952c640e8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:52f4339a-6a47-4877-b041-9c27d7be2e94\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aafa167c-c8ba-4509-88dc-33b3a07e940a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e823c6a1-f7e2-495f-a5dc-6fdfd2b19cf0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ba1efeb5-724e-4415-a5ed-12ce8c9489bc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:25 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-2604b626-9a5a-4682-a29c-8a1e6eb2aaa5 tempest-TestVolumeSwap-1274447143 tempest-TestVolumeSwap-1274447143-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 18:47:25 user nova-compute[75216]: No targets found.
Nov 13 18:47:25 user nova-compute[75216]: iSNS:
Nov 13 18:47:25 user nova-compute[75216]: No targets found.
Nov 13 18:47:25 user nova-compute[75216]: STATIC:
Nov 13 18:47:25 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:f530e526-b4b9-405c-8bde-111e34095cc4
Nov 13 18:47:25 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 18:47:25 user nova-compute[75216]:                 Iface Name: default
Nov 13 18:47:25 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:d72e8803-2ded-42f6-858f-803c16c2d2a4
Nov 13 18:47:25 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 18:47:25 user nova-compute[75216]:                 Iface Name: default
Nov 13 18:47:25 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:2a1a5e82-4f70-4668-94bd-4a842d826214
Nov 13 18:47:25 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 18:47:25 user nova-compute[75216]:                 Iface Name: default
Nov 13 18:47:25 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:0fc393f0-1356-404f-a87b-bed1fb91b924
Nov 13 18:47:25 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 18:47:25 user nova-compute[75216]:                 Iface Name: default
Nov 13 18:47:25 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:4cd9ea8a-0fbb-4dd4-b11c-fd661086e803
Nov 13 18:47:25 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 18:47:25 user nova-compute[75216]:                 Iface Name: default
Nov 13 18:47:25 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac
Nov 13 18:47:25 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 18:47:25 user nova-compute[75216]:                 Iface Name: default
Nov 13 18:47:25 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:de3d195d-b8b4-4c79-a150-813952c640e8
Nov 13 18:47:25 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 18:47:25 user nova-compute[75216]:                 Iface Name: default
Nov 13 18:47:25 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:52f4339a-6a47-4877-b041-9c27d7be2e94
Nov 13 18:47:25 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 18:47:25 user nova-compute[75216]:                 Iface Name: default
Nov 13 18:47:25 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:aafa167c-c8ba-4509-88dc-33b3a07e940a
Nov 13 18:47:25 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 18:47:25 user nova-compute[75216]:                 Iface Name: default
Nov 13 18:47:25 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:e823c6a1-f7e2-495f-a5dc-6fdfd2b19cf0
Nov 13 18:47:25 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 18:47:25 user nova-compute[75216]:                 Iface Name: default
Nov 13 18:47:25 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:ba1efeb5-724e-4415-a5ed-12ce8c9489bc
Nov 13 18:47:25 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 18:47:25 user nova-compute[75216]:                 Iface Name: default
Nov 13 18:47:25 user nova-compute[75216]: FIRMWARE:
Nov 13 18:47:25 user nova-compute[75216]: No targets found.
Nov 13 18:47:25 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 18:47:25 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-2604b626-9a5a-4682-a29c-8a1e6eb2aaa5 tempest-TestVolumeSwap-1274447143 tempest-TestVolumeSwap-1274447143-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 18:47:25 user nova-compute[75216]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 18:47:25 user nova-compute[75216]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75216) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 18:47:25 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-2604b626-9a5a-4682-a29c-8a1e6eb2aaa5 tempest-TestVolumeSwap-1274447143 tempest-TestVolumeSwap-1274447143-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f530e526-b4b9-405c-8bde-111e34095cc4', 0)] {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 18:47:25 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:25 user nova-compute[75216]: DEBUG nova.compute.manager [req-b85fe768-7f44-4781-bfee-723d7cc0caac req-0eb7c4fa-eb00-4f17-b8c6-dde92f92703d service nova] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] Received event network-vif-unplugged-217faeb3-4474-449c-ae9f-86e555ce7cd7 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:47:25 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-b85fe768-7f44-4781-bfee-723d7cc0caac req-0eb7c4fa-eb00-4f17-b8c6-dde92f92703d service nova] Acquiring lock "3274203b-a985-4f28-9b45-3f83509ae782-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:47:25 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-b85fe768-7f44-4781-bfee-723d7cc0caac req-0eb7c4fa-eb00-4f17-b8c6-dde92f92703d service nova] Lock "3274203b-a985-4f28-9b45-3f83509ae782-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:47:25 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-b85fe768-7f44-4781-bfee-723d7cc0caac req-0eb7c4fa-eb00-4f17-b8c6-dde92f92703d service nova] Lock "3274203b-a985-4f28-9b45-3f83509ae782-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:47:25 user nova-compute[75216]: DEBUG nova.compute.manager [req-b85fe768-7f44-4781-bfee-723d7cc0caac req-0eb7c4fa-eb00-4f17-b8c6-dde92f92703d service nova] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] No waiting events found dispatching network-vif-unplugged-217faeb3-4474-449c-ae9f-86e555ce7cd7 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:47:25 user nova-compute[75216]: DEBUG nova.compute.manager [req-b85fe768-7f44-4781-bfee-723d7cc0caac req-0eb7c4fa-eb00-4f17-b8c6-dde92f92703d service nova] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] Received event network-vif-unplugged-217faeb3-4474-449c-ae9f-86e555ce7cd7 for instance with task_state deleting. {{(pid=75216) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 18:47:25 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:25 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9886863-4645-40cb-a2df-56d4fbc7c495]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0fc393f0-1356-404f-a87b-bed1fb91b924\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2a1a5e82-4f70-4668-94bd-4a842d826214\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4cd9ea8a-0fbb-4dd4-b11c-fd661086e803\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:52f4339a-6a47-4877-b041-9c27d7be2e94\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aafa167c-c8ba-4509-88dc-33b3a07e940a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba1efeb5-724e-4415-a5ed-12ce8c9489bc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d72e8803-2ded-42f6-858f-803c16c2d2a4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:de3d195d-b8b4-4c79-a150-813952c640e8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e823c6a1-f7e2-495f-a5dc-6fdfd2b19cf0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f530e526-b4b9-405c-8bde-111e34095cc4\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:25 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:47:25 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:25 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[631a247d-7fd5-4623-8a90-80ad0dd0470f]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aafa167c-c8ba-4509-88dc-33b3a07e940a (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530e526-b4b9-405c-8bde-111e34095cc4 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cd9ea8a-0fbb-4dd4-b11c-fd661086e803 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d72e8803-2ded-42f6-858f-803c16c2d2a4 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba1efeb5-724e-4415-a5ed-12ce8c9489bc (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3d195d-b8b4-4c79-a150-813952c640e8 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fc393f0-1356-404f-a87b-bed1fb91b924 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a1a5e82-4f70-4668-94bd-4a842d826214 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e823c6a1-f7e2-495f-a5dc-6fdfd2b19cf0 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52f4339a-6a47-4877-b041-9c27d7be2e94 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac (non-flash)\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:25 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-2604b626-9a5a-4682-a29c-8a1e6eb2aaa5 tempest-TestVolumeSwap-1274447143 tempest-TestVolumeSwap-1274447143-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aafa167c-c8ba-4509-88dc-33b3a07e940a (non-flash)
Nov 13 18:47:25 user nova-compute[75216]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530e526-b4b9-405c-8bde-111e34095cc4 (non-flash)
Nov 13 18:47:25 user nova-compute[75216]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cd9ea8a-0fbb-4dd4-b11c-fd661086e803 (non-flash)
Nov 13 18:47:25 user nova-compute[75216]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d72e8803-2ded-42f6-858f-803c16c2d2a4 (non-flash)
Nov 13 18:47:25 user nova-compute[75216]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba1efeb5-724e-4415-a5ed-12ce8c9489bc (non-flash)
Nov 13 18:47:25 user nova-compute[75216]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3d195d-b8b4-4c79-a150-813952c640e8 (non-flash)
Nov 13 18:47:25 user nova-compute[75216]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fc393f0-1356-404f-a87b-bed1fb91b924 (non-flash)
Nov 13 18:47:25 user nova-compute[75216]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a1a5e82-4f70-4668-94bd-4a842d826214 (non-flash)
Nov 13 18:47:25 user nova-compute[75216]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e823c6a1-f7e2-495f-a5dc-6fdfd2b19cf0 (non-flash)
Nov 13 18:47:25 user nova-compute[75216]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52f4339a-6a47-4877-b041-9c27d7be2e94 (non-flash)
Nov 13 18:47:25 user nova-compute[75216]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac (non-flash)
Nov 13 18:47:25 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 18:47:25 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-2604b626-9a5a-4682-a29c-8a1e6eb2aaa5 tempest-TestVolumeSwap-1274447143 tempest-TestVolumeSwap-1274447143-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aafa167c-c8ba-4509-88dc-33b3a07e940a (non-flash)
Nov 13 18:47:25 user nova-compute[75216]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530e526-b4b9-405c-8bde-111e34095cc4 (non-flash)
Nov 13 18:47:25 user nova-compute[75216]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cd9ea8a-0fbb-4dd4-b11c-fd661086e803 (non-flash)
Nov 13 18:47:25 user nova-compute[75216]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d72e8803-2ded-42f6-858f-803c16c2d2a4 (non-flash)
Nov 13 18:47:25 user nova-compute[75216]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba1efeb5-724e-4415-a5ed-12ce8c9489bc (non-flash)
Nov 13 18:47:25 user nova-compute[75216]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3d195d-b8b4-4c79-a150-813952c640e8 (non-flash)
Nov 13 18:47:25 user nova-compute[75216]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fc393f0-1356-404f-a87b-bed1fb91b924 (non-flash)
Nov 13 18:47:25 user nova-compute[75216]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a1a5e82-4f70-4668-94bd-4a842d826214 (non-flash)
Nov 13 18:47:25 user nova-compute[75216]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e823c6a1-f7e2-495f-a5dc-6fdfd2b19cf0 (non-flash)
Nov 13 18:47:25 user nova-compute[75216]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52f4339a-6a47-4877-b041-9c27d7be2e94 (non-flash)
Nov 13 18:47:25 user nova-compute[75216]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac (non-flash)
Nov 13 18:47:25 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 18:47:25 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-2604b626-9a5a-4682-a29c-8a1e6eb2aaa5 tempest-TestVolumeSwap-1274447143 tempest-TestVolumeSwap-1274447143-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe3a82b3a30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f530e526-b4b9-405c-8bde-111e34095cc4'): ({'sdj'}, set())}) {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 18:47:25 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-2604b626-9a5a-4682-a29c-8a1e6eb2aaa5 tempest-TestVolumeSwap-1274447143 tempest-TestVolumeSwap-1274447143-project-admin] Removing single pathed devices sdj {{(pid=75216) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 18:47:25 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:47:25 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:25 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c09da8a-3e37-4d4e-ac4d-2a13e052fe17]: (4, ('path checker states:\nup                  11\n\npaths: 0\nbusy: False\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:25 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:25 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.021s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:25 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[783e38ac-6471-4bcb-bb9a-2ed35ef397c5]: (4, ('ok\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:25 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-2604b626-9a5a-4682-a29c-8a1e6eb2aaa5 tempest-TestVolumeSwap-1274447143 tempest-TestVolumeSwap-1274447143-project-admin] Flushing IO for device /dev/sdj {{(pid=75216) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 18:47:25 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:26 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.014s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:26 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbbb5b3c-3bb9-4cee-ab5c-d59759d0ccd7]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:26 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-2604b626-9a5a-4682-a29c-8a1e6eb2aaa5 tempest-TestVolumeSwap-1274447143 tempest-TestVolumeSwap-1274447143-project-admin] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=75216) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 18:47:26 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:26 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:47:26 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:47:26 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.066s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:26 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[30e6d877-d04b-4f50-933f-4c0fdf380465]: (4, ('1', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:26 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-2604b626-9a5a-4682-a29c-8a1e6eb2aaa5 tempest-TestVolumeSwap-1274447143 tempest-TestVolumeSwap-1274447143-project-admin] Checking to see if SCSI volumes sdj have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 18:47:26 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-2604b626-9a5a-4682-a29c-8a1e6eb2aaa5 tempest-TestVolumeSwap-1274447143 tempest-TestVolumeSwap-1274447143-project-admin] SCSI volumes sdj have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 18:47:26 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-2604b626-9a5a-4682-a29c-8a1e6eb2aaa5 tempest-TestVolumeSwap-1274447143 tempest-TestVolumeSwap-1274447143-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f530e526-b4b9-405c-8bde-111e34095cc4')] {{(pid=75216) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 18:47:26 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f530e526-b4b9-405c-8bde-111e34095cc4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:26 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f530e526-b4b9-405c-8bde-111e34095cc4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:26 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[52164d94-c556-490d-8eae-66fbbe3f3fa7]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:26 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-2604b626-9a5a-4682-a29c-8a1e6eb2aaa5 tempest-TestVolumeSwap-1274447143 tempest-TestVolumeSwap-1274447143-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:47:26 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f530e526-b4b9-405c-8bde-111e34095cc4 -p 172.16.0.220:3260 --logout {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:26 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:47:26 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:47:26 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:47:26 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-5048db89-ee71-4f4d-9186-23c2bc140106 tempest-VolumesAssistedSnapshotsTest-1584726322 tempest-VolumesAssistedSnapshotsTest-1584726322-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 576e97b7-285a-451f-a80d-aaa321a79d3b {{(pid=75216) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 13 18:47:26 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:47:26 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f530e526-b4b9-405c-8bde-111e34095cc4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.142s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:26 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[91b62ab4-bca3-4d0d-b78a-f4c91cfea792]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:f530e526-b4b9-405c-8bde-111e34095cc4, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:f530e526-b4b9-405c-8bde-111e34095cc4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:26 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-2604b626-9a5a-4682-a29c-8a1e6eb2aaa5 tempest-TestVolumeSwap-1274447143 tempest-TestVolumeSwap-1274447143-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:f530e526-b4b9-405c-8bde-111e34095cc4, portal: 172.16.0.220,3260]
Nov 13 18:47:26 user nova-compute[75216]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:f530e526-b4b9-405c-8bde-111e34095cc4, portal: 172.16.0.220,3260] successful.
Nov 13 18:47:26 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:47:26 user nova-compute[75216]: DEBUG nova.compute.manager [req-d8ea920d-241c-4edb-9d26-b1df5ac99340 req-67cd069b-27e1-47d9-8014-23bef62543ad service nova] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] Received event network-vif-unplugged-7aa7e71d-2c00-40fd-9d05-d108bcc807ec {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:47:26 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-d8ea920d-241c-4edb-9d26-b1df5ac99340 req-67cd069b-27e1-47d9-8014-23bef62543ad service nova] Acquiring lock "3274203b-a985-4f28-9b45-3f83509ae782-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:47:26 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-d8ea920d-241c-4edb-9d26-b1df5ac99340 req-67cd069b-27e1-47d9-8014-23bef62543ad service nova] Lock "3274203b-a985-4f28-9b45-3f83509ae782-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:47:26 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-d8ea920d-241c-4edb-9d26-b1df5ac99340 req-67cd069b-27e1-47d9-8014-23bef62543ad service nova] Lock "3274203b-a985-4f28-9b45-3f83509ae782-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:47:26 user nova-compute[75216]: DEBUG nova.compute.manager [req-d8ea920d-241c-4edb-9d26-b1df5ac99340 req-67cd069b-27e1-47d9-8014-23bef62543ad service nova] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] No waiting events found dispatching network-vif-unplugged-7aa7e71d-2c00-40fd-9d05-d108bcc807ec {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:47:26 user nova-compute[75216]: DEBUG nova.compute.manager [req-d8ea920d-241c-4edb-9d26-b1df5ac99340 req-67cd069b-27e1-47d9-8014-23bef62543ad service nova] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] Received event network-vif-unplugged-7aa7e71d-2c00-40fd-9d05-d108bcc807ec for instance with task_state deleting. {{(pid=75216) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 18:47:26 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f530e526-b4b9-405c-8bde-111e34095cc4 -p 172.16.0.220:3260 --op delete {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:26 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:47:26 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f530e526-b4b9-405c-8bde-111e34095cc4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.041s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:26 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[86b6c650-e40d-4c0d-afae-89be133ae622]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:26 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-2604b626-9a5a-4682-a29c-8a1e6eb2aaa5 tempest-TestVolumeSwap-1274447143 tempest-TestVolumeSwap-1274447143-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:47:26 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-2604b626-9a5a-4682-a29c-8a1e6eb2aaa5 tempest-TestVolumeSwap-1274447143 tempest-TestVolumeSwap-1274447143-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.496s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 18:47:26 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-2604b626-9a5a-4682-a29c-8a1e6eb2aaa5 tempest-TestVolumeSwap-1274447143 tempest-TestVolumeSwap-1274447143-project-admin] <== disconnect_volume: return (497ms) None {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 18:47:26 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2604b626-9a5a-4682-a29c-8a1e6eb2aaa5 tempest-TestVolumeSwap-1274447143 tempest-TestVolumeSwap-1274447143-project-admin] [instance: 872856e5-cdc4-444e-8835-55e36708d776] Disconnected iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 18:47:26 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:47:26 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:47:26 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:47:26 user nova-compute[75216]: DEBUG nova.compute.manager [None req-2604b626-9a5a-4682-a29c-8a1e6eb2aaa5 tempest-TestVolumeSwap-1274447143 tempest-TestVolumeSwap-1274447143-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4cd9ea8a-0fbb-4dd4-b11c-fd661086e803', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DbhNcyvG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk'}, 'status': 'reserved', 'instance': '872856e5-cdc4-444e-8835-55e36708d776', 'attached_at': '', 'detached_at': '', 'volume_id': '4cd9ea8a-0fbb-4dd4-b11c-fd661086e803', 'serial'} {{(pid=75216) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 13 18:47:26 user nova-compute[75216]: DEBUG nova.compute.manager [None req-2604b626-9a5a-4682-a29c-8a1e6eb2aaa5 tempest-TestVolumeSwap-1274447143 tempest-TestVolumeSwap-1274447143-project-admin] [instance: 872856e5-cdc4-444e-8835-55e36708d776] swap_volume: removing Cinder connection for volume f530e526-b4b9-405c-8bde-111e34095cc4 {{(pid=75216) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 13 18:47:26 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:47:26 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:47:26 user nova-compute[75216]: DEBUG nova.compute.manager [req-769b8e3e-40a6-41a7-ace7-81ef8856f8e4 req-1e74e949-61d3-459d-8b6e-c6f46192ac6f service nova] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] Received event network-vif-unplugged-1bb4df6f-02b2-415b-9cea-fd8a7a04874c {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:47:26 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-769b8e3e-40a6-41a7-ace7-81ef8856f8e4 req-1e74e949-61d3-459d-8b6e-c6f46192ac6f service nova] Acquiring lock "3274203b-a985-4f28-9b45-3f83509ae782-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:47:26 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-769b8e3e-40a6-41a7-ace7-81ef8856f8e4 req-1e74e949-61d3-459d-8b6e-c6f46192ac6f service nova] Lock "3274203b-a985-4f28-9b45-3f83509ae782-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:47:26 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-769b8e3e-40a6-41a7-ace7-81ef8856f8e4 req-1e74e949-61d3-459d-8b6e-c6f46192ac6f service nova] Lock "3274203b-a985-4f28-9b45-3f83509ae782-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:47:26 user nova-compute[75216]: DEBUG nova.compute.manager [req-769b8e3e-40a6-41a7-ace7-81ef8856f8e4 req-1e74e949-61d3-459d-8b6e-c6f46192ac6f service nova] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] No waiting events found dispatching network-vif-unplugged-1bb4df6f-02b2-415b-9cea-fd8a7a04874c {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:47:26 user nova-compute[75216]: DEBUG nova.compute.manager [req-769b8e3e-40a6-41a7-ace7-81ef8856f8e4 req-1e74e949-61d3-459d-8b6e-c6f46192ac6f service nova] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] Received event network-vif-unplugged-1bb4df6f-02b2-415b-9cea-fd8a7a04874c for instance with task_state deleting. {{(pid=75216) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 18:47:26 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:47:26 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:47:26 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:47:26 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:47:27 user nova-compute[75216]: DEBUG nova.compute.manager [None req-2604b626-9a5a-4682-a29c-8a1e6eb2aaa5 tempest-TestVolumeSwap-1274447143 tempest-TestVolumeSwap-1274447143-project-admin] [instance: 872856e5-cdc4-444e-8835-55e36708d776] swap_volume: Updating volume f530e526-b4b9-405c-8bde-111e34095cc4 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:4cd9ea8a-0fbb-4dd4-b11c-fd661086e803", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "DbhNcyvG", "auth_password": "RHlYoicrCuSTKN", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdk", "volume_id": "4cd9ea8a-0fbb-4dd4-b11c-fd661086e803"}, "status": "reserved", "instance": "872856e5-cdc4-444e-8835-55e36708d776", "attached_at": "", "detached_at": "", "volume_id": "4cd9ea8a-0fbb-4dd4-b11c-fd661086e803", "serial": "4cd9ea8a-0fbb-4dd4-b11c-fd661086e803"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '4cd9ea8a-0fbb-4dd4-b11c-fd661086e803', 'no_device': None, 'attachment_id': '0eece3af-fc83-4e50-86d4-7237d6f4176b'} {{(pid=75216) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 13 18:47:27 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-2604b626-9a5a-4682-a29c-8a1e6eb2aaa5 tempest-TestVolumeSwap-1274447143 tempest-TestVolumeSwap-1274447143-project-admin] Lock "872856e5-cdc4-444e-8835-55e36708d776" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 11.864s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:47:27 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] Instance destroyed successfully.
Nov 13 18:47:27 user nova-compute[75216]: DEBUG nova.objects.instance [None req-62a20587-5b7d-41eb-b545-9e475c72da58 tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Lazy-loading 'resources' on Instance uuid 3274203b-a985-4f28-9b45-3f83509ae782 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 18:47:27 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-62a20587-5b7d-41eb-b545-9e475c72da58 tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T18:45:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-835191015',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-835191015',id=9,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEhfcD46zss7ONQ1SY+r8F1CQFXVOm5N4z75azo3v6RrQS7/wvwfpVFyai5x8zqx3fdjrh60HyXnAzyj7itmyT24OjHnNNB9Ltm77zsQMNNIJ86VCYN8lCciAo2iDKAK3g==',key_name='tempest-keypair-557064356',keypairs=<?>,launch_index=0,launched_at=2023-11-13T18:46:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a8d0f284dd8d4cc88f04a729b1d5d38c',ramdisk_id='',reservation_id='r-7thq8eg2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1999686773',owner_user_name='tempest-TaggedBootDevicesTest_v242-1999686773-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T18:46:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2fd1904e6cdb4600a2e250aefdc0f0ce',uuid=3274203b-a985-4f28-9b45-3f83509ae782,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "217faeb3-4474-449c-ae9f-86e555ce7cd7", "address": "fa:16:3e:49:58:83", "network": {"id": "804f3c05-e540-4bae-a58f-682133e0c762", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-619032523-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8d0f284dd8d4cc88f04a729b1d5d38c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap217faeb3-44", "ovs_interfaceid": "217faeb3-4474-449c-ae9f-86e555ce7cd7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 18:47:27 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-62a20587-5b7d-41eb-b545-9e475c72da58 tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Converting VIF {"id": "217faeb3-4474-449c-ae9f-86e555ce7cd7", "address": "fa:16:3e:49:58:83", "network": {"id": "804f3c05-e540-4bae-a58f-682133e0c762", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-619032523-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8d0f284dd8d4cc88f04a729b1d5d38c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap217faeb3-44", "ovs_interfaceid": "217faeb3-4474-449c-ae9f-86e555ce7cd7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 18:47:27 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-62a20587-5b7d-41eb-b545-9e475c72da58 tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:49:58:83,bridge_name='br-int',has_traffic_filtering=True,id=217faeb3-4474-449c-ae9f-86e555ce7cd7,network=Network(804f3c05-e540-4bae-a58f-682133e0c762),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap217faeb3-44') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 18:47:27 user nova-compute[75216]: DEBUG os_vif [None req-62a20587-5b7d-41eb-b545-9e475c72da58 tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:49:58:83,bridge_name='br-int',has_traffic_filtering=True,id=217faeb3-4474-449c-ae9f-86e555ce7cd7,network=Network(804f3c05-e540-4bae-a58f-682133e0c762),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap217faeb3-44') {{(pid=75216) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 18:47:27 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:47:27 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap217faeb3-44, bridge=br-int, if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:47:27 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:47:27 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:47:27 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:47:27 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:47:27 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b4ead642-b55d-4fe2-926b-dc7723f37c51) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:47:27 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:47:27 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:47:27 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:47:27 user nova-compute[75216]: INFO os_vif [None req-62a20587-5b7d-41eb-b545-9e475c72da58 tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:49:58:83,bridge_name='br-int',has_traffic_filtering=True,id=217faeb3-4474-449c-ae9f-86e555ce7cd7,network=Network(804f3c05-e540-4bae-a58f-682133e0c762),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap217faeb3-44')
Nov 13 18:47:27 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-62a20587-5b7d-41eb-b545-9e475c72da58 tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T18:45:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-835191015',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-835191015',id=9,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEhfcD46zss7ONQ1SY+r8F1CQFXVOm5N4z75azo3v6RrQS7/wvwfpVFyai5x8zqx3fdjrh60HyXnAzyj7itmyT24OjHnNNB9Ltm77zsQMNNIJ86VCYN8lCciAo2iDKAK3g==',key_name='tempest-keypair-557064356',keypairs=<?>,launch_index=0,launched_at=2023-11-13T18:46:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a8d0f284dd8d4cc88f04a729b1d5d38c',ramdisk_id='',reservation_id='r-7thq8eg2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1999686773',owner_user_name='tempest-TaggedBootDevicesTest_v242-1999686773-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T18:46:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2fd1904e6cdb4600a2e250aefdc0f0ce',uuid=3274203b-a985-4f28-9b45-3f83509ae782,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9bed3978-d90d-4b90-b798-12413ea26a48", "address": "fa:16:3e:17:08:ae", "network": {"id": "590b5147-c33a-45bd-a502-8fd41408064d", "bridge": "br-int", "label": "tempest-device-tagging-net1-904391500", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a8d0f284dd8d4cc88f04a729b1d5d38c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bed3978-d9", "ovs_interfaceid": "9bed3978-d90d-4b90-b798-12413ea26a48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75216) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 18:47:27 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-62a20587-5b7d-41eb-b545-9e475c72da58 tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Converting VIF {"id": "9bed3978-d90d-4b90-b798-12413ea26a48", "address": "fa:16:3e:17:08:ae", "network": {"id": "590b5147-c33a-45bd-a502-8fd41408064d", "bridge": "br-int", "label": "tempest-device-tagging-net1-904391500", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a8d0f284dd8d4cc88f04a729b1d5d38c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bed3978-d9", "ovs_interfaceid": "9bed3978-d90d-4b90-b798-12413ea26a48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 18:47:27 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-62a20587-5b7d-41eb-b545-9e475c72da58 tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:08:ae,bridge_name='br-int',has_traffic_filtering=True,id=9bed3978-d90d-4b90-b798-12413ea26a48,network=Network(590b5147-c33a-45bd-a502-8fd41408064d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9bed3978-d9') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 18:47:27 user nova-compute[75216]: DEBUG os_vif [None req-62a20587-5b7d-41eb-b545-9e475c72da58 tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:08:ae,bridge_name='br-int',has_traffic_filtering=True,id=9bed3978-d90d-4b90-b798-12413ea26a48,network=Network(590b5147-c33a-45bd-a502-8fd41408064d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9bed3978-d9') {{(pid=75216) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 18:47:27 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:47:27 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9bed3978-d9, bridge=br-int, if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:47:27 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:47:27 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:47:27 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:47:27 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:47:27 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=61eae569-e7b9-4c30-bce6-3f8ddfd27a57) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:47:27 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:47:27 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:47:27 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:47:27 user nova-compute[75216]: INFO os_vif [None req-62a20587-5b7d-41eb-b545-9e475c72da58 tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:08:ae,bridge_name='br-int',has_traffic_filtering=True,id=9bed3978-d90d-4b90-b798-12413ea26a48,network=Network(590b5147-c33a-45bd-a502-8fd41408064d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9bed3978-d9')
Nov 13 18:47:27 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-62a20587-5b7d-41eb-b545-9e475c72da58 tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T18:45:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-835191015',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-835191015',id=9,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEhfcD46zss7ONQ1SY+r8F1CQFXVOm5N4z75azo3v6RrQS7/wvwfpVFyai5x8zqx3fdjrh60HyXnAzyj7itmyT24OjHnNNB9Ltm77zsQMNNIJ86VCYN8lCciAo2iDKAK3g==',key_name='tempest-keypair-557064356',keypairs=<?>,launch_index=0,launched_at=2023-11-13T18:46:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a8d0f284dd8d4cc88f04a729b1d5d38c',ramdisk_id='',reservation_id='r-7thq8eg2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1999686773',owner_user_name='tempest-TaggedBootDevicesTest_v242-1999686773-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T18:46:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2fd1904e6cdb4600a2e250aefdc0f0ce',uuid=3274203b-a985-4f28-9b45-3f83509ae782,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "95a425c5-f994-4504-a94b-040103b2efa7", "address": "fa:16:3e:02:ea:af", "network": {"id": "590b5147-c33a-45bd-a502-8fd41408064d", "bridge": "br-int", "label": "tempest-device-tagging-net1-904391500", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.40", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a8d0f284dd8d4cc88f04a729b1d5d38c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95a425c5-f9", "ovs_interfaceid": "95a425c5-f994-4504-a94b-040103b2efa7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75216) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 18:47:27 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-62a20587-5b7d-41eb-b545-9e475c72da58 tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Converting VIF {"id": "95a425c5-f994-4504-a94b-040103b2efa7", "address": "fa:16:3e:02:ea:af", "network": {"id": "590b5147-c33a-45bd-a502-8fd41408064d", "bridge": "br-int", "label": "tempest-device-tagging-net1-904391500", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.40", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a8d0f284dd8d4cc88f04a729b1d5d38c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95a425c5-f9", "ovs_interfaceid": "95a425c5-f994-4504-a94b-040103b2efa7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 18:47:27 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-62a20587-5b7d-41eb-b545-9e475c72da58 tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:ea:af,bridge_name='br-int',has_traffic_filtering=True,id=95a425c5-f994-4504-a94b-040103b2efa7,network=Network(590b5147-c33a-45bd-a502-8fd41408064d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap95a425c5-f9') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 18:47:27 user nova-compute[75216]: DEBUG os_vif [None req-62a20587-5b7d-41eb-b545-9e475c72da58 tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:ea:af,bridge_name='br-int',has_traffic_filtering=True,id=95a425c5-f994-4504-a94b-040103b2efa7,network=Network(590b5147-c33a-45bd-a502-8fd41408064d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap95a425c5-f9') {{(pid=75216) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 18:47:27 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:47:27 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap95a425c5-f9, bridge=br-int, if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:47:27 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:47:27 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:47:27 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:47:27 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:47:27 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=11a584cd-dd6d-4b9c-8ff7-766f4cc6b24b) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:47:27 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:47:27 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG nova.compute.manager [req-e1d71db0-5097-4f49-ab67-7aa9afbfaaaa req-fe8c10b4-2850-455a-aa0a-119116f074fd service nova] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] Received event network-vif-plugged-217faeb3-4474-449c-ae9f-86e555ce7cd7 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-e1d71db0-5097-4f49-ab67-7aa9afbfaaaa req-fe8c10b4-2850-455a-aa0a-119116f074fd service nova] Acquiring lock "3274203b-a985-4f28-9b45-3f83509ae782-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-e1d71db0-5097-4f49-ab67-7aa9afbfaaaa req-fe8c10b4-2850-455a-aa0a-119116f074fd service nova] Lock "3274203b-a985-4f28-9b45-3f83509ae782-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-e1d71db0-5097-4f49-ab67-7aa9afbfaaaa req-fe8c10b4-2850-455a-aa0a-119116f074fd service nova] Lock "3274203b-a985-4f28-9b45-3f83509ae782-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG nova.compute.manager [req-e1d71db0-5097-4f49-ab67-7aa9afbfaaaa req-fe8c10b4-2850-455a-aa0a-119116f074fd service nova] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] No waiting events found dispatching network-vif-plugged-217faeb3-4474-449c-ae9f-86e555ce7cd7 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:47:28 user nova-compute[75216]: WARNING nova.compute.manager [req-e1d71db0-5097-4f49-ab67-7aa9afbfaaaa req-fe8c10b4-2850-455a-aa0a-119116f074fd service nova] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] Received unexpected event network-vif-plugged-217faeb3-4474-449c-ae9f-86e555ce7cd7 for instance with vm_state active and task_state deleting.
Nov 13 18:47:28 user nova-compute[75216]: DEBUG nova.compute.manager [req-e1d71db0-5097-4f49-ab67-7aa9afbfaaaa req-fe8c10b4-2850-455a-aa0a-119116f074fd service nova] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] Received event network-vif-unplugged-9bed3978-d90d-4b90-b798-12413ea26a48 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-e1d71db0-5097-4f49-ab67-7aa9afbfaaaa req-fe8c10b4-2850-455a-aa0a-119116f074fd service nova] Acquiring lock "3274203b-a985-4f28-9b45-3f83509ae782-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-e1d71db0-5097-4f49-ab67-7aa9afbfaaaa req-fe8c10b4-2850-455a-aa0a-119116f074fd service nova] Lock "3274203b-a985-4f28-9b45-3f83509ae782-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-e1d71db0-5097-4f49-ab67-7aa9afbfaaaa req-fe8c10b4-2850-455a-aa0a-119116f074fd service nova] Lock "3274203b-a985-4f28-9b45-3f83509ae782-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG nova.compute.manager [req-e1d71db0-5097-4f49-ab67-7aa9afbfaaaa req-fe8c10b4-2850-455a-aa0a-119116f074fd service nova] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] No waiting events found dispatching network-vif-unplugged-9bed3978-d90d-4b90-b798-12413ea26a48 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG nova.compute.manager [req-e1d71db0-5097-4f49-ab67-7aa9afbfaaaa req-fe8c10b4-2850-455a-aa0a-119116f074fd service nova] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] Received event network-vif-unplugged-9bed3978-d90d-4b90-b798-12413ea26a48 for instance with task_state deleting. {{(pid=75216) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG nova.compute.manager [req-e1d71db0-5097-4f49-ab67-7aa9afbfaaaa req-fe8c10b4-2850-455a-aa0a-119116f074fd service nova] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] Received event network-vif-plugged-9bed3978-d90d-4b90-b798-12413ea26a48 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-e1d71db0-5097-4f49-ab67-7aa9afbfaaaa req-fe8c10b4-2850-455a-aa0a-119116f074fd service nova] Acquiring lock "3274203b-a985-4f28-9b45-3f83509ae782-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-e1d71db0-5097-4f49-ab67-7aa9afbfaaaa req-fe8c10b4-2850-455a-aa0a-119116f074fd service nova] Lock "3274203b-a985-4f28-9b45-3f83509ae782-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-e1d71db0-5097-4f49-ab67-7aa9afbfaaaa req-fe8c10b4-2850-455a-aa0a-119116f074fd service nova] Lock "3274203b-a985-4f28-9b45-3f83509ae782-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG nova.compute.manager [req-e1d71db0-5097-4f49-ab67-7aa9afbfaaaa req-fe8c10b4-2850-455a-aa0a-119116f074fd service nova] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] No waiting events found dispatching network-vif-plugged-9bed3978-d90d-4b90-b798-12413ea26a48 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:47:28 user nova-compute[75216]: WARNING nova.compute.manager [req-e1d71db0-5097-4f49-ab67-7aa9afbfaaaa req-fe8c10b4-2850-455a-aa0a-119116f074fd service nova] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] Received unexpected event network-vif-plugged-9bed3978-d90d-4b90-b798-12413ea26a48 for instance with vm_state active and task_state deleting.
Nov 13 18:47:28 user nova-compute[75216]: DEBUG nova.compute.manager [req-e1d71db0-5097-4f49-ab67-7aa9afbfaaaa req-fe8c10b4-2850-455a-aa0a-119116f074fd service nova] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] Received event network-vif-unplugged-95a425c5-f994-4504-a94b-040103b2efa7 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-e1d71db0-5097-4f49-ab67-7aa9afbfaaaa req-fe8c10b4-2850-455a-aa0a-119116f074fd service nova] Acquiring lock "3274203b-a985-4f28-9b45-3f83509ae782-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-e1d71db0-5097-4f49-ab67-7aa9afbfaaaa req-fe8c10b4-2850-455a-aa0a-119116f074fd service nova] Lock "3274203b-a985-4f28-9b45-3f83509ae782-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-e1d71db0-5097-4f49-ab67-7aa9afbfaaaa req-fe8c10b4-2850-455a-aa0a-119116f074fd service nova] Lock "3274203b-a985-4f28-9b45-3f83509ae782-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG nova.compute.manager [req-e1d71db0-5097-4f49-ab67-7aa9afbfaaaa req-fe8c10b4-2850-455a-aa0a-119116f074fd service nova] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] No waiting events found dispatching network-vif-unplugged-95a425c5-f994-4504-a94b-040103b2efa7 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG nova.compute.manager [req-e1d71db0-5097-4f49-ab67-7aa9afbfaaaa req-fe8c10b4-2850-455a-aa0a-119116f074fd service nova] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] Received event network-vif-unplugged-95a425c5-f994-4504-a94b-040103b2efa7 for instance with task_state deleting. {{(pid=75216) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG nova.compute.manager [req-e1d71db0-5097-4f49-ab67-7aa9afbfaaaa req-fe8c10b4-2850-455a-aa0a-119116f074fd service nova] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] Received event network-vif-plugged-95a425c5-f994-4504-a94b-040103b2efa7 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-e1d71db0-5097-4f49-ab67-7aa9afbfaaaa req-fe8c10b4-2850-455a-aa0a-119116f074fd service nova] Acquiring lock "3274203b-a985-4f28-9b45-3f83509ae782-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-e1d71db0-5097-4f49-ab67-7aa9afbfaaaa req-fe8c10b4-2850-455a-aa0a-119116f074fd service nova] Lock "3274203b-a985-4f28-9b45-3f83509ae782-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-e1d71db0-5097-4f49-ab67-7aa9afbfaaaa req-fe8c10b4-2850-455a-aa0a-119116f074fd service nova] Lock "3274203b-a985-4f28-9b45-3f83509ae782-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG nova.compute.manager [req-e1d71db0-5097-4f49-ab67-7aa9afbfaaaa req-fe8c10b4-2850-455a-aa0a-119116f074fd service nova] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] No waiting events found dispatching network-vif-plugged-95a425c5-f994-4504-a94b-040103b2efa7 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:47:28 user nova-compute[75216]: WARNING nova.compute.manager [req-e1d71db0-5097-4f49-ab67-7aa9afbfaaaa req-fe8c10b4-2850-455a-aa0a-119116f074fd service nova] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] Received unexpected event network-vif-plugged-95a425c5-f994-4504-a94b-040103b2efa7 for instance with vm_state active and task_state deleting.
Nov 13 18:47:28 user nova-compute[75216]: DEBUG nova.compute.manager [req-e1d71db0-5097-4f49-ab67-7aa9afbfaaaa req-fe8c10b4-2850-455a-aa0a-119116f074fd service nova] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] Received event network-vif-unplugged-a07efcd3-59f4-452e-8fb7-8b8233ae235f {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-e1d71db0-5097-4f49-ab67-7aa9afbfaaaa req-fe8c10b4-2850-455a-aa0a-119116f074fd service nova] Acquiring lock "3274203b-a985-4f28-9b45-3f83509ae782-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-e1d71db0-5097-4f49-ab67-7aa9afbfaaaa req-fe8c10b4-2850-455a-aa0a-119116f074fd service nova] Lock "3274203b-a985-4f28-9b45-3f83509ae782-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-e1d71db0-5097-4f49-ab67-7aa9afbfaaaa req-fe8c10b4-2850-455a-aa0a-119116f074fd service nova] Lock "3274203b-a985-4f28-9b45-3f83509ae782-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG nova.compute.manager [req-e1d71db0-5097-4f49-ab67-7aa9afbfaaaa req-fe8c10b4-2850-455a-aa0a-119116f074fd service nova] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] No waiting events found dispatching network-vif-unplugged-a07efcd3-59f4-452e-8fb7-8b8233ae235f {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG nova.compute.manager [req-e1d71db0-5097-4f49-ab67-7aa9afbfaaaa req-fe8c10b4-2850-455a-aa0a-119116f074fd service nova] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] Received event network-vif-unplugged-a07efcd3-59f4-452e-8fb7-8b8233ae235f for instance with task_state deleting. {{(pid=75216) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG nova.compute.manager [req-e1d71db0-5097-4f49-ab67-7aa9afbfaaaa req-fe8c10b4-2850-455a-aa0a-119116f074fd service nova] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] Received event network-vif-plugged-a07efcd3-59f4-452e-8fb7-8b8233ae235f {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-e1d71db0-5097-4f49-ab67-7aa9afbfaaaa req-fe8c10b4-2850-455a-aa0a-119116f074fd service nova] Acquiring lock "3274203b-a985-4f28-9b45-3f83509ae782-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-e1d71db0-5097-4f49-ab67-7aa9afbfaaaa req-fe8c10b4-2850-455a-aa0a-119116f074fd service nova] Lock "3274203b-a985-4f28-9b45-3f83509ae782-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-e1d71db0-5097-4f49-ab67-7aa9afbfaaaa req-fe8c10b4-2850-455a-aa0a-119116f074fd service nova] Lock "3274203b-a985-4f28-9b45-3f83509ae782-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG nova.compute.manager [req-e1d71db0-5097-4f49-ab67-7aa9afbfaaaa req-fe8c10b4-2850-455a-aa0a-119116f074fd service nova] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] No waiting events found dispatching network-vif-plugged-a07efcd3-59f4-452e-8fb7-8b8233ae235f {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:47:28 user nova-compute[75216]: WARNING nova.compute.manager [req-e1d71db0-5097-4f49-ab67-7aa9afbfaaaa req-fe8c10b4-2850-455a-aa0a-119116f074fd service nova] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] Received unexpected event network-vif-plugged-a07efcd3-59f4-452e-8fb7-8b8233ae235f for instance with vm_state active and task_state deleting.
Nov 13 18:47:28 user nova-compute[75216]: INFO os_vif [None req-62a20587-5b7d-41eb-b545-9e475c72da58 tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:ea:af,bridge_name='br-int',has_traffic_filtering=True,id=95a425c5-f994-4504-a94b-040103b2efa7,network=Network(590b5147-c33a-45bd-a502-8fd41408064d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap95a425c5-f9')
Nov 13 18:47:28 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-62a20587-5b7d-41eb-b545-9e475c72da58 tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T18:45:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-835191015',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-835191015',id=9,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEhfcD46zss7ONQ1SY+r8F1CQFXVOm5N4z75azo3v6RrQS7/wvwfpVFyai5x8zqx3fdjrh60HyXnAzyj7itmyT24OjHnNNB9Ltm77zsQMNNIJ86VCYN8lCciAo2iDKAK3g==',key_name='tempest-keypair-557064356',keypairs=<?>,launch_index=0,launched_at=2023-11-13T18:46:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a8d0f284dd8d4cc88f04a729b1d5d38c',ramdisk_id='',reservation_id='r-7thq8eg2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1999686773',owner_user_name='tempest-TaggedBootDevicesTest_v242-1999686773-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T18:46:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2fd1904e6cdb4600a2e250aefdc0f0ce',uuid=3274203b-a985-4f28-9b45-3f83509ae782,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7aa7e71d-2c00-40fd-9d05-d108bcc807ec", "address": "fa:16:3e:73:99:8a", "network": {"id": "590b5147-c33a-45bd-a502-8fd41408064d", "bridge": "br-int", "label": "tempest-device-tagging-net1-904391500", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.98", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a8d0f284dd8d4cc88f04a729b1d5d38c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7aa7e71d-2c", "ovs_interfaceid": "7aa7e71d-2c00-40fd-9d05-d108bcc807ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-62a20587-5b7d-41eb-b545-9e475c72da58 tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Converting VIF {"id": "7aa7e71d-2c00-40fd-9d05-d108bcc807ec", "address": "fa:16:3e:73:99:8a", "network": {"id": "590b5147-c33a-45bd-a502-8fd41408064d", "bridge": "br-int", "label": "tempest-device-tagging-net1-904391500", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.98", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a8d0f284dd8d4cc88f04a729b1d5d38c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7aa7e71d-2c", "ovs_interfaceid": "7aa7e71d-2c00-40fd-9d05-d108bcc807ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-62a20587-5b7d-41eb-b545-9e475c72da58 tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:99:8a,bridge_name='br-int',has_traffic_filtering=True,id=7aa7e71d-2c00-40fd-9d05-d108bcc807ec,network=Network(590b5147-c33a-45bd-a502-8fd41408064d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7aa7e71d-2c') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG os_vif [None req-62a20587-5b7d-41eb-b545-9e475c72da58 tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:99:8a,bridge_name='br-int',has_traffic_filtering=True,id=7aa7e71d-2c00-40fd-9d05-d108bcc807ec,network=Network(590b5147-c33a-45bd-a502-8fd41408064d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7aa7e71d-2c') {{(pid=75216) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7aa7e71d-2c, bridge=br-int, if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=209f9bc3-a531-41da-bbf0-65d1c473f39e) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:47:28 user nova-compute[75216]: INFO os_vif [None req-62a20587-5b7d-41eb-b545-9e475c72da58 tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:99:8a,bridge_name='br-int',has_traffic_filtering=True,id=7aa7e71d-2c00-40fd-9d05-d108bcc807ec,network=Network(590b5147-c33a-45bd-a502-8fd41408064d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7aa7e71d-2c')
Nov 13 18:47:28 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-62a20587-5b7d-41eb-b545-9e475c72da58 tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T18:45:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-835191015',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-835191015',id=9,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEhfcD46zss7ONQ1SY+r8F1CQFXVOm5N4z75azo3v6RrQS7/wvwfpVFyai5x8zqx3fdjrh60HyXnAzyj7itmyT24OjHnNNB9Ltm77zsQMNNIJ86VCYN8lCciAo2iDKAK3g==',key_name='tempest-keypair-557064356',keypairs=<?>,launch_index=0,launched_at=2023-11-13T18:46:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a8d0f284dd8d4cc88f04a729b1d5d38c',ramdisk_id='',reservation_id='r-7thq8eg2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1999686773',owner_user_name='tempest-TaggedBootDevicesTest_v242-1999686773-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T18:46:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2fd1904e6cdb4600a2e250aefdc0f0ce',uuid=3274203b-a985-4f28-9b45-3f83509ae782,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "01772e53-e624-4728-beb1-929cc4165f21", "address": "fa:16:3e:a7:a0:fe", "network": {"id": "590b5147-c33a-45bd-a502-8fd41408064d", "bridge": "br-int", "label": "tempest-device-tagging-net1-904391500", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a8d0f284dd8d4cc88f04a729b1d5d38c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01772e53-e6", "ovs_interfaceid": "01772e53-e624-4728-beb1-929cc4165f21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-62a20587-5b7d-41eb-b545-9e475c72da58 tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Converting VIF {"id": "01772e53-e624-4728-beb1-929cc4165f21", "address": "fa:16:3e:a7:a0:fe", "network": {"id": "590b5147-c33a-45bd-a502-8fd41408064d", "bridge": "br-int", "label": "tempest-device-tagging-net1-904391500", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a8d0f284dd8d4cc88f04a729b1d5d38c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01772e53-e6", "ovs_interfaceid": "01772e53-e624-4728-beb1-929cc4165f21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-62a20587-5b7d-41eb-b545-9e475c72da58 tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:a0:fe,bridge_name='br-int',has_traffic_filtering=True,id=01772e53-e624-4728-beb1-929cc4165f21,network=Network(590b5147-c33a-45bd-a502-8fd41408064d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01772e53-e6') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG os_vif [None req-62a20587-5b7d-41eb-b545-9e475c72da58 tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:a0:fe,bridge_name='br-int',has_traffic_filtering=True,id=01772e53-e624-4728-beb1-929cc4165f21,network=Network(590b5147-c33a-45bd-a502-8fd41408064d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01772e53-e6') {{(pid=75216) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap01772e53-e6, bridge=br-int, if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3b9d1723-c6e6-4776-bbfa-b71a55e5a524) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:47:28 user nova-compute[75216]: INFO os_vif [None req-62a20587-5b7d-41eb-b545-9e475c72da58 tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:a0:fe,bridge_name='br-int',has_traffic_filtering=True,id=01772e53-e624-4728-beb1-929cc4165f21,network=Network(590b5147-c33a-45bd-a502-8fd41408064d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01772e53-e6')
Nov 13 18:47:28 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-62a20587-5b7d-41eb-b545-9e475c72da58 tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T18:45:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-835191015',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-835191015',id=9,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEhfcD46zss7ONQ1SY+r8F1CQFXVOm5N4z75azo3v6RrQS7/wvwfpVFyai5x8zqx3fdjrh60HyXnAzyj7itmyT24OjHnNNB9Ltm77zsQMNNIJ86VCYN8lCciAo2iDKAK3g==',key_name='tempest-keypair-557064356',keypairs=<?>,launch_index=0,launched_at=2023-11-13T18:46:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a8d0f284dd8d4cc88f04a729b1d5d38c',ramdisk_id='',reservation_id='r-7thq8eg2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1999686773',owner_user_name='tempest-TaggedBootDevicesTest_v242-1999686773-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T18:46:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2fd1904e6cdb4600a2e250aefdc0f0ce',uuid=3274203b-a985-4f28-9b45-3f83509ae782,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1bb4df6f-02b2-415b-9cea-fd8a7a04874c", "address": "fa:16:3e:cb:71:3b", "network": {"id": "f82e0fd1-978f-4b08-8480-709765208ef9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1203652186", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a8d0f284dd8d4cc88f04a729b1d5d38c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bb4df6f-02", "ovs_interfaceid": "1bb4df6f-02b2-415b-9cea-fd8a7a04874c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-62a20587-5b7d-41eb-b545-9e475c72da58 tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Converting VIF {"id": "1bb4df6f-02b2-415b-9cea-fd8a7a04874c", "address": "fa:16:3e:cb:71:3b", "network": {"id": "f82e0fd1-978f-4b08-8480-709765208ef9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1203652186", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a8d0f284dd8d4cc88f04a729b1d5d38c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bb4df6f-02", "ovs_interfaceid": "1bb4df6f-02b2-415b-9cea-fd8a7a04874c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-62a20587-5b7d-41eb-b545-9e475c72da58 tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:71:3b,bridge_name='br-int',has_traffic_filtering=True,id=1bb4df6f-02b2-415b-9cea-fd8a7a04874c,network=Network(f82e0fd1-978f-4b08-8480-709765208ef9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bb4df6f-02') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG os_vif [None req-62a20587-5b7d-41eb-b545-9e475c72da58 tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:71:3b,bridge_name='br-int',has_traffic_filtering=True,id=1bb4df6f-02b2-415b-9cea-fd8a7a04874c,network=Network(f82e0fd1-978f-4b08-8480-709765208ef9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bb4df6f-02') {{(pid=75216) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1bb4df6f-02, bridge=br-int, if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=92096f21-3f13-4469-834b-b91a0dfc90ec) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:47:28 user nova-compute[75216]: INFO os_vif [None req-62a20587-5b7d-41eb-b545-9e475c72da58 tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:71:3b,bridge_name='br-int',has_traffic_filtering=True,id=1bb4df6f-02b2-415b-9cea-fd8a7a04874c,network=Network(f82e0fd1-978f-4b08-8480-709765208ef9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bb4df6f-02')
Nov 13 18:47:28 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-62a20587-5b7d-41eb-b545-9e475c72da58 tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T18:45:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-835191015',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-835191015',id=9,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEhfcD46zss7ONQ1SY+r8F1CQFXVOm5N4z75azo3v6RrQS7/wvwfpVFyai5x8zqx3fdjrh60HyXnAzyj7itmyT24OjHnNNB9Ltm77zsQMNNIJ86VCYN8lCciAo2iDKAK3g==',key_name='tempest-keypair-557064356',keypairs=<?>,launch_index=0,launched_at=2023-11-13T18:46:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a8d0f284dd8d4cc88f04a729b1d5d38c',ramdisk_id='',reservation_id='r-7thq8eg2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1999686773',owner_user_name='tempest-TaggedBootDevicesTest_v242-1999686773-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T18:46:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2fd1904e6cdb4600a2e250aefdc0f0ce',uuid=3274203b-a985-4f28-9b45-3f83509ae782,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a07efcd3-59f4-452e-8fb7-8b8233ae235f", "address": "fa:16:3e:6c:cb:eb", "network": {"id": "f82e0fd1-978f-4b08-8480-709765208ef9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1203652186", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a8d0f284dd8d4cc88f04a729b1d5d38c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa07efcd3-59", "ovs_interfaceid": "a07efcd3-59f4-452e-8fb7-8b8233ae235f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-62a20587-5b7d-41eb-b545-9e475c72da58 tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Converting VIF {"id": "a07efcd3-59f4-452e-8fb7-8b8233ae235f", "address": "fa:16:3e:6c:cb:eb", "network": {"id": "f82e0fd1-978f-4b08-8480-709765208ef9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1203652186", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a8d0f284dd8d4cc88f04a729b1d5d38c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa07efcd3-59", "ovs_interfaceid": "a07efcd3-59f4-452e-8fb7-8b8233ae235f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-62a20587-5b7d-41eb-b545-9e475c72da58 tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:cb:eb,bridge_name='br-int',has_traffic_filtering=True,id=a07efcd3-59f4-452e-8fb7-8b8233ae235f,network=Network(f82e0fd1-978f-4b08-8480-709765208ef9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa07efcd3-59') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG os_vif [None req-62a20587-5b7d-41eb-b545-9e475c72da58 tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:cb:eb,bridge_name='br-int',has_traffic_filtering=True,id=a07efcd3-59f4-452e-8fb7-8b8233ae235f,network=Network(f82e0fd1-978f-4b08-8480-709765208ef9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa07efcd3-59') {{(pid=75216) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa07efcd3-59, bridge=br-int, if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ce0149df-acc9-4120-87c4-414b100e4126) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:47:28 user nova-compute[75216]: INFO os_vif [None req-62a20587-5b7d-41eb-b545-9e475c72da58 tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:cb:eb,bridge_name='br-int',has_traffic_filtering=True,id=a07efcd3-59f4-452e-8fb7-8b8233ae235f,network=Network(f82e0fd1-978f-4b08-8480-709765208ef9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa07efcd3-59')
Nov 13 18:47:28 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-62a20587-5b7d-41eb-b545-9e475c72da58 tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] calling os-brick to detach iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-62a20587-5b7d-41eb-b545-9e475c72da58 tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3a8669e40>, {'target_iqn': 'iqn.2010-10.org.openstack:de3d195d-b8b4-4c79-a150-813952c640e8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WTBrHnmk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 18:47:28 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-62a20587-5b7d-41eb-b545-9e475c72da58 tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 18:47:28 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-62a20587-5b7d-41eb-b545-9e475c72da58 tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-62a20587-5b7d-41eb-b545-9e475c72da58 tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-fca63c40-e0e7-49e0-a25e-9796f5541cfd tempest-TestVolumeSwap-1274447143 tempest-TestVolumeSwap-1274447143-project-admin] Acquiring lock "872856e5-cdc4-444e-8835-55e36708d776" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-fca63c40-e0e7-49e0-a25e-9796f5541cfd tempest-TestVolumeSwap-1274447143 tempest-TestVolumeSwap-1274447143-project-admin] Lock "872856e5-cdc4-444e-8835-55e36708d776" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.003s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[df017f99-ba25-4c4d-a88f-f8c4388dbbe1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d72e8803-2ded-42f6-858f-803c16c2d2a4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2a1a5e82-4f70-4668-94bd-4a842d826214\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0fc393f0-1356-404f-a87b-bed1fb91b924\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4cd9ea8a-0fbb-4dd4-b11c-fd661086e803\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:de3d195d-b8b4-4c79-a150-813952c640e8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:52f4339a-6a47-4877-b041-9c27d7be2e94\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aafa167c-c8ba-4509-88dc-33b3a07e940a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e823c6a1-f7e2-495f-a5dc-6fdfd2b19cf0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ba1efeb5-724e-4415-a5ed-12ce8c9489bc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-62a20587-5b7d-41eb-b545-9e475c72da58 tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 18:47:28 user nova-compute[75216]: No targets found.
Nov 13 18:47:28 user nova-compute[75216]: iSNS:
Nov 13 18:47:28 user nova-compute[75216]: No targets found.
Nov 13 18:47:28 user nova-compute[75216]: STATIC:
Nov 13 18:47:28 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:d72e8803-2ded-42f6-858f-803c16c2d2a4
Nov 13 18:47:28 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 18:47:28 user nova-compute[75216]:                 Iface Name: default
Nov 13 18:47:28 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:2a1a5e82-4f70-4668-94bd-4a842d826214
Nov 13 18:47:28 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 18:47:28 user nova-compute[75216]:                 Iface Name: default
Nov 13 18:47:28 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:0fc393f0-1356-404f-a87b-bed1fb91b924
Nov 13 18:47:28 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 18:47:28 user nova-compute[75216]:                 Iface Name: default
Nov 13 18:47:28 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:4cd9ea8a-0fbb-4dd4-b11c-fd661086e803
Nov 13 18:47:28 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 18:47:28 user nova-compute[75216]:                 Iface Name: default
Nov 13 18:47:28 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac
Nov 13 18:47:28 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 18:47:28 user nova-compute[75216]:                 Iface Name: default
Nov 13 18:47:28 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:de3d195d-b8b4-4c79-a150-813952c640e8
Nov 13 18:47:28 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 18:47:28 user nova-compute[75216]:                 Iface Name: default
Nov 13 18:47:28 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:52f4339a-6a47-4877-b041-9c27d7be2e94
Nov 13 18:47:28 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 18:47:28 user nova-compute[75216]:                 Iface Name: default
Nov 13 18:47:28 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:aafa167c-c8ba-4509-88dc-33b3a07e940a
Nov 13 18:47:28 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 18:47:28 user nova-compute[75216]:                 Iface Name: default
Nov 13 18:47:28 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:e823c6a1-f7e2-495f-a5dc-6fdfd2b19cf0
Nov 13 18:47:28 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 18:47:28 user nova-compute[75216]:                 Iface Name: default
Nov 13 18:47:28 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:ba1efeb5-724e-4415-a5ed-12ce8c9489bc
Nov 13 18:47:28 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 18:47:28 user nova-compute[75216]:                 Iface Name: default
Nov 13 18:47:28 user nova-compute[75216]: FIRMWARE:
Nov 13 18:47:28 user nova-compute[75216]: No targets found.
Nov 13 18:47:28 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-62a20587-5b7d-41eb-b545-9e475c72da58 tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 18:47:28 user nova-compute[75216]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 18:47:28 user nova-compute[75216]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75216) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-62a20587-5b7d-41eb-b545-9e475c72da58 tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:de3d195d-b8b4-4c79-a150-813952c640e8', 0)] {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG os_brick.utils [None req-fca63c40-e0e7-49e0-a25e-9796f5541cfd tempest-TestVolumeSwap-1274447143 tempest-TestVolumeSwap-1274447143-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[b52cddfd-96d5-47c2-a854-f250754e6219]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aea6fcfe14b9\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[96e1b132-f919-440d-8928-4eb1988d4803]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0fc393f0-1356-404f-a87b-bed1fb91b924\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2a1a5e82-4f70-4668-94bd-4a842d826214\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4cd9ea8a-0fbb-4dd4-b11c-fd661086e803\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:52f4339a-6a47-4877-b041-9c27d7be2e94\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aafa167c-c8ba-4509-88dc-33b3a07e940a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba1efeb5-724e-4415-a5ed-12ce8c9489bc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d72e8803-2ded-42f6-858f-803c16c2d2a4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:de3d195d-b8b4-4c79-a150-813952c640e8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e823c6a1-f7e2-495f-a5dc-6fdfd2b19cf0\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG nova.compute.manager [req-73831cd9-cb77-4e87-bcd2-9b3a78c7b9e0 req-858490e9-0279-4acc-b93f-c51e1db7401a service nova] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] Received event network-vif-plugged-7aa7e71d-2c00-40fd-9d05-d108bcc807ec {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-73831cd9-cb77-4e87-bcd2-9b3a78c7b9e0 req-858490e9-0279-4acc-b93f-c51e1db7401a service nova] Acquiring lock "3274203b-a985-4f28-9b45-3f83509ae782-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-73831cd9-cb77-4e87-bcd2-9b3a78c7b9e0 req-858490e9-0279-4acc-b93f-c51e1db7401a service nova] Lock "3274203b-a985-4f28-9b45-3f83509ae782-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-73831cd9-cb77-4e87-bcd2-9b3a78c7b9e0 req-858490e9-0279-4acc-b93f-c51e1db7401a service nova] Lock "3274203b-a985-4f28-9b45-3f83509ae782-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG nova.compute.manager [req-73831cd9-cb77-4e87-bcd2-9b3a78c7b9e0 req-858490e9-0279-4acc-b93f-c51e1db7401a service nova] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] No waiting events found dispatching network-vif-plugged-7aa7e71d-2c00-40fd-9d05-d108bcc807ec {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:47:28 user nova-compute[75216]: WARNING nova.compute.manager [req-73831cd9-cb77-4e87-bcd2-9b3a78c7b9e0 req-858490e9-0279-4acc-b93f-c51e1db7401a service nova] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] Received unexpected event network-vif-plugged-7aa7e71d-2c00-40fd-9d05-d108bcc807ec for instance with vm_state active and task_state deleting.
Nov 13 18:47:28 user nova-compute[75216]: DEBUG nova.compute.manager [req-73831cd9-cb77-4e87-bcd2-9b3a78c7b9e0 req-858490e9-0279-4acc-b93f-c51e1db7401a service nova] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] Received event network-vif-unplugged-01772e53-e624-4728-beb1-929cc4165f21 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-73831cd9-cb77-4e87-bcd2-9b3a78c7b9e0 req-858490e9-0279-4acc-b93f-c51e1db7401a service nova] Acquiring lock "3274203b-a985-4f28-9b45-3f83509ae782-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-73831cd9-cb77-4e87-bcd2-9b3a78c7b9e0 req-858490e9-0279-4acc-b93f-c51e1db7401a service nova] Lock "3274203b-a985-4f28-9b45-3f83509ae782-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-73831cd9-cb77-4e87-bcd2-9b3a78c7b9e0 req-858490e9-0279-4acc-b93f-c51e1db7401a service nova] Lock "3274203b-a985-4f28-9b45-3f83509ae782-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG nova.compute.manager [req-73831cd9-cb77-4e87-bcd2-9b3a78c7b9e0 req-858490e9-0279-4acc-b93f-c51e1db7401a service nova] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] No waiting events found dispatching network-vif-unplugged-01772e53-e624-4728-beb1-929cc4165f21 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG nova.compute.manager [req-73831cd9-cb77-4e87-bcd2-9b3a78c7b9e0 req-858490e9-0279-4acc-b93f-c51e1db7401a service nova] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] Received event network-vif-unplugged-01772e53-e624-4728-beb1-929cc4165f21 for instance with task_state deleting. {{(pid=75216) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG nova.compute.manager [req-73831cd9-cb77-4e87-bcd2-9b3a78c7b9e0 req-858490e9-0279-4acc-b93f-c51e1db7401a service nova] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] Received event network-vif-plugged-01772e53-e624-4728-beb1-929cc4165f21 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-73831cd9-cb77-4e87-bcd2-9b3a78c7b9e0 req-858490e9-0279-4acc-b93f-c51e1db7401a service nova] Acquiring lock "3274203b-a985-4f28-9b45-3f83509ae782-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-73831cd9-cb77-4e87-bcd2-9b3a78c7b9e0 req-858490e9-0279-4acc-b93f-c51e1db7401a service nova] Lock "3274203b-a985-4f28-9b45-3f83509ae782-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-73831cd9-cb77-4e87-bcd2-9b3a78c7b9e0 req-858490e9-0279-4acc-b93f-c51e1db7401a service nova] Lock "3274203b-a985-4f28-9b45-3f83509ae782-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG nova.compute.manager [req-73831cd9-cb77-4e87-bcd2-9b3a78c7b9e0 req-858490e9-0279-4acc-b93f-c51e1db7401a service nova] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] No waiting events found dispatching network-vif-plugged-01772e53-e624-4728-beb1-929cc4165f21 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:47:28 user nova-compute[75216]: WARNING nova.compute.manager [req-73831cd9-cb77-4e87-bcd2-9b3a78c7b9e0 req-858490e9-0279-4acc-b93f-c51e1db7401a service nova] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] Received unexpected event network-vif-plugged-01772e53-e624-4728-beb1-929cc4165f21 for instance with vm_state active and task_state deleting.
Nov 13 18:47:28 user nova-compute[75216]: DEBUG nova.compute.manager [req-73831cd9-cb77-4e87-bcd2-9b3a78c7b9e0 req-858490e9-0279-4acc-b93f-c51e1db7401a service nova] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Received event network-changed-6b91caf7-7b72-41be-8cf7-96e728c0eae5 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG nova.compute.manager [req-73831cd9-cb77-4e87-bcd2-9b3a78c7b9e0 req-858490e9-0279-4acc-b93f-c51e1db7401a service nova] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Refreshing instance network info cache due to event network-changed-6b91caf7-7b72-41be-8cf7-96e728c0eae5. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-73831cd9-cb77-4e87-bcd2-9b3a78c7b9e0 req-858490e9-0279-4acc-b93f-c51e1db7401a service nova] Acquiring lock "refresh_cache-78605259-17bf-47da-86de-3c76ac1c5bfa" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-73831cd9-cb77-4e87-bcd2-9b3a78c7b9e0 req-858490e9-0279-4acc-b93f-c51e1db7401a service nova] Acquired lock "refresh_cache-78605259-17bf-47da-86de-3c76ac1c5bfa" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG nova.network.neutron [req-73831cd9-cb77-4e87-bcd2-9b3a78c7b9e0 req-858490e9-0279-4acc-b93f-c51e1db7401a service nova] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Refreshing network info cache for port 6b91caf7-7b72-41be-8cf7-96e728c0eae5 {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[96e587e8-c0e8-44e0-bb8d-073bd85c3e26]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[01765e33-a2f9-4e91-8da8-1a3098846c48]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aafa167c-c8ba-4509-88dc-33b3a07e940a (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cd9ea8a-0fbb-4dd4-b11c-fd661086e803 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d72e8803-2ded-42f6-858f-803c16c2d2a4 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba1efeb5-724e-4415-a5ed-12ce8c9489bc (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3d195d-b8b4-4c79-a150-813952c640e8 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fc393f0-1356-404f-a87b-bed1fb91b924 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a1a5e82-4f70-4668-94bd-4a842d826214 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e823c6a1-f7e2-495f-a5dc-6fdfd2b19cf0 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52f4339a-6a47-4877-b041-9c27d7be2e94 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac (non-flash)\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-62a20587-5b7d-41eb-b545-9e475c72da58 tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aafa167c-c8ba-4509-88dc-33b3a07e940a (non-flash)
Nov 13 18:47:28 user nova-compute[75216]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cd9ea8a-0fbb-4dd4-b11c-fd661086e803 (non-flash)
Nov 13 18:47:28 user nova-compute[75216]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d72e8803-2ded-42f6-858f-803c16c2d2a4 (non-flash)
Nov 13 18:47:28 user nova-compute[75216]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba1efeb5-724e-4415-a5ed-12ce8c9489bc (non-flash)
Nov 13 18:47:28 user nova-compute[75216]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3d195d-b8b4-4c79-a150-813952c640e8 (non-flash)
Nov 13 18:47:28 user nova-compute[75216]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fc393f0-1356-404f-a87b-bed1fb91b924 (non-flash)
Nov 13 18:47:28 user nova-compute[75216]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a1a5e82-4f70-4668-94bd-4a842d826214 (non-flash)
Nov 13 18:47:28 user nova-compute[75216]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e823c6a1-f7e2-495f-a5dc-6fdfd2b19cf0 (non-flash)
Nov 13 18:47:28 user nova-compute[75216]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52f4339a-6a47-4877-b041-9c27d7be2e94 (non-flash)
Nov 13 18:47:28 user nova-compute[75216]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac (non-flash)
Nov 13 18:47:28 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-62a20587-5b7d-41eb-b545-9e475c72da58 tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aafa167c-c8ba-4509-88dc-33b3a07e940a (non-flash)
Nov 13 18:47:28 user nova-compute[75216]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cd9ea8a-0fbb-4dd4-b11c-fd661086e803 (non-flash)
Nov 13 18:47:28 user nova-compute[75216]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d72e8803-2ded-42f6-858f-803c16c2d2a4 (non-flash)
Nov 13 18:47:28 user nova-compute[75216]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba1efeb5-724e-4415-a5ed-12ce8c9489bc (non-flash)
Nov 13 18:47:28 user nova-compute[75216]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3d195d-b8b4-4c79-a150-813952c640e8 (non-flash)
Nov 13 18:47:28 user nova-compute[75216]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fc393f0-1356-404f-a87b-bed1fb91b924 (non-flash)
Nov 13 18:47:28 user nova-compute[75216]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a1a5e82-4f70-4668-94bd-4a842d826214 (non-flash)
Nov 13 18:47:28 user nova-compute[75216]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e823c6a1-f7e2-495f-a5dc-6fdfd2b19cf0 (non-flash)
Nov 13 18:47:28 user nova-compute[75216]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52f4339a-6a47-4877-b041-9c27d7be2e94 (non-flash)
Nov 13 18:47:28 user nova-compute[75216]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac (non-flash)
Nov 13 18:47:28 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-62a20587-5b7d-41eb-b545-9e475c72da58 tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe3a82b09d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:de3d195d-b8b4-4c79-a150-813952c640e8'): ({'sdc'}, set())}) {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-62a20587-5b7d-41eb-b545-9e475c72da58 tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Removing single pathed devices sdc {{(pid=75216) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[60751b1a-eded-4409-a5d3-d83e4a4bd2ab]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[d440de33-bfd3-4b0c-888f-2ef8375c5655]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-fca63c40-e0e7-49e0-a25e-9796f5541cfd tempest-TestVolumeSwap-1274447143 tempest-TestVolumeSwap-1274447143-project-admin] Running cmd (subprocess): nvme version {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-fca63c40-e0e7-49e0-a25e-9796f5541cfd tempest-TestVolumeSwap-1274447143 tempest-TestVolumeSwap-1274447143-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[e86b322a-dd9b-4544-823f-1bd488a2837d]: (4, ('path checker states:\nup                  10\n\npaths: 0\nbusy: False\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fca63c40-e0e7-49e0-a25e-9796f5541cfd tempest-TestVolumeSwap-1274447143 tempest-TestVolumeSwap-1274447143-project-admin] nvme not present on system {{(pid=75216) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 18:47:28 user nova-compute[75216]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 18:47:28 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffdff770-832e-4bd9-8859-f64d4d6706d3]: (4, '') {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-fca63c40-e0e7-49e0-a25e-9796f5541cfd tempest-TestVolumeSwap-1274447143 tempest-TestVolumeSwap-1274447143-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75216) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-fca63c40-e0e7-49e0-a25e-9796f5541cfd tempest-TestVolumeSwap-1274447143 tempest-TestVolumeSwap-1274447143-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-fca63c40-e0e7-49e0-a25e-9796f5541cfd tempest-TestVolumeSwap-1274447143 tempest-TestVolumeSwap-1274447143-project-admin] LIGHTOS: no hostnqn found. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG os_brick.utils [None req-fca63c40-e0e7-49e0-a25e-9796f5541cfd tempest-TestVolumeSwap-1274447143 tempest-TestVolumeSwap-1274447143-project-admin] <== get_connector_properties: return (159ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aea6fcfe14b9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[26e05cdd-00a8-403c-b3cf-fabf769e96f8]: (4, ('ok\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-62a20587-5b7d-41eb-b545-9e475c72da58 tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Flushing IO for device /dev/sdc {{(pid=75216) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d6ed05d-3620-4f68-b7f8-e73dc5edff8c]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-62a20587-5b7d-41eb-b545-9e475c72da58 tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75216) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.042s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4de819f-62b7-4c01-93f8-a3a6595a7d41]: (4, ('1', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-62a20587-5b7d-41eb-b545-9e475c72da58 tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-62a20587-5b7d-41eb-b545-9e475c72da58 tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] SCSI volumes sdc have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-62a20587-5b7d-41eb-b545-9e475c72da58 tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:de3d195d-b8b4-4c79-a150-813952c640e8')] {{(pid=75216) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de3d195d-b8b4-4c79-a150-813952c640e8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de3d195d-b8b4-4c79-a150-813952c640e8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[958ea82f-7e49-4af9-9330-5a1e7f31836a]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-62a20587-5b7d-41eb-b545-9e475c72da58 tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:47:28 user nova-compute[75216]: INFO nova.compute.manager [None req-fca63c40-e0e7-49e0-a25e-9796f5541cfd tempest-TestVolumeSwap-1274447143 tempest-TestVolumeSwap-1274447143-project-admin] [instance: 872856e5-cdc4-444e-8835-55e36708d776] Swapping volume 4cd9ea8a-0fbb-4dd4-b11c-fd661086e803 for f530e526-b4b9-405c-8bde-111e34095cc4
Nov 13 18:47:28 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de3d195d-b8b4-4c79-a150-813952c640e8 -p 172.16.0.220:3260 --logout {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG nova.compute.manager [req-e80df423-298d-4cb6-9683-169b21928625 req-93e920f5-a680-4b7c-a2fd-e691d1964b0a service nova] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] Received event network-vif-plugged-1bb4df6f-02b2-415b-9cea-fd8a7a04874c {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-e80df423-298d-4cb6-9683-169b21928625 req-93e920f5-a680-4b7c-a2fd-e691d1964b0a service nova] Acquiring lock "3274203b-a985-4f28-9b45-3f83509ae782-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-e80df423-298d-4cb6-9683-169b21928625 req-93e920f5-a680-4b7c-a2fd-e691d1964b0a service nova] Lock "3274203b-a985-4f28-9b45-3f83509ae782-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.005s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-e80df423-298d-4cb6-9683-169b21928625 req-93e920f5-a680-4b7c-a2fd-e691d1964b0a service nova] Lock "3274203b-a985-4f28-9b45-3f83509ae782-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG nova.compute.manager [req-e80df423-298d-4cb6-9683-169b21928625 req-93e920f5-a680-4b7c-a2fd-e691d1964b0a service nova] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] No waiting events found dispatching network-vif-plugged-1bb4df6f-02b2-415b-9cea-fd8a7a04874c {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:47:28 user nova-compute[75216]: WARNING nova.compute.manager [req-e80df423-298d-4cb6-9683-169b21928625 req-93e920f5-a680-4b7c-a2fd-e691d1964b0a service nova] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] Received unexpected event network-vif-plugged-1bb4df6f-02b2-415b-9cea-fd8a7a04874c for instance with vm_state active and task_state deleting.
Nov 13 18:47:28 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de3d195d-b8b4-4c79-a150-813952c640e8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.086s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[c51c4be8-c10e-4600-93d9-9b521c46f89f]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:de3d195d-b8b4-4c79-a150-813952c640e8, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:de3d195d-b8b4-4c79-a150-813952c640e8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-62a20587-5b7d-41eb-b545-9e475c72da58 tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:de3d195d-b8b4-4c79-a150-813952c640e8, portal: 172.16.0.220,3260]
Nov 13 18:47:28 user nova-compute[75216]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:de3d195d-b8b4-4c79-a150-813952c640e8, portal: 172.16.0.220,3260] successful.
Nov 13 18:47:28 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de3d195d-b8b4-4c79-a150-813952c640e8 -p 172.16.0.220:3260 --op delete {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de3d195d-b8b4-4c79-a150-813952c640e8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.039s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[432e7833-57e7-40eb-a177-cd7d043d7e54]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-62a20587-5b7d-41eb-b545-9e475c72da58 tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-62a20587-5b7d-41eb-b545-9e475c72da58 tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.440s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-62a20587-5b7d-41eb-b545-9e475c72da58 tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] <== disconnect_volume: return (441ms) None {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-62a20587-5b7d-41eb-b545-9e475c72da58 tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] Disconnected iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-62a20587-5b7d-41eb-b545-9e475c72da58 tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] calling os-brick to detach iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-62a20587-5b7d-41eb-b545-9e475c72da58 tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3a8669e40>, {'target_iqn': 'iqn.2010-10.org.openstack:2a1a5e82-4f70-4668-94bd-4a842d826214', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DYBgeCvJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 18:47:28 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-62a20587-5b7d-41eb-b545-9e475c72da58 tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 18:47:28 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-62a20587-5b7d-41eb-b545-9e475c72da58 tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-62a20587-5b7d-41eb-b545-9e475c72da58 tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf1cf345-6d59-47e5-9710-bb4c61a47cf8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d72e8803-2ded-42f6-858f-803c16c2d2a4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2a1a5e82-4f70-4668-94bd-4a842d826214\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0fc393f0-1356-404f-a87b-bed1fb91b924\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4cd9ea8a-0fbb-4dd4-b11c-fd661086e803\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:52f4339a-6a47-4877-b041-9c27d7be2e94\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aafa167c-c8ba-4509-88dc-33b3a07e940a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e823c6a1-f7e2-495f-a5dc-6fdfd2b19cf0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ba1efeb5-724e-4415-a5ed-12ce8c9489bc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-62a20587-5b7d-41eb-b545-9e475c72da58 tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 18:47:28 user nova-compute[75216]: No targets found.
Nov 13 18:47:28 user nova-compute[75216]: iSNS:
Nov 13 18:47:28 user nova-compute[75216]: No targets found.
Nov 13 18:47:28 user nova-compute[75216]: STATIC:
Nov 13 18:47:28 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:d72e8803-2ded-42f6-858f-803c16c2d2a4
Nov 13 18:47:28 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 18:47:28 user nova-compute[75216]:                 Iface Name: default
Nov 13 18:47:28 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:2a1a5e82-4f70-4668-94bd-4a842d826214
Nov 13 18:47:28 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 18:47:28 user nova-compute[75216]:                 Iface Name: default
Nov 13 18:47:28 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:0fc393f0-1356-404f-a87b-bed1fb91b924
Nov 13 18:47:28 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 18:47:28 user nova-compute[75216]:                 Iface Name: default
Nov 13 18:47:28 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:4cd9ea8a-0fbb-4dd4-b11c-fd661086e803
Nov 13 18:47:28 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 18:47:28 user nova-compute[75216]:                 Iface Name: default
Nov 13 18:47:28 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac
Nov 13 18:47:28 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 18:47:28 user nova-compute[75216]:                 Iface Name: default
Nov 13 18:47:28 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:52f4339a-6a47-4877-b041-9c27d7be2e94
Nov 13 18:47:28 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 18:47:28 user nova-compute[75216]:                 Iface Name: default
Nov 13 18:47:28 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:aafa167c-c8ba-4509-88dc-33b3a07e940a
Nov 13 18:47:28 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 18:47:28 user nova-compute[75216]:                 Iface Name: default
Nov 13 18:47:28 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:e823c6a1-f7e2-495f-a5dc-6fdfd2b19cf0
Nov 13 18:47:28 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 18:47:28 user nova-compute[75216]:                 Iface Name: default
Nov 13 18:47:28 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:ba1efeb5-724e-4415-a5ed-12ce8c9489bc
Nov 13 18:47:28 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 18:47:28 user nova-compute[75216]:                 Iface Name: default
Nov 13 18:47:28 user nova-compute[75216]: FIRMWARE:
Nov 13 18:47:28 user nova-compute[75216]: No targets found.
Nov 13 18:47:28 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-62a20587-5b7d-41eb-b545-9e475c72da58 tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 18:47:28 user nova-compute[75216]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 18:47:28 user nova-compute[75216]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75216) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-62a20587-5b7d-41eb-b545-9e475c72da58 tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2a1a5e82-4f70-4668-94bd-4a842d826214', 0)] {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcab8296-7e8d-410e-948d-05cf2324841a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0fc393f0-1356-404f-a87b-bed1fb91b924\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2a1a5e82-4f70-4668-94bd-4a842d826214\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4cd9ea8a-0fbb-4dd4-b11c-fd661086e803\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:52f4339a-6a47-4877-b041-9c27d7be2e94\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aafa167c-c8ba-4509-88dc-33b3a07e940a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba1efeb5-724e-4415-a5ed-12ce8c9489bc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d72e8803-2ded-42f6-858f-803c16c2d2a4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e823c6a1-f7e2-495f-a5dc-6fdfd2b19cf0\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG nova.network.neutron [req-73831cd9-cb77-4e87-bcd2-9b3a78c7b9e0 req-858490e9-0279-4acc-b93f-c51e1db7401a service nova] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Updated VIF entry in instance network info cache for port 6b91caf7-7b72-41be-8cf7-96e728c0eae5. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG nova.network.neutron [req-73831cd9-cb77-4e87-bcd2-9b3a78c7b9e0 req-858490e9-0279-4acc-b93f-c51e1db7401a service nova] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Updating instance_info_cache with network_info: [{"id": "6b91caf7-7b72-41be-8cf7-96e728c0eae5", "address": "fa:16:3e:22:29:78", "network": {"id": "65bd62c0-ccfd-486a-a4e4-eafe4e4f587f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-92675676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "046be82514bf4c3483f8b3b8f2299b96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b91caf7-7b", "ovs_interfaceid": "6b91caf7-7b72-41be-8cf7-96e728c0eae5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7c9f8c17-a293-4817-ae4f-3fab0a1076a6", "address": "fa:16:3e:bc:93:0e", "network": {"id": "badd6fc4-dc5e-4623-b319-4969f674705f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1322270738", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.246", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "046be82514bf4c3483f8b3b8f2299b96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c9f8c17-a2", "ovs_interfaceid": "7c9f8c17-a293-4817-ae4f-3fab0a1076a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c5b1d8e6-f202-4278-924c-abecf64f299c", "address": "fa:16:3e:a1:c9:75", "network": {"id": "badd6fc4-dc5e-4623-b319-4969f674705f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1322270738", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.53", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "046be82514bf4c3483f8b3b8f2299b96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5b1d8e6-f2", "ovs_interfaceid": "c5b1d8e6-f202-4278-924c-abecf64f299c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5c412896-2c62-4248-a888-9b0612378259", "address": "fa:16:3e:47:55:1a", "network": {"id": "badd6fc4-dc5e-4623-b319-4969f674705f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1322270738", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "046be82514bf4c3483f8b3b8f2299b96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c412896-2c", "ovs_interfaceid": "5c412896-2c62-4248-a888-9b0612378259", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e4e34ea8-fb99-4a0e-8b65-a93933cc7d6b", "address": "fa:16:3e:a8:83:c9", "network": {"id": "badd6fc4-dc5e-4623-b319-4969f674705f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1322270738", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "046be82514bf4c3483f8b3b8f2299b96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4e34ea8-fb", "ovs_interfaceid": "e4e34ea8-fb99-4a0e-8b65-a93933cc7d6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7b6ed148-b7c9-479b-9e2d-cfc0c3f6f93a", "address": "fa:16:3e:e4:db:d9", "network": {"id": "debccb89-bf2d-40a9-b114-b1bb2e913648", "bridge": "br-int", "label": "tempest-device-tagging-net2-185988930", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "046be82514bf4c3483f8b3b8f2299b96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b6ed148-b7", "ovs_interfaceid": "7b6ed148-b7c9-479b-9e2d-cfc0c3f6f93a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "815d1175-2997-4d74-8f35-7ca982cf46aa", "address": "fa:16:3e:2c:4b:72", "network": {"id": "debccb89-bf2d-40a9-b114-b1bb2e913648", "bridge": "br-int", "label": "tempest-device-tagging-net2-185988930", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "046be82514bf4c3483f8b3b8f2299b96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap815d1175-29", "ovs_interfaceid": "815d1175-2997-4d74-8f35-7ca982cf46aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-73831cd9-cb77-4e87-bcd2-9b3a78c7b9e0 req-858490e9-0279-4acc-b93f-c51e1db7401a service nova] Releasing lock "refresh_cache-78605259-17bf-47da-86de-3c76ac1c5bfa" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9489751-e3e2-4245-a34a-ddc61fae9a59]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aafa167c-c8ba-4509-88dc-33b3a07e940a (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cd9ea8a-0fbb-4dd4-b11c-fd661086e803 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d72e8803-2ded-42f6-858f-803c16c2d2a4 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba1efeb5-724e-4415-a5ed-12ce8c9489bc (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fc393f0-1356-404f-a87b-bed1fb91b924 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a1a5e82-4f70-4668-94bd-4a842d826214 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e823c6a1-f7e2-495f-a5dc-6fdfd2b19cf0 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52f4339a-6a47-4877-b041-9c27d7be2e94 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac (non-flash)\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-62a20587-5b7d-41eb-b545-9e475c72da58 tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aafa167c-c8ba-4509-88dc-33b3a07e940a (non-flash)
Nov 13 18:47:28 user nova-compute[75216]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cd9ea8a-0fbb-4dd4-b11c-fd661086e803 (non-flash)
Nov 13 18:47:28 user nova-compute[75216]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d72e8803-2ded-42f6-858f-803c16c2d2a4 (non-flash)
Nov 13 18:47:28 user nova-compute[75216]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba1efeb5-724e-4415-a5ed-12ce8c9489bc (non-flash)
Nov 13 18:47:28 user nova-compute[75216]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fc393f0-1356-404f-a87b-bed1fb91b924 (non-flash)
Nov 13 18:47:28 user nova-compute[75216]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a1a5e82-4f70-4668-94bd-4a842d826214 (non-flash)
Nov 13 18:47:28 user nova-compute[75216]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e823c6a1-f7e2-495f-a5dc-6fdfd2b19cf0 (non-flash)
Nov 13 18:47:28 user nova-compute[75216]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52f4339a-6a47-4877-b041-9c27d7be2e94 (non-flash)
Nov 13 18:47:28 user nova-compute[75216]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac (non-flash)
Nov 13 18:47:28 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-62a20587-5b7d-41eb-b545-9e475c72da58 tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aafa167c-c8ba-4509-88dc-33b3a07e940a (non-flash)
Nov 13 18:47:28 user nova-compute[75216]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cd9ea8a-0fbb-4dd4-b11c-fd661086e803 (non-flash)
Nov 13 18:47:28 user nova-compute[75216]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d72e8803-2ded-42f6-858f-803c16c2d2a4 (non-flash)
Nov 13 18:47:28 user nova-compute[75216]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba1efeb5-724e-4415-a5ed-12ce8c9489bc (non-flash)
Nov 13 18:47:28 user nova-compute[75216]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fc393f0-1356-404f-a87b-bed1fb91b924 (non-flash)
Nov 13 18:47:28 user nova-compute[75216]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a1a5e82-4f70-4668-94bd-4a842d826214 (non-flash)
Nov 13 18:47:28 user nova-compute[75216]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e823c6a1-f7e2-495f-a5dc-6fdfd2b19cf0 (non-flash)
Nov 13 18:47:28 user nova-compute[75216]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52f4339a-6a47-4877-b041-9c27d7be2e94 (non-flash)
Nov 13 18:47:28 user nova-compute[75216]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac (non-flash)
Nov 13 18:47:28 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-62a20587-5b7d-41eb-b545-9e475c72da58 tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe3c01b9900>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2a1a5e82-4f70-4668-94bd-4a842d826214'): ({'sdf'}, set())}) {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-62a20587-5b7d-41eb-b545-9e475c72da58 tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Removing single pathed devices sdf {{(pid=75216) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fa297d5-58e9-4e80-b44a-8db5ae05ff28]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab4b62e3-254c-400b-af23-fa81a927aaaa]: (4, ('ok\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-62a20587-5b7d-41eb-b545-9e475c72da58 tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Flushing IO for device /dev/sdf {{(pid=75216) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.012s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae88d9ea-1055-4575-b930-6a6628e65247]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-62a20587-5b7d-41eb-b545-9e475c72da58 tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75216) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.046s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[a31734d7-0f14-4279-97db-f48184c05879]: (4, ('1', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-62a20587-5b7d-41eb-b545-9e475c72da58 tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-62a20587-5b7d-41eb-b545-9e475c72da58 tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] SCSI volumes sdf have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-62a20587-5b7d-41eb-b545-9e475c72da58 tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2a1a5e82-4f70-4668-94bd-4a842d826214')] {{(pid=75216) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a1a5e82-4f70-4668-94bd-4a842d826214 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a1a5e82-4f70-4668-94bd-4a842d826214 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[173ef3e6-24d6-47d9-82ea-5267798970af]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-62a20587-5b7d-41eb-b545-9e475c72da58 tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:47:28 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a1a5e82-4f70-4668-94bd-4a842d826214 -p 172.16.0.220:3260 --logout {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:29 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a1a5e82-4f70-4668-94bd-4a842d826214 -p 172.16.0.220:3260 --logout" returned: 0 in 0.083s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:29 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f54bdcf-020a-4a2a-9fd1-c9f1e04ee6cd]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:2a1a5e82-4f70-4668-94bd-4a842d826214, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:2a1a5e82-4f70-4668-94bd-4a842d826214, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:29 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-62a20587-5b7d-41eb-b545-9e475c72da58 tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:2a1a5e82-4f70-4668-94bd-4a842d826214, portal: 172.16.0.220,3260]
Nov 13 18:47:29 user nova-compute[75216]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:2a1a5e82-4f70-4668-94bd-4a842d826214, portal: 172.16.0.220,3260] successful.
Nov 13 18:47:29 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:47:29 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a1a5e82-4f70-4668-94bd-4a842d826214 -p 172.16.0.220:3260 --op delete {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:29 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a1a5e82-4f70-4668-94bd-4a842d826214 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:29 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[7de20529-0c6b-4eb1-9919-235f7e986b15]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:29 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-62a20587-5b7d-41eb-b545-9e475c72da58 tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:47:29 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-62a20587-5b7d-41eb-b545-9e475c72da58 tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.371s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 18:47:29 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-62a20587-5b7d-41eb-b545-9e475c72da58 tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] <== disconnect_volume: return (373ms) None {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 18:47:29 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-62a20587-5b7d-41eb-b545-9e475c72da58 tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] Disconnected iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 18:47:29 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-62a20587-5b7d-41eb-b545-9e475c72da58 tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] calling os-brick to detach iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 18:47:29 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-62a20587-5b7d-41eb-b545-9e475c72da58 tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3a8669e40>, {'target_iqn': 'iqn.2010-10.org.openstack:52f4339a-6a47-4877-b041-9c27d7be2e94', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EoteNJdj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 18:47:29 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-62a20587-5b7d-41eb-b545-9e475c72da58 tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 18:47:29 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-62a20587-5b7d-41eb-b545-9e475c72da58 tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 18:47:29 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-62a20587-5b7d-41eb-b545-9e475c72da58 tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 18:47:29 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:29 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:29 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[583dff28-91bd-4f03-8c5d-fd633ef90756]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d72e8803-2ded-42f6-858f-803c16c2d2a4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0fc393f0-1356-404f-a87b-bed1fb91b924\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4cd9ea8a-0fbb-4dd4-b11c-fd661086e803\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:52f4339a-6a47-4877-b041-9c27d7be2e94\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aafa167c-c8ba-4509-88dc-33b3a07e940a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e823c6a1-f7e2-495f-a5dc-6fdfd2b19cf0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ba1efeb5-724e-4415-a5ed-12ce8c9489bc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:29 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-62a20587-5b7d-41eb-b545-9e475c72da58 tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 18:47:29 user nova-compute[75216]: No targets found.
Nov 13 18:47:29 user nova-compute[75216]: iSNS:
Nov 13 18:47:29 user nova-compute[75216]: No targets found.
Nov 13 18:47:29 user nova-compute[75216]: STATIC:
Nov 13 18:47:29 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:d72e8803-2ded-42f6-858f-803c16c2d2a4
Nov 13 18:47:29 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 18:47:29 user nova-compute[75216]:                 Iface Name: default
Nov 13 18:47:29 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:0fc393f0-1356-404f-a87b-bed1fb91b924
Nov 13 18:47:29 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 18:47:29 user nova-compute[75216]:                 Iface Name: default
Nov 13 18:47:29 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:4cd9ea8a-0fbb-4dd4-b11c-fd661086e803
Nov 13 18:47:29 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 18:47:29 user nova-compute[75216]:                 Iface Name: default
Nov 13 18:47:29 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac
Nov 13 18:47:29 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 18:47:29 user nova-compute[75216]:                 Iface Name: default
Nov 13 18:47:29 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:52f4339a-6a47-4877-b041-9c27d7be2e94
Nov 13 18:47:29 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 18:47:29 user nova-compute[75216]:                 Iface Name: default
Nov 13 18:47:29 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:aafa167c-c8ba-4509-88dc-33b3a07e940a
Nov 13 18:47:29 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 18:47:29 user nova-compute[75216]:                 Iface Name: default
Nov 13 18:47:29 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:e823c6a1-f7e2-495f-a5dc-6fdfd2b19cf0
Nov 13 18:47:29 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 18:47:29 user nova-compute[75216]:                 Iface Name: default
Nov 13 18:47:29 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:ba1efeb5-724e-4415-a5ed-12ce8c9489bc
Nov 13 18:47:29 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 18:47:29 user nova-compute[75216]:                 Iface Name: default
Nov 13 18:47:29 user nova-compute[75216]: FIRMWARE:
Nov 13 18:47:29 user nova-compute[75216]: No targets found.
Nov 13 18:47:29 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 18:47:29 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-62a20587-5b7d-41eb-b545-9e475c72da58 tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 18:47:29 user nova-compute[75216]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 18:47:29 user nova-compute[75216]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75216) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 18:47:29 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-62a20587-5b7d-41eb-b545-9e475c72da58 tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:52f4339a-6a47-4877-b041-9c27d7be2e94', 0)] {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 18:47:29 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:29 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:29 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[42a67a06-28a0-445d-87ba-a3b6c872885f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0fc393f0-1356-404f-a87b-bed1fb91b924\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4cd9ea8a-0fbb-4dd4-b11c-fd661086e803\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:52f4339a-6a47-4877-b041-9c27d7be2e94\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aafa167c-c8ba-4509-88dc-33b3a07e940a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba1efeb5-724e-4415-a5ed-12ce8c9489bc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d72e8803-2ded-42f6-858f-803c16c2d2a4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e823c6a1-f7e2-495f-a5dc-6fdfd2b19cf0\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:29 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:29 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:29 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[845ff730-aca9-4d7d-a211-5e71d925fda2]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aafa167c-c8ba-4509-88dc-33b3a07e940a (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cd9ea8a-0fbb-4dd4-b11c-fd661086e803 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d72e8803-2ded-42f6-858f-803c16c2d2a4 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba1efeb5-724e-4415-a5ed-12ce8c9489bc (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fc393f0-1356-404f-a87b-bed1fb91b924 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e823c6a1-f7e2-495f-a5dc-6fdfd2b19cf0 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52f4339a-6a47-4877-b041-9c27d7be2e94 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac (non-flash)\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:29 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-62a20587-5b7d-41eb-b545-9e475c72da58 tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aafa167c-c8ba-4509-88dc-33b3a07e940a (non-flash)
Nov 13 18:47:29 user nova-compute[75216]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cd9ea8a-0fbb-4dd4-b11c-fd661086e803 (non-flash)
Nov 13 18:47:29 user nova-compute[75216]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d72e8803-2ded-42f6-858f-803c16c2d2a4 (non-flash)
Nov 13 18:47:29 user nova-compute[75216]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba1efeb5-724e-4415-a5ed-12ce8c9489bc (non-flash)
Nov 13 18:47:29 user nova-compute[75216]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fc393f0-1356-404f-a87b-bed1fb91b924 (non-flash)
Nov 13 18:47:29 user nova-compute[75216]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e823c6a1-f7e2-495f-a5dc-6fdfd2b19cf0 (non-flash)
Nov 13 18:47:29 user nova-compute[75216]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52f4339a-6a47-4877-b041-9c27d7be2e94 (non-flash)
Nov 13 18:47:29 user nova-compute[75216]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac (non-flash)
Nov 13 18:47:29 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 18:47:29 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-62a20587-5b7d-41eb-b545-9e475c72da58 tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aafa167c-c8ba-4509-88dc-33b3a07e940a (non-flash)
Nov 13 18:47:29 user nova-compute[75216]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cd9ea8a-0fbb-4dd4-b11c-fd661086e803 (non-flash)
Nov 13 18:47:29 user nova-compute[75216]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d72e8803-2ded-42f6-858f-803c16c2d2a4 (non-flash)
Nov 13 18:47:29 user nova-compute[75216]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba1efeb5-724e-4415-a5ed-12ce8c9489bc (non-flash)
Nov 13 18:47:29 user nova-compute[75216]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fc393f0-1356-404f-a87b-bed1fb91b924 (non-flash)
Nov 13 18:47:29 user nova-compute[75216]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e823c6a1-f7e2-495f-a5dc-6fdfd2b19cf0 (non-flash)
Nov 13 18:47:29 user nova-compute[75216]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52f4339a-6a47-4877-b041-9c27d7be2e94 (non-flash)
Nov 13 18:47:29 user nova-compute[75216]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac (non-flash)
Nov 13 18:47:29 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 18:47:29 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-62a20587-5b7d-41eb-b545-9e475c72da58 tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe3a834f400>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:52f4339a-6a47-4877-b041-9c27d7be2e94'): ({'sdd'}, set())}) {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 18:47:29 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-62a20587-5b7d-41eb-b545-9e475c72da58 tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Removing single pathed devices sdd {{(pid=75216) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 18:47:29 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:29 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:29 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4712990-42de-447d-a178-57b67c0b9598]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:29 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:29 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:29 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[3162e54e-5611-4359-b2be-e634781abf38]: (4, ('ok\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:29 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-62a20587-5b7d-41eb-b545-9e475c72da58 tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Flushing IO for device /dev/sdd {{(pid=75216) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 18:47:29 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:29 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:29 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[b81b7373-53f0-4704-b11c-38fe36882afb]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:29 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-62a20587-5b7d-41eb-b545-9e475c72da58 tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75216) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 18:47:29 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:29 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.040s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:29 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d449e78-0485-455e-8216-f1d67c2a69ee]: (4, ('1', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:29 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-62a20587-5b7d-41eb-b545-9e475c72da58 tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 18:47:29 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-62a20587-5b7d-41eb-b545-9e475c72da58 tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] SCSI volumes sdd have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 18:47:29 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-62a20587-5b7d-41eb-b545-9e475c72da58 tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:52f4339a-6a47-4877-b041-9c27d7be2e94')] {{(pid=75216) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 18:47:29 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52f4339a-6a47-4877-b041-9c27d7be2e94 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:29 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52f4339a-6a47-4877-b041-9c27d7be2e94 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:29 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2c883d5-8209-4c6a-9bd4-91637b6d2f3f]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:29 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-62a20587-5b7d-41eb-b545-9e475c72da58 tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:47:29 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52f4339a-6a47-4877-b041-9c27d7be2e94 -p 172.16.0.220:3260 --logout {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:29 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52f4339a-6a47-4877-b041-9c27d7be2e94 -p 172.16.0.220:3260 --logout" returned: 0 in 0.080s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:29 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[0041335e-8fc5-4e3a-9e8e-1b146241e17c]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:52f4339a-6a47-4877-b041-9c27d7be2e94, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:52f4339a-6a47-4877-b041-9c27d7be2e94, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:29 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-62a20587-5b7d-41eb-b545-9e475c72da58 tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:52f4339a-6a47-4877-b041-9c27d7be2e94, portal: 172.16.0.220,3260]
Nov 13 18:47:29 user nova-compute[75216]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:52f4339a-6a47-4877-b041-9c27d7be2e94, portal: 172.16.0.220,3260] successful.
Nov 13 18:47:29 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:47:29 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52f4339a-6a47-4877-b041-9c27d7be2e94 -p 172.16.0.220:3260 --op delete {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:29 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52f4339a-6a47-4877-b041-9c27d7be2e94 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:29 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[11e3b604-777f-44e3-bb53-ee3415df8e78]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:29 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-62a20587-5b7d-41eb-b545-9e475c72da58 tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:47:29 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-62a20587-5b7d-41eb-b545-9e475c72da58 tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.347s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 18:47:29 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-62a20587-5b7d-41eb-b545-9e475c72da58 tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] <== disconnect_volume: return (348ms) None {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 18:47:29 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-62a20587-5b7d-41eb-b545-9e475c72da58 tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] Disconnected iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 18:47:29 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-62a20587-5b7d-41eb-b545-9e475c72da58 tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] Deleting instance files /opt/stack/data/nova/instances/3274203b-a985-4f28-9b45-3f83509ae782_del
Nov 13 18:47:29 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-62a20587-5b7d-41eb-b545-9e475c72da58 tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] Deletion of /opt/stack/data/nova/instances/3274203b-a985-4f28-9b45-3f83509ae782_del complete
Nov 13 18:47:29 user nova-compute[75216]: INFO nova.compute.manager [None req-62a20587-5b7d-41eb-b545-9e475c72da58 tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] Took 3.98 seconds to destroy the instance on the hypervisor.
Nov 13 18:47:29 user nova-compute[75216]: DEBUG oslo.service.loopingcall [None req-62a20587-5b7d-41eb-b545-9e475c72da58 tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75216) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 18:47:29 user nova-compute[75216]: DEBUG nova.compute.manager [-] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] Deallocating network for instance {{(pid=75216) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 18:47:29 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] deallocate_for_instance() {{(pid=75216) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 18:47:30 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a7a85247-963f-447c-b7f2-b42258d0713a tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Acquiring lock "78605259-17bf-47da-86de-3c76ac1c5bfa" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:47:30 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a7a85247-963f-447c-b7f2-b42258d0713a tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Lock "78605259-17bf-47da-86de-3c76ac1c5bfa" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:47:30 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a7a85247-963f-447c-b7f2-b42258d0713a tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Acquiring lock "78605259-17bf-47da-86de-3c76ac1c5bfa-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:47:30 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a7a85247-963f-447c-b7f2-b42258d0713a tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Lock "78605259-17bf-47da-86de-3c76ac1c5bfa-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:47:30 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a7a85247-963f-447c-b7f2-b42258d0713a tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Lock "78605259-17bf-47da-86de-3c76ac1c5bfa-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:47:30 user nova-compute[75216]: INFO nova.compute.manager [None req-a7a85247-963f-447c-b7f2-b42258d0713a tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Terminating instance
Nov 13 18:47:30 user nova-compute[75216]: DEBUG nova.compute.manager [None req-a7a85247-963f-447c-b7f2-b42258d0713a tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Start destroying the instance on the hypervisor. {{(pid=75216) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 18:47:30 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:47:30 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:47:30 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:47:30 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:47:30 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:47:30 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:47:30 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:47:30 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:47:30 user nova-compute[75216]: DEBUG nova.compute.manager [req-f4dd5b3d-5e0c-4bab-87ec-006faa5568a8 req-4666c76c-ef8b-4f35-a86b-298a77581d29 service nova] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Received event network-vif-unplugged-7c9f8c17-a293-4817-ae4f-3fab0a1076a6 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:47:30 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-f4dd5b3d-5e0c-4bab-87ec-006faa5568a8 req-4666c76c-ef8b-4f35-a86b-298a77581d29 service nova] Acquiring lock "78605259-17bf-47da-86de-3c76ac1c5bfa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:47:30 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-f4dd5b3d-5e0c-4bab-87ec-006faa5568a8 req-4666c76c-ef8b-4f35-a86b-298a77581d29 service nova] Lock "78605259-17bf-47da-86de-3c76ac1c5bfa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:47:30 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-f4dd5b3d-5e0c-4bab-87ec-006faa5568a8 req-4666c76c-ef8b-4f35-a86b-298a77581d29 service nova] Lock "78605259-17bf-47da-86de-3c76ac1c5bfa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:47:30 user nova-compute[75216]: DEBUG nova.compute.manager [req-f4dd5b3d-5e0c-4bab-87ec-006faa5568a8 req-4666c76c-ef8b-4f35-a86b-298a77581d29 service nova] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] No waiting events found dispatching network-vif-unplugged-7c9f8c17-a293-4817-ae4f-3fab0a1076a6 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:47:30 user nova-compute[75216]: DEBUG nova.compute.manager [req-f4dd5b3d-5e0c-4bab-87ec-006faa5568a8 req-4666c76c-ef8b-4f35-a86b-298a77581d29 service nova] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Received event network-vif-unplugged-7c9f8c17-a293-4817-ae4f-3fab0a1076a6 for instance with task_state deleting. {{(pid=75216) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 18:47:30 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:47:30 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:47:31 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:47:31 user nova-compute[75216]: DEBUG nova.compute.manager [req-3e816009-b61e-4d59-aba9-81db505a0c78 req-f0c67c8c-6f35-428a-b863-86d726955c4e service nova] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Received event network-vif-unplugged-6b91caf7-7b72-41be-8cf7-96e728c0eae5 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:47:31 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-3e816009-b61e-4d59-aba9-81db505a0c78 req-f0c67c8c-6f35-428a-b863-86d726955c4e service nova] Acquiring lock "78605259-17bf-47da-86de-3c76ac1c5bfa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:47:31 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-3e816009-b61e-4d59-aba9-81db505a0c78 req-f0c67c8c-6f35-428a-b863-86d726955c4e service nova] Lock "78605259-17bf-47da-86de-3c76ac1c5bfa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:47:31 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-3e816009-b61e-4d59-aba9-81db505a0c78 req-f0c67c8c-6f35-428a-b863-86d726955c4e service nova] Lock "78605259-17bf-47da-86de-3c76ac1c5bfa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:47:31 user nova-compute[75216]: DEBUG nova.compute.manager [req-3e816009-b61e-4d59-aba9-81db505a0c78 req-f0c67c8c-6f35-428a-b863-86d726955c4e service nova] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] No waiting events found dispatching network-vif-unplugged-6b91caf7-7b72-41be-8cf7-96e728c0eae5 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:47:31 user nova-compute[75216]: DEBUG nova.compute.manager [req-3e816009-b61e-4d59-aba9-81db505a0c78 req-f0c67c8c-6f35-428a-b863-86d726955c4e service nova] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Received event network-vif-unplugged-6b91caf7-7b72-41be-8cf7-96e728c0eae5 for instance with task_state deleting. {{(pid=75216) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 18:47:31 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:47:31 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:47:31 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:47:31 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:47:31 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:47:31 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:47:31 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:47:31 user nova-compute[75216]: DEBUG nova.compute.manager [req-9cdb7ae5-cdae-4679-b453-d59387b2e7aa req-be897b53-b3bc-4e22-ac2b-9b40e7718d40 service nova] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Received event network-vif-unplugged-7b6ed148-b7c9-479b-9e2d-cfc0c3f6f93a {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:47:31 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-9cdb7ae5-cdae-4679-b453-d59387b2e7aa req-be897b53-b3bc-4e22-ac2b-9b40e7718d40 service nova] Acquiring lock "78605259-17bf-47da-86de-3c76ac1c5bfa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:47:31 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-9cdb7ae5-cdae-4679-b453-d59387b2e7aa req-be897b53-b3bc-4e22-ac2b-9b40e7718d40 service nova] Lock "78605259-17bf-47da-86de-3c76ac1c5bfa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:47:31 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-9cdb7ae5-cdae-4679-b453-d59387b2e7aa req-be897b53-b3bc-4e22-ac2b-9b40e7718d40 service nova] Lock "78605259-17bf-47da-86de-3c76ac1c5bfa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:47:31 user nova-compute[75216]: DEBUG nova.compute.manager [req-9cdb7ae5-cdae-4679-b453-d59387b2e7aa req-be897b53-b3bc-4e22-ac2b-9b40e7718d40 service nova] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] No waiting events found dispatching network-vif-unplugged-7b6ed148-b7c9-479b-9e2d-cfc0c3f6f93a {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:47:31 user nova-compute[75216]: DEBUG nova.compute.manager [req-9cdb7ae5-cdae-4679-b453-d59387b2e7aa req-be897b53-b3bc-4e22-ac2b-9b40e7718d40 service nova] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Received event network-vif-unplugged-7b6ed148-b7c9-479b-9e2d-cfc0c3f6f93a for instance with task_state deleting. {{(pid=75216) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 18:47:31 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:47:31 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:47:31 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:47:32 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Instance destroyed successfully.
Nov 13 18:47:32 user nova-compute[75216]: DEBUG nova.objects.instance [None req-a7a85247-963f-447c-b7f2-b42258d0713a tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Lazy-loading 'resources' on Instance uuid 78605259-17bf-47da-86de-3c76ac1c5bfa {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 18:47:32 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-a7a85247-963f-447c-b7f2-b42258d0713a tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T18:45:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1463949560',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1463949560',id=10,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJx1T0XvsP0KOjgfjqi1q2on3nFgwBDJFjn7Y8e88Ig7TPicxUto3+yVPGSHigorr0YsRdHzdX17JooejloMPwKeQjFAdOrZNu9nCzVwcWfb8i+XfefIuuJFu8o61w00DA==',key_name='tempest-keypair-103032790',keypairs=<?>,launch_index=0,launched_at=2023-11-13T18:46:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='046be82514bf4c3483f8b3b8f2299b96',ramdisk_id='',reservation_id='r-k6do0zkd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1270684031',owner_user_name='tempest-TaggedBootDevicesTest-1270684031-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T18:46:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1ceef8ad05744447bcbf29460f62e32a',uuid=78605259-17bf-47da-86de-3c76ac1c5bfa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6b91caf7-7b72-41be-8cf7-96e728c0eae5", "address": "fa:16:3e:22:29:78", "network": {"id": "65bd62c0-ccfd-486a-a4e4-eafe4e4f587f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-92675676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "046be82514bf4c3483f8b3b8f2299b96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b91caf7-7b", "ovs_interfaceid": "6b91caf7-7b72-41be-8cf7-96e728c0eae5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 18:47:32 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-a7a85247-963f-447c-b7f2-b42258d0713a tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Converting VIF {"id": "6b91caf7-7b72-41be-8cf7-96e728c0eae5", "address": "fa:16:3e:22:29:78", "network": {"id": "65bd62c0-ccfd-486a-a4e4-eafe4e4f587f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-92675676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "046be82514bf4c3483f8b3b8f2299b96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b91caf7-7b", "ovs_interfaceid": "6b91caf7-7b72-41be-8cf7-96e728c0eae5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 18:47:32 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-a7a85247-963f-447c-b7f2-b42258d0713a tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:22:29:78,bridge_name='br-int',has_traffic_filtering=True,id=6b91caf7-7b72-41be-8cf7-96e728c0eae5,network=Network(65bd62c0-ccfd-486a-a4e4-eafe4e4f587f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b91caf7-7b') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 18:47:32 user nova-compute[75216]: DEBUG os_vif [None req-a7a85247-963f-447c-b7f2-b42258d0713a tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:22:29:78,bridge_name='br-int',has_traffic_filtering=True,id=6b91caf7-7b72-41be-8cf7-96e728c0eae5,network=Network(65bd62c0-ccfd-486a-a4e4-eafe4e4f587f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b91caf7-7b') {{(pid=75216) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 18:47:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:47:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6b91caf7-7b, bridge=br-int, if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:47:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:47:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:47:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:47:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:47:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ba539905-93a1-4cee-93dd-12c83a79b3da) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:47:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:47:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:47:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:47:32 user nova-compute[75216]: INFO os_vif [None req-a7a85247-963f-447c-b7f2-b42258d0713a tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:22:29:78,bridge_name='br-int',has_traffic_filtering=True,id=6b91caf7-7b72-41be-8cf7-96e728c0eae5,network=Network(65bd62c0-ccfd-486a-a4e4-eafe4e4f587f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b91caf7-7b')
Nov 13 18:47:32 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-a7a85247-963f-447c-b7f2-b42258d0713a tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T18:45:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1463949560',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1463949560',id=10,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJx1T0XvsP0KOjgfjqi1q2on3nFgwBDJFjn7Y8e88Ig7TPicxUto3+yVPGSHigorr0YsRdHzdX17JooejloMPwKeQjFAdOrZNu9nCzVwcWfb8i+XfefIuuJFu8o61w00DA==',key_name='tempest-keypair-103032790',keypairs=<?>,launch_index=0,launched_at=2023-11-13T18:46:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='046be82514bf4c3483f8b3b8f2299b96',ramdisk_id='',reservation_id='r-k6do0zkd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1270684031',owner_user_name='tempest-TaggedBootDevicesTest-1270684031-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T18:46:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1ceef8ad05744447bcbf29460f62e32a',uuid=78605259-17bf-47da-86de-3c76ac1c5bfa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7c9f8c17-a293-4817-ae4f-3fab0a1076a6", "address": "fa:16:3e:bc:93:0e", "network": {"id": "badd6fc4-dc5e-4623-b319-4969f674705f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1322270738", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.246", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "046be82514bf4c3483f8b3b8f2299b96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c9f8c17-a2", "ovs_interfaceid": "7c9f8c17-a293-4817-ae4f-3fab0a1076a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75216) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 18:47:32 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-a7a85247-963f-447c-b7f2-b42258d0713a tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Converting VIF {"id": "7c9f8c17-a293-4817-ae4f-3fab0a1076a6", "address": "fa:16:3e:bc:93:0e", "network": {"id": "badd6fc4-dc5e-4623-b319-4969f674705f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1322270738", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.246", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "046be82514bf4c3483f8b3b8f2299b96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c9f8c17-a2", "ovs_interfaceid": "7c9f8c17-a293-4817-ae4f-3fab0a1076a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 18:47:32 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-a7a85247-963f-447c-b7f2-b42258d0713a tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:93:0e,bridge_name='br-int',has_traffic_filtering=True,id=7c9f8c17-a293-4817-ae4f-3fab0a1076a6,network=Network(badd6fc4-dc5e-4623-b319-4969f674705f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7c9f8c17-a2') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 18:47:32 user nova-compute[75216]: DEBUG os_vif [None req-a7a85247-963f-447c-b7f2-b42258d0713a tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:93:0e,bridge_name='br-int',has_traffic_filtering=True,id=7c9f8c17-a293-4817-ae4f-3fab0a1076a6,network=Network(badd6fc4-dc5e-4623-b319-4969f674705f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7c9f8c17-a2') {{(pid=75216) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 18:47:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:47:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7c9f8c17-a2, bridge=br-int, if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:47:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:47:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:47:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:47:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:47:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=eb5e71b3-e499-4baa-a45b-4fd41a6d8744) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:47:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:47:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:47:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:47:32 user nova-compute[75216]: INFO os_vif [None req-a7a85247-963f-447c-b7f2-b42258d0713a tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:93:0e,bridge_name='br-int',has_traffic_filtering=True,id=7c9f8c17-a293-4817-ae4f-3fab0a1076a6,network=Network(badd6fc4-dc5e-4623-b319-4969f674705f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7c9f8c17-a2')
Nov 13 18:47:32 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-a7a85247-963f-447c-b7f2-b42258d0713a tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T18:45:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1463949560',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1463949560',id=10,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJx1T0XvsP0KOjgfjqi1q2on3nFgwBDJFjn7Y8e88Ig7TPicxUto3+yVPGSHigorr0YsRdHzdX17JooejloMPwKeQjFAdOrZNu9nCzVwcWfb8i+XfefIuuJFu8o61w00DA==',key_name='tempest-keypair-103032790',keypairs=<?>,launch_index=0,launched_at=2023-11-13T18:46:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='046be82514bf4c3483f8b3b8f2299b96',ramdisk_id='',reservation_id='r-k6do0zkd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1270684031',owner_user_name='tempest-TaggedBootDevicesTest-1270684031-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T18:46:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1ceef8ad05744447bcbf29460f62e32a',uuid=78605259-17bf-47da-86de-3c76ac1c5bfa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c5b1d8e6-f202-4278-924c-abecf64f299c", "address": "fa:16:3e:a1:c9:75", "network": {"id": "badd6fc4-dc5e-4623-b319-4969f674705f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1322270738", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.53", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "046be82514bf4c3483f8b3b8f2299b96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5b1d8e6-f2", "ovs_interfaceid": "c5b1d8e6-f202-4278-924c-abecf64f299c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75216) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 18:47:32 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-a7a85247-963f-447c-b7f2-b42258d0713a tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Converting VIF {"id": "c5b1d8e6-f202-4278-924c-abecf64f299c", "address": "fa:16:3e:a1:c9:75", "network": {"id": "badd6fc4-dc5e-4623-b319-4969f674705f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1322270738", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.53", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "046be82514bf4c3483f8b3b8f2299b96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5b1d8e6-f2", "ovs_interfaceid": "c5b1d8e6-f202-4278-924c-abecf64f299c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 18:47:32 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-a7a85247-963f-447c-b7f2-b42258d0713a tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:c9:75,bridge_name='br-int',has_traffic_filtering=True,id=c5b1d8e6-f202-4278-924c-abecf64f299c,network=Network(badd6fc4-dc5e-4623-b319-4969f674705f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc5b1d8e6-f2') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 18:47:32 user nova-compute[75216]: DEBUG os_vif [None req-a7a85247-963f-447c-b7f2-b42258d0713a tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:c9:75,bridge_name='br-int',has_traffic_filtering=True,id=c5b1d8e6-f202-4278-924c-abecf64f299c,network=Network(badd6fc4-dc5e-4623-b319-4969f674705f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc5b1d8e6-f2') {{(pid=75216) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 18:47:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:47:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc5b1d8e6-f2, bridge=br-int, if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:47:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:47:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:47:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:47:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:47:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3f8366a4-49e1-4c60-91de-ba6ae3b6308e) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:47:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:47:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:47:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:47:32 user nova-compute[75216]: INFO os_vif [None req-a7a85247-963f-447c-b7f2-b42258d0713a tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:c9:75,bridge_name='br-int',has_traffic_filtering=True,id=c5b1d8e6-f202-4278-924c-abecf64f299c,network=Network(badd6fc4-dc5e-4623-b319-4969f674705f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc5b1d8e6-f2')
Nov 13 18:47:32 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-a7a85247-963f-447c-b7f2-b42258d0713a tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T18:45:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1463949560',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1463949560',id=10,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJx1T0XvsP0KOjgfjqi1q2on3nFgwBDJFjn7Y8e88Ig7TPicxUto3+yVPGSHigorr0YsRdHzdX17JooejloMPwKeQjFAdOrZNu9nCzVwcWfb8i+XfefIuuJFu8o61w00DA==',key_name='tempest-keypair-103032790',keypairs=<?>,launch_index=0,launched_at=2023-11-13T18:46:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='046be82514bf4c3483f8b3b8f2299b96',ramdisk_id='',reservation_id='r-k6do0zkd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1270684031',owner_user_name='tempest-TaggedBootDevicesTest-1270684031-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T18:46:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1ceef8ad05744447bcbf29460f62e32a',uuid=78605259-17bf-47da-86de-3c76ac1c5bfa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5c412896-2c62-4248-a888-9b0612378259", "address": "fa:16:3e:47:55:1a", "network": {"id": "badd6fc4-dc5e-4623-b319-4969f674705f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1322270738", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "046be82514bf4c3483f8b3b8f2299b96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c412896-2c", "ovs_interfaceid": "5c412896-2c62-4248-a888-9b0612378259", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 18:47:32 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-a7a85247-963f-447c-b7f2-b42258d0713a tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Converting VIF {"id": "5c412896-2c62-4248-a888-9b0612378259", "address": "fa:16:3e:47:55:1a", "network": {"id": "badd6fc4-dc5e-4623-b319-4969f674705f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1322270738", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "046be82514bf4c3483f8b3b8f2299b96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c412896-2c", "ovs_interfaceid": "5c412896-2c62-4248-a888-9b0612378259", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 18:47:32 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-a7a85247-963f-447c-b7f2-b42258d0713a tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:55:1a,bridge_name='br-int',has_traffic_filtering=True,id=5c412896-2c62-4248-a888-9b0612378259,network=Network(badd6fc4-dc5e-4623-b319-4969f674705f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c412896-2c') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 18:47:32 user nova-compute[75216]: DEBUG os_vif [None req-a7a85247-963f-447c-b7f2-b42258d0713a tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:55:1a,bridge_name='br-int',has_traffic_filtering=True,id=5c412896-2c62-4248-a888-9b0612378259,network=Network(badd6fc4-dc5e-4623-b319-4969f674705f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c412896-2c') {{(pid=75216) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 18:47:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:47:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5c412896-2c, bridge=br-int, if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:47:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:47:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:47:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:47:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:47:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=97ecc007-d461-418e-8497-68e9596be15b) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:47:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:47:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:47:32 user nova-compute[75216]: INFO os_vif [None req-a7a85247-963f-447c-b7f2-b42258d0713a tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:55:1a,bridge_name='br-int',has_traffic_filtering=True,id=5c412896-2c62-4248-a888-9b0612378259,network=Network(badd6fc4-dc5e-4623-b319-4969f674705f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c412896-2c')
Nov 13 18:47:32 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-a7a85247-963f-447c-b7f2-b42258d0713a tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T18:45:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1463949560',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1463949560',id=10,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJx1T0XvsP0KOjgfjqi1q2on3nFgwBDJFjn7Y8e88Ig7TPicxUto3+yVPGSHigorr0YsRdHzdX17JooejloMPwKeQjFAdOrZNu9nCzVwcWfb8i+XfefIuuJFu8o61w00DA==',key_name='tempest-keypair-103032790',keypairs=<?>,launch_index=0,launched_at=2023-11-13T18:46:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='046be82514bf4c3483f8b3b8f2299b96',ramdisk_id='',reservation_id='r-k6do0zkd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1270684031',owner_user_name='tempest-TaggedBootDevicesTest-1270684031-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T18:46:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1ceef8ad05744447bcbf29460f62e32a',uuid=78605259-17bf-47da-86de-3c76ac1c5bfa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e4e34ea8-fb99-4a0e-8b65-a93933cc7d6b", "address": "fa:16:3e:a8:83:c9", "network": {"id": "badd6fc4-dc5e-4623-b319-4969f674705f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1322270738", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "046be82514bf4c3483f8b3b8f2299b96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4e34ea8-fb", "ovs_interfaceid": "e4e34ea8-fb99-4a0e-8b65-a93933cc7d6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 18:47:32 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-a7a85247-963f-447c-b7f2-b42258d0713a tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Converting VIF {"id": "e4e34ea8-fb99-4a0e-8b65-a93933cc7d6b", "address": "fa:16:3e:a8:83:c9", "network": {"id": "badd6fc4-dc5e-4623-b319-4969f674705f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1322270738", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "046be82514bf4c3483f8b3b8f2299b96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4e34ea8-fb", "ovs_interfaceid": "e4e34ea8-fb99-4a0e-8b65-a93933cc7d6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 18:47:32 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-a7a85247-963f-447c-b7f2-b42258d0713a tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:83:c9,bridge_name='br-int',has_traffic_filtering=True,id=e4e34ea8-fb99-4a0e-8b65-a93933cc7d6b,network=Network(badd6fc4-dc5e-4623-b319-4969f674705f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4e34ea8-fb') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 18:47:32 user nova-compute[75216]: DEBUG os_vif [None req-a7a85247-963f-447c-b7f2-b42258d0713a tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:83:c9,bridge_name='br-int',has_traffic_filtering=True,id=e4e34ea8-fb99-4a0e-8b65-a93933cc7d6b,network=Network(badd6fc4-dc5e-4623-b319-4969f674705f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4e34ea8-fb') {{(pid=75216) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 18:47:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:47:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape4e34ea8-fb, bridge=br-int, if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:47:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:47:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:47:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:47:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1c15d167-526b-4d42-a007-075295d0390f) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:47:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:47:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:47:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:47:32 user nova-compute[75216]: INFO os_vif [None req-a7a85247-963f-447c-b7f2-b42258d0713a tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:83:c9,bridge_name='br-int',has_traffic_filtering=True,id=e4e34ea8-fb99-4a0e-8b65-a93933cc7d6b,network=Network(badd6fc4-dc5e-4623-b319-4969f674705f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4e34ea8-fb')
Nov 13 18:47:32 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-a7a85247-963f-447c-b7f2-b42258d0713a tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T18:45:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1463949560',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1463949560',id=10,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJx1T0XvsP0KOjgfjqi1q2on3nFgwBDJFjn7Y8e88Ig7TPicxUto3+yVPGSHigorr0YsRdHzdX17JooejloMPwKeQjFAdOrZNu9nCzVwcWfb8i+XfefIuuJFu8o61w00DA==',key_name='tempest-keypair-103032790',keypairs=<?>,launch_index=0,launched_at=2023-11-13T18:46:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='046be82514bf4c3483f8b3b8f2299b96',ramdisk_id='',reservation_id='r-k6do0zkd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1270684031',owner_user_name='tempest-TaggedBootDevicesTest-1270684031-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T18:46:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1ceef8ad05744447bcbf29460f62e32a',uuid=78605259-17bf-47da-86de-3c76ac1c5bfa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7b6ed148-b7c9-479b-9e2d-cfc0c3f6f93a", "address": "fa:16:3e:e4:db:d9", "network": {"id": "debccb89-bf2d-40a9-b114-b1bb2e913648", "bridge": "br-int", "label": "tempest-device-tagging-net2-185988930", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "046be82514bf4c3483f8b3b8f2299b96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b6ed148-b7", "ovs_interfaceid": "7b6ed148-b7c9-479b-9e2d-cfc0c3f6f93a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 18:47:32 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-a7a85247-963f-447c-b7f2-b42258d0713a tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Converting VIF {"id": "7b6ed148-b7c9-479b-9e2d-cfc0c3f6f93a", "address": "fa:16:3e:e4:db:d9", "network": {"id": "debccb89-bf2d-40a9-b114-b1bb2e913648", "bridge": "br-int", "label": "tempest-device-tagging-net2-185988930", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "046be82514bf4c3483f8b3b8f2299b96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b6ed148-b7", "ovs_interfaceid": "7b6ed148-b7c9-479b-9e2d-cfc0c3f6f93a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 18:47:32 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-a7a85247-963f-447c-b7f2-b42258d0713a tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:db:d9,bridge_name='br-int',has_traffic_filtering=True,id=7b6ed148-b7c9-479b-9e2d-cfc0c3f6f93a,network=Network(debccb89-bf2d-40a9-b114-b1bb2e913648),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b6ed148-b7') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 18:47:32 user nova-compute[75216]: DEBUG os_vif [None req-a7a85247-963f-447c-b7f2-b42258d0713a tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:db:d9,bridge_name='br-int',has_traffic_filtering=True,id=7b6ed148-b7c9-479b-9e2d-cfc0c3f6f93a,network=Network(debccb89-bf2d-40a9-b114-b1bb2e913648),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b6ed148-b7') {{(pid=75216) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 18:47:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:47:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7b6ed148-b7, bridge=br-int, if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:47:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:47:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:47:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:47:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:47:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f85a1d8f-32b4-4d5f-8a90-ab85771aee84) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:47:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:47:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:47:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:47:32 user nova-compute[75216]: INFO os_vif [None req-a7a85247-963f-447c-b7f2-b42258d0713a tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:db:d9,bridge_name='br-int',has_traffic_filtering=True,id=7b6ed148-b7c9-479b-9e2d-cfc0c3f6f93a,network=Network(debccb89-bf2d-40a9-b114-b1bb2e913648),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b6ed148-b7')
Nov 13 18:47:32 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-a7a85247-963f-447c-b7f2-b42258d0713a tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T18:45:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1463949560',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1463949560',id=10,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJx1T0XvsP0KOjgfjqi1q2on3nFgwBDJFjn7Y8e88Ig7TPicxUto3+yVPGSHigorr0YsRdHzdX17JooejloMPwKeQjFAdOrZNu9nCzVwcWfb8i+XfefIuuJFu8o61w00DA==',key_name='tempest-keypair-103032790',keypairs=<?>,launch_index=0,launched_at=2023-11-13T18:46:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='046be82514bf4c3483f8b3b8f2299b96',ramdisk_id='',reservation_id='r-k6do0zkd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1270684031',owner_user_name='tempest-TaggedBootDevicesTest-1270684031-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T18:46:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1ceef8ad05744447bcbf29460f62e32a',uuid=78605259-17bf-47da-86de-3c76ac1c5bfa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "815d1175-2997-4d74-8f35-7ca982cf46aa", "address": "fa:16:3e:2c:4b:72", "network": {"id": "debccb89-bf2d-40a9-b114-b1bb2e913648", "bridge": "br-int", "label": "tempest-device-tagging-net2-185988930", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "046be82514bf4c3483f8b3b8f2299b96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap815d1175-29", "ovs_interfaceid": "815d1175-2997-4d74-8f35-7ca982cf46aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 18:47:32 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-a7a85247-963f-447c-b7f2-b42258d0713a tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Converting VIF {"id": "815d1175-2997-4d74-8f35-7ca982cf46aa", "address": "fa:16:3e:2c:4b:72", "network": {"id": "debccb89-bf2d-40a9-b114-b1bb2e913648", "bridge": "br-int", "label": "tempest-device-tagging-net2-185988930", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "046be82514bf4c3483f8b3b8f2299b96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap815d1175-29", "ovs_interfaceid": "815d1175-2997-4d74-8f35-7ca982cf46aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 18:47:32 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-a7a85247-963f-447c-b7f2-b42258d0713a tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2c:4b:72,bridge_name='br-int',has_traffic_filtering=True,id=815d1175-2997-4d74-8f35-7ca982cf46aa,network=Network(debccb89-bf2d-40a9-b114-b1bb2e913648),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap815d1175-29') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 18:47:32 user nova-compute[75216]: DEBUG os_vif [None req-a7a85247-963f-447c-b7f2-b42258d0713a tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2c:4b:72,bridge_name='br-int',has_traffic_filtering=True,id=815d1175-2997-4d74-8f35-7ca982cf46aa,network=Network(debccb89-bf2d-40a9-b114-b1bb2e913648),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap815d1175-29') {{(pid=75216) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 18:47:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:47:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap815d1175-29, bridge=br-int, if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:47:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:47:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:47:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=91bca6c5-db18-4e97-bbd3-1f128634a75e) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:47:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:47:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:47:32 user nova-compute[75216]: INFO os_vif [None req-a7a85247-963f-447c-b7f2-b42258d0713a tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2c:4b:72,bridge_name='br-int',has_traffic_filtering=True,id=815d1175-2997-4d74-8f35-7ca982cf46aa,network=Network(debccb89-bf2d-40a9-b114-b1bb2e913648),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap815d1175-29')
Nov 13 18:47:32 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a7a85247-963f-447c-b7f2-b42258d0713a tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] calling os-brick to detach iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 18:47:32 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7a85247-963f-447c-b7f2-b42258d0713a tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3a8669e40>, {'target_iqn': 'iqn.2010-10.org.openstack:ba1efeb5-724e-4415-a5ed-12ce8c9489bc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rIfKXvbA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 18:47:32 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-a7a85247-963f-447c-b7f2-b42258d0713a tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 18:47:32 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-a7a85247-963f-447c-b7f2-b42258d0713a tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 18:47:32 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-a7a85247-963f-447c-b7f2-b42258d0713a tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 18:47:32 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:32 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:32 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e6701b2-8472-4134-93f4-9a58e3500030]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d72e8803-2ded-42f6-858f-803c16c2d2a4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0fc393f0-1356-404f-a87b-bed1fb91b924\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4cd9ea8a-0fbb-4dd4-b11c-fd661086e803\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aafa167c-c8ba-4509-88dc-33b3a07e940a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e823c6a1-f7e2-495f-a5dc-6fdfd2b19cf0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ba1efeb5-724e-4415-a5ed-12ce8c9489bc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:32 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7a85247-963f-447c-b7f2-b42258d0713a tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 18:47:32 user nova-compute[75216]: No targets found.
Nov 13 18:47:32 user nova-compute[75216]: iSNS:
Nov 13 18:47:32 user nova-compute[75216]: No targets found.
Nov 13 18:47:32 user nova-compute[75216]: STATIC:
Nov 13 18:47:32 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:d72e8803-2ded-42f6-858f-803c16c2d2a4
Nov 13 18:47:32 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 18:47:32 user nova-compute[75216]:                 Iface Name: default
Nov 13 18:47:32 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:0fc393f0-1356-404f-a87b-bed1fb91b924
Nov 13 18:47:32 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 18:47:32 user nova-compute[75216]:                 Iface Name: default
Nov 13 18:47:32 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:4cd9ea8a-0fbb-4dd4-b11c-fd661086e803
Nov 13 18:47:32 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 18:47:32 user nova-compute[75216]:                 Iface Name: default
Nov 13 18:47:32 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac
Nov 13 18:47:32 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 18:47:32 user nova-compute[75216]:                 Iface Name: default
Nov 13 18:47:32 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:aafa167c-c8ba-4509-88dc-33b3a07e940a
Nov 13 18:47:32 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 18:47:32 user nova-compute[75216]:                 Iface Name: default
Nov 13 18:47:32 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:e823c6a1-f7e2-495f-a5dc-6fdfd2b19cf0
Nov 13 18:47:32 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 18:47:32 user nova-compute[75216]:                 Iface Name: default
Nov 13 18:47:32 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:ba1efeb5-724e-4415-a5ed-12ce8c9489bc
Nov 13 18:47:32 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 18:47:32 user nova-compute[75216]:                 Iface Name: default
Nov 13 18:47:32 user nova-compute[75216]: FIRMWARE:
Nov 13 18:47:32 user nova-compute[75216]: No targets found.
Nov 13 18:47:32 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 18:47:32 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7a85247-963f-447c-b7f2-b42258d0713a tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 18:47:32 user nova-compute[75216]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 18:47:32 user nova-compute[75216]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75216) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 18:47:32 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7a85247-963f-447c-b7f2-b42258d0713a tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ba1efeb5-724e-4415-a5ed-12ce8c9489bc', 0)] {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 18:47:32 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:32 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:32 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[159567cd-9dc2-4df8-a5a1-a1a6ecf5617b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0fc393f0-1356-404f-a87b-bed1fb91b924\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4cd9ea8a-0fbb-4dd4-b11c-fd661086e803\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aafa167c-c8ba-4509-88dc-33b3a07e940a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba1efeb5-724e-4415-a5ed-12ce8c9489bc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d72e8803-2ded-42f6-858f-803c16c2d2a4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e823c6a1-f7e2-495f-a5dc-6fdfd2b19cf0\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:32 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:32 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:32 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d0f23c5-e097-413d-9687-e8ee05bbdf41]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aafa167c-c8ba-4509-88dc-33b3a07e940a (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cd9ea8a-0fbb-4dd4-b11c-fd661086e803 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d72e8803-2ded-42f6-858f-803c16c2d2a4 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba1efeb5-724e-4415-a5ed-12ce8c9489bc (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fc393f0-1356-404f-a87b-bed1fb91b924 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e823c6a1-f7e2-495f-a5dc-6fdfd2b19cf0 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac (non-flash)\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:32 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7a85247-963f-447c-b7f2-b42258d0713a tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aafa167c-c8ba-4509-88dc-33b3a07e940a (non-flash)
Nov 13 18:47:32 user nova-compute[75216]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cd9ea8a-0fbb-4dd4-b11c-fd661086e803 (non-flash)
Nov 13 18:47:32 user nova-compute[75216]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d72e8803-2ded-42f6-858f-803c16c2d2a4 (non-flash)
Nov 13 18:47:32 user nova-compute[75216]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba1efeb5-724e-4415-a5ed-12ce8c9489bc (non-flash)
Nov 13 18:47:32 user nova-compute[75216]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fc393f0-1356-404f-a87b-bed1fb91b924 (non-flash)
Nov 13 18:47:32 user nova-compute[75216]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e823c6a1-f7e2-495f-a5dc-6fdfd2b19cf0 (non-flash)
Nov 13 18:47:32 user nova-compute[75216]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac (non-flash)
Nov 13 18:47:32 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 18:47:32 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7a85247-963f-447c-b7f2-b42258d0713a tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aafa167c-c8ba-4509-88dc-33b3a07e940a (non-flash)
Nov 13 18:47:32 user nova-compute[75216]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cd9ea8a-0fbb-4dd4-b11c-fd661086e803 (non-flash)
Nov 13 18:47:32 user nova-compute[75216]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d72e8803-2ded-42f6-858f-803c16c2d2a4 (non-flash)
Nov 13 18:47:32 user nova-compute[75216]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba1efeb5-724e-4415-a5ed-12ce8c9489bc (non-flash)
Nov 13 18:47:32 user nova-compute[75216]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fc393f0-1356-404f-a87b-bed1fb91b924 (non-flash)
Nov 13 18:47:32 user nova-compute[75216]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e823c6a1-f7e2-495f-a5dc-6fdfd2b19cf0 (non-flash)
Nov 13 18:47:32 user nova-compute[75216]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac (non-flash)
Nov 13 18:47:32 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 18:47:32 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7a85247-963f-447c-b7f2-b42258d0713a tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe3c0266ef0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ba1efeb5-724e-4415-a5ed-12ce8c9489bc'): ({'sdb'}, set())}) {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 18:47:32 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-a7a85247-963f-447c-b7f2-b42258d0713a tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Removing single pathed devices sdb {{(pid=75216) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 18:47:32 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:32 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:32 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[18ab8e5a-86c4-46a7-8d3d-360ffca2d5ca]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:32 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:32 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.025s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:32 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[51a9d964-917a-4b25-8432-97bfc23003fd]: (4, ('ok\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:32 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-a7a85247-963f-447c-b7f2-b42258d0713a tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Flushing IO for device /dev/sdb {{(pid=75216) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 18:47:32 user nova-compute[75216]: DEBUG nova.compute.manager [req-0e3d7488-1232-45da-9049-b196a5f63157 req-7950b74b-602d-495a-8ed7-ea11db89efc5 service nova] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Received event network-vif-plugged-7c9f8c17-a293-4817-ae4f-3fab0a1076a6 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:47:32 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-0e3d7488-1232-45da-9049-b196a5f63157 req-7950b74b-602d-495a-8ed7-ea11db89efc5 service nova] Acquiring lock "78605259-17bf-47da-86de-3c76ac1c5bfa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:47:32 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-0e3d7488-1232-45da-9049-b196a5f63157 req-7950b74b-602d-495a-8ed7-ea11db89efc5 service nova] Lock "78605259-17bf-47da-86de-3c76ac1c5bfa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:47:32 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-0e3d7488-1232-45da-9049-b196a5f63157 req-7950b74b-602d-495a-8ed7-ea11db89efc5 service nova] Lock "78605259-17bf-47da-86de-3c76ac1c5bfa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:47:32 user nova-compute[75216]: DEBUG nova.compute.manager [req-0e3d7488-1232-45da-9049-b196a5f63157 req-7950b74b-602d-495a-8ed7-ea11db89efc5 service nova] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] No waiting events found dispatching network-vif-plugged-7c9f8c17-a293-4817-ae4f-3fab0a1076a6 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:47:32 user nova-compute[75216]: WARNING nova.compute.manager [req-0e3d7488-1232-45da-9049-b196a5f63157 req-7950b74b-602d-495a-8ed7-ea11db89efc5 service nova] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Received unexpected event network-vif-plugged-7c9f8c17-a293-4817-ae4f-3fab0a1076a6 for instance with vm_state active and task_state deleting.
Nov 13 18:47:32 user nova-compute[75216]: DEBUG nova.compute.manager [req-0e3d7488-1232-45da-9049-b196a5f63157 req-7950b74b-602d-495a-8ed7-ea11db89efc5 service nova] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Received event network-vif-unplugged-c5b1d8e6-f202-4278-924c-abecf64f299c {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:47:32 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-0e3d7488-1232-45da-9049-b196a5f63157 req-7950b74b-602d-495a-8ed7-ea11db89efc5 service nova] Acquiring lock "78605259-17bf-47da-86de-3c76ac1c5bfa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:47:32 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-0e3d7488-1232-45da-9049-b196a5f63157 req-7950b74b-602d-495a-8ed7-ea11db89efc5 service nova] Lock "78605259-17bf-47da-86de-3c76ac1c5bfa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:47:32 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-0e3d7488-1232-45da-9049-b196a5f63157 req-7950b74b-602d-495a-8ed7-ea11db89efc5 service nova] Lock "78605259-17bf-47da-86de-3c76ac1c5bfa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:47:32 user nova-compute[75216]: DEBUG nova.compute.manager [req-0e3d7488-1232-45da-9049-b196a5f63157 req-7950b74b-602d-495a-8ed7-ea11db89efc5 service nova] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] No waiting events found dispatching network-vif-unplugged-c5b1d8e6-f202-4278-924c-abecf64f299c {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:47:32 user nova-compute[75216]: DEBUG nova.compute.manager [req-0e3d7488-1232-45da-9049-b196a5f63157 req-7950b74b-602d-495a-8ed7-ea11db89efc5 service nova] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Received event network-vif-unplugged-c5b1d8e6-f202-4278-924c-abecf64f299c for instance with task_state deleting. {{(pid=75216) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 18:47:32 user nova-compute[75216]: DEBUG nova.compute.manager [req-0e3d7488-1232-45da-9049-b196a5f63157 req-7950b74b-602d-495a-8ed7-ea11db89efc5 service nova] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Received event network-vif-plugged-c5b1d8e6-f202-4278-924c-abecf64f299c {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:47:32 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-0e3d7488-1232-45da-9049-b196a5f63157 req-7950b74b-602d-495a-8ed7-ea11db89efc5 service nova] Acquiring lock "78605259-17bf-47da-86de-3c76ac1c5bfa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:47:32 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-0e3d7488-1232-45da-9049-b196a5f63157 req-7950b74b-602d-495a-8ed7-ea11db89efc5 service nova] Lock "78605259-17bf-47da-86de-3c76ac1c5bfa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:47:32 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-0e3d7488-1232-45da-9049-b196a5f63157 req-7950b74b-602d-495a-8ed7-ea11db89efc5 service nova] Lock "78605259-17bf-47da-86de-3c76ac1c5bfa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:47:32 user nova-compute[75216]: DEBUG nova.compute.manager [req-0e3d7488-1232-45da-9049-b196a5f63157 req-7950b74b-602d-495a-8ed7-ea11db89efc5 service nova] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] No waiting events found dispatching network-vif-plugged-c5b1d8e6-f202-4278-924c-abecf64f299c {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:47:32 user nova-compute[75216]: WARNING nova.compute.manager [req-0e3d7488-1232-45da-9049-b196a5f63157 req-7950b74b-602d-495a-8ed7-ea11db89efc5 service nova] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Received unexpected event network-vif-plugged-c5b1d8e6-f202-4278-924c-abecf64f299c for instance with vm_state active and task_state deleting.
Nov 13 18:47:32 user nova-compute[75216]: DEBUG nova.compute.manager [req-0e3d7488-1232-45da-9049-b196a5f63157 req-7950b74b-602d-495a-8ed7-ea11db89efc5 service nova] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Received event network-vif-unplugged-e4e34ea8-fb99-4a0e-8b65-a93933cc7d6b {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:47:32 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-0e3d7488-1232-45da-9049-b196a5f63157 req-7950b74b-602d-495a-8ed7-ea11db89efc5 service nova] Acquiring lock "78605259-17bf-47da-86de-3c76ac1c5bfa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:47:32 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-0e3d7488-1232-45da-9049-b196a5f63157 req-7950b74b-602d-495a-8ed7-ea11db89efc5 service nova] Lock "78605259-17bf-47da-86de-3c76ac1c5bfa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:47:32 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-0e3d7488-1232-45da-9049-b196a5f63157 req-7950b74b-602d-495a-8ed7-ea11db89efc5 service nova] Lock "78605259-17bf-47da-86de-3c76ac1c5bfa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:47:32 user nova-compute[75216]: DEBUG nova.compute.manager [req-0e3d7488-1232-45da-9049-b196a5f63157 req-7950b74b-602d-495a-8ed7-ea11db89efc5 service nova] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] No waiting events found dispatching network-vif-unplugged-e4e34ea8-fb99-4a0e-8b65-a93933cc7d6b {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:47:32 user nova-compute[75216]: DEBUG nova.compute.manager [req-0e3d7488-1232-45da-9049-b196a5f63157 req-7950b74b-602d-495a-8ed7-ea11db89efc5 service nova] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Received event network-vif-unplugged-e4e34ea8-fb99-4a0e-8b65-a93933cc7d6b for instance with task_state deleting. {{(pid=75216) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 18:47:32 user nova-compute[75216]: DEBUG nova.compute.manager [req-0e3d7488-1232-45da-9049-b196a5f63157 req-7950b74b-602d-495a-8ed7-ea11db89efc5 service nova] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Received event network-vif-plugged-e4e34ea8-fb99-4a0e-8b65-a93933cc7d6b {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:47:32 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-0e3d7488-1232-45da-9049-b196a5f63157 req-7950b74b-602d-495a-8ed7-ea11db89efc5 service nova] Acquiring lock "78605259-17bf-47da-86de-3c76ac1c5bfa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:47:32 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-0e3d7488-1232-45da-9049-b196a5f63157 req-7950b74b-602d-495a-8ed7-ea11db89efc5 service nova] Lock "78605259-17bf-47da-86de-3c76ac1c5bfa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:47:32 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-0e3d7488-1232-45da-9049-b196a5f63157 req-7950b74b-602d-495a-8ed7-ea11db89efc5 service nova] Lock "78605259-17bf-47da-86de-3c76ac1c5bfa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:47:32 user nova-compute[75216]: DEBUG nova.compute.manager [req-0e3d7488-1232-45da-9049-b196a5f63157 req-7950b74b-602d-495a-8ed7-ea11db89efc5 service nova] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] No waiting events found dispatching network-vif-plugged-e4e34ea8-fb99-4a0e-8b65-a93933cc7d6b {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:47:32 user nova-compute[75216]: WARNING nova.compute.manager [req-0e3d7488-1232-45da-9049-b196a5f63157 req-7950b74b-602d-495a-8ed7-ea11db89efc5 service nova] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Received unexpected event network-vif-plugged-e4e34ea8-fb99-4a0e-8b65-a93933cc7d6b for instance with vm_state active and task_state deleting.
Nov 13 18:47:32 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:32 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:32 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[f745d632-0487-4116-bce5-7e1ba1ef9666]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:32 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-a7a85247-963f-447c-b7f2-b42258d0713a tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75216) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 18:47:32 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:32 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:32 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[de639ac3-fcdc-4596-89ac-0658a999998d]: (4, ('1', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:32 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-a7a85247-963f-447c-b7f2-b42258d0713a tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 18:47:32 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-a7a85247-963f-447c-b7f2-b42258d0713a tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] SCSI volumes sdb have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 18:47:33 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7a85247-963f-447c-b7f2-b42258d0713a tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ba1efeb5-724e-4415-a5ed-12ce8c9489bc')] {{(pid=75216) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 18:47:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba1efeb5-724e-4415-a5ed-12ce8c9489bc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba1efeb5-724e-4415-a5ed-12ce8c9489bc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:33 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd4e2f6b-6651-4568-b486-87178a0ae0b4]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:33 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7a85247-963f-447c-b7f2-b42258d0713a tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:47:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba1efeb5-724e-4415-a5ed-12ce8c9489bc -p 172.16.0.220:3260 --logout {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:33 user nova-compute[75216]: DEBUG nova.compute.manager [None req-fca63c40-e0e7-49e0-a25e-9796f5541cfd tempest-TestVolumeSwap-1274447143 tempest-TestVolumeSwap-1274447143-project-admin] [instance: 872856e5-cdc4-444e-8835-55e36708d776] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f530e526-b4b9-405c-8bde-111e34095cc4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ReFEXBsZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '872856e5-cdc4-444e-8835-55e36708d776', 'attached_at': '', 'detached_at': '', 'volume_id': 'f530e526-b4b9-405c-8bde-111e34095cc4', 'serial': 'f530e526-b4b9-405c-8bde-111e34095cc4'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4cd9ea8a-0fbb-4dd4-b11c-fd661086e803', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DbhNcyvG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk', 'volume_id': '4cd9ea8a-0fbb-4dd4-b11c-fd661086e803'}, 'status': 'reserved', 'instance': '872856e5-cdc4-444e-8835-55e36708d776', 'attached_at': '', 'detached_at': '', 'volume_id': '4cd9ea8a-0fbb-4dd4-b11c-fd661086e803', 'serial'} {{(pid=75216) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 13 18:47:33 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fca63c40-e0e7-49e0-a25e-9796f5541cfd tempest-TestVolumeSwap-1274447143 tempest-TestVolumeSwap-1274447143-project-admin] [instance: 872856e5-cdc4-444e-8835-55e36708d776] Calling os-brick to attach iSCSI Volume {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 18:47:33 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-fca63c40-e0e7-49e0-a25e-9796f5541cfd tempest-TestVolumeSwap-1274447143 tempest-TestVolumeSwap-1274447143-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3a8669e40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f530e526-b4b9-405c-8bde-111e34095cc4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ReFEXBsZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 18:47:33 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-fca63c40-e0e7-49e0-a25e-9796f5541cfd tempest-TestVolumeSwap-1274447143 tempest-TestVolumeSwap-1274447143-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 18:47:33 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-fca63c40-e0e7-49e0-a25e-9796f5541cfd tempest-TestVolumeSwap-1274447143 tempest-TestVolumeSwap-1274447143-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 18:47:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba1efeb5-724e-4415-a5ed-12ce8c9489bc -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:33 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfd793df-9b3c-4320-8565-2d28e8548a75]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:ba1efeb5-724e-4415-a5ed-12ce8c9489bc, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:ba1efeb5-724e-4415-a5ed-12ce8c9489bc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:33 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7a85247-963f-447c-b7f2-b42258d0713a tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:ba1efeb5-724e-4415-a5ed-12ce8c9489bc, portal: 172.16.0.220,3260]
Nov 13 18:47:33 user nova-compute[75216]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:ba1efeb5-724e-4415-a5ed-12ce8c9489bc, portal: 172.16.0.220,3260] successful.
Nov 13 18:47:33 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:47:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba1efeb5-724e-4415-a5ed-12ce8c9489bc -p 172.16.0.220:3260 --op delete {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:33 user nova-compute[75216]: DEBUG nova.compute.manager [req-1b0c579f-1525-4316-a008-06ff8a9354ef req-f51f736e-3ce4-4174-b48a-8c9f1700ee8c service nova] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Received event network-vif-plugged-6b91caf7-7b72-41be-8cf7-96e728c0eae5 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:47:33 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-1b0c579f-1525-4316-a008-06ff8a9354ef req-f51f736e-3ce4-4174-b48a-8c9f1700ee8c service nova] Acquiring lock "78605259-17bf-47da-86de-3c76ac1c5bfa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:47:33 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-1b0c579f-1525-4316-a008-06ff8a9354ef req-f51f736e-3ce4-4174-b48a-8c9f1700ee8c service nova] Lock "78605259-17bf-47da-86de-3c76ac1c5bfa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:47:33 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-1b0c579f-1525-4316-a008-06ff8a9354ef req-f51f736e-3ce4-4174-b48a-8c9f1700ee8c service nova] Lock "78605259-17bf-47da-86de-3c76ac1c5bfa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:47:33 user nova-compute[75216]: DEBUG nova.compute.manager [req-1b0c579f-1525-4316-a008-06ff8a9354ef req-f51f736e-3ce4-4174-b48a-8c9f1700ee8c service nova] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] No waiting events found dispatching network-vif-plugged-6b91caf7-7b72-41be-8cf7-96e728c0eae5 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:47:33 user nova-compute[75216]: WARNING nova.compute.manager [req-1b0c579f-1525-4316-a008-06ff8a9354ef req-f51f736e-3ce4-4174-b48a-8c9f1700ee8c service nova] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Received unexpected event network-vif-plugged-6b91caf7-7b72-41be-8cf7-96e728c0eae5 for instance with vm_state active and task_state deleting.
Nov 13 18:47:33 user nova-compute[75216]: DEBUG nova.compute.manager [req-1b0c579f-1525-4316-a008-06ff8a9354ef req-f51f736e-3ce4-4174-b48a-8c9f1700ee8c service nova] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Received event network-vif-unplugged-5c412896-2c62-4248-a888-9b0612378259 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:47:33 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-1b0c579f-1525-4316-a008-06ff8a9354ef req-f51f736e-3ce4-4174-b48a-8c9f1700ee8c service nova] Acquiring lock "78605259-17bf-47da-86de-3c76ac1c5bfa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:47:33 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-1b0c579f-1525-4316-a008-06ff8a9354ef req-f51f736e-3ce4-4174-b48a-8c9f1700ee8c service nova] Lock "78605259-17bf-47da-86de-3c76ac1c5bfa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:47:33 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-1b0c579f-1525-4316-a008-06ff8a9354ef req-f51f736e-3ce4-4174-b48a-8c9f1700ee8c service nova] Lock "78605259-17bf-47da-86de-3c76ac1c5bfa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:47:33 user nova-compute[75216]: DEBUG nova.compute.manager [req-1b0c579f-1525-4316-a008-06ff8a9354ef req-f51f736e-3ce4-4174-b48a-8c9f1700ee8c service nova] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] No waiting events found dispatching network-vif-unplugged-5c412896-2c62-4248-a888-9b0612378259 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:47:33 user nova-compute[75216]: DEBUG nova.compute.manager [req-1b0c579f-1525-4316-a008-06ff8a9354ef req-f51f736e-3ce4-4174-b48a-8c9f1700ee8c service nova] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Received event network-vif-unplugged-5c412896-2c62-4248-a888-9b0612378259 for instance with task_state deleting. {{(pid=75216) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 18:47:33 user nova-compute[75216]: DEBUG nova.compute.manager [req-1b0c579f-1525-4316-a008-06ff8a9354ef req-f51f736e-3ce4-4174-b48a-8c9f1700ee8c service nova] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Received event network-vif-plugged-5c412896-2c62-4248-a888-9b0612378259 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:47:33 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-1b0c579f-1525-4316-a008-06ff8a9354ef req-f51f736e-3ce4-4174-b48a-8c9f1700ee8c service nova] Acquiring lock "78605259-17bf-47da-86de-3c76ac1c5bfa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:47:33 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-1b0c579f-1525-4316-a008-06ff8a9354ef req-f51f736e-3ce4-4174-b48a-8c9f1700ee8c service nova] Lock "78605259-17bf-47da-86de-3c76ac1c5bfa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:47:33 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-1b0c579f-1525-4316-a008-06ff8a9354ef req-f51f736e-3ce4-4174-b48a-8c9f1700ee8c service nova] Lock "78605259-17bf-47da-86de-3c76ac1c5bfa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:47:33 user nova-compute[75216]: DEBUG nova.compute.manager [req-1b0c579f-1525-4316-a008-06ff8a9354ef req-f51f736e-3ce4-4174-b48a-8c9f1700ee8c service nova] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] No waiting events found dispatching network-vif-plugged-5c412896-2c62-4248-a888-9b0612378259 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:47:33 user nova-compute[75216]: WARNING nova.compute.manager [req-1b0c579f-1525-4316-a008-06ff8a9354ef req-f51f736e-3ce4-4174-b48a-8c9f1700ee8c service nova] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Received unexpected event network-vif-plugged-5c412896-2c62-4248-a888-9b0612378259 for instance with vm_state active and task_state deleting.
Nov 13 18:47:33 user nova-compute[75216]: DEBUG nova.compute.manager [req-1b0c579f-1525-4316-a008-06ff8a9354ef req-f51f736e-3ce4-4174-b48a-8c9f1700ee8c service nova] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Received event network-vif-unplugged-815d1175-2997-4d74-8f35-7ca982cf46aa {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:47:33 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-1b0c579f-1525-4316-a008-06ff8a9354ef req-f51f736e-3ce4-4174-b48a-8c9f1700ee8c service nova] Acquiring lock "78605259-17bf-47da-86de-3c76ac1c5bfa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:47:33 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-1b0c579f-1525-4316-a008-06ff8a9354ef req-f51f736e-3ce4-4174-b48a-8c9f1700ee8c service nova] Lock "78605259-17bf-47da-86de-3c76ac1c5bfa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:47:33 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-1b0c579f-1525-4316-a008-06ff8a9354ef req-f51f736e-3ce4-4174-b48a-8c9f1700ee8c service nova] Lock "78605259-17bf-47da-86de-3c76ac1c5bfa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:47:33 user nova-compute[75216]: DEBUG nova.compute.manager [req-1b0c579f-1525-4316-a008-06ff8a9354ef req-f51f736e-3ce4-4174-b48a-8c9f1700ee8c service nova] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] No waiting events found dispatching network-vif-unplugged-815d1175-2997-4d74-8f35-7ca982cf46aa {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:47:33 user nova-compute[75216]: DEBUG nova.compute.manager [req-1b0c579f-1525-4316-a008-06ff8a9354ef req-f51f736e-3ce4-4174-b48a-8c9f1700ee8c service nova] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Received event network-vif-unplugged-815d1175-2997-4d74-8f35-7ca982cf46aa for instance with task_state deleting. {{(pid=75216) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 18:47:33 user nova-compute[75216]: DEBUG nova.compute.manager [req-1b0c579f-1525-4316-a008-06ff8a9354ef req-f51f736e-3ce4-4174-b48a-8c9f1700ee8c service nova] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Received event network-vif-plugged-815d1175-2997-4d74-8f35-7ca982cf46aa {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:47:33 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-1b0c579f-1525-4316-a008-06ff8a9354ef req-f51f736e-3ce4-4174-b48a-8c9f1700ee8c service nova] Acquiring lock "78605259-17bf-47da-86de-3c76ac1c5bfa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:47:33 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-1b0c579f-1525-4316-a008-06ff8a9354ef req-f51f736e-3ce4-4174-b48a-8c9f1700ee8c service nova] Lock "78605259-17bf-47da-86de-3c76ac1c5bfa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:47:33 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-1b0c579f-1525-4316-a008-06ff8a9354ef req-f51f736e-3ce4-4174-b48a-8c9f1700ee8c service nova] Lock "78605259-17bf-47da-86de-3c76ac1c5bfa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:47:33 user nova-compute[75216]: DEBUG nova.compute.manager [req-1b0c579f-1525-4316-a008-06ff8a9354ef req-f51f736e-3ce4-4174-b48a-8c9f1700ee8c service nova] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] No waiting events found dispatching network-vif-plugged-815d1175-2997-4d74-8f35-7ca982cf46aa {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:47:33 user nova-compute[75216]: WARNING nova.compute.manager [req-1b0c579f-1525-4316-a008-06ff8a9354ef req-f51f736e-3ce4-4174-b48a-8c9f1700ee8c service nova] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Received unexpected event network-vif-plugged-815d1175-2997-4d74-8f35-7ca982cf46aa for instance with vm_state active and task_state deleting.
Nov 13 18:47:33 user nova-compute[75216]: DEBUG nova.compute.manager [req-1b0c579f-1525-4316-a008-06ff8a9354ef req-f51f736e-3ce4-4174-b48a-8c9f1700ee8c service nova] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] Received event network-vif-deleted-1bb4df6f-02b2-415b-9cea-fd8a7a04874c {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:47:33 user nova-compute[75216]: INFO nova.compute.manager [req-1b0c579f-1525-4316-a008-06ff8a9354ef req-f51f736e-3ce4-4174-b48a-8c9f1700ee8c service nova] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] Neutron deleted interface 1bb4df6f-02b2-415b-9cea-fd8a7a04874c; detaching it from the instance and deleting it from the info cache
Nov 13 18:47:33 user nova-compute[75216]: DEBUG nova.network.neutron [req-1b0c579f-1525-4316-a008-06ff8a9354ef req-f51f736e-3ce4-4174-b48a-8c9f1700ee8c service nova] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] Updating instance_info_cache with network_info: [{"id": "217faeb3-4474-449c-ae9f-86e555ce7cd7", "address": "fa:16:3e:49:58:83", "network": {"id": "804f3c05-e540-4bae-a58f-682133e0c762", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-619032523-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8d0f284dd8d4cc88f04a729b1d5d38c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap217faeb3-44", "ovs_interfaceid": "217faeb3-4474-449c-ae9f-86e555ce7cd7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9bed3978-d90d-4b90-b798-12413ea26a48", "address": "fa:16:3e:17:08:ae", "network": {"id": "590b5147-c33a-45bd-a502-8fd41408064d", "bridge": "br-int", "label": "tempest-device-tagging-net1-904391500", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a8d0f284dd8d4cc88f04a729b1d5d38c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bed3978-d9", "ovs_interfaceid": "9bed3978-d90d-4b90-b798-12413ea26a48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "95a425c5-f994-4504-a94b-040103b2efa7", "address": "fa:16:3e:02:ea:af", "network": {"id": "590b5147-c33a-45bd-a502-8fd41408064d", "bridge": "br-int", "label": "tempest-device-tagging-net1-904391500", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.40", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a8d0f284dd8d4cc88f04a729b1d5d38c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95a425c5-f9", "ovs_interfaceid": "95a425c5-f994-4504-a94b-040103b2efa7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7aa7e71d-2c00-40fd-9d05-d108bcc807ec", "address": "fa:16:3e:73:99:8a", "network": {"id": "590b5147-c33a-45bd-a502-8fd41408064d", "bridge": "br-int", "label": "tempest-device-tagging-net1-904391500", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.98", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a8d0f284dd8d4cc88f04a729b1d5d38c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7aa7e71d-2c", "ovs_interfaceid": "7aa7e71d-2c00-40fd-9d05-d108bcc807ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "01772e53-e624-4728-beb1-929cc4165f21", "address": "fa:16:3e:a7:a0:fe", "network": {"id": "590b5147-c33a-45bd-a502-8fd41408064d", "bridge": "br-int", "label": "tempest-device-tagging-net1-904391500", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a8d0f284dd8d4cc88f04a729b1d5d38c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01772e53-e6", "ovs_interfaceid": "01772e53-e624-4728-beb1-929cc4165f21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a07efcd3-59f4-452e-8fb7-8b8233ae235f", "address": "fa:16:3e:6c:cb:eb", "network": {"id": "f82e0fd1-978f-4b08-8480-709765208ef9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1203652186", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a8d0f284dd8d4cc88f04a729b1d5d38c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa07efcd3-59", "ovs_interfaceid": "a07efcd3-59f4-452e-8fb7-8b8233ae235f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 18:47:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba1efeb5-724e-4415-a5ed-12ce8c9489bc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:33 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfe7f5cd-0286-4758-a0f0-d34b798f7794]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:33 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7a85247-963f-447c-b7f2-b42258d0713a tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:47:33 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-a7a85247-963f-447c-b7f2-b42258d0713a tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.355s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 18:47:33 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7a85247-963f-447c-b7f2-b42258d0713a tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] <== disconnect_volume: return (356ms) None {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 18:47:33 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a7a85247-963f-447c-b7f2-b42258d0713a tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Disconnected iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 18:47:33 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-fca63c40-e0e7-49e0-a25e-9796f5541cfd tempest-TestVolumeSwap-1274447143 tempest-TestVolumeSwap-1274447143-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.052s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 18:47:33 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-fca63c40-e0e7-49e0-a25e-9796f5541cfd tempest-TestVolumeSwap-1274447143 tempest-TestVolumeSwap-1274447143-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 18:47:33 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-fca63c40-e0e7-49e0-a25e-9796f5541cfd tempest-TestVolumeSwap-1274447143 tempest-TestVolumeSwap-1274447143-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f530e526-b4b9-405c-8bde-111e34095cc4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 18:47:33 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-fca63c40-e0e7-49e0-a25e-9796f5541cfd tempest-TestVolumeSwap-1274447143 tempest-TestVolumeSwap-1274447143-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f530e526-b4b9-405c-8bde-111e34095cc4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 18:47:33 user nova-compute[75216]: INFO os_brick.initiator.connectors.iscsi [None req-fca63c40-e0e7-49e0-a25e-9796f5541cfd tempest-TestVolumeSwap-1274447143 tempest-TestVolumeSwap-1274447143-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 18:47:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f530e526-b4b9-405c-8bde-111e34095cc4 -p 172.16.0.220:3260 {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:33 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:47:33 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a7a85247-963f-447c-b7f2-b42258d0713a tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] calling os-brick to detach iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 18:47:33 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7a85247-963f-447c-b7f2-b42258d0713a tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3a8669e40>, {'target_iqn': 'iqn.2010-10.org.openstack:0fc393f0-1356-404f-a87b-bed1fb91b924', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZsBVjobt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 18:47:33 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-a7a85247-963f-447c-b7f2-b42258d0713a tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 18:47:33 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-a7a85247-963f-447c-b7f2-b42258d0713a tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 18:47:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f530e526-b4b9-405c-8bde-111e34095cc4 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:33 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dfbbf72-2332-4477-9ac9-28c492480df9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:33 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-fca63c40-e0e7-49e0-a25e-9796f5541cfd tempest-TestVolumeSwap-1274447143 tempest-TestVolumeSwap-1274447143-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 18:47:33 user nova-compute[75216]:  {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:47:33 user nova-compute[75216]: DEBUG nova.compute.manager [req-1b0c579f-1525-4316-a008-06ff8a9354ef req-f51f736e-3ce4-4174-b48a-8c9f1700ee8c service nova] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] Detach interface failed, port_id=1bb4df6f-02b2-415b-9cea-fd8a7a04874c, reason: Instance 3274203b-a985-4f28-9b45-3f83509ae782 could not be found. {{(pid=75216) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 13 18:47:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f530e526-b4b9-405c-8bde-111e34095cc4 -p 172.16.0.220:3260 --interface default --op new {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f530e526-b4b9-405c-8bde-111e34095cc4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:33 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3e52b37-803f-4c9a-925a-07758a9f52f6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f530e526-b4b9-405c-8bde-111e34095cc4] added\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:33 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-fca63c40-e0e7-49e0-a25e-9796f5541cfd tempest-TestVolumeSwap-1274447143 tempest-TestVolumeSwap-1274447143-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f530e526-b4b9-405c-8bde-111e34095cc4] added
Nov 13 18:47:33 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:47:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f530e526-b4b9-405c-8bde-111e34095cc4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f530e526-b4b9-405c-8bde-111e34095cc4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:33 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c0d3ec1-8ac1-4c6c-bdec-4e369ec97634]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:33 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-fca63c40-e0e7-49e0-a25e-9796f5541cfd tempest-TestVolumeSwap-1274447143 tempest-TestVolumeSwap-1274447143-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:47:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f530e526-b4b9-405c-8bde-111e34095cc4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f530e526-b4b9-405c-8bde-111e34095cc4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:33 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b05dcaa-4e69-4650-b291-7b5eb8c85ea8]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:33 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-fca63c40-e0e7-49e0-a25e-9796f5541cfd tempest-TestVolumeSwap-1274447143 tempest-TestVolumeSwap-1274447143-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:47:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f530e526-b4b9-405c-8bde-111e34095cc4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ReFEXBsZ {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f530e526-b4b9-405c-8bde-111e34095cc4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ReFEXBsZ" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:33 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[849fc465-52b1-4c15-9791-07558be2726f]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:33 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-fca63c40-e0e7-49e0-a25e-9796f5541cfd tempest-TestVolumeSwap-1274447143 tempest-TestVolumeSwap-1274447143-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ReFEXBsZ'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:47:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f530e526-b4b9-405c-8bde-111e34095cc4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f530e526-b4b9-405c-8bde-111e34095cc4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:33 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c5df2ea-c032-4aea-bd29-42c45709234f]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:33 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-fca63c40-e0e7-49e0-a25e-9796f5541cfd tempest-TestVolumeSwap-1274447143 tempest-TestVolumeSwap-1274447143-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:47:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:33 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[4da059a9-a3c2-4a66-af8a-94f42f202e87]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aafa167c-c8ba-4509-88dc-33b3a07e940a (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cd9ea8a-0fbb-4dd4-b11c-fd661086e803 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d72e8803-2ded-42f6-858f-803c16c2d2a4 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fc393f0-1356-404f-a87b-bed1fb91b924 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e823c6a1-f7e2-495f-a5dc-6fdfd2b19cf0 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac (non-flash)\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:33 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-fca63c40-e0e7-49e0-a25e-9796f5541cfd tempest-TestVolumeSwap-1274447143 tempest-TestVolumeSwap-1274447143-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aafa167c-c8ba-4509-88dc-33b3a07e940a (non-flash)
Nov 13 18:47:33 user nova-compute[75216]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cd9ea8a-0fbb-4dd4-b11c-fd661086e803 (non-flash)
Nov 13 18:47:33 user nova-compute[75216]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d72e8803-2ded-42f6-858f-803c16c2d2a4 (non-flash)
Nov 13 18:47:33 user nova-compute[75216]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fc393f0-1356-404f-a87b-bed1fb91b924 (non-flash)
Nov 13 18:47:33 user nova-compute[75216]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e823c6a1-f7e2-495f-a5dc-6fdfd2b19cf0 (non-flash)
Nov 13 18:47:33 user nova-compute[75216]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac (non-flash)
Nov 13 18:47:33 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 18:47:33 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-fca63c40-e0e7-49e0-a25e-9796f5541cfd tempest-TestVolumeSwap-1274447143 tempest-TestVolumeSwap-1274447143-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aafa167c-c8ba-4509-88dc-33b3a07e940a (non-flash)
Nov 13 18:47:33 user nova-compute[75216]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cd9ea8a-0fbb-4dd4-b11c-fd661086e803 (non-flash)
Nov 13 18:47:33 user nova-compute[75216]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d72e8803-2ded-42f6-858f-803c16c2d2a4 (non-flash)
Nov 13 18:47:33 user nova-compute[75216]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fc393f0-1356-404f-a87b-bed1fb91b924 (non-flash)
Nov 13 18:47:33 user nova-compute[75216]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e823c6a1-f7e2-495f-a5dc-6fdfd2b19cf0 (non-flash)
Nov 13 18:47:33 user nova-compute[75216]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac (non-flash)
Nov 13 18:47:33 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 18:47:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f530e526-b4b9-405c-8bde-111e34095cc4 -p 172.16.0.220:3260 --login {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f530e526-b4b9-405c-8bde-111e34095cc4 -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:33 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d1d8545-a08a-44d7-826c-abb217257d3f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f530e526-b4b9-405c-8bde-111e34095cc4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f530e526-b4b9-405c-8bde-111e34095cc4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:33 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-fca63c40-e0e7-49e0-a25e-9796f5541cfd tempest-TestVolumeSwap-1274447143 tempest-TestVolumeSwap-1274447143-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f530e526-b4b9-405c-8bde-111e34095cc4, portal: 172.16.0.220,3260]
Nov 13 18:47:33 user nova-compute[75216]: Login to [iface: default, target: iqn.2010-10.org.openstack:f530e526-b4b9-405c-8bde-111e34095cc4, portal: 172.16.0.220,3260] successful.
Nov 13 18:47:33 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:47:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f530e526-b4b9-405c-8bde-111e34095cc4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f530e526-b4b9-405c-8bde-111e34095cc4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:33 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[fef45be3-49e2-4115-a919-0f8f322c02d0]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:33 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-fca63c40-e0e7-49e0-a25e-9796f5541cfd tempest-TestVolumeSwap-1274447143 tempest-TestVolumeSwap-1274447143-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:47:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:33 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[c06f68ba-fedd-4526-8e7f-509a14d25d79]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aafa167c-c8ba-4509-88dc-33b3a07e940a (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cd9ea8a-0fbb-4dd4-b11c-fd661086e803 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d72e8803-2ded-42f6-858f-803c16c2d2a4 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530e526-b4b9-405c-8bde-111e34095cc4 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fc393f0-1356-404f-a87b-bed1fb91b924 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e823c6a1-f7e2-495f-a5dc-6fdfd2b19cf0 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac (non-flash)\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:33 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-fca63c40-e0e7-49e0-a25e-9796f5541cfd tempest-TestVolumeSwap-1274447143 tempest-TestVolumeSwap-1274447143-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aafa167c-c8ba-4509-88dc-33b3a07e940a (non-flash)
Nov 13 18:47:33 user nova-compute[75216]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cd9ea8a-0fbb-4dd4-b11c-fd661086e803 (non-flash)
Nov 13 18:47:33 user nova-compute[75216]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d72e8803-2ded-42f6-858f-803c16c2d2a4 (non-flash)
Nov 13 18:47:33 user nova-compute[75216]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530e526-b4b9-405c-8bde-111e34095cc4 (non-flash)
Nov 13 18:47:33 user nova-compute[75216]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fc393f0-1356-404f-a87b-bed1fb91b924 (non-flash)
Nov 13 18:47:33 user nova-compute[75216]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e823c6a1-f7e2-495f-a5dc-6fdfd2b19cf0 (non-flash)
Nov 13 18:47:33 user nova-compute[75216]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac (non-flash)
Nov 13 18:47:33 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 18:47:33 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-fca63c40-e0e7-49e0-a25e-9796f5541cfd tempest-TestVolumeSwap-1274447143 tempest-TestVolumeSwap-1274447143-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aafa167c-c8ba-4509-88dc-33b3a07e940a (non-flash)
Nov 13 18:47:33 user nova-compute[75216]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cd9ea8a-0fbb-4dd4-b11c-fd661086e803 (non-flash)
Nov 13 18:47:33 user nova-compute[75216]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d72e8803-2ded-42f6-858f-803c16c2d2a4 (non-flash)
Nov 13 18:47:33 user nova-compute[75216]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530e526-b4b9-405c-8bde-111e34095cc4 (non-flash)
Nov 13 18:47:33 user nova-compute[75216]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fc393f0-1356-404f-a87b-bed1fb91b924 (non-flash)
Nov 13 18:47:33 user nova-compute[75216]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e823c6a1-f7e2-495f-a5dc-6fdfd2b19cf0 (non-flash)
Nov 13 18:47:33 user nova-compute[75216]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac (non-flash)
Nov 13 18:47:33 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 18:47:33 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-fca63c40-e0e7-49e0-a25e-9796f5541cfd tempest-TestVolumeSwap-1274447143 tempest-TestVolumeSwap-1274447143-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f530e526-b4b9-405c-8bde-111e34095cc4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.313s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 18:47:33 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-fca63c40-e0e7-49e0-a25e-9796f5541cfd tempest-TestVolumeSwap-1274447143 tempest-TestVolumeSwap-1274447143-project-admin] Connected to 172.16.0.220:3260 {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 18:47:33 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-fca63c40-e0e7-49e0-a25e-9796f5541cfd tempest-TestVolumeSwap-1274447143 tempest-TestVolumeSwap-1274447143-project-admin] HCTL ('33', '-', '-', 0) found on session 15 with lun 0 {{(pid=75216) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 18:47:33 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-fca63c40-e0e7-49e0-a25e-9796f5541cfd tempest-TestVolumeSwap-1274447143 tempest-TestVolumeSwap-1274447143-project-admin] Scanning host 33 c: -, t: -, l: 0) {{(pid=75216) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 18:47:33 user nova-compute[75216]: DEBUG nova.compute.manager [req-7b8bac5a-7333-4f93-82b3-295a1bfdb18e req-faa8853f-5fb7-457a-aaa3-f76f2124b61d service nova] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Received event network-vif-plugged-7b6ed148-b7c9-479b-9e2d-cfc0c3f6f93a {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:47:33 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-7b8bac5a-7333-4f93-82b3-295a1bfdb18e req-faa8853f-5fb7-457a-aaa3-f76f2124b61d service nova] Acquiring lock "78605259-17bf-47da-86de-3c76ac1c5bfa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:47:33 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-7b8bac5a-7333-4f93-82b3-295a1bfdb18e req-faa8853f-5fb7-457a-aaa3-f76f2124b61d service nova] Lock "78605259-17bf-47da-86de-3c76ac1c5bfa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:47:33 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-7b8bac5a-7333-4f93-82b3-295a1bfdb18e req-faa8853f-5fb7-457a-aaa3-f76f2124b61d service nova] Lock "78605259-17bf-47da-86de-3c76ac1c5bfa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:47:33 user nova-compute[75216]: DEBUG nova.compute.manager [req-7b8bac5a-7333-4f93-82b3-295a1bfdb18e req-faa8853f-5fb7-457a-aaa3-f76f2124b61d service nova] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] No waiting events found dispatching network-vif-plugged-7b6ed148-b7c9-479b-9e2d-cfc0c3f6f93a {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:47:33 user nova-compute[75216]: WARNING nova.compute.manager [req-7b8bac5a-7333-4f93-82b3-295a1bfdb18e req-faa8853f-5fb7-457a-aaa3-f76f2124b61d service nova] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Received unexpected event network-vif-plugged-7b6ed148-b7c9-479b-9e2d-cfc0c3f6f93a for instance with vm_state active and task_state deleting.
Nov 13 18:47:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:33 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[f14b7779-e5dc-4f54-973c-3d2628492543]: (4, ('- - 0', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:33 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-fca63c40-e0e7-49e0-a25e-9796f5541cfd tempest-TestVolumeSwap-1274447143 tempest-TestVolumeSwap-1274447143-project-admin] Searching for a device in session 15 and hctl ['33', '*', '*', 0] yield: None {{(pid=75216) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 18:47:33 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-0107ddb3-b970-4740-974c-4f7655c19bda tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 83fda249-9d28-4cc2-aeb0-103ce4f1faa4 is timed out.
Nov 13 18:47:33 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-0107ddb3-b970-4740-974c-4f7655c19bda tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] Successfully detached device vdb from instance 83fda249-9d28-4cc2-aeb0-103ce4f1faa4 from the live domain config.
Nov 13 18:47:33 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0107ddb3-b970-4740-974c-4f7655c19bda tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] [instance: 83fda249-9d28-4cc2-aeb0-103ce4f1faa4] calling os-brick to detach iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 18:47:33 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-0107ddb3-b970-4740-974c-4f7655c19bda tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3a8669e40>, {'target_iqn': 'iqn.2010-10.org.openstack:aafa167c-c8ba-4509-88dc-33b3a07e940a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EdrGSLqo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 18:47:33 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-0107ddb3-b970-4740-974c-4f7655c19bda tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 18:47:33 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-0107ddb3-b970-4740-974c-4f7655c19bda tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 18:47:34 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-fca63c40-e0e7-49e0-a25e-9796f5541cfd tempest-TestVolumeSwap-1274447143 tempest-TestVolumeSwap-1274447143-project-admin] Searching for a device in session 15 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75216) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 18:47:34 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-fca63c40-e0e7-49e0-a25e-9796f5541cfd tempest-TestVolumeSwap-1274447143 tempest-TestVolumeSwap-1274447143-project-admin] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:f530e526-b4b9-405c-8bde-111e34095cc4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ReFEXBsZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 18:47:34 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-fca63c40-e0e7-49e0-a25e-9796f5541cfd tempest-TestVolumeSwap-1274447143 tempest-TestVolumeSwap-1274447143-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.345s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 18:47:34 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-fca63c40-e0e7-49e0-a25e-9796f5541cfd tempest-TestVolumeSwap-1274447143 tempest-TestVolumeSwap-1274447143-project-admin] <== connect_volume: return (1397ms) {'type': 'block', 'scsi_wwn': '26236636366626336', 'path': '/dev/sdb'} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 18:47:34 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fca63c40-e0e7-49e0-a25e-9796f5541cfd tempest-TestVolumeSwap-1274447143 tempest-TestVolumeSwap-1274447143-project-admin] [instance: 872856e5-cdc4-444e-8835-55e36708d776] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26236636366626336', 'path': '/dev/sdb'} {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 18:47:34 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-a7a85247-963f-447c-b7f2-b42258d0713a tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.338s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 18:47:34 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:34 user nova-compute[75216]: DEBUG nova.objects.instance [None req-fca63c40-e0e7-49e0-a25e-9796f5541cfd tempest-TestVolumeSwap-1274447143 tempest-TestVolumeSwap-1274447143-project-admin] Lazy-loading 'flavor' on Instance uuid 872856e5-cdc4-444e-8835-55e36708d776 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 18:47:34 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:34 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[239ef3b8-0c22-4b09-8d50-fc79b25c33c6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f530e526-b4b9-405c-8bde-111e34095cc4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d72e8803-2ded-42f6-858f-803c16c2d2a4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0fc393f0-1356-404f-a87b-bed1fb91b924\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4cd9ea8a-0fbb-4dd4-b11c-fd661086e803\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aafa167c-c8ba-4509-88dc-33b3a07e940a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e823c6a1-f7e2-495f-a5dc-6fdfd2b19cf0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:34 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7a85247-963f-447c-b7f2-b42258d0713a tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 18:47:34 user nova-compute[75216]: No targets found.
Nov 13 18:47:34 user nova-compute[75216]: iSNS:
Nov 13 18:47:34 user nova-compute[75216]: No targets found.
Nov 13 18:47:34 user nova-compute[75216]: STATIC:
Nov 13 18:47:34 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:f530e526-b4b9-405c-8bde-111e34095cc4
Nov 13 18:47:34 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 18:47:34 user nova-compute[75216]:                 Iface Name: default
Nov 13 18:47:34 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:d72e8803-2ded-42f6-858f-803c16c2d2a4
Nov 13 18:47:34 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 18:47:34 user nova-compute[75216]:                 Iface Name: default
Nov 13 18:47:34 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:0fc393f0-1356-404f-a87b-bed1fb91b924
Nov 13 18:47:34 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 18:47:34 user nova-compute[75216]:                 Iface Name: default
Nov 13 18:47:34 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:4cd9ea8a-0fbb-4dd4-b11c-fd661086e803
Nov 13 18:47:34 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 18:47:34 user nova-compute[75216]:                 Iface Name: default
Nov 13 18:47:34 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac
Nov 13 18:47:34 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 18:47:34 user nova-compute[75216]:                 Iface Name: default
Nov 13 18:47:34 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:aafa167c-c8ba-4509-88dc-33b3a07e940a
Nov 13 18:47:34 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 18:47:34 user nova-compute[75216]:                 Iface Name: default
Nov 13 18:47:34 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:e823c6a1-f7e2-495f-a5dc-6fdfd2b19cf0
Nov 13 18:47:34 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 18:47:34 user nova-compute[75216]:                 Iface Name: default
Nov 13 18:47:34 user nova-compute[75216]: FIRMWARE:
Nov 13 18:47:34 user nova-compute[75216]: No targets found.
Nov 13 18:47:34 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 18:47:34 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7a85247-963f-447c-b7f2-b42258d0713a tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 18:47:34 user nova-compute[75216]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 18:47:34 user nova-compute[75216]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75216) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 18:47:34 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7a85247-963f-447c-b7f2-b42258d0713a tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0fc393f0-1356-404f-a87b-bed1fb91b924', 0)] {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 18:47:34 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:34 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:34 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e72f42d-ee3f-4ec6-a15b-349b974090d8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0fc393f0-1356-404f-a87b-bed1fb91b924\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4cd9ea8a-0fbb-4dd4-b11c-fd661086e803\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aafa167c-c8ba-4509-88dc-33b3a07e940a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d72e8803-2ded-42f6-858f-803c16c2d2a4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e823c6a1-f7e2-495f-a5dc-6fdfd2b19cf0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f530e526-b4b9-405c-8bde-111e34095cc4\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:34 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:34 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:34 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f3a7535-9f0c-4d9c-8359-d360ef4c8ac7]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aafa167c-c8ba-4509-88dc-33b3a07e940a (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cd9ea8a-0fbb-4dd4-b11c-fd661086e803 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d72e8803-2ded-42f6-858f-803c16c2d2a4 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530e526-b4b9-405c-8bde-111e34095cc4 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fc393f0-1356-404f-a87b-bed1fb91b924 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e823c6a1-f7e2-495f-a5dc-6fdfd2b19cf0 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac (non-flash)\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:34 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7a85247-963f-447c-b7f2-b42258d0713a tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aafa167c-c8ba-4509-88dc-33b3a07e940a (non-flash)
Nov 13 18:47:34 user nova-compute[75216]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cd9ea8a-0fbb-4dd4-b11c-fd661086e803 (non-flash)
Nov 13 18:47:34 user nova-compute[75216]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d72e8803-2ded-42f6-858f-803c16c2d2a4 (non-flash)
Nov 13 18:47:34 user nova-compute[75216]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530e526-b4b9-405c-8bde-111e34095cc4 (non-flash)
Nov 13 18:47:34 user nova-compute[75216]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fc393f0-1356-404f-a87b-bed1fb91b924 (non-flash)
Nov 13 18:47:34 user nova-compute[75216]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e823c6a1-f7e2-495f-a5dc-6fdfd2b19cf0 (non-flash)
Nov 13 18:47:34 user nova-compute[75216]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac (non-flash)
Nov 13 18:47:34 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 18:47:34 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7a85247-963f-447c-b7f2-b42258d0713a tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aafa167c-c8ba-4509-88dc-33b3a07e940a (non-flash)
Nov 13 18:47:34 user nova-compute[75216]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cd9ea8a-0fbb-4dd4-b11c-fd661086e803 (non-flash)
Nov 13 18:47:34 user nova-compute[75216]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d72e8803-2ded-42f6-858f-803c16c2d2a4 (non-flash)
Nov 13 18:47:34 user nova-compute[75216]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530e526-b4b9-405c-8bde-111e34095cc4 (non-flash)
Nov 13 18:47:34 user nova-compute[75216]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fc393f0-1356-404f-a87b-bed1fb91b924 (non-flash)
Nov 13 18:47:34 user nova-compute[75216]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e823c6a1-f7e2-495f-a5dc-6fdfd2b19cf0 (non-flash)
Nov 13 18:47:34 user nova-compute[75216]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac (non-flash)
Nov 13 18:47:34 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 18:47:34 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7a85247-963f-447c-b7f2-b42258d0713a tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe3a857a0e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0fc393f0-1356-404f-a87b-bed1fb91b924'): ({'sde'}, set())}) {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 18:47:34 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-a7a85247-963f-447c-b7f2-b42258d0713a tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Removing single pathed devices sde {{(pid=75216) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 18:47:34 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:34 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:34 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff676637-e34a-4267-afd1-b277230c6559]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:34 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:34 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.023s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:34 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[44a2dec6-e72a-4855-b7d6-2c16d3d0599c]: (4, ('ok\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:34 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-a7a85247-963f-447c-b7f2-b42258d0713a tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Flushing IO for device /dev/sde {{(pid=75216) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 18:47:34 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:34 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:34 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb83d891-7731-4922-bc2e-abdaeb207c83]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:34 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-a7a85247-963f-447c-b7f2-b42258d0713a tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75216) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 18:47:34 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:34 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.037s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:34 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[923d74c8-d499-40da-813e-085e632ef804]: (4, ('1', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:34 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-a7a85247-963f-447c-b7f2-b42258d0713a tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 18:47:34 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-a7a85247-963f-447c-b7f2-b42258d0713a tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] SCSI volumes sde have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 18:47:34 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7a85247-963f-447c-b7f2-b42258d0713a tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0fc393f0-1356-404f-a87b-bed1fb91b924')] {{(pid=75216) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 18:47:34 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fc393f0-1356-404f-a87b-bed1fb91b924 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:34 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fc393f0-1356-404f-a87b-bed1fb91b924 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:34 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[77d1d805-6c38-4361-b176-f1f4180d941c]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:34 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7a85247-963f-447c-b7f2-b42258d0713a tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:47:34 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fc393f0-1356-404f-a87b-bed1fb91b924 -p 172.16.0.220:3260 --logout {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:34 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fc393f0-1356-404f-a87b-bed1fb91b924 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:34 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb4e7837-bbc3-4cb5-bfcd-246636c35ce0]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:0fc393f0-1356-404f-a87b-bed1fb91b924, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:0fc393f0-1356-404f-a87b-bed1fb91b924, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:34 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7a85247-963f-447c-b7f2-b42258d0713a tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:0fc393f0-1356-404f-a87b-bed1fb91b924, portal: 172.16.0.220,3260]
Nov 13 18:47:34 user nova-compute[75216]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:0fc393f0-1356-404f-a87b-bed1fb91b924, portal: 172.16.0.220,3260] successful.
Nov 13 18:47:34 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:47:34 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fc393f0-1356-404f-a87b-bed1fb91b924 -p 172.16.0.220:3260 --op delete {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:34 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fc393f0-1356-404f-a87b-bed1fb91b924 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:34 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[5846f4d0-d4de-4907-9543-e7c03c686daa]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:34 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7a85247-963f-447c-b7f2-b42258d0713a tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:47:34 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-a7a85247-963f-447c-b7f2-b42258d0713a tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.325s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 18:47:34 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7a85247-963f-447c-b7f2-b42258d0713a tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] <== disconnect_volume: return (1663ms) None {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 18:47:34 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a7a85247-963f-447c-b7f2-b42258d0713a tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Disconnected iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 18:47:34 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-0107ddb3-b970-4740-974c-4f7655c19bda tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.974s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 18:47:34 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:34 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a7a85247-963f-447c-b7f2-b42258d0713a tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] calling os-brick to detach iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 18:47:34 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7a85247-963f-447c-b7f2-b42258d0713a tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3a8669e40>, {'target_iqn': 'iqn.2010-10.org.openstack:e823c6a1-f7e2-495f-a5dc-6fdfd2b19cf0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'egXpiAOk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 18:47:34 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-a7a85247-963f-447c-b7f2-b42258d0713a tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 18:47:34 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-a7a85247-963f-447c-b7f2-b42258d0713a tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 18:47:34 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] Updating instance_info_cache with network_info: [] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 18:47:34 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:34 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[a10b0eda-520e-4bad-be3d-bd8cf85258cc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f530e526-b4b9-405c-8bde-111e34095cc4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d72e8803-2ded-42f6-858f-803c16c2d2a4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4cd9ea8a-0fbb-4dd4-b11c-fd661086e803\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aafa167c-c8ba-4509-88dc-33b3a07e940a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e823c6a1-f7e2-495f-a5dc-6fdfd2b19cf0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:34 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-0107ddb3-b970-4740-974c-4f7655c19bda tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 18:47:34 user nova-compute[75216]: No targets found.
Nov 13 18:47:34 user nova-compute[75216]: iSNS:
Nov 13 18:47:34 user nova-compute[75216]: No targets found.
Nov 13 18:47:34 user nova-compute[75216]: STATIC:
Nov 13 18:47:34 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:f530e526-b4b9-405c-8bde-111e34095cc4
Nov 13 18:47:34 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 18:47:34 user nova-compute[75216]:                 Iface Name: default
Nov 13 18:47:34 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:d72e8803-2ded-42f6-858f-803c16c2d2a4
Nov 13 18:47:34 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 18:47:34 user nova-compute[75216]:                 Iface Name: default
Nov 13 18:47:34 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:4cd9ea8a-0fbb-4dd4-b11c-fd661086e803
Nov 13 18:47:34 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 18:47:34 user nova-compute[75216]:                 Iface Name: default
Nov 13 18:47:34 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac
Nov 13 18:47:34 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 18:47:34 user nova-compute[75216]:                 Iface Name: default
Nov 13 18:47:34 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:aafa167c-c8ba-4509-88dc-33b3a07e940a
Nov 13 18:47:34 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 18:47:34 user nova-compute[75216]:                 Iface Name: default
Nov 13 18:47:34 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:e823c6a1-f7e2-495f-a5dc-6fdfd2b19cf0
Nov 13 18:47:34 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 18:47:34 user nova-compute[75216]:                 Iface Name: default
Nov 13 18:47:34 user nova-compute[75216]: FIRMWARE:
Nov 13 18:47:34 user nova-compute[75216]: No targets found.
Nov 13 18:47:34 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 18:47:34 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-0107ddb3-b970-4740-974c-4f7655c19bda tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 18:47:34 user nova-compute[75216]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 18:47:34 user nova-compute[75216]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75216) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 18:47:34 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-0107ddb3-b970-4740-974c-4f7655c19bda tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aafa167c-c8ba-4509-88dc-33b3a07e940a', 0)] {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 18:47:34 user nova-compute[75216]: INFO nova.compute.manager [-] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] Took 5.28 seconds to deallocate network for instance.
Nov 13 18:47:34 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:34 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:34 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e04df91-10ee-48f4-b849-6e8b9ca13af1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4cd9ea8a-0fbb-4dd4-b11c-fd661086e803\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aafa167c-c8ba-4509-88dc-33b3a07e940a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d72e8803-2ded-42f6-858f-803c16c2d2a4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e823c6a1-f7e2-495f-a5dc-6fdfd2b19cf0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f530e526-b4b9-405c-8bde-111e34095cc4\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:34 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:34 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.055s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:34 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[3637a5e6-cee3-40a3-83ee-00281d844ee8]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aafa167c-c8ba-4509-88dc-33b3a07e940a (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cd9ea8a-0fbb-4dd4-b11c-fd661086e803 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d72e8803-2ded-42f6-858f-803c16c2d2a4 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530e526-b4b9-405c-8bde-111e34095cc4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e823c6a1-f7e2-495f-a5dc-6fdfd2b19cf0 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac (non-flash)\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:34 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-0107ddb3-b970-4740-974c-4f7655c19bda tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aafa167c-c8ba-4509-88dc-33b3a07e940a (non-flash)
Nov 13 18:47:34 user nova-compute[75216]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cd9ea8a-0fbb-4dd4-b11c-fd661086e803 (non-flash)
Nov 13 18:47:34 user nova-compute[75216]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d72e8803-2ded-42f6-858f-803c16c2d2a4 (non-flash)
Nov 13 18:47:34 user nova-compute[75216]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530e526-b4b9-405c-8bde-111e34095cc4 (non-flash)
Nov 13 18:47:34 user nova-compute[75216]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e823c6a1-f7e2-495f-a5dc-6fdfd2b19cf0 (non-flash)
Nov 13 18:47:34 user nova-compute[75216]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac (non-flash)
Nov 13 18:47:34 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 18:47:34 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-0107ddb3-b970-4740-974c-4f7655c19bda tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aafa167c-c8ba-4509-88dc-33b3a07e940a (non-flash)
Nov 13 18:47:34 user nova-compute[75216]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cd9ea8a-0fbb-4dd4-b11c-fd661086e803 (non-flash)
Nov 13 18:47:34 user nova-compute[75216]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d72e8803-2ded-42f6-858f-803c16c2d2a4 (non-flash)
Nov 13 18:47:34 user nova-compute[75216]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530e526-b4b9-405c-8bde-111e34095cc4 (non-flash)
Nov 13 18:47:34 user nova-compute[75216]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e823c6a1-f7e2-495f-a5dc-6fdfd2b19cf0 (non-flash)
Nov 13 18:47:34 user nova-compute[75216]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac (non-flash)
Nov 13 18:47:34 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 18:47:34 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-0107ddb3-b970-4740-974c-4f7655c19bda tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe3a87441f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aafa167c-c8ba-4509-88dc-33b3a07e940a'): ({'sdi'}, set())}) {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 18:47:34 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-0107ddb3-b970-4740-974c-4f7655c19bda tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] Removing single pathed devices sdi {{(pid=75216) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 18:47:34 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:34 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:34 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7040c98-bd7e-42e2-aa72-197b4469f74a]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:34 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:34 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-fca63c40-e0e7-49e0-a25e-9796f5541cfd tempest-TestVolumeSwap-1274447143 tempest-TestVolumeSwap-1274447143-project-admin] COPY block job progress, current cursor: 2097152 final cursor: 1073741824 {{(pid=75216) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 13 18:47:34 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.024s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:34 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[19407f5f-b135-48a5-9ae6-7e543c91cbb2]: (4, ('ok\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:34 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-0107ddb3-b970-4740-974c-4f7655c19bda tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] Flushing IO for device /dev/sdi {{(pid=75216) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 18:47:34 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:34 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.016s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:34 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[d09c74ea-de3b-4af0-b28c-e572557cff70]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:34 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-0107ddb3-b970-4740-974c-4f7655c19bda tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=75216) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 18:47:34 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.046s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:35 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[b20da0ef-6c90-4296-90b4-1148eb1725ff]: (4, ('1', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:35 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-0107ddb3-b970-4740-974c-4f7655c19bda tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 18:47:35 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-0107ddb3-b970-4740-974c-4f7655c19bda tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] SCSI volumes sdi have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 18:47:35 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-0107ddb3-b970-4740-974c-4f7655c19bda tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aafa167c-c8ba-4509-88dc-33b3a07e940a')] {{(pid=75216) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 18:47:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aafa167c-c8ba-4509-88dc-33b3a07e940a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aafa167c-c8ba-4509-88dc-33b3a07e940a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:35 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ca81753-b6a8-4913-b24f-f5b0a719b266]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:35 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-0107ddb3-b970-4740-974c-4f7655c19bda tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:47:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aafa167c-c8ba-4509-88dc-33b3a07e940a -p 172.16.0.220:3260 --logout {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aafa167c-c8ba-4509-88dc-33b3a07e940a -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:35 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[9648b802-7011-4ae5-8f74-e8f8111a8a21]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:aafa167c-c8ba-4509-88dc-33b3a07e940a, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:aafa167c-c8ba-4509-88dc-33b3a07e940a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:35 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-0107ddb3-b970-4740-974c-4f7655c19bda tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:aafa167c-c8ba-4509-88dc-33b3a07e940a, portal: 172.16.0.220,3260]
Nov 13 18:47:35 user nova-compute[75216]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:aafa167c-c8ba-4509-88dc-33b3a07e940a, portal: 172.16.0.220,3260] successful.
Nov 13 18:47:35 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:47:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aafa167c-c8ba-4509-88dc-33b3a07e940a -p 172.16.0.220:3260 --op delete {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:35 user nova-compute[75216]: DEBUG nova.compute.manager [req-995d2c7c-43ce-4129-ac93-e57a7999660b req-4e24a8a5-6341-45ab-a903-e8e8d4d07f80 service nova] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] Received event network-vif-deleted-01772e53-e624-4728-beb1-929cc4165f21 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:47:35 user nova-compute[75216]: DEBUG nova.compute.manager [req-995d2c7c-43ce-4129-ac93-e57a7999660b req-4e24a8a5-6341-45ab-a903-e8e8d4d07f80 service nova] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] Received event network-vif-deleted-7aa7e71d-2c00-40fd-9d05-d108bcc807ec {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:47:35 user nova-compute[75216]: DEBUG nova.compute.manager [req-995d2c7c-43ce-4129-ac93-e57a7999660b req-4e24a8a5-6341-45ab-a903-e8e8d4d07f80 service nova] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] Received event network-vif-deleted-217faeb3-4474-449c-ae9f-86e555ce7cd7 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:47:35 user nova-compute[75216]: DEBUG nova.compute.manager [req-995d2c7c-43ce-4129-ac93-e57a7999660b req-4e24a8a5-6341-45ab-a903-e8e8d4d07f80 service nova] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] Received event network-vif-deleted-a07efcd3-59f4-452e-8fb7-8b8233ae235f {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:47:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aafa167c-c8ba-4509-88dc-33b3a07e940a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:35 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[4afaea5e-061c-4eb9-8b36-1f182d7868ed]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:35 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-0107ddb3-b970-4740-974c-4f7655c19bda tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:47:35 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-0107ddb3-b970-4740-974c-4f7655c19bda tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.376s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 18:47:35 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-0107ddb3-b970-4740-974c-4f7655c19bda tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] <== disconnect_volume: return (1349ms) None {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 18:47:35 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0107ddb3-b970-4740-974c-4f7655c19bda tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] [instance: 83fda249-9d28-4cc2-aeb0-103ce4f1faa4] Disconnected iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 18:47:35 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-a7a85247-963f-447c-b7f2-b42258d0713a tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.375s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 18:47:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:35 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[1abcbbdf-8ddd-4edf-9a25-7e2e2bddea3f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f530e526-b4b9-405c-8bde-111e34095cc4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d72e8803-2ded-42f6-858f-803c16c2d2a4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4cd9ea8a-0fbb-4dd4-b11c-fd661086e803\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e823c6a1-f7e2-495f-a5dc-6fdfd2b19cf0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:35 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7a85247-963f-447c-b7f2-b42258d0713a tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 18:47:35 user nova-compute[75216]: No targets found.
Nov 13 18:47:35 user nova-compute[75216]: iSNS:
Nov 13 18:47:35 user nova-compute[75216]: No targets found.
Nov 13 18:47:35 user nova-compute[75216]: STATIC:
Nov 13 18:47:35 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:f530e526-b4b9-405c-8bde-111e34095cc4
Nov 13 18:47:35 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 18:47:35 user nova-compute[75216]:                 Iface Name: default
Nov 13 18:47:35 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:d72e8803-2ded-42f6-858f-803c16c2d2a4
Nov 13 18:47:35 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 18:47:35 user nova-compute[75216]:                 Iface Name: default
Nov 13 18:47:35 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:4cd9ea8a-0fbb-4dd4-b11c-fd661086e803
Nov 13 18:47:35 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 18:47:35 user nova-compute[75216]:                 Iface Name: default
Nov 13 18:47:35 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac
Nov 13 18:47:35 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 18:47:35 user nova-compute[75216]:                 Iface Name: default
Nov 13 18:47:35 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:e823c6a1-f7e2-495f-a5dc-6fdfd2b19cf0
Nov 13 18:47:35 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 18:47:35 user nova-compute[75216]:                 Iface Name: default
Nov 13 18:47:35 user nova-compute[75216]: FIRMWARE:
Nov 13 18:47:35 user nova-compute[75216]: No targets found.
Nov 13 18:47:35 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 18:47:35 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7a85247-963f-447c-b7f2-b42258d0713a tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 18:47:35 user nova-compute[75216]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 18:47:35 user nova-compute[75216]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75216) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 18:47:35 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7a85247-963f-447c-b7f2-b42258d0713a tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e823c6a1-f7e2-495f-a5dc-6fdfd2b19cf0', 0)] {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 18:47:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:35 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[32e25c51-1637-4db8-bf8b-e071b7dae497]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4cd9ea8a-0fbb-4dd4-b11c-fd661086e803\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d72e8803-2ded-42f6-858f-803c16c2d2a4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e823c6a1-f7e2-495f-a5dc-6fdfd2b19cf0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f530e526-b4b9-405c-8bde-111e34095cc4\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:35 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[189eebbc-ced7-48d3-b648-dc87875a277d]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cd9ea8a-0fbb-4dd4-b11c-fd661086e803 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d72e8803-2ded-42f6-858f-803c16c2d2a4 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530e526-b4b9-405c-8bde-111e34095cc4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e823c6a1-f7e2-495f-a5dc-6fdfd2b19cf0 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac (non-flash)\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:35 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7a85247-963f-447c-b7f2-b42258d0713a tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cd9ea8a-0fbb-4dd4-b11c-fd661086e803 (non-flash)
Nov 13 18:47:35 user nova-compute[75216]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d72e8803-2ded-42f6-858f-803c16c2d2a4 (non-flash)
Nov 13 18:47:35 user nova-compute[75216]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530e526-b4b9-405c-8bde-111e34095cc4 (non-flash)
Nov 13 18:47:35 user nova-compute[75216]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e823c6a1-f7e2-495f-a5dc-6fdfd2b19cf0 (non-flash)
Nov 13 18:47:35 user nova-compute[75216]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac (non-flash)
Nov 13 18:47:35 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 18:47:35 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7a85247-963f-447c-b7f2-b42258d0713a tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cd9ea8a-0fbb-4dd4-b11c-fd661086e803 (non-flash)
Nov 13 18:47:35 user nova-compute[75216]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d72e8803-2ded-42f6-858f-803c16c2d2a4 (non-flash)
Nov 13 18:47:35 user nova-compute[75216]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530e526-b4b9-405c-8bde-111e34095cc4 (non-flash)
Nov 13 18:47:35 user nova-compute[75216]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e823c6a1-f7e2-495f-a5dc-6fdfd2b19cf0 (non-flash)
Nov 13 18:47:35 user nova-compute[75216]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac (non-flash)
Nov 13 18:47:35 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 18:47:35 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7a85247-963f-447c-b7f2-b42258d0713a tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe3c029b880>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e823c6a1-f7e2-495f-a5dc-6fdfd2b19cf0'): ({'sdg'}, set())}) {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 18:47:35 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-a7a85247-963f-447c-b7f2-b42258d0713a tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Removing single pathed devices sdg {{(pid=75216) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 18:47:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:35 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcfc7172-9fa1-41b3-9301-22d0ece83dd6]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:35 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[73ff9fad-1f5b-4c4a-81d3-e342b4cffdc8]: (4, ('ok\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:35 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-a7a85247-963f-447c-b7f2-b42258d0713a tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Flushing IO for device /dev/sdg {{(pid=75216) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 18:47:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.013s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:35 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[9296fe95-3635-4ac0-a5ba-45baeab2425a]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:35 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-a7a85247-963f-447c-b7f2-b42258d0713a tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75216) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 18:47:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.044s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:35 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[d681dff8-aae7-4e10-9710-a49b65847ad0]: (4, ('1', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:35 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-a7a85247-963f-447c-b7f2-b42258d0713a tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 18:47:35 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-a7a85247-963f-447c-b7f2-b42258d0713a tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] SCSI volumes sdg have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 18:47:35 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7a85247-963f-447c-b7f2-b42258d0713a tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e823c6a1-f7e2-495f-a5dc-6fdfd2b19cf0')] {{(pid=75216) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 18:47:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e823c6a1-f7e2-495f-a5dc-6fdfd2b19cf0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e823c6a1-f7e2-495f-a5dc-6fdfd2b19cf0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:35 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1efe808-6509-48c2-a3f0-c311906c00b3]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:35 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7a85247-963f-447c-b7f2-b42258d0713a tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:47:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e823c6a1-f7e2-495f-a5dc-6fdfd2b19cf0 -p 172.16.0.220:3260 --logout {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:35 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-fca63c40-e0e7-49e0-a25e-9796f5541cfd tempest-TestVolumeSwap-1274447143 tempest-TestVolumeSwap-1274447143-project-admin] COPY block job progress, current cursor: 66060288 final cursor: 1073741824 {{(pid=75216) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 13 18:47:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e823c6a1-f7e2-495f-a5dc-6fdfd2b19cf0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:35 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c88e9fc-6dd2-4fc6-942f-f6f46632ca88]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:e823c6a1-f7e2-495f-a5dc-6fdfd2b19cf0, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:e823c6a1-f7e2-495f-a5dc-6fdfd2b19cf0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:35 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7a85247-963f-447c-b7f2-b42258d0713a tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:e823c6a1-f7e2-495f-a5dc-6fdfd2b19cf0, portal: 172.16.0.220,3260]
Nov 13 18:47:35 user nova-compute[75216]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:e823c6a1-f7e2-495f-a5dc-6fdfd2b19cf0, portal: 172.16.0.220,3260] successful.
Nov 13 18:47:35 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:47:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e823c6a1-f7e2-495f-a5dc-6fdfd2b19cf0 -p 172.16.0.220:3260 --op delete {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e823c6a1-f7e2-495f-a5dc-6fdfd2b19cf0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:35 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[d68be18c-d633-4048-a2fe-0c2dcff20614]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:35 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7a85247-963f-447c-b7f2-b42258d0713a tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:47:35 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-a7a85247-963f-447c-b7f2-b42258d0713a tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.338s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 18:47:35 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7a85247-963f-447c-b7f2-b42258d0713a tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] <== disconnect_volume: return (713ms) None {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 18:47:35 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a7a85247-963f-447c-b7f2-b42258d0713a tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Disconnected iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 18:47:35 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-a7a85247-963f-447c-b7f2-b42258d0713a tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Deleting instance files /opt/stack/data/nova/instances/78605259-17bf-47da-86de-3c76ac1c5bfa_del
Nov 13 18:47:35 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-a7a85247-963f-447c-b7f2-b42258d0713a tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Deletion of /opt/stack/data/nova/instances/78605259-17bf-47da-86de-3c76ac1c5bfa_del complete
Nov 13 18:47:35 user nova-compute[75216]: INFO nova.compute.manager [None req-a7a85247-963f-447c-b7f2-b42258d0713a tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Took 5.14 seconds to destroy the instance on the hypervisor.
Nov 13 18:47:35 user nova-compute[75216]: DEBUG oslo.service.loopingcall [None req-a7a85247-963f-447c-b7f2-b42258d0713a tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75216) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 18:47:35 user nova-compute[75216]: DEBUG nova.compute.manager [-] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Deallocating network for instance {{(pid=75216) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 18:47:35 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] deallocate_for_instance() {{(pid=75216) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 18:47:35 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-fca63c40-e0e7-49e0-a25e-9796f5541cfd tempest-TestVolumeSwap-1274447143 tempest-TestVolumeSwap-1274447143-project-admin] COPY block job progress, current cursor: 191889408 final cursor: 1073741824 {{(pid=75216) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 13 18:47:36 user nova-compute[75216]: DEBUG nova.objects.instance [None req-0107ddb3-b970-4740-974c-4f7655c19bda tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] Lazy-loading 'flavor' on Instance uuid 83fda249-9d28-4cc2-aeb0-103ce4f1faa4 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 18:47:36 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-0107ddb3-b970-4740-974c-4f7655c19bda tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] Lock "83fda249-9d28-4cc2-aeb0-103ce4f1faa4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 23.029s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:47:36 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-fca63c40-e0e7-49e0-a25e-9796f5541cfd tempest-TestVolumeSwap-1274447143 tempest-TestVolumeSwap-1274447143-project-admin] COPY block job progress, current cursor: 314572800 final cursor: 1073741824 {{(pid=75216) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 13 18:47:36 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-fca63c40-e0e7-49e0-a25e-9796f5541cfd tempest-TestVolumeSwap-1274447143 tempest-TestVolumeSwap-1274447143-project-admin] COPY block job progress, current cursor: 401604608 final cursor: 1073741824 {{(pid=75216) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 13 18:47:37 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-fca63c40-e0e7-49e0-a25e-9796f5541cfd tempest-TestVolumeSwap-1274447143 tempest-TestVolumeSwap-1274447143-project-admin] COPY block job progress, current cursor: 534773760 final cursor: 1073741824 {{(pid=75216) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 13 18:47:37 user nova-compute[75216]: DEBUG nova.compute.manager [req-7ab9d256-72f3-41d3-9b8a-ab801dc380c0 req-f4472bc3-2f8f-4460-a9bb-a2ac4e918d16 service nova] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Received event network-vif-deleted-e4e34ea8-fb99-4a0e-8b65-a93933cc7d6b {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:47:37 user nova-compute[75216]: INFO nova.compute.manager [req-7ab9d256-72f3-41d3-9b8a-ab801dc380c0 req-f4472bc3-2f8f-4460-a9bb-a2ac4e918d16 service nova] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Neutron deleted interface e4e34ea8-fb99-4a0e-8b65-a93933cc7d6b; detaching it from the instance and deleting it from the info cache
Nov 13 18:47:37 user nova-compute[75216]: DEBUG nova.network.neutron [req-7ab9d256-72f3-41d3-9b8a-ab801dc380c0 req-f4472bc3-2f8f-4460-a9bb-a2ac4e918d16 service nova] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Updating instance_info_cache with network_info: [{"id": "6b91caf7-7b72-41be-8cf7-96e728c0eae5", "address": "fa:16:3e:22:29:78", "network": {"id": "65bd62c0-ccfd-486a-a4e4-eafe4e4f587f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-92675676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "046be82514bf4c3483f8b3b8f2299b96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b91caf7-7b", "ovs_interfaceid": "6b91caf7-7b72-41be-8cf7-96e728c0eae5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7c9f8c17-a293-4817-ae4f-3fab0a1076a6", "address": "fa:16:3e:bc:93:0e", "network": {"id": "badd6fc4-dc5e-4623-b319-4969f674705f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1322270738", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.246", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "046be82514bf4c3483f8b3b8f2299b96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c9f8c17-a2", "ovs_interfaceid": "7c9f8c17-a293-4817-ae4f-3fab0a1076a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c5b1d8e6-f202-4278-924c-abecf64f299c", "address": "fa:16:3e:a1:c9:75", "network": {"id": "badd6fc4-dc5e-4623-b319-4969f674705f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1322270738", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.53", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "046be82514bf4c3483f8b3b8f2299b96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5b1d8e6-f2", "ovs_interfaceid": "c5b1d8e6-f202-4278-924c-abecf64f299c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5c412896-2c62-4248-a888-9b0612378259", "address": "fa:16:3e:47:55:1a", "network": {"id": "badd6fc4-dc5e-4623-b319-4969f674705f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1322270738", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "046be82514bf4c3483f8b3b8f2299b96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c412896-2c", "ovs_interfaceid": "5c412896-2c62-4248-a888-9b0612378259", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7b6ed148-b7c9-479b-9e2d-cfc0c3f6f93a", "address": "fa:16:3e:e4:db:d9", "network": {"id": "debccb89-bf2d-40a9-b114-b1bb2e913648", "bridge": "br-int", "label": "tempest-device-tagging-net2-185988930", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "046be82514bf4c3483f8b3b8f2299b96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b6ed148-b7", "ovs_interfaceid": "7b6ed148-b7c9-479b-9e2d-cfc0c3f6f93a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "815d1175-2997-4d74-8f35-7ca982cf46aa", "address": "fa:16:3e:2c:4b:72", "network": {"id": "debccb89-bf2d-40a9-b114-b1bb2e913648", "bridge": "br-int", "label": "tempest-device-tagging-net2-185988930", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "046be82514bf4c3483f8b3b8f2299b96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap815d1175-29", "ovs_interfaceid": "815d1175-2997-4d74-8f35-7ca982cf46aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 18:47:37 user nova-compute[75216]: DEBUG nova.compute.manager [req-7ab9d256-72f3-41d3-9b8a-ab801dc380c0 req-f4472bc3-2f8f-4460-a9bb-a2ac4e918d16 service nova] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Detach interface failed, port_id=e4e34ea8-fb99-4a0e-8b65-a93933cc7d6b, reason: Instance 78605259-17bf-47da-86de-3c76ac1c5bfa could not be found. {{(pid=75216) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 13 18:47:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:47:38 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-fca63c40-e0e7-49e0-a25e-9796f5541cfd tempest-TestVolumeSwap-1274447143 tempest-TestVolumeSwap-1274447143-project-admin] COPY block job progress, current cursor: 643825664 final cursor: 1073741824 {{(pid=75216) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 13 18:47:38 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:47:38 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-fca63c40-e0e7-49e0-a25e-9796f5541cfd tempest-TestVolumeSwap-1274447143 tempest-TestVolumeSwap-1274447143-project-admin] COPY block job progress, current cursor: 760217600 final cursor: 1073741824 {{(pid=75216) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 13 18:47:38 user nova-compute[75216]: INFO nova.compute.manager [None req-62a20587-5b7d-41eb-b545-9e475c72da58 tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] [instance: 3274203b-a985-4f28-9b45-3f83509ae782] Took 3.76 seconds to detach 3 volumes for instance.
Nov 13 18:47:38 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-62a20587-5b7d-41eb-b545-9e475c72da58 tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:47:38 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-62a20587-5b7d-41eb-b545-9e475c72da58 tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:47:39 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-fca63c40-e0e7-49e0-a25e-9796f5541cfd tempest-TestVolumeSwap-1274447143 tempest-TestVolumeSwap-1274447143-project-admin] COPY block job progress, current cursor: 934281216 final cursor: 1073741824 {{(pid=75216) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 13 18:47:39 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-62a20587-5b7d-41eb-b545-9e475c72da58 tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 18:47:39 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-62a20587-5b7d-41eb-b545-9e475c72da58 tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 18:47:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-62a20587-5b7d-41eb-b545-9e475c72da58 tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.484s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:47:39 user nova-compute[75216]: INFO nova.scheduler.client.report [None req-62a20587-5b7d-41eb-b545-9e475c72da58 tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Deleted allocations for instance 3274203b-a985-4f28-9b45-3f83509ae782
Nov 13 18:47:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-62a20587-5b7d-41eb-b545-9e475c72da58 tempest-TaggedBootDevicesTest_v242-1999686773 tempest-TaggedBootDevicesTest_v242-1999686773-project-member] Lock "3274203b-a985-4f28-9b45-3f83509ae782" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 13.768s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:47:39 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-fca63c40-e0e7-49e0-a25e-9796f5541cfd tempest-TestVolumeSwap-1274447143 tempest-TestVolumeSwap-1274447143-project-admin] COPY block job progress, current cursor: 1058013184 final cursor: 1073741824 {{(pid=75216) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 13 18:47:39 user nova-compute[75216]: DEBUG nova.compute.manager [req-4b8db435-4a2d-41c5-9e4e-b06470de0d25 req-3a145915-76b9-4034-a59f-4b5bbda43060 service nova] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Received event network-vif-deleted-7b6ed148-b7c9-479b-9e2d-cfc0c3f6f93a {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:47:39 user nova-compute[75216]: INFO nova.compute.manager [req-4b8db435-4a2d-41c5-9e4e-b06470de0d25 req-3a145915-76b9-4034-a59f-4b5bbda43060 service nova] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Neutron deleted interface 7b6ed148-b7c9-479b-9e2d-cfc0c3f6f93a; detaching it from the instance and deleting it from the info cache
Nov 13 18:47:39 user nova-compute[75216]: DEBUG nova.network.neutron [req-4b8db435-4a2d-41c5-9e4e-b06470de0d25 req-3a145915-76b9-4034-a59f-4b5bbda43060 service nova] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Updating instance_info_cache with network_info: [{"id": "6b91caf7-7b72-41be-8cf7-96e728c0eae5", "address": "fa:16:3e:22:29:78", "network": {"id": "65bd62c0-ccfd-486a-a4e4-eafe4e4f587f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-92675676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "046be82514bf4c3483f8b3b8f2299b96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b91caf7-7b", "ovs_interfaceid": "6b91caf7-7b72-41be-8cf7-96e728c0eae5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7c9f8c17-a293-4817-ae4f-3fab0a1076a6", "address": "fa:16:3e:bc:93:0e", "network": {"id": "badd6fc4-dc5e-4623-b319-4969f674705f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1322270738", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.246", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "046be82514bf4c3483f8b3b8f2299b96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c9f8c17-a2", "ovs_interfaceid": "7c9f8c17-a293-4817-ae4f-3fab0a1076a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c5b1d8e6-f202-4278-924c-abecf64f299c", "address": "fa:16:3e:a1:c9:75", "network": {"id": "badd6fc4-dc5e-4623-b319-4969f674705f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1322270738", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.53", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "046be82514bf4c3483f8b3b8f2299b96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5b1d8e6-f2", "ovs_interfaceid": "c5b1d8e6-f202-4278-924c-abecf64f299c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5c412896-2c62-4248-a888-9b0612378259", "address": "fa:16:3e:47:55:1a", "network": {"id": "badd6fc4-dc5e-4623-b319-4969f674705f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1322270738", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "046be82514bf4c3483f8b3b8f2299b96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c412896-2c", "ovs_interfaceid": "5c412896-2c62-4248-a888-9b0612378259", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "815d1175-2997-4d74-8f35-7ca982cf46aa", "address": "fa:16:3e:2c:4b:72", "network": {"id": "debccb89-bf2d-40a9-b114-b1bb2e913648", "bridge": "br-int", "label": "tempest-device-tagging-net2-185988930", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "046be82514bf4c3483f8b3b8f2299b96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap815d1175-29", "ovs_interfaceid": "815d1175-2997-4d74-8f35-7ca982cf46aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 18:47:39 user nova-compute[75216]: DEBUG nova.compute.manager [req-4b8db435-4a2d-41c5-9e4e-b06470de0d25 req-3a145915-76b9-4034-a59f-4b5bbda43060 service nova] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Detach interface failed, port_id=7b6ed148-b7c9-479b-9e2d-cfc0c3f6f93a, reason: Instance 78605259-17bf-47da-86de-3c76ac1c5bfa could not be found. {{(pid=75216) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 13 18:47:39 user nova-compute[75216]: DEBUG nova.compute.manager [req-4b8db435-4a2d-41c5-9e4e-b06470de0d25 req-3a145915-76b9-4034-a59f-4b5bbda43060 service nova] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Received event network-vif-deleted-5c412896-2c62-4248-a888-9b0612378259 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:47:39 user nova-compute[75216]: INFO nova.compute.manager [req-4b8db435-4a2d-41c5-9e4e-b06470de0d25 req-3a145915-76b9-4034-a59f-4b5bbda43060 service nova] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Neutron deleted interface 5c412896-2c62-4248-a888-9b0612378259; detaching it from the instance and deleting it from the info cache
Nov 13 18:47:39 user nova-compute[75216]: DEBUG nova.network.neutron [req-4b8db435-4a2d-41c5-9e4e-b06470de0d25 req-3a145915-76b9-4034-a59f-4b5bbda43060 service nova] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Updating instance_info_cache with network_info: [{"id": "6b91caf7-7b72-41be-8cf7-96e728c0eae5", "address": "fa:16:3e:22:29:78", "network": {"id": "65bd62c0-ccfd-486a-a4e4-eafe4e4f587f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-92675676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "046be82514bf4c3483f8b3b8f2299b96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b91caf7-7b", "ovs_interfaceid": "6b91caf7-7b72-41be-8cf7-96e728c0eae5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7c9f8c17-a293-4817-ae4f-3fab0a1076a6", "address": "fa:16:3e:bc:93:0e", "network": {"id": "badd6fc4-dc5e-4623-b319-4969f674705f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1322270738", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.246", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "046be82514bf4c3483f8b3b8f2299b96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c9f8c17-a2", "ovs_interfaceid": "7c9f8c17-a293-4817-ae4f-3fab0a1076a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c5b1d8e6-f202-4278-924c-abecf64f299c", "address": "fa:16:3e:a1:c9:75", "network": {"id": "badd6fc4-dc5e-4623-b319-4969f674705f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1322270738", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.53", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "046be82514bf4c3483f8b3b8f2299b96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5b1d8e6-f2", "ovs_interfaceid": "c5b1d8e6-f202-4278-924c-abecf64f299c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "815d1175-2997-4d74-8f35-7ca982cf46aa", "address": "fa:16:3e:2c:4b:72", "network": {"id": "debccb89-bf2d-40a9-b114-b1bb2e913648", "bridge": "br-int", "label": "tempest-device-tagging-net2-185988930", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "046be82514bf4c3483f8b3b8f2299b96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap815d1175-29", "ovs_interfaceid": "815d1175-2997-4d74-8f35-7ca982cf46aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 18:47:39 user nova-compute[75216]: DEBUG nova.compute.manager [req-4b8db435-4a2d-41c5-9e4e-b06470de0d25 req-3a145915-76b9-4034-a59f-4b5bbda43060 service nova] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Detach interface failed, port_id=5c412896-2c62-4248-a888-9b0612378259, reason: Instance 78605259-17bf-47da-86de-3c76ac1c5bfa could not be found. {{(pid=75216) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 13 18:47:39 user nova-compute[75216]: DEBUG nova.compute.manager [req-4b8db435-4a2d-41c5-9e4e-b06470de0d25 req-3a145915-76b9-4034-a59f-4b5bbda43060 service nova] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Received event network-vif-deleted-6b91caf7-7b72-41be-8cf7-96e728c0eae5 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:47:39 user nova-compute[75216]: INFO nova.compute.manager [req-4b8db435-4a2d-41c5-9e4e-b06470de0d25 req-3a145915-76b9-4034-a59f-4b5bbda43060 service nova] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Neutron deleted interface 6b91caf7-7b72-41be-8cf7-96e728c0eae5; detaching it from the instance and deleting it from the info cache
Nov 13 18:47:39 user nova-compute[75216]: DEBUG nova.network.neutron [req-4b8db435-4a2d-41c5-9e4e-b06470de0d25 req-3a145915-76b9-4034-a59f-4b5bbda43060 service nova] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Updating instance_info_cache with network_info: [{"id": "7c9f8c17-a293-4817-ae4f-3fab0a1076a6", "address": "fa:16:3e:bc:93:0e", "network": {"id": "badd6fc4-dc5e-4623-b319-4969f674705f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1322270738", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.246", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "046be82514bf4c3483f8b3b8f2299b96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c9f8c17-a2", "ovs_interfaceid": "7c9f8c17-a293-4817-ae4f-3fab0a1076a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c5b1d8e6-f202-4278-924c-abecf64f299c", "address": "fa:16:3e:a1:c9:75", "network": {"id": "badd6fc4-dc5e-4623-b319-4969f674705f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1322270738", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.53", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "046be82514bf4c3483f8b3b8f2299b96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5b1d8e6-f2", "ovs_interfaceid": "c5b1d8e6-f202-4278-924c-abecf64f299c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "815d1175-2997-4d74-8f35-7ca982cf46aa", "address": "fa:16:3e:2c:4b:72", "network": {"id": "debccb89-bf2d-40a9-b114-b1bb2e913648", "bridge": "br-int", "label": "tempest-device-tagging-net2-185988930", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "046be82514bf4c3483f8b3b8f2299b96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap815d1175-29", "ovs_interfaceid": "815d1175-2997-4d74-8f35-7ca982cf46aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 18:47:39 user nova-compute[75216]: DEBUG nova.compute.manager [req-4b8db435-4a2d-41c5-9e4e-b06470de0d25 req-3a145915-76b9-4034-a59f-4b5bbda43060 service nova] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Detach interface failed, port_id=6b91caf7-7b72-41be-8cf7-96e728c0eae5, reason: Instance 78605259-17bf-47da-86de-3c76ac1c5bfa could not be found. {{(pid=75216) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 13 18:47:39 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Updating instance_info_cache with network_info: [] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 18:47:39 user nova-compute[75216]: INFO nova.compute.manager [-] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Took 4.26 seconds to deallocate network for instance.
Nov 13 18:47:40 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-fca63c40-e0e7-49e0-a25e-9796f5541cfd tempest-TestVolumeSwap-1274447143 tempest-TestVolumeSwap-1274447143-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=75216) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 13 18:47:40 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fca63c40-e0e7-49e0-a25e-9796f5541cfd tempest-TestVolumeSwap-1274447143 tempest-TestVolumeSwap-1274447143-project-admin] [instance: 872856e5-cdc4-444e-8835-55e36708d776] calling os-brick to detach iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 18:47:40 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-fca63c40-e0e7-49e0-a25e-9796f5541cfd tempest-TestVolumeSwap-1274447143 tempest-TestVolumeSwap-1274447143-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3a8669e40>, {'target_iqn': 'iqn.2010-10.org.openstack:4cd9ea8a-0fbb-4dd4-b11c-fd661086e803', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DbhNcyvG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk', 'volume_id': '4cd9ea8a-0fbb-4dd4-b11c-fd661086e803'}, None), 'kwargs': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 18:47:40 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-fca63c40-e0e7-49e0-a25e-9796f5541cfd tempest-TestVolumeSwap-1274447143 tempest-TestVolumeSwap-1274447143-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 18:47:40 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-fca63c40-e0e7-49e0-a25e-9796f5541cfd tempest-TestVolumeSwap-1274447143 tempest-TestVolumeSwap-1274447143-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 18:47:40 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-fca63c40-e0e7-49e0-a25e-9796f5541cfd tempest-TestVolumeSwap-1274447143 tempest-TestVolumeSwap-1274447143-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 18:47:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:40 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[24047c34-be21-4d37-8f07-14ff6572971f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f530e526-b4b9-405c-8bde-111e34095cc4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d72e8803-2ded-42f6-858f-803c16c2d2a4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4cd9ea8a-0fbb-4dd4-b11c-fd661086e803\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:40 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-fca63c40-e0e7-49e0-a25e-9796f5541cfd tempest-TestVolumeSwap-1274447143 tempest-TestVolumeSwap-1274447143-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 18:47:40 user nova-compute[75216]: No targets found.
Nov 13 18:47:40 user nova-compute[75216]: iSNS:
Nov 13 18:47:40 user nova-compute[75216]: No targets found.
Nov 13 18:47:40 user nova-compute[75216]: STATIC:
Nov 13 18:47:40 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:f530e526-b4b9-405c-8bde-111e34095cc4
Nov 13 18:47:40 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 18:47:40 user nova-compute[75216]:                 Iface Name: default
Nov 13 18:47:40 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:d72e8803-2ded-42f6-858f-803c16c2d2a4
Nov 13 18:47:40 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 18:47:40 user nova-compute[75216]:                 Iface Name: default
Nov 13 18:47:40 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:4cd9ea8a-0fbb-4dd4-b11c-fd661086e803
Nov 13 18:47:40 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 18:47:40 user nova-compute[75216]:                 Iface Name: default
Nov 13 18:47:40 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac
Nov 13 18:47:40 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 18:47:40 user nova-compute[75216]:                 Iface Name: default
Nov 13 18:47:40 user nova-compute[75216]: FIRMWARE:
Nov 13 18:47:40 user nova-compute[75216]: No targets found.
Nov 13 18:47:40 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 18:47:40 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-fca63c40-e0e7-49e0-a25e-9796f5541cfd tempest-TestVolumeSwap-1274447143 tempest-TestVolumeSwap-1274447143-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 18:47:40 user nova-compute[75216]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 18:47:40 user nova-compute[75216]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75216) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 18:47:40 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-fca63c40-e0e7-49e0-a25e-9796f5541cfd tempest-TestVolumeSwap-1274447143 tempest-TestVolumeSwap-1274447143-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4cd9ea8a-0fbb-4dd4-b11c-fd661086e803', 0)] {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 18:47:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:40 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[66c0da6a-8ee2-42b5-bb17-b7f84ebc36b7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4cd9ea8a-0fbb-4dd4-b11c-fd661086e803\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d72e8803-2ded-42f6-858f-803c16c2d2a4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f530e526-b4b9-405c-8bde-111e34095cc4\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:40 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[a88c39f7-c379-4214-af60-de0fe6348d2a]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cd9ea8a-0fbb-4dd4-b11c-fd661086e803 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d72e8803-2ded-42f6-858f-803c16c2d2a4 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530e526-b4b9-405c-8bde-111e34095cc4 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac (non-flash)\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:40 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-fca63c40-e0e7-49e0-a25e-9796f5541cfd tempest-TestVolumeSwap-1274447143 tempest-TestVolumeSwap-1274447143-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cd9ea8a-0fbb-4dd4-b11c-fd661086e803 (non-flash)
Nov 13 18:47:40 user nova-compute[75216]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d72e8803-2ded-42f6-858f-803c16c2d2a4 (non-flash)
Nov 13 18:47:40 user nova-compute[75216]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530e526-b4b9-405c-8bde-111e34095cc4 (non-flash)
Nov 13 18:47:40 user nova-compute[75216]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac (non-flash)
Nov 13 18:47:40 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 18:47:40 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-fca63c40-e0e7-49e0-a25e-9796f5541cfd tempest-TestVolumeSwap-1274447143 tempest-TestVolumeSwap-1274447143-project-admin] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cd9ea8a-0fbb-4dd4-b11c-fd661086e803 (non-flash)
Nov 13 18:47:40 user nova-compute[75216]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d72e8803-2ded-42f6-858f-803c16c2d2a4 (non-flash)
Nov 13 18:47:40 user nova-compute[75216]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530e526-b4b9-405c-8bde-111e34095cc4 (non-flash)
Nov 13 18:47:40 user nova-compute[75216]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac (non-flash)
Nov 13 18:47:40 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 18:47:40 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-fca63c40-e0e7-49e0-a25e-9796f5541cfd tempest-TestVolumeSwap-1274447143 tempest-TestVolumeSwap-1274447143-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe3a826edd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4cd9ea8a-0fbb-4dd4-b11c-fd661086e803'): ({'sdk'}, set())}) {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 18:47:40 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-fca63c40-e0e7-49e0-a25e-9796f5541cfd tempest-TestVolumeSwap-1274447143 tempest-TestVolumeSwap-1274447143-project-admin] Removing single pathed devices sdk {{(pid=75216) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 18:47:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:40 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[f744088f-cafd-4450-ba35-370f3c469e39]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdk {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdk" returned: 0 in 0.019s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:40 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e4ac4a5-9b39-4d84-93fe-98e1007012f0]: (4, ('ok\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:40 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-fca63c40-e0e7-49e0-a25e-9796f5541cfd tempest-TestVolumeSwap-1274447143 tempest-TestVolumeSwap-1274447143-project-admin] Flushing IO for device /dev/sdk {{(pid=75216) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 18:47:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdk {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdk" returned: 0 in 0.014s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:40 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab2b722a-4fbe-4fc0-a0db-6b33c655322d]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:40 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-fca63c40-e0e7-49e0-a25e-9796f5541cfd tempest-TestVolumeSwap-1274447143 tempest-TestVolumeSwap-1274447143-project-admin] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=75216) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 18:47:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdk/device/delete {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:40 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:47:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdk/device/delete" returned: 0 in 0.049s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:40 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[26e97c2e-24ce-4ba2-be02-582c7e07129d]: (4, ('1', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:40 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-fca63c40-e0e7-49e0-a25e-9796f5541cfd tempest-TestVolumeSwap-1274447143 tempest-TestVolumeSwap-1274447143-project-admin] Checking to see if SCSI volumes sdk have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 18:47:40 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-fca63c40-e0e7-49e0-a25e-9796f5541cfd tempest-TestVolumeSwap-1274447143 tempest-TestVolumeSwap-1274447143-project-admin] SCSI volumes sdk have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 18:47:40 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-fca63c40-e0e7-49e0-a25e-9796f5541cfd tempest-TestVolumeSwap-1274447143 tempest-TestVolumeSwap-1274447143-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4cd9ea8a-0fbb-4dd4-b11c-fd661086e803')] {{(pid=75216) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 18:47:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4cd9ea8a-0fbb-4dd4-b11c-fd661086e803 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4cd9ea8a-0fbb-4dd4-b11c-fd661086e803 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:40 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[a44ca950-00fd-4e5c-821a-7d89894692dd]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:40 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-fca63c40-e0e7-49e0-a25e-9796f5541cfd tempest-TestVolumeSwap-1274447143 tempest-TestVolumeSwap-1274447143-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:47:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4cd9ea8a-0fbb-4dd4-b11c-fd661086e803 -p 172.16.0.220:3260 --logout {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4cd9ea8a-0fbb-4dd4-b11c-fd661086e803 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:40 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[19483b9b-ec10-43c9-8832-820688a8ebbd]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:4cd9ea8a-0fbb-4dd4-b11c-fd661086e803, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:4cd9ea8a-0fbb-4dd4-b11c-fd661086e803, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:40 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-fca63c40-e0e7-49e0-a25e-9796f5541cfd tempest-TestVolumeSwap-1274447143 tempest-TestVolumeSwap-1274447143-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:4cd9ea8a-0fbb-4dd4-b11c-fd661086e803, portal: 172.16.0.220,3260]
Nov 13 18:47:40 user nova-compute[75216]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:4cd9ea8a-0fbb-4dd4-b11c-fd661086e803, portal: 172.16.0.220,3260] successful.
Nov 13 18:47:40 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:47:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4cd9ea8a-0fbb-4dd4-b11c-fd661086e803 -p 172.16.0.220:3260 --op delete {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4cd9ea8a-0fbb-4dd4-b11c-fd661086e803 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:40 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdb245e4-d632-4646-8bab-98fafe78d740]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:40 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-fca63c40-e0e7-49e0-a25e-9796f5541cfd tempest-TestVolumeSwap-1274447143 tempest-TestVolumeSwap-1274447143-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:47:40 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-fca63c40-e0e7-49e0-a25e-9796f5541cfd tempest-TestVolumeSwap-1274447143 tempest-TestVolumeSwap-1274447143-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.325s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 18:47:40 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-fca63c40-e0e7-49e0-a25e-9796f5541cfd tempest-TestVolumeSwap-1274447143 tempest-TestVolumeSwap-1274447143-project-admin] <== disconnect_volume: return (326ms) None {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 18:47:40 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fca63c40-e0e7-49e0-a25e-9796f5541cfd tempest-TestVolumeSwap-1274447143 tempest-TestVolumeSwap-1274447143-project-admin] [instance: 872856e5-cdc4-444e-8835-55e36708d776] Disconnected iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 18:47:40 user nova-compute[75216]: DEBUG nova.compute.manager [None req-fca63c40-e0e7-49e0-a25e-9796f5541cfd tempest-TestVolumeSwap-1274447143 tempest-TestVolumeSwap-1274447143-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f530e526-b4b9-405c-8bde-111e34095cc4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ReFEXBsZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '872856e5-cdc4-444e-8835-55e36708d776', 'attached_at': '', 'detached_at': '', 'volume_id': 'f530e526-b4b9-405c-8bde-111e34095cc4', 'serial'} {{(pid=75216) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 13 18:47:40 user nova-compute[75216]: DEBUG nova.compute.manager [None req-fca63c40-e0e7-49e0-a25e-9796f5541cfd tempest-TestVolumeSwap-1274447143 tempest-TestVolumeSwap-1274447143-project-admin] [instance: 872856e5-cdc4-444e-8835-55e36708d776] swap_volume: removing Cinder connection for volume 4cd9ea8a-0fbb-4dd4-b11c-fd661086e803 {{(pid=75216) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 13 18:47:40 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-805d10a2-4763-4d0e-8e6c-4902073d7a7c tempest-VolumesActionsTest-586345736 tempest-VolumesActionsTest-586345736-project-member] Acquiring lock "30ca36a3-ac49-44e4-a804-8940f7ef25b8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:47:40 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-805d10a2-4763-4d0e-8e6c-4902073d7a7c tempest-VolumesActionsTest-586345736 tempest-VolumesActionsTest-586345736-project-member] Lock "30ca36a3-ac49-44e4-a804-8940f7ef25b8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:47:40 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-805d10a2-4763-4d0e-8e6c-4902073d7a7c tempest-VolumesActionsTest-586345736 tempest-VolumesActionsTest-586345736-project-member] Acquiring lock "30ca36a3-ac49-44e4-a804-8940f7ef25b8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:47:40 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-805d10a2-4763-4d0e-8e6c-4902073d7a7c tempest-VolumesActionsTest-586345736 tempest-VolumesActionsTest-586345736-project-member] Lock "30ca36a3-ac49-44e4-a804-8940f7ef25b8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:47:40 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-805d10a2-4763-4d0e-8e6c-4902073d7a7c tempest-VolumesActionsTest-586345736 tempest-VolumesActionsTest-586345736-project-member] Lock "30ca36a3-ac49-44e4-a804-8940f7ef25b8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:47:40 user nova-compute[75216]: INFO nova.compute.manager [None req-805d10a2-4763-4d0e-8e6c-4902073d7a7c tempest-VolumesActionsTest-586345736 tempest-VolumesActionsTest-586345736-project-member] [instance: 30ca36a3-ac49-44e4-a804-8940f7ef25b8] Terminating instance
Nov 13 18:47:40 user nova-compute[75216]: DEBUG nova.compute.manager [None req-805d10a2-4763-4d0e-8e6c-4902073d7a7c tempest-VolumesActionsTest-586345736 tempest-VolumesActionsTest-586345736-project-member] [instance: 30ca36a3-ac49-44e4-a804-8940f7ef25b8] Start destroying the instance on the hypervisor. {{(pid=75216) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 18:47:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:47:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:47:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:47:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:47:41 user nova-compute[75216]: DEBUG nova.compute.manager [req-fc34e129-b41b-4489-b28a-3c302e520ba8 req-e7505db7-5bd5-4faa-a149-e18eacd857a2 service nova] [instance: 30ca36a3-ac49-44e4-a804-8940f7ef25b8] Received event network-vif-unplugged-806f1a86-b973-4d62-9ad4-a5df9de18821 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:47:41 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-fc34e129-b41b-4489-b28a-3c302e520ba8 req-e7505db7-5bd5-4faa-a149-e18eacd857a2 service nova] Acquiring lock "30ca36a3-ac49-44e4-a804-8940f7ef25b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:47:41 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-fc34e129-b41b-4489-b28a-3c302e520ba8 req-e7505db7-5bd5-4faa-a149-e18eacd857a2 service nova] Lock "30ca36a3-ac49-44e4-a804-8940f7ef25b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:47:41 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-fc34e129-b41b-4489-b28a-3c302e520ba8 req-e7505db7-5bd5-4faa-a149-e18eacd857a2 service nova] Lock "30ca36a3-ac49-44e4-a804-8940f7ef25b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:47:41 user nova-compute[75216]: DEBUG nova.compute.manager [req-fc34e129-b41b-4489-b28a-3c302e520ba8 req-e7505db7-5bd5-4faa-a149-e18eacd857a2 service nova] [instance: 30ca36a3-ac49-44e4-a804-8940f7ef25b8] No waiting events found dispatching network-vif-unplugged-806f1a86-b973-4d62-9ad4-a5df9de18821 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:47:41 user nova-compute[75216]: DEBUG nova.compute.manager [req-fc34e129-b41b-4489-b28a-3c302e520ba8 req-e7505db7-5bd5-4faa-a149-e18eacd857a2 service nova] [instance: 30ca36a3-ac49-44e4-a804-8940f7ef25b8] Received event network-vif-unplugged-806f1a86-b973-4d62-9ad4-a5df9de18821 for instance with task_state deleting. {{(pid=75216) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 18:47:41 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:47:41 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:47:41 user nova-compute[75216]: DEBUG nova.compute.manager [None req-fca63c40-e0e7-49e0-a25e-9796f5541cfd tempest-TestVolumeSwap-1274447143 tempest-TestVolumeSwap-1274447143-project-admin] [instance: 872856e5-cdc4-444e-8835-55e36708d776] swap_volume: Updating volume 4cd9ea8a-0fbb-4dd4-b11c-fd661086e803 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:f530e526-b4b9-405c-8bde-111e34095cc4", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "ReFEXBsZ", "auth_password": "mh1DU8sKPjNzfO", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdb", "volume_id": "f530e526-b4b9-405c-8bde-111e34095cc4"}, "status": "reserved", "instance": "872856e5-cdc4-444e-8835-55e36708d776", "attached_at": "", "detached_at": "", "volume_id": "f530e526-b4b9-405c-8bde-111e34095cc4", "serial": "f530e526-b4b9-405c-8bde-111e34095cc4"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'f530e526-b4b9-405c-8bde-111e34095cc4', 'no_device': None, 'attachment_id': 'f51fd968-d1ed-4679-94d8-51f80b483a97'} {{(pid=75216) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 13 18:47:41 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-fca63c40-e0e7-49e0-a25e-9796f5541cfd tempest-TestVolumeSwap-1274447143 tempest-TestVolumeSwap-1274447143-project-admin] Lock "872856e5-cdc4-444e-8835-55e36708d776" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 13.158s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:47:41 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 30ca36a3-ac49-44e4-a804-8940f7ef25b8] Instance destroyed successfully.
Nov 13 18:47:41 user nova-compute[75216]: DEBUG nova.objects.instance [None req-805d10a2-4763-4d0e-8e6c-4902073d7a7c tempest-VolumesActionsTest-586345736 tempest-VolumesActionsTest-586345736-project-member] Lazy-loading 'resources' on Instance uuid 30ca36a3-ac49-44e4-a804-8940f7ef25b8 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 18:47:41 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-805d10a2-4763-4d0e-8e6c-4902073d7a7c tempest-VolumesActionsTest-586345736 tempest-VolumesActionsTest-586345736-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T18:45:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-691647798',display_name='tempest-VolumesActionsTest-instance-691647798',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-691647798',id=11,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-13T18:45:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='986d2e55aab34f7e8e09b9619c492b10',ramdisk_id='',reservation_id='r-3r111o7r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-586345736',owner_user_name='tempest-VolumesActionsTest-586345736-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T18:45:54Z,user_data=None,user_id='838f3474d7d84930959d11f51fa03e17',uuid=30ca36a3-ac49-44e4-a804-8940f7ef25b8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "806f1a86-b973-4d62-9ad4-a5df9de18821", "address": "fa:16:3e:c9:a0:08", "network": {"id": "bcfd8798-68b4-454a-a3ad-9cad0d42ad8e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1666293979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "986d2e55aab34f7e8e09b9619c492b10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap806f1a86-b9", "ovs_interfaceid": "806f1a86-b973-4d62-9ad4-a5df9de18821", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 18:47:41 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-805d10a2-4763-4d0e-8e6c-4902073d7a7c tempest-VolumesActionsTest-586345736 tempest-VolumesActionsTest-586345736-project-member] Converting VIF {"id": "806f1a86-b973-4d62-9ad4-a5df9de18821", "address": "fa:16:3e:c9:a0:08", "network": {"id": "bcfd8798-68b4-454a-a3ad-9cad0d42ad8e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1666293979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "986d2e55aab34f7e8e09b9619c492b10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap806f1a86-b9", "ovs_interfaceid": "806f1a86-b973-4d62-9ad4-a5df9de18821", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 18:47:41 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-805d10a2-4763-4d0e-8e6c-4902073d7a7c tempest-VolumesActionsTest-586345736 tempest-VolumesActionsTest-586345736-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:a0:08,bridge_name='br-int',has_traffic_filtering=True,id=806f1a86-b973-4d62-9ad4-a5df9de18821,network=Network(bcfd8798-68b4-454a-a3ad-9cad0d42ad8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap806f1a86-b9') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 18:47:41 user nova-compute[75216]: DEBUG os_vif [None req-805d10a2-4763-4d0e-8e6c-4902073d7a7c tempest-VolumesActionsTest-586345736 tempest-VolumesActionsTest-586345736-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:a0:08,bridge_name='br-int',has_traffic_filtering=True,id=806f1a86-b973-4d62-9ad4-a5df9de18821,network=Network(bcfd8798-68b4-454a-a3ad-9cad0d42ad8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap806f1a86-b9') {{(pid=75216) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 18:47:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:47:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap806f1a86-b9, bridge=br-int, if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:47:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:47:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:47:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:47:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:47:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=33efe44a-9ff9-4e24-bd4b-5bcc75cf650c) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:47:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:47:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:47:41 user nova-compute[75216]: INFO os_vif [None req-805d10a2-4763-4d0e-8e6c-4902073d7a7c tempest-VolumesActionsTest-586345736 tempest-VolumesActionsTest-586345736-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:a0:08,bridge_name='br-int',has_traffic_filtering=True,id=806f1a86-b973-4d62-9ad4-a5df9de18821,network=Network(bcfd8798-68b4-454a-a3ad-9cad0d42ad8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap806f1a86-b9')
Nov 13 18:47:41 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-805d10a2-4763-4d0e-8e6c-4902073d7a7c tempest-VolumesActionsTest-586345736 tempest-VolumesActionsTest-586345736-project-member] [instance: 30ca36a3-ac49-44e4-a804-8940f7ef25b8] Deleting instance files /opt/stack/data/nova/instances/30ca36a3-ac49-44e4-a804-8940f7ef25b8_del
Nov 13 18:47:41 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-805d10a2-4763-4d0e-8e6c-4902073d7a7c tempest-VolumesActionsTest-586345736 tempest-VolumesActionsTest-586345736-project-member] [instance: 30ca36a3-ac49-44e4-a804-8940f7ef25b8] Deletion of /opt/stack/data/nova/instances/30ca36a3-ac49-44e4-a804-8940f7ef25b8_del complete
Nov 13 18:47:41 user nova-compute[75216]: INFO nova.compute.manager [None req-805d10a2-4763-4d0e-8e6c-4902073d7a7c tempest-VolumesActionsTest-586345736 tempest-VolumesActionsTest-586345736-project-member] [instance: 30ca36a3-ac49-44e4-a804-8940f7ef25b8] Took 0.67 seconds to destroy the instance on the hypervisor.
Nov 13 18:47:41 user nova-compute[75216]: DEBUG oslo.service.loopingcall [None req-805d10a2-4763-4d0e-8e6c-4902073d7a7c tempest-VolumesActionsTest-586345736 tempest-VolumesActionsTest-586345736-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75216) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 18:47:41 user nova-compute[75216]: DEBUG nova.compute.manager [-] [instance: 30ca36a3-ac49-44e4-a804-8940f7ef25b8] Deallocating network for instance {{(pid=75216) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 18:47:41 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: 30ca36a3-ac49-44e4-a804-8940f7ef25b8] deallocate_for_instance() {{(pid=75216) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 18:47:41 user nova-compute[75216]: DEBUG nova.compute.manager [req-9bbd918b-f09d-4afb-b1d4-77bab70838bf req-1efbde46-36b8-4eaa-a2a0-80ba5ff37173 service nova] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Received event network-vif-deleted-815d1175-2997-4d74-8f35-7ca982cf46aa {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:47:42 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: 30ca36a3-ac49-44e4-a804-8940f7ef25b8] Updating instance_info_cache with network_info: [] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 18:47:42 user nova-compute[75216]: INFO nova.compute.manager [-] [instance: 30ca36a3-ac49-44e4-a804-8940f7ef25b8] Took 0.49 seconds to deallocate network for instance.
Nov 13 18:47:42 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-805d10a2-4763-4d0e-8e6c-4902073d7a7c tempest-VolumesActionsTest-586345736 tempest-VolumesActionsTest-586345736-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:47:42 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-805d10a2-4763-4d0e-8e6c-4902073d7a7c tempest-VolumesActionsTest-586345736 tempest-VolumesActionsTest-586345736-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:47:42 user nova-compute[75216]: INFO nova.compute.manager [None req-a7a85247-963f-447c-b7f2-b42258d0713a tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] [instance: 78605259-17bf-47da-86de-3c76ac1c5bfa] Took 2.44 seconds to detach 3 volumes for instance.
Nov 13 18:47:42 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a7a85247-963f-447c-b7f2-b42258d0713a tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:47:42 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:47:42 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:47:42 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:47:42 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75216) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 18:47:42 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-805d10a2-4763-4d0e-8e6c-4902073d7a7c tempest-VolumesActionsTest-586345736 tempest-VolumesActionsTest-586345736-project-member] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 18:47:42 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-805d10a2-4763-4d0e-8e6c-4902073d7a7c tempest-VolumesActionsTest-586345736 tempest-VolumesActionsTest-586345736-project-member] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 18:47:42 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-805d10a2-4763-4d0e-8e6c-4902073d7a7c tempest-VolumesActionsTest-586345736 tempest-VolumesActionsTest-586345736-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.360s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:47:42 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a7a85247-963f-447c-b7f2-b42258d0713a tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.152s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:47:42 user nova-compute[75216]: INFO nova.scheduler.client.report [None req-805d10a2-4763-4d0e-8e6c-4902073d7a7c tempest-VolumesActionsTest-586345736 tempest-VolumesActionsTest-586345736-project-member] Deleted allocations for instance 30ca36a3-ac49-44e4-a804-8940f7ef25b8
Nov 13 18:47:42 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-805d10a2-4763-4d0e-8e6c-4902073d7a7c tempest-VolumesActionsTest-586345736 tempest-VolumesActionsTest-586345736-project-member] Lock "30ca36a3-ac49-44e4-a804-8940f7ef25b8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.717s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:47:42 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-416f74d9-dd6a-482b-ac44-20aea900630f tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] Acquiring lock "872856e5-cdc4-444e-8835-55e36708d776" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:47:42 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-416f74d9-dd6a-482b-ac44-20aea900630f tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] Lock "872856e5-cdc4-444e-8835-55e36708d776" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:47:42 user nova-compute[75216]: INFO nova.compute.manager [None req-416f74d9-dd6a-482b-ac44-20aea900630f tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] [instance: 872856e5-cdc4-444e-8835-55e36708d776] Detaching volume f530e526-b4b9-405c-8bde-111e34095cc4
Nov 13 18:47:42 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-a7a85247-963f-447c-b7f2-b42258d0713a tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 18:47:42 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-a7a85247-963f-447c-b7f2-b42258d0713a tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 18:47:42 user nova-compute[75216]: INFO nova.virt.block_device [None req-416f74d9-dd6a-482b-ac44-20aea900630f tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] [instance: 872856e5-cdc4-444e-8835-55e36708d776] Attempting to driver detach volume f530e526-b4b9-405c-8bde-111e34095cc4 from mountpoint /dev/vdb
Nov 13 18:47:42 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-416f74d9-dd6a-482b-ac44-20aea900630f tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] Attempting to detach device vdb from instance 872856e5-cdc4-444e-8835-55e36708d776 from the persistent domain config. {{(pid=75216) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 13 18:47:42 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-416f74d9-dd6a-482b-ac44-20aea900630f tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 18:47:42 user nova-compute[75216]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 18:47:42 user nova-compute[75216]:   <source dev="/dev/sdb"/>
Nov 13 18:47:42 user nova-compute[75216]:   <target dev="vdb" bus="virtio"/>
Nov 13 18:47:42 user nova-compute[75216]:   <serial>f530e526-b4b9-405c-8bde-111e34095cc4</serial>
Nov 13 18:47:42 user nova-compute[75216]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 18:47:42 user nova-compute[75216]: </disk>
Nov 13 18:47:42 user nova-compute[75216]:  {{(pid=75216) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 18:47:42 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-416f74d9-dd6a-482b-ac44-20aea900630f tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] Successfully detached device vdb from instance 872856e5-cdc4-444e-8835-55e36708d776 from the persistent domain config.
Nov 13 18:47:42 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-416f74d9-dd6a-482b-ac44-20aea900630f tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 872856e5-cdc4-444e-8835-55e36708d776 from the live domain config. {{(pid=75216) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 13 18:47:42 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-416f74d9-dd6a-482b-ac44-20aea900630f tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 18:47:42 user nova-compute[75216]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 18:47:42 user nova-compute[75216]:   <source dev="/dev/sdb"/>
Nov 13 18:47:42 user nova-compute[75216]:   <target dev="vdb" bus="virtio"/>
Nov 13 18:47:42 user nova-compute[75216]:   <serial>f530e526-b4b9-405c-8bde-111e34095cc4</serial>
Nov 13 18:47:42 user nova-compute[75216]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 18:47:42 user nova-compute[75216]: </disk>
Nov 13 18:47:42 user nova-compute[75216]:  {{(pid=75216) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 18:47:42 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a7a85247-963f-447c-b7f2-b42258d0713a tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.341s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:47:42 user nova-compute[75216]: INFO nova.scheduler.client.report [None req-a7a85247-963f-447c-b7f2-b42258d0713a tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Deleted allocations for instance 78605259-17bf-47da-86de-3c76ac1c5bfa
Nov 13 18:47:42 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a7a85247-963f-447c-b7f2-b42258d0713a tempest-TaggedBootDevicesTest-1270684031 tempest-TaggedBootDevicesTest-1270684031-project-member] Lock "78605259-17bf-47da-86de-3c76ac1c5bfa" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 12.543s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:47:43 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:47:43 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-416f74d9-dd6a-482b-ac44-20aea900630f tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 872856e5-cdc4-444e-8835-55e36708d776 {{(pid=75216) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 13 18:47:43 user nova-compute[75216]: DEBUG nova.compute.manager [req-81b4ea34-ab67-492e-82b2-729a606b440e req-c7354a16-c29a-4c34-b22f-b26ab163cec3 service nova] [instance: 30ca36a3-ac49-44e4-a804-8940f7ef25b8] Received event network-vif-plugged-806f1a86-b973-4d62-9ad4-a5df9de18821 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:47:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-81b4ea34-ab67-492e-82b2-729a606b440e req-c7354a16-c29a-4c34-b22f-b26ab163cec3 service nova] Acquiring lock "30ca36a3-ac49-44e4-a804-8940f7ef25b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:47:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-81b4ea34-ab67-492e-82b2-729a606b440e req-c7354a16-c29a-4c34-b22f-b26ab163cec3 service nova] Lock "30ca36a3-ac49-44e4-a804-8940f7ef25b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:47:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-81b4ea34-ab67-492e-82b2-729a606b440e req-c7354a16-c29a-4c34-b22f-b26ab163cec3 service nova] Lock "30ca36a3-ac49-44e4-a804-8940f7ef25b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:47:43 user nova-compute[75216]: DEBUG nova.compute.manager [req-81b4ea34-ab67-492e-82b2-729a606b440e req-c7354a16-c29a-4c34-b22f-b26ab163cec3 service nova] [instance: 30ca36a3-ac49-44e4-a804-8940f7ef25b8] No waiting events found dispatching network-vif-plugged-806f1a86-b973-4d62-9ad4-a5df9de18821 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:47:43 user nova-compute[75216]: WARNING nova.compute.manager [req-81b4ea34-ab67-492e-82b2-729a606b440e req-c7354a16-c29a-4c34-b22f-b26ab163cec3 service nova] [instance: 30ca36a3-ac49-44e4-a804-8940f7ef25b8] Received unexpected event network-vif-plugged-806f1a86-b973-4d62-9ad4-a5df9de18821 for instance with vm_state deleted and task_state None.
Nov 13 18:47:43 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:47:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:47:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:47:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:47:43 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Auditing locally available compute resources for user (node: user) {{(pid=75216) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 18:47:43 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 18:47:43 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a3e849-6570-4820-97c8-75468b5bea4f/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:43 user nova-compute[75216]: DEBUG nova.compute.manager [req-3011819d-dbc5-41ba-aaf1-1685356131fb req-0b544e8d-eff0-4070-850d-14aae1f29c91 service nova] [instance: 30ca36a3-ac49-44e4-a804-8940f7ef25b8] Received event network-vif-deleted-806f1a86-b973-4d62-9ad4-a5df9de18821 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:47:43 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a3e849-6570-4820-97c8-75468b5bea4f/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:43 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a3e849-6570-4820-97c8-75468b5bea4f/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a3e849-6570-4820-97c8-75468b5bea4f/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83fda249-9d28-4cc2-aeb0-103ce4f1faa4/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83fda249-9d28-4cc2-aeb0-103ce4f1faa4/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83fda249-9d28-4cc2-aeb0-103ce4f1faa4/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83fda249-9d28-4cc2-aeb0-103ce4f1faa4/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d589d57e-de50-482a-843f-e8246b3d7528/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d589d57e-de50-482a-843f-e8246b3d7528/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d589d57e-de50-482a-843f-e8246b3d7528/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d589d57e-de50-482a-843f-e8246b3d7528/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b078f75-57f2-495a-abd5-f8adf72db80b/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b078f75-57f2-495a-abd5-f8adf72db80b/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b078f75-57f2-495a-abd5-f8adf72db80b/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:45 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b078f75-57f2-495a-abd5-f8adf72db80b/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:45 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/872856e5-cdc4-444e-8835-55e36708d776/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:45 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/872856e5-cdc4-444e-8835-55e36708d776/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:45 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/872856e5-cdc4-444e-8835-55e36708d776/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:45 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/872856e5-cdc4-444e-8835-55e36708d776/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:45 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/576e97b7-285a-451f-a80d-aaa321a79d3b/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:45 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/576e97b7-285a-451f-a80d-aaa321a79d3b/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:45 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/576e97b7-285a-451f-a80d-aaa321a79d3b/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:45 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/576e97b7-285a-451f-a80d-aaa321a79d3b/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:45 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85624c58-6c72-4490-8a3e-547953295ade/disk.rescue --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:46 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85624c58-6c72-4490-8a3e-547953295ade/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:46 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85624c58-6c72-4490-8a3e-547953295ade/disk.rescue --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:46 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-5048db89-ee71-4f4d-9186-23c2bc140106 tempest-VolumesAssistedSnapshotsTest-1584726322 tempest-VolumesAssistedSnapshotsTest-1584726322-project-admin] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 576e97b7-285a-451f-a80d-aaa321a79d3b is timed out.
Nov 13 18:47:46 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-5048db89-ee71-4f4d-9186-23c2bc140106 tempest-VolumesAssistedSnapshotsTest-1584726322 tempest-VolumesAssistedSnapshotsTest-1584726322-project-admin] Successfully detached device vdb from instance 576e97b7-285a-451f-a80d-aaa321a79d3b from the live domain config.
Nov 13 18:47:46 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5048db89-ee71-4f4d-9186-23c2bc140106 tempest-VolumesAssistedSnapshotsTest-1584726322 tempest-VolumesAssistedSnapshotsTest-1584726322-project-admin] [instance: 576e97b7-285a-451f-a80d-aaa321a79d3b] calling os-brick to detach iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 18:47:46 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-5048db89-ee71-4f4d-9186-23c2bc140106 tempest-VolumesAssistedSnapshotsTest-1584726322 tempest-VolumesAssistedSnapshotsTest-1584726322-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3a8669e40>, {'target_iqn': 'iqn.2010-10.org.openstack:d72e8803-2ded-42f6-858f-803c16c2d2a4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gKToYrIR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdl'}, None), 'kwargs': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 18:47:46 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-5048db89-ee71-4f4d-9186-23c2bc140106 tempest-VolumesAssistedSnapshotsTest-1584726322 tempest-VolumesAssistedSnapshotsTest-1584726322-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 18:47:46 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-5048db89-ee71-4f4d-9186-23c2bc140106 tempest-VolumesAssistedSnapshotsTest-1584726322 tempest-VolumesAssistedSnapshotsTest-1584726322-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 18:47:46 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-5048db89-ee71-4f4d-9186-23c2bc140106 tempest-VolumesAssistedSnapshotsTest-1584726322 tempest-VolumesAssistedSnapshotsTest-1584726322-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 18:47:46 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:46 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:46 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[997a759a-d12e-4fcf-a09e-9795ff17e4f6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f530e526-b4b9-405c-8bde-111e34095cc4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d72e8803-2ded-42f6-858f-803c16c2d2a4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:46 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-5048db89-ee71-4f4d-9186-23c2bc140106 tempest-VolumesAssistedSnapshotsTest-1584726322 tempest-VolumesAssistedSnapshotsTest-1584726322-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 18:47:46 user nova-compute[75216]: No targets found.
Nov 13 18:47:46 user nova-compute[75216]: iSNS:
Nov 13 18:47:46 user nova-compute[75216]: No targets found.
Nov 13 18:47:46 user nova-compute[75216]: STATIC:
Nov 13 18:47:46 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:f530e526-b4b9-405c-8bde-111e34095cc4
Nov 13 18:47:46 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 18:47:46 user nova-compute[75216]:                 Iface Name: default
Nov 13 18:47:46 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:d72e8803-2ded-42f6-858f-803c16c2d2a4
Nov 13 18:47:46 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 18:47:46 user nova-compute[75216]:                 Iface Name: default
Nov 13 18:47:46 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac
Nov 13 18:47:46 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 18:47:46 user nova-compute[75216]:                 Iface Name: default
Nov 13 18:47:46 user nova-compute[75216]: FIRMWARE:
Nov 13 18:47:46 user nova-compute[75216]: No targets found.
Nov 13 18:47:46 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 18:47:46 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-5048db89-ee71-4f4d-9186-23c2bc140106 tempest-VolumesAssistedSnapshotsTest-1584726322 tempest-VolumesAssistedSnapshotsTest-1584726322-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 18:47:46 user nova-compute[75216]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 18:47:46 user nova-compute[75216]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75216) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 18:47:46 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-5048db89-ee71-4f4d-9186-23c2bc140106 tempest-VolumesAssistedSnapshotsTest-1584726322 tempest-VolumesAssistedSnapshotsTest-1584726322-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d72e8803-2ded-42f6-858f-803c16c2d2a4', 0)] {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 18:47:46 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:46 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85624c58-6c72-4490-8a3e-547953295ade/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:46 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85624c58-6c72-4490-8a3e-547953295ade/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:46 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:46 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[c043fdd4-12a8-43eb-93f5-e02b57754462]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d72e8803-2ded-42f6-858f-803c16c2d2a4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f530e526-b4b9-405c-8bde-111e34095cc4\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:46 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:46 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:46 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[227ba4a8-15ff-4a83-a428-bee8a1af0f1f]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d72e8803-2ded-42f6-858f-803c16c2d2a4 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530e526-b4b9-405c-8bde-111e34095cc4 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac (non-flash)\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:46 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-5048db89-ee71-4f4d-9186-23c2bc140106 tempest-VolumesAssistedSnapshotsTest-1584726322 tempest-VolumesAssistedSnapshotsTest-1584726322-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d72e8803-2ded-42f6-858f-803c16c2d2a4 (non-flash)
Nov 13 18:47:46 user nova-compute[75216]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530e526-b4b9-405c-8bde-111e34095cc4 (non-flash)
Nov 13 18:47:46 user nova-compute[75216]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac (non-flash)
Nov 13 18:47:46 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 18:47:46 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-5048db89-ee71-4f4d-9186-23c2bc140106 tempest-VolumesAssistedSnapshotsTest-1584726322 tempest-VolumesAssistedSnapshotsTest-1584726322-project-admin] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d72e8803-2ded-42f6-858f-803c16c2d2a4 (non-flash)
Nov 13 18:47:46 user nova-compute[75216]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530e526-b4b9-405c-8bde-111e34095cc4 (non-flash)
Nov 13 18:47:46 user nova-compute[75216]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac (non-flash)
Nov 13 18:47:46 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 18:47:46 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-5048db89-ee71-4f4d-9186-23c2bc140106 tempest-VolumesAssistedSnapshotsTest-1584726322 tempest-VolumesAssistedSnapshotsTest-1584726322-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe3c02c43a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d72e8803-2ded-42f6-858f-803c16c2d2a4'): ({'sdl'}, set())}) {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 18:47:46 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-5048db89-ee71-4f4d-9186-23c2bc140106 tempest-VolumesAssistedSnapshotsTest-1584726322 tempest-VolumesAssistedSnapshotsTest-1584726322-project-admin] Removing single pathed devices sdl {{(pid=75216) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 18:47:46 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:46 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:46 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[b03222ef-ada9-4e8a-9421-ae26b51a2540]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:46 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdl {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:46 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdl" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:46 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[7db484e3-cc0c-485d-97fc-f77c5dc0cb3e]: (4, ('ok\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:46 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-5048db89-ee71-4f4d-9186-23c2bc140106 tempest-VolumesAssistedSnapshotsTest-1584726322 tempest-VolumesAssistedSnapshotsTest-1584726322-project-admin] Flushing IO for device /dev/sdl {{(pid=75216) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 18:47:46 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdl {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:46 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdl" returned: 0 in 0.013s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:46 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ba5f3d5-1ea7-4973-9181-f8e76ee378bf]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:46 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-5048db89-ee71-4f4d-9186-23c2bc140106 tempest-VolumesAssistedSnapshotsTest-1584726322 tempest-VolumesAssistedSnapshotsTest-1584726322-project-admin] Remove SCSI device /dev/sdl with /sys/block/sdl/device/delete {{(pid=75216) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 18:47:46 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdl/device/delete {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:46 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdl/device/delete" returned: 0 in 0.041s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:46 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[906e1812-340a-4012-818d-f9982c63f9be]: (4, ('1', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:46 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-5048db89-ee71-4f4d-9186-23c2bc140106 tempest-VolumesAssistedSnapshotsTest-1584726322 tempest-VolumesAssistedSnapshotsTest-1584726322-project-admin] Checking to see if SCSI volumes sdl have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 18:47:46 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-5048db89-ee71-4f4d-9186-23c2bc140106 tempest-VolumesAssistedSnapshotsTest-1584726322 tempest-VolumesAssistedSnapshotsTest-1584726322-project-admin] SCSI volumes sdl have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 18:47:46 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-5048db89-ee71-4f4d-9186-23c2bc140106 tempest-VolumesAssistedSnapshotsTest-1584726322 tempest-VolumesAssistedSnapshotsTest-1584726322-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d72e8803-2ded-42f6-858f-803c16c2d2a4')] {{(pid=75216) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 18:47:46 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d72e8803-2ded-42f6-858f-803c16c2d2a4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:46 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85624c58-6c72-4490-8a3e-547953295ade/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:46 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85624c58-6c72-4490-8a3e-547953295ade/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:46 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d72e8803-2ded-42f6-858f-803c16c2d2a4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:46 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[52fdabee-3e86-4a4d-91a3-f5d2732fc783]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:46 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-5048db89-ee71-4f4d-9186-23c2bc140106 tempest-VolumesAssistedSnapshotsTest-1584726322 tempest-VolumesAssistedSnapshotsTest-1584726322-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:47:46 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d72e8803-2ded-42f6-858f-803c16c2d2a4 -p 172.16.0.220:3260 --logout {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:46 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:47:46 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d72e8803-2ded-42f6-858f-803c16c2d2a4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:46 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[51ee8171-109f-4798-a00c-41d4f3157c01]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:d72e8803-2ded-42f6-858f-803c16c2d2a4, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:d72e8803-2ded-42f6-858f-803c16c2d2a4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:46 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-5048db89-ee71-4f4d-9186-23c2bc140106 tempest-VolumesAssistedSnapshotsTest-1584726322 tempest-VolumesAssistedSnapshotsTest-1584726322-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:d72e8803-2ded-42f6-858f-803c16c2d2a4, portal: 172.16.0.220,3260]
Nov 13 18:47:46 user nova-compute[75216]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:d72e8803-2ded-42f6-858f-803c16c2d2a4, portal: 172.16.0.220,3260] successful.
Nov 13 18:47:46 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:47:46 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d72e8803-2ded-42f6-858f-803c16c2d2a4 -p 172.16.0.220:3260 --op delete {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:47:46 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d72e8803-2ded-42f6-858f-803c16c2d2a4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:46 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a2cb69a-7aeb-4b3a-8fdc-7603f4f928fa]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:47:46 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-5048db89-ee71-4f4d-9186-23c2bc140106 tempest-VolumesAssistedSnapshotsTest-1584726322 tempest-VolumesAssistedSnapshotsTest-1584726322-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:47:46 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-5048db89-ee71-4f4d-9186-23c2bc140106 tempest-VolumesAssistedSnapshotsTest-1584726322 tempest-VolumesAssistedSnapshotsTest-1584726322-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.366s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 18:47:46 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-5048db89-ee71-4f4d-9186-23c2bc140106 tempest-VolumesAssistedSnapshotsTest-1584726322 tempest-VolumesAssistedSnapshotsTest-1584726322-project-admin] <== disconnect_volume: return (368ms) None {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 18:47:46 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5048db89-ee71-4f4d-9186-23c2bc140106 tempest-VolumesAssistedSnapshotsTest-1584726322 tempest-VolumesAssistedSnapshotsTest-1584726322-project-admin] [instance: 576e97b7-285a-451f-a80d-aaa321a79d3b] Disconnected iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 18:47:46 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85624c58-6c72-4490-8a3e-547953295ade/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:47:47 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 18:47:47 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 18:47:47 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Hypervisor/Node resource view: name=user free_ram=7593MB free_disk=25.712207794189453GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75216) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 18:47:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:47:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:47:47 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance a1a3e849-6570-4820-97c8-75468b5bea4f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 18:47:47 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance d589d57e-de50-482a-843f-e8246b3d7528 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 18:47:47 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance 85624c58-6c72-4490-8a3e-547953295ade actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 18:47:47 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance 9b078f75-57f2-495a-abd5-f8adf72db80b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 18:47:47 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance 83fda249-9d28-4cc2-aeb0-103ce4f1faa4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 18:47:47 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance 872856e5-cdc4-444e-8835-55e36708d776 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 18:47:47 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance 576e97b7-285a-451f-a80d-aaa321a79d3b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 18:47:47 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance a3bcf65e-bd5b-4350-a222-5f4522418a67 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 18:47:47 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 18:47:47 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 18:47:47 user nova-compute[75216]: DEBUG nova.objects.instance [None req-5048db89-ee71-4f4d-9186-23c2bc140106 tempest-VolumesAssistedSnapshotsTest-1584726322 tempest-VolumesAssistedSnapshotsTest-1584726322-project-admin] Lazy-loading 'flavor' on Instance uuid 576e97b7-285a-451f-a80d-aaa321a79d3b {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 18:47:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-5048db89-ee71-4f4d-9186-23c2bc140106 tempest-VolumesAssistedSnapshotsTest-1584726322 tempest-VolumesAssistedSnapshotsTest-1584726322-project-admin] Lock "576e97b7-285a-451f-a80d-aaa321a79d3b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.780s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:47:47 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 18:47:47 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 18:47:47 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Compute_service record updated for user:user {{(pid=75216) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 18:47:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.403s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:47:48 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:47:48 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:47:48 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Starting heal instance info cache {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 18:47:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "refresh_cache-85624c58-6c72-4490-8a3e-547953295ade" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 18:47:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquired lock "refresh_cache-85624c58-6c72-4490-8a3e-547953295ade" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 18:47:48 user nova-compute[75216]: DEBUG nova.network.neutron [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: 85624c58-6c72-4490-8a3e-547953295ade] Forcefully refreshing network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 18:47:48 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:47:49 user nova-compute[75216]: DEBUG nova.network.neutron [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: 85624c58-6c72-4490-8a3e-547953295ade] Updating instance_info_cache with network_info: [{"id": "51ccc958-5ce8-4e1d-8d28-f10c5ac288bd", "address": "fa:16:3e:f4:a4:79", "network": {"id": "6d182db1-03b5-4d1b-86cf-b9367921b7b0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1877006951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2efafc26c47c4050bd367c47469999fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51ccc958-5c", "ovs_interfaceid": "51ccc958-5ce8-4e1d-8d28-f10c5ac288bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 18:47:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Releasing lock "refresh_cache-85624c58-6c72-4490-8a3e-547953295ade" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 18:47:49 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: 85624c58-6c72-4490-8a3e-547953295ade] Updated the network info_cache for instance {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 18:47:49 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:47:50 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:47:51 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:47:53 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:47:53 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:47:55 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:47:56 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:47:58 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:48:01 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-20fbc57e-27ac-445f-9e0f-8ddfbaec2233 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] Acquiring lock "64dfe522-8b46-4df4-8032-591ce56900ec" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:48:01 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-20fbc57e-27ac-445f-9e0f-8ddfbaec2233 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] Lock "64dfe522-8b46-4df4-8032-591ce56900ec" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:48:01 user nova-compute[75216]: DEBUG nova.compute.manager [None req-20fbc57e-27ac-445f-9e0f-8ddfbaec2233 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] [instance: 64dfe522-8b46-4df4-8032-591ce56900ec] Starting instance... {{(pid=75216) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 18:48:01 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-20fbc57e-27ac-445f-9e0f-8ddfbaec2233 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:48:01 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-20fbc57e-27ac-445f-9e0f-8ddfbaec2233 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:48:01 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-20fbc57e-27ac-445f-9e0f-8ddfbaec2233 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75216) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 18:48:01 user nova-compute[75216]: INFO nova.compute.claims [None req-20fbc57e-27ac-445f-9e0f-8ddfbaec2233 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] [instance: 64dfe522-8b46-4df4-8032-591ce56900ec] Claim successful on node user
Nov 13 18:48:01 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:48:01 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-20fbc57e-27ac-445f-9e0f-8ddfbaec2233 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 18:48:01 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-20fbc57e-27ac-445f-9e0f-8ddfbaec2233 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 18:48:01 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-20fbc57e-27ac-445f-9e0f-8ddfbaec2233 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.388s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:48:01 user nova-compute[75216]: DEBUG nova.compute.manager [None req-20fbc57e-27ac-445f-9e0f-8ddfbaec2233 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] [instance: 64dfe522-8b46-4df4-8032-591ce56900ec] Start building networks asynchronously for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 18:48:01 user nova-compute[75216]: DEBUG nova.compute.manager [None req-20fbc57e-27ac-445f-9e0f-8ddfbaec2233 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] [instance: 64dfe522-8b46-4df4-8032-591ce56900ec] Allocating IP information in the background. {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 18:48:01 user nova-compute[75216]: DEBUG nova.network.neutron [None req-20fbc57e-27ac-445f-9e0f-8ddfbaec2233 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] [instance: 64dfe522-8b46-4df4-8032-591ce56900ec] allocate_for_instance() {{(pid=75216) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 18:48:01 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-20fbc57e-27ac-445f-9e0f-8ddfbaec2233 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] [instance: 64dfe522-8b46-4df4-8032-591ce56900ec] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 18:48:01 user nova-compute[75216]: DEBUG nova.compute.manager [None req-20fbc57e-27ac-445f-9e0f-8ddfbaec2233 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] [instance: 64dfe522-8b46-4df4-8032-591ce56900ec] Start building block device mappings for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 18:48:01 user nova-compute[75216]: DEBUG nova.policy [None req-20fbc57e-27ac-445f-9e0f-8ddfbaec2233 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '454caf80dd76487baead7c52f05df1a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ec18dd2e6ea476dbf3745d14a866190', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75216) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 18:48:01 user nova-compute[75216]: DEBUG nova.compute.manager [None req-20fbc57e-27ac-445f-9e0f-8ddfbaec2233 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] [instance: 64dfe522-8b46-4df4-8032-591ce56900ec] Start spawning the instance on the hypervisor. {{(pid=75216) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 18:48:01 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-20fbc57e-27ac-445f-9e0f-8ddfbaec2233 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] [instance: 64dfe522-8b46-4df4-8032-591ce56900ec] Creating instance directory {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 18:48:01 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-20fbc57e-27ac-445f-9e0f-8ddfbaec2233 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] [instance: 64dfe522-8b46-4df4-8032-591ce56900ec] Creating image(s)
Nov 13 18:48:01 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-20fbc57e-27ac-445f-9e0f-8ddfbaec2233 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] Acquiring lock "/opt/stack/data/nova/instances/64dfe522-8b46-4df4-8032-591ce56900ec/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:48:01 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-20fbc57e-27ac-445f-9e0f-8ddfbaec2233 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] Lock "/opt/stack/data/nova/instances/64dfe522-8b46-4df4-8032-591ce56900ec/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:48:01 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-20fbc57e-27ac-445f-9e0f-8ddfbaec2233 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] Lock "/opt/stack/data/nova/instances/64dfe522-8b46-4df4-8032-591ce56900ec/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:48:01 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-20fbc57e-27ac-445f-9e0f-8ddfbaec2233 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:48:02 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-20fbc57e-27ac-445f-9e0f-8ddfbaec2233 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json" returned: 0 in 0.179s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:48:02 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-20fbc57e-27ac-445f-9e0f-8ddfbaec2233 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] Acquiring lock "88c50a45bec9d6b0427462b3242b9b8e5f49c2b6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:48:02 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-20fbc57e-27ac-445f-9e0f-8ddfbaec2233 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] Lock "88c50a45bec9d6b0427462b3242b9b8e5f49c2b6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:48:02 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-20fbc57e-27ac-445f-9e0f-8ddfbaec2233 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:48:02 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-20fbc57e-27ac-445f-9e0f-8ddfbaec2233 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json" returned: 0 in 0.171s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:48:02 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-20fbc57e-27ac-445f-9e0f-8ddfbaec2233 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6,backing_fmt=raw /opt/stack/data/nova/instances/64dfe522-8b46-4df4-8032-591ce56900ec/disk 1073741824 {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:48:02 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-20fbc57e-27ac-445f-9e0f-8ddfbaec2233 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6,backing_fmt=raw /opt/stack/data/nova/instances/64dfe522-8b46-4df4-8032-591ce56900ec/disk 1073741824" returned: 0 in 0.052s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:48:02 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-20fbc57e-27ac-445f-9e0f-8ddfbaec2233 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] Lock "88c50a45bec9d6b0427462b3242b9b8e5f49c2b6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.230s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:48:02 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-20fbc57e-27ac-445f-9e0f-8ddfbaec2233 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:48:02 user nova-compute[75216]: DEBUG nova.network.neutron [None req-20fbc57e-27ac-445f-9e0f-8ddfbaec2233 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] [instance: 64dfe522-8b46-4df4-8032-591ce56900ec] Successfully created port: 2d12f254-7874-4622-a7cb-8180de961bd1 {{(pid=75216) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 18:48:02 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-20fbc57e-27ac-445f-9e0f-8ddfbaec2233 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json" returned: 0 in 0.175s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:48:02 user nova-compute[75216]: DEBUG nova.virt.disk.api [None req-20fbc57e-27ac-445f-9e0f-8ddfbaec2233 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] Checking if we can resize image /opt/stack/data/nova/instances/64dfe522-8b46-4df4-8032-591ce56900ec/disk. size=1073741824 {{(pid=75216) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 18:48:02 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-20fbc57e-27ac-445f-9e0f-8ddfbaec2233 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64dfe522-8b46-4df4-8032-591ce56900ec/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:48:02 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-20fbc57e-27ac-445f-9e0f-8ddfbaec2233 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64dfe522-8b46-4df4-8032-591ce56900ec/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:48:02 user nova-compute[75216]: DEBUG nova.virt.disk.api [None req-20fbc57e-27ac-445f-9e0f-8ddfbaec2233 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] Cannot resize image /opt/stack/data/nova/instances/64dfe522-8b46-4df4-8032-591ce56900ec/disk to a smaller size. {{(pid=75216) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 18:48:02 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-20fbc57e-27ac-445f-9e0f-8ddfbaec2233 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] [instance: 64dfe522-8b46-4df4-8032-591ce56900ec] Created local disks {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 18:48:02 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-20fbc57e-27ac-445f-9e0f-8ddfbaec2233 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] [instance: 64dfe522-8b46-4df4-8032-591ce56900ec] Ensure instance console log exists: /opt/stack/data/nova/instances/64dfe522-8b46-4df4-8032-591ce56900ec/console.log {{(pid=75216) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 18:48:02 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-20fbc57e-27ac-445f-9e0f-8ddfbaec2233 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:48:02 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-20fbc57e-27ac-445f-9e0f-8ddfbaec2233 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:48:02 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-20fbc57e-27ac-445f-9e0f-8ddfbaec2233 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:48:03 user nova-compute[75216]: DEBUG nova.network.neutron [None req-20fbc57e-27ac-445f-9e0f-8ddfbaec2233 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] [instance: 64dfe522-8b46-4df4-8032-591ce56900ec] Successfully updated port: 2d12f254-7874-4622-a7cb-8180de961bd1 {{(pid=75216) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 18:48:03 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:48:03 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-20fbc57e-27ac-445f-9e0f-8ddfbaec2233 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] Acquiring lock "refresh_cache-64dfe522-8b46-4df4-8032-591ce56900ec" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 18:48:03 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-20fbc57e-27ac-445f-9e0f-8ddfbaec2233 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] Acquired lock "refresh_cache-64dfe522-8b46-4df4-8032-591ce56900ec" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 18:48:03 user nova-compute[75216]: DEBUG nova.network.neutron [None req-20fbc57e-27ac-445f-9e0f-8ddfbaec2233 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] [instance: 64dfe522-8b46-4df4-8032-591ce56900ec] Building network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 18:48:03 user nova-compute[75216]: DEBUG nova.compute.manager [req-96581c7e-07a0-4947-955b-04a90706efd4 req-5b1e9e4b-5aaa-46a9-9229-264ea04bfae3 service nova] [instance: 64dfe522-8b46-4df4-8032-591ce56900ec] Received event network-changed-2d12f254-7874-4622-a7cb-8180de961bd1 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:48:03 user nova-compute[75216]: DEBUG nova.compute.manager [req-96581c7e-07a0-4947-955b-04a90706efd4 req-5b1e9e4b-5aaa-46a9-9229-264ea04bfae3 service nova] [instance: 64dfe522-8b46-4df4-8032-591ce56900ec] Refreshing instance network info cache due to event network-changed-2d12f254-7874-4622-a7cb-8180de961bd1. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 18:48:03 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-96581c7e-07a0-4947-955b-04a90706efd4 req-5b1e9e4b-5aaa-46a9-9229-264ea04bfae3 service nova] Acquiring lock "refresh_cache-64dfe522-8b46-4df4-8032-591ce56900ec" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 18:48:03 user nova-compute[75216]: DEBUG nova.network.neutron [None req-20fbc57e-27ac-445f-9e0f-8ddfbaec2233 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] [instance: 64dfe522-8b46-4df4-8032-591ce56900ec] Instance cache missing network info. {{(pid=75216) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 18:48:03 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-416f74d9-dd6a-482b-ac44-20aea900630f tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 872856e5-cdc4-444e-8835-55e36708d776 is timed out.
Nov 13 18:48:03 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-416f74d9-dd6a-482b-ac44-20aea900630f tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] Successfully detached device vdb from instance 872856e5-cdc4-444e-8835-55e36708d776 from the live domain config.
Nov 13 18:48:03 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-416f74d9-dd6a-482b-ac44-20aea900630f tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] [instance: 872856e5-cdc4-444e-8835-55e36708d776] calling os-brick to detach iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 18:48:03 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-416f74d9-dd6a-482b-ac44-20aea900630f tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3a8669e40>, {'target_iqn': 'iqn.2010-10.org.openstack:f530e526-b4b9-405c-8bde-111e34095cc4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ReFEXBsZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'volume_id': 'f530e526-b4b9-405c-8bde-111e34095cc4'}, None), 'kwargs': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 18:48:03 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-416f74d9-dd6a-482b-ac44-20aea900630f tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 18:48:03 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-416f74d9-dd6a-482b-ac44-20aea900630f tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 18:48:03 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-416f74d9-dd6a-482b-ac44-20aea900630f tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 18:48:03 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:48:03 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:48:03 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fff6963-1407-47f5-ba83-7679a2eda2a6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f530e526-b4b9-405c-8bde-111e34095cc4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:48:03 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-416f74d9-dd6a-482b-ac44-20aea900630f tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 18:48:03 user nova-compute[75216]: No targets found.
Nov 13 18:48:03 user nova-compute[75216]: iSNS:
Nov 13 18:48:03 user nova-compute[75216]: No targets found.
Nov 13 18:48:03 user nova-compute[75216]: STATIC:
Nov 13 18:48:03 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:f530e526-b4b9-405c-8bde-111e34095cc4
Nov 13 18:48:03 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 18:48:03 user nova-compute[75216]:                 Iface Name: default
Nov 13 18:48:03 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac
Nov 13 18:48:03 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 18:48:03 user nova-compute[75216]:                 Iface Name: default
Nov 13 18:48:03 user nova-compute[75216]: FIRMWARE:
Nov 13 18:48:03 user nova-compute[75216]: No targets found.
Nov 13 18:48:03 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 18:48:03 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-416f74d9-dd6a-482b-ac44-20aea900630f tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 18:48:03 user nova-compute[75216]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 18:48:03 user nova-compute[75216]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75216) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 18:48:03 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-416f74d9-dd6a-482b-ac44-20aea900630f tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f530e526-b4b9-405c-8bde-111e34095cc4', 0)] {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 18:48:03 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:48:03 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:48:03 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[52465cbb-1c14-4b89-9fbf-0d3d334da50d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f530e526-b4b9-405c-8bde-111e34095cc4\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:48:03 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:48:03 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:48:03 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[702afb68-d9a8-4151-a9e0-71949f02d8dd]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530e526-b4b9-405c-8bde-111e34095cc4 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac (non-flash)\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:48:03 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-416f74d9-dd6a-482b-ac44-20aea900630f tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530e526-b4b9-405c-8bde-111e34095cc4 (non-flash)
Nov 13 18:48:03 user nova-compute[75216]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac (non-flash)
Nov 13 18:48:03 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 18:48:03 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-416f74d9-dd6a-482b-ac44-20aea900630f tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f530e526-b4b9-405c-8bde-111e34095cc4 (non-flash)
Nov 13 18:48:03 user nova-compute[75216]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac (non-flash)
Nov 13 18:48:03 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 18:48:03 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-416f74d9-dd6a-482b-ac44-20aea900630f tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe3c0299cf0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f530e526-b4b9-405c-8bde-111e34095cc4'): ({'sdb'}, set())}) {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 18:48:03 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-416f74d9-dd6a-482b-ac44-20aea900630f tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] Removing single pathed devices sdb {{(pid=75216) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 18:48:03 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:48:03 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:48:03 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdd83b2e-120c-4427-8c0f-0baaf4031ff1]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:48:03 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:48:03 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:48:03 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc9cb26e-2068-4670-8b50-f84de7b9f77d]: (4, ('ok\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:48:03 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-416f74d9-dd6a-482b-ac44-20aea900630f tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] Flushing IO for device /dev/sdb {{(pid=75216) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 18:48:03 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:48:03 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:48:03 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[39b10a47-c26b-4cbb-9bef-2075574dde65]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:48:03 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-416f74d9-dd6a-482b-ac44-20aea900630f tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75216) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 18:48:03 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:48:03 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.032s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:48:03 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a2a0274-f4bc-4c6c-a8af-85d801c7fda3]: (4, ('1', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:48:03 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-416f74d9-dd6a-482b-ac44-20aea900630f tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 18:48:03 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-416f74d9-dd6a-482b-ac44-20aea900630f tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] SCSI volumes sdb have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 18:48:03 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-416f74d9-dd6a-482b-ac44-20aea900630f tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f530e526-b4b9-405c-8bde-111e34095cc4')] {{(pid=75216) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 18:48:03 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f530e526-b4b9-405c-8bde-111e34095cc4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:48:03 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f530e526-b4b9-405c-8bde-111e34095cc4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:48:03 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[78dabe86-3a14-4308-8f70-63078f21f568]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:48:03 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-416f74d9-dd6a-482b-ac44-20aea900630f tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:48:03 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f530e526-b4b9-405c-8bde-111e34095cc4 -p 172.16.0.220:3260 --logout {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:48:03 user nova-compute[75216]: DEBUG nova.network.neutron [None req-20fbc57e-27ac-445f-9e0f-8ddfbaec2233 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] [instance: 64dfe522-8b46-4df4-8032-591ce56900ec] Updating instance_info_cache with network_info: [{"id": "2d12f254-7874-4622-a7cb-8180de961bd1", "address": "fa:16:3e:a1:6b:92", "network": {"id": "0b64448d-5ece-4814-9bdc-de0167e921f9", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-67835474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ec18dd2e6ea476dbf3745d14a866190", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d12f254-78", "ovs_interfaceid": "2d12f254-7874-4622-a7cb-8180de961bd1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 18:48:03 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-20fbc57e-27ac-445f-9e0f-8ddfbaec2233 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] Releasing lock "refresh_cache-64dfe522-8b46-4df4-8032-591ce56900ec" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 18:48:03 user nova-compute[75216]: DEBUG nova.compute.manager [None req-20fbc57e-27ac-445f-9e0f-8ddfbaec2233 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] [instance: 64dfe522-8b46-4df4-8032-591ce56900ec] Instance network_info: |[{"id": "2d12f254-7874-4622-a7cb-8180de961bd1", "address": "fa:16:3e:a1:6b:92", "network": {"id": "0b64448d-5ece-4814-9bdc-de0167e921f9", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-67835474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ec18dd2e6ea476dbf3745d14a866190", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d12f254-78", "ovs_interfaceid": "2d12f254-7874-4622-a7cb-8180de961bd1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 18:48:03 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-96581c7e-07a0-4947-955b-04a90706efd4 req-5b1e9e4b-5aaa-46a9-9229-264ea04bfae3 service nova] Acquired lock "refresh_cache-64dfe522-8b46-4df4-8032-591ce56900ec" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 18:48:03 user nova-compute[75216]: DEBUG nova.network.neutron [req-96581c7e-07a0-4947-955b-04a90706efd4 req-5b1e9e4b-5aaa-46a9-9229-264ea04bfae3 service nova] [instance: 64dfe522-8b46-4df4-8032-591ce56900ec] Refreshing network info cache for port 2d12f254-7874-4622-a7cb-8180de961bd1 {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 18:48:03 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-20fbc57e-27ac-445f-9e0f-8ddfbaec2233 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] [instance: 64dfe522-8b46-4df4-8032-591ce56900ec] Start _get_guest_xml network_info=[{"id": "2d12f254-7874-4622-a7cb-8180de961bd1", "address": "fa:16:3e:a1:6b:92", "network": {"id": "0b64448d-5ece-4814-9bdc-de0167e921f9", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-67835474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ec18dd2e6ea476dbf3745d14a866190", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d12f254-78", "ovs_interfaceid": "2d12f254-7874-4622-a7cb-8180de961bd1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T18:41:06Z,direct_url=<?>,disk_format='qcow2',id=77bcb5ba-8510-41ec-a88d-96097bb431de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c465b7c26ec44582b6d1b7169536ecc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T18:41:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'guest_format': None, 'boot_index': 0, 'image_id': '77bcb5ba-8510-41ec-a88d-96097bb431de'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 18:48:03 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-20fbc57e-27ac-445f-9e0f-8ddfbaec2233 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 18:48:03 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-20fbc57e-27ac-445f-9e0f-8ddfbaec2233 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 18:48:03 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-20fbc57e-27ac-445f-9e0f-8ddfbaec2233 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 18:48:03 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-20fbc57e-27ac-445f-9e0f-8ddfbaec2233 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] CPU controller missing on host. {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 18:48:03 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-20fbc57e-27ac-445f-9e0f-8ddfbaec2233 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 18:48:03 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-20fbc57e-27ac-445f-9e0f-8ddfbaec2233 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] CPU controller found on host. {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 18:48:03 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-20fbc57e-27ac-445f-9e0f-8ddfbaec2233 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75216) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 18:48:03 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-20fbc57e-27ac-445f-9e0f-8ddfbaec2233 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T18:40:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T18:41:06Z,direct_url=<?>,disk_format='qcow2',id=77bcb5ba-8510-41ec-a88d-96097bb431de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c465b7c26ec44582b6d1b7169536ecc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T18:41:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 18:48:03 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-20fbc57e-27ac-445f-9e0f-8ddfbaec2233 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] Flavor limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 18:48:03 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-20fbc57e-27ac-445f-9e0f-8ddfbaec2233 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] Image limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 18:48:03 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-20fbc57e-27ac-445f-9e0f-8ddfbaec2233 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] Flavor pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 18:48:03 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-20fbc57e-27ac-445f-9e0f-8ddfbaec2233 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] Image pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 18:48:03 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-20fbc57e-27ac-445f-9e0f-8ddfbaec2233 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 18:48:03 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-20fbc57e-27ac-445f-9e0f-8ddfbaec2233 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 18:48:03 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-20fbc57e-27ac-445f-9e0f-8ddfbaec2233 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 18:48:03 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-20fbc57e-27ac-445f-9e0f-8ddfbaec2233 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] Got 1 possible topologies {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 18:48:03 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-20fbc57e-27ac-445f-9e0f-8ddfbaec2233 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 18:48:03 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-20fbc57e-27ac-445f-9e0f-8ddfbaec2233 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 18:48:03 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-20fbc57e-27ac-445f-9e0f-8ddfbaec2233 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T18:48:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-904595823',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-904595823',id=13,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAnoGBZDueYOh3xcWER1AMv30DIYxQxeWRDS2fRFXh6l4DZc8pD4qIgg0IjDLbUZuBfE7+vn5QgzB7ChiJAa+d1ltHilcpx/dg8eDxHVfO8o++kjL7IH7NIL3RYQDYV6Ew==',key_name='tempest-keypair-1295383460',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0ec18dd2e6ea476dbf3745d14a866190',ramdisk_id='',reservation_id='r-0a499j0h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-507898025',owner_user_name='tempest-TaggedAttachmentsTest-507898025-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T18:48:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='454caf80dd76487baead7c52f05df1a5',uuid=64dfe522-8b46-4df4-8032-591ce56900ec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2d12f254-7874-4622-a7cb-8180de961bd1", "address": "fa:16:3e:a1:6b:92", "network": {"id": "0b64448d-5ece-4814-9bdc-de0167e921f9", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-67835474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ec18dd2e6ea476dbf3745d14a866190", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d12f254-78", "ovs_interfaceid": "2d12f254-7874-4622-a7cb-8180de961bd1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75216) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 18:48:03 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-20fbc57e-27ac-445f-9e0f-8ddfbaec2233 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] Converting VIF {"id": "2d12f254-7874-4622-a7cb-8180de961bd1", "address": "fa:16:3e:a1:6b:92", "network": {"id": "0b64448d-5ece-4814-9bdc-de0167e921f9", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-67835474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ec18dd2e6ea476dbf3745d14a866190", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d12f254-78", "ovs_interfaceid": "2d12f254-7874-4622-a7cb-8180de961bd1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 18:48:03 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-20fbc57e-27ac-445f-9e0f-8ddfbaec2233 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:6b:92,bridge_name='br-int',has_traffic_filtering=True,id=2d12f254-7874-4622-a7cb-8180de961bd1,network=Network(0b64448d-5ece-4814-9bdc-de0167e921f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d12f254-78') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 18:48:03 user nova-compute[75216]: DEBUG nova.objects.instance [None req-20fbc57e-27ac-445f-9e0f-8ddfbaec2233 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] Lazy-loading 'pci_devices' on Instance uuid 64dfe522-8b46-4df4-8032-591ce56900ec {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 18:48:03 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f530e526-b4b9-405c-8bde-111e34095cc4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:48:03 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[07898984-a578-4f60-ac1b-77554a4eef42]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:f530e526-b4b9-405c-8bde-111e34095cc4, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:f530e526-b4b9-405c-8bde-111e34095cc4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:48:03 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-416f74d9-dd6a-482b-ac44-20aea900630f tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:f530e526-b4b9-405c-8bde-111e34095cc4, portal: 172.16.0.220,3260]
Nov 13 18:48:03 user nova-compute[75216]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:f530e526-b4b9-405c-8bde-111e34095cc4, portal: 172.16.0.220,3260] successful.
Nov 13 18:48:03 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:48:03 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f530e526-b4b9-405c-8bde-111e34095cc4 -p 172.16.0.220:3260 --op delete {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:48:03 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-20fbc57e-27ac-445f-9e0f-8ddfbaec2233 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] [instance: 64dfe522-8b46-4df4-8032-591ce56900ec] End _get_guest_xml xml=<domain type="kvm">
Nov 13 18:48:03 user nova-compute[75216]:   <uuid>64dfe522-8b46-4df4-8032-591ce56900ec</uuid>
Nov 13 18:48:03 user nova-compute[75216]:   <name>instance-0000000d</name>
Nov 13 18:48:03 user nova-compute[75216]:   <memory>524288</memory>
Nov 13 18:48:03 user nova-compute[75216]:   <vcpu>1</vcpu>
Nov 13 18:48:03 user nova-compute[75216]:   <metadata>
Nov 13 18:48:03 user nova-compute[75216]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 18:48:03 user nova-compute[75216]:       <nova:package version="0.0.0"/>
Nov 13 18:48:03 user nova-compute[75216]:       <nova:name>tempest-device-tagging-server-904595823</nova:name>
Nov 13 18:48:03 user nova-compute[75216]:       <nova:creationTime>2023-11-13 18:48:03</nova:creationTime>
Nov 13 18:48:03 user nova-compute[75216]:       <nova:flavor name="m1.tiny">
Nov 13 18:48:03 user nova-compute[75216]:         <nova:memory>512</nova:memory>
Nov 13 18:48:03 user nova-compute[75216]:         <nova:disk>1</nova:disk>
Nov 13 18:48:03 user nova-compute[75216]:         <nova:swap>0</nova:swap>
Nov 13 18:48:03 user nova-compute[75216]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 18:48:03 user nova-compute[75216]:         <nova:vcpus>1</nova:vcpus>
Nov 13 18:48:03 user nova-compute[75216]:       </nova:flavor>
Nov 13 18:48:03 user nova-compute[75216]:       <nova:owner>
Nov 13 18:48:03 user nova-compute[75216]:         <nova:user uuid="454caf80dd76487baead7c52f05df1a5">tempest-TaggedAttachmentsTest-507898025-project-member</nova:user>
Nov 13 18:48:03 user nova-compute[75216]:         <nova:project uuid="0ec18dd2e6ea476dbf3745d14a866190">tempest-TaggedAttachmentsTest-507898025</nova:project>
Nov 13 18:48:03 user nova-compute[75216]:       </nova:owner>
Nov 13 18:48:03 user nova-compute[75216]:       <nova:root type="image" uuid="77bcb5ba-8510-41ec-a88d-96097bb431de"/>
Nov 13 18:48:03 user nova-compute[75216]:       <nova:ports>
Nov 13 18:48:03 user nova-compute[75216]:         <nova:port uuid="2d12f254-7874-4622-a7cb-8180de961bd1">
Nov 13 18:48:03 user nova-compute[75216]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 13 18:48:03 user nova-compute[75216]:         </nova:port>
Nov 13 18:48:03 user nova-compute[75216]:       </nova:ports>
Nov 13 18:48:03 user nova-compute[75216]:     </nova:instance>
Nov 13 18:48:03 user nova-compute[75216]:   </metadata>
Nov 13 18:48:03 user nova-compute[75216]:   <sysinfo type="smbios">
Nov 13 18:48:03 user nova-compute[75216]:     <system>
Nov 13 18:48:03 user nova-compute[75216]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 18:48:03 user nova-compute[75216]:       <entry name="product">OpenStack Nova</entry>
Nov 13 18:48:03 user nova-compute[75216]:       <entry name="version">0.0.0</entry>
Nov 13 18:48:03 user nova-compute[75216]:       <entry name="serial">64dfe522-8b46-4df4-8032-591ce56900ec</entry>
Nov 13 18:48:03 user nova-compute[75216]:       <entry name="uuid">64dfe522-8b46-4df4-8032-591ce56900ec</entry>
Nov 13 18:48:03 user nova-compute[75216]:       <entry name="family">Virtual Machine</entry>
Nov 13 18:48:03 user nova-compute[75216]:     </system>
Nov 13 18:48:03 user nova-compute[75216]:   </sysinfo>
Nov 13 18:48:03 user nova-compute[75216]:   <os>
Nov 13 18:48:03 user nova-compute[75216]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 18:48:03 user nova-compute[75216]:     <boot dev="hd"/>
Nov 13 18:48:03 user nova-compute[75216]:     <smbios mode="sysinfo"/>
Nov 13 18:48:03 user nova-compute[75216]:   </os>
Nov 13 18:48:03 user nova-compute[75216]:   <features>
Nov 13 18:48:03 user nova-compute[75216]:     <acpi/>
Nov 13 18:48:03 user nova-compute[75216]:     <apic/>
Nov 13 18:48:03 user nova-compute[75216]:     <vmcoreinfo/>
Nov 13 18:48:03 user nova-compute[75216]:   </features>
Nov 13 18:48:03 user nova-compute[75216]:   <clock offset="utc">
Nov 13 18:48:03 user nova-compute[75216]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 18:48:03 user nova-compute[75216]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 18:48:03 user nova-compute[75216]:     <timer name="hpet" present="no"/>
Nov 13 18:48:03 user nova-compute[75216]:   </clock>
Nov 13 18:48:03 user nova-compute[75216]:   <cpu mode="custom" match="exact">
Nov 13 18:48:03 user nova-compute[75216]:     <model>Nehalem</model>
Nov 13 18:48:03 user nova-compute[75216]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 18:48:03 user nova-compute[75216]:   </cpu>
Nov 13 18:48:03 user nova-compute[75216]:   <devices>
Nov 13 18:48:03 user nova-compute[75216]:     <disk type="file" device="disk">
Nov 13 18:48:03 user nova-compute[75216]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 18:48:03 user nova-compute[75216]:       <source file="/opt/stack/data/nova/instances/64dfe522-8b46-4df4-8032-591ce56900ec/disk"/>
Nov 13 18:48:03 user nova-compute[75216]:       <target dev="vda" bus="virtio"/>
Nov 13 18:48:03 user nova-compute[75216]:     </disk>
Nov 13 18:48:03 user nova-compute[75216]:     <disk type="file" device="cdrom">
Nov 13 18:48:03 user nova-compute[75216]:       <driver name="qemu" type="raw" cache="none"/>
Nov 13 18:48:03 user nova-compute[75216]:       <source file="/opt/stack/data/nova/instances/64dfe522-8b46-4df4-8032-591ce56900ec/disk.config"/>
Nov 13 18:48:03 user nova-compute[75216]:       <target dev="hda" bus="ide"/>
Nov 13 18:48:03 user nova-compute[75216]:     </disk>
Nov 13 18:48:03 user nova-compute[75216]:     <interface type="ethernet">
Nov 13 18:48:03 user nova-compute[75216]:       <mac address="fa:16:3e:a1:6b:92"/>
Nov 13 18:48:03 user nova-compute[75216]:       <model type="virtio"/>
Nov 13 18:48:03 user nova-compute[75216]:       <mtu size="1442"/>
Nov 13 18:48:03 user nova-compute[75216]:       <target dev="tap2d12f254-78"/>
Nov 13 18:48:03 user nova-compute[75216]:     </interface>
Nov 13 18:48:03 user nova-compute[75216]:     <serial type="pty">
Nov 13 18:48:03 user nova-compute[75216]:       <log file="/opt/stack/data/nova/instances/64dfe522-8b46-4df4-8032-591ce56900ec/console.log" append="off"/>
Nov 13 18:48:03 user nova-compute[75216]:     </serial>
Nov 13 18:48:03 user nova-compute[75216]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 18:48:03 user nova-compute[75216]:     <video>
Nov 13 18:48:03 user nova-compute[75216]:       <model type="virtio"/>
Nov 13 18:48:03 user nova-compute[75216]:     </video>
Nov 13 18:48:03 user nova-compute[75216]:     <rng model="virtio">
Nov 13 18:48:03 user nova-compute[75216]:       <backend model="random">/dev/urandom</backend>
Nov 13 18:48:03 user nova-compute[75216]:     </rng>
Nov 13 18:48:03 user nova-compute[75216]:     <controller type="usb" index="0" model="none"/>
Nov 13 18:48:03 user nova-compute[75216]:     <memballoon model="virtio">
Nov 13 18:48:03 user nova-compute[75216]:       <stats period="10"/>
Nov 13 18:48:03 user nova-compute[75216]:     </memballoon>
Nov 13 18:48:03 user nova-compute[75216]:   </devices>
Nov 13 18:48:03 user nova-compute[75216]: </domain>
Nov 13 18:48:03 user nova-compute[75216]:  {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 18:48:03 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-20fbc57e-27ac-445f-9e0f-8ddfbaec2233 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T18:48:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-904595823',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-904595823',id=13,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAnoGBZDueYOh3xcWER1AMv30DIYxQxeWRDS2fRFXh6l4DZc8pD4qIgg0IjDLbUZuBfE7+vn5QgzB7ChiJAa+d1ltHilcpx/dg8eDxHVfO8o++kjL7IH7NIL3RYQDYV6Ew==',key_name='tempest-keypair-1295383460',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0ec18dd2e6ea476dbf3745d14a866190',ramdisk_id='',reservation_id='r-0a499j0h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-507898025',owner_user_name='tempest-TaggedAttachmentsTest-507898025-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T18:48:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='454caf80dd76487baead7c52f05df1a5',uuid=64dfe522-8b46-4df4-8032-591ce56900ec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2d12f254-7874-4622-a7cb-8180de961bd1", "address": "fa:16:3e:a1:6b:92", "network": {"id": "0b64448d-5ece-4814-9bdc-de0167e921f9", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-67835474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ec18dd2e6ea476dbf3745d14a866190", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d12f254-78", "ovs_interfaceid": "2d12f254-7874-4622-a7cb-8180de961bd1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 18:48:03 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-20fbc57e-27ac-445f-9e0f-8ddfbaec2233 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] Converting VIF {"id": "2d12f254-7874-4622-a7cb-8180de961bd1", "address": "fa:16:3e:a1:6b:92", "network": {"id": "0b64448d-5ece-4814-9bdc-de0167e921f9", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-67835474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ec18dd2e6ea476dbf3745d14a866190", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d12f254-78", "ovs_interfaceid": "2d12f254-7874-4622-a7cb-8180de961bd1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 18:48:03 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-20fbc57e-27ac-445f-9e0f-8ddfbaec2233 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:6b:92,bridge_name='br-int',has_traffic_filtering=True,id=2d12f254-7874-4622-a7cb-8180de961bd1,network=Network(0b64448d-5ece-4814-9bdc-de0167e921f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d12f254-78') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 18:48:03 user nova-compute[75216]: DEBUG os_vif [None req-20fbc57e-27ac-445f-9e0f-8ddfbaec2233 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:6b:92,bridge_name='br-int',has_traffic_filtering=True,id=2d12f254-7874-4622-a7cb-8180de961bd1,network=Network(0b64448d-5ece-4814-9bdc-de0167e921f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d12f254-78') {{(pid=75216) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 18:48:03 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:48:03 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:48:03 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 18:48:03 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:48:03 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9886cd57-6ab3-50b4-8373-a487f43ec9ca', '_type': 'linux-noop'}}, row=False) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:48:03 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:48:03 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:48:03 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:48:03 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2d12f254-78, may_exist=True, interface_attrs={}) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:48:03 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2d12f254-78, col_values=(('qos', UUID('6199eed4-5e88-44f5-9a47-ef8a95e33420')),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:48:03 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2d12f254-78, col_values=(('external_ids', {'iface-id': '2d12f254-7874-4622-a7cb-8180de961bd1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a1:6b:92', 'vm-uuid': '64dfe522-8b46-4df4-8032-591ce56900ec'}),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:48:03 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:48:03 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f530e526-b4b9-405c-8bde-111e34095cc4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:48:03 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[35736c68-eea7-4373-bb29-51c2f725df1d]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:48:03 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-416f74d9-dd6a-482b-ac44-20aea900630f tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:48:03 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-416f74d9-dd6a-482b-ac44-20aea900630f tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.322s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 18:48:03 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-416f74d9-dd6a-482b-ac44-20aea900630f tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] <== disconnect_volume: return (324ms) None {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 18:48:03 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-416f74d9-dd6a-482b-ac44-20aea900630f tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] [instance: 872856e5-cdc4-444e-8835-55e36708d776] Disconnected iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 18:48:03 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:48:03 user nova-compute[75216]: INFO os_vif [None req-20fbc57e-27ac-445f-9e0f-8ddfbaec2233 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:6b:92,bridge_name='br-int',has_traffic_filtering=True,id=2d12f254-7874-4622-a7cb-8180de961bd1,network=Network(0b64448d-5ece-4814-9bdc-de0167e921f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d12f254-78')
Nov 13 18:48:03 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-20fbc57e-27ac-445f-9e0f-8ddfbaec2233 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 18:48:03 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-20fbc57e-27ac-445f-9e0f-8ddfbaec2233 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] No BDM found with device name hda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 18:48:03 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-20fbc57e-27ac-445f-9e0f-8ddfbaec2233 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] No VIF found with MAC fa:16:3e:a1:6b:92, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 18:48:03 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-20fbc57e-27ac-445f-9e0f-8ddfbaec2233 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] [instance: 64dfe522-8b46-4df4-8032-591ce56900ec] Using config drive
Nov 13 18:48:03 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-20fbc57e-27ac-445f-9e0f-8ddfbaec2233 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] [instance: 64dfe522-8b46-4df4-8032-591ce56900ec] Creating config drive at /opt/stack/data/nova/instances/64dfe522-8b46-4df4-8032-591ce56900ec/disk.config
Nov 13 18:48:03 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-20fbc57e-27ac-445f-9e0f-8ddfbaec2233 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/64dfe522-8b46-4df4-8032-591ce56900ec/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpoz96oyw2 {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:48:03 user nova-compute[75216]: DEBUG nova.network.neutron [req-96581c7e-07a0-4947-955b-04a90706efd4 req-5b1e9e4b-5aaa-46a9-9229-264ea04bfae3 service nova] [instance: 64dfe522-8b46-4df4-8032-591ce56900ec] Updated VIF entry in instance network info cache for port 2d12f254-7874-4622-a7cb-8180de961bd1. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 18:48:03 user nova-compute[75216]: DEBUG nova.network.neutron [req-96581c7e-07a0-4947-955b-04a90706efd4 req-5b1e9e4b-5aaa-46a9-9229-264ea04bfae3 service nova] [instance: 64dfe522-8b46-4df4-8032-591ce56900ec] Updating instance_info_cache with network_info: [{"id": "2d12f254-7874-4622-a7cb-8180de961bd1", "address": "fa:16:3e:a1:6b:92", "network": {"id": "0b64448d-5ece-4814-9bdc-de0167e921f9", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-67835474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ec18dd2e6ea476dbf3745d14a866190", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d12f254-78", "ovs_interfaceid": "2d12f254-7874-4622-a7cb-8180de961bd1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 18:48:03 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-20fbc57e-27ac-445f-9e0f-8ddfbaec2233 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/64dfe522-8b46-4df4-8032-591ce56900ec/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpoz96oyw2" returned: 0 in 0.113s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:48:03 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-96581c7e-07a0-4947-955b-04a90706efd4 req-5b1e9e4b-5aaa-46a9-9229-264ea04bfae3 service nova] Releasing lock "refresh_cache-64dfe522-8b46-4df4-8032-591ce56900ec" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 18:48:04 user nova-compute[75216]: DEBUG nova.objects.instance [None req-416f74d9-dd6a-482b-ac44-20aea900630f tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] Lazy-loading 'flavor' on Instance uuid 872856e5-cdc4-444e-8835-55e36708d776 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 18:48:04 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-416f74d9-dd6a-482b-ac44-20aea900630f tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] Lock "872856e5-cdc4-444e-8835-55e36708d776" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.677s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:48:04 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-b401585d-91f4-4daa-8c3a-989f01a3796b tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] Acquiring lock "ed251b5e-5f1d-404c-a09b-156e5ed72e82" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:48:04 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-b401585d-91f4-4daa-8c3a-989f01a3796b tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] Lock "ed251b5e-5f1d-404c-a09b-156e5ed72e82" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:48:04 user nova-compute[75216]: DEBUG nova.compute.manager [None req-b401585d-91f4-4daa-8c3a-989f01a3796b tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] [instance: ed251b5e-5f1d-404c-a09b-156e5ed72e82] Starting instance... {{(pid=75216) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 18:48:04 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-b401585d-91f4-4daa-8c3a-989f01a3796b tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:48:04 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-b401585d-91f4-4daa-8c3a-989f01a3796b tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:48:04 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-b401585d-91f4-4daa-8c3a-989f01a3796b tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75216) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 18:48:04 user nova-compute[75216]: INFO nova.compute.claims [None req-b401585d-91f4-4daa-8c3a-989f01a3796b tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] [instance: ed251b5e-5f1d-404c-a09b-156e5ed72e82] Claim successful on node user
Nov 13 18:48:05 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-b401585d-91f4-4daa-8c3a-989f01a3796b tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 18:48:05 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-b401585d-91f4-4daa-8c3a-989f01a3796b tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 18:48:05 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-b401585d-91f4-4daa-8c3a-989f01a3796b tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.552s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:48:05 user nova-compute[75216]: DEBUG nova.compute.manager [None req-b401585d-91f4-4daa-8c3a-989f01a3796b tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] [instance: ed251b5e-5f1d-404c-a09b-156e5ed72e82] Start building networks asynchronously for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 18:48:05 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:48:05 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:48:05 user nova-compute[75216]: DEBUG nova.compute.manager [None req-b401585d-91f4-4daa-8c3a-989f01a3796b tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] [instance: ed251b5e-5f1d-404c-a09b-156e5ed72e82] Allocating IP information in the background. {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 18:48:05 user nova-compute[75216]: DEBUG nova.network.neutron [None req-b401585d-91f4-4daa-8c3a-989f01a3796b tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] [instance: ed251b5e-5f1d-404c-a09b-156e5ed72e82] allocate_for_instance() {{(pid=75216) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 18:48:05 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-b401585d-91f4-4daa-8c3a-989f01a3796b tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] [instance: ed251b5e-5f1d-404c-a09b-156e5ed72e82] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 18:48:05 user nova-compute[75216]: DEBUG nova.compute.manager [None req-b401585d-91f4-4daa-8c3a-989f01a3796b tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] [instance: ed251b5e-5f1d-404c-a09b-156e5ed72e82] Start building block device mappings for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 18:48:05 user nova-compute[75216]: DEBUG nova.policy [None req-b401585d-91f4-4daa-8c3a-989f01a3796b tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9328187f980b430f9f65420eec9f8c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d63d01c37774af48f4d3e49901802f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75216) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 18:48:05 user nova-compute[75216]: DEBUG nova.compute.manager [None req-b401585d-91f4-4daa-8c3a-989f01a3796b tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] [instance: ed251b5e-5f1d-404c-a09b-156e5ed72e82] Start spawning the instance on the hypervisor. {{(pid=75216) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 18:48:05 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-b401585d-91f4-4daa-8c3a-989f01a3796b tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] [instance: ed251b5e-5f1d-404c-a09b-156e5ed72e82] Creating instance directory {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 18:48:05 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-b401585d-91f4-4daa-8c3a-989f01a3796b tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] [instance: ed251b5e-5f1d-404c-a09b-156e5ed72e82] Creating image(s)
Nov 13 18:48:05 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-b401585d-91f4-4daa-8c3a-989f01a3796b tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] Acquiring lock "/opt/stack/data/nova/instances/ed251b5e-5f1d-404c-a09b-156e5ed72e82/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:48:05 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-b401585d-91f4-4daa-8c3a-989f01a3796b tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] Lock "/opt/stack/data/nova/instances/ed251b5e-5f1d-404c-a09b-156e5ed72e82/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:48:05 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-b401585d-91f4-4daa-8c3a-989f01a3796b tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] Lock "/opt/stack/data/nova/instances/ed251b5e-5f1d-404c-a09b-156e5ed72e82/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:48:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-b401585d-91f4-4daa-8c3a-989f01a3796b tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:48:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-b401585d-91f4-4daa-8c3a-989f01a3796b tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json" returned: 0 in 0.207s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:48:05 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-b401585d-91f4-4daa-8c3a-989f01a3796b tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] Acquiring lock "88c50a45bec9d6b0427462b3242b9b8e5f49c2b6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:48:05 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-b401585d-91f4-4daa-8c3a-989f01a3796b tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] Lock "88c50a45bec9d6b0427462b3242b9b8e5f49c2b6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:48:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-b401585d-91f4-4daa-8c3a-989f01a3796b tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:48:05 user nova-compute[75216]: DEBUG nova.compute.manager [req-393c66ba-0be7-49ce-ad9a-38931700cc9f req-f2b6d06d-b16d-40dd-a7cc-d7c623820ac3 service nova] [instance: 64dfe522-8b46-4df4-8032-591ce56900ec] Received event network-vif-plugged-2d12f254-7874-4622-a7cb-8180de961bd1 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:48:05 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-393c66ba-0be7-49ce-ad9a-38931700cc9f req-f2b6d06d-b16d-40dd-a7cc-d7c623820ac3 service nova] Acquiring lock "64dfe522-8b46-4df4-8032-591ce56900ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:48:05 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-393c66ba-0be7-49ce-ad9a-38931700cc9f req-f2b6d06d-b16d-40dd-a7cc-d7c623820ac3 service nova] Lock "64dfe522-8b46-4df4-8032-591ce56900ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:48:05 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-393c66ba-0be7-49ce-ad9a-38931700cc9f req-f2b6d06d-b16d-40dd-a7cc-d7c623820ac3 service nova] Lock "64dfe522-8b46-4df4-8032-591ce56900ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:48:05 user nova-compute[75216]: DEBUG nova.compute.manager [req-393c66ba-0be7-49ce-ad9a-38931700cc9f req-f2b6d06d-b16d-40dd-a7cc-d7c623820ac3 service nova] [instance: 64dfe522-8b46-4df4-8032-591ce56900ec] No waiting events found dispatching network-vif-plugged-2d12f254-7874-4622-a7cb-8180de961bd1 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:48:05 user nova-compute[75216]: WARNING nova.compute.manager [req-393c66ba-0be7-49ce-ad9a-38931700cc9f req-f2b6d06d-b16d-40dd-a7cc-d7c623820ac3 service nova] [instance: 64dfe522-8b46-4df4-8032-591ce56900ec] Received unexpected event network-vif-plugged-2d12f254-7874-4622-a7cb-8180de961bd1 for instance with vm_state building and task_state spawning.
Nov 13 18:48:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-b401585d-91f4-4daa-8c3a-989f01a3796b tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json" returned: 0 in 0.171s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:48:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-b401585d-91f4-4daa-8c3a-989f01a3796b tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6,backing_fmt=raw /opt/stack/data/nova/instances/ed251b5e-5f1d-404c-a09b-156e5ed72e82/disk 1073741824 {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:48:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-b401585d-91f4-4daa-8c3a-989f01a3796b tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6,backing_fmt=raw /opt/stack/data/nova/instances/ed251b5e-5f1d-404c-a09b-156e5ed72e82/disk 1073741824" returned: 0 in 0.056s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:48:05 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-b401585d-91f4-4daa-8c3a-989f01a3796b tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] Lock "88c50a45bec9d6b0427462b3242b9b8e5f49c2b6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.232s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:48:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-b401585d-91f4-4daa-8c3a-989f01a3796b tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:48:05 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:48:05 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:48:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-b401585d-91f4-4daa-8c3a-989f01a3796b tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json" returned: 0 in 0.176s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:48:06 user nova-compute[75216]: DEBUG nova.virt.disk.api [None req-b401585d-91f4-4daa-8c3a-989f01a3796b tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ed251b5e-5f1d-404c-a09b-156e5ed72e82/disk. size=1073741824 {{(pid=75216) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 18:48:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-b401585d-91f4-4daa-8c3a-989f01a3796b tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed251b5e-5f1d-404c-a09b-156e5ed72e82/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:48:06 user nova-compute[75216]: DEBUG nova.network.neutron [None req-b401585d-91f4-4daa-8c3a-989f01a3796b tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] [instance: ed251b5e-5f1d-404c-a09b-156e5ed72e82] Successfully created port: d35d00b9-b4f6-4a81-8112-706ac49f4a21 {{(pid=75216) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 18:48:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-b401585d-91f4-4daa-8c3a-989f01a3796b tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed251b5e-5f1d-404c-a09b-156e5ed72e82/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:48:06 user nova-compute[75216]: DEBUG nova.virt.disk.api [None req-b401585d-91f4-4daa-8c3a-989f01a3796b tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] Cannot resize image /opt/stack/data/nova/instances/ed251b5e-5f1d-404c-a09b-156e5ed72e82/disk to a smaller size. {{(pid=75216) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 18:48:06 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-b401585d-91f4-4daa-8c3a-989f01a3796b tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] [instance: ed251b5e-5f1d-404c-a09b-156e5ed72e82] Created local disks {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 18:48:06 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-b401585d-91f4-4daa-8c3a-989f01a3796b tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] [instance: ed251b5e-5f1d-404c-a09b-156e5ed72e82] Ensure instance console log exists: /opt/stack/data/nova/instances/ed251b5e-5f1d-404c-a09b-156e5ed72e82/console.log {{(pid=75216) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 18:48:06 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-b401585d-91f4-4daa-8c3a-989f01a3796b tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:48:06 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-b401585d-91f4-4daa-8c3a-989f01a3796b tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:48:06 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-b401585d-91f4-4daa-8c3a-989f01a3796b tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:48:06 user nova-compute[75216]: DEBUG nova.network.neutron [None req-b401585d-91f4-4daa-8c3a-989f01a3796b tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] [instance: ed251b5e-5f1d-404c-a09b-156e5ed72e82] Successfully updated port: d35d00b9-b4f6-4a81-8112-706ac49f4a21 {{(pid=75216) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 18:48:06 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-b401585d-91f4-4daa-8c3a-989f01a3796b tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] Acquiring lock "refresh_cache-ed251b5e-5f1d-404c-a09b-156e5ed72e82" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 18:48:06 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-b401585d-91f4-4daa-8c3a-989f01a3796b tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] Acquired lock "refresh_cache-ed251b5e-5f1d-404c-a09b-156e5ed72e82" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 18:48:06 user nova-compute[75216]: DEBUG nova.network.neutron [None req-b401585d-91f4-4daa-8c3a-989f01a3796b tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] [instance: ed251b5e-5f1d-404c-a09b-156e5ed72e82] Building network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 18:48:06 user nova-compute[75216]: DEBUG nova.compute.manager [req-32904d7c-b22e-4e26-89ee-48e75b936a69 req-6fc24c40-490f-425e-b359-9a20a76622fc service nova] [instance: ed251b5e-5f1d-404c-a09b-156e5ed72e82] Received event network-changed-d35d00b9-b4f6-4a81-8112-706ac49f4a21 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:48:06 user nova-compute[75216]: DEBUG nova.compute.manager [req-32904d7c-b22e-4e26-89ee-48e75b936a69 req-6fc24c40-490f-425e-b359-9a20a76622fc service nova] [instance: ed251b5e-5f1d-404c-a09b-156e5ed72e82] Refreshing instance network info cache due to event network-changed-d35d00b9-b4f6-4a81-8112-706ac49f4a21. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 18:48:06 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-32904d7c-b22e-4e26-89ee-48e75b936a69 req-6fc24c40-490f-425e-b359-9a20a76622fc service nova] Acquiring lock "refresh_cache-ed251b5e-5f1d-404c-a09b-156e5ed72e82" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 18:48:06 user nova-compute[75216]: DEBUG nova.network.neutron [None req-b401585d-91f4-4daa-8c3a-989f01a3796b tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] [instance: ed251b5e-5f1d-404c-a09b-156e5ed72e82] Instance cache missing network info. {{(pid=75216) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 18:48:07 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c2c44f23-e74c-49a0-954c-ff7d7f2ab2c2 tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] Acquiring lock "a3bcf65e-bd5b-4350-a222-5f4522418a67" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:48:07 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c2c44f23-e74c-49a0-954c-ff7d7f2ab2c2 tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] Lock "a3bcf65e-bd5b-4350-a222-5f4522418a67" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:48:07 user nova-compute[75216]: INFO nova.compute.manager [None req-c2c44f23-e74c-49a0-954c-ff7d7f2ab2c2 tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] [instance: a3bcf65e-bd5b-4350-a222-5f4522418a67] Shelve offloading
Nov 13 18:48:07 user nova-compute[75216]: DEBUG nova.network.neutron [None req-b401585d-91f4-4daa-8c3a-989f01a3796b tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] [instance: ed251b5e-5f1d-404c-a09b-156e5ed72e82] Updating instance_info_cache with network_info: [{"id": "d35d00b9-b4f6-4a81-8112-706ac49f4a21", "address": "fa:16:3e:3a:d0:50", "network": {"id": "3e05e26f-bb3f-48d7-a8cf-8974b02b1745", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-600263470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d63d01c37774af48f4d3e49901802f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd35d00b9-b4", "ovs_interfaceid": "d35d00b9-b4f6-4a81-8112-706ac49f4a21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 18:48:07 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-b401585d-91f4-4daa-8c3a-989f01a3796b tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] Releasing lock "refresh_cache-ed251b5e-5f1d-404c-a09b-156e5ed72e82" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 18:48:07 user nova-compute[75216]: DEBUG nova.compute.manager [None req-b401585d-91f4-4daa-8c3a-989f01a3796b tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] [instance: ed251b5e-5f1d-404c-a09b-156e5ed72e82] Instance network_info: |[{"id": "d35d00b9-b4f6-4a81-8112-706ac49f4a21", "address": "fa:16:3e:3a:d0:50", "network": {"id": "3e05e26f-bb3f-48d7-a8cf-8974b02b1745", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-600263470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d63d01c37774af48f4d3e49901802f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd35d00b9-b4", "ovs_interfaceid": "d35d00b9-b4f6-4a81-8112-706ac49f4a21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 18:48:07 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-32904d7c-b22e-4e26-89ee-48e75b936a69 req-6fc24c40-490f-425e-b359-9a20a76622fc service nova] Acquired lock "refresh_cache-ed251b5e-5f1d-404c-a09b-156e5ed72e82" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 18:48:07 user nova-compute[75216]: DEBUG nova.network.neutron [req-32904d7c-b22e-4e26-89ee-48e75b936a69 req-6fc24c40-490f-425e-b359-9a20a76622fc service nova] [instance: ed251b5e-5f1d-404c-a09b-156e5ed72e82] Refreshing network info cache for port d35d00b9-b4f6-4a81-8112-706ac49f4a21 {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 18:48:07 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-b401585d-91f4-4daa-8c3a-989f01a3796b tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] [instance: ed251b5e-5f1d-404c-a09b-156e5ed72e82] Start _get_guest_xml network_info=[{"id": "d35d00b9-b4f6-4a81-8112-706ac49f4a21", "address": "fa:16:3e:3a:d0:50", "network": {"id": "3e05e26f-bb3f-48d7-a8cf-8974b02b1745", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-600263470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d63d01c37774af48f4d3e49901802f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd35d00b9-b4", "ovs_interfaceid": "d35d00b9-b4f6-4a81-8112-706ac49f4a21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T18:41:06Z,direct_url=<?>,disk_format='qcow2',id=77bcb5ba-8510-41ec-a88d-96097bb431de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c465b7c26ec44582b6d1b7169536ecc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T18:41:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'guest_format': None, 'boot_index': 0, 'image_id': '77bcb5ba-8510-41ec-a88d-96097bb431de'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 18:48:07 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:48:07 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-b401585d-91f4-4daa-8c3a-989f01a3796b tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 18:48:07 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-b401585d-91f4-4daa-8c3a-989f01a3796b tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 18:48:07 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-b401585d-91f4-4daa-8c3a-989f01a3796b tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 18:48:07 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-b401585d-91f4-4daa-8c3a-989f01a3796b tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] CPU controller missing on host. {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 18:48:07 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-b401585d-91f4-4daa-8c3a-989f01a3796b tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 18:48:07 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-b401585d-91f4-4daa-8c3a-989f01a3796b tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] CPU controller found on host. {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 18:48:07 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-b401585d-91f4-4daa-8c3a-989f01a3796b tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75216) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 18:48:07 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-b401585d-91f4-4daa-8c3a-989f01a3796b tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T18:40:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T18:41:06Z,direct_url=<?>,disk_format='qcow2',id=77bcb5ba-8510-41ec-a88d-96097bb431de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c465b7c26ec44582b6d1b7169536ecc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T18:41:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 18:48:07 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-b401585d-91f4-4daa-8c3a-989f01a3796b tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] Flavor limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 18:48:07 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-b401585d-91f4-4daa-8c3a-989f01a3796b tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] Image limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 18:48:07 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-b401585d-91f4-4daa-8c3a-989f01a3796b tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] Flavor pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 18:48:07 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-b401585d-91f4-4daa-8c3a-989f01a3796b tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] Image pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 18:48:07 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-b401585d-91f4-4daa-8c3a-989f01a3796b tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 18:48:07 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-b401585d-91f4-4daa-8c3a-989f01a3796b tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 18:48:07 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-b401585d-91f4-4daa-8c3a-989f01a3796b tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 18:48:07 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-b401585d-91f4-4daa-8c3a-989f01a3796b tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] Got 1 possible topologies {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 18:48:07 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-b401585d-91f4-4daa-8c3a-989f01a3796b tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 18:48:07 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-b401585d-91f4-4daa-8c3a-989f01a3796b tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 18:48:07 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-b401585d-91f4-4daa-8c3a-989f01a3796b tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T18:48:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-627121455',display_name='tempest-VolumesAdminNegativeTest-server-627121455',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-627121455',id=14,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7d63d01c37774af48f4d3e49901802f9',ramdisk_id='',reservation_id='r-cfmxt4o0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-999712097',owner_user_name='tempest-VolumesAdminNegativeTest-999712097-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T18:48:05Z,user_data=None,user_id='9328187f980b430f9f65420eec9f8c98',uuid=ed251b5e-5f1d-404c-a09b-156e5ed72e82,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d35d00b9-b4f6-4a81-8112-706ac49f4a21", "address": "fa:16:3e:3a:d0:50", "network": {"id": "3e05e26f-bb3f-48d7-a8cf-8974b02b1745", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-600263470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d63d01c37774af48f4d3e49901802f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd35d00b9-b4", "ovs_interfaceid": "d35d00b9-b4f6-4a81-8112-706ac49f4a21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75216) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 18:48:07 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-b401585d-91f4-4daa-8c3a-989f01a3796b tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] Converting VIF {"id": "d35d00b9-b4f6-4a81-8112-706ac49f4a21", "address": "fa:16:3e:3a:d0:50", "network": {"id": "3e05e26f-bb3f-48d7-a8cf-8974b02b1745", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-600263470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d63d01c37774af48f4d3e49901802f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd35d00b9-b4", "ovs_interfaceid": "d35d00b9-b4f6-4a81-8112-706ac49f4a21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 18:48:07 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-b401585d-91f4-4daa-8c3a-989f01a3796b tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:d0:50,bridge_name='br-int',has_traffic_filtering=True,id=d35d00b9-b4f6-4a81-8112-706ac49f4a21,network=Network(3e05e26f-bb3f-48d7-a8cf-8974b02b1745),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd35d00b9-b4') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 18:48:07 user nova-compute[75216]: DEBUG nova.objects.instance [None req-b401585d-91f4-4daa-8c3a-989f01a3796b tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] Lazy-loading 'pci_devices' on Instance uuid ed251b5e-5f1d-404c-a09b-156e5ed72e82 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 18:48:07 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:48:07 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-b401585d-91f4-4daa-8c3a-989f01a3796b tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] [instance: ed251b5e-5f1d-404c-a09b-156e5ed72e82] End _get_guest_xml xml=<domain type="kvm">
Nov 13 18:48:07 user nova-compute[75216]:   <uuid>ed251b5e-5f1d-404c-a09b-156e5ed72e82</uuid>
Nov 13 18:48:07 user nova-compute[75216]:   <name>instance-0000000e</name>
Nov 13 18:48:07 user nova-compute[75216]:   <memory>524288</memory>
Nov 13 18:48:07 user nova-compute[75216]:   <vcpu>1</vcpu>
Nov 13 18:48:07 user nova-compute[75216]:   <metadata>
Nov 13 18:48:07 user nova-compute[75216]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 18:48:07 user nova-compute[75216]:       <nova:package version="0.0.0"/>
Nov 13 18:48:07 user nova-compute[75216]:       <nova:name>tempest-VolumesAdminNegativeTest-server-627121455</nova:name>
Nov 13 18:48:07 user nova-compute[75216]:       <nova:creationTime>2023-11-13 18:48:07</nova:creationTime>
Nov 13 18:48:07 user nova-compute[75216]:       <nova:flavor name="m1.tiny">
Nov 13 18:48:07 user nova-compute[75216]:         <nova:memory>512</nova:memory>
Nov 13 18:48:07 user nova-compute[75216]:         <nova:disk>1</nova:disk>
Nov 13 18:48:07 user nova-compute[75216]:         <nova:swap>0</nova:swap>
Nov 13 18:48:07 user nova-compute[75216]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 18:48:07 user nova-compute[75216]:         <nova:vcpus>1</nova:vcpus>
Nov 13 18:48:07 user nova-compute[75216]:       </nova:flavor>
Nov 13 18:48:07 user nova-compute[75216]:       <nova:owner>
Nov 13 18:48:07 user nova-compute[75216]:         <nova:user uuid="9328187f980b430f9f65420eec9f8c98">tempest-VolumesAdminNegativeTest-999712097-project-member</nova:user>
Nov 13 18:48:07 user nova-compute[75216]:         <nova:project uuid="7d63d01c37774af48f4d3e49901802f9">tempest-VolumesAdminNegativeTest-999712097</nova:project>
Nov 13 18:48:07 user nova-compute[75216]:       </nova:owner>
Nov 13 18:48:07 user nova-compute[75216]:       <nova:root type="image" uuid="77bcb5ba-8510-41ec-a88d-96097bb431de"/>
Nov 13 18:48:07 user nova-compute[75216]:       <nova:ports>
Nov 13 18:48:07 user nova-compute[75216]:         <nova:port uuid="d35d00b9-b4f6-4a81-8112-706ac49f4a21">
Nov 13 18:48:07 user nova-compute[75216]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 13 18:48:07 user nova-compute[75216]:         </nova:port>
Nov 13 18:48:07 user nova-compute[75216]:       </nova:ports>
Nov 13 18:48:07 user nova-compute[75216]:     </nova:instance>
Nov 13 18:48:07 user nova-compute[75216]:   </metadata>
Nov 13 18:48:07 user nova-compute[75216]:   <sysinfo type="smbios">
Nov 13 18:48:07 user nova-compute[75216]:     <system>
Nov 13 18:48:07 user nova-compute[75216]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 18:48:07 user nova-compute[75216]:       <entry name="product">OpenStack Nova</entry>
Nov 13 18:48:07 user nova-compute[75216]:       <entry name="version">0.0.0</entry>
Nov 13 18:48:07 user nova-compute[75216]:       <entry name="serial">ed251b5e-5f1d-404c-a09b-156e5ed72e82</entry>
Nov 13 18:48:07 user nova-compute[75216]:       <entry name="uuid">ed251b5e-5f1d-404c-a09b-156e5ed72e82</entry>
Nov 13 18:48:07 user nova-compute[75216]:       <entry name="family">Virtual Machine</entry>
Nov 13 18:48:07 user nova-compute[75216]:     </system>
Nov 13 18:48:07 user nova-compute[75216]:   </sysinfo>
Nov 13 18:48:07 user nova-compute[75216]:   <os>
Nov 13 18:48:07 user nova-compute[75216]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 18:48:07 user nova-compute[75216]:     <boot dev="hd"/>
Nov 13 18:48:07 user nova-compute[75216]:     <smbios mode="sysinfo"/>
Nov 13 18:48:07 user nova-compute[75216]:   </os>
Nov 13 18:48:07 user nova-compute[75216]:   <features>
Nov 13 18:48:07 user nova-compute[75216]:     <acpi/>
Nov 13 18:48:07 user nova-compute[75216]:     <apic/>
Nov 13 18:48:07 user nova-compute[75216]:     <vmcoreinfo/>
Nov 13 18:48:07 user nova-compute[75216]:   </features>
Nov 13 18:48:07 user nova-compute[75216]:   <clock offset="utc">
Nov 13 18:48:07 user nova-compute[75216]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 18:48:07 user nova-compute[75216]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 18:48:07 user nova-compute[75216]:     <timer name="hpet" present="no"/>
Nov 13 18:48:07 user nova-compute[75216]:   </clock>
Nov 13 18:48:07 user nova-compute[75216]:   <cpu mode="custom" match="exact">
Nov 13 18:48:07 user nova-compute[75216]:     <model>Nehalem</model>
Nov 13 18:48:07 user nova-compute[75216]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 18:48:07 user nova-compute[75216]:   </cpu>
Nov 13 18:48:07 user nova-compute[75216]:   <devices>
Nov 13 18:48:07 user nova-compute[75216]:     <disk type="file" device="disk">
Nov 13 18:48:07 user nova-compute[75216]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 18:48:07 user nova-compute[75216]:       <source file="/opt/stack/data/nova/instances/ed251b5e-5f1d-404c-a09b-156e5ed72e82/disk"/>
Nov 13 18:48:07 user nova-compute[75216]:       <target dev="vda" bus="virtio"/>
Nov 13 18:48:07 user nova-compute[75216]:     </disk>
Nov 13 18:48:07 user nova-compute[75216]:     <interface type="ethernet">
Nov 13 18:48:07 user nova-compute[75216]:       <mac address="fa:16:3e:3a:d0:50"/>
Nov 13 18:48:07 user nova-compute[75216]:       <model type="virtio"/>
Nov 13 18:48:07 user nova-compute[75216]:       <mtu size="1442"/>
Nov 13 18:48:07 user nova-compute[75216]:       <target dev="tapd35d00b9-b4"/>
Nov 13 18:48:07 user nova-compute[75216]:     </interface>
Nov 13 18:48:07 user nova-compute[75216]:     <serial type="pty">
Nov 13 18:48:07 user nova-compute[75216]:       <log file="/opt/stack/data/nova/instances/ed251b5e-5f1d-404c-a09b-156e5ed72e82/console.log" append="off"/>
Nov 13 18:48:07 user nova-compute[75216]:     </serial>
Nov 13 18:48:07 user nova-compute[75216]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 18:48:07 user nova-compute[75216]:     <video>
Nov 13 18:48:07 user nova-compute[75216]:       <model type="virtio"/>
Nov 13 18:48:07 user nova-compute[75216]:     </video>
Nov 13 18:48:07 user nova-compute[75216]:     <rng model="virtio">
Nov 13 18:48:07 user nova-compute[75216]:       <backend model="random">/dev/urandom</backend>
Nov 13 18:48:07 user nova-compute[75216]:     </rng>
Nov 13 18:48:07 user nova-compute[75216]:     <controller type="usb" index="0" model="none"/>
Nov 13 18:48:07 user nova-compute[75216]:     <memballoon model="virtio">
Nov 13 18:48:07 user nova-compute[75216]:       <stats period="10"/>
Nov 13 18:48:07 user nova-compute[75216]:     </memballoon>
Nov 13 18:48:07 user nova-compute[75216]:   </devices>
Nov 13 18:48:07 user nova-compute[75216]: </domain>
Nov 13 18:48:07 user nova-compute[75216]:  {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 18:48:07 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-b401585d-91f4-4daa-8c3a-989f01a3796b tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T18:48:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-627121455',display_name='tempest-VolumesAdminNegativeTest-server-627121455',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-627121455',id=14,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7d63d01c37774af48f4d3e49901802f9',ramdisk_id='',reservation_id='r-cfmxt4o0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-999712097',owner_user_name='tempest-VolumesAdminNegativeTest-999712097-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T18:48:05Z,user_data=None,user_id='9328187f980b430f9f65420eec9f8c98',uuid=ed251b5e-5f1d-404c-a09b-156e5ed72e82,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d35d00b9-b4f6-4a81-8112-706ac49f4a21", "address": "fa:16:3e:3a:d0:50", "network": {"id": "3e05e26f-bb3f-48d7-a8cf-8974b02b1745", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-600263470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d63d01c37774af48f4d3e49901802f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd35d00b9-b4", "ovs_interfaceid": "d35d00b9-b4f6-4a81-8112-706ac49f4a21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 18:48:07 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-b401585d-91f4-4daa-8c3a-989f01a3796b tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] Converting VIF {"id": "d35d00b9-b4f6-4a81-8112-706ac49f4a21", "address": "fa:16:3e:3a:d0:50", "network": {"id": "3e05e26f-bb3f-48d7-a8cf-8974b02b1745", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-600263470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d63d01c37774af48f4d3e49901802f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd35d00b9-b4", "ovs_interfaceid": "d35d00b9-b4f6-4a81-8112-706ac49f4a21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 18:48:07 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-b401585d-91f4-4daa-8c3a-989f01a3796b tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:d0:50,bridge_name='br-int',has_traffic_filtering=True,id=d35d00b9-b4f6-4a81-8112-706ac49f4a21,network=Network(3e05e26f-bb3f-48d7-a8cf-8974b02b1745),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd35d00b9-b4') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 18:48:07 user nova-compute[75216]: DEBUG os_vif [None req-b401585d-91f4-4daa-8c3a-989f01a3796b tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:d0:50,bridge_name='br-int',has_traffic_filtering=True,id=d35d00b9-b4f6-4a81-8112-706ac49f4a21,network=Network(3e05e26f-bb3f-48d7-a8cf-8974b02b1745),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd35d00b9-b4') {{(pid=75216) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 18:48:07 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:48:07 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:48:07 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 18:48:07 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:48:07 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:48:07 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6615476a-2ac5-5b16-9bda-607de8db446a', '_type': 'linux-noop'}}, row=False) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:48:07 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:48:07 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:48:07 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:48:07 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:48:07 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd35d00b9-b4, may_exist=True, interface_attrs={}) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:48:07 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd35d00b9-b4, col_values=(('qos', UUID('bafdb1af-9c72-4ecc-82dc-8be252a4b8a2')),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:48:07 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd35d00b9-b4, col_values=(('external_ids', {'iface-id': 'd35d00b9-b4f6-4a81-8112-706ac49f4a21', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3a:d0:50', 'vm-uuid': 'ed251b5e-5f1d-404c-a09b-156e5ed72e82'}),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:48:07 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:48:07 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:48:07 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:48:07 user nova-compute[75216]: INFO os_vif [None req-b401585d-91f4-4daa-8c3a-989f01a3796b tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:d0:50,bridge_name='br-int',has_traffic_filtering=True,id=d35d00b9-b4f6-4a81-8112-706ac49f4a21,network=Network(3e05e26f-bb3f-48d7-a8cf-8974b02b1745),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd35d00b9-b4')
Nov 13 18:48:07 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-b401585d-91f4-4daa-8c3a-989f01a3796b tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 18:48:07 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-b401585d-91f4-4daa-8c3a-989f01a3796b tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] No VIF found with MAC fa:16:3e:3a:d0:50, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 18:48:07 user nova-compute[75216]: DEBUG nova.compute.manager [req-6d1df204-aba1-4936-b38c-f6d4f55dbcda req-4fc51718-4959-468e-84b2-8e7f6509196e service nova] [instance: a3bcf65e-bd5b-4350-a222-5f4522418a67] Received event network-vif-unplugged-c4ac5376-d559-4365-b2ce-d827fecd2d1a {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:48:07 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-6d1df204-aba1-4936-b38c-f6d4f55dbcda req-4fc51718-4959-468e-84b2-8e7f6509196e service nova] Acquiring lock "a3bcf65e-bd5b-4350-a222-5f4522418a67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:48:07 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-6d1df204-aba1-4936-b38c-f6d4f55dbcda req-4fc51718-4959-468e-84b2-8e7f6509196e service nova] Lock "a3bcf65e-bd5b-4350-a222-5f4522418a67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:48:07 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-6d1df204-aba1-4936-b38c-f6d4f55dbcda req-4fc51718-4959-468e-84b2-8e7f6509196e service nova] Lock "a3bcf65e-bd5b-4350-a222-5f4522418a67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:48:07 user nova-compute[75216]: DEBUG nova.compute.manager [req-6d1df204-aba1-4936-b38c-f6d4f55dbcda req-4fc51718-4959-468e-84b2-8e7f6509196e service nova] [instance: a3bcf65e-bd5b-4350-a222-5f4522418a67] No waiting events found dispatching network-vif-unplugged-c4ac5376-d559-4365-b2ce-d827fecd2d1a {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:48:07 user nova-compute[75216]: WARNING nova.compute.manager [req-6d1df204-aba1-4936-b38c-f6d4f55dbcda req-4fc51718-4959-468e-84b2-8e7f6509196e service nova] [instance: a3bcf65e-bd5b-4350-a222-5f4522418a67] Received unexpected event network-vif-unplugged-c4ac5376-d559-4365-b2ce-d827fecd2d1a for instance with vm_state active and task_state shelving.
Nov 13 18:48:07 user nova-compute[75216]: DEBUG nova.compute.manager [None req-20fbc57e-27ac-445f-9e0f-8ddfbaec2233 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] [instance: 64dfe522-8b46-4df4-8032-591ce56900ec] Instance event wait completed in 0 seconds for  {{(pid=75216) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 18:48:07 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-20fbc57e-27ac-445f-9e0f-8ddfbaec2233 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] [instance: 64dfe522-8b46-4df4-8032-591ce56900ec] Guest created on hypervisor {{(pid=75216) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 18:48:07 user nova-compute[75216]: DEBUG nova.network.neutron [req-32904d7c-b22e-4e26-89ee-48e75b936a69 req-6fc24c40-490f-425e-b359-9a20a76622fc service nova] [instance: ed251b5e-5f1d-404c-a09b-156e5ed72e82] Updated VIF entry in instance network info cache for port d35d00b9-b4f6-4a81-8112-706ac49f4a21. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 18:48:07 user nova-compute[75216]: DEBUG nova.network.neutron [req-32904d7c-b22e-4e26-89ee-48e75b936a69 req-6fc24c40-490f-425e-b359-9a20a76622fc service nova] [instance: ed251b5e-5f1d-404c-a09b-156e5ed72e82] Updating instance_info_cache with network_info: [{"id": "d35d00b9-b4f6-4a81-8112-706ac49f4a21", "address": "fa:16:3e:3a:d0:50", "network": {"id": "3e05e26f-bb3f-48d7-a8cf-8974b02b1745", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-600263470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d63d01c37774af48f4d3e49901802f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd35d00b9-b4", "ovs_interfaceid": "d35d00b9-b4f6-4a81-8112-706ac49f4a21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 18:48:07 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 64dfe522-8b46-4df4-8032-591ce56900ec] Instance spawned successfully.
Nov 13 18:48:07 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-20fbc57e-27ac-445f-9e0f-8ddfbaec2233 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] [instance: 64dfe522-8b46-4df4-8032-591ce56900ec] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 18:48:07 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-32904d7c-b22e-4e26-89ee-48e75b936a69 req-6fc24c40-490f-425e-b359-9a20a76622fc service nova] Releasing lock "refresh_cache-ed251b5e-5f1d-404c-a09b-156e5ed72e82" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 18:48:07 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-20fbc57e-27ac-445f-9e0f-8ddfbaec2233 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] [instance: 64dfe522-8b46-4df4-8032-591ce56900ec] Found default for hw_cdrom_bus of ide {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 18:48:07 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-20fbc57e-27ac-445f-9e0f-8ddfbaec2233 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] [instance: 64dfe522-8b46-4df4-8032-591ce56900ec] Found default for hw_disk_bus of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 18:48:07 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-20fbc57e-27ac-445f-9e0f-8ddfbaec2233 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] [instance: 64dfe522-8b46-4df4-8032-591ce56900ec] Found default for hw_input_bus of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 18:48:07 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-20fbc57e-27ac-445f-9e0f-8ddfbaec2233 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] [instance: 64dfe522-8b46-4df4-8032-591ce56900ec] Found default for hw_pointer_model of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 18:48:07 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-20fbc57e-27ac-445f-9e0f-8ddfbaec2233 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] [instance: 64dfe522-8b46-4df4-8032-591ce56900ec] Found default for hw_video_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 18:48:07 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-20fbc57e-27ac-445f-9e0f-8ddfbaec2233 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] [instance: 64dfe522-8b46-4df4-8032-591ce56900ec] Found default for hw_vif_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 18:48:07 user nova-compute[75216]: INFO nova.compute.manager [None req-20fbc57e-27ac-445f-9e0f-8ddfbaec2233 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] [instance: 64dfe522-8b46-4df4-8032-591ce56900ec] Took 5.61 seconds to spawn the instance on the hypervisor.
Nov 13 18:48:07 user nova-compute[75216]: DEBUG nova.compute.manager [None req-20fbc57e-27ac-445f-9e0f-8ddfbaec2233 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] [instance: 64dfe522-8b46-4df4-8032-591ce56900ec] Checking state {{(pid=75216) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 18:48:07 user nova-compute[75216]: INFO nova.compute.manager [None req-20fbc57e-27ac-445f-9e0f-8ddfbaec2233 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] [instance: 64dfe522-8b46-4df4-8032-591ce56900ec] Took 6.30 seconds to build instance.
Nov 13 18:48:07 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-20fbc57e-27ac-445f-9e0f-8ddfbaec2233 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] Lock "64dfe522-8b46-4df4-8032-591ce56900ec" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.407s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:48:07 user nova-compute[75216]: DEBUG nova.compute.manager [req-4d5ff6b3-2252-426f-abb9-0031d993a1d0 req-2b14f611-a584-450e-b34b-8581070adf3f service nova] [instance: 64dfe522-8b46-4df4-8032-591ce56900ec] Received event network-vif-plugged-2d12f254-7874-4622-a7cb-8180de961bd1 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:48:07 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-4d5ff6b3-2252-426f-abb9-0031d993a1d0 req-2b14f611-a584-450e-b34b-8581070adf3f service nova] Acquiring lock "64dfe522-8b46-4df4-8032-591ce56900ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:48:07 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-4d5ff6b3-2252-426f-abb9-0031d993a1d0 req-2b14f611-a584-450e-b34b-8581070adf3f service nova] Lock "64dfe522-8b46-4df4-8032-591ce56900ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:48:07 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-4d5ff6b3-2252-426f-abb9-0031d993a1d0 req-2b14f611-a584-450e-b34b-8581070adf3f service nova] Lock "64dfe522-8b46-4df4-8032-591ce56900ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:48:07 user nova-compute[75216]: DEBUG nova.compute.manager [req-4d5ff6b3-2252-426f-abb9-0031d993a1d0 req-2b14f611-a584-450e-b34b-8581070adf3f service nova] [instance: 64dfe522-8b46-4df4-8032-591ce56900ec] No waiting events found dispatching network-vif-plugged-2d12f254-7874-4622-a7cb-8180de961bd1 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:48:07 user nova-compute[75216]: WARNING nova.compute.manager [req-4d5ff6b3-2252-426f-abb9-0031d993a1d0 req-2b14f611-a584-450e-b34b-8581070adf3f service nova] [instance: 64dfe522-8b46-4df4-8032-591ce56900ec] Received unexpected event network-vif-plugged-2d12f254-7874-4622-a7cb-8180de961bd1 for instance with vm_state active and task_state None.
Nov 13 18:48:07 user nova-compute[75216]: DEBUG nova.compute.manager [req-4d5ff6b3-2252-426f-abb9-0031d993a1d0 req-2b14f611-a584-450e-b34b-8581070adf3f service nova] [instance: a3bcf65e-bd5b-4350-a222-5f4522418a67] Received event network-changed-c4ac5376-d559-4365-b2ce-d827fecd2d1a {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:48:07 user nova-compute[75216]: DEBUG nova.compute.manager [req-4d5ff6b3-2252-426f-abb9-0031d993a1d0 req-2b14f611-a584-450e-b34b-8581070adf3f service nova] [instance: a3bcf65e-bd5b-4350-a222-5f4522418a67] Refreshing instance network info cache due to event network-changed-c4ac5376-d559-4365-b2ce-d827fecd2d1a. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 18:48:07 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-4d5ff6b3-2252-426f-abb9-0031d993a1d0 req-2b14f611-a584-450e-b34b-8581070adf3f service nova] Acquiring lock "refresh_cache-a3bcf65e-bd5b-4350-a222-5f4522418a67" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 18:48:07 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-4d5ff6b3-2252-426f-abb9-0031d993a1d0 req-2b14f611-a584-450e-b34b-8581070adf3f service nova] Acquired lock "refresh_cache-a3bcf65e-bd5b-4350-a222-5f4522418a67" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 18:48:07 user nova-compute[75216]: DEBUG nova.network.neutron [req-4d5ff6b3-2252-426f-abb9-0031d993a1d0 req-2b14f611-a584-450e-b34b-8581070adf3f service nova] [instance: a3bcf65e-bd5b-4350-a222-5f4522418a67] Refreshing network info cache for port c4ac5376-d559-4365-b2ce-d827fecd2d1a {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 18:48:08 user nova-compute[75216]: DEBUG nova.network.neutron [req-4d5ff6b3-2252-426f-abb9-0031d993a1d0 req-2b14f611-a584-450e-b34b-8581070adf3f service nova] [instance: a3bcf65e-bd5b-4350-a222-5f4522418a67] Updated VIF entry in instance network info cache for port c4ac5376-d559-4365-b2ce-d827fecd2d1a. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 18:48:08 user nova-compute[75216]: DEBUG nova.network.neutron [req-4d5ff6b3-2252-426f-abb9-0031d993a1d0 req-2b14f611-a584-450e-b34b-8581070adf3f service nova] [instance: a3bcf65e-bd5b-4350-a222-5f4522418a67] Updating instance_info_cache with network_info: [{"id": "c4ac5376-d559-4365-b2ce-d827fecd2d1a", "address": "fa:16:3e:f7:06:79", "network": {"id": "4f264ec8-b112-4549-aa16-029824a0fcb4", "bridge": "br-int", "label": "tempest-TestShelveInstance-1108623968-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2601440dcec64a86a539dbdddafc7a5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4ac5376-d5", "ovs_interfaceid": "c4ac5376-d559-4365-b2ce-d827fecd2d1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 18:48:08 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-4d5ff6b3-2252-426f-abb9-0031d993a1d0 req-2b14f611-a584-450e-b34b-8581070adf3f service nova] Releasing lock "refresh_cache-a3bcf65e-bd5b-4350-a222-5f4522418a67" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 18:48:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:48:08 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: a3bcf65e-bd5b-4350-a222-5f4522418a67] Instance destroyed successfully.
Nov 13 18:48:08 user nova-compute[75216]: DEBUG nova.compute.manager [None req-c2c44f23-e74c-49a0-954c-ff7d7f2ab2c2 tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] [instance: a3bcf65e-bd5b-4350-a222-5f4522418a67] Checking state {{(pid=75216) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 18:48:08 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c2c44f23-e74c-49a0-954c-ff7d7f2ab2c2 tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] Acquiring lock "refresh_cache-a3bcf65e-bd5b-4350-a222-5f4522418a67" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 18:48:08 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c2c44f23-e74c-49a0-954c-ff7d7f2ab2c2 tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] Acquired lock "refresh_cache-a3bcf65e-bd5b-4350-a222-5f4522418a67" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 18:48:08 user nova-compute[75216]: DEBUG nova.network.neutron [None req-c2c44f23-e74c-49a0-954c-ff7d7f2ab2c2 tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] [instance: a3bcf65e-bd5b-4350-a222-5f4522418a67] Building network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 18:48:08 user nova-compute[75216]: DEBUG nova.network.neutron [None req-c2c44f23-e74c-49a0-954c-ff7d7f2ab2c2 tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] [instance: a3bcf65e-bd5b-4350-a222-5f4522418a67] Updating instance_info_cache with network_info: [{"id": "c4ac5376-d559-4365-b2ce-d827fecd2d1a", "address": "fa:16:3e:f7:06:79", "network": {"id": "4f264ec8-b112-4549-aa16-029824a0fcb4", "bridge": "br-int", "label": "tempest-TestShelveInstance-1108623968-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2601440dcec64a86a539dbdddafc7a5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4ac5376-d5", "ovs_interfaceid": "c4ac5376-d559-4365-b2ce-d827fecd2d1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 18:48:08 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c2c44f23-e74c-49a0-954c-ff7d7f2ab2c2 tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] Releasing lock "refresh_cache-a3bcf65e-bd5b-4350-a222-5f4522418a67" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 18:48:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:48:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:48:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:48:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:48:09 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:48:09 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: a3bcf65e-bd5b-4350-a222-5f4522418a67] Instance destroyed successfully.
Nov 13 18:48:09 user nova-compute[75216]: DEBUG nova.objects.instance [None req-c2c44f23-e74c-49a0-954c-ff7d7f2ab2c2 tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] Lazy-loading 'resources' on Instance uuid a3bcf65e-bd5b-4350-a222-5f4522418a67 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 18:48:09 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:48:09 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-c2c44f23-e74c-49a0-954c-ff7d7f2ab2c2 tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T18:46:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-87869039',display_name='tempest-TestShelveInstance-server-87869039',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-87869039',id=12,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPf0Z5pKlRRYrkYQFZZ0LACxhlQS1FSX42rZOPJMyvxKGvcaboPCfNe3ktO1Wd/Ubb0iNMpYVdQ715G8FRIzu5wlnhJ6jeanXKJe8TuPRmnvCmt4lh2Ehwnc7Gc7HtYc2Q==',key_name='tempest-TestShelveInstance-2022745159',keypairs=<?>,launch_index=0,launched_at=2023-11-13T18:46:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2601440dcec64a86a539dbdddafc7a5d',ramdisk_id='',reservation_id='r-x2eeit0j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-55051446',owner_user_name='tempest-TestShelveInstance-55051446-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T18:46:26Z,user_data=None,user_id='59c263be93a143c3878bec0c4ae626af',uuid=a3bcf65e-bd5b-4350-a222-5f4522418a67,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c4ac5376-d559-4365-b2ce-d827fecd2d1a", "address": "fa:16:3e:f7:06:79", "network": {"id": "4f264ec8-b112-4549-aa16-029824a0fcb4", "bridge": "br-int", "label": "tempest-TestShelveInstance-1108623968-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2601440dcec64a86a539dbdddafc7a5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4ac5376-d5", "ovs_interfaceid": "c4ac5376-d559-4365-b2ce-d827fecd2d1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 18:48:09 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-c2c44f23-e74c-49a0-954c-ff7d7f2ab2c2 tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] Converting VIF {"id": "c4ac5376-d559-4365-b2ce-d827fecd2d1a", "address": "fa:16:3e:f7:06:79", "network": {"id": "4f264ec8-b112-4549-aa16-029824a0fcb4", "bridge": "br-int", "label": "tempest-TestShelveInstance-1108623968-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2601440dcec64a86a539dbdddafc7a5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4ac5376-d5", "ovs_interfaceid": "c4ac5376-d559-4365-b2ce-d827fecd2d1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 18:48:09 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-c2c44f23-e74c-49a0-954c-ff7d7f2ab2c2 tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:06:79,bridge_name='br-int',has_traffic_filtering=True,id=c4ac5376-d559-4365-b2ce-d827fecd2d1a,network=Network(4f264ec8-b112-4549-aa16-029824a0fcb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4ac5376-d5') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 18:48:09 user nova-compute[75216]: DEBUG os_vif [None req-c2c44f23-e74c-49a0-954c-ff7d7f2ab2c2 tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:06:79,bridge_name='br-int',has_traffic_filtering=True,id=c4ac5376-d559-4365-b2ce-d827fecd2d1a,network=Network(4f264ec8-b112-4549-aa16-029824a0fcb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4ac5376-d5') {{(pid=75216) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 18:48:09 user nova-compute[75216]: DEBUG nova.compute.manager [req-78460c9b-1582-4365-aa41-c3ecc98a72f2 req-660f8130-03e7-4151-bdce-90b1d092f3aa service nova] [instance: a3bcf65e-bd5b-4350-a222-5f4522418a67] Received event network-changed-c4ac5376-d559-4365-b2ce-d827fecd2d1a {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:48:09 user nova-compute[75216]: DEBUG nova.compute.manager [req-78460c9b-1582-4365-aa41-c3ecc98a72f2 req-660f8130-03e7-4151-bdce-90b1d092f3aa service nova] [instance: a3bcf65e-bd5b-4350-a222-5f4522418a67] Refreshing instance network info cache due to event network-changed-c4ac5376-d559-4365-b2ce-d827fecd2d1a. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 18:48:09 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-78460c9b-1582-4365-aa41-c3ecc98a72f2 req-660f8130-03e7-4151-bdce-90b1d092f3aa service nova] Acquiring lock "refresh_cache-a3bcf65e-bd5b-4350-a222-5f4522418a67" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 18:48:09 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-78460c9b-1582-4365-aa41-c3ecc98a72f2 req-660f8130-03e7-4151-bdce-90b1d092f3aa service nova] Acquired lock "refresh_cache-a3bcf65e-bd5b-4350-a222-5f4522418a67" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 18:48:09 user nova-compute[75216]: DEBUG nova.network.neutron [req-78460c9b-1582-4365-aa41-c3ecc98a72f2 req-660f8130-03e7-4151-bdce-90b1d092f3aa service nova] [instance: a3bcf65e-bd5b-4350-a222-5f4522418a67] Refreshing network info cache for port c4ac5376-d559-4365-b2ce-d827fecd2d1a {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 18:48:09 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:48:09 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc4ac5376-d5, bridge=br-int, if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:48:09 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:48:09 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:48:09 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:48:09 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3b39900c-08f6-4c14-a4dd-f00129556ffb) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:48:09 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:48:09 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:48:09 user nova-compute[75216]: INFO os_vif [None req-c2c44f23-e74c-49a0-954c-ff7d7f2ab2c2 tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:06:79,bridge_name='br-int',has_traffic_filtering=True,id=c4ac5376-d559-4365-b2ce-d827fecd2d1a,network=Network(4f264ec8-b112-4549-aa16-029824a0fcb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4ac5376-d5')
Nov 13 18:48:09 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c2c44f23-e74c-49a0-954c-ff7d7f2ab2c2 tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] [instance: a3bcf65e-bd5b-4350-a222-5f4522418a67] calling os-brick to detach iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 18:48:09 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2c44f23-e74c-49a0-954c-ff7d7f2ab2c2 tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3a8669e40>, {'target_iqn': 'iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OGxHvBQW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 18:48:09 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-c2c44f23-e74c-49a0-954c-ff7d7f2ab2c2 tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 18:48:09 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-c2c44f23-e74c-49a0-954c-ff7d7f2ab2c2 tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 18:48:09 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-c2c44f23-e74c-49a0-954c-ff7d7f2ab2c2 tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 18:48:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:48:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:48:09 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[e710a7e8-dfe6-4701-a7b7-5997bd595f8e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:48:09 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2c44f23-e74c-49a0-954c-ff7d7f2ab2c2 tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 18:48:09 user nova-compute[75216]: No targets found.
Nov 13 18:48:09 user nova-compute[75216]: iSNS:
Nov 13 18:48:09 user nova-compute[75216]: No targets found.
Nov 13 18:48:09 user nova-compute[75216]: STATIC:
Nov 13 18:48:09 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac
Nov 13 18:48:09 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 18:48:09 user nova-compute[75216]:                 Iface Name: default
Nov 13 18:48:09 user nova-compute[75216]: FIRMWARE:
Nov 13 18:48:09 user nova-compute[75216]: No targets found.
Nov 13 18:48:09 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 18:48:09 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2c44f23-e74c-49a0-954c-ff7d7f2ab2c2 tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 18:48:09 user nova-compute[75216]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 18:48:09 user nova-compute[75216]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75216) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 18:48:09 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2c44f23-e74c-49a0-954c-ff7d7f2ab2c2 tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac', 0)] {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 18:48:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:48:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:48:09 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[28d0c13e-ff73-4a27-bb42-f2eeec5f965d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:48:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:48:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:48:09 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2066ec3-8a53-4b1f-b9ce-74f9b87fae7c]: (4, ('tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac (non-flash)\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:48:09 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2c44f23-e74c-49a0-954c-ff7d7f2ab2c2 tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac (non-flash)
Nov 13 18:48:09 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 18:48:09 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2c44f23-e74c-49a0-954c-ff7d7f2ab2c2 tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] iscsi session list stdout=tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac (non-flash)
Nov 13 18:48:09 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 18:48:09 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2c44f23-e74c-49a0-954c-ff7d7f2ab2c2 tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe3a83136d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac'): ({'sdh'}, set())}) {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 18:48:09 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-c2c44f23-e74c-49a0-954c-ff7d7f2ab2c2 tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] Removing single pathed devices sdh {{(pid=75216) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 18:48:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:48:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:48:09 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cc6bc4e-cdc5-4a9a-9c49-9df3d6550b7d]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:48:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:48:09 user nova-compute[75216]: DEBUG nova.compute.manager [req-ca64cc9d-a90f-48bf-aab0-e230fafd5d9e req-3dcb7d83-ff70-4bca-b468-a1c743a7aa76 service nova] [instance: a3bcf65e-bd5b-4350-a222-5f4522418a67] Received event network-vif-plugged-c4ac5376-d559-4365-b2ce-d827fecd2d1a {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:48:09 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-ca64cc9d-a90f-48bf-aab0-e230fafd5d9e req-3dcb7d83-ff70-4bca-b468-a1c743a7aa76 service nova] Acquiring lock "a3bcf65e-bd5b-4350-a222-5f4522418a67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:48:09 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-ca64cc9d-a90f-48bf-aab0-e230fafd5d9e req-3dcb7d83-ff70-4bca-b468-a1c743a7aa76 service nova] Lock "a3bcf65e-bd5b-4350-a222-5f4522418a67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:48:09 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-ca64cc9d-a90f-48bf-aab0-e230fafd5d9e req-3dcb7d83-ff70-4bca-b468-a1c743a7aa76 service nova] Lock "a3bcf65e-bd5b-4350-a222-5f4522418a67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:48:09 user nova-compute[75216]: DEBUG nova.compute.manager [req-ca64cc9d-a90f-48bf-aab0-e230fafd5d9e req-3dcb7d83-ff70-4bca-b468-a1c743a7aa76 service nova] [instance: a3bcf65e-bd5b-4350-a222-5f4522418a67] No waiting events found dispatching network-vif-plugged-c4ac5376-d559-4365-b2ce-d827fecd2d1a {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:48:09 user nova-compute[75216]: WARNING nova.compute.manager [req-ca64cc9d-a90f-48bf-aab0-e230fafd5d9e req-3dcb7d83-ff70-4bca-b468-a1c743a7aa76 service nova] [instance: a3bcf65e-bd5b-4350-a222-5f4522418a67] Received unexpected event network-vif-plugged-c4ac5376-d559-4365-b2ce-d827fecd2d1a for instance with vm_state active and task_state shelving.
Nov 13 18:48:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.023s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:48:09 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b52b6cf-8b63-4c80-910b-f550b0ba0aa9]: (4, ('ok\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:48:09 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-c2c44f23-e74c-49a0-954c-ff7d7f2ab2c2 tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] Flushing IO for device /dev/sdh {{(pid=75216) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 18:48:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:48:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.013s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:48:09 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f26d913-1541-47c2-bc62-570c7ed0d7c4]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:48:09 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-c2c44f23-e74c-49a0-954c-ff7d7f2ab2c2 tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=75216) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 18:48:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:48:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.049s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:48:09 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e0de160-36d0-4927-ac4c-fa43f1bb66e9]: (4, ('1', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:48:09 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-c2c44f23-e74c-49a0-954c-ff7d7f2ab2c2 tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 18:48:09 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-c2c44f23-e74c-49a0-954c-ff7d7f2ab2c2 tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] SCSI volumes sdh have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 18:48:09 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2c44f23-e74c-49a0-954c-ff7d7f2ab2c2 tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac')] {{(pid=75216) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 18:48:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:48:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:48:09 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[52f4f1c5-b141-4d60-81cf-90ebaf63ed53]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:48:09 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2c44f23-e74c-49a0-954c-ff7d7f2ab2c2 tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:48:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac -p 172.16.0.220:3260 --logout {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:48:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:48:09 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b32c049-b733-439b-8627-910f2f0dabab]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:48:09 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2c44f23-e74c-49a0-954c-ff7d7f2ab2c2 tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac, portal: 172.16.0.220,3260]
Nov 13 18:48:09 user nova-compute[75216]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac, portal: 172.16.0.220,3260] successful.
Nov 13 18:48:09 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:48:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac -p 172.16.0.220:3260 --op delete {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:48:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:48:09 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa3158f1-c356-4549-9c4a-d310f161c34c]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:48:09 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2c44f23-e74c-49a0-954c-ff7d7f2ab2c2 tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:48:09 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-c2c44f23-e74c-49a0-954c-ff7d7f2ab2c2 tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.343s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 18:48:09 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2c44f23-e74c-49a0-954c-ff7d7f2ab2c2 tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] <== disconnect_volume: return (344ms) None {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 18:48:09 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c2c44f23-e74c-49a0-954c-ff7d7f2ab2c2 tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] [instance: a3bcf65e-bd5b-4350-a222-5f4522418a67] Disconnected iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 18:48:09 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-c2c44f23-e74c-49a0-954c-ff7d7f2ab2c2 tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] [instance: a3bcf65e-bd5b-4350-a222-5f4522418a67] Deleting instance files /opt/stack/data/nova/instances/a3bcf65e-bd5b-4350-a222-5f4522418a67_del
Nov 13 18:48:09 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-c2c44f23-e74c-49a0-954c-ff7d7f2ab2c2 tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] [instance: a3bcf65e-bd5b-4350-a222-5f4522418a67] Deletion of /opt/stack/data/nova/instances/a3bcf65e-bd5b-4350-a222-5f4522418a67_del complete
Nov 13 18:48:10 user nova-compute[75216]: DEBUG nova.network.neutron [req-78460c9b-1582-4365-aa41-c3ecc98a72f2 req-660f8130-03e7-4151-bdce-90b1d092f3aa service nova] [instance: a3bcf65e-bd5b-4350-a222-5f4522418a67] Updated VIF entry in instance network info cache for port c4ac5376-d559-4365-b2ce-d827fecd2d1a. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 18:48:10 user nova-compute[75216]: DEBUG nova.network.neutron [req-78460c9b-1582-4365-aa41-c3ecc98a72f2 req-660f8130-03e7-4151-bdce-90b1d092f3aa service nova] [instance: a3bcf65e-bd5b-4350-a222-5f4522418a67] Updating instance_info_cache with network_info: [{"id": "c4ac5376-d559-4365-b2ce-d827fecd2d1a", "address": "fa:16:3e:f7:06:79", "network": {"id": "4f264ec8-b112-4549-aa16-029824a0fcb4", "bridge": null, "label": "tempest-TestShelveInstance-1108623968-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2601440dcec64a86a539dbdddafc7a5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapc4ac5376-d5", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 18:48:10 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-78460c9b-1582-4365-aa41-c3ecc98a72f2 req-660f8130-03e7-4151-bdce-90b1d092f3aa service nova] Releasing lock "refresh_cache-a3bcf65e-bd5b-4350-a222-5f4522418a67" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 18:48:10 user nova-compute[75216]: INFO nova.scheduler.client.report [None req-c2c44f23-e74c-49a0-954c-ff7d7f2ab2c2 tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] Deleted allocations for instance a3bcf65e-bd5b-4350-a222-5f4522418a67
Nov 13 18:48:10 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c2c44f23-e74c-49a0-954c-ff7d7f2ab2c2 tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:48:10 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c2c44f23-e74c-49a0-954c-ff7d7f2ab2c2 tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:48:10 user nova-compute[75216]: DEBUG nova.objects.instance [None req-c2c44f23-e74c-49a0-954c-ff7d7f2ab2c2 tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] Lazy-loading 'numa_topology' on Instance uuid a3bcf65e-bd5b-4350-a222-5f4522418a67 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 18:48:10 user nova-compute[75216]: DEBUG nova.objects.base [None req-c2c44f23-e74c-49a0-954c-ff7d7f2ab2c2 tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] Object Instance<a3bcf65e-bd5b-4350-a222-5f4522418a67> lazy-loaded attributes: resources,numa_topology {{(pid=75216) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 18:48:11 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-c2c44f23-e74c-49a0-954c-ff7d7f2ab2c2 tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 18:48:11 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-c2c44f23-e74c-49a0-954c-ff7d7f2ab2c2 tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 18:48:11 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c2c44f23-e74c-49a0-954c-ff7d7f2ab2c2 tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.350s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:48:11 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c2c44f23-e74c-49a0-954c-ff7d7f2ab2c2 tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] Lock "a3bcf65e-bd5b-4350-a222-5f4522418a67" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 4.133s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:48:11 user nova-compute[75216]: DEBUG nova.compute.manager [None req-b401585d-91f4-4daa-8c3a-989f01a3796b tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] [instance: ed251b5e-5f1d-404c-a09b-156e5ed72e82] Instance event wait completed in 0 seconds for  {{(pid=75216) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 18:48:11 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-b401585d-91f4-4daa-8c3a-989f01a3796b tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] [instance: ed251b5e-5f1d-404c-a09b-156e5ed72e82] Guest created on hypervisor {{(pid=75216) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 18:48:11 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: ed251b5e-5f1d-404c-a09b-156e5ed72e82] Instance spawned successfully.
Nov 13 18:48:11 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-b401585d-91f4-4daa-8c3a-989f01a3796b tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] [instance: ed251b5e-5f1d-404c-a09b-156e5ed72e82] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 18:48:11 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-b401585d-91f4-4daa-8c3a-989f01a3796b tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] [instance: ed251b5e-5f1d-404c-a09b-156e5ed72e82] Found default for hw_cdrom_bus of ide {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 18:48:11 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-b401585d-91f4-4daa-8c3a-989f01a3796b tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] [instance: ed251b5e-5f1d-404c-a09b-156e5ed72e82] Found default for hw_disk_bus of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 18:48:11 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-b401585d-91f4-4daa-8c3a-989f01a3796b tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] [instance: ed251b5e-5f1d-404c-a09b-156e5ed72e82] Found default for hw_input_bus of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 18:48:11 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-b401585d-91f4-4daa-8c3a-989f01a3796b tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] [instance: ed251b5e-5f1d-404c-a09b-156e5ed72e82] Found default for hw_pointer_model of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 18:48:11 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-b401585d-91f4-4daa-8c3a-989f01a3796b tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] [instance: ed251b5e-5f1d-404c-a09b-156e5ed72e82] Found default for hw_video_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 18:48:11 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-b401585d-91f4-4daa-8c3a-989f01a3796b tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] [instance: ed251b5e-5f1d-404c-a09b-156e5ed72e82] Found default for hw_vif_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 18:48:11 user nova-compute[75216]: INFO nova.compute.manager [None req-b401585d-91f4-4daa-8c3a-989f01a3796b tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] [instance: ed251b5e-5f1d-404c-a09b-156e5ed72e82] Took 5.85 seconds to spawn the instance on the hypervisor.
Nov 13 18:48:11 user nova-compute[75216]: DEBUG nova.compute.manager [None req-b401585d-91f4-4daa-8c3a-989f01a3796b tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] [instance: ed251b5e-5f1d-404c-a09b-156e5ed72e82] Checking state {{(pid=75216) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 18:48:11 user nova-compute[75216]: DEBUG nova.compute.manager [req-b5298e08-f732-4b1c-9c11-257822be722b req-4070de48-f05d-4acd-9372-b07a85fcb37e service nova] [instance: ed251b5e-5f1d-404c-a09b-156e5ed72e82] Received event network-vif-plugged-d35d00b9-b4f6-4a81-8112-706ac49f4a21 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:48:11 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-b5298e08-f732-4b1c-9c11-257822be722b req-4070de48-f05d-4acd-9372-b07a85fcb37e service nova] Acquiring lock "ed251b5e-5f1d-404c-a09b-156e5ed72e82-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:48:11 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-b5298e08-f732-4b1c-9c11-257822be722b req-4070de48-f05d-4acd-9372-b07a85fcb37e service nova] Lock "ed251b5e-5f1d-404c-a09b-156e5ed72e82-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:48:11 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-b5298e08-f732-4b1c-9c11-257822be722b req-4070de48-f05d-4acd-9372-b07a85fcb37e service nova] Lock "ed251b5e-5f1d-404c-a09b-156e5ed72e82-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:48:11 user nova-compute[75216]: DEBUG nova.compute.manager [req-b5298e08-f732-4b1c-9c11-257822be722b req-4070de48-f05d-4acd-9372-b07a85fcb37e service nova] [instance: ed251b5e-5f1d-404c-a09b-156e5ed72e82] No waiting events found dispatching network-vif-plugged-d35d00b9-b4f6-4a81-8112-706ac49f4a21 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:48:11 user nova-compute[75216]: WARNING nova.compute.manager [req-b5298e08-f732-4b1c-9c11-257822be722b req-4070de48-f05d-4acd-9372-b07a85fcb37e service nova] [instance: ed251b5e-5f1d-404c-a09b-156e5ed72e82] Received unexpected event network-vif-plugged-d35d00b9-b4f6-4a81-8112-706ac49f4a21 for instance with vm_state building and task_state spawning.
Nov 13 18:48:11 user nova-compute[75216]: DEBUG nova.compute.manager [req-b5298e08-f732-4b1c-9c11-257822be722b req-4070de48-f05d-4acd-9372-b07a85fcb37e service nova] [instance: ed251b5e-5f1d-404c-a09b-156e5ed72e82] Received event network-vif-plugged-d35d00b9-b4f6-4a81-8112-706ac49f4a21 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:48:11 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-b5298e08-f732-4b1c-9c11-257822be722b req-4070de48-f05d-4acd-9372-b07a85fcb37e service nova] Acquiring lock "ed251b5e-5f1d-404c-a09b-156e5ed72e82-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:48:11 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-b5298e08-f732-4b1c-9c11-257822be722b req-4070de48-f05d-4acd-9372-b07a85fcb37e service nova] Lock "ed251b5e-5f1d-404c-a09b-156e5ed72e82-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:48:11 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-b5298e08-f732-4b1c-9c11-257822be722b req-4070de48-f05d-4acd-9372-b07a85fcb37e service nova] Lock "ed251b5e-5f1d-404c-a09b-156e5ed72e82-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:48:11 user nova-compute[75216]: DEBUG nova.compute.manager [req-b5298e08-f732-4b1c-9c11-257822be722b req-4070de48-f05d-4acd-9372-b07a85fcb37e service nova] [instance: ed251b5e-5f1d-404c-a09b-156e5ed72e82] No waiting events found dispatching network-vif-plugged-d35d00b9-b4f6-4a81-8112-706ac49f4a21 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:48:11 user nova-compute[75216]: WARNING nova.compute.manager [req-b5298e08-f732-4b1c-9c11-257822be722b req-4070de48-f05d-4acd-9372-b07a85fcb37e service nova] [instance: ed251b5e-5f1d-404c-a09b-156e5ed72e82] Received unexpected event network-vif-plugged-d35d00b9-b4f6-4a81-8112-706ac49f4a21 for instance with vm_state building and task_state spawning.
Nov 13 18:48:11 user nova-compute[75216]: INFO nova.compute.manager [None req-b401585d-91f4-4daa-8c3a-989f01a3796b tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] [instance: ed251b5e-5f1d-404c-a09b-156e5ed72e82] Took 6.78 seconds to build instance.
Nov 13 18:48:11 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-b401585d-91f4-4daa-8c3a-989f01a3796b tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] Lock "ed251b5e-5f1d-404c-a09b-156e5ed72e82" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.877s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:48:13 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:48:14 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:48:17 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-668a039d-3e89-446d-ac6c-3c1813d6a41c tempest-VolumesAssistedSnapshotsTest-1233733883 tempest-VolumesAssistedSnapshotsTest-1233733883-project-member] Acquiring lock "576e97b7-285a-451f-a80d-aaa321a79d3b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:48:17 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-668a039d-3e89-446d-ac6c-3c1813d6a41c tempest-VolumesAssistedSnapshotsTest-1233733883 tempest-VolumesAssistedSnapshotsTest-1233733883-project-member] Lock "576e97b7-285a-451f-a80d-aaa321a79d3b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:48:17 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-668a039d-3e89-446d-ac6c-3c1813d6a41c tempest-VolumesAssistedSnapshotsTest-1233733883 tempest-VolumesAssistedSnapshotsTest-1233733883-project-member] Acquiring lock "576e97b7-285a-451f-a80d-aaa321a79d3b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:48:17 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-668a039d-3e89-446d-ac6c-3c1813d6a41c tempest-VolumesAssistedSnapshotsTest-1233733883 tempest-VolumesAssistedSnapshotsTest-1233733883-project-member] Lock "576e97b7-285a-451f-a80d-aaa321a79d3b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:48:17 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-668a039d-3e89-446d-ac6c-3c1813d6a41c tempest-VolumesAssistedSnapshotsTest-1233733883 tempest-VolumesAssistedSnapshotsTest-1233733883-project-member] Lock "576e97b7-285a-451f-a80d-aaa321a79d3b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:48:17 user nova-compute[75216]: INFO nova.compute.manager [None req-668a039d-3e89-446d-ac6c-3c1813d6a41c tempest-VolumesAssistedSnapshotsTest-1233733883 tempest-VolumesAssistedSnapshotsTest-1233733883-project-member] [instance: 576e97b7-285a-451f-a80d-aaa321a79d3b] Terminating instance
Nov 13 18:48:17 user nova-compute[75216]: DEBUG nova.compute.manager [None req-668a039d-3e89-446d-ac6c-3c1813d6a41c tempest-VolumesAssistedSnapshotsTest-1233733883 tempest-VolumesAssistedSnapshotsTest-1233733883-project-member] [instance: 576e97b7-285a-451f-a80d-aaa321a79d3b] Start destroying the instance on the hypervisor. {{(pid=75216) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 18:48:17 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:48:17 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:48:17 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:48:17 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:48:17 user nova-compute[75216]: DEBUG nova.compute.manager [req-90520801-87aa-4f7f-81ef-4d4d1d06caa3 req-9e95b23f-1183-401c-81b5-3919821e0d80 service nova] [instance: 576e97b7-285a-451f-a80d-aaa321a79d3b] Received event network-vif-unplugged-af70d3c4-b668-4cfa-92fb-5bf17a903572 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:48:17 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-90520801-87aa-4f7f-81ef-4d4d1d06caa3 req-9e95b23f-1183-401c-81b5-3919821e0d80 service nova] Acquiring lock "576e97b7-285a-451f-a80d-aaa321a79d3b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:48:17 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-90520801-87aa-4f7f-81ef-4d4d1d06caa3 req-9e95b23f-1183-401c-81b5-3919821e0d80 service nova] Lock "576e97b7-285a-451f-a80d-aaa321a79d3b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:48:17 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-90520801-87aa-4f7f-81ef-4d4d1d06caa3 req-9e95b23f-1183-401c-81b5-3919821e0d80 service nova] Lock "576e97b7-285a-451f-a80d-aaa321a79d3b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:48:17 user nova-compute[75216]: DEBUG nova.compute.manager [req-90520801-87aa-4f7f-81ef-4d4d1d06caa3 req-9e95b23f-1183-401c-81b5-3919821e0d80 service nova] [instance: 576e97b7-285a-451f-a80d-aaa321a79d3b] No waiting events found dispatching network-vif-unplugged-af70d3c4-b668-4cfa-92fb-5bf17a903572 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:48:17 user nova-compute[75216]: DEBUG nova.compute.manager [req-90520801-87aa-4f7f-81ef-4d4d1d06caa3 req-9e95b23f-1183-401c-81b5-3919821e0d80 service nova] [instance: 576e97b7-285a-451f-a80d-aaa321a79d3b] Received event network-vif-unplugged-af70d3c4-b668-4cfa-92fb-5bf17a903572 for instance with task_state deleting. {{(pid=75216) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 18:48:17 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:48:17 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:48:17 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:48:18 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 576e97b7-285a-451f-a80d-aaa321a79d3b] Instance destroyed successfully.
Nov 13 18:48:18 user nova-compute[75216]: DEBUG nova.objects.instance [None req-668a039d-3e89-446d-ac6c-3c1813d6a41c tempest-VolumesAssistedSnapshotsTest-1233733883 tempest-VolumesAssistedSnapshotsTest-1233733883-project-member] Lazy-loading 'resources' on Instance uuid 576e97b7-285a-451f-a80d-aaa321a79d3b {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 18:48:18 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-668a039d-3e89-446d-ac6c-3c1813d6a41c tempest-VolumesAssistedSnapshotsTest-1233733883 tempest-VolumesAssistedSnapshotsTest-1233733883-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T18:45:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1282536025',display_name='tempest-VolumesAssistedSnapshotsTest-server-1282536025',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1282536025',id=8,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGK5kwimrtPNgyWvXjn4c9bHpOstVwrHZDR8nIXsBYCG9sB8SFKEWbUEqIEonDSTs0cvkjqSa7vMx+RA1QEq1AzSMzYsMzjQsLKQ2JKNIguBs3Xjr0rx+XJoMLyIbTOF+A==',key_name='tempest-keypair-1703816178',keypairs=<?>,launch_index=0,launched_at=2023-11-13T18:45:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='763712c69c7f45a8a0ff5cfdeb032baa',ramdisk_id='',reservation_id='r-cpqnmsgq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1233733883',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1233733883-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T18:45:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='526a993a42884f82a75231be9aa332cf',uuid=576e97b7-285a-451f-a80d-aaa321a79d3b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "af70d3c4-b668-4cfa-92fb-5bf17a903572", "address": "fa:16:3e:72:14:30", "network": {"id": "a5954c64-25ea-4c12-b852-ce2cf531689c", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1064303336-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "763712c69c7f45a8a0ff5cfdeb032baa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf70d3c4-b6", "ovs_interfaceid": "af70d3c4-b668-4cfa-92fb-5bf17a903572", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 18:48:18 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-668a039d-3e89-446d-ac6c-3c1813d6a41c tempest-VolumesAssistedSnapshotsTest-1233733883 tempest-VolumesAssistedSnapshotsTest-1233733883-project-member] Converting VIF {"id": "af70d3c4-b668-4cfa-92fb-5bf17a903572", "address": "fa:16:3e:72:14:30", "network": {"id": "a5954c64-25ea-4c12-b852-ce2cf531689c", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1064303336-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "763712c69c7f45a8a0ff5cfdeb032baa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf70d3c4-b6", "ovs_interfaceid": "af70d3c4-b668-4cfa-92fb-5bf17a903572", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 18:48:18 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-668a039d-3e89-446d-ac6c-3c1813d6a41c tempest-VolumesAssistedSnapshotsTest-1233733883 tempest-VolumesAssistedSnapshotsTest-1233733883-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:72:14:30,bridge_name='br-int',has_traffic_filtering=True,id=af70d3c4-b668-4cfa-92fb-5bf17a903572,network=Network(a5954c64-25ea-4c12-b852-ce2cf531689c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf70d3c4-b6') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 18:48:18 user nova-compute[75216]: DEBUG os_vif [None req-668a039d-3e89-446d-ac6c-3c1813d6a41c tempest-VolumesAssistedSnapshotsTest-1233733883 tempest-VolumesAssistedSnapshotsTest-1233733883-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:72:14:30,bridge_name='br-int',has_traffic_filtering=True,id=af70d3c4-b668-4cfa-92fb-5bf17a903572,network=Network(a5954c64-25ea-4c12-b852-ce2cf531689c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf70d3c4-b6') {{(pid=75216) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 18:48:18 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:48:18 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaf70d3c4-b6, bridge=br-int, if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:48:18 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:48:18 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:48:18 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:48:18 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1e760c75-96b9-4f48-b01f-215017d503fb) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:48:18 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:48:18 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:48:18 user nova-compute[75216]: INFO os_vif [None req-668a039d-3e89-446d-ac6c-3c1813d6a41c tempest-VolumesAssistedSnapshotsTest-1233733883 tempest-VolumesAssistedSnapshotsTest-1233733883-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:72:14:30,bridge_name='br-int',has_traffic_filtering=True,id=af70d3c4-b668-4cfa-92fb-5bf17a903572,network=Network(a5954c64-25ea-4c12-b852-ce2cf531689c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf70d3c4-b6')
Nov 13 18:48:18 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-668a039d-3e89-446d-ac6c-3c1813d6a41c tempest-VolumesAssistedSnapshotsTest-1233733883 tempest-VolumesAssistedSnapshotsTest-1233733883-project-member] [instance: 576e97b7-285a-451f-a80d-aaa321a79d3b] Deleting instance files /opt/stack/data/nova/instances/576e97b7-285a-451f-a80d-aaa321a79d3b_del
Nov 13 18:48:18 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-668a039d-3e89-446d-ac6c-3c1813d6a41c tempest-VolumesAssistedSnapshotsTest-1233733883 tempest-VolumesAssistedSnapshotsTest-1233733883-project-member] [instance: 576e97b7-285a-451f-a80d-aaa321a79d3b] Deletion of /opt/stack/data/nova/instances/576e97b7-285a-451f-a80d-aaa321a79d3b_del complete
Nov 13 18:48:18 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:48:18 user nova-compute[75216]: INFO nova.compute.manager [None req-668a039d-3e89-446d-ac6c-3c1813d6a41c tempest-VolumesAssistedSnapshotsTest-1233733883 tempest-VolumesAssistedSnapshotsTest-1233733883-project-member] [instance: 576e97b7-285a-451f-a80d-aaa321a79d3b] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 13 18:48:18 user nova-compute[75216]: DEBUG oslo.service.loopingcall [None req-668a039d-3e89-446d-ac6c-3c1813d6a41c tempest-VolumesAssistedSnapshotsTest-1233733883 tempest-VolumesAssistedSnapshotsTest-1233733883-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75216) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 18:48:18 user nova-compute[75216]: DEBUG nova.compute.manager [-] [instance: 576e97b7-285a-451f-a80d-aaa321a79d3b] Deallocating network for instance {{(pid=75216) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 18:48:18 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: 576e97b7-285a-451f-a80d-aaa321a79d3b] deallocate_for_instance() {{(pid=75216) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 18:48:18 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:48:18 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:48:18 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:48:18 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:48:18 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:48:18 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:48:19 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: 576e97b7-285a-451f-a80d-aaa321a79d3b] Updating instance_info_cache with network_info: [] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 18:48:19 user nova-compute[75216]: INFO nova.compute.manager [-] [instance: 576e97b7-285a-451f-a80d-aaa321a79d3b] Took 1.27 seconds to deallocate network for instance.
Nov 13 18:48:19 user nova-compute[75216]: DEBUG nova.compute.manager [req-bddc209c-163d-43b5-9f0d-9f230cab383b req-0fe9a942-68f8-4f24-80bb-b2c450050f9b service nova] [instance: 576e97b7-285a-451f-a80d-aaa321a79d3b] Received event network-vif-deleted-af70d3c4-b668-4cfa-92fb-5bf17a903572 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:48:19 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-668a039d-3e89-446d-ac6c-3c1813d6a41c tempest-VolumesAssistedSnapshotsTest-1233733883 tempest-VolumesAssistedSnapshotsTest-1233733883-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:48:19 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-668a039d-3e89-446d-ac6c-3c1813d6a41c tempest-VolumesAssistedSnapshotsTest-1233733883 tempest-VolumesAssistedSnapshotsTest-1233733883-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:48:19 user nova-compute[75216]: DEBUG nova.compute.manager [req-5821f622-9d0b-46f6-9883-12a080caf337 req-d5336e3c-9aa8-413d-8766-b424057fff01 service nova] [instance: 576e97b7-285a-451f-a80d-aaa321a79d3b] Received event network-vif-plugged-af70d3c4-b668-4cfa-92fb-5bf17a903572 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:48:19 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-5821f622-9d0b-46f6-9883-12a080caf337 req-d5336e3c-9aa8-413d-8766-b424057fff01 service nova] Acquiring lock "576e97b7-285a-451f-a80d-aaa321a79d3b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:48:19 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-5821f622-9d0b-46f6-9883-12a080caf337 req-d5336e3c-9aa8-413d-8766-b424057fff01 service nova] Lock "576e97b7-285a-451f-a80d-aaa321a79d3b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:48:19 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-5821f622-9d0b-46f6-9883-12a080caf337 req-d5336e3c-9aa8-413d-8766-b424057fff01 service nova] Lock "576e97b7-285a-451f-a80d-aaa321a79d3b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:48:19 user nova-compute[75216]: DEBUG nova.compute.manager [req-5821f622-9d0b-46f6-9883-12a080caf337 req-d5336e3c-9aa8-413d-8766-b424057fff01 service nova] [instance: 576e97b7-285a-451f-a80d-aaa321a79d3b] No waiting events found dispatching network-vif-plugged-af70d3c4-b668-4cfa-92fb-5bf17a903572 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:48:19 user nova-compute[75216]: WARNING nova.compute.manager [req-5821f622-9d0b-46f6-9883-12a080caf337 req-d5336e3c-9aa8-413d-8766-b424057fff01 service nova] [instance: 576e97b7-285a-451f-a80d-aaa321a79d3b] Received unexpected event network-vif-plugged-af70d3c4-b668-4cfa-92fb-5bf17a903572 for instance with vm_state deleted and task_state None.
Nov 13 18:48:19 user nova-compute[75216]: DEBUG nova.compute.manager [req-5821f622-9d0b-46f6-9883-12a080caf337 req-d5336e3c-9aa8-413d-8766-b424057fff01 service nova] [instance: 576e97b7-285a-451f-a80d-aaa321a79d3b] Received event network-vif-plugged-af70d3c4-b668-4cfa-92fb-5bf17a903572 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:48:19 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-5821f622-9d0b-46f6-9883-12a080caf337 req-d5336e3c-9aa8-413d-8766-b424057fff01 service nova] Acquiring lock "576e97b7-285a-451f-a80d-aaa321a79d3b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:48:19 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-5821f622-9d0b-46f6-9883-12a080caf337 req-d5336e3c-9aa8-413d-8766-b424057fff01 service nova] Lock "576e97b7-285a-451f-a80d-aaa321a79d3b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:48:19 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-5821f622-9d0b-46f6-9883-12a080caf337 req-d5336e3c-9aa8-413d-8766-b424057fff01 service nova] Lock "576e97b7-285a-451f-a80d-aaa321a79d3b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:48:19 user nova-compute[75216]: DEBUG nova.compute.manager [req-5821f622-9d0b-46f6-9883-12a080caf337 req-d5336e3c-9aa8-413d-8766-b424057fff01 service nova] [instance: 576e97b7-285a-451f-a80d-aaa321a79d3b] No waiting events found dispatching network-vif-plugged-af70d3c4-b668-4cfa-92fb-5bf17a903572 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:48:19 user nova-compute[75216]: WARNING nova.compute.manager [req-5821f622-9d0b-46f6-9883-12a080caf337 req-d5336e3c-9aa8-413d-8766-b424057fff01 service nova] [instance: 576e97b7-285a-451f-a80d-aaa321a79d3b] Received unexpected event network-vif-plugged-af70d3c4-b668-4cfa-92fb-5bf17a903572 for instance with vm_state deleted and task_state None.
Nov 13 18:48:19 user nova-compute[75216]: DEBUG nova.compute.manager [req-5821f622-9d0b-46f6-9883-12a080caf337 req-d5336e3c-9aa8-413d-8766-b424057fff01 service nova] [instance: 576e97b7-285a-451f-a80d-aaa321a79d3b] Received event network-vif-plugged-af70d3c4-b668-4cfa-92fb-5bf17a903572 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:48:19 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-5821f622-9d0b-46f6-9883-12a080caf337 req-d5336e3c-9aa8-413d-8766-b424057fff01 service nova] Acquiring lock "576e97b7-285a-451f-a80d-aaa321a79d3b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:48:19 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-5821f622-9d0b-46f6-9883-12a080caf337 req-d5336e3c-9aa8-413d-8766-b424057fff01 service nova] Lock "576e97b7-285a-451f-a80d-aaa321a79d3b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:48:19 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-5821f622-9d0b-46f6-9883-12a080caf337 req-d5336e3c-9aa8-413d-8766-b424057fff01 service nova] Lock "576e97b7-285a-451f-a80d-aaa321a79d3b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:48:19 user nova-compute[75216]: DEBUG nova.compute.manager [req-5821f622-9d0b-46f6-9883-12a080caf337 req-d5336e3c-9aa8-413d-8766-b424057fff01 service nova] [instance: 576e97b7-285a-451f-a80d-aaa321a79d3b] No waiting events found dispatching network-vif-plugged-af70d3c4-b668-4cfa-92fb-5bf17a903572 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:48:19 user nova-compute[75216]: WARNING nova.compute.manager [req-5821f622-9d0b-46f6-9883-12a080caf337 req-d5336e3c-9aa8-413d-8766-b424057fff01 service nova] [instance: 576e97b7-285a-451f-a80d-aaa321a79d3b] Received unexpected event network-vif-plugged-af70d3c4-b668-4cfa-92fb-5bf17a903572 for instance with vm_state deleted and task_state None.
Nov 13 18:48:19 user nova-compute[75216]: DEBUG nova.compute.manager [req-5821f622-9d0b-46f6-9883-12a080caf337 req-d5336e3c-9aa8-413d-8766-b424057fff01 service nova] [instance: 576e97b7-285a-451f-a80d-aaa321a79d3b] Received event network-vif-unplugged-af70d3c4-b668-4cfa-92fb-5bf17a903572 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:48:19 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-5821f622-9d0b-46f6-9883-12a080caf337 req-d5336e3c-9aa8-413d-8766-b424057fff01 service nova] Acquiring lock "576e97b7-285a-451f-a80d-aaa321a79d3b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:48:19 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-5821f622-9d0b-46f6-9883-12a080caf337 req-d5336e3c-9aa8-413d-8766-b424057fff01 service nova] Lock "576e97b7-285a-451f-a80d-aaa321a79d3b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:48:19 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-5821f622-9d0b-46f6-9883-12a080caf337 req-d5336e3c-9aa8-413d-8766-b424057fff01 service nova] Lock "576e97b7-285a-451f-a80d-aaa321a79d3b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:48:19 user nova-compute[75216]: DEBUG nova.compute.manager [req-5821f622-9d0b-46f6-9883-12a080caf337 req-d5336e3c-9aa8-413d-8766-b424057fff01 service nova] [instance: 576e97b7-285a-451f-a80d-aaa321a79d3b] No waiting events found dispatching network-vif-unplugged-af70d3c4-b668-4cfa-92fb-5bf17a903572 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:48:19 user nova-compute[75216]: WARNING nova.compute.manager [req-5821f622-9d0b-46f6-9883-12a080caf337 req-d5336e3c-9aa8-413d-8766-b424057fff01 service nova] [instance: 576e97b7-285a-451f-a80d-aaa321a79d3b] Received unexpected event network-vif-unplugged-af70d3c4-b668-4cfa-92fb-5bf17a903572 for instance with vm_state deleted and task_state None.
Nov 13 18:48:19 user nova-compute[75216]: DEBUG nova.compute.manager [req-5821f622-9d0b-46f6-9883-12a080caf337 req-d5336e3c-9aa8-413d-8766-b424057fff01 service nova] [instance: 576e97b7-285a-451f-a80d-aaa321a79d3b] Received event network-vif-plugged-af70d3c4-b668-4cfa-92fb-5bf17a903572 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:48:19 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-5821f622-9d0b-46f6-9883-12a080caf337 req-d5336e3c-9aa8-413d-8766-b424057fff01 service nova] Acquiring lock "576e97b7-285a-451f-a80d-aaa321a79d3b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:48:19 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-5821f622-9d0b-46f6-9883-12a080caf337 req-d5336e3c-9aa8-413d-8766-b424057fff01 service nova] Lock "576e97b7-285a-451f-a80d-aaa321a79d3b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:48:19 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-5821f622-9d0b-46f6-9883-12a080caf337 req-d5336e3c-9aa8-413d-8766-b424057fff01 service nova] Lock "576e97b7-285a-451f-a80d-aaa321a79d3b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:48:19 user nova-compute[75216]: DEBUG nova.compute.manager [req-5821f622-9d0b-46f6-9883-12a080caf337 req-d5336e3c-9aa8-413d-8766-b424057fff01 service nova] [instance: 576e97b7-285a-451f-a80d-aaa321a79d3b] No waiting events found dispatching network-vif-plugged-af70d3c4-b668-4cfa-92fb-5bf17a903572 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:48:19 user nova-compute[75216]: WARNING nova.compute.manager [req-5821f622-9d0b-46f6-9883-12a080caf337 req-d5336e3c-9aa8-413d-8766-b424057fff01 service nova] [instance: 576e97b7-285a-451f-a80d-aaa321a79d3b] Received unexpected event network-vif-plugged-af70d3c4-b668-4cfa-92fb-5bf17a903572 for instance with vm_state deleted and task_state None.
Nov 13 18:48:19 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-668a039d-3e89-446d-ac6c-3c1813d6a41c tempest-VolumesAssistedSnapshotsTest-1233733883 tempest-VolumesAssistedSnapshotsTest-1233733883-project-member] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 18:48:19 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-668a039d-3e89-446d-ac6c-3c1813d6a41c tempest-VolumesAssistedSnapshotsTest-1233733883 tempest-VolumesAssistedSnapshotsTest-1233733883-project-member] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 18:48:20 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-668a039d-3e89-446d-ac6c-3c1813d6a41c tempest-VolumesAssistedSnapshotsTest-1233733883 tempest-VolumesAssistedSnapshotsTest-1233733883-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.574s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:48:20 user nova-compute[75216]: INFO nova.scheduler.client.report [None req-668a039d-3e89-446d-ac6c-3c1813d6a41c tempest-VolumesAssistedSnapshotsTest-1233733883 tempest-VolumesAssistedSnapshotsTest-1233733883-project-member] Deleted allocations for instance 576e97b7-285a-451f-a80d-aaa321a79d3b
Nov 13 18:48:20 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-668a039d-3e89-446d-ac6c-3c1813d6a41c tempest-VolumesAssistedSnapshotsTest-1233733883 tempest-VolumesAssistedSnapshotsTest-1233733883-project-member] Lock "576e97b7-285a-451f-a80d-aaa321a79d3b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.010s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:48:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:48:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:48:27 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:48:27 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:48:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:48:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:48:30 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-ef5ddb46-3c19-45fc-98e2-f0eee5ebf1e5 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Acquiring lock "7c9d9c1b-6df5-41ff-a696-871e70d04e07" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:48:30 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-ef5ddb46-3c19-45fc-98e2-f0eee5ebf1e5 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Lock "7c9d9c1b-6df5-41ff-a696-871e70d04e07" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:48:30 user nova-compute[75216]: DEBUG nova.compute.manager [None req-ef5ddb46-3c19-45fc-98e2-f0eee5ebf1e5 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: 7c9d9c1b-6df5-41ff-a696-871e70d04e07] Starting instance... {{(pid=75216) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 18:48:31 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:48:31 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-ef5ddb46-3c19-45fc-98e2-f0eee5ebf1e5 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:48:31 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-ef5ddb46-3c19-45fc-98e2-f0eee5ebf1e5 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:48:31 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-ef5ddb46-3c19-45fc-98e2-f0eee5ebf1e5 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75216) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 18:48:31 user nova-compute[75216]: INFO nova.compute.claims [None req-ef5ddb46-3c19-45fc-98e2-f0eee5ebf1e5 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: 7c9d9c1b-6df5-41ff-a696-871e70d04e07] Claim successful on node user
Nov 13 18:48:31 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:48:31 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-ef5ddb46-3c19-45fc-98e2-f0eee5ebf1e5 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 18:48:31 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-ef5ddb46-3c19-45fc-98e2-f0eee5ebf1e5 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 18:48:31 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-ef5ddb46-3c19-45fc-98e2-f0eee5ebf1e5 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.564s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:48:31 user nova-compute[75216]: DEBUG nova.compute.manager [None req-ef5ddb46-3c19-45fc-98e2-f0eee5ebf1e5 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: 7c9d9c1b-6df5-41ff-a696-871e70d04e07] Start building networks asynchronously for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 18:48:31 user nova-compute[75216]: DEBUG nova.compute.manager [None req-ef5ddb46-3c19-45fc-98e2-f0eee5ebf1e5 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: 7c9d9c1b-6df5-41ff-a696-871e70d04e07] Allocating IP information in the background. {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 18:48:31 user nova-compute[75216]: DEBUG nova.network.neutron [None req-ef5ddb46-3c19-45fc-98e2-f0eee5ebf1e5 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: 7c9d9c1b-6df5-41ff-a696-871e70d04e07] allocate_for_instance() {{(pid=75216) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 18:48:31 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-ef5ddb46-3c19-45fc-98e2-f0eee5ebf1e5 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: 7c9d9c1b-6df5-41ff-a696-871e70d04e07] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 18:48:31 user nova-compute[75216]: DEBUG nova.compute.manager [None req-ef5ddb46-3c19-45fc-98e2-f0eee5ebf1e5 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: 7c9d9c1b-6df5-41ff-a696-871e70d04e07] Start building block device mappings for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 18:48:31 user nova-compute[75216]: DEBUG nova.policy [None req-ef5ddb46-3c19-45fc-98e2-f0eee5ebf1e5 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '23f029ff09464d699e5bd6dbf44a905d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b7e11038e54e368acd22d06e54a351', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75216) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 18:48:31 user nova-compute[75216]: DEBUG nova.compute.manager [None req-ef5ddb46-3c19-45fc-98e2-f0eee5ebf1e5 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: 7c9d9c1b-6df5-41ff-a696-871e70d04e07] Start spawning the instance on the hypervisor. {{(pid=75216) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 18:48:31 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-ef5ddb46-3c19-45fc-98e2-f0eee5ebf1e5 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: 7c9d9c1b-6df5-41ff-a696-871e70d04e07] Creating instance directory {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 18:48:31 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-ef5ddb46-3c19-45fc-98e2-f0eee5ebf1e5 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: 7c9d9c1b-6df5-41ff-a696-871e70d04e07] Creating image(s)
Nov 13 18:48:31 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-ef5ddb46-3c19-45fc-98e2-f0eee5ebf1e5 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Acquiring lock "/opt/stack/data/nova/instances/7c9d9c1b-6df5-41ff-a696-871e70d04e07/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:48:31 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-ef5ddb46-3c19-45fc-98e2-f0eee5ebf1e5 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Lock "/opt/stack/data/nova/instances/7c9d9c1b-6df5-41ff-a696-871e70d04e07/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:48:31 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-ef5ddb46-3c19-45fc-98e2-f0eee5ebf1e5 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Lock "/opt/stack/data/nova/instances/7c9d9c1b-6df5-41ff-a696-871e70d04e07/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:48:31 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-ef5ddb46-3c19-45fc-98e2-f0eee5ebf1e5 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:48:32 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-ef5ddb46-3c19-45fc-98e2-f0eee5ebf1e5 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json" returned: 0 in 0.225s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:48:32 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-ef5ddb46-3c19-45fc-98e2-f0eee5ebf1e5 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Acquiring lock "88c50a45bec9d6b0427462b3242b9b8e5f49c2b6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:48:32 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-ef5ddb46-3c19-45fc-98e2-f0eee5ebf1e5 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Lock "88c50a45bec9d6b0427462b3242b9b8e5f49c2b6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.006s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:48:32 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-ef5ddb46-3c19-45fc-98e2-f0eee5ebf1e5 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:48:32 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-ef5ddb46-3c19-45fc-98e2-f0eee5ebf1e5 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json" returned: 0 in 0.224s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:48:32 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-ef5ddb46-3c19-45fc-98e2-f0eee5ebf1e5 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6,backing_fmt=raw /opt/stack/data/nova/instances/7c9d9c1b-6df5-41ff-a696-871e70d04e07/disk 1073741824 {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:48:32 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-ef5ddb46-3c19-45fc-98e2-f0eee5ebf1e5 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6,backing_fmt=raw /opt/stack/data/nova/instances/7c9d9c1b-6df5-41ff-a696-871e70d04e07/disk 1073741824" returned: 0 in 0.053s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:48:32 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-ef5ddb46-3c19-45fc-98e2-f0eee5ebf1e5 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Lock "88c50a45bec9d6b0427462b3242b9b8e5f49c2b6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.288s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:48:32 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-ef5ddb46-3c19-45fc-98e2-f0eee5ebf1e5 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:48:32 user nova-compute[75216]: DEBUG nova.network.neutron [None req-ef5ddb46-3c19-45fc-98e2-f0eee5ebf1e5 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: 7c9d9c1b-6df5-41ff-a696-871e70d04e07] Successfully created port: c7fc6ea1-71ae-4068-b4a4-e3432a82cfad {{(pid=75216) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 18:48:32 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-ef5ddb46-3c19-45fc-98e2-f0eee5ebf1e5 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json" returned: 0 in 0.215s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:48:32 user nova-compute[75216]: DEBUG nova.virt.disk.api [None req-ef5ddb46-3c19-45fc-98e2-f0eee5ebf1e5 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7c9d9c1b-6df5-41ff-a696-871e70d04e07/disk. size=1073741824 {{(pid=75216) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 18:48:32 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-ef5ddb46-3c19-45fc-98e2-f0eee5ebf1e5 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c9d9c1b-6df5-41ff-a696-871e70d04e07/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:48:32 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-ef5ddb46-3c19-45fc-98e2-f0eee5ebf1e5 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c9d9c1b-6df5-41ff-a696-871e70d04e07/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:48:32 user nova-compute[75216]: DEBUG nova.virt.disk.api [None req-ef5ddb46-3c19-45fc-98e2-f0eee5ebf1e5 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Cannot resize image /opt/stack/data/nova/instances/7c9d9c1b-6df5-41ff-a696-871e70d04e07/disk to a smaller size. {{(pid=75216) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 18:48:32 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-ef5ddb46-3c19-45fc-98e2-f0eee5ebf1e5 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: 7c9d9c1b-6df5-41ff-a696-871e70d04e07] Created local disks {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 18:48:32 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-ef5ddb46-3c19-45fc-98e2-f0eee5ebf1e5 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: 7c9d9c1b-6df5-41ff-a696-871e70d04e07] Ensure instance console log exists: /opt/stack/data/nova/instances/7c9d9c1b-6df5-41ff-a696-871e70d04e07/console.log {{(pid=75216) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 18:48:32 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-ef5ddb46-3c19-45fc-98e2-f0eee5ebf1e5 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:48:32 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-ef5ddb46-3c19-45fc-98e2-f0eee5ebf1e5 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:48:32 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-ef5ddb46-3c19-45fc-98e2-f0eee5ebf1e5 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:48:33 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:48:33 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:48:33 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-0ae7911d-1e71-4f9b-be08-b24e0dc71534 tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] Acquiring lock "872856e5-cdc4-444e-8835-55e36708d776" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:48:33 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-0ae7911d-1e71-4f9b-be08-b24e0dc71534 tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] Lock "872856e5-cdc4-444e-8835-55e36708d776" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:48:33 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-0ae7911d-1e71-4f9b-be08-b24e0dc71534 tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] Acquiring lock "872856e5-cdc4-444e-8835-55e36708d776-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:48:33 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-0ae7911d-1e71-4f9b-be08-b24e0dc71534 tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] Lock "872856e5-cdc4-444e-8835-55e36708d776-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:48:33 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-0ae7911d-1e71-4f9b-be08-b24e0dc71534 tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] Lock "872856e5-cdc4-444e-8835-55e36708d776-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:48:33 user nova-compute[75216]: INFO nova.compute.manager [None req-0ae7911d-1e71-4f9b-be08-b24e0dc71534 tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] [instance: 872856e5-cdc4-444e-8835-55e36708d776] Terminating instance
Nov 13 18:48:33 user nova-compute[75216]: DEBUG nova.compute.manager [None req-0ae7911d-1e71-4f9b-be08-b24e0dc71534 tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] [instance: 872856e5-cdc4-444e-8835-55e36708d776] Start destroying the instance on the hypervisor. {{(pid=75216) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 18:48:33 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:48:33 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:48:33 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:48:33 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:48:33 user nova-compute[75216]: DEBUG nova.network.neutron [None req-ef5ddb46-3c19-45fc-98e2-f0eee5ebf1e5 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: 7c9d9c1b-6df5-41ff-a696-871e70d04e07] Successfully updated port: c7fc6ea1-71ae-4068-b4a4-e3432a82cfad {{(pid=75216) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 18:48:33 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-ef5ddb46-3c19-45fc-98e2-f0eee5ebf1e5 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Acquiring lock "refresh_cache-7c9d9c1b-6df5-41ff-a696-871e70d04e07" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 18:48:33 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-ef5ddb46-3c19-45fc-98e2-f0eee5ebf1e5 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Acquired lock "refresh_cache-7c9d9c1b-6df5-41ff-a696-871e70d04e07" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 18:48:33 user nova-compute[75216]: DEBUG nova.network.neutron [None req-ef5ddb46-3c19-45fc-98e2-f0eee5ebf1e5 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: 7c9d9c1b-6df5-41ff-a696-871e70d04e07] Building network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 18:48:33 user nova-compute[75216]: DEBUG nova.compute.manager [req-09c72f82-13df-4bd9-9369-77ea5199c611 req-df7e9d03-0fea-4217-b29f-bcd51fcb2c45 service nova] [instance: 7c9d9c1b-6df5-41ff-a696-871e70d04e07] Received event network-changed-c7fc6ea1-71ae-4068-b4a4-e3432a82cfad {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:48:33 user nova-compute[75216]: DEBUG nova.compute.manager [req-09c72f82-13df-4bd9-9369-77ea5199c611 req-df7e9d03-0fea-4217-b29f-bcd51fcb2c45 service nova] [instance: 7c9d9c1b-6df5-41ff-a696-871e70d04e07] Refreshing instance network info cache due to event network-changed-c7fc6ea1-71ae-4068-b4a4-e3432a82cfad. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 18:48:33 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-09c72f82-13df-4bd9-9369-77ea5199c611 req-df7e9d03-0fea-4217-b29f-bcd51fcb2c45 service nova] Acquiring lock "refresh_cache-7c9d9c1b-6df5-41ff-a696-871e70d04e07" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 18:48:33 user nova-compute[75216]: DEBUG nova.network.neutron [None req-ef5ddb46-3c19-45fc-98e2-f0eee5ebf1e5 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: 7c9d9c1b-6df5-41ff-a696-871e70d04e07] Instance cache missing network info. {{(pid=75216) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 18:48:33 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:48:34 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 872856e5-cdc4-444e-8835-55e36708d776] Instance destroyed successfully.
Nov 13 18:48:34 user nova-compute[75216]: DEBUG nova.objects.instance [None req-0ae7911d-1e71-4f9b-be08-b24e0dc71534 tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] Lazy-loading 'resources' on Instance uuid 872856e5-cdc4-444e-8835-55e36708d776 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 18:48:34 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-0ae7911d-1e71-4f9b-be08-b24e0dc71534 tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T18:45:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1869777560',display_name='tempest-TestVolumeSwap-server-1869777560',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1869777560',id=7,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNzwwoef1ZbrsFPrKPP4nqNUUInozLsiDXyu7XYjWtk1tyJvFx18YhtE8Us2TK+oD/Kadav8Y+h0nHYKbbfvPtX064TSnGRMOFBywFpyjdgXojfROppOsb6bW75Jx+xD9A==',key_name='tempest-keypair-1485195297',keypairs=<?>,launch_index=0,launched_at=2023-11-13T18:45:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='462d302bb02243f89ec881369fcf7301',ramdisk_id='',reservation_id='r-qob74pu4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-990658792',owner_user_name='tempest-TestVolumeSwap-990658792-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T18:45:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='85d5c0c3293f41ec9adb01dceb492c27',uuid=872856e5-cdc4-444e-8835-55e36708d776,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "296cb77a-c087-4484-adf2-7fd703942e0d", "address": "fa:16:3e:86:fe:e9", "network": {"id": "14e06b65-d8b1-43d1-a1f3-03e6c82ecc39", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2042637446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "462d302bb02243f89ec881369fcf7301", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap296cb77a-c0", "ovs_interfaceid": "296cb77a-c087-4484-adf2-7fd703942e0d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 18:48:34 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-0ae7911d-1e71-4f9b-be08-b24e0dc71534 tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] Converting VIF {"id": "296cb77a-c087-4484-adf2-7fd703942e0d", "address": "fa:16:3e:86:fe:e9", "network": {"id": "14e06b65-d8b1-43d1-a1f3-03e6c82ecc39", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2042637446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "462d302bb02243f89ec881369fcf7301", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap296cb77a-c0", "ovs_interfaceid": "296cb77a-c087-4484-adf2-7fd703942e0d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 18:48:34 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-0ae7911d-1e71-4f9b-be08-b24e0dc71534 tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:86:fe:e9,bridge_name='br-int',has_traffic_filtering=True,id=296cb77a-c087-4484-adf2-7fd703942e0d,network=Network(14e06b65-d8b1-43d1-a1f3-03e6c82ecc39),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap296cb77a-c0') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 18:48:34 user nova-compute[75216]: DEBUG os_vif [None req-0ae7911d-1e71-4f9b-be08-b24e0dc71534 tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:86:fe:e9,bridge_name='br-int',has_traffic_filtering=True,id=296cb77a-c087-4484-adf2-7fd703942e0d,network=Network(14e06b65-d8b1-43d1-a1f3-03e6c82ecc39),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap296cb77a-c0') {{(pid=75216) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 18:48:34 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:48:34 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap296cb77a-c0, bridge=br-int, if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:48:34 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:48:34 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:48:34 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0b1ca8df-64b4-442c-99f2-460185ac59d7) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:48:34 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:48:34 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:48:34 user nova-compute[75216]: INFO os_vif [None req-0ae7911d-1e71-4f9b-be08-b24e0dc71534 tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:86:fe:e9,bridge_name='br-int',has_traffic_filtering=True,id=296cb77a-c087-4484-adf2-7fd703942e0d,network=Network(14e06b65-d8b1-43d1-a1f3-03e6c82ecc39),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap296cb77a-c0')
Nov 13 18:48:34 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-0ae7911d-1e71-4f9b-be08-b24e0dc71534 tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] [instance: 872856e5-cdc4-444e-8835-55e36708d776] Deleting instance files /opt/stack/data/nova/instances/872856e5-cdc4-444e-8835-55e36708d776_del
Nov 13 18:48:34 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-0ae7911d-1e71-4f9b-be08-b24e0dc71534 tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] [instance: 872856e5-cdc4-444e-8835-55e36708d776] Deletion of /opt/stack/data/nova/instances/872856e5-cdc4-444e-8835-55e36708d776_del complete
Nov 13 18:48:34 user nova-compute[75216]: INFO nova.compute.manager [None req-0ae7911d-1e71-4f9b-be08-b24e0dc71534 tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] [instance: 872856e5-cdc4-444e-8835-55e36708d776] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 13 18:48:34 user nova-compute[75216]: DEBUG oslo.service.loopingcall [None req-0ae7911d-1e71-4f9b-be08-b24e0dc71534 tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75216) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 18:48:34 user nova-compute[75216]: DEBUG nova.compute.manager [-] [instance: 872856e5-cdc4-444e-8835-55e36708d776] Deallocating network for instance {{(pid=75216) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 18:48:34 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: 872856e5-cdc4-444e-8835-55e36708d776] deallocate_for_instance() {{(pid=75216) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 18:48:34 user nova-compute[75216]: DEBUG nova.network.neutron [None req-ef5ddb46-3c19-45fc-98e2-f0eee5ebf1e5 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: 7c9d9c1b-6df5-41ff-a696-871e70d04e07] Updating instance_info_cache with network_info: [{"id": "c7fc6ea1-71ae-4068-b4a4-e3432a82cfad", "address": "fa:16:3e:57:f0:d2", "network": {"id": "d7a691f0-4495-40ad-a349-91b5dc9c635a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-961583097-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9b7e11038e54e368acd22d06e54a351", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7fc6ea1-71", "ovs_interfaceid": "c7fc6ea1-71ae-4068-b4a4-e3432a82cfad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 18:48:34 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-ef5ddb46-3c19-45fc-98e2-f0eee5ebf1e5 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Releasing lock "refresh_cache-7c9d9c1b-6df5-41ff-a696-871e70d04e07" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 18:48:34 user nova-compute[75216]: DEBUG nova.compute.manager [None req-ef5ddb46-3c19-45fc-98e2-f0eee5ebf1e5 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: 7c9d9c1b-6df5-41ff-a696-871e70d04e07] Instance network_info: |[{"id": "c7fc6ea1-71ae-4068-b4a4-e3432a82cfad", "address": "fa:16:3e:57:f0:d2", "network": {"id": "d7a691f0-4495-40ad-a349-91b5dc9c635a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-961583097-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9b7e11038e54e368acd22d06e54a351", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7fc6ea1-71", "ovs_interfaceid": "c7fc6ea1-71ae-4068-b4a4-e3432a82cfad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 18:48:34 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-09c72f82-13df-4bd9-9369-77ea5199c611 req-df7e9d03-0fea-4217-b29f-bcd51fcb2c45 service nova] Acquired lock "refresh_cache-7c9d9c1b-6df5-41ff-a696-871e70d04e07" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 18:48:34 user nova-compute[75216]: DEBUG nova.network.neutron [req-09c72f82-13df-4bd9-9369-77ea5199c611 req-df7e9d03-0fea-4217-b29f-bcd51fcb2c45 service nova] [instance: 7c9d9c1b-6df5-41ff-a696-871e70d04e07] Refreshing network info cache for port c7fc6ea1-71ae-4068-b4a4-e3432a82cfad {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 18:48:34 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-ef5ddb46-3c19-45fc-98e2-f0eee5ebf1e5 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: 7c9d9c1b-6df5-41ff-a696-871e70d04e07] Start _get_guest_xml network_info=[{"id": "c7fc6ea1-71ae-4068-b4a4-e3432a82cfad", "address": "fa:16:3e:57:f0:d2", "network": {"id": "d7a691f0-4495-40ad-a349-91b5dc9c635a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-961583097-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9b7e11038e54e368acd22d06e54a351", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7fc6ea1-71", "ovs_interfaceid": "c7fc6ea1-71ae-4068-b4a4-e3432a82cfad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T18:41:06Z,direct_url=<?>,disk_format='qcow2',id=77bcb5ba-8510-41ec-a88d-96097bb431de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c465b7c26ec44582b6d1b7169536ecc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T18:41:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'guest_format': None, 'boot_index': 0, 'image_id': '77bcb5ba-8510-41ec-a88d-96097bb431de'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 18:48:34 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-ef5ddb46-3c19-45fc-98e2-f0eee5ebf1e5 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 18:48:34 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-ef5ddb46-3c19-45fc-98e2-f0eee5ebf1e5 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 18:48:34 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-ef5ddb46-3c19-45fc-98e2-f0eee5ebf1e5 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 18:48:34 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-ef5ddb46-3c19-45fc-98e2-f0eee5ebf1e5 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] CPU controller missing on host. {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 18:48:34 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-ef5ddb46-3c19-45fc-98e2-f0eee5ebf1e5 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 18:48:34 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-ef5ddb46-3c19-45fc-98e2-f0eee5ebf1e5 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] CPU controller found on host. {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 18:48:34 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-ef5ddb46-3c19-45fc-98e2-f0eee5ebf1e5 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75216) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 18:48:34 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-ef5ddb46-3c19-45fc-98e2-f0eee5ebf1e5 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T18:40:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T18:41:06Z,direct_url=<?>,disk_format='qcow2',id=77bcb5ba-8510-41ec-a88d-96097bb431de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c465b7c26ec44582b6d1b7169536ecc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T18:41:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 18:48:34 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-ef5ddb46-3c19-45fc-98e2-f0eee5ebf1e5 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Flavor limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 18:48:34 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-ef5ddb46-3c19-45fc-98e2-f0eee5ebf1e5 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Image limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 18:48:34 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-ef5ddb46-3c19-45fc-98e2-f0eee5ebf1e5 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Flavor pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 18:48:34 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-ef5ddb46-3c19-45fc-98e2-f0eee5ebf1e5 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Image pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 18:48:34 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-ef5ddb46-3c19-45fc-98e2-f0eee5ebf1e5 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 18:48:34 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-ef5ddb46-3c19-45fc-98e2-f0eee5ebf1e5 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 18:48:34 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-ef5ddb46-3c19-45fc-98e2-f0eee5ebf1e5 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 18:48:34 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-ef5ddb46-3c19-45fc-98e2-f0eee5ebf1e5 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Got 1 possible topologies {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 18:48:34 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-ef5ddb46-3c19-45fc-98e2-f0eee5ebf1e5 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 18:48:34 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-ef5ddb46-3c19-45fc-98e2-f0eee5ebf1e5 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 18:48:34 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-ef5ddb46-3c19-45fc-98e2-f0eee5ebf1e5 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T18:48:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1402749069',display_name='tempest-tempest.common.compute-instance-1402749069',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1402749069',id=15,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB3Ae+ECFlA3sYuvUiY4zZUqwlHO9GOkN+S3EitsaTvPnKHRwjJAlSh4xDkptEhbxWjHAYqFkukQp4RTJQ+f+V7vYOIcvfMMYXH7rnQu72lMH/fbmDohZCVr2iSodUm4lA==',key_name='tempest-keypair-773824062',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b9b7e11038e54e368acd22d06e54a351',ramdisk_id='',reservation_id='r-2lvnqzq7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-537419316',owner_user_name='tempest-ServerActionsTestOtherA-537419316-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T18:48:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='23f029ff09464d699e5bd6dbf44a905d',uuid=7c9d9c1b-6df5-41ff-a696-871e70d04e07,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c7fc6ea1-71ae-4068-b4a4-e3432a82cfad", "address": "fa:16:3e:57:f0:d2", "network": {"id": "d7a691f0-4495-40ad-a349-91b5dc9c635a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-961583097-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9b7e11038e54e368acd22d06e54a351", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7fc6ea1-71", "ovs_interfaceid": "c7fc6ea1-71ae-4068-b4a4-e3432a82cfad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75216) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 18:48:34 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-ef5ddb46-3c19-45fc-98e2-f0eee5ebf1e5 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Converting VIF {"id": "c7fc6ea1-71ae-4068-b4a4-e3432a82cfad", "address": "fa:16:3e:57:f0:d2", "network": {"id": "d7a691f0-4495-40ad-a349-91b5dc9c635a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-961583097-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9b7e11038e54e368acd22d06e54a351", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7fc6ea1-71", "ovs_interfaceid": "c7fc6ea1-71ae-4068-b4a4-e3432a82cfad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 18:48:34 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-ef5ddb46-3c19-45fc-98e2-f0eee5ebf1e5 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:f0:d2,bridge_name='br-int',has_traffic_filtering=True,id=c7fc6ea1-71ae-4068-b4a4-e3432a82cfad,network=Network(d7a691f0-4495-40ad-a349-91b5dc9c635a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7fc6ea1-71') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 18:48:34 user nova-compute[75216]: DEBUG nova.objects.instance [None req-ef5ddb46-3c19-45fc-98e2-f0eee5ebf1e5 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Lazy-loading 'pci_devices' on Instance uuid 7c9d9c1b-6df5-41ff-a696-871e70d04e07 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 18:48:34 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-ef5ddb46-3c19-45fc-98e2-f0eee5ebf1e5 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: 7c9d9c1b-6df5-41ff-a696-871e70d04e07] End _get_guest_xml xml=<domain type="kvm">
Nov 13 18:48:34 user nova-compute[75216]:   <uuid>7c9d9c1b-6df5-41ff-a696-871e70d04e07</uuid>
Nov 13 18:48:34 user nova-compute[75216]:   <name>instance-0000000f</name>
Nov 13 18:48:34 user nova-compute[75216]:   <memory>524288</memory>
Nov 13 18:48:34 user nova-compute[75216]:   <vcpu>1</vcpu>
Nov 13 18:48:34 user nova-compute[75216]:   <metadata>
Nov 13 18:48:34 user nova-compute[75216]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 18:48:34 user nova-compute[75216]:       <nova:package version="0.0.0"/>
Nov 13 18:48:34 user nova-compute[75216]:       <nova:name>tempest-tempest.common.compute-instance-1402749069</nova:name>
Nov 13 18:48:34 user nova-compute[75216]:       <nova:creationTime>2023-11-13 18:48:34</nova:creationTime>
Nov 13 18:48:34 user nova-compute[75216]:       <nova:flavor name="m1.tiny">
Nov 13 18:48:34 user nova-compute[75216]:         <nova:memory>512</nova:memory>
Nov 13 18:48:34 user nova-compute[75216]:         <nova:disk>1</nova:disk>
Nov 13 18:48:34 user nova-compute[75216]:         <nova:swap>0</nova:swap>
Nov 13 18:48:34 user nova-compute[75216]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 18:48:34 user nova-compute[75216]:         <nova:vcpus>1</nova:vcpus>
Nov 13 18:48:34 user nova-compute[75216]:       </nova:flavor>
Nov 13 18:48:34 user nova-compute[75216]:       <nova:owner>
Nov 13 18:48:34 user nova-compute[75216]:         <nova:user uuid="23f029ff09464d699e5bd6dbf44a905d">tempest-ServerActionsTestOtherA-537419316-project-member</nova:user>
Nov 13 18:48:34 user nova-compute[75216]:         <nova:project uuid="b9b7e11038e54e368acd22d06e54a351">tempest-ServerActionsTestOtherA-537419316</nova:project>
Nov 13 18:48:34 user nova-compute[75216]:       </nova:owner>
Nov 13 18:48:34 user nova-compute[75216]:       <nova:root type="image" uuid="77bcb5ba-8510-41ec-a88d-96097bb431de"/>
Nov 13 18:48:34 user nova-compute[75216]:       <nova:ports>
Nov 13 18:48:34 user nova-compute[75216]:         <nova:port uuid="c7fc6ea1-71ae-4068-b4a4-e3432a82cfad">
Nov 13 18:48:34 user nova-compute[75216]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 13 18:48:34 user nova-compute[75216]:         </nova:port>
Nov 13 18:48:34 user nova-compute[75216]:       </nova:ports>
Nov 13 18:48:34 user nova-compute[75216]:     </nova:instance>
Nov 13 18:48:34 user nova-compute[75216]:   </metadata>
Nov 13 18:48:34 user nova-compute[75216]:   <sysinfo type="smbios">
Nov 13 18:48:34 user nova-compute[75216]:     <system>
Nov 13 18:48:34 user nova-compute[75216]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 18:48:34 user nova-compute[75216]:       <entry name="product">OpenStack Nova</entry>
Nov 13 18:48:34 user nova-compute[75216]:       <entry name="version">0.0.0</entry>
Nov 13 18:48:34 user nova-compute[75216]:       <entry name="serial">7c9d9c1b-6df5-41ff-a696-871e70d04e07</entry>
Nov 13 18:48:34 user nova-compute[75216]:       <entry name="uuid">7c9d9c1b-6df5-41ff-a696-871e70d04e07</entry>
Nov 13 18:48:34 user nova-compute[75216]:       <entry name="family">Virtual Machine</entry>
Nov 13 18:48:34 user nova-compute[75216]:     </system>
Nov 13 18:48:34 user nova-compute[75216]:   </sysinfo>
Nov 13 18:48:34 user nova-compute[75216]:   <os>
Nov 13 18:48:34 user nova-compute[75216]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 18:48:34 user nova-compute[75216]:     <boot dev="hd"/>
Nov 13 18:48:34 user nova-compute[75216]:     <smbios mode="sysinfo"/>
Nov 13 18:48:34 user nova-compute[75216]:   </os>
Nov 13 18:48:34 user nova-compute[75216]:   <features>
Nov 13 18:48:34 user nova-compute[75216]:     <acpi/>
Nov 13 18:48:34 user nova-compute[75216]:     <apic/>
Nov 13 18:48:34 user nova-compute[75216]:     <vmcoreinfo/>
Nov 13 18:48:34 user nova-compute[75216]:   </features>
Nov 13 18:48:34 user nova-compute[75216]:   <clock offset="utc">
Nov 13 18:48:34 user nova-compute[75216]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 18:48:34 user nova-compute[75216]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 18:48:34 user nova-compute[75216]:     <timer name="hpet" present="no"/>
Nov 13 18:48:34 user nova-compute[75216]:   </clock>
Nov 13 18:48:34 user nova-compute[75216]:   <cpu mode="custom" match="exact">
Nov 13 18:48:34 user nova-compute[75216]:     <model>Nehalem</model>
Nov 13 18:48:34 user nova-compute[75216]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 18:48:34 user nova-compute[75216]:   </cpu>
Nov 13 18:48:34 user nova-compute[75216]:   <devices>
Nov 13 18:48:34 user nova-compute[75216]:     <disk type="file" device="disk">
Nov 13 18:48:34 user nova-compute[75216]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 18:48:34 user nova-compute[75216]:       <source file="/opt/stack/data/nova/instances/7c9d9c1b-6df5-41ff-a696-871e70d04e07/disk"/>
Nov 13 18:48:34 user nova-compute[75216]:       <target dev="vda" bus="virtio"/>
Nov 13 18:48:34 user nova-compute[75216]:     </disk>
Nov 13 18:48:34 user nova-compute[75216]:     <interface type="ethernet">
Nov 13 18:48:34 user nova-compute[75216]:       <mac address="fa:16:3e:57:f0:d2"/>
Nov 13 18:48:34 user nova-compute[75216]:       <model type="virtio"/>
Nov 13 18:48:34 user nova-compute[75216]:       <mtu size="1442"/>
Nov 13 18:48:34 user nova-compute[75216]:       <target dev="tapc7fc6ea1-71"/>
Nov 13 18:48:34 user nova-compute[75216]:     </interface>
Nov 13 18:48:34 user nova-compute[75216]:     <serial type="pty">
Nov 13 18:48:34 user nova-compute[75216]:       <log file="/opt/stack/data/nova/instances/7c9d9c1b-6df5-41ff-a696-871e70d04e07/console.log" append="off"/>
Nov 13 18:48:34 user nova-compute[75216]:     </serial>
Nov 13 18:48:34 user nova-compute[75216]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 18:48:34 user nova-compute[75216]:     <video>
Nov 13 18:48:34 user nova-compute[75216]:       <model type="virtio"/>
Nov 13 18:48:34 user nova-compute[75216]:     </video>
Nov 13 18:48:34 user nova-compute[75216]:     <rng model="virtio">
Nov 13 18:48:34 user nova-compute[75216]:       <backend model="random">/dev/urandom</backend>
Nov 13 18:48:34 user nova-compute[75216]:     </rng>
Nov 13 18:48:34 user nova-compute[75216]:     <controller type="usb" index="0" model="none"/>
Nov 13 18:48:34 user nova-compute[75216]:     <memballoon model="virtio">
Nov 13 18:48:34 user nova-compute[75216]:       <stats period="10"/>
Nov 13 18:48:34 user nova-compute[75216]:     </memballoon>
Nov 13 18:48:34 user nova-compute[75216]:   </devices>
Nov 13 18:48:34 user nova-compute[75216]: </domain>
Nov 13 18:48:34 user nova-compute[75216]:  {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 18:48:34 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-ef5ddb46-3c19-45fc-98e2-f0eee5ebf1e5 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T18:48:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1402749069',display_name='tempest-tempest.common.compute-instance-1402749069',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1402749069',id=15,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB3Ae+ECFlA3sYuvUiY4zZUqwlHO9GOkN+S3EitsaTvPnKHRwjJAlSh4xDkptEhbxWjHAYqFkukQp4RTJQ+f+V7vYOIcvfMMYXH7rnQu72lMH/fbmDohZCVr2iSodUm4lA==',key_name='tempest-keypair-773824062',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b9b7e11038e54e368acd22d06e54a351',ramdisk_id='',reservation_id='r-2lvnqzq7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-537419316',owner_user_name='tempest-ServerActionsTestOtherA-537419316-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T18:48:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='23f029ff09464d699e5bd6dbf44a905d',uuid=7c9d9c1b-6df5-41ff-a696-871e70d04e07,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c7fc6ea1-71ae-4068-b4a4-e3432a82cfad", "address": "fa:16:3e:57:f0:d2", "network": {"id": "d7a691f0-4495-40ad-a349-91b5dc9c635a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-961583097-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9b7e11038e54e368acd22d06e54a351", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7fc6ea1-71", "ovs_interfaceid": "c7fc6ea1-71ae-4068-b4a4-e3432a82cfad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 18:48:34 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-ef5ddb46-3c19-45fc-98e2-f0eee5ebf1e5 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Converting VIF {"id": "c7fc6ea1-71ae-4068-b4a4-e3432a82cfad", "address": "fa:16:3e:57:f0:d2", "network": {"id": "d7a691f0-4495-40ad-a349-91b5dc9c635a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-961583097-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9b7e11038e54e368acd22d06e54a351", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7fc6ea1-71", "ovs_interfaceid": "c7fc6ea1-71ae-4068-b4a4-e3432a82cfad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 18:48:34 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-ef5ddb46-3c19-45fc-98e2-f0eee5ebf1e5 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:f0:d2,bridge_name='br-int',has_traffic_filtering=True,id=c7fc6ea1-71ae-4068-b4a4-e3432a82cfad,network=Network(d7a691f0-4495-40ad-a349-91b5dc9c635a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7fc6ea1-71') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 18:48:34 user nova-compute[75216]: DEBUG os_vif [None req-ef5ddb46-3c19-45fc-98e2-f0eee5ebf1e5 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:f0:d2,bridge_name='br-int',has_traffic_filtering=True,id=c7fc6ea1-71ae-4068-b4a4-e3432a82cfad,network=Network(d7a691f0-4495-40ad-a349-91b5dc9c635a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7fc6ea1-71') {{(pid=75216) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 18:48:34 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:48:34 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:48:34 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 18:48:34 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:48:34 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3a435999-c5e3-575f-a6bc-3d7ae3db48f5', '_type': 'linux-noop'}}, row=False) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:48:34 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:48:34 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:48:34 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc7fc6ea1-71, may_exist=True, interface_attrs={}) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:48:34 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc7fc6ea1-71, col_values=(('qos', UUID('b0501ac1-0741-499d-9db2-cf8889f1b954')),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:48:34 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc7fc6ea1-71, col_values=(('external_ids', {'iface-id': 'c7fc6ea1-71ae-4068-b4a4-e3432a82cfad', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:57:f0:d2', 'vm-uuid': '7c9d9c1b-6df5-41ff-a696-871e70d04e07'}),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:48:34 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:48:34 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:48:34 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:48:34 user nova-compute[75216]: INFO os_vif [None req-ef5ddb46-3c19-45fc-98e2-f0eee5ebf1e5 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:f0:d2,bridge_name='br-int',has_traffic_filtering=True,id=c7fc6ea1-71ae-4068-b4a4-e3432a82cfad,network=Network(d7a691f0-4495-40ad-a349-91b5dc9c635a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7fc6ea1-71')
Nov 13 18:48:34 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-ef5ddb46-3c19-45fc-98e2-f0eee5ebf1e5 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 18:48:34 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-ef5ddb46-3c19-45fc-98e2-f0eee5ebf1e5 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] No VIF found with MAC fa:16:3e:57:f0:d2, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 18:48:34 user nova-compute[75216]: DEBUG nova.network.neutron [req-09c72f82-13df-4bd9-9369-77ea5199c611 req-df7e9d03-0fea-4217-b29f-bcd51fcb2c45 service nova] [instance: 7c9d9c1b-6df5-41ff-a696-871e70d04e07] Updated VIF entry in instance network info cache for port c7fc6ea1-71ae-4068-b4a4-e3432a82cfad. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 18:48:34 user nova-compute[75216]: DEBUG nova.network.neutron [req-09c72f82-13df-4bd9-9369-77ea5199c611 req-df7e9d03-0fea-4217-b29f-bcd51fcb2c45 service nova] [instance: 7c9d9c1b-6df5-41ff-a696-871e70d04e07] Updating instance_info_cache with network_info: [{"id": "c7fc6ea1-71ae-4068-b4a4-e3432a82cfad", "address": "fa:16:3e:57:f0:d2", "network": {"id": "d7a691f0-4495-40ad-a349-91b5dc9c635a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-961583097-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9b7e11038e54e368acd22d06e54a351", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7fc6ea1-71", "ovs_interfaceid": "c7fc6ea1-71ae-4068-b4a4-e3432a82cfad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 18:48:34 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-09c72f82-13df-4bd9-9369-77ea5199c611 req-df7e9d03-0fea-4217-b29f-bcd51fcb2c45 service nova] Releasing lock "refresh_cache-7c9d9c1b-6df5-41ff-a696-871e70d04e07" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 18:48:35 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:48:35 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: 872856e5-cdc4-444e-8835-55e36708d776] Updating instance_info_cache with network_info: [] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 18:48:35 user nova-compute[75216]: INFO nova.compute.manager [-] [instance: 872856e5-cdc4-444e-8835-55e36708d776] Took 1.55 seconds to deallocate network for instance.
Nov 13 18:48:35 user nova-compute[75216]: DEBUG nova.compute.manager [req-5b46f793-4496-4fb5-9938-dd07748519a7 req-7f8729b9-496f-4136-9065-ee044d66149b service nova] [instance: 872856e5-cdc4-444e-8835-55e36708d776] Received event network-vif-deleted-296cb77a-c087-4484-adf2-7fd703942e0d {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:48:35 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-0ae7911d-1e71-4f9b-be08-b24e0dc71534 tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:48:35 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-0ae7911d-1e71-4f9b-be08-b24e0dc71534 tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:48:35 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:48:35 user nova-compute[75216]: DEBUG nova.compute.manager [req-4773d6db-f504-4fd2-8587-a0326cbf67a8 req-872dcc4e-74ef-4388-9cab-16d924b6bacc service nova] [instance: 872856e5-cdc4-444e-8835-55e36708d776] Received event network-vif-unplugged-296cb77a-c087-4484-adf2-7fd703942e0d {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:48:35 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-4773d6db-f504-4fd2-8587-a0326cbf67a8 req-872dcc4e-74ef-4388-9cab-16d924b6bacc service nova] Acquiring lock "872856e5-cdc4-444e-8835-55e36708d776-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:48:35 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-4773d6db-f504-4fd2-8587-a0326cbf67a8 req-872dcc4e-74ef-4388-9cab-16d924b6bacc service nova] Lock "872856e5-cdc4-444e-8835-55e36708d776-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:48:35 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-4773d6db-f504-4fd2-8587-a0326cbf67a8 req-872dcc4e-74ef-4388-9cab-16d924b6bacc service nova] Lock "872856e5-cdc4-444e-8835-55e36708d776-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:48:35 user nova-compute[75216]: DEBUG nova.compute.manager [req-4773d6db-f504-4fd2-8587-a0326cbf67a8 req-872dcc4e-74ef-4388-9cab-16d924b6bacc service nova] [instance: 872856e5-cdc4-444e-8835-55e36708d776] No waiting events found dispatching network-vif-unplugged-296cb77a-c087-4484-adf2-7fd703942e0d {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:48:35 user nova-compute[75216]: WARNING nova.compute.manager [req-4773d6db-f504-4fd2-8587-a0326cbf67a8 req-872dcc4e-74ef-4388-9cab-16d924b6bacc service nova] [instance: 872856e5-cdc4-444e-8835-55e36708d776] Received unexpected event network-vif-unplugged-296cb77a-c087-4484-adf2-7fd703942e0d for instance with vm_state deleted and task_state None.
Nov 13 18:48:35 user nova-compute[75216]: DEBUG nova.compute.manager [req-4773d6db-f504-4fd2-8587-a0326cbf67a8 req-872dcc4e-74ef-4388-9cab-16d924b6bacc service nova] [instance: 872856e5-cdc4-444e-8835-55e36708d776] Received event network-vif-plugged-296cb77a-c087-4484-adf2-7fd703942e0d {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:48:35 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-4773d6db-f504-4fd2-8587-a0326cbf67a8 req-872dcc4e-74ef-4388-9cab-16d924b6bacc service nova] Acquiring lock "872856e5-cdc4-444e-8835-55e36708d776-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:48:35 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-4773d6db-f504-4fd2-8587-a0326cbf67a8 req-872dcc4e-74ef-4388-9cab-16d924b6bacc service nova] Lock "872856e5-cdc4-444e-8835-55e36708d776-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:48:35 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-4773d6db-f504-4fd2-8587-a0326cbf67a8 req-872dcc4e-74ef-4388-9cab-16d924b6bacc service nova] Lock "872856e5-cdc4-444e-8835-55e36708d776-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:48:35 user nova-compute[75216]: DEBUG nova.compute.manager [req-4773d6db-f504-4fd2-8587-a0326cbf67a8 req-872dcc4e-74ef-4388-9cab-16d924b6bacc service nova] [instance: 872856e5-cdc4-444e-8835-55e36708d776] No waiting events found dispatching network-vif-plugged-296cb77a-c087-4484-adf2-7fd703942e0d {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:48:35 user nova-compute[75216]: WARNING nova.compute.manager [req-4773d6db-f504-4fd2-8587-a0326cbf67a8 req-872dcc4e-74ef-4388-9cab-16d924b6bacc service nova] [instance: 872856e5-cdc4-444e-8835-55e36708d776] Received unexpected event network-vif-plugged-296cb77a-c087-4484-adf2-7fd703942e0d for instance with vm_state deleted and task_state None.
Nov 13 18:48:35 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:48:35 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:48:35 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:48:36 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-0ae7911d-1e71-4f9b-be08-b24e0dc71534 tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 18:48:36 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:48:36 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:48:36 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-0ae7911d-1e71-4f9b-be08-b24e0dc71534 tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 18:48:36 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-0ae7911d-1e71-4f9b-be08-b24e0dc71534 tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.471s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:48:36 user nova-compute[75216]: INFO nova.scheduler.client.report [None req-0ae7911d-1e71-4f9b-be08-b24e0dc71534 tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] Deleted allocations for instance 872856e5-cdc4-444e-8835-55e36708d776
Nov 13 18:48:36 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-0ae7911d-1e71-4f9b-be08-b24e0dc71534 tempest-TestVolumeSwap-990658792 tempest-TestVolumeSwap-990658792-project-member] Lock "872856e5-cdc4-444e-8835-55e36708d776" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.133s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:48:37 user nova-compute[75216]: DEBUG nova.compute.manager [req-81ed3372-464e-4567-a65a-16fd4231767c req-90d1605f-020e-423e-8e1a-07c4f355ca32 service nova] [instance: 7c9d9c1b-6df5-41ff-a696-871e70d04e07] Received event network-vif-plugged-c7fc6ea1-71ae-4068-b4a4-e3432a82cfad {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:48:37 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-81ed3372-464e-4567-a65a-16fd4231767c req-90d1605f-020e-423e-8e1a-07c4f355ca32 service nova] Acquiring lock "7c9d9c1b-6df5-41ff-a696-871e70d04e07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:48:37 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-81ed3372-464e-4567-a65a-16fd4231767c req-90d1605f-020e-423e-8e1a-07c4f355ca32 service nova] Lock "7c9d9c1b-6df5-41ff-a696-871e70d04e07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:48:37 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-81ed3372-464e-4567-a65a-16fd4231767c req-90d1605f-020e-423e-8e1a-07c4f355ca32 service nova] Lock "7c9d9c1b-6df5-41ff-a696-871e70d04e07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:48:37 user nova-compute[75216]: DEBUG nova.compute.manager [req-81ed3372-464e-4567-a65a-16fd4231767c req-90d1605f-020e-423e-8e1a-07c4f355ca32 service nova] [instance: 7c9d9c1b-6df5-41ff-a696-871e70d04e07] No waiting events found dispatching network-vif-plugged-c7fc6ea1-71ae-4068-b4a4-e3432a82cfad {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:48:37 user nova-compute[75216]: WARNING nova.compute.manager [req-81ed3372-464e-4567-a65a-16fd4231767c req-90d1605f-020e-423e-8e1a-07c4f355ca32 service nova] [instance: 7c9d9c1b-6df5-41ff-a696-871e70d04e07] Received unexpected event network-vif-plugged-c7fc6ea1-71ae-4068-b4a4-e3432a82cfad for instance with vm_state building and task_state spawning.
Nov 13 18:48:37 user nova-compute[75216]: DEBUG nova.compute.manager [req-81ed3372-464e-4567-a65a-16fd4231767c req-90d1605f-020e-423e-8e1a-07c4f355ca32 service nova] [instance: 7c9d9c1b-6df5-41ff-a696-871e70d04e07] Received event network-vif-plugged-c7fc6ea1-71ae-4068-b4a4-e3432a82cfad {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:48:37 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-81ed3372-464e-4567-a65a-16fd4231767c req-90d1605f-020e-423e-8e1a-07c4f355ca32 service nova] Acquiring lock "7c9d9c1b-6df5-41ff-a696-871e70d04e07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:48:37 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-81ed3372-464e-4567-a65a-16fd4231767c req-90d1605f-020e-423e-8e1a-07c4f355ca32 service nova] Lock "7c9d9c1b-6df5-41ff-a696-871e70d04e07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:48:37 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-81ed3372-464e-4567-a65a-16fd4231767c req-90d1605f-020e-423e-8e1a-07c4f355ca32 service nova] Lock "7c9d9c1b-6df5-41ff-a696-871e70d04e07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:48:37 user nova-compute[75216]: DEBUG nova.compute.manager [req-81ed3372-464e-4567-a65a-16fd4231767c req-90d1605f-020e-423e-8e1a-07c4f355ca32 service nova] [instance: 7c9d9c1b-6df5-41ff-a696-871e70d04e07] No waiting events found dispatching network-vif-plugged-c7fc6ea1-71ae-4068-b4a4-e3432a82cfad {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:48:37 user nova-compute[75216]: WARNING nova.compute.manager [req-81ed3372-464e-4567-a65a-16fd4231767c req-90d1605f-020e-423e-8e1a-07c4f355ca32 service nova] [instance: 7c9d9c1b-6df5-41ff-a696-871e70d04e07] Received unexpected event network-vif-plugged-c7fc6ea1-71ae-4068-b4a4-e3432a82cfad for instance with vm_state building and task_state spawning.
Nov 13 18:48:38 user nova-compute[75216]: DEBUG nova.compute.manager [None req-ef5ddb46-3c19-45fc-98e2-f0eee5ebf1e5 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: 7c9d9c1b-6df5-41ff-a696-871e70d04e07] Instance event wait completed in 0 seconds for  {{(pid=75216) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 18:48:38 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-ef5ddb46-3c19-45fc-98e2-f0eee5ebf1e5 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: 7c9d9c1b-6df5-41ff-a696-871e70d04e07] Guest created on hypervisor {{(pid=75216) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 18:48:38 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 7c9d9c1b-6df5-41ff-a696-871e70d04e07] Instance spawned successfully.
Nov 13 18:48:38 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-ef5ddb46-3c19-45fc-98e2-f0eee5ebf1e5 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: 7c9d9c1b-6df5-41ff-a696-871e70d04e07] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 18:48:38 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-ef5ddb46-3c19-45fc-98e2-f0eee5ebf1e5 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: 7c9d9c1b-6df5-41ff-a696-871e70d04e07] Found default for hw_cdrom_bus of ide {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 18:48:38 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-ef5ddb46-3c19-45fc-98e2-f0eee5ebf1e5 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: 7c9d9c1b-6df5-41ff-a696-871e70d04e07] Found default for hw_disk_bus of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 18:48:38 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-ef5ddb46-3c19-45fc-98e2-f0eee5ebf1e5 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: 7c9d9c1b-6df5-41ff-a696-871e70d04e07] Found default for hw_input_bus of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 18:48:38 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-ef5ddb46-3c19-45fc-98e2-f0eee5ebf1e5 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: 7c9d9c1b-6df5-41ff-a696-871e70d04e07] Found default for hw_pointer_model of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 18:48:38 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-ef5ddb46-3c19-45fc-98e2-f0eee5ebf1e5 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: 7c9d9c1b-6df5-41ff-a696-871e70d04e07] Found default for hw_video_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 18:48:38 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-ef5ddb46-3c19-45fc-98e2-f0eee5ebf1e5 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: 7c9d9c1b-6df5-41ff-a696-871e70d04e07] Found default for hw_vif_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 18:48:38 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:48:38 user nova-compute[75216]: INFO nova.compute.manager [None req-ef5ddb46-3c19-45fc-98e2-f0eee5ebf1e5 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: 7c9d9c1b-6df5-41ff-a696-871e70d04e07] Took 6.37 seconds to spawn the instance on the hypervisor.
Nov 13 18:48:38 user nova-compute[75216]: DEBUG nova.compute.manager [None req-ef5ddb46-3c19-45fc-98e2-f0eee5ebf1e5 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: 7c9d9c1b-6df5-41ff-a696-871e70d04e07] Checking state {{(pid=75216) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 18:48:38 user nova-compute[75216]: INFO nova.compute.manager [None req-ef5ddb46-3c19-45fc-98e2-f0eee5ebf1e5 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: 7c9d9c1b-6df5-41ff-a696-871e70d04e07] Took 7.33 seconds to build instance.
Nov 13 18:48:38 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-ef5ddb46-3c19-45fc-98e2-f0eee5ebf1e5 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Lock "7c9d9c1b-6df5-41ff-a696-871e70d04e07" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.447s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:48:38 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-946dac85-7fb0-4db3-b97f-368d45cb91dc tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] Acquiring lock "9b078f75-57f2-495a-abd5-f8adf72db80b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:48:38 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-946dac85-7fb0-4db3-b97f-368d45cb91dc tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] Lock "9b078f75-57f2-495a-abd5-f8adf72db80b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:48:38 user nova-compute[75216]: DEBUG nova.objects.instance [None req-946dac85-7fb0-4db3-b97f-368d45cb91dc tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] Lazy-loading 'flavor' on Instance uuid 9b078f75-57f2-495a-abd5-f8adf72db80b {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 18:48:38 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-946dac85-7fb0-4db3-b97f-368d45cb91dc tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] Lock "9b078f75-57f2-495a-abd5-f8adf72db80b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:48:38 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-946dac85-7fb0-4db3-b97f-368d45cb91dc tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] Acquiring lock "9b078f75-57f2-495a-abd5-f8adf72db80b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:48:38 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-946dac85-7fb0-4db3-b97f-368d45cb91dc tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] Lock "9b078f75-57f2-495a-abd5-f8adf72db80b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:48:38 user nova-compute[75216]: INFO nova.compute.manager [None req-946dac85-7fb0-4db3-b97f-368d45cb91dc tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] [instance: 9b078f75-57f2-495a-abd5-f8adf72db80b] Attaching volume bf4e9e60-f40d-49e0-8234-ae45c23b695b to /dev/vdb
Nov 13 18:48:38 user nova-compute[75216]: DEBUG os_brick.utils [None req-946dac85-7fb0-4db3-b97f-368d45cb91dc tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 18:48:38 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:48:38 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:48:38 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[077fc244-9ca1-45da-a855-98ba76535170]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aea6fcfe14b9\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:48:38 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:48:38 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:48:38 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[94bc4c32-28e0-4c25-87b6-e1e34a4bb644]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:48:38 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:48:38 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:48:38 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d280126-f3fb-4cf8-94a3-2c17b2294dba]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:48:38 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9c94ba3-42cd-4bc6-8779-7049f0ee344a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:48:38 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-946dac85-7fb0-4db3-b97f-368d45cb91dc tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] Running cmd (subprocess): nvme version {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:48:38 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-946dac85-7fb0-4db3-b97f-368d45cb91dc tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] 'nvme version' failed. Not Retrying. {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 18:48:39 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.nvmeof [None req-946dac85-7fb0-4db3-b97f-368d45cb91dc tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] nvme not present on system {{(pid=75216) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 18:48:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:48:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 18:48:39 user nova-compute[75216]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 18:48:39 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[7adb1099-458f-44a7-8964-dfbff947e23b]: (4, '') {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:48:39 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-946dac85-7fb0-4db3-b97f-368d45cb91dc tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75216) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 18:48:39 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-946dac85-7fb0-4db3-b97f-368d45cb91dc tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 18:48:39 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-946dac85-7fb0-4db3-b97f-368d45cb91dc tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] LIGHTOS: no hostnqn found. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 18:48:39 user nova-compute[75216]: DEBUG os_brick.utils [None req-946dac85-7fb0-4db3-b97f-368d45cb91dc tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aea6fcfe14b9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 18:48:39 user nova-compute[75216]: DEBUG nova.virt.block_device [None req-946dac85-7fb0-4db3-b97f-368d45cb91dc tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] [instance: 9b078f75-57f2-495a-abd5-f8adf72db80b] Updating existing volume attachment record: 642d0524-56d0-4759-9d31-63a91b68d64b {{(pid=75216) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 18:48:39 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:48:40 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:48:42 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:48:42 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:48:43 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:48:43 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:48:43 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:48:43 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-946dac85-7fb0-4db3-b97f-368d45cb91dc tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] [instance: 9b078f75-57f2-495a-abd5-f8adf72db80b] Calling os-brick to attach iSCSI Volume {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 18:48:43 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-946dac85-7fb0-4db3-b97f-368d45cb91dc tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3a8669e40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bf4e9e60-f40d-49e0-8234-ae45c23b695b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vWqlSnQN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 18:48:43 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-946dac85-7fb0-4db3-b97f-368d45cb91dc tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 18:48:43 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-946dac85-7fb0-4db3-b97f-368d45cb91dc tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 18:48:43 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-946dac85-7fb0-4db3-b97f-368d45cb91dc tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 18:48:43 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-946dac85-7fb0-4db3-b97f-368d45cb91dc tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 18:48:43 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-946dac85-7fb0-4db3-b97f-368d45cb91dc tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bf4e9e60-f40d-49e0-8234-ae45c23b695b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 18:48:43 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-946dac85-7fb0-4db3-b97f-368d45cb91dc tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bf4e9e60-f40d-49e0-8234-ae45c23b695b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 18:48:43 user nova-compute[75216]: INFO os_brick.initiator.connectors.iscsi [None req-946dac85-7fb0-4db3-b97f-368d45cb91dc tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 18:48:43 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf4e9e60-f40d-49e0-8234-ae45c23b695b -p 172.16.0.220:3260 {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:48:43 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf4e9e60-f40d-49e0-8234-ae45c23b695b -p 172.16.0.220:3260" returned: 21 in 0.052s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:48:43 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[812a0688-ee12-4f6a-854d-622ea667a18e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:48:43 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-946dac85-7fb0-4db3-b97f-368d45cb91dc tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 18:48:43 user nova-compute[75216]:  {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:48:43 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf4e9e60-f40d-49e0-8234-ae45c23b695b -p 172.16.0.220:3260 --interface default --op new {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:48:43 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf4e9e60-f40d-49e0-8234-ae45c23b695b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.032s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:48:43 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a7a8bad-8a43-4697-9b4a-1d5de7091dfb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bf4e9e60-f40d-49e0-8234-ae45c23b695b] added\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:48:43 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-946dac85-7fb0-4db3-b97f-368d45cb91dc tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bf4e9e60-f40d-49e0-8234-ae45c23b695b] added
Nov 13 18:48:43 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:48:43 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf4e9e60-f40d-49e0-8234-ae45c23b695b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:48:43 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf4e9e60-f40d-49e0-8234-ae45c23b695b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:48:43 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbe03f5c-b2c2-4a55-b226-ee16ac0c52ef]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:48:43 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-946dac85-7fb0-4db3-b97f-368d45cb91dc tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:48:43 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf4e9e60-f40d-49e0-8234-ae45c23b695b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:48:43 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf4e9e60-f40d-49e0-8234-ae45c23b695b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:48:43 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d570042-8eeb-4d90-90f6-4c32cb5c34b9]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:48:43 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-946dac85-7fb0-4db3-b97f-368d45cb91dc tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:48:43 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf4e9e60-f40d-49e0-8234-ae45c23b695b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vWqlSnQN {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:48:43 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf4e9e60-f40d-49e0-8234-ae45c23b695b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vWqlSnQN" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:48:43 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c66551b-0bf7-44f7-ab70-6cd9e6ecc618]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:48:43 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-946dac85-7fb0-4db3-b97f-368d45cb91dc tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vWqlSnQN'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:48:43 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf4e9e60-f40d-49e0-8234-ae45c23b695b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:48:43 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf4e9e60-f40d-49e0-8234-ae45c23b695b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:48:43 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[c024be3e-4f8a-4b07-a5b1-ec4c85cf6d10]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:48:43 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-946dac85-7fb0-4db3-b97f-368d45cb91dc tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:48:43 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:48:43 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:48:43 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[acfeab24-d2b7-4f9e-8bd9-2d32ed56153a]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:48:43 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-946dac85-7fb0-4db3-b97f-368d45cb91dc tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 13 18:48:43 user nova-compute[75216]:  {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 18:48:43 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-946dac85-7fb0-4db3-b97f-368d45cb91dc tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 13 18:48:43 user nova-compute[75216]:  {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 18:48:43 user nova-compute[75216]: WARNING os_brick.initiator.connectors.iscsi [None req-946dac85-7fb0-4db3-b97f-368d45cb91dc tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 13 18:48:43 user nova-compute[75216]: 
Nov 13 18:48:43 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf4e9e60-f40d-49e0-8234-ae45c23b695b -p 172.16.0.220:3260 --login {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:48:43 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf4e9e60-f40d-49e0-8234-ae45c23b695b -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:48:43 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb5728b8-3e89-4ef5-97f3-22c28bef07ad]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bf4e9e60-f40d-49e0-8234-ae45c23b695b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bf4e9e60-f40d-49e0-8234-ae45c23b695b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:48:43 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-946dac85-7fb0-4db3-b97f-368d45cb91dc tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bf4e9e60-f40d-49e0-8234-ae45c23b695b, portal: 172.16.0.220,3260]
Nov 13 18:48:43 user nova-compute[75216]: Login to [iface: default, target: iqn.2010-10.org.openstack:bf4e9e60-f40d-49e0-8234-ae45c23b695b, portal: 172.16.0.220,3260] successful.
Nov 13 18:48:43 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:48:43 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf4e9e60-f40d-49e0-8234-ae45c23b695b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:48:43 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf4e9e60-f40d-49e0-8234-ae45c23b695b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:48:43 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[75302abe-1ae1-4875-8410-bdbc842fcc50]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:48:43 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-946dac85-7fb0-4db3-b97f-368d45cb91dc tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:48:43 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:48:43 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:48:43 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cfe355f-2ef7-48d5-bb3e-32d99770f3b0]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf4e9e60-f40d-49e0-8234-ae45c23b695b (non-flash)\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:48:43 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-946dac85-7fb0-4db3-b97f-368d45cb91dc tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf4e9e60-f40d-49e0-8234-ae45c23b695b (non-flash)
Nov 13 18:48:43 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 18:48:43 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-946dac85-7fb0-4db3-b97f-368d45cb91dc tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf4e9e60-f40d-49e0-8234-ae45c23b695b (non-flash)
Nov 13 18:48:43 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 18:48:43 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-946dac85-7fb0-4db3-b97f-368d45cb91dc tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bf4e9e60-f40d-49e0-8234-ae45c23b695b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.330s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 18:48:43 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-946dac85-7fb0-4db3-b97f-368d45cb91dc tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] Connected to 172.16.0.220:3260 {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 18:48:43 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-946dac85-7fb0-4db3-b97f-368d45cb91dc tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] HCTL ('33', '-', '-', 0) found on session 16 with lun 0 {{(pid=75216) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 18:48:43 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-946dac85-7fb0-4db3-b97f-368d45cb91dc tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75216) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 18:48:43 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:48:43 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:48:43 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[7197625c-cd03-4e94-83a6-ee3b960b09ab]: (4, ('- - 0', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:48:43 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-946dac85-7fb0-4db3-b97f-368d45cb91dc tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] Searching for a device in session 16 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75216) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 18:48:43 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-946dac85-7fb0-4db3-b97f-368d45cb91dc tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:bf4e9e60-f40d-49e0-8234-ae45c23b695b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vWqlSnQN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 18:48:44 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:48:44 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:48:44 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:48:44 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:48:44 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75216) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 18:48:44 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-946dac85-7fb0-4db3-b97f-368d45cb91dc tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.365s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 18:48:44 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-946dac85-7fb0-4db3-b97f-368d45cb91dc tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] <== connect_volume: return (1367ms) {'type': 'block', 'scsi_wwn': '23162336131353762', 'path': '/dev/sdb'} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 18:48:44 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-946dac85-7fb0-4db3-b97f-368d45cb91dc tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] [instance: 9b078f75-57f2-495a-abd5-f8adf72db80b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23162336131353762', 'path': '/dev/sdb'} {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 18:48:44 user nova-compute[75216]: DEBUG nova.objects.instance [None req-946dac85-7fb0-4db3-b97f-368d45cb91dc tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] Lazy-loading 'flavor' on Instance uuid 9b078f75-57f2-495a-abd5-f8adf72db80b {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 18:48:44 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-946dac85-7fb0-4db3-b97f-368d45cb91dc tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] attach device xml: <disk type="block" device="disk">
Nov 13 18:48:44 user nova-compute[75216]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 18:48:44 user nova-compute[75216]:   <source dev="/dev/sdb"/>
Nov 13 18:48:44 user nova-compute[75216]:   <target dev="vdb" bus="virtio"/>
Nov 13 18:48:44 user nova-compute[75216]:   <serial>bf4e9e60-f40d-49e0-8234-ae45c23b695b</serial>
Nov 13 18:48:44 user nova-compute[75216]: </disk>
Nov 13 18:48:44 user nova-compute[75216]:  {{(pid=75216) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 13 18:48:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-0c07ce82-71f4-4d90-bf03-02377df1ff8e tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] Acquiring lock "3679beb0-5244-443a-8512-38b29ccb62f0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:48:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-0c07ce82-71f4-4d90-bf03-02377df1ff8e tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] Lock "3679beb0-5244-443a-8512-38b29ccb62f0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:48:45 user nova-compute[75216]: DEBUG nova.compute.manager [None req-0c07ce82-71f4-4d90-bf03-02377df1ff8e tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] [instance: 3679beb0-5244-443a-8512-38b29ccb62f0] Starting instance... {{(pid=75216) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 18:48:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-0c07ce82-71f4-4d90-bf03-02377df1ff8e tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:48:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-0c07ce82-71f4-4d90-bf03-02377df1ff8e tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:48:45 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-0c07ce82-71f4-4d90-bf03-02377df1ff8e tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75216) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 18:48:45 user nova-compute[75216]: INFO nova.compute.claims [None req-0c07ce82-71f4-4d90-bf03-02377df1ff8e tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] [instance: 3679beb0-5244-443a-8512-38b29ccb62f0] Claim successful on node user
Nov 13 18:48:45 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:48:45 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Starting heal instance info cache {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 18:48:45 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-946dac85-7fb0-4db3-b97f-368d45cb91dc tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 18:48:45 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-946dac85-7fb0-4db3-b97f-368d45cb91dc tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 18:48:45 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-946dac85-7fb0-4db3-b97f-368d45cb91dc tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] No VIF found with MAC fa:16:3e:30:88:c4, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 18:48:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "refresh_cache-9b078f75-57f2-495a-abd5-f8adf72db80b" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 18:48:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquired lock "refresh_cache-9b078f75-57f2-495a-abd5-f8adf72db80b" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 18:48:45 user nova-compute[75216]: DEBUG nova.network.neutron [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: 9b078f75-57f2-495a-abd5-f8adf72db80b] Forcefully refreshing network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 18:48:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-946dac85-7fb0-4db3-b97f-368d45cb91dc tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] Lock "9b078f75-57f2-495a-abd5-f8adf72db80b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.799s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:48:45 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-0c07ce82-71f4-4d90-bf03-02377df1ff8e tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 18:48:45 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-0c07ce82-71f4-4d90-bf03-02377df1ff8e tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 18:48:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-0c07ce82-71f4-4d90-bf03-02377df1ff8e tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.492s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:48:45 user nova-compute[75216]: DEBUG nova.compute.manager [None req-0c07ce82-71f4-4d90-bf03-02377df1ff8e tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] [instance: 3679beb0-5244-443a-8512-38b29ccb62f0] Start building networks asynchronously for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 18:48:45 user nova-compute[75216]: DEBUG nova.compute.manager [None req-0c07ce82-71f4-4d90-bf03-02377df1ff8e tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] [instance: 3679beb0-5244-443a-8512-38b29ccb62f0] Allocating IP information in the background. {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 18:48:45 user nova-compute[75216]: DEBUG nova.network.neutron [None req-0c07ce82-71f4-4d90-bf03-02377df1ff8e tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] [instance: 3679beb0-5244-443a-8512-38b29ccb62f0] allocate_for_instance() {{(pid=75216) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 18:48:45 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-0c07ce82-71f4-4d90-bf03-02377df1ff8e tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] [instance: 3679beb0-5244-443a-8512-38b29ccb62f0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 18:48:45 user nova-compute[75216]: DEBUG nova.compute.manager [None req-0c07ce82-71f4-4d90-bf03-02377df1ff8e tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] [instance: 3679beb0-5244-443a-8512-38b29ccb62f0] Start building block device mappings for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 18:48:45 user nova-compute[75216]: INFO nova.virt.block_device [None req-0c07ce82-71f4-4d90-bf03-02377df1ff8e tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] [instance: 3679beb0-5244-443a-8512-38b29ccb62f0] Booting with volume ae66a157-b0d3-4501-a728-a010d6a83a10 at /dev/vda
Nov 13 18:48:46 user nova-compute[75216]: DEBUG nova.policy [None req-0c07ce82-71f4-4d90-bf03-02377df1ff8e tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b245d24d053e4504baa2670a3fe0b2b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f28b10790a0548b785d2242360d631b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75216) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 18:48:46 user nova-compute[75216]: DEBUG nova.network.neutron [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: 9b078f75-57f2-495a-abd5-f8adf72db80b] Updating instance_info_cache with network_info: [{"id": "96bda2a6-53d1-4052-9230-4907fe60d70b", "address": "fa:16:3e:30:88:c4", "network": {"id": "eac74a7f-b8a0-4653-82a9-1113186e7682", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1781360101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e76353a038ca478598ddd984f4503e34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96bda2a6-53", "ovs_interfaceid": "96bda2a6-53d1-4052-9230-4907fe60d70b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 18:48:46 user nova-compute[75216]: DEBUG os_brick.utils [None req-0c07ce82-71f4-4d90-bf03-02377df1ff8e tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 18:48:46 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:48:46 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Releasing lock "refresh_cache-9b078f75-57f2-495a-abd5-f8adf72db80b" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 18:48:46 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: 9b078f75-57f2-495a-abd5-f8adf72db80b] Updated the network info_cache for instance {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 18:48:46 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:48:46 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:48:46 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:48:46 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[9269a341-af84-472d-a24a-945fde419b9a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aea6fcfe14b9\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:48:46 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:48:46 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:48:46 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:48:46 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:48:46 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Auditing locally available compute resources for user (node: user) {{(pid=75216) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 18:48:46 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:48:46 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb055438-5def-4908-8188-61bab6671a36]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:48:46 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:48:46 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:48:46 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c543f81-ba56-428e-b045-66dc8e99383e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:48:46 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8fa7e22-11fe-4068-92e3-02e65b397448]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:48:46 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-0c07ce82-71f4-4d90-bf03-02377df1ff8e tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] Running cmd (subprocess): nvme version {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:48:46 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-0c07ce82-71f4-4d90-bf03-02377df1ff8e tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] 'nvme version' failed. Not Retrying. {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 18:48:46 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0c07ce82-71f4-4d90-bf03-02377df1ff8e tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] nvme not present on system {{(pid=75216) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 18:48:46 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:48:46 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 18:48:46 user nova-compute[75216]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 18:48:46 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[d582de75-8b2c-4ce5-81a5-4f2e916b22da]: (4, '') {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:48:46 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-0c07ce82-71f4-4d90-bf03-02377df1ff8e tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75216) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 18:48:46 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-0c07ce82-71f4-4d90-bf03-02377df1ff8e tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 18:48:46 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-0c07ce82-71f4-4d90-bf03-02377df1ff8e tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] LIGHTOS: no hostnqn found. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 18:48:46 user nova-compute[75216]: DEBUG os_brick.utils [None req-0c07ce82-71f4-4d90-bf03-02377df1ff8e tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aea6fcfe14b9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 18:48:46 user nova-compute[75216]: DEBUG nova.virt.block_device [None req-0c07ce82-71f4-4d90-bf03-02377df1ff8e tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] [instance: 3679beb0-5244-443a-8512-38b29ccb62f0] Updating existing volume attachment record: 2be00411-327d-4e49-a75e-688a877bb0ac {{(pid=75216) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 18:48:46 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a3e849-6570-4820-97c8-75468b5bea4f/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:48:46 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a3e849-6570-4820-97c8-75468b5bea4f/disk --force-share --output=json" returned: 0 in 0.346s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:48:46 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a3e849-6570-4820-97c8-75468b5bea4f/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:48:46 user nova-compute[75216]: DEBUG nova.network.neutron [None req-0c07ce82-71f4-4d90-bf03-02377df1ff8e tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] [instance: 3679beb0-5244-443a-8512-38b29ccb62f0] Successfully created port: 9dd60454-c5ac-4afe-b6fc-ad9ba9b83423 {{(pid=75216) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 18:48:46 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a3e849-6570-4820-97c8-75468b5bea4f/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:48:46 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c9d9c1b-6df5-41ff-a696-871e70d04e07/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:48:47 user nova-compute[75216]: INFO nova.compute.manager [None req-a29a3c63-a574-4a43-b5b5-a0560bf849c9 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] [instance: 9b078f75-57f2-495a-abd5-f8adf72db80b] Rescuing
Nov 13 18:48:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a29a3c63-a574-4a43-b5b5-a0560bf849c9 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] Acquiring lock "refresh_cache-9b078f75-57f2-495a-abd5-f8adf72db80b" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 18:48:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a29a3c63-a574-4a43-b5b5-a0560bf849c9 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] Acquired lock "refresh_cache-9b078f75-57f2-495a-abd5-f8adf72db80b" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 18:48:47 user nova-compute[75216]: DEBUG nova.network.neutron [None req-a29a3c63-a574-4a43-b5b5-a0560bf849c9 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] [instance: 9b078f75-57f2-495a-abd5-f8adf72db80b] Building network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 18:48:47 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c9d9c1b-6df5-41ff-a696-871e70d04e07/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:48:47 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c9d9c1b-6df5-41ff-a696-871e70d04e07/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:48:47 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c9d9c1b-6df5-41ff-a696-871e70d04e07/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:48:47 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83fda249-9d28-4cc2-aeb0-103ce4f1faa4/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:48:47 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83fda249-9d28-4cc2-aeb0-103ce4f1faa4/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:48:47 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83fda249-9d28-4cc2-aeb0-103ce4f1faa4/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:48:47 user nova-compute[75216]: DEBUG nova.network.neutron [None req-a29a3c63-a574-4a43-b5b5-a0560bf849c9 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] [instance: 9b078f75-57f2-495a-abd5-f8adf72db80b] Updating instance_info_cache with network_info: [{"id": "96bda2a6-53d1-4052-9230-4907fe60d70b", "address": "fa:16:3e:30:88:c4", "network": {"id": "eac74a7f-b8a0-4653-82a9-1113186e7682", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1781360101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e76353a038ca478598ddd984f4503e34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96bda2a6-53", "ovs_interfaceid": "96bda2a6-53d1-4052-9230-4907fe60d70b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 18:48:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a29a3c63-a574-4a43-b5b5-a0560bf849c9 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] Releasing lock "refresh_cache-9b078f75-57f2-495a-abd5-f8adf72db80b" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 18:48:47 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83fda249-9d28-4cc2-aeb0-103ce4f1faa4/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:48:47 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d589d57e-de50-482a-843f-e8246b3d7528/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:48:47 user nova-compute[75216]: DEBUG nova.network.neutron [None req-0c07ce82-71f4-4d90-bf03-02377df1ff8e tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] [instance: 3679beb0-5244-443a-8512-38b29ccb62f0] Successfully updated port: 9dd60454-c5ac-4afe-b6fc-ad9ba9b83423 {{(pid=75216) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 18:48:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-0c07ce82-71f4-4d90-bf03-02377df1ff8e tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] Acquiring lock "refresh_cache-3679beb0-5244-443a-8512-38b29ccb62f0" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 18:48:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-0c07ce82-71f4-4d90-bf03-02377df1ff8e tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] Acquired lock "refresh_cache-3679beb0-5244-443a-8512-38b29ccb62f0" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 18:48:47 user nova-compute[75216]: DEBUG nova.network.neutron [None req-0c07ce82-71f4-4d90-bf03-02377df1ff8e tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] [instance: 3679beb0-5244-443a-8512-38b29ccb62f0] Building network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 18:48:47 user nova-compute[75216]: DEBUG nova.compute.manager [req-6da52b2f-cadb-44af-aeed-e2ea8ad0ce25 req-27463d66-f5f3-4450-9d1c-4c74b4a4dcb3 service nova] [instance: 3679beb0-5244-443a-8512-38b29ccb62f0] Received event network-changed-9dd60454-c5ac-4afe-b6fc-ad9ba9b83423 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:48:47 user nova-compute[75216]: DEBUG nova.compute.manager [req-6da52b2f-cadb-44af-aeed-e2ea8ad0ce25 req-27463d66-f5f3-4450-9d1c-4c74b4a4dcb3 service nova] [instance: 3679beb0-5244-443a-8512-38b29ccb62f0] Refreshing instance network info cache due to event network-changed-9dd60454-c5ac-4afe-b6fc-ad9ba9b83423. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 18:48:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-6da52b2f-cadb-44af-aeed-e2ea8ad0ce25 req-27463d66-f5f3-4450-9d1c-4c74b4a4dcb3 service nova] Acquiring lock "refresh_cache-3679beb0-5244-443a-8512-38b29ccb62f0" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 18:48:47 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:48:47 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:48:47 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:48:47 user nova-compute[75216]: DEBUG nova.network.neutron [None req-0c07ce82-71f4-4d90-bf03-02377df1ff8e tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] [instance: 3679beb0-5244-443a-8512-38b29ccb62f0] Instance cache missing network info. {{(pid=75216) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 18:48:47 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d589d57e-de50-482a-843f-e8246b3d7528/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:48:47 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d589d57e-de50-482a-843f-e8246b3d7528/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:48:48 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:48:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d589d57e-de50-482a-843f-e8246b3d7528/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:48:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b078f75-57f2-495a-abd5-f8adf72db80b/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:48:48 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:48:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b078f75-57f2-495a-abd5-f8adf72db80b/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:48:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b078f75-57f2-495a-abd5-f8adf72db80b/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:48:48 user nova-compute[75216]: DEBUG nova.network.neutron [None req-0c07ce82-71f4-4d90-bf03-02377df1ff8e tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] [instance: 3679beb0-5244-443a-8512-38b29ccb62f0] Updating instance_info_cache with network_info: [{"id": "9dd60454-c5ac-4afe-b6fc-ad9ba9b83423", "address": "fa:16:3e:f0:11:a2", "network": {"id": "36f9d4ef-d504-457e-be5c-873fd634988f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-998310827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f28b10790a0548b785d2242360d631b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dd60454-c5", "ovs_interfaceid": "9dd60454-c5ac-4afe-b6fc-ad9ba9b83423", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 18:48:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-0c07ce82-71f4-4d90-bf03-02377df1ff8e tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] Releasing lock "refresh_cache-3679beb0-5244-443a-8512-38b29ccb62f0" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 18:48:48 user nova-compute[75216]: DEBUG nova.compute.manager [None req-0c07ce82-71f4-4d90-bf03-02377df1ff8e tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] [instance: 3679beb0-5244-443a-8512-38b29ccb62f0] Instance network_info: |[{"id": "9dd60454-c5ac-4afe-b6fc-ad9ba9b83423", "address": "fa:16:3e:f0:11:a2", "network": {"id": "36f9d4ef-d504-457e-be5c-873fd634988f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-998310827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f28b10790a0548b785d2242360d631b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dd60454-c5", "ovs_interfaceid": "9dd60454-c5ac-4afe-b6fc-ad9ba9b83423", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 18:48:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-6da52b2f-cadb-44af-aeed-e2ea8ad0ce25 req-27463d66-f5f3-4450-9d1c-4c74b4a4dcb3 service nova] Acquired lock "refresh_cache-3679beb0-5244-443a-8512-38b29ccb62f0" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 18:48:48 user nova-compute[75216]: DEBUG nova.network.neutron [req-6da52b2f-cadb-44af-aeed-e2ea8ad0ce25 req-27463d66-f5f3-4450-9d1c-4c74b4a4dcb3 service nova] [instance: 3679beb0-5244-443a-8512-38b29ccb62f0] Refreshing network info cache for port 9dd60454-c5ac-4afe-b6fc-ad9ba9b83423 {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 18:48:48 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:48:48 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:48:48 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:48:48 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 9b078f75-57f2-495a-abd5-f8adf72db80b] Instance destroyed successfully.
Nov 13 18:48:48 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-a29a3c63-a574-4a43-b5b5-a0560bf849c9 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] [instance: 9b078f75-57f2-495a-abd5-f8adf72db80b] Attempting a stable device rescue
Nov 13 18:48:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b078f75-57f2-495a-abd5-f8adf72db80b/disk --force-share --output=json" returned: 0 in 0.272s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:48:48 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 18:48:48 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-a29a3c63-a574-4a43-b5b5-a0560bf849c9 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=75216) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 13 18:48:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85624c58-6c72-4490-8a3e-547953295ade/disk.rescue --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:48:48 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-a29a3c63-a574-4a43-b5b5-a0560bf849c9 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] [instance: 9b078f75-57f2-495a-abd5-f8adf72db80b] Instance directory exists: not creating {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 13 18:48:48 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-a29a3c63-a574-4a43-b5b5-a0560bf849c9 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] [instance: 9b078f75-57f2-495a-abd5-f8adf72db80b] Creating image(s)
Nov 13 18:48:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a29a3c63-a574-4a43-b5b5-a0560bf849c9 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] Acquiring lock "/opt/stack/data/nova/instances/9b078f75-57f2-495a-abd5-f8adf72db80b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:48:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a29a3c63-a574-4a43-b5b5-a0560bf849c9 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] Lock "/opt/stack/data/nova/instances/9b078f75-57f2-495a-abd5-f8adf72db80b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:48:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a29a3c63-a574-4a43-b5b5-a0560bf849c9 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] Lock "/opt/stack/data/nova/instances/9b078f75-57f2-495a-abd5-f8adf72db80b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:48:48 user nova-compute[75216]: DEBUG nova.objects.instance [None req-a29a3c63-a574-4a43-b5b5-a0560bf849c9 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] Lazy-loading 'trusted_certs' on Instance uuid 9b078f75-57f2-495a-abd5-f8adf72db80b {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 18:48:48 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:48:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a29a3c63-a574-4a43-b5b5-a0560bf849c9 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] Acquiring lock "6941c672f5a762c53dbd3715a683339a4a8e35e2" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:48:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a29a3c63-a574-4a43-b5b5-a0560bf849c9 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] Lock "6941c672f5a762c53dbd3715a683339a4a8e35e2" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:48:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-a29a3c63-a574-4a43-b5b5-a0560bf849c9 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6941c672f5a762c53dbd3715a683339a4a8e35e2.part --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:48:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:48:49 user nova-compute[75216]: DEBUG nova.compute.manager [req-6890227a-0eda-4cd8-9cca-c6b72d0eb841 req-a5860f2c-12a0-46cb-b1f0-6ec1d0107842 service nova] [instance: 9b078f75-57f2-495a-abd5-f8adf72db80b] Received event network-vif-unplugged-96bda2a6-53d1-4052-9230-4907fe60d70b {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:48:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-6890227a-0eda-4cd8-9cca-c6b72d0eb841 req-a5860f2c-12a0-46cb-b1f0-6ec1d0107842 service nova] Acquiring lock "9b078f75-57f2-495a-abd5-f8adf72db80b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:48:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-6890227a-0eda-4cd8-9cca-c6b72d0eb841 req-a5860f2c-12a0-46cb-b1f0-6ec1d0107842 service nova] Lock "9b078f75-57f2-495a-abd5-f8adf72db80b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:48:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-6890227a-0eda-4cd8-9cca-c6b72d0eb841 req-a5860f2c-12a0-46cb-b1f0-6ec1d0107842 service nova] Lock "9b078f75-57f2-495a-abd5-f8adf72db80b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:48:49 user nova-compute[75216]: DEBUG nova.compute.manager [req-6890227a-0eda-4cd8-9cca-c6b72d0eb841 req-a5860f2c-12a0-46cb-b1f0-6ec1d0107842 service nova] [instance: 9b078f75-57f2-495a-abd5-f8adf72db80b] No waiting events found dispatching network-vif-unplugged-96bda2a6-53d1-4052-9230-4907fe60d70b {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:48:49 user nova-compute[75216]: WARNING nova.compute.manager [req-6890227a-0eda-4cd8-9cca-c6b72d0eb841 req-a5860f2c-12a0-46cb-b1f0-6ec1d0107842 service nova] [instance: 9b078f75-57f2-495a-abd5-f8adf72db80b] Received unexpected event network-vif-unplugged-96bda2a6-53d1-4052-9230-4907fe60d70b for instance with vm_state active and task_state rescuing.
Nov 13 18:48:49 user nova-compute[75216]: DEBUG nova.compute.manager [req-6890227a-0eda-4cd8-9cca-c6b72d0eb841 req-a5860f2c-12a0-46cb-b1f0-6ec1d0107842 service nova] [instance: 9b078f75-57f2-495a-abd5-f8adf72db80b] Received event network-vif-plugged-96bda2a6-53d1-4052-9230-4907fe60d70b {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:48:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-6890227a-0eda-4cd8-9cca-c6b72d0eb841 req-a5860f2c-12a0-46cb-b1f0-6ec1d0107842 service nova] Acquiring lock "9b078f75-57f2-495a-abd5-f8adf72db80b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:48:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-6890227a-0eda-4cd8-9cca-c6b72d0eb841 req-a5860f2c-12a0-46cb-b1f0-6ec1d0107842 service nova] Lock "9b078f75-57f2-495a-abd5-f8adf72db80b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:48:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-6890227a-0eda-4cd8-9cca-c6b72d0eb841 req-a5860f2c-12a0-46cb-b1f0-6ec1d0107842 service nova] Lock "9b078f75-57f2-495a-abd5-f8adf72db80b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:48:49 user nova-compute[75216]: DEBUG nova.compute.manager [req-6890227a-0eda-4cd8-9cca-c6b72d0eb841 req-a5860f2c-12a0-46cb-b1f0-6ec1d0107842 service nova] [instance: 9b078f75-57f2-495a-abd5-f8adf72db80b] No waiting events found dispatching network-vif-plugged-96bda2a6-53d1-4052-9230-4907fe60d70b {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:48:49 user nova-compute[75216]: WARNING nova.compute.manager [req-6890227a-0eda-4cd8-9cca-c6b72d0eb841 req-a5860f2c-12a0-46cb-b1f0-6ec1d0107842 service nova] [instance: 9b078f75-57f2-495a-abd5-f8adf72db80b] Received unexpected event network-vif-plugged-96bda2a6-53d1-4052-9230-4907fe60d70b for instance with vm_state active and task_state rescuing.
Nov 13 18:48:49 user nova-compute[75216]: DEBUG nova.compute.manager [req-6890227a-0eda-4cd8-9cca-c6b72d0eb841 req-a5860f2c-12a0-46cb-b1f0-6ec1d0107842 service nova] [instance: 9b078f75-57f2-495a-abd5-f8adf72db80b] Received event network-vif-plugged-96bda2a6-53d1-4052-9230-4907fe60d70b {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:48:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-6890227a-0eda-4cd8-9cca-c6b72d0eb841 req-a5860f2c-12a0-46cb-b1f0-6ec1d0107842 service nova] Acquiring lock "9b078f75-57f2-495a-abd5-f8adf72db80b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:48:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-6890227a-0eda-4cd8-9cca-c6b72d0eb841 req-a5860f2c-12a0-46cb-b1f0-6ec1d0107842 service nova] Lock "9b078f75-57f2-495a-abd5-f8adf72db80b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:48:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-6890227a-0eda-4cd8-9cca-c6b72d0eb841 req-a5860f2c-12a0-46cb-b1f0-6ec1d0107842 service nova] Lock "9b078f75-57f2-495a-abd5-f8adf72db80b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:48:49 user nova-compute[75216]: DEBUG nova.compute.manager [req-6890227a-0eda-4cd8-9cca-c6b72d0eb841 req-a5860f2c-12a0-46cb-b1f0-6ec1d0107842 service nova] [instance: 9b078f75-57f2-495a-abd5-f8adf72db80b] No waiting events found dispatching network-vif-plugged-96bda2a6-53d1-4052-9230-4907fe60d70b {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:48:49 user nova-compute[75216]: WARNING nova.compute.manager [req-6890227a-0eda-4cd8-9cca-c6b72d0eb841 req-a5860f2c-12a0-46cb-b1f0-6ec1d0107842 service nova] [instance: 9b078f75-57f2-495a-abd5-f8adf72db80b] Received unexpected event network-vif-plugged-96bda2a6-53d1-4052-9230-4907fe60d70b for instance with vm_state active and task_state rescuing.
Nov 13 18:48:49 user nova-compute[75216]: DEBUG nova.compute.manager [req-6890227a-0eda-4cd8-9cca-c6b72d0eb841 req-a5860f2c-12a0-46cb-b1f0-6ec1d0107842 service nova] [instance: 9b078f75-57f2-495a-abd5-f8adf72db80b] Received event network-vif-plugged-96bda2a6-53d1-4052-9230-4907fe60d70b {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:48:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-6890227a-0eda-4cd8-9cca-c6b72d0eb841 req-a5860f2c-12a0-46cb-b1f0-6ec1d0107842 service nova] Acquiring lock "9b078f75-57f2-495a-abd5-f8adf72db80b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:48:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-6890227a-0eda-4cd8-9cca-c6b72d0eb841 req-a5860f2c-12a0-46cb-b1f0-6ec1d0107842 service nova] Lock "9b078f75-57f2-495a-abd5-f8adf72db80b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:48:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-6890227a-0eda-4cd8-9cca-c6b72d0eb841 req-a5860f2c-12a0-46cb-b1f0-6ec1d0107842 service nova] Lock "9b078f75-57f2-495a-abd5-f8adf72db80b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:48:49 user nova-compute[75216]: DEBUG nova.compute.manager [req-6890227a-0eda-4cd8-9cca-c6b72d0eb841 req-a5860f2c-12a0-46cb-b1f0-6ec1d0107842 service nova] [instance: 9b078f75-57f2-495a-abd5-f8adf72db80b] No waiting events found dispatching network-vif-plugged-96bda2a6-53d1-4052-9230-4907fe60d70b {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:48:49 user nova-compute[75216]: WARNING nova.compute.manager [req-6890227a-0eda-4cd8-9cca-c6b72d0eb841 req-a5860f2c-12a0-46cb-b1f0-6ec1d0107842 service nova] [instance: 9b078f75-57f2-495a-abd5-f8adf72db80b] Received unexpected event network-vif-plugged-96bda2a6-53d1-4052-9230-4907fe60d70b for instance with vm_state active and task_state rescuing.
Nov 13 18:48:49 user nova-compute[75216]: DEBUG nova.compute.manager [req-6890227a-0eda-4cd8-9cca-c6b72d0eb841 req-a5860f2c-12a0-46cb-b1f0-6ec1d0107842 service nova] [instance: 9b078f75-57f2-495a-abd5-f8adf72db80b] Received event network-vif-unplugged-96bda2a6-53d1-4052-9230-4907fe60d70b {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:48:50 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-6890227a-0eda-4cd8-9cca-c6b72d0eb841 req-a5860f2c-12a0-46cb-b1f0-6ec1d0107842 service nova] Acquiring lock "9b078f75-57f2-495a-abd5-f8adf72db80b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:48:50 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-6890227a-0eda-4cd8-9cca-c6b72d0eb841 req-a5860f2c-12a0-46cb-b1f0-6ec1d0107842 service nova] Lock "9b078f75-57f2-495a-abd5-f8adf72db80b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:48:50 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-6890227a-0eda-4cd8-9cca-c6b72d0eb841 req-a5860f2c-12a0-46cb-b1f0-6ec1d0107842 service nova] Lock "9b078f75-57f2-495a-abd5-f8adf72db80b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:48:50 user nova-compute[75216]: DEBUG nova.compute.manager [req-6890227a-0eda-4cd8-9cca-c6b72d0eb841 req-a5860f2c-12a0-46cb-b1f0-6ec1d0107842 service nova] [instance: 9b078f75-57f2-495a-abd5-f8adf72db80b] No waiting events found dispatching network-vif-unplugged-96bda2a6-53d1-4052-9230-4907fe60d70b {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:48:50 user nova-compute[75216]: WARNING nova.compute.manager [req-6890227a-0eda-4cd8-9cca-c6b72d0eb841 req-a5860f2c-12a0-46cb-b1f0-6ec1d0107842 service nova] [instance: 9b078f75-57f2-495a-abd5-f8adf72db80b] Received unexpected event network-vif-unplugged-96bda2a6-53d1-4052-9230-4907fe60d70b for instance with vm_state active and task_state rescuing.
Nov 13 18:48:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85624c58-6c72-4490-8a3e-547953295ade/disk.rescue --force-share --output=json" returned: 0 in 1.282s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:48:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85624c58-6c72-4490-8a3e-547953295ade/disk.rescue --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:48:50 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:48:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-a29a3c63-a574-4a43-b5b5-a0560bf849c9 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6941c672f5a762c53dbd3715a683339a4a8e35e2.part --force-share --output=json" returned: 0 in 0.168s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:48:50 user nova-compute[75216]: DEBUG nova.virt.images [None req-a29a3c63-a574-4a43-b5b5-a0560bf849c9 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] 8dec793d-6e32-4c26-b215-5505dcb64b8b was qcow2, converting to raw {{(pid=75216) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 13 18:48:50 user nova-compute[75216]: DEBUG nova.privsep.utils [None req-a29a3c63-a574-4a43-b5b5-a0560bf849c9 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75216) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 13 18:48:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-a29a3c63-a574-4a43-b5b5-a0560bf849c9 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/6941c672f5a762c53dbd3715a683339a4a8e35e2.part /opt/stack/data/nova/instances/_base/6941c672f5a762c53dbd3715a683339a4a8e35e2.converted {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:48:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85624c58-6c72-4490-8a3e-547953295ade/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:48:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85624c58-6c72-4490-8a3e-547953295ade/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:48:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85624c58-6c72-4490-8a3e-547953295ade/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:48:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85624c58-6c72-4490-8a3e-547953295ade/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:48:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-a29a3c63-a574-4a43-b5b5-a0560bf849c9 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/6941c672f5a762c53dbd3715a683339a4a8e35e2.part /opt/stack/data/nova/instances/_base/6941c672f5a762c53dbd3715a683339a4a8e35e2.converted" returned: 0 in 0.321s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:48:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-a29a3c63-a574-4a43-b5b5-a0560bf849c9 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6941c672f5a762c53dbd3715a683339a4a8e35e2.converted --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:48:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85624c58-6c72-4490-8a3e-547953295ade/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:48:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64dfe522-8b46-4df4-8032-591ce56900ec/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:48:50 user nova-compute[75216]: DEBUG nova.network.neutron [req-6da52b2f-cadb-44af-aeed-e2ea8ad0ce25 req-27463d66-f5f3-4450-9d1c-4c74b4a4dcb3 service nova] [instance: 3679beb0-5244-443a-8512-38b29ccb62f0] Updated VIF entry in instance network info cache for port 9dd60454-c5ac-4afe-b6fc-ad9ba9b83423. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 18:48:50 user nova-compute[75216]: DEBUG nova.network.neutron [req-6da52b2f-cadb-44af-aeed-e2ea8ad0ce25 req-27463d66-f5f3-4450-9d1c-4c74b4a4dcb3 service nova] [instance: 3679beb0-5244-443a-8512-38b29ccb62f0] Updating instance_info_cache with network_info: [{"id": "9dd60454-c5ac-4afe-b6fc-ad9ba9b83423", "address": "fa:16:3e:f0:11:a2", "network": {"id": "36f9d4ef-d504-457e-be5c-873fd634988f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-998310827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f28b10790a0548b785d2242360d631b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dd60454-c5", "ovs_interfaceid": "9dd60454-c5ac-4afe-b6fc-ad9ba9b83423", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 18:48:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-a29a3c63-a574-4a43-b5b5-a0560bf849c9 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6941c672f5a762c53dbd3715a683339a4a8e35e2.converted --force-share --output=json" returned: 0 in 0.202s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:48:50 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a29a3c63-a574-4a43-b5b5-a0560bf849c9 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] Lock "6941c672f5a762c53dbd3715a683339a4a8e35e2" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.861s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:48:50 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a29a3c63-a574-4a43-b5b5-a0560bf849c9 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] Acquiring lock "6941c672f5a762c53dbd3715a683339a4a8e35e2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:48:50 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a29a3c63-a574-4a43-b5b5-a0560bf849c9 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] Lock "6941c672f5a762c53dbd3715a683339a4a8e35e2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:48:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-a29a3c63-a574-4a43-b5b5-a0560bf849c9 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6941c672f5a762c53dbd3715a683339a4a8e35e2 --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:48:50 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-6da52b2f-cadb-44af-aeed-e2ea8ad0ce25 req-27463d66-f5f3-4450-9d1c-4c74b4a4dcb3 service nova] Releasing lock "refresh_cache-3679beb0-5244-443a-8512-38b29ccb62f0" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 18:48:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64dfe522-8b46-4df4-8032-591ce56900ec/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:48:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64dfe522-8b46-4df4-8032-591ce56900ec/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:48:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-a29a3c63-a574-4a43-b5b5-a0560bf849c9 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6941c672f5a762c53dbd3715a683339a4a8e35e2 --force-share --output=json" returned: 0 in 0.192s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:48:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-a29a3c63-a574-4a43-b5b5-a0560bf849c9 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6941c672f5a762c53dbd3715a683339a4a8e35e2,backing_fmt=raw /opt/stack/data/nova/instances/9b078f75-57f2-495a-abd5-f8adf72db80b/disk.rescue {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:48:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-a29a3c63-a574-4a43-b5b5-a0560bf849c9 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6941c672f5a762c53dbd3715a683339a4a8e35e2,backing_fmt=raw /opt/stack/data/nova/instances/9b078f75-57f2-495a-abd5-f8adf72db80b/disk.rescue" returned: 0 in 0.054s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:48:50 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a29a3c63-a574-4a43-b5b5-a0560bf849c9 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] Lock "6941c672f5a762c53dbd3715a683339a4a8e35e2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.254s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:48:50 user nova-compute[75216]: DEBUG nova.objects.instance [None req-a29a3c63-a574-4a43-b5b5-a0560bf849c9 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] Lazy-loading 'migration_context' on Instance uuid 9b078f75-57f2-495a-abd5-f8adf72db80b {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 18:48:50 user nova-compute[75216]: DEBUG nova.objects.base [None req-a29a3c63-a574-4a43-b5b5-a0560bf849c9 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] Object Instance<9b078f75-57f2-495a-abd5-f8adf72db80b> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75216) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 18:48:50 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-a29a3c63-a574-4a43-b5b5-a0560bf849c9 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] [instance: 9b078f75-57f2-495a-abd5-f8adf72db80b] Created local disks {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 18:48:50 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-a29a3c63-a574-4a43-b5b5-a0560bf849c9 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] [instance: 9b078f75-57f2-495a-abd5-f8adf72db80b] Start _get_guest_xml network_info=[{"id": "96bda2a6-53d1-4052-9230-4907fe60d70b", "address": "fa:16:3e:30:88:c4", "network": {"id": "eac74a7f-b8a0-4653-82a9-1113186e7682", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1781360101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1781360101-network", "vif_mac": "fa:16:3e:30:88:c4"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e76353a038ca478598ddd984f4503e34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96bda2a6-53", "ovs_interfaceid": "96bda2a6-53d1-4052-9230-4907fe60d70b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T18:41:06Z,direct_url=<?>,disk_format='qcow2',id=77bcb5ba-8510-41ec-a88d-96097bb431de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c465b7c26ec44582b6d1b7169536ecc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T18:41:07Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '8dec793d-6e32-4c26-b215-5505dcb64b8b', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'guest_format': None, 'boot_index': 0, 'image_id': '77bcb5ba-8510-41ec-a88d-96097bb431de'}], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:bf4e9e60-f40d-49e0-8234-ae45c23b695b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vWqlSnQN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '9b078f75-57f2-495a-abd5-f8adf72db80b', 'attached_at': '', 'detached_at': '', 'volume_id': 'bf4e9e60-f40d-49e0-8234-ae45c23b695b', 'serial': 'bf4e9e60-f40d-49e0-8234-ae45c23b695b'}, 'attachment_id': '642d0524-56d0-4759-9d31-63a91b68d64b', 'guest_format': None, 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'boot_index': None, 'volume_type': None} {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 18:48:50 user nova-compute[75216]: DEBUG nova.objects.instance [None req-a29a3c63-a574-4a43-b5b5-a0560bf849c9 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] Lazy-loading 'resources' on Instance uuid 9b078f75-57f2-495a-abd5-f8adf72db80b {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 18:48:50 user nova-compute[75216]: DEBUG nova.objects.base [None req-a29a3c63-a574-4a43-b5b5-a0560bf849c9 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] Object Instance<9b078f75-57f2-495a-abd5-f8adf72db80b> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75216) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 18:48:50 user nova-compute[75216]: DEBUG nova.objects.instance [None req-a29a3c63-a574-4a43-b5b5-a0560bf849c9 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] Lazy-loading 'numa_topology' on Instance uuid 9b078f75-57f2-495a-abd5-f8adf72db80b {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 18:48:50 user nova-compute[75216]: DEBUG nova.objects.base [None req-a29a3c63-a574-4a43-b5b5-a0560bf849c9 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] Object Instance<9b078f75-57f2-495a-abd5-f8adf72db80b> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75216) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 18:48:50 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-a29a3c63-a574-4a43-b5b5-a0560bf849c9 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 18:48:50 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-a29a3c63-a574-4a43-b5b5-a0560bf849c9 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 18:48:50 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-a29a3c63-a574-4a43-b5b5-a0560bf849c9 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 18:48:50 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-a29a3c63-a574-4a43-b5b5-a0560bf849c9 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] CPU controller missing on host. {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 18:48:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64dfe522-8b46-4df4-8032-591ce56900ec/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:48:51 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-a29a3c63-a574-4a43-b5b5-a0560bf849c9 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 18:48:51 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-a29a3c63-a574-4a43-b5b5-a0560bf849c9 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] CPU controller found on host. {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 18:48:51 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-a29a3c63-a574-4a43-b5b5-a0560bf849c9 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75216) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 18:48:51 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-a29a3c63-a574-4a43-b5b5-a0560bf849c9 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T18:40:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T18:41:06Z,direct_url=<?>,disk_format='qcow2',id=77bcb5ba-8510-41ec-a88d-96097bb431de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c465b7c26ec44582b6d1b7169536ecc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T18:41:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 18:48:51 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-a29a3c63-a574-4a43-b5b5-a0560bf849c9 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] Flavor limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 18:48:51 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-a29a3c63-a574-4a43-b5b5-a0560bf849c9 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] Image limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 18:48:51 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-a29a3c63-a574-4a43-b5b5-a0560bf849c9 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] Flavor pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 18:48:51 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-a29a3c63-a574-4a43-b5b5-a0560bf849c9 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] Image pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 18:48:51 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-a29a3c63-a574-4a43-b5b5-a0560bf849c9 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 18:48:51 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-a29a3c63-a574-4a43-b5b5-a0560bf849c9 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 18:48:51 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-a29a3c63-a574-4a43-b5b5-a0560bf849c9 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 18:48:51 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-a29a3c63-a574-4a43-b5b5-a0560bf849c9 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] Got 1 possible topologies {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 18:48:51 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-a29a3c63-a574-4a43-b5b5-a0560bf849c9 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 18:48:51 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-a29a3c63-a574-4a43-b5b5-a0560bf849c9 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 18:48:51 user nova-compute[75216]: DEBUG nova.objects.instance [None req-a29a3c63-a574-4a43-b5b5-a0560bf849c9 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] Lazy-loading 'vcpu_model' on Instance uuid 9b078f75-57f2-495a-abd5-f8adf72db80b {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 18:48:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed251b5e-5f1d-404c-a09b-156e5ed72e82/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:48:51 user nova-compute[75216]: DEBUG nova.objects.base [None req-a29a3c63-a574-4a43-b5b5-a0560bf849c9 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] Object Instance<9b078f75-57f2-495a-abd5-f8adf72db80b> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75216) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 18:48:51 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a29a3c63-a574-4a43-b5b5-a0560bf849c9 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] [instance: 9b078f75-57f2-495a-abd5-f8adf72db80b] Calling os-brick to attach iSCSI Volume {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 18:48:51 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a29a3c63-a574-4a43-b5b5-a0560bf849c9 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3a8669e40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bf4e9e60-f40d-49e0-8234-ae45c23b695b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vWqlSnQN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 18:48:51 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-a29a3c63-a574-4a43-b5b5-a0560bf849c9 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 18:48:51 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-a29a3c63-a574-4a43-b5b5-a0560bf849c9 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 18:48:51 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-a29a3c63-a574-4a43-b5b5-a0560bf849c9 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.006s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 18:48:51 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-a29a3c63-a574-4a43-b5b5-a0560bf849c9 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 18:48:51 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-a29a3c63-a574-4a43-b5b5-a0560bf849c9 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bf4e9e60-f40d-49e0-8234-ae45c23b695b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 18:48:51 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-a29a3c63-a574-4a43-b5b5-a0560bf849c9 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bf4e9e60-f40d-49e0-8234-ae45c23b695b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.005s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 18:48:51 user nova-compute[75216]: INFO os_brick.initiator.connectors.iscsi [None req-a29a3c63-a574-4a43-b5b5-a0560bf849c9 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 18:48:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf4e9e60-f40d-49e0-8234-ae45c23b695b -p 172.16.0.220:3260 {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:48:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf4e9e60-f40d-49e0-8234-ae45c23b695b -p 172.16.0.220:3260" returned: 0 in 0.020s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:48:51 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[312f6821-2ec0-437a-b411-9fdb43e6a46a]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:bf4e9e60-f40d-49e0-8234-ae45c23b695b\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = vWqlSnQN\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:48:51 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a29a3c63-a574-4a43-b5b5-a0560bf849c9 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 13 18:48:51 user nova-compute[75216]: node.name = iqn.2010-10.org.openstack:bf4e9e60-f40d-49e0-8234-ae45c23b695b
Nov 13 18:48:51 user nova-compute[75216]: node.tpgt = -1
Nov 13 18:48:51 user nova-compute[75216]: node.startup = automatic
Nov 13 18:48:51 user nova-compute[75216]: node.leading_login = No
Nov 13 18:48:51 user nova-compute[75216]: iface.iscsi_ifacename = default
Nov 13 18:48:51 user nova-compute[75216]: iface.net_ifacename = <empty>
Nov 13 18:48:51 user nova-compute[75216]: iface.ipaddress = <empty>
Nov 13 18:48:51 user nova-compute[75216]: iface.prefix_len = 0
Nov 13 18:48:51 user nova-compute[75216]: iface.hwaddress = <empty>
Nov 13 18:48:51 user nova-compute[75216]: iface.transport_name = tcp
Nov 13 18:48:51 user nova-compute[75216]: iface.initiatorname = <empty>
Nov 13 18:48:51 user nova-compute[75216]: iface.state = <empty>
Nov 13 18:48:51 user nova-compute[75216]: iface.vlan_id = 0
Nov 13 18:48:51 user nova-compute[75216]: iface.vlan_priority = 0
Nov 13 18:48:51 user nova-compute[75216]: iface.vlan_state = <empty>
Nov 13 18:48:51 user nova-compute[75216]: iface.iface_num = 0
Nov 13 18:48:51 user nova-compute[75216]: iface.mtu = 0
Nov 13 18:48:51 user nova-compute[75216]: iface.port = 0
Nov 13 18:48:51 user nova-compute[75216]: iface.bootproto = <empty>
Nov 13 18:48:51 user nova-compute[75216]: iface.subnet_mask = <empty>
Nov 13 18:48:51 user nova-compute[75216]: iface.gateway = <empty>
Nov 13 18:48:51 user nova-compute[75216]: iface.dhcp_alt_client_id_state = <empty>
Nov 13 18:48:51 user nova-compute[75216]: iface.dhcp_alt_client_id = <empty>
Nov 13 18:48:51 user nova-compute[75216]: iface.dhcp_dns = <empty>
Nov 13 18:48:51 user nova-compute[75216]: iface.dhcp_learn_iqn = <empty>
Nov 13 18:48:51 user nova-compute[75216]: iface.dhcp_req_vendor_id_state = <empty>
Nov 13 18:48:51 user nova-compute[75216]: iface.dhcp_vendor_id_state = <empty>
Nov 13 18:48:51 user nova-compute[75216]: iface.dhcp_vendor_id = <empty>
Nov 13 18:48:51 user nova-compute[75216]: iface.dhcp_slp_da = <empty>
Nov 13 18:48:51 user nova-compute[75216]: iface.fragmentation = <empty>
Nov 13 18:48:51 user nova-compute[75216]: iface.gratuitous_arp = <empty>
Nov 13 18:48:51 user nova-compute[75216]: iface.incoming_forwarding = <empty>
Nov 13 18:48:51 user nova-compute[75216]: iface.tos_state = <empty>
Nov 13 18:48:51 user nova-compute[75216]: iface.tos = 0
Nov 13 18:48:51 user nova-compute[75216]: iface.ttl = 0
Nov 13 18:48:51 user nova-compute[75216]: iface.delayed_ack = <empty>
Nov 13 18:48:51 user nova-compute[75216]: iface.tcp_nagle = <empty>
Nov 13 18:48:51 user nova-compute[75216]: iface.tcp_wsf_state = <empty>
Nov 13 18:48:51 user nova-compute[75216]: iface.tcp_wsf = 0
Nov 13 18:48:51 user nova-compute[75216]: iface.tcp_timer_scale = 0
Nov 13 18:48:51 user nova-compute[75216]: iface.tcp_timestamp = <empty>
Nov 13 18:48:51 user nova-compute[75216]: iface.redirect = <empty>
Nov 13 18:48:51 user nova-compute[75216]: iface.def_task_mgmt_timeout = 0
Nov 13 18:48:51 user nova-compute[75216]: iface.header_digest = <empty>
Nov 13 18:48:51 user nova-compute[75216]: iface.data_digest = <empty>
Nov 13 18:48:51 user nova-compute[75216]: iface.immediate_data = <empty>
Nov 13 18:48:51 user nova-compute[75216]: iface.initial_r2t = <empty>
Nov 13 18:48:51 user nova-compute[75216]: iface.data_seq_inorder = <empty>
Nov 13 18:48:51 user nova-compute[75216]: iface.data_pdu_inorder = <empty>
Nov 13 18:48:51 user nova-compute[75216]: iface.erl = 0
Nov 13 18:48:51 user nova-compute[75216]: iface.max_receive_data_len = 0
Nov 13 18:48:51 user nova-compute[75216]: iface.first_burst_len = 0
Nov 13 18:48:51 user nova-compute[75216]: iface.max_outstanding_r2t = 0
Nov 13 18:48:51 user nova-compute[75216]: iface.max_burst_len = 0
Nov 13 18:48:51 user nova-compute[75216]: iface.chap_auth = <empty>
Nov 13 18:48:51 user nova-compute[75216]: iface.bidi_chap = <empty>
Nov 13 18:48:51 user nova-compute[75216]: iface.strict_login_compliance = <empty>
Nov 13 18:48:51 user nova-compute[75216]: iface.discovery_auth = <empty>
Nov 13 18:48:51 user nova-compute[75216]: iface.discovery_logout = <empty>
Nov 13 18:48:51 user nova-compute[75216]: node.discovery_address = <empty>
Nov 13 18:48:51 user nova-compute[75216]: node.discovery_port = 0
Nov 13 18:48:51 user nova-compute[75216]: node.discovery_type = static
Nov 13 18:48:51 user nova-compute[75216]: node.session.initial_cmdsn = 0
Nov 13 18:48:51 user nova-compute[75216]: node.session.initial_login_retry_max = 8
Nov 13 18:48:51 user nova-compute[75216]: node.session.xmit_thread_priority = -20
Nov 13 18:48:51 user nova-compute[75216]: node.session.cmds_max = 128
Nov 13 18:48:51 user nova-compute[75216]: node.session.queue_depth = 32
Nov 13 18:48:51 user nova-compute[75216]: node.session.nr_sessions = 1
Nov 13 18:48:51 user nova-compute[75216]: node.session.auth.authmethod = CHAP
Nov 13 18:48:51 user nova-compute[75216]: node.session.auth.username = vWqlSnQN
Nov 13 18:48:51 user nova-compute[75216]: node.session.auth.password = ***
Nov 13 18:48:51 user nova-compute[75216]: node.session.auth.username_in = <empty>
Nov 13 18:48:51 user nova-compute[75216]: node.session.auth.password_in = <empty>
Nov 13 18:48:51 user nova-compute[75216]: node.session.auth.chap_algs = MD5
Nov 13 18:48:51 user nova-compute[75216]: node.session.timeo.replacement_timeout = 120
Nov 13 18:48:51 user nova-compute[75216]: node.session.err_timeo.abort_timeout = 15
Nov 13 18:48:51 user nova-compute[75216]: node.session.err_timeo.lu_reset_timeout = 30
Nov 13 18:48:51 user nova-compute[75216]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 13 18:48:51 user nova-compute[75216]: node.session.err_timeo.host_reset_timeout = 60
Nov 13 18:48:51 user nova-compute[75216]: node.session.iscsi.FastAbort = Yes
Nov 13 18:48:51 user nova-compute[75216]: node.session.iscsi.InitialR2T = No
Nov 13 18:48:51 user nova-compute[75216]: node.session.iscsi.ImmediateData = Yes
Nov 13 18:48:51 user nova-compute[75216]: node.session.iscsi.FirstBurstLength = 262144
Nov 13 18:48:51 user nova-compute[75216]: node.session.iscsi.MaxBurstLength = 16776192
Nov 13 18:48:51 user nova-compute[75216]: node.session.iscsi.DefaultTime2Retain = 0
Nov 13 18:48:51 user nova-compute[75216]: node.session.iscsi.DefaultTime2Wait = 2
Nov 13 18:48:51 user nova-compute[75216]: node.session.iscsi.MaxConnections = 1
Nov 13 18:48:51 user nova-compute[75216]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 13 18:48:51 user nova-compute[75216]: node.session.iscsi.ERL = 0
Nov 13 18:48:51 user nova-compute[75216]: node.session.scan = manual
Nov 13 18:48:51 user nova-compute[75216]: node.session.reopen_max = 0
Nov 13 18:48:51 user nova-compute[75216]: node.conn[0].address = 172.16.0.220
Nov 13 18:48:51 user nova-compute[75216]: node.conn[0].port = 3260
Nov 13 18:48:51 user nova-compute[75216]: node.conn[0].startup = manual
Nov 13 18:48:51 user nova-compute[75216]: node.conn[0].tcp.window_size = 524288
Nov 13 18:48:51 user nova-compute[75216]: node.conn[0].tcp.type_of_service = 0
Nov 13 18:48:51 user nova-compute[75216]: node.conn[0].timeo.logout_timeout = 15
Nov 13 18:48:51 user nova-compute[75216]: node.conn[0].timeo.login_timeout = 15
Nov 13 18:48:51 user nova-compute[75216]: node.conn[0].timeo.auth_timeout = 45
Nov 13 18:48:51 user nova-compute[75216]: node.conn[0].timeo.noop_out_interval = 5
Nov 13 18:48:51 user nova-compute[75216]: node.conn[0].timeo.noop_out_timeout = 5
Nov 13 18:48:51 user nova-compute[75216]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 13 18:48:51 user nova-compute[75216]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 13 18:48:51 user nova-compute[75216]: node.conn[0].iscsi.HeaderDigest = None
Nov 13 18:48:51 user nova-compute[75216]: node.conn[0].iscsi.DataDigest = None
Nov 13 18:48:51 user nova-compute[75216]: node.conn[0].iscsi.IFMarker = No
Nov 13 18:48:51 user nova-compute[75216]: node.conn[0].iscsi.OFMarker = No
Nov 13 18:48:51 user nova-compute[75216]: # END RECORD
Nov 13 18:48:51 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:48:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf4e9e60-f40d-49e0-8234-ae45c23b695b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:48:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf4e9e60-f40d-49e0-8234-ae45c23b695b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:48:51 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[faeb7a4f-385a-49f2-97b1-bc4f55cdf629]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:48:51 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a29a3c63-a574-4a43-b5b5-a0560bf849c9 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:48:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf4e9e60-f40d-49e0-8234-ae45c23b695b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:48:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf4e9e60-f40d-49e0-8234-ae45c23b695b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:48:51 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8bcd8bd-bf23-44a1-9623-41cc27023503]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:48:51 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a29a3c63-a574-4a43-b5b5-a0560bf849c9 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:48:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf4e9e60-f40d-49e0-8234-ae45c23b695b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vWqlSnQN {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:48:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf4e9e60-f40d-49e0-8234-ae45c23b695b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vWqlSnQN" returned: 0 in 0.024s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:48:51 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ced1c4a-e76a-4a4c-8c53-e21bf34ba632]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:48:51 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a29a3c63-a574-4a43-b5b5-a0560bf849c9 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vWqlSnQN'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:48:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf4e9e60-f40d-49e0-8234-ae45c23b695b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:48:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed251b5e-5f1d-404c-a09b-156e5ed72e82/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:48:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed251b5e-5f1d-404c-a09b-156e5ed72e82/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:48:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf4e9e60-f40d-49e0-8234-ae45c23b695b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:48:51 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[293e9999-8c8a-4b3a-9ce5-5819f23c9445]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:48:51 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a29a3c63-a574-4a43-b5b5-a0560bf849c9 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:48:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:48:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:48:51 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[c26e61b8-df09-48e2-94b7-6a00808d271a]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf4e9e60-f40d-49e0-8234-ae45c23b695b (non-flash)\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:48:51 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a29a3c63-a574-4a43-b5b5-a0560bf849c9 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf4e9e60-f40d-49e0-8234-ae45c23b695b (non-flash)
Nov 13 18:48:51 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 18:48:51 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a29a3c63-a574-4a43-b5b5-a0560bf849c9 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf4e9e60-f40d-49e0-8234-ae45c23b695b (non-flash)
Nov 13 18:48:51 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 18:48:51 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-a29a3c63-a574-4a43-b5b5-a0560bf849c9 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bf4e9e60-f40d-49e0-8234-ae45c23b695b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.180s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 18:48:51 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a29a3c63-a574-4a43-b5b5-a0560bf849c9 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] Connected to 172.16.0.220:3260 {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 18:48:51 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-a29a3c63-a574-4a43-b5b5-a0560bf849c9 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] HCTL ('33', '0', '0', 0) found on session 16 with lun 0 {{(pid=75216) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 18:48:51 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-a29a3c63-a574-4a43-b5b5-a0560bf849c9 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=75216) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 18:48:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:48:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.012s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:48:51 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[c235ed5a-9a55-4923-a5ef-76fd5fddc786]: (4, ('0 0 0', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:48:51 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-a29a3c63-a574-4a43-b5b5-a0560bf849c9 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] Searching for a device in session 16 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=75216) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 18:48:51 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a29a3c63-a574-4a43-b5b5-a0560bf849c9 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:bf4e9e60-f40d-49e0-8234-ae45c23b695b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vWqlSnQN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 18:48:51 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-a29a3c63-a574-4a43-b5b5-a0560bf849c9 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.206s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 18:48:51 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a29a3c63-a574-4a43-b5b5-a0560bf849c9 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] <== connect_volume: return (212ms) {'type': 'block', 'scsi_wwn': '23162336131353762', 'path': '/dev/sdb'} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 18:48:51 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a29a3c63-a574-4a43-b5b5-a0560bf849c9 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] [instance: 9b078f75-57f2-495a-abd5-f8adf72db80b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23162336131353762', 'path': '/dev/sdb'} {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 18:48:51 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-a29a3c63-a574-4a43-b5b5-a0560bf849c9 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T18:44:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-2037924683',display_name='tempest-ServerStableDeviceRescueTest-server-2037924683',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-2037924683',id=5,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDyNRjKkEXE946W7ATv6X8QWLmngeHlSnPG/JxUF3ZiVINBi3q8Kko9NDXYQqGAv1e8V8a0QDwPM0ffhuobkkIWKpFKPb2hwJDWRakg7VKmbTavuHCqEjEADGU4Zo+roSw==',key_name='tempest-keypair-1672182613',keypairs=<?>,launch_index=0,launched_at=2023-11-13T18:45:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e76353a038ca478598ddd984f4503e34',ramdisk_id='',reservation_id='r-n2dzdbze',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-689881972',owner_user_name='tempest-ServerStableDeviceRescueTest-689881972-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T18:46:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b114ba28a4124b14a9376346953075bf',uuid=9b078f75-57f2-495a-abd5-f8adf72db80b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "96bda2a6-53d1-4052-9230-4907fe60d70b", "address": "fa:16:3e:30:88:c4", "network": {"id": "eac74a7f-b8a0-4653-82a9-1113186e7682", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1781360101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1781360101-network", "vif_mac": "fa:16:3e:30:88:c4"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e76353a038ca478598ddd984f4503e34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96bda2a6-53", "ovs_interfaceid": "96bda2a6-53d1-4052-9230-4907fe60d70b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75216) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 18:48:51 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-a29a3c63-a574-4a43-b5b5-a0560bf849c9 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] Converting VIF {"id": "96bda2a6-53d1-4052-9230-4907fe60d70b", "address": "fa:16:3e:30:88:c4", "network": {"id": "eac74a7f-b8a0-4653-82a9-1113186e7682", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1781360101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1781360101-network", "vif_mac": "fa:16:3e:30:88:c4"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e76353a038ca478598ddd984f4503e34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96bda2a6-53", "ovs_interfaceid": "96bda2a6-53d1-4052-9230-4907fe60d70b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 18:48:51 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-a29a3c63-a574-4a43-b5b5-a0560bf849c9 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:30:88:c4,bridge_name='br-int',has_traffic_filtering=True,id=96bda2a6-53d1-4052-9230-4907fe60d70b,network=Network(eac74a7f-b8a0-4653-82a9-1113186e7682),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96bda2a6-53') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 18:48:51 user nova-compute[75216]: DEBUG nova.objects.instance [None req-a29a3c63-a574-4a43-b5b5-a0560bf849c9 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] Lazy-loading 'pci_devices' on Instance uuid 9b078f75-57f2-495a-abd5-f8adf72db80b {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 18:48:51 user nova-compute[75216]: DEBUG nova.objects.base [None req-a29a3c63-a574-4a43-b5b5-a0560bf849c9 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] Object Instance<9b078f75-57f2-495a-abd5-f8adf72db80b> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75216) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 18:48:51 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-a29a3c63-a574-4a43-b5b5-a0560bf849c9 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] [instance: 9b078f75-57f2-495a-abd5-f8adf72db80b] End _get_guest_xml xml=<domain type="kvm">
Nov 13 18:48:51 user nova-compute[75216]:   <uuid>9b078f75-57f2-495a-abd5-f8adf72db80b</uuid>
Nov 13 18:48:51 user nova-compute[75216]:   <name>instance-00000005</name>
Nov 13 18:48:51 user nova-compute[75216]:   <memory>524288</memory>
Nov 13 18:48:51 user nova-compute[75216]:   <vcpu>1</vcpu>
Nov 13 18:48:51 user nova-compute[75216]:   <metadata>
Nov 13 18:48:51 user nova-compute[75216]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 18:48:51 user nova-compute[75216]:       <nova:package version="0.0.0"/>
Nov 13 18:48:51 user nova-compute[75216]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-2037924683</nova:name>
Nov 13 18:48:51 user nova-compute[75216]:       <nova:creationTime>2023-11-13 18:48:50</nova:creationTime>
Nov 13 18:48:51 user nova-compute[75216]:       <nova:flavor name="m1.tiny">
Nov 13 18:48:51 user nova-compute[75216]:         <nova:memory>512</nova:memory>
Nov 13 18:48:51 user nova-compute[75216]:         <nova:disk>1</nova:disk>
Nov 13 18:48:51 user nova-compute[75216]:         <nova:swap>0</nova:swap>
Nov 13 18:48:51 user nova-compute[75216]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 18:48:51 user nova-compute[75216]:         <nova:vcpus>1</nova:vcpus>
Nov 13 18:48:51 user nova-compute[75216]:       </nova:flavor>
Nov 13 18:48:51 user nova-compute[75216]:       <nova:owner>
Nov 13 18:48:51 user nova-compute[75216]:         <nova:user uuid="b114ba28a4124b14a9376346953075bf">tempest-ServerStableDeviceRescueTest-689881972-project-member</nova:user>
Nov 13 18:48:51 user nova-compute[75216]:         <nova:project uuid="e76353a038ca478598ddd984f4503e34">tempest-ServerStableDeviceRescueTest-689881972</nova:project>
Nov 13 18:48:51 user nova-compute[75216]:       </nova:owner>
Nov 13 18:48:51 user nova-compute[75216]:       <nova:root type="image" uuid="77bcb5ba-8510-41ec-a88d-96097bb431de"/>
Nov 13 18:48:51 user nova-compute[75216]:       <nova:ports>
Nov 13 18:48:51 user nova-compute[75216]:         <nova:port uuid="96bda2a6-53d1-4052-9230-4907fe60d70b">
Nov 13 18:48:51 user nova-compute[75216]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 13 18:48:51 user nova-compute[75216]:         </nova:port>
Nov 13 18:48:51 user nova-compute[75216]:       </nova:ports>
Nov 13 18:48:51 user nova-compute[75216]:     </nova:instance>
Nov 13 18:48:51 user nova-compute[75216]:   </metadata>
Nov 13 18:48:51 user nova-compute[75216]:   <sysinfo type="smbios">
Nov 13 18:48:51 user nova-compute[75216]:     <system>
Nov 13 18:48:51 user nova-compute[75216]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 18:48:51 user nova-compute[75216]:       <entry name="product">OpenStack Nova</entry>
Nov 13 18:48:51 user nova-compute[75216]:       <entry name="version">0.0.0</entry>
Nov 13 18:48:51 user nova-compute[75216]:       <entry name="serial">9b078f75-57f2-495a-abd5-f8adf72db80b</entry>
Nov 13 18:48:51 user nova-compute[75216]:       <entry name="uuid">9b078f75-57f2-495a-abd5-f8adf72db80b</entry>
Nov 13 18:48:51 user nova-compute[75216]:       <entry name="family">Virtual Machine</entry>
Nov 13 18:48:51 user nova-compute[75216]:     </system>
Nov 13 18:48:51 user nova-compute[75216]:   </sysinfo>
Nov 13 18:48:51 user nova-compute[75216]:   <os>
Nov 13 18:48:51 user nova-compute[75216]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 18:48:51 user nova-compute[75216]:     <smbios mode="sysinfo"/>
Nov 13 18:48:51 user nova-compute[75216]:   </os>
Nov 13 18:48:51 user nova-compute[75216]:   <features>
Nov 13 18:48:51 user nova-compute[75216]:     <acpi/>
Nov 13 18:48:51 user nova-compute[75216]:     <apic/>
Nov 13 18:48:51 user nova-compute[75216]:     <vmcoreinfo/>
Nov 13 18:48:51 user nova-compute[75216]:   </features>
Nov 13 18:48:51 user nova-compute[75216]:   <clock offset="utc">
Nov 13 18:48:51 user nova-compute[75216]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 18:48:51 user nova-compute[75216]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 18:48:51 user nova-compute[75216]:     <timer name="hpet" present="no"/>
Nov 13 18:48:51 user nova-compute[75216]:   </clock>
Nov 13 18:48:51 user nova-compute[75216]:   <cpu mode="custom" match="exact">
Nov 13 18:48:51 user nova-compute[75216]:     <model>Nehalem</model>
Nov 13 18:48:51 user nova-compute[75216]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 18:48:51 user nova-compute[75216]:   </cpu>
Nov 13 18:48:51 user nova-compute[75216]:   <devices>
Nov 13 18:48:51 user nova-compute[75216]:     <disk type="file" device="disk">
Nov 13 18:48:51 user nova-compute[75216]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 18:48:51 user nova-compute[75216]:       <source file="/opt/stack/data/nova/instances/9b078f75-57f2-495a-abd5-f8adf72db80b/disk"/>
Nov 13 18:48:51 user nova-compute[75216]:       <target dev="vda" bus="virtio"/>
Nov 13 18:48:51 user nova-compute[75216]:     </disk>
Nov 13 18:48:51 user nova-compute[75216]:     <disk type="block" device="disk">
Nov 13 18:48:51 user nova-compute[75216]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 18:48:51 user nova-compute[75216]:       <source dev="/dev/sdb"/>
Nov 13 18:48:51 user nova-compute[75216]:       <target dev="vdb" bus="virtio"/>
Nov 13 18:48:51 user nova-compute[75216]:       <serial>bf4e9e60-f40d-49e0-8234-ae45c23b695b</serial>
Nov 13 18:48:51 user nova-compute[75216]:     </disk>
Nov 13 18:48:51 user nova-compute[75216]:     <disk type="file" device="disk">
Nov 13 18:48:51 user nova-compute[75216]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 18:48:51 user nova-compute[75216]:       <source file="/opt/stack/data/nova/instances/9b078f75-57f2-495a-abd5-f8adf72db80b/disk.rescue"/>
Nov 13 18:48:51 user nova-compute[75216]:       <target dev="vdc" bus="virtio"/>
Nov 13 18:48:51 user nova-compute[75216]:       <boot order="1"/>
Nov 13 18:48:51 user nova-compute[75216]:     </disk>
Nov 13 18:48:51 user nova-compute[75216]:     <interface type="ethernet">
Nov 13 18:48:51 user nova-compute[75216]:       <mac address="fa:16:3e:30:88:c4"/>
Nov 13 18:48:51 user nova-compute[75216]:       <model type="virtio"/>
Nov 13 18:48:51 user nova-compute[75216]:       <mtu size="1442"/>
Nov 13 18:48:51 user nova-compute[75216]:       <target dev="tap96bda2a6-53"/>
Nov 13 18:48:51 user nova-compute[75216]:     </interface>
Nov 13 18:48:51 user nova-compute[75216]:     <serial type="pty">
Nov 13 18:48:51 user nova-compute[75216]:       <log file="/opt/stack/data/nova/instances/9b078f75-57f2-495a-abd5-f8adf72db80b/console.log" append="off"/>
Nov 13 18:48:51 user nova-compute[75216]:     </serial>
Nov 13 18:48:51 user nova-compute[75216]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 18:48:51 user nova-compute[75216]:     <video>
Nov 13 18:48:51 user nova-compute[75216]:       <model type="virtio"/>
Nov 13 18:48:51 user nova-compute[75216]:     </video>
Nov 13 18:48:51 user nova-compute[75216]:     <rng model="virtio">
Nov 13 18:48:51 user nova-compute[75216]:       <backend model="random">/dev/urandom</backend>
Nov 13 18:48:51 user nova-compute[75216]:     </rng>
Nov 13 18:48:51 user nova-compute[75216]:     <controller type="usb" index="0" model="none"/>
Nov 13 18:48:51 user nova-compute[75216]:     <memballoon model="virtio">
Nov 13 18:48:51 user nova-compute[75216]:       <stats period="10"/>
Nov 13 18:48:51 user nova-compute[75216]:     </memballoon>
Nov 13 18:48:51 user nova-compute[75216]:   </devices>
Nov 13 18:48:51 user nova-compute[75216]: </domain>
Nov 13 18:48:51 user nova-compute[75216]:  {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 18:48:51 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 9b078f75-57f2-495a-abd5-f8adf72db80b] Instance destroyed successfully.
Nov 13 18:48:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed251b5e-5f1d-404c-a09b-156e5ed72e82/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:48:51 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 18:48:51 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 18:48:51 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Hypervisor/Node resource view: name=user free_ram=7730MB free_disk=25.686511993408203GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75216) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 18:48:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:48:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:48:51 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-a29a3c63-a574-4a43-b5b5-a0560bf849c9 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 18:48:51 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-a29a3c63-a574-4a43-b5b5-a0560bf849c9 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 18:48:51 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-a29a3c63-a574-4a43-b5b5-a0560bf849c9 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 18:48:51 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-a29a3c63-a574-4a43-b5b5-a0560bf849c9 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] No VIF found with MAC fa:16:3e:30:88:c4, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 18:48:51 user nova-compute[75216]: DEBUG nova.compute.manager [None req-0c07ce82-71f4-4d90-bf03-02377df1ff8e tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] [instance: 3679beb0-5244-443a-8512-38b29ccb62f0] Start spawning the instance on the hypervisor. {{(pid=75216) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 18:48:51 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-0c07ce82-71f4-4d90-bf03-02377df1ff8e tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] [instance: 3679beb0-5244-443a-8512-38b29ccb62f0] Creating instance directory {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 18:48:51 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-0c07ce82-71f4-4d90-bf03-02377df1ff8e tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] [instance: 3679beb0-5244-443a-8512-38b29ccb62f0] Creating image(s)
Nov 13 18:48:51 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-0c07ce82-71f4-4d90-bf03-02377df1ff8e tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] [instance: 3679beb0-5244-443a-8512-38b29ccb62f0] Did not create local disks {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 13 18:48:51 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-0c07ce82-71f4-4d90-bf03-02377df1ff8e tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] [instance: 3679beb0-5244-443a-8512-38b29ccb62f0] Ensure instance console log exists: /opt/stack/data/nova/instances/3679beb0-5244-443a-8512-38b29ccb62f0/console.log {{(pid=75216) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 18:48:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-0c07ce82-71f4-4d90-bf03-02377df1ff8e tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:48:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-0c07ce82-71f4-4d90-bf03-02377df1ff8e tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:48:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-0c07ce82-71f4-4d90-bf03-02377df1ff8e tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:48:51 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-0c07ce82-71f4-4d90-bf03-02377df1ff8e tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] [instance: 3679beb0-5244-443a-8512-38b29ccb62f0] Start _get_guest_xml network_info=[{"id": "9dd60454-c5ac-4afe-b6fc-ad9ba9b83423", "address": "fa:16:3e:f0:11:a2", "network": {"id": "36f9d4ef-d504-457e-be5c-873fd634988f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-998310827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f28b10790a0548b785d2242360d631b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dd60454-c5", "ovs_interfaceid": "9dd60454-c5ac-4afe-b6fc-ad9ba9b83423", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ae66a157-b0d3-4501-a728-a010d6a83a10', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'buEowZlO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3679beb0-5244-443a-8512-38b29ccb62f0', 'attached_at': '', 'detached_at': '', 'volume_id': 'ae66a157-b0d3-4501-a728-a010d6a83a10', 'serial': 'ae66a157-b0d3-4501-a728-a010d6a83a10'}, 'attachment_id': '2be00411-327d-4e49-a75e-688a877bb0ac', 'guest_format': None, 'mount_device': '/dev/vda', 'delete_on_termination': True, 'boot_index': 0, 'volume_type': None} {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 18:48:51 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-0c07ce82-71f4-4d90-bf03-02377df1ff8e tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 18:48:51 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-0c07ce82-71f4-4d90-bf03-02377df1ff8e tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 18:48:51 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-0c07ce82-71f4-4d90-bf03-02377df1ff8e tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 18:48:51 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-0c07ce82-71f4-4d90-bf03-02377df1ff8e tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] CPU controller missing on host. {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 18:48:51 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-0c07ce82-71f4-4d90-bf03-02377df1ff8e tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 18:48:51 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-0c07ce82-71f4-4d90-bf03-02377df1ff8e tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] CPU controller found on host. {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 18:48:51 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-0c07ce82-71f4-4d90-bf03-02377df1ff8e tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75216) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 18:48:51 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-0c07ce82-71f4-4d90-bf03-02377df1ff8e tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T18:40:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 18:48:51 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-0c07ce82-71f4-4d90-bf03-02377df1ff8e tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] Flavor limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 18:48:51 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-0c07ce82-71f4-4d90-bf03-02377df1ff8e tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] Image limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 18:48:52 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-0c07ce82-71f4-4d90-bf03-02377df1ff8e tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] Flavor pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 18:48:52 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-0c07ce82-71f4-4d90-bf03-02377df1ff8e tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] Image pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 18:48:52 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-0c07ce82-71f4-4d90-bf03-02377df1ff8e tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 18:48:52 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-0c07ce82-71f4-4d90-bf03-02377df1ff8e tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 18:48:52 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-0c07ce82-71f4-4d90-bf03-02377df1ff8e tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 18:48:52 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-0c07ce82-71f4-4d90-bf03-02377df1ff8e tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] Got 1 possible topologies {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 18:48:52 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-0c07ce82-71f4-4d90-bf03-02377df1ff8e tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 18:48:52 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-0c07ce82-71f4-4d90-bf03-02377df1ff8e tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 18:48:52 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c07ce82-71f4-4d90-bf03-02377df1ff8e tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] [instance: 3679beb0-5244-443a-8512-38b29ccb62f0] Calling os-brick to attach iSCSI Volume {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 18:48:52 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c07ce82-71f4-4d90-bf03-02377df1ff8e tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3a8669e40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ae66a157-b0d3-4501-a728-a010d6a83a10', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'buEowZlO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 18:48:52 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-0c07ce82-71f4-4d90-bf03-02377df1ff8e tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 18:48:52 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-0c07ce82-71f4-4d90-bf03-02377df1ff8e tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 18:48:52 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-0c07ce82-71f4-4d90-bf03-02377df1ff8e tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 18:48:52 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-0c07ce82-71f4-4d90-bf03-02377df1ff8e tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 18:48:52 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-0c07ce82-71f4-4d90-bf03-02377df1ff8e tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ae66a157-b0d3-4501-a728-a010d6a83a10" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 18:48:52 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-0c07ce82-71f4-4d90-bf03-02377df1ff8e tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ae66a157-b0d3-4501-a728-a010d6a83a10" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 18:48:52 user nova-compute[75216]: INFO os_brick.initiator.connectors.iscsi [None req-0c07ce82-71f4-4d90-bf03-02377df1ff8e tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 18:48:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae66a157-b0d3-4501-a728-a010d6a83a10 -p 172.16.0.220:3260 {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:48:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae66a157-b0d3-4501-a728-a010d6a83a10 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:48:52 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[5307b743-46a6-4e19-95ff-9c13e87faa0f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:48:52 user nova-compute[75216]: DEBUG nova.compute.manager [req-1c4ecbe4-ba5f-4d5f-a82b-da02a90dca20 req-9b92a6f0-ae01-43b7-9a3c-a45ba72a3ce9 service nova] [instance: 9b078f75-57f2-495a-abd5-f8adf72db80b] Received event network-vif-plugged-96bda2a6-53d1-4052-9230-4907fe60d70b {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:48:52 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-1c4ecbe4-ba5f-4d5f-a82b-da02a90dca20 req-9b92a6f0-ae01-43b7-9a3c-a45ba72a3ce9 service nova] Acquiring lock "9b078f75-57f2-495a-abd5-f8adf72db80b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:48:52 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-1c4ecbe4-ba5f-4d5f-a82b-da02a90dca20 req-9b92a6f0-ae01-43b7-9a3c-a45ba72a3ce9 service nova] Lock "9b078f75-57f2-495a-abd5-f8adf72db80b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:48:52 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-1c4ecbe4-ba5f-4d5f-a82b-da02a90dca20 req-9b92a6f0-ae01-43b7-9a3c-a45ba72a3ce9 service nova] Lock "9b078f75-57f2-495a-abd5-f8adf72db80b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:48:52 user nova-compute[75216]: DEBUG nova.compute.manager [req-1c4ecbe4-ba5f-4d5f-a82b-da02a90dca20 req-9b92a6f0-ae01-43b7-9a3c-a45ba72a3ce9 service nova] [instance: 9b078f75-57f2-495a-abd5-f8adf72db80b] No waiting events found dispatching network-vif-plugged-96bda2a6-53d1-4052-9230-4907fe60d70b {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:48:52 user nova-compute[75216]: WARNING nova.compute.manager [req-1c4ecbe4-ba5f-4d5f-a82b-da02a90dca20 req-9b92a6f0-ae01-43b7-9a3c-a45ba72a3ce9 service nova] [instance: 9b078f75-57f2-495a-abd5-f8adf72db80b] Received unexpected event network-vif-plugged-96bda2a6-53d1-4052-9230-4907fe60d70b for instance with vm_state active and task_state rescuing.
Nov 13 18:48:52 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c07ce82-71f4-4d90-bf03-02377df1ff8e tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 18:48:52 user nova-compute[75216]:  {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:48:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae66a157-b0d3-4501-a728-a010d6a83a10 -p 172.16.0.220:3260 --interface default --op new {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:48:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae66a157-b0d3-4501-a728-a010d6a83a10 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:48:52 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance a1a3e849-6570-4820-97c8-75468b5bea4f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 18:48:52 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance d589d57e-de50-482a-843f-e8246b3d7528 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 18:48:52 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance 85624c58-6c72-4490-8a3e-547953295ade actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 18:48:52 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance 9b078f75-57f2-495a-abd5-f8adf72db80b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 18:48:52 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance 83fda249-9d28-4cc2-aeb0-103ce4f1faa4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 18:48:52 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance 64dfe522-8b46-4df4-8032-591ce56900ec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 18:48:52 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance ed251b5e-5f1d-404c-a09b-156e5ed72e82 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 18:48:52 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance 7c9d9c1b-6df5-41ff-a696-871e70d04e07 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 18:48:52 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance 3679beb0-5244-443a-8512-38b29ccb62f0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 18:48:52 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 18:48:52 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 18:48:52 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[a39a5fdc-7272-449a-823c-df6771f32dcb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ae66a157-b0d3-4501-a728-a010d6a83a10] added\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:48:52 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c07ce82-71f4-4d90-bf03-02377df1ff8e tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ae66a157-b0d3-4501-a728-a010d6a83a10] added
Nov 13 18:48:52 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:48:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae66a157-b0d3-4501-a728-a010d6a83a10 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:48:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae66a157-b0d3-4501-a728-a010d6a83a10 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:48:52 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9a2d9b1-2195-42d7-a984-c7a7fe3441ea]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:48:52 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c07ce82-71f4-4d90-bf03-02377df1ff8e tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:48:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae66a157-b0d3-4501-a728-a010d6a83a10 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:48:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae66a157-b0d3-4501-a728-a010d6a83a10 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:48:52 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[5951e0f7-b520-421d-896e-8ec3d83cc2e3]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:48:52 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c07ce82-71f4-4d90-bf03-02377df1ff8e tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:48:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae66a157-b0d3-4501-a728-a010d6a83a10 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v buEowZlO {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:48:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae66a157-b0d3-4501-a728-a010d6a83a10 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v buEowZlO" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:48:52 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[32e97e24-2451-4e2e-9079-76847802e31a]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:48:52 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c07ce82-71f4-4d90-bf03-02377df1ff8e tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'buEowZlO'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:48:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae66a157-b0d3-4501-a728-a010d6a83a10 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:48:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae66a157-b0d3-4501-a728-a010d6a83a10 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:48:52 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[06902b16-c516-4e66-a741-9c008f84be16]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:48:52 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c07ce82-71f4-4d90-bf03-02377df1ff8e tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:48:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:48:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:48:52 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[04e9af20-a7dd-4b4f-a26b-6ea5e5bb1560]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf4e9e60-f40d-49e0-8234-ae45c23b695b (non-flash)\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:48:52 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c07ce82-71f4-4d90-bf03-02377df1ff8e tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf4e9e60-f40d-49e0-8234-ae45c23b695b (non-flash)
Nov 13 18:48:52 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 18:48:52 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c07ce82-71f4-4d90-bf03-02377df1ff8e tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf4e9e60-f40d-49e0-8234-ae45c23b695b (non-flash)
Nov 13 18:48:52 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 18:48:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae66a157-b0d3-4501-a728-a010d6a83a10 -p 172.16.0.220:3260 --login {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:48:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae66a157-b0d3-4501-a728-a010d6a83a10 -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:48:52 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[c90ff3ba-ae29-4228-9b5b-aae14a4e237e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ae66a157-b0d3-4501-a728-a010d6a83a10, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ae66a157-b0d3-4501-a728-a010d6a83a10, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:48:52 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c07ce82-71f4-4d90-bf03-02377df1ff8e tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ae66a157-b0d3-4501-a728-a010d6a83a10, portal: 172.16.0.220,3260]
Nov 13 18:48:52 user nova-compute[75216]: Login to [iface: default, target: iqn.2010-10.org.openstack:ae66a157-b0d3-4501-a728-a010d6a83a10, portal: 172.16.0.220,3260] successful.
Nov 13 18:48:52 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:48:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae66a157-b0d3-4501-a728-a010d6a83a10 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:48:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae66a157-b0d3-4501-a728-a010d6a83a10 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:48:52 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[594fd6ce-136e-4702-be2a-5f709e4b9916]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:48:52 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c07ce82-71f4-4d90-bf03-02377df1ff8e tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:48:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:48:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:48:52 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceb8916b-5a24-4fe6-bc8d-1feeedbb14aa]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf4e9e60-f40d-49e0-8234-ae45c23b695b (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae66a157-b0d3-4501-a728-a010d6a83a10 (non-flash)\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:48:52 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c07ce82-71f4-4d90-bf03-02377df1ff8e tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf4e9e60-f40d-49e0-8234-ae45c23b695b (non-flash)
Nov 13 18:48:52 user nova-compute[75216]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae66a157-b0d3-4501-a728-a010d6a83a10 (non-flash)
Nov 13 18:48:52 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 18:48:52 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c07ce82-71f4-4d90-bf03-02377df1ff8e tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf4e9e60-f40d-49e0-8234-ae45c23b695b (non-flash)
Nov 13 18:48:52 user nova-compute[75216]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae66a157-b0d3-4501-a728-a010d6a83a10 (non-flash)
Nov 13 18:48:52 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 18:48:52 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-0c07ce82-71f4-4d90-bf03-02377df1ff8e tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ae66a157-b0d3-4501-a728-a010d6a83a10" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.324s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 18:48:52 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c07ce82-71f4-4d90-bf03-02377df1ff8e tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] Connected to 172.16.0.220:3260 {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 18:48:52 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-0c07ce82-71f4-4d90-bf03-02377df1ff8e tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] HCTL ('34', '-', '-', 0) found on session 17 with lun 0 {{(pid=75216) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 18:48:52 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-0c07ce82-71f4-4d90-bf03-02377df1ff8e tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75216) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 18:48:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:48:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:48:52 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecb700d2-5cdd-4436-8d5d-06287423a59c]: (4, ('- - 0', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:48:52 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-0c07ce82-71f4-4d90-bf03-02377df1ff8e tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] Searching for a device in session 17 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75216) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 18:48:52 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c07ce82-71f4-4d90-bf03-02377df1ff8e tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:ae66a157-b0d3-4501-a728-a010d6a83a10', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'buEowZlO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 18:48:52 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 18:48:52 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:48:52 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 18:48:52 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Compute_service record updated for user:user {{(pid=75216) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 18:48:52 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.556s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:48:53 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:48:53 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:48:53 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:48:53 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:48:53 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:48:53 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-0c07ce82-71f4-4d90-bf03-02377df1ff8e tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.359s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 18:48:53 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c07ce82-71f4-4d90-bf03-02377df1ff8e tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] <== connect_volume: return (1360ms) {'type': 'block', 'scsi_wwn': '26462643636356565', 'path': '/dev/sdc'} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 18:48:53 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c07ce82-71f4-4d90-bf03-02377df1ff8e tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] [instance: 3679beb0-5244-443a-8512-38b29ccb62f0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26462643636356565', 'path': '/dev/sdc'} {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 18:48:53 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-0c07ce82-71f4-4d90-bf03-02377df1ff8e tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T18:48:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1139702488',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1139702488',id=16,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMERu/g7S2xD4fYqmzFAJXYDR7hKcSuIXV2v7GsKW6Fvu41/rKIsCoqYwYjeLuX+94gqfUJqutarG8qQbb/uJ1X4T/7CELwQc16iiSCVbNPYMOIZbGoMv5QgSdk5IEn2iA==',key_name='tempest-keypair-810733778',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f28b10790a0548b785d2242360d631b1',ramdisk_id='',reservation_id='r-gqrzdq0g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-980167634',owner_user_name='tempest-ServerActionsV293TestJSON-980167634-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T18:48:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b245d24d053e4504baa2670a3fe0b2b1',uuid=3679beb0-5244-443a-8512-38b29ccb62f0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9dd60454-c5ac-4afe-b6fc-ad9ba9b83423", "address": "fa:16:3e:f0:11:a2", "network": {"id": "36f9d4ef-d504-457e-be5c-873fd634988f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-998310827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f28b10790a0548b785d2242360d631b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dd60454-c5", "ovs_interfaceid": "9dd60454-c5ac-4afe-b6fc-ad9ba9b83423", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75216) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 18:48:53 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-0c07ce82-71f4-4d90-bf03-02377df1ff8e tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] Converting VIF {"id": "9dd60454-c5ac-4afe-b6fc-ad9ba9b83423", "address": "fa:16:3e:f0:11:a2", "network": {"id": "36f9d4ef-d504-457e-be5c-873fd634988f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-998310827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f28b10790a0548b785d2242360d631b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dd60454-c5", "ovs_interfaceid": "9dd60454-c5ac-4afe-b6fc-ad9ba9b83423", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 18:48:53 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-0c07ce82-71f4-4d90-bf03-02377df1ff8e tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:11:a2,bridge_name='br-int',has_traffic_filtering=True,id=9dd60454-c5ac-4afe-b6fc-ad9ba9b83423,network=Network(36f9d4ef-d504-457e-be5c-873fd634988f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9dd60454-c5') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 18:48:53 user nova-compute[75216]: DEBUG nova.objects.instance [None req-0c07ce82-71f4-4d90-bf03-02377df1ff8e tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] Lazy-loading 'pci_devices' on Instance uuid 3679beb0-5244-443a-8512-38b29ccb62f0 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 18:48:53 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-0c07ce82-71f4-4d90-bf03-02377df1ff8e tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] [instance: 3679beb0-5244-443a-8512-38b29ccb62f0] End _get_guest_xml xml=<domain type="kvm">
Nov 13 18:48:53 user nova-compute[75216]:   <uuid>3679beb0-5244-443a-8512-38b29ccb62f0</uuid>
Nov 13 18:48:53 user nova-compute[75216]:   <name>instance-00000010</name>
Nov 13 18:48:53 user nova-compute[75216]:   <memory>524288</memory>
Nov 13 18:48:53 user nova-compute[75216]:   <vcpu>1</vcpu>
Nov 13 18:48:53 user nova-compute[75216]:   <metadata>
Nov 13 18:48:53 user nova-compute[75216]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 18:48:53 user nova-compute[75216]:       <nova:package version="0.0.0"/>
Nov 13 18:48:53 user nova-compute[75216]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1139702488</nova:name>
Nov 13 18:48:53 user nova-compute[75216]:       <nova:creationTime>2023-11-13 18:48:51</nova:creationTime>
Nov 13 18:48:53 user nova-compute[75216]:       <nova:flavor name="m1.tiny">
Nov 13 18:48:53 user nova-compute[75216]:         <nova:memory>512</nova:memory>
Nov 13 18:48:53 user nova-compute[75216]:         <nova:disk>1</nova:disk>
Nov 13 18:48:53 user nova-compute[75216]:         <nova:swap>0</nova:swap>
Nov 13 18:48:53 user nova-compute[75216]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 18:48:53 user nova-compute[75216]:         <nova:vcpus>1</nova:vcpus>
Nov 13 18:48:53 user nova-compute[75216]:       </nova:flavor>
Nov 13 18:48:53 user nova-compute[75216]:       <nova:owner>
Nov 13 18:48:53 user nova-compute[75216]:         <nova:user uuid="b245d24d053e4504baa2670a3fe0b2b1">tempest-ServerActionsV293TestJSON-980167634-project-member</nova:user>
Nov 13 18:48:53 user nova-compute[75216]:         <nova:project uuid="f28b10790a0548b785d2242360d631b1">tempest-ServerActionsV293TestJSON-980167634</nova:project>
Nov 13 18:48:53 user nova-compute[75216]:       </nova:owner>
Nov 13 18:48:53 user nova-compute[75216]:       <nova:ports>
Nov 13 18:48:53 user nova-compute[75216]:         <nova:port uuid="9dd60454-c5ac-4afe-b6fc-ad9ba9b83423">
Nov 13 18:48:53 user nova-compute[75216]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 13 18:48:53 user nova-compute[75216]:         </nova:port>
Nov 13 18:48:53 user nova-compute[75216]:       </nova:ports>
Nov 13 18:48:53 user nova-compute[75216]:     </nova:instance>
Nov 13 18:48:53 user nova-compute[75216]:   </metadata>
Nov 13 18:48:53 user nova-compute[75216]:   <sysinfo type="smbios">
Nov 13 18:48:53 user nova-compute[75216]:     <system>
Nov 13 18:48:53 user nova-compute[75216]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 18:48:53 user nova-compute[75216]:       <entry name="product">OpenStack Nova</entry>
Nov 13 18:48:53 user nova-compute[75216]:       <entry name="version">0.0.0</entry>
Nov 13 18:48:53 user nova-compute[75216]:       <entry name="serial">3679beb0-5244-443a-8512-38b29ccb62f0</entry>
Nov 13 18:48:53 user nova-compute[75216]:       <entry name="uuid">3679beb0-5244-443a-8512-38b29ccb62f0</entry>
Nov 13 18:48:53 user nova-compute[75216]:       <entry name="family">Virtual Machine</entry>
Nov 13 18:48:53 user nova-compute[75216]:     </system>
Nov 13 18:48:53 user nova-compute[75216]:   </sysinfo>
Nov 13 18:48:53 user nova-compute[75216]:   <os>
Nov 13 18:48:53 user nova-compute[75216]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 18:48:53 user nova-compute[75216]:     <boot dev="hd"/>
Nov 13 18:48:53 user nova-compute[75216]:     <smbios mode="sysinfo"/>
Nov 13 18:48:53 user nova-compute[75216]:   </os>
Nov 13 18:48:53 user nova-compute[75216]:   <features>
Nov 13 18:48:53 user nova-compute[75216]:     <acpi/>
Nov 13 18:48:53 user nova-compute[75216]:     <apic/>
Nov 13 18:48:53 user nova-compute[75216]:     <vmcoreinfo/>
Nov 13 18:48:53 user nova-compute[75216]:   </features>
Nov 13 18:48:53 user nova-compute[75216]:   <clock offset="utc">
Nov 13 18:48:53 user nova-compute[75216]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 18:48:53 user nova-compute[75216]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 18:48:53 user nova-compute[75216]:     <timer name="hpet" present="no"/>
Nov 13 18:48:53 user nova-compute[75216]:   </clock>
Nov 13 18:48:53 user nova-compute[75216]:   <cpu mode="custom" match="exact">
Nov 13 18:48:53 user nova-compute[75216]:     <model>Nehalem</model>
Nov 13 18:48:53 user nova-compute[75216]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 18:48:53 user nova-compute[75216]:   </cpu>
Nov 13 18:48:53 user nova-compute[75216]:   <devices>
Nov 13 18:48:53 user nova-compute[75216]:     <disk type="block" device="disk">
Nov 13 18:48:53 user nova-compute[75216]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 18:48:53 user nova-compute[75216]:       <source dev="/dev/sdc"/>
Nov 13 18:48:53 user nova-compute[75216]:       <target dev="vda" bus="virtio"/>
Nov 13 18:48:53 user nova-compute[75216]:       <serial>ae66a157-b0d3-4501-a728-a010d6a83a10</serial>
Nov 13 18:48:53 user nova-compute[75216]:     </disk>
Nov 13 18:48:53 user nova-compute[75216]:     <interface type="ethernet">
Nov 13 18:48:53 user nova-compute[75216]:       <mac address="fa:16:3e:f0:11:a2"/>
Nov 13 18:48:53 user nova-compute[75216]:       <model type="virtio"/>
Nov 13 18:48:53 user nova-compute[75216]:       <mtu size="1442"/>
Nov 13 18:48:53 user nova-compute[75216]:       <target dev="tap9dd60454-c5"/>
Nov 13 18:48:53 user nova-compute[75216]:     </interface>
Nov 13 18:48:53 user nova-compute[75216]:     <serial type="pty">
Nov 13 18:48:53 user nova-compute[75216]:       <log file="/opt/stack/data/nova/instances/3679beb0-5244-443a-8512-38b29ccb62f0/console.log" append="off"/>
Nov 13 18:48:53 user nova-compute[75216]:     </serial>
Nov 13 18:48:53 user nova-compute[75216]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 18:48:53 user nova-compute[75216]:     <video>
Nov 13 18:48:53 user nova-compute[75216]:       <model type="virtio"/>
Nov 13 18:48:53 user nova-compute[75216]:     </video>
Nov 13 18:48:53 user nova-compute[75216]:     <rng model="virtio">
Nov 13 18:48:53 user nova-compute[75216]:       <backend model="random">/dev/urandom</backend>
Nov 13 18:48:53 user nova-compute[75216]:     </rng>
Nov 13 18:48:53 user nova-compute[75216]:     <controller type="usb" index="0" model="none"/>
Nov 13 18:48:53 user nova-compute[75216]:     <memballoon model="virtio">
Nov 13 18:48:53 user nova-compute[75216]:       <stats period="10"/>
Nov 13 18:48:53 user nova-compute[75216]:     </memballoon>
Nov 13 18:48:53 user nova-compute[75216]:   </devices>
Nov 13 18:48:53 user nova-compute[75216]: </domain>
Nov 13 18:48:53 user nova-compute[75216]:  {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 18:48:53 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-0c07ce82-71f4-4d90-bf03-02377df1ff8e tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T18:48:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1139702488',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1139702488',id=16,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMERu/g7S2xD4fYqmzFAJXYDR7hKcSuIXV2v7GsKW6Fvu41/rKIsCoqYwYjeLuX+94gqfUJqutarG8qQbb/uJ1X4T/7CELwQc16iiSCVbNPYMOIZbGoMv5QgSdk5IEn2iA==',key_name='tempest-keypair-810733778',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f28b10790a0548b785d2242360d631b1',ramdisk_id='',reservation_id='r-gqrzdq0g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-980167634',owner_user_name='tempest-ServerActionsV293TestJSON-980167634-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T18:48:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b245d24d053e4504baa2670a3fe0b2b1',uuid=3679beb0-5244-443a-8512-38b29ccb62f0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9dd60454-c5ac-4afe-b6fc-ad9ba9b83423", "address": "fa:16:3e:f0:11:a2", "network": {"id": "36f9d4ef-d504-457e-be5c-873fd634988f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-998310827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f28b10790a0548b785d2242360d631b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dd60454-c5", "ovs_interfaceid": "9dd60454-c5ac-4afe-b6fc-ad9ba9b83423", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 18:48:53 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-0c07ce82-71f4-4d90-bf03-02377df1ff8e tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] Converting VIF {"id": "9dd60454-c5ac-4afe-b6fc-ad9ba9b83423", "address": "fa:16:3e:f0:11:a2", "network": {"id": "36f9d4ef-d504-457e-be5c-873fd634988f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-998310827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f28b10790a0548b785d2242360d631b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dd60454-c5", "ovs_interfaceid": "9dd60454-c5ac-4afe-b6fc-ad9ba9b83423", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 18:48:53 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-0c07ce82-71f4-4d90-bf03-02377df1ff8e tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:11:a2,bridge_name='br-int',has_traffic_filtering=True,id=9dd60454-c5ac-4afe-b6fc-ad9ba9b83423,network=Network(36f9d4ef-d504-457e-be5c-873fd634988f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9dd60454-c5') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 18:48:53 user nova-compute[75216]: DEBUG os_vif [None req-0c07ce82-71f4-4d90-bf03-02377df1ff8e tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:11:a2,bridge_name='br-int',has_traffic_filtering=True,id=9dd60454-c5ac-4afe-b6fc-ad9ba9b83423,network=Network(36f9d4ef-d504-457e-be5c-873fd634988f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9dd60454-c5') {{(pid=75216) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 18:48:53 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:48:53 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:48:53 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 18:48:53 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:48:53 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd2866df7-68fe-54dd-93bd-1b19a0eb227a', '_type': 'linux-noop'}}, row=False) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:48:53 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:48:53 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:48:53 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:48:53 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9dd60454-c5, may_exist=True, interface_attrs={}) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:48:53 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9dd60454-c5, col_values=(('qos', UUID('8e7bf507-f7dc-495f-be3d-65ef292fa757')),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:48:53 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9dd60454-c5, col_values=(('external_ids', {'iface-id': '9dd60454-c5ac-4afe-b6fc-ad9ba9b83423', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f0:11:a2', 'vm-uuid': '3679beb0-5244-443a-8512-38b29ccb62f0'}),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:48:53 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:48:53 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:48:53 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:48:53 user nova-compute[75216]: INFO os_vif [None req-0c07ce82-71f4-4d90-bf03-02377df1ff8e tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:11:a2,bridge_name='br-int',has_traffic_filtering=True,id=9dd60454-c5ac-4afe-b6fc-ad9ba9b83423,network=Network(36f9d4ef-d504-457e-be5c-873fd634988f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9dd60454-c5')
Nov 13 18:48:53 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-0c07ce82-71f4-4d90-bf03-02377df1ff8e tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 18:48:53 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-0c07ce82-71f4-4d90-bf03-02377df1ff8e tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] No VIF found with MAC fa:16:3e:f0:11:a2, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 18:48:53 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:48:53 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:48:53 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:48:53 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:48:54 user nova-compute[75216]: DEBUG nova.compute.manager [req-96609013-471a-49d4-ad89-f93668787a04 req-8b4d5c16-f6a7-40ca-bd15-e7f25903b89a service nova] [instance: 9b078f75-57f2-495a-abd5-f8adf72db80b] Received event network-vif-plugged-96bda2a6-53d1-4052-9230-4907fe60d70b {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:48:54 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-96609013-471a-49d4-ad89-f93668787a04 req-8b4d5c16-f6a7-40ca-bd15-e7f25903b89a service nova] Acquiring lock "9b078f75-57f2-495a-abd5-f8adf72db80b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:48:54 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-96609013-471a-49d4-ad89-f93668787a04 req-8b4d5c16-f6a7-40ca-bd15-e7f25903b89a service nova] Lock "9b078f75-57f2-495a-abd5-f8adf72db80b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:48:54 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-96609013-471a-49d4-ad89-f93668787a04 req-8b4d5c16-f6a7-40ca-bd15-e7f25903b89a service nova] Lock "9b078f75-57f2-495a-abd5-f8adf72db80b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:48:54 user nova-compute[75216]: DEBUG nova.compute.manager [req-96609013-471a-49d4-ad89-f93668787a04 req-8b4d5c16-f6a7-40ca-bd15-e7f25903b89a service nova] [instance: 9b078f75-57f2-495a-abd5-f8adf72db80b] No waiting events found dispatching network-vif-plugged-96bda2a6-53d1-4052-9230-4907fe60d70b {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:48:54 user nova-compute[75216]: WARNING nova.compute.manager [req-96609013-471a-49d4-ad89-f93668787a04 req-8b4d5c16-f6a7-40ca-bd15-e7f25903b89a service nova] [instance: 9b078f75-57f2-495a-abd5-f8adf72db80b] Received unexpected event network-vif-plugged-96bda2a6-53d1-4052-9230-4907fe60d70b for instance with vm_state active and task_state rescuing.
Nov 13 18:48:54 user nova-compute[75216]: DEBUG nova.compute.manager [req-96609013-471a-49d4-ad89-f93668787a04 req-8b4d5c16-f6a7-40ca-bd15-e7f25903b89a service nova] [instance: 9b078f75-57f2-495a-abd5-f8adf72db80b] Received event network-vif-plugged-96bda2a6-53d1-4052-9230-4907fe60d70b {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:48:54 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-96609013-471a-49d4-ad89-f93668787a04 req-8b4d5c16-f6a7-40ca-bd15-e7f25903b89a service nova] Acquiring lock "9b078f75-57f2-495a-abd5-f8adf72db80b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:48:54 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-96609013-471a-49d4-ad89-f93668787a04 req-8b4d5c16-f6a7-40ca-bd15-e7f25903b89a service nova] Lock "9b078f75-57f2-495a-abd5-f8adf72db80b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:48:54 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-96609013-471a-49d4-ad89-f93668787a04 req-8b4d5c16-f6a7-40ca-bd15-e7f25903b89a service nova] Lock "9b078f75-57f2-495a-abd5-f8adf72db80b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:48:54 user nova-compute[75216]: DEBUG nova.compute.manager [req-96609013-471a-49d4-ad89-f93668787a04 req-8b4d5c16-f6a7-40ca-bd15-e7f25903b89a service nova] [instance: 9b078f75-57f2-495a-abd5-f8adf72db80b] No waiting events found dispatching network-vif-plugged-96bda2a6-53d1-4052-9230-4907fe60d70b {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:48:54 user nova-compute[75216]: WARNING nova.compute.manager [req-96609013-471a-49d4-ad89-f93668787a04 req-8b4d5c16-f6a7-40ca-bd15-e7f25903b89a service nova] [instance: 9b078f75-57f2-495a-abd5-f8adf72db80b] Received unexpected event network-vif-plugged-96bda2a6-53d1-4052-9230-4907fe60d70b for instance with vm_state active and task_state rescuing.
Nov 13 18:48:54 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:48:54 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:48:54 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:48:55 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:48:55 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:48:55 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:48:56 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:48:56 user nova-compute[75216]: DEBUG nova.compute.manager [req-3ef27867-41da-4945-a28c-2950fb5b53bf req-4416ed7d-6833-494b-80b0-373ad579b8da service nova] [instance: 3679beb0-5244-443a-8512-38b29ccb62f0] Received event network-vif-plugged-9dd60454-c5ac-4afe-b6fc-ad9ba9b83423 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:48:56 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-3ef27867-41da-4945-a28c-2950fb5b53bf req-4416ed7d-6833-494b-80b0-373ad579b8da service nova] Acquiring lock "3679beb0-5244-443a-8512-38b29ccb62f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:48:56 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-3ef27867-41da-4945-a28c-2950fb5b53bf req-4416ed7d-6833-494b-80b0-373ad579b8da service nova] Lock "3679beb0-5244-443a-8512-38b29ccb62f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:48:56 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-3ef27867-41da-4945-a28c-2950fb5b53bf req-4416ed7d-6833-494b-80b0-373ad579b8da service nova] Lock "3679beb0-5244-443a-8512-38b29ccb62f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:48:56 user nova-compute[75216]: DEBUG nova.compute.manager [req-3ef27867-41da-4945-a28c-2950fb5b53bf req-4416ed7d-6833-494b-80b0-373ad579b8da service nova] [instance: 3679beb0-5244-443a-8512-38b29ccb62f0] No waiting events found dispatching network-vif-plugged-9dd60454-c5ac-4afe-b6fc-ad9ba9b83423 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:48:56 user nova-compute[75216]: WARNING nova.compute.manager [req-3ef27867-41da-4945-a28c-2950fb5b53bf req-4416ed7d-6833-494b-80b0-373ad579b8da service nova] [instance: 3679beb0-5244-443a-8512-38b29ccb62f0] Received unexpected event network-vif-plugged-9dd60454-c5ac-4afe-b6fc-ad9ba9b83423 for instance with vm_state building and task_state spawning.
Nov 13 18:48:56 user nova-compute[75216]: DEBUG nova.compute.manager [req-3ef27867-41da-4945-a28c-2950fb5b53bf req-4416ed7d-6833-494b-80b0-373ad579b8da service nova] [instance: 3679beb0-5244-443a-8512-38b29ccb62f0] Received event network-vif-plugged-9dd60454-c5ac-4afe-b6fc-ad9ba9b83423 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:48:56 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-3ef27867-41da-4945-a28c-2950fb5b53bf req-4416ed7d-6833-494b-80b0-373ad579b8da service nova] Acquiring lock "3679beb0-5244-443a-8512-38b29ccb62f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:48:56 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-3ef27867-41da-4945-a28c-2950fb5b53bf req-4416ed7d-6833-494b-80b0-373ad579b8da service nova] Lock "3679beb0-5244-443a-8512-38b29ccb62f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:48:56 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-3ef27867-41da-4945-a28c-2950fb5b53bf req-4416ed7d-6833-494b-80b0-373ad579b8da service nova] Lock "3679beb0-5244-443a-8512-38b29ccb62f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:48:56 user nova-compute[75216]: DEBUG nova.compute.manager [req-3ef27867-41da-4945-a28c-2950fb5b53bf req-4416ed7d-6833-494b-80b0-373ad579b8da service nova] [instance: 3679beb0-5244-443a-8512-38b29ccb62f0] No waiting events found dispatching network-vif-plugged-9dd60454-c5ac-4afe-b6fc-ad9ba9b83423 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:48:56 user nova-compute[75216]: WARNING nova.compute.manager [req-3ef27867-41da-4945-a28c-2950fb5b53bf req-4416ed7d-6833-494b-80b0-373ad579b8da service nova] [instance: 3679beb0-5244-443a-8512-38b29ccb62f0] Received unexpected event network-vif-plugged-9dd60454-c5ac-4afe-b6fc-ad9ba9b83423 for instance with vm_state building and task_state spawning.
Nov 13 18:48:56 user nova-compute[75216]: DEBUG nova.compute.manager [None req-a29a3c63-a574-4a43-b5b5-a0560bf849c9 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] [instance: 9b078f75-57f2-495a-abd5-f8adf72db80b] Checking state {{(pid=75216) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 18:48:57 user nova-compute[75216]: DEBUG nova.compute.manager [None req-0c07ce82-71f4-4d90-bf03-02377df1ff8e tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] [instance: 3679beb0-5244-443a-8512-38b29ccb62f0] Instance event wait completed in 0 seconds for  {{(pid=75216) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 18:48:57 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-0c07ce82-71f4-4d90-bf03-02377df1ff8e tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] [instance: 3679beb0-5244-443a-8512-38b29ccb62f0] Guest created on hypervisor {{(pid=75216) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 18:48:57 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 3679beb0-5244-443a-8512-38b29ccb62f0] Instance spawned successfully.
Nov 13 18:48:57 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-0c07ce82-71f4-4d90-bf03-02377df1ff8e tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] [instance: 3679beb0-5244-443a-8512-38b29ccb62f0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 18:48:57 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-0c07ce82-71f4-4d90-bf03-02377df1ff8e tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] [instance: 3679beb0-5244-443a-8512-38b29ccb62f0] Found default for hw_cdrom_bus of ide {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 18:48:57 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-0c07ce82-71f4-4d90-bf03-02377df1ff8e tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] [instance: 3679beb0-5244-443a-8512-38b29ccb62f0] Found default for hw_disk_bus of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 18:48:57 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-0c07ce82-71f4-4d90-bf03-02377df1ff8e tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] [instance: 3679beb0-5244-443a-8512-38b29ccb62f0] Found default for hw_input_bus of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 18:48:57 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-0c07ce82-71f4-4d90-bf03-02377df1ff8e tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] [instance: 3679beb0-5244-443a-8512-38b29ccb62f0] Found default for hw_pointer_model of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 18:48:57 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-0c07ce82-71f4-4d90-bf03-02377df1ff8e tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] [instance: 3679beb0-5244-443a-8512-38b29ccb62f0] Found default for hw_video_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 18:48:57 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-0c07ce82-71f4-4d90-bf03-02377df1ff8e tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] [instance: 3679beb0-5244-443a-8512-38b29ccb62f0] Found default for hw_vif_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 18:48:57 user nova-compute[75216]: INFO nova.compute.manager [None req-0c07ce82-71f4-4d90-bf03-02377df1ff8e tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] [instance: 3679beb0-5244-443a-8512-38b29ccb62f0] Took 5.32 seconds to spawn the instance on the hypervisor.
Nov 13 18:48:57 user nova-compute[75216]: DEBUG nova.compute.manager [None req-0c07ce82-71f4-4d90-bf03-02377df1ff8e tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] [instance: 3679beb0-5244-443a-8512-38b29ccb62f0] Checking state {{(pid=75216) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 18:48:57 user nova-compute[75216]: INFO nova.compute.manager [None req-0c07ce82-71f4-4d90-bf03-02377df1ff8e tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] [instance: 3679beb0-5244-443a-8512-38b29ccb62f0] Took 12.08 seconds to build instance.
Nov 13 18:48:57 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-0c07ce82-71f4-4d90-bf03-02377df1ff8e tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] Lock "3679beb0-5244-443a-8512-38b29ccb62f0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.197s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:48:58 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:48:58 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:49:03 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:49:03 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:49:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:49:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:49:11 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:49:13 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:49:13 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:49:14 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:49:17 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:49:18 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:49:18 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:49:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:49:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:49:24 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:49:26 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:49:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:49:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:49:30 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:49:30 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:49:31 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:49:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:49:33 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:49:33 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:49:34 user nova-compute[75216]: INFO nova.compute.manager [None req-c78ddfe3-17cf-475d-9dcc-0afa9984f2bb tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] [instance: d589d57e-de50-482a-843f-e8246b3d7528] Rescuing
Nov 13 18:49:34 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c78ddfe3-17cf-475d-9dcc-0afa9984f2bb tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Acquiring lock "refresh_cache-d589d57e-de50-482a-843f-e8246b3d7528" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 18:49:34 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c78ddfe3-17cf-475d-9dcc-0afa9984f2bb tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Acquired lock "refresh_cache-d589d57e-de50-482a-843f-e8246b3d7528" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 18:49:34 user nova-compute[75216]: DEBUG nova.network.neutron [None req-c78ddfe3-17cf-475d-9dcc-0afa9984f2bb tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] [instance: d589d57e-de50-482a-843f-e8246b3d7528] Building network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 18:49:35 user nova-compute[75216]: DEBUG nova.network.neutron [None req-c78ddfe3-17cf-475d-9dcc-0afa9984f2bb tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] [instance: d589d57e-de50-482a-843f-e8246b3d7528] Updating instance_info_cache with network_info: [{"id": "87426a6f-0164-4df3-aad0-becbbbfe8310", "address": "fa:16:3e:64:4d:81", "network": {"id": "6d182db1-03b5-4d1b-86cf-b9367921b7b0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1877006951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2efafc26c47c4050bd367c47469999fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87426a6f-01", "ovs_interfaceid": "87426a6f-0164-4df3-aad0-becbbbfe8310", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 18:49:35 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c78ddfe3-17cf-475d-9dcc-0afa9984f2bb tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Releasing lock "refresh_cache-d589d57e-de50-482a-843f-e8246b3d7528" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 18:49:35 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:49:35 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:49:35 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:49:35 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:49:35 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:49:36 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: d589d57e-de50-482a-843f-e8246b3d7528] Instance destroyed successfully.
Nov 13 18:49:36 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-c78ddfe3-17cf-475d-9dcc-0afa9984f2bb tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] [instance: d589d57e-de50-482a-843f-e8246b3d7528] Attempting rescue
Nov 13 18:49:36 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-c78ddfe3-17cf-475d-9dcc-0afa9984f2bb tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75216) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 13 18:49:36 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-c78ddfe3-17cf-475d-9dcc-0afa9984f2bb tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] [instance: d589d57e-de50-482a-843f-e8246b3d7528] Instance directory exists: not creating {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 13 18:49:36 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-c78ddfe3-17cf-475d-9dcc-0afa9984f2bb tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] [instance: d589d57e-de50-482a-843f-e8246b3d7528] Creating image(s)
Nov 13 18:49:36 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c78ddfe3-17cf-475d-9dcc-0afa9984f2bb tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Acquiring lock "/opt/stack/data/nova/instances/d589d57e-de50-482a-843f-e8246b3d7528/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:49:36 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c78ddfe3-17cf-475d-9dcc-0afa9984f2bb tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Lock "/opt/stack/data/nova/instances/d589d57e-de50-482a-843f-e8246b3d7528/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:49:36 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c78ddfe3-17cf-475d-9dcc-0afa9984f2bb tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Lock "/opt/stack/data/nova/instances/d589d57e-de50-482a-843f-e8246b3d7528/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:49:36 user nova-compute[75216]: DEBUG nova.objects.instance [None req-c78ddfe3-17cf-475d-9dcc-0afa9984f2bb tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Lazy-loading 'trusted_certs' on Instance uuid d589d57e-de50-482a-843f-e8246b3d7528 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 18:49:36 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c78ddfe3-17cf-475d-9dcc-0afa9984f2bb tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Acquiring lock "88c50a45bec9d6b0427462b3242b9b8e5f49c2b6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:49:36 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c78ddfe3-17cf-475d-9dcc-0afa9984f2bb tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Lock "88c50a45bec9d6b0427462b3242b9b8e5f49c2b6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:49:36 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-c78ddfe3-17cf-475d-9dcc-0afa9984f2bb tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:49:36 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-c78ddfe3-17cf-475d-9dcc-0afa9984f2bb tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json" returned: 0 in 0.172s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:49:36 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-c78ddfe3-17cf-475d-9dcc-0afa9984f2bb tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6,backing_fmt=raw /opt/stack/data/nova/instances/d589d57e-de50-482a-843f-e8246b3d7528/disk.rescue {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:49:36 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-c78ddfe3-17cf-475d-9dcc-0afa9984f2bb tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6,backing_fmt=raw /opt/stack/data/nova/instances/d589d57e-de50-482a-843f-e8246b3d7528/disk.rescue" returned: 0 in 0.049s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:49:36 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c78ddfe3-17cf-475d-9dcc-0afa9984f2bb tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Lock "88c50a45bec9d6b0427462b3242b9b8e5f49c2b6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.228s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:49:36 user nova-compute[75216]: DEBUG nova.objects.instance [None req-c78ddfe3-17cf-475d-9dcc-0afa9984f2bb tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Lazy-loading 'migration_context' on Instance uuid d589d57e-de50-482a-843f-e8246b3d7528 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 18:49:36 user nova-compute[75216]: DEBUG nova.objects.base [None req-c78ddfe3-17cf-475d-9dcc-0afa9984f2bb tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Object Instance<d589d57e-de50-482a-843f-e8246b3d7528> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75216) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 18:49:36 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-c78ddfe3-17cf-475d-9dcc-0afa9984f2bb tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] [instance: d589d57e-de50-482a-843f-e8246b3d7528] Created local disks {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 18:49:36 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-c78ddfe3-17cf-475d-9dcc-0afa9984f2bb tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] [instance: d589d57e-de50-482a-843f-e8246b3d7528] Start _get_guest_xml network_info=[{"id": "87426a6f-0164-4df3-aad0-becbbbfe8310", "address": "fa:16:3e:64:4d:81", "network": {"id": "6d182db1-03b5-4d1b-86cf-b9367921b7b0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1877006951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1877006951-network", "vif_mac": "fa:16:3e:64:4d:81"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2efafc26c47c4050bd367c47469999fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87426a6f-01", "ovs_interfaceid": "87426a6f-0164-4df3-aad0-becbbbfe8310", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T18:41:06Z,direct_url=<?>,disk_format='qcow2',id=77bcb5ba-8510-41ec-a88d-96097bb431de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c465b7c26ec44582b6d1b7169536ecc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T18:41:07Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '77bcb5ba-8510-41ec-a88d-96097bb431de', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 18:49:36 user nova-compute[75216]: DEBUG nova.objects.instance [None req-c78ddfe3-17cf-475d-9dcc-0afa9984f2bb tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Lazy-loading 'resources' on Instance uuid d589d57e-de50-482a-843f-e8246b3d7528 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 18:49:36 user nova-compute[75216]: DEBUG nova.objects.base [None req-c78ddfe3-17cf-475d-9dcc-0afa9984f2bb tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Object Instance<d589d57e-de50-482a-843f-e8246b3d7528> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75216) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 18:49:36 user nova-compute[75216]: DEBUG nova.objects.instance [None req-c78ddfe3-17cf-475d-9dcc-0afa9984f2bb tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Lazy-loading 'numa_topology' on Instance uuid d589d57e-de50-482a-843f-e8246b3d7528 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 18:49:36 user nova-compute[75216]: DEBUG nova.objects.base [None req-c78ddfe3-17cf-475d-9dcc-0afa9984f2bb tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Object Instance<d589d57e-de50-482a-843f-e8246b3d7528> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75216) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 18:49:36 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-c78ddfe3-17cf-475d-9dcc-0afa9984f2bb tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 18:49:36 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-c78ddfe3-17cf-475d-9dcc-0afa9984f2bb tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 18:49:36 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-c78ddfe3-17cf-475d-9dcc-0afa9984f2bb tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 18:49:36 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-c78ddfe3-17cf-475d-9dcc-0afa9984f2bb tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] CPU controller missing on host. {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 18:49:36 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-c78ddfe3-17cf-475d-9dcc-0afa9984f2bb tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 18:49:36 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-c78ddfe3-17cf-475d-9dcc-0afa9984f2bb tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] CPU controller found on host. {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 18:49:36 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-c78ddfe3-17cf-475d-9dcc-0afa9984f2bb tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75216) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 18:49:36 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-c78ddfe3-17cf-475d-9dcc-0afa9984f2bb tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T18:40:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T18:41:06Z,direct_url=<?>,disk_format='qcow2',id=77bcb5ba-8510-41ec-a88d-96097bb431de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c465b7c26ec44582b6d1b7169536ecc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T18:41:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 18:49:36 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-c78ddfe3-17cf-475d-9dcc-0afa9984f2bb tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Flavor limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 18:49:36 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-c78ddfe3-17cf-475d-9dcc-0afa9984f2bb tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Image limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 18:49:36 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-c78ddfe3-17cf-475d-9dcc-0afa9984f2bb tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Flavor pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 18:49:36 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-c78ddfe3-17cf-475d-9dcc-0afa9984f2bb tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Image pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 18:49:36 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-c78ddfe3-17cf-475d-9dcc-0afa9984f2bb tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 18:49:36 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-c78ddfe3-17cf-475d-9dcc-0afa9984f2bb tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 18:49:36 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-c78ddfe3-17cf-475d-9dcc-0afa9984f2bb tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 18:49:36 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-c78ddfe3-17cf-475d-9dcc-0afa9984f2bb tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Got 1 possible topologies {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 18:49:36 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-c78ddfe3-17cf-475d-9dcc-0afa9984f2bb tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 18:49:36 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-c78ddfe3-17cf-475d-9dcc-0afa9984f2bb tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 18:49:36 user nova-compute[75216]: DEBUG nova.objects.instance [None req-c78ddfe3-17cf-475d-9dcc-0afa9984f2bb tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Lazy-loading 'vcpu_model' on Instance uuid d589d57e-de50-482a-843f-e8246b3d7528 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 18:49:36 user nova-compute[75216]: DEBUG nova.objects.base [None req-c78ddfe3-17cf-475d-9dcc-0afa9984f2bb tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Object Instance<d589d57e-de50-482a-843f-e8246b3d7528> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75216) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 18:49:36 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-c78ddfe3-17cf-475d-9dcc-0afa9984f2bb tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T18:44:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2144084973',display_name='tempest-ServerRescueNegativeTestJSON-server-2144084973',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2144084973',id=3,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-13T18:45:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2efafc26c47c4050bd367c47469999fb',ramdisk_id='',reservation_id='r-4hj1xmlx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-165310019',owner_user_name='tempest-ServerRescueNegativeTestJSON-165310019-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T18:45:05Z,user_data=None,user_id='3587565f5b56450e95f2bd572d7e4f88',uuid=d589d57e-de50-482a-843f-e8246b3d7528,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "87426a6f-0164-4df3-aad0-becbbbfe8310", "address": "fa:16:3e:64:4d:81", "network": {"id": "6d182db1-03b5-4d1b-86cf-b9367921b7b0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1877006951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1877006951-network", "vif_mac": "fa:16:3e:64:4d:81"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2efafc26c47c4050bd367c47469999fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87426a6f-01", "ovs_interfaceid": "87426a6f-0164-4df3-aad0-becbbbfe8310", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75216) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 18:49:36 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-c78ddfe3-17cf-475d-9dcc-0afa9984f2bb tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Converting VIF {"id": "87426a6f-0164-4df3-aad0-becbbbfe8310", "address": "fa:16:3e:64:4d:81", "network": {"id": "6d182db1-03b5-4d1b-86cf-b9367921b7b0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1877006951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1877006951-network", "vif_mac": "fa:16:3e:64:4d:81"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2efafc26c47c4050bd367c47469999fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87426a6f-01", "ovs_interfaceid": "87426a6f-0164-4df3-aad0-becbbbfe8310", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 18:49:36 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-c78ddfe3-17cf-475d-9dcc-0afa9984f2bb tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:64:4d:81,bridge_name='br-int',has_traffic_filtering=True,id=87426a6f-0164-4df3-aad0-becbbbfe8310,network=Network(6d182db1-03b5-4d1b-86cf-b9367921b7b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87426a6f-01') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 18:49:36 user nova-compute[75216]: DEBUG nova.objects.instance [None req-c78ddfe3-17cf-475d-9dcc-0afa9984f2bb tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Lazy-loading 'pci_devices' on Instance uuid d589d57e-de50-482a-843f-e8246b3d7528 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 18:49:36 user nova-compute[75216]: DEBUG nova.objects.base [None req-c78ddfe3-17cf-475d-9dcc-0afa9984f2bb tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Object Instance<d589d57e-de50-482a-843f-e8246b3d7528> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75216) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 18:49:36 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-c78ddfe3-17cf-475d-9dcc-0afa9984f2bb tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] [instance: d589d57e-de50-482a-843f-e8246b3d7528] End _get_guest_xml xml=<domain type="kvm">
Nov 13 18:49:36 user nova-compute[75216]:   <uuid>d589d57e-de50-482a-843f-e8246b3d7528</uuid>
Nov 13 18:49:36 user nova-compute[75216]:   <name>instance-00000003</name>
Nov 13 18:49:36 user nova-compute[75216]:   <memory>524288</memory>
Nov 13 18:49:36 user nova-compute[75216]:   <vcpu>1</vcpu>
Nov 13 18:49:36 user nova-compute[75216]:   <metadata>
Nov 13 18:49:36 user nova-compute[75216]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 18:49:36 user nova-compute[75216]:       <nova:package version="0.0.0"/>
Nov 13 18:49:36 user nova-compute[75216]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-2144084973</nova:name>
Nov 13 18:49:36 user nova-compute[75216]:       <nova:creationTime>2023-11-13 18:49:36</nova:creationTime>
Nov 13 18:49:36 user nova-compute[75216]:       <nova:flavor name="m1.tiny">
Nov 13 18:49:36 user nova-compute[75216]:         <nova:memory>512</nova:memory>
Nov 13 18:49:36 user nova-compute[75216]:         <nova:disk>1</nova:disk>
Nov 13 18:49:36 user nova-compute[75216]:         <nova:swap>0</nova:swap>
Nov 13 18:49:36 user nova-compute[75216]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 18:49:36 user nova-compute[75216]:         <nova:vcpus>1</nova:vcpus>
Nov 13 18:49:36 user nova-compute[75216]:       </nova:flavor>
Nov 13 18:49:36 user nova-compute[75216]:       <nova:owner>
Nov 13 18:49:36 user nova-compute[75216]:         <nova:user uuid="3587565f5b56450e95f2bd572d7e4f88">tempest-ServerRescueNegativeTestJSON-165310019-project-member</nova:user>
Nov 13 18:49:36 user nova-compute[75216]:         <nova:project uuid="2efafc26c47c4050bd367c47469999fb">tempest-ServerRescueNegativeTestJSON-165310019</nova:project>
Nov 13 18:49:36 user nova-compute[75216]:       </nova:owner>
Nov 13 18:49:36 user nova-compute[75216]:       <nova:root type="image" uuid="77bcb5ba-8510-41ec-a88d-96097bb431de"/>
Nov 13 18:49:36 user nova-compute[75216]:       <nova:ports>
Nov 13 18:49:36 user nova-compute[75216]:         <nova:port uuid="87426a6f-0164-4df3-aad0-becbbbfe8310">
Nov 13 18:49:36 user nova-compute[75216]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 13 18:49:36 user nova-compute[75216]:         </nova:port>
Nov 13 18:49:36 user nova-compute[75216]:       </nova:ports>
Nov 13 18:49:36 user nova-compute[75216]:     </nova:instance>
Nov 13 18:49:36 user nova-compute[75216]:   </metadata>
Nov 13 18:49:36 user nova-compute[75216]:   <sysinfo type="smbios">
Nov 13 18:49:36 user nova-compute[75216]:     <system>
Nov 13 18:49:36 user nova-compute[75216]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 18:49:36 user nova-compute[75216]:       <entry name="product">OpenStack Nova</entry>
Nov 13 18:49:36 user nova-compute[75216]:       <entry name="version">0.0.0</entry>
Nov 13 18:49:36 user nova-compute[75216]:       <entry name="serial">d589d57e-de50-482a-843f-e8246b3d7528</entry>
Nov 13 18:49:36 user nova-compute[75216]:       <entry name="uuid">d589d57e-de50-482a-843f-e8246b3d7528</entry>
Nov 13 18:49:36 user nova-compute[75216]:       <entry name="family">Virtual Machine</entry>
Nov 13 18:49:36 user nova-compute[75216]:     </system>
Nov 13 18:49:36 user nova-compute[75216]:   </sysinfo>
Nov 13 18:49:36 user nova-compute[75216]:   <os>
Nov 13 18:49:36 user nova-compute[75216]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 18:49:36 user nova-compute[75216]:     <smbios mode="sysinfo"/>
Nov 13 18:49:36 user nova-compute[75216]:   </os>
Nov 13 18:49:36 user nova-compute[75216]:   <features>
Nov 13 18:49:36 user nova-compute[75216]:     <acpi/>
Nov 13 18:49:36 user nova-compute[75216]:     <apic/>
Nov 13 18:49:36 user nova-compute[75216]:     <vmcoreinfo/>
Nov 13 18:49:36 user nova-compute[75216]:   </features>
Nov 13 18:49:36 user nova-compute[75216]:   <clock offset="utc">
Nov 13 18:49:36 user nova-compute[75216]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 18:49:36 user nova-compute[75216]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 18:49:36 user nova-compute[75216]:     <timer name="hpet" present="no"/>
Nov 13 18:49:36 user nova-compute[75216]:   </clock>
Nov 13 18:49:36 user nova-compute[75216]:   <cpu mode="custom" match="exact">
Nov 13 18:49:36 user nova-compute[75216]:     <model>Nehalem</model>
Nov 13 18:49:36 user nova-compute[75216]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 18:49:36 user nova-compute[75216]:   </cpu>
Nov 13 18:49:36 user nova-compute[75216]:   <devices>
Nov 13 18:49:36 user nova-compute[75216]:     <disk type="file" device="disk">
Nov 13 18:49:36 user nova-compute[75216]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 18:49:36 user nova-compute[75216]:       <source file="/opt/stack/data/nova/instances/d589d57e-de50-482a-843f-e8246b3d7528/disk.rescue"/>
Nov 13 18:49:36 user nova-compute[75216]:       <target dev="vda" bus="virtio"/>
Nov 13 18:49:36 user nova-compute[75216]:     </disk>
Nov 13 18:49:36 user nova-compute[75216]:     <disk type="file" device="disk">
Nov 13 18:49:36 user nova-compute[75216]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 18:49:36 user nova-compute[75216]:       <source file="/opt/stack/data/nova/instances/d589d57e-de50-482a-843f-e8246b3d7528/disk"/>
Nov 13 18:49:36 user nova-compute[75216]:       <target dev="vdb" bus="virtio"/>
Nov 13 18:49:36 user nova-compute[75216]:     </disk>
Nov 13 18:49:36 user nova-compute[75216]:     <interface type="ethernet">
Nov 13 18:49:36 user nova-compute[75216]:       <mac address="fa:16:3e:64:4d:81"/>
Nov 13 18:49:36 user nova-compute[75216]:       <model type="virtio"/>
Nov 13 18:49:36 user nova-compute[75216]:       <mtu size="1442"/>
Nov 13 18:49:36 user nova-compute[75216]:       <target dev="tap87426a6f-01"/>
Nov 13 18:49:36 user nova-compute[75216]:     </interface>
Nov 13 18:49:36 user nova-compute[75216]:     <serial type="pty">
Nov 13 18:49:36 user nova-compute[75216]:       <log file="/opt/stack/data/nova/instances/d589d57e-de50-482a-843f-e8246b3d7528/console.log" append="off"/>
Nov 13 18:49:36 user nova-compute[75216]:     </serial>
Nov 13 18:49:36 user nova-compute[75216]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 18:49:36 user nova-compute[75216]:     <video>
Nov 13 18:49:36 user nova-compute[75216]:       <model type="virtio"/>
Nov 13 18:49:36 user nova-compute[75216]:     </video>
Nov 13 18:49:36 user nova-compute[75216]:     <rng model="virtio">
Nov 13 18:49:36 user nova-compute[75216]:       <backend model="random">/dev/urandom</backend>
Nov 13 18:49:36 user nova-compute[75216]:     </rng>
Nov 13 18:49:36 user nova-compute[75216]:     <controller type="usb" index="0" model="none"/>
Nov 13 18:49:36 user nova-compute[75216]:     <memballoon model="virtio">
Nov 13 18:49:36 user nova-compute[75216]:       <stats period="10"/>
Nov 13 18:49:36 user nova-compute[75216]:     </memballoon>
Nov 13 18:49:36 user nova-compute[75216]:   </devices>
Nov 13 18:49:36 user nova-compute[75216]: </domain>
Nov 13 18:49:36 user nova-compute[75216]:  {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 18:49:36 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: d589d57e-de50-482a-843f-e8246b3d7528] Instance destroyed successfully.
Nov 13 18:49:36 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-c78ddfe3-17cf-475d-9dcc-0afa9984f2bb tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 18:49:36 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-c78ddfe3-17cf-475d-9dcc-0afa9984f2bb tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 18:49:36 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-c78ddfe3-17cf-475d-9dcc-0afa9984f2bb tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] No VIF found with MAC fa:16:3e:64:4d:81, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 18:49:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:49:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:49:38 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:49:38 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:49:38 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:49:38 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:49:38 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:49:38 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:49:38 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e9f1128d-d951-48a0-99bf-8da897754545 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] Acquiring lock "e1350bc4-558a-40ac-91e5-96da24f154f5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:49:38 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e9f1128d-d951-48a0-99bf-8da897754545 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] Lock "e1350bc4-558a-40ac-91e5-96da24f154f5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:49:38 user nova-compute[75216]: DEBUG nova.compute.manager [None req-e9f1128d-d951-48a0-99bf-8da897754545 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] [instance: e1350bc4-558a-40ac-91e5-96da24f154f5] Starting instance... {{(pid=75216) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 18:49:38 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e9f1128d-d951-48a0-99bf-8da897754545 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:49:38 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e9f1128d-d951-48a0-99bf-8da897754545 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:49:38 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-e9f1128d-d951-48a0-99bf-8da897754545 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75216) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 18:49:38 user nova-compute[75216]: INFO nova.compute.claims [None req-e9f1128d-d951-48a0-99bf-8da897754545 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] [instance: e1350bc4-558a-40ac-91e5-96da24f154f5] Claim successful on node user
Nov 13 18:49:39 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-e9f1128d-d951-48a0-99bf-8da897754545 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 18:49:39 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-e9f1128d-d951-48a0-99bf-8da897754545 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 18:49:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e9f1128d-d951-48a0-99bf-8da897754545 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.443s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:49:39 user nova-compute[75216]: DEBUG nova.compute.manager [None req-e9f1128d-d951-48a0-99bf-8da897754545 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] [instance: e1350bc4-558a-40ac-91e5-96da24f154f5] Start building networks asynchronously for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 18:49:39 user nova-compute[75216]: DEBUG nova.compute.manager [None req-e9f1128d-d951-48a0-99bf-8da897754545 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] [instance: e1350bc4-558a-40ac-91e5-96da24f154f5] Allocating IP information in the background. {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 18:49:39 user nova-compute[75216]: DEBUG nova.network.neutron [None req-e9f1128d-d951-48a0-99bf-8da897754545 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] [instance: e1350bc4-558a-40ac-91e5-96da24f154f5] allocate_for_instance() {{(pid=75216) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 18:49:39 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-e9f1128d-d951-48a0-99bf-8da897754545 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] [instance: e1350bc4-558a-40ac-91e5-96da24f154f5] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Nov 13 18:49:39 user nova-compute[75216]: DEBUG nova.compute.manager [None req-e9f1128d-d951-48a0-99bf-8da897754545 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] [instance: e1350bc4-558a-40ac-91e5-96da24f154f5] Start building block device mappings for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 18:49:39 user nova-compute[75216]: DEBUG nova.policy [None req-e9f1128d-d951-48a0-99bf-8da897754545 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a2dca87196c74236b3df1cc4eed57cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3303a3ffcb5d4d1495f45a7c3cc9076a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75216) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 18:49:39 user nova-compute[75216]: DEBUG nova.compute.manager [None req-e9f1128d-d951-48a0-99bf-8da897754545 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] [instance: e1350bc4-558a-40ac-91e5-96da24f154f5] Start spawning the instance on the hypervisor. {{(pid=75216) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 18:49:39 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-e9f1128d-d951-48a0-99bf-8da897754545 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] [instance: e1350bc4-558a-40ac-91e5-96da24f154f5] Creating instance directory {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 18:49:39 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-e9f1128d-d951-48a0-99bf-8da897754545 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] [instance: e1350bc4-558a-40ac-91e5-96da24f154f5] Creating image(s)
Nov 13 18:49:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e9f1128d-d951-48a0-99bf-8da897754545 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] Acquiring lock "/opt/stack/data/nova/instances/e1350bc4-558a-40ac-91e5-96da24f154f5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:49:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e9f1128d-d951-48a0-99bf-8da897754545 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] Lock "/opt/stack/data/nova/instances/e1350bc4-558a-40ac-91e5-96da24f154f5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:49:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e9f1128d-d951-48a0-99bf-8da897754545 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] Lock "/opt/stack/data/nova/instances/e1350bc4-558a-40ac-91e5-96da24f154f5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:49:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e9f1128d-d951-48a0-99bf-8da897754545 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] Acquiring lock "b5e1c640f34f21d2c6b20cd3235743c7e0f6e8b1" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:49:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e9f1128d-d951-48a0-99bf-8da897754545 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] Lock "b5e1c640f34f21d2c6b20cd3235743c7e0f6e8b1" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:49:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-e9f1128d-d951-48a0-99bf-8da897754545 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b5e1c640f34f21d2c6b20cd3235743c7e0f6e8b1.part --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:49:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-e9f1128d-d951-48a0-99bf-8da897754545 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b5e1c640f34f21d2c6b20cd3235743c7e0f6e8b1.part --force-share --output=json" returned: 0 in 0.199s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:49:40 user nova-compute[75216]: DEBUG nova.virt.images [None req-e9f1128d-d951-48a0-99bf-8da897754545 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] d64c4c49-a469-4642-ae7c-29858896ff0d was qcow2, converting to raw {{(pid=75216) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 13 18:49:40 user nova-compute[75216]: DEBUG nova.privsep.utils [None req-e9f1128d-d951-48a0-99bf-8da897754545 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75216) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 13 18:49:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-e9f1128d-d951-48a0-99bf-8da897754545 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b5e1c640f34f21d2c6b20cd3235743c7e0f6e8b1.part /opt/stack/data/nova/instances/_base/b5e1c640f34f21d2c6b20cd3235743c7e0f6e8b1.converted {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:49:40 user nova-compute[75216]: DEBUG nova.compute.manager [None req-c78ddfe3-17cf-475d-9dcc-0afa9984f2bb tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] [instance: d589d57e-de50-482a-843f-e8246b3d7528] Checking state {{(pid=75216) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 18:49:40 user nova-compute[75216]: DEBUG nova.network.neutron [None req-e9f1128d-d951-48a0-99bf-8da897754545 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] [instance: e1350bc4-558a-40ac-91e5-96da24f154f5] Successfully created port: 87a8f08d-9d26-49e7-9111-8758d3bbcf2f {{(pid=75216) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 18:49:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-e9f1128d-d951-48a0-99bf-8da897754545 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b5e1c640f34f21d2c6b20cd3235743c7e0f6e8b1.part /opt/stack/data/nova/instances/_base/b5e1c640f34f21d2c6b20cd3235743c7e0f6e8b1.converted" returned: 0 in 0.173s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:49:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-e9f1128d-d951-48a0-99bf-8da897754545 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b5e1c640f34f21d2c6b20cd3235743c7e0f6e8b1.converted --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:49:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-e9f1128d-d951-48a0-99bf-8da897754545 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b5e1c640f34f21d2c6b20cd3235743c7e0f6e8b1.converted --force-share --output=json" returned: 0 in 0.223s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:49:40 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e9f1128d-d951-48a0-99bf-8da897754545 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] Lock "b5e1c640f34f21d2c6b20cd3235743c7e0f6e8b1" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.026s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:49:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-e9f1128d-d951-48a0-99bf-8da897754545 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b5e1c640f34f21d2c6b20cd3235743c7e0f6e8b1 --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:49:40 user nova-compute[75216]: DEBUG nova.compute.manager [req-17dfca3e-c868-4191-85e0-421cd424ed00 req-0b53de61-1a10-462f-a891-4e4eba592d7f service nova] [instance: d589d57e-de50-482a-843f-e8246b3d7528] Received event network-vif-unplugged-87426a6f-0164-4df3-aad0-becbbbfe8310 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:49:40 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-17dfca3e-c868-4191-85e0-421cd424ed00 req-0b53de61-1a10-462f-a891-4e4eba592d7f service nova] Acquiring lock "d589d57e-de50-482a-843f-e8246b3d7528-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:49:40 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-17dfca3e-c868-4191-85e0-421cd424ed00 req-0b53de61-1a10-462f-a891-4e4eba592d7f service nova] Lock "d589d57e-de50-482a-843f-e8246b3d7528-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:49:40 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-17dfca3e-c868-4191-85e0-421cd424ed00 req-0b53de61-1a10-462f-a891-4e4eba592d7f service nova] Lock "d589d57e-de50-482a-843f-e8246b3d7528-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:49:40 user nova-compute[75216]: DEBUG nova.compute.manager [req-17dfca3e-c868-4191-85e0-421cd424ed00 req-0b53de61-1a10-462f-a891-4e4eba592d7f service nova] [instance: d589d57e-de50-482a-843f-e8246b3d7528] No waiting events found dispatching network-vif-unplugged-87426a6f-0164-4df3-aad0-becbbbfe8310 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:49:40 user nova-compute[75216]: WARNING nova.compute.manager [req-17dfca3e-c868-4191-85e0-421cd424ed00 req-0b53de61-1a10-462f-a891-4e4eba592d7f service nova] [instance: d589d57e-de50-482a-843f-e8246b3d7528] Received unexpected event network-vif-unplugged-87426a6f-0164-4df3-aad0-becbbbfe8310 for instance with vm_state rescued and task_state None.
Nov 13 18:49:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-e9f1128d-d951-48a0-99bf-8da897754545 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b5e1c640f34f21d2c6b20cd3235743c7e0f6e8b1 --force-share --output=json" returned: 0 in 0.201s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:49:40 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e9f1128d-d951-48a0-99bf-8da897754545 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] Acquiring lock "b5e1c640f34f21d2c6b20cd3235743c7e0f6e8b1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:49:40 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e9f1128d-d951-48a0-99bf-8da897754545 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] Lock "b5e1c640f34f21d2c6b20cd3235743c7e0f6e8b1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:49:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-e9f1128d-d951-48a0-99bf-8da897754545 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b5e1c640f34f21d2c6b20cd3235743c7e0f6e8b1 --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:49:41 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-e9f1128d-d951-48a0-99bf-8da897754545 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b5e1c640f34f21d2c6b20cd3235743c7e0f6e8b1 --force-share --output=json" returned: 0 in 0.176s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:49:41 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-e9f1128d-d951-48a0-99bf-8da897754545 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b5e1c640f34f21d2c6b20cd3235743c7e0f6e8b1,backing_fmt=raw /opt/stack/data/nova/instances/e1350bc4-558a-40ac-91e5-96da24f154f5/disk 1073741824 {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:49:41 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-e9f1128d-d951-48a0-99bf-8da897754545 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b5e1c640f34f21d2c6b20cd3235743c7e0f6e8b1,backing_fmt=raw /opt/stack/data/nova/instances/e1350bc4-558a-40ac-91e5-96da24f154f5/disk 1073741824" returned: 0 in 0.051s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:49:41 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e9f1128d-d951-48a0-99bf-8da897754545 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] Lock "b5e1c640f34f21d2c6b20cd3235743c7e0f6e8b1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.240s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:49:41 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-e9f1128d-d951-48a0-99bf-8da897754545 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b5e1c640f34f21d2c6b20cd3235743c7e0f6e8b1 --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:49:41 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-e9f1128d-d951-48a0-99bf-8da897754545 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b5e1c640f34f21d2c6b20cd3235743c7e0f6e8b1 --force-share --output=json" returned: 0 in 0.202s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:49:41 user nova-compute[75216]: DEBUG nova.virt.disk.api [None req-e9f1128d-d951-48a0-99bf-8da897754545 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e1350bc4-558a-40ac-91e5-96da24f154f5/disk. size=1073741824 {{(pid=75216) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 18:49:41 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-e9f1128d-d951-48a0-99bf-8da897754545 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1350bc4-558a-40ac-91e5-96da24f154f5/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:49:41 user nova-compute[75216]: DEBUG nova.network.neutron [None req-e9f1128d-d951-48a0-99bf-8da897754545 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] [instance: e1350bc4-558a-40ac-91e5-96da24f154f5] Successfully updated port: 87a8f08d-9d26-49e7-9111-8758d3bbcf2f {{(pid=75216) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 18:49:41 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e9f1128d-d951-48a0-99bf-8da897754545 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] Acquiring lock "refresh_cache-e1350bc4-558a-40ac-91e5-96da24f154f5" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 18:49:41 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e9f1128d-d951-48a0-99bf-8da897754545 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] Acquired lock "refresh_cache-e1350bc4-558a-40ac-91e5-96da24f154f5" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 18:49:41 user nova-compute[75216]: DEBUG nova.network.neutron [None req-e9f1128d-d951-48a0-99bf-8da897754545 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] [instance: e1350bc4-558a-40ac-91e5-96da24f154f5] Building network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 18:49:41 user nova-compute[75216]: DEBUG nova.network.neutron [None req-e9f1128d-d951-48a0-99bf-8da897754545 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] [instance: e1350bc4-558a-40ac-91e5-96da24f154f5] Instance cache missing network info. {{(pid=75216) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 18:49:41 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-e9f1128d-d951-48a0-99bf-8da897754545 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1350bc4-558a-40ac-91e5-96da24f154f5/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:49:41 user nova-compute[75216]: DEBUG nova.virt.disk.api [None req-e9f1128d-d951-48a0-99bf-8da897754545 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] Cannot resize image /opt/stack/data/nova/instances/e1350bc4-558a-40ac-91e5-96da24f154f5/disk to a smaller size. {{(pid=75216) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 18:49:41 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-e9f1128d-d951-48a0-99bf-8da897754545 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] [instance: e1350bc4-558a-40ac-91e5-96da24f154f5] Created local disks {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 18:49:41 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-e9f1128d-d951-48a0-99bf-8da897754545 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] [instance: e1350bc4-558a-40ac-91e5-96da24f154f5] Ensure instance console log exists: /opt/stack/data/nova/instances/e1350bc4-558a-40ac-91e5-96da24f154f5/console.log {{(pid=75216) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 18:49:41 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e9f1128d-d951-48a0-99bf-8da897754545 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:49:41 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e9f1128d-d951-48a0-99bf-8da897754545 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:49:41 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e9f1128d-d951-48a0-99bf-8da897754545 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:49:41 user nova-compute[75216]: DEBUG nova.network.neutron [None req-e9f1128d-d951-48a0-99bf-8da897754545 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] [instance: e1350bc4-558a-40ac-91e5-96da24f154f5] Updating instance_info_cache with network_info: [{"id": "87a8f08d-9d26-49e7-9111-8758d3bbcf2f", "address": "fa:16:3e:96:a6:55", "network": {"id": "78d34574-c9cb-4054-9b54-15ab42a41a6d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-2015553211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3303a3ffcb5d4d1495f45a7c3cc9076a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87a8f08d-9d", "ovs_interfaceid": "87a8f08d-9d26-49e7-9111-8758d3bbcf2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 18:49:41 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e9f1128d-d951-48a0-99bf-8da897754545 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] Releasing lock "refresh_cache-e1350bc4-558a-40ac-91e5-96da24f154f5" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 18:49:41 user nova-compute[75216]: DEBUG nova.compute.manager [None req-e9f1128d-d951-48a0-99bf-8da897754545 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] [instance: e1350bc4-558a-40ac-91e5-96da24f154f5] Instance network_info: |[{"id": "87a8f08d-9d26-49e7-9111-8758d3bbcf2f", "address": "fa:16:3e:96:a6:55", "network": {"id": "78d34574-c9cb-4054-9b54-15ab42a41a6d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-2015553211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3303a3ffcb5d4d1495f45a7c3cc9076a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87a8f08d-9d", "ovs_interfaceid": "87a8f08d-9d26-49e7-9111-8758d3bbcf2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 18:49:41 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-e9f1128d-d951-48a0-99bf-8da897754545 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] [instance: e1350bc4-558a-40ac-91e5-96da24f154f5] Start _get_guest_xml network_info=[{"id": "87a8f08d-9d26-49e7-9111-8758d3bbcf2f", "address": "fa:16:3e:96:a6:55", "network": {"id": "78d34574-c9cb-4054-9b54-15ab42a41a6d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-2015553211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3303a3ffcb5d4d1495f45a7c3cc9076a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87a8f08d-9d", "ovs_interfaceid": "87a8f08d-9d26-49e7-9111-8758d3bbcf2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T18:49:34Z,direct_url=<?>,disk_format='qcow2',id=d64c4c49-a469-4642-ae7c-29858896ff0d,min_disk=0,min_ram=0,name='',owner='05bccd41685d4d5b943155b9cbb10b3a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T18:49:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'disk_bus': 'scsi', 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/sda', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'guest_format': None, 'boot_index': 0, 'image_id': 'd64c4c49-a469-4642-ae7c-29858896ff0d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 18:49:41 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-e9f1128d-d951-48a0-99bf-8da897754545 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 18:49:41 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-e9f1128d-d951-48a0-99bf-8da897754545 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 18:49:41 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-e9f1128d-d951-48a0-99bf-8da897754545 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 18:49:41 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-e9f1128d-d951-48a0-99bf-8da897754545 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] CPU controller missing on host. {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 18:49:41 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-e9f1128d-d951-48a0-99bf-8da897754545 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 18:49:41 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-e9f1128d-d951-48a0-99bf-8da897754545 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] CPU controller found on host. {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 18:49:41 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-e9f1128d-d951-48a0-99bf-8da897754545 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75216) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 18:49:41 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-e9f1128d-d951-48a0-99bf-8da897754545 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T18:40:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T18:49:34Z,direct_url=<?>,disk_format='qcow2',id=d64c4c49-a469-4642-ae7c-29858896ff0d,min_disk=0,min_ram=0,name='',owner='05bccd41685d4d5b943155b9cbb10b3a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T18:49:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 18:49:41 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-e9f1128d-d951-48a0-99bf-8da897754545 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] Flavor limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 18:49:41 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-e9f1128d-d951-48a0-99bf-8da897754545 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] Image limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 18:49:41 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-e9f1128d-d951-48a0-99bf-8da897754545 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] Flavor pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 18:49:41 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-e9f1128d-d951-48a0-99bf-8da897754545 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] Image pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 18:49:41 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-e9f1128d-d951-48a0-99bf-8da897754545 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 18:49:41 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-e9f1128d-d951-48a0-99bf-8da897754545 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 18:49:41 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-e9f1128d-d951-48a0-99bf-8da897754545 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 18:49:41 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-e9f1128d-d951-48a0-99bf-8da897754545 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] Got 1 possible topologies {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 18:49:41 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-e9f1128d-d951-48a0-99bf-8da897754545 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 18:49:41 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-e9f1128d-d951-48a0-99bf-8da897754545 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 18:49:41 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-e9f1128d-d951-48a0-99bf-8da897754545 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T18:49:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-529468211',display_name='tempest-AttachSCSIVolumeTestJSON-server-529468211',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-529468211',id=17,image_ref='d64c4c49-a469-4642-ae7c-29858896ff0d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPB5htGRf8NhiIPLr8eOrgxloOYLp5TkNhpR6mTQWG6uAqBLI/87B6kEefWqRX1VvhVG3RLYOcrRZ6ZP4R0fBedkJ8nBgor9P1bXRGfTN4XWv6AcTT6wB54THMNFO4Djvg==',key_name='tempest-keypair-270475825',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3303a3ffcb5d4d1495f45a7c3cc9076a',ramdisk_id='',reservation_id='r-91g4y0qg',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d64c4c49-a469-4642-ae7c-29858896ff0d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-913042882',owner_user_name='tempest-AttachSCSIVolumeTestJSON-913042882-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T18:49:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a2dca87196c74236b3df1cc4eed57cd4',uuid=e1350bc4-558a-40ac-91e5-96da24f154f5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "87a8f08d-9d26-49e7-9111-8758d3bbcf2f", "address": "fa:16:3e:96:a6:55", "network": {"id": "78d34574-c9cb-4054-9b54-15ab42a41a6d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-2015553211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3303a3ffcb5d4d1495f45a7c3cc9076a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87a8f08d-9d", "ovs_interfaceid": "87a8f08d-9d26-49e7-9111-8758d3bbcf2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75216) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 18:49:41 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-e9f1128d-d951-48a0-99bf-8da897754545 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] Converting VIF {"id": "87a8f08d-9d26-49e7-9111-8758d3bbcf2f", "address": "fa:16:3e:96:a6:55", "network": {"id": "78d34574-c9cb-4054-9b54-15ab42a41a6d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-2015553211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3303a3ffcb5d4d1495f45a7c3cc9076a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87a8f08d-9d", "ovs_interfaceid": "87a8f08d-9d26-49e7-9111-8758d3bbcf2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 18:49:41 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-e9f1128d-d951-48a0-99bf-8da897754545 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:a6:55,bridge_name='br-int',has_traffic_filtering=True,id=87a8f08d-9d26-49e7-9111-8758d3bbcf2f,network=Network(78d34574-c9cb-4054-9b54-15ab42a41a6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87a8f08d-9d') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 18:49:41 user nova-compute[75216]: DEBUG nova.objects.instance [None req-e9f1128d-d951-48a0-99bf-8da897754545 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] Lazy-loading 'pci_devices' on Instance uuid e1350bc4-558a-40ac-91e5-96da24f154f5 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 18:49:41 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-e9f1128d-d951-48a0-99bf-8da897754545 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] [instance: e1350bc4-558a-40ac-91e5-96da24f154f5] End _get_guest_xml xml=<domain type="kvm">
Nov 13 18:49:41 user nova-compute[75216]:   <uuid>e1350bc4-558a-40ac-91e5-96da24f154f5</uuid>
Nov 13 18:49:41 user nova-compute[75216]:   <name>instance-00000011</name>
Nov 13 18:49:41 user nova-compute[75216]:   <memory>524288</memory>
Nov 13 18:49:41 user nova-compute[75216]:   <vcpu>1</vcpu>
Nov 13 18:49:41 user nova-compute[75216]:   <metadata>
Nov 13 18:49:41 user nova-compute[75216]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 18:49:41 user nova-compute[75216]:       <nova:package version="0.0.0"/>
Nov 13 18:49:41 user nova-compute[75216]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-529468211</nova:name>
Nov 13 18:49:41 user nova-compute[75216]:       <nova:creationTime>2023-11-13 18:49:41</nova:creationTime>
Nov 13 18:49:41 user nova-compute[75216]:       <nova:flavor name="m1.tiny">
Nov 13 18:49:41 user nova-compute[75216]:         <nova:memory>512</nova:memory>
Nov 13 18:49:41 user nova-compute[75216]:         <nova:disk>1</nova:disk>
Nov 13 18:49:41 user nova-compute[75216]:         <nova:swap>0</nova:swap>
Nov 13 18:49:41 user nova-compute[75216]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 18:49:41 user nova-compute[75216]:         <nova:vcpus>1</nova:vcpus>
Nov 13 18:49:41 user nova-compute[75216]:       </nova:flavor>
Nov 13 18:49:41 user nova-compute[75216]:       <nova:owner>
Nov 13 18:49:41 user nova-compute[75216]:         <nova:user uuid="a2dca87196c74236b3df1cc4eed57cd4">tempest-AttachSCSIVolumeTestJSON-913042882-project-member</nova:user>
Nov 13 18:49:41 user nova-compute[75216]:         <nova:project uuid="3303a3ffcb5d4d1495f45a7c3cc9076a">tempest-AttachSCSIVolumeTestJSON-913042882</nova:project>
Nov 13 18:49:41 user nova-compute[75216]:       </nova:owner>
Nov 13 18:49:41 user nova-compute[75216]:       <nova:root type="image" uuid="d64c4c49-a469-4642-ae7c-29858896ff0d"/>
Nov 13 18:49:41 user nova-compute[75216]:       <nova:ports>
Nov 13 18:49:41 user nova-compute[75216]:         <nova:port uuid="87a8f08d-9d26-49e7-9111-8758d3bbcf2f">
Nov 13 18:49:41 user nova-compute[75216]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 13 18:49:41 user nova-compute[75216]:         </nova:port>
Nov 13 18:49:41 user nova-compute[75216]:       </nova:ports>
Nov 13 18:49:41 user nova-compute[75216]:     </nova:instance>
Nov 13 18:49:41 user nova-compute[75216]:   </metadata>
Nov 13 18:49:41 user nova-compute[75216]:   <sysinfo type="smbios">
Nov 13 18:49:41 user nova-compute[75216]:     <system>
Nov 13 18:49:41 user nova-compute[75216]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 18:49:41 user nova-compute[75216]:       <entry name="product">OpenStack Nova</entry>
Nov 13 18:49:41 user nova-compute[75216]:       <entry name="version">0.0.0</entry>
Nov 13 18:49:41 user nova-compute[75216]:       <entry name="serial">e1350bc4-558a-40ac-91e5-96da24f154f5</entry>
Nov 13 18:49:41 user nova-compute[75216]:       <entry name="uuid">e1350bc4-558a-40ac-91e5-96da24f154f5</entry>
Nov 13 18:49:41 user nova-compute[75216]:       <entry name="family">Virtual Machine</entry>
Nov 13 18:49:41 user nova-compute[75216]:     </system>
Nov 13 18:49:41 user nova-compute[75216]:   </sysinfo>
Nov 13 18:49:41 user nova-compute[75216]:   <os>
Nov 13 18:49:41 user nova-compute[75216]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 18:49:41 user nova-compute[75216]:     <boot dev="hd"/>
Nov 13 18:49:41 user nova-compute[75216]:     <smbios mode="sysinfo"/>
Nov 13 18:49:41 user nova-compute[75216]:   </os>
Nov 13 18:49:41 user nova-compute[75216]:   <features>
Nov 13 18:49:41 user nova-compute[75216]:     <acpi/>
Nov 13 18:49:41 user nova-compute[75216]:     <apic/>
Nov 13 18:49:41 user nova-compute[75216]:     <vmcoreinfo/>
Nov 13 18:49:41 user nova-compute[75216]:   </features>
Nov 13 18:49:41 user nova-compute[75216]:   <clock offset="utc">
Nov 13 18:49:41 user nova-compute[75216]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 18:49:41 user nova-compute[75216]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 18:49:41 user nova-compute[75216]:     <timer name="hpet" present="no"/>
Nov 13 18:49:41 user nova-compute[75216]:   </clock>
Nov 13 18:49:41 user nova-compute[75216]:   <cpu mode="custom" match="exact">
Nov 13 18:49:41 user nova-compute[75216]:     <model>Nehalem</model>
Nov 13 18:49:41 user nova-compute[75216]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 18:49:41 user nova-compute[75216]:   </cpu>
Nov 13 18:49:41 user nova-compute[75216]:   <devices>
Nov 13 18:49:41 user nova-compute[75216]:     <disk type="file" device="disk">
Nov 13 18:49:41 user nova-compute[75216]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 18:49:41 user nova-compute[75216]:       <source file="/opt/stack/data/nova/instances/e1350bc4-558a-40ac-91e5-96da24f154f5/disk"/>
Nov 13 18:49:41 user nova-compute[75216]:       <target dev="sda" bus="scsi"/>
Nov 13 18:49:41 user nova-compute[75216]:       <address type="drive" controller="0" unit="0"/>
Nov 13 18:49:41 user nova-compute[75216]:     </disk>
Nov 13 18:49:41 user nova-compute[75216]:     <disk type="file" device="cdrom">
Nov 13 18:49:41 user nova-compute[75216]:       <driver name="qemu" type="raw" cache="none"/>
Nov 13 18:49:41 user nova-compute[75216]:       <source file="/opt/stack/data/nova/instances/e1350bc4-558a-40ac-91e5-96da24f154f5/disk.config"/>
Nov 13 18:49:41 user nova-compute[75216]:       <target dev="sdb" bus="scsi"/>
Nov 13 18:49:41 user nova-compute[75216]:       <address type="drive" controller="0" unit="1"/>
Nov 13 18:49:41 user nova-compute[75216]:     </disk>
Nov 13 18:49:41 user nova-compute[75216]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Nov 13 18:49:41 user nova-compute[75216]:     <interface type="ethernet">
Nov 13 18:49:41 user nova-compute[75216]:       <mac address="fa:16:3e:96:a6:55"/>
Nov 13 18:49:41 user nova-compute[75216]:       <model type="virtio"/>
Nov 13 18:49:41 user nova-compute[75216]:       <mtu size="1442"/>
Nov 13 18:49:41 user nova-compute[75216]:       <target dev="tap87a8f08d-9d"/>
Nov 13 18:49:41 user nova-compute[75216]:     </interface>
Nov 13 18:49:41 user nova-compute[75216]:     <serial type="pty">
Nov 13 18:49:41 user nova-compute[75216]:       <log file="/opt/stack/data/nova/instances/e1350bc4-558a-40ac-91e5-96da24f154f5/console.log" append="off"/>
Nov 13 18:49:41 user nova-compute[75216]:     </serial>
Nov 13 18:49:41 user nova-compute[75216]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 18:49:41 user nova-compute[75216]:     <video>
Nov 13 18:49:41 user nova-compute[75216]:       <model type="virtio"/>
Nov 13 18:49:41 user nova-compute[75216]:     </video>
Nov 13 18:49:41 user nova-compute[75216]:     <rng model="virtio">
Nov 13 18:49:41 user nova-compute[75216]:       <backend model="random">/dev/urandom</backend>
Nov 13 18:49:41 user nova-compute[75216]:     </rng>
Nov 13 18:49:41 user nova-compute[75216]:     <controller type="usb" index="0" model="none"/>
Nov 13 18:49:41 user nova-compute[75216]:     <memballoon model="virtio">
Nov 13 18:49:41 user nova-compute[75216]:       <stats period="10"/>
Nov 13 18:49:41 user nova-compute[75216]:     </memballoon>
Nov 13 18:49:41 user nova-compute[75216]:   </devices>
Nov 13 18:49:41 user nova-compute[75216]: </domain>
Nov 13 18:49:41 user nova-compute[75216]:  {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 18:49:41 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-e9f1128d-d951-48a0-99bf-8da897754545 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T18:49:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-529468211',display_name='tempest-AttachSCSIVolumeTestJSON-server-529468211',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-529468211',id=17,image_ref='d64c4c49-a469-4642-ae7c-29858896ff0d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPB5htGRf8NhiIPLr8eOrgxloOYLp5TkNhpR6mTQWG6uAqBLI/87B6kEefWqRX1VvhVG3RLYOcrRZ6ZP4R0fBedkJ8nBgor9P1bXRGfTN4XWv6AcTT6wB54THMNFO4Djvg==',key_name='tempest-keypair-270475825',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3303a3ffcb5d4d1495f45a7c3cc9076a',ramdisk_id='',reservation_id='r-91g4y0qg',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d64c4c49-a469-4642-ae7c-29858896ff0d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-913042882',owner_user_name='tempest-AttachSCSIVolumeTestJSON-913042882-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T18:49:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a2dca87196c74236b3df1cc4eed57cd4',uuid=e1350bc4-558a-40ac-91e5-96da24f154f5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "87a8f08d-9d26-49e7-9111-8758d3bbcf2f", "address": "fa:16:3e:96:a6:55", "network": {"id": "78d34574-c9cb-4054-9b54-15ab42a41a6d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-2015553211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3303a3ffcb5d4d1495f45a7c3cc9076a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87a8f08d-9d", "ovs_interfaceid": "87a8f08d-9d26-49e7-9111-8758d3bbcf2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 18:49:41 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-e9f1128d-d951-48a0-99bf-8da897754545 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] Converting VIF {"id": "87a8f08d-9d26-49e7-9111-8758d3bbcf2f", "address": "fa:16:3e:96:a6:55", "network": {"id": "78d34574-c9cb-4054-9b54-15ab42a41a6d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-2015553211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3303a3ffcb5d4d1495f45a7c3cc9076a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87a8f08d-9d", "ovs_interfaceid": "87a8f08d-9d26-49e7-9111-8758d3bbcf2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 18:49:41 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-e9f1128d-d951-48a0-99bf-8da897754545 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:a6:55,bridge_name='br-int',has_traffic_filtering=True,id=87a8f08d-9d26-49e7-9111-8758d3bbcf2f,network=Network(78d34574-c9cb-4054-9b54-15ab42a41a6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87a8f08d-9d') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 18:49:41 user nova-compute[75216]: DEBUG os_vif [None req-e9f1128d-d951-48a0-99bf-8da897754545 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:a6:55,bridge_name='br-int',has_traffic_filtering=True,id=87a8f08d-9d26-49e7-9111-8758d3bbcf2f,network=Network(78d34574-c9cb-4054-9b54-15ab42a41a6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87a8f08d-9d') {{(pid=75216) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 18:49:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:49:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:49:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 18:49:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:49:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0da4aee2-1e19-547a-a48c-b0edaefebd56', '_type': 'linux-noop'}}, row=False) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:49:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:49:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:49:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:49:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap87a8f08d-9d, may_exist=True, interface_attrs={}) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:49:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap87a8f08d-9d, col_values=(('qos', UUID('e00df094-82cc-482b-8b31-ef193e5d0771')),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:49:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap87a8f08d-9d, col_values=(('external_ids', {'iface-id': '87a8f08d-9d26-49e7-9111-8758d3bbcf2f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:96:a6:55', 'vm-uuid': 'e1350bc4-558a-40ac-91e5-96da24f154f5'}),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:49:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:49:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:49:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:49:41 user nova-compute[75216]: INFO os_vif [None req-e9f1128d-d951-48a0-99bf-8da897754545 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:a6:55,bridge_name='br-int',has_traffic_filtering=True,id=87a8f08d-9d26-49e7-9111-8758d3bbcf2f,network=Network(78d34574-c9cb-4054-9b54-15ab42a41a6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87a8f08d-9d')
Nov 13 18:49:42 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-e9f1128d-d951-48a0-99bf-8da897754545 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] No BDM found with device name sda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 18:49:42 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-e9f1128d-d951-48a0-99bf-8da897754545 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] No BDM found with device name sdb, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 18:49:42 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-e9f1128d-d951-48a0-99bf-8da897754545 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] No VIF found with MAC fa:16:3e:96:a6:55, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 18:49:42 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-e9f1128d-d951-48a0-99bf-8da897754545 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] [instance: e1350bc4-558a-40ac-91e5-96da24f154f5] Using config drive
Nov 13 18:49:42 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-e9f1128d-d951-48a0-99bf-8da897754545 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] [instance: e1350bc4-558a-40ac-91e5-96da24f154f5] Creating config drive at /opt/stack/data/nova/instances/e1350bc4-558a-40ac-91e5-96da24f154f5/disk.config
Nov 13 18:49:42 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-e9f1128d-d951-48a0-99bf-8da897754545 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/e1350bc4-558a-40ac-91e5-96da24f154f5/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp7xtle8p6 {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:49:42 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-e9f1128d-d951-48a0-99bf-8da897754545 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/e1350bc4-558a-40ac-91e5-96da24f154f5/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp7xtle8p6" returned: 0 in 0.052s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:49:42 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:49:42 user nova-compute[75216]: DEBUG nova.compute.manager [req-896d3c9e-de4b-4709-a52a-e763d37bf908 req-79235b2d-f2da-40eb-8a7c-8a9d71bde956 service nova] [instance: d589d57e-de50-482a-843f-e8246b3d7528] Received event network-vif-plugged-87426a6f-0164-4df3-aad0-becbbbfe8310 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:49:42 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-896d3c9e-de4b-4709-a52a-e763d37bf908 req-79235b2d-f2da-40eb-8a7c-8a9d71bde956 service nova] Acquiring lock "d589d57e-de50-482a-843f-e8246b3d7528-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:49:42 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-896d3c9e-de4b-4709-a52a-e763d37bf908 req-79235b2d-f2da-40eb-8a7c-8a9d71bde956 service nova] Lock "d589d57e-de50-482a-843f-e8246b3d7528-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:49:42 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-896d3c9e-de4b-4709-a52a-e763d37bf908 req-79235b2d-f2da-40eb-8a7c-8a9d71bde956 service nova] Lock "d589d57e-de50-482a-843f-e8246b3d7528-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:49:42 user nova-compute[75216]: DEBUG nova.compute.manager [req-896d3c9e-de4b-4709-a52a-e763d37bf908 req-79235b2d-f2da-40eb-8a7c-8a9d71bde956 service nova] [instance: d589d57e-de50-482a-843f-e8246b3d7528] No waiting events found dispatching network-vif-plugged-87426a6f-0164-4df3-aad0-becbbbfe8310 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:49:42 user nova-compute[75216]: WARNING nova.compute.manager [req-896d3c9e-de4b-4709-a52a-e763d37bf908 req-79235b2d-f2da-40eb-8a7c-8a9d71bde956 service nova] [instance: d589d57e-de50-482a-843f-e8246b3d7528] Received unexpected event network-vif-plugged-87426a6f-0164-4df3-aad0-becbbbfe8310 for instance with vm_state rescued and task_state None.
Nov 13 18:49:42 user nova-compute[75216]: DEBUG nova.compute.manager [req-896d3c9e-de4b-4709-a52a-e763d37bf908 req-79235b2d-f2da-40eb-8a7c-8a9d71bde956 service nova] [instance: e1350bc4-558a-40ac-91e5-96da24f154f5] Received event network-changed-87a8f08d-9d26-49e7-9111-8758d3bbcf2f {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:49:42 user nova-compute[75216]: DEBUG nova.compute.manager [req-896d3c9e-de4b-4709-a52a-e763d37bf908 req-79235b2d-f2da-40eb-8a7c-8a9d71bde956 service nova] [instance: e1350bc4-558a-40ac-91e5-96da24f154f5] Refreshing instance network info cache due to event network-changed-87a8f08d-9d26-49e7-9111-8758d3bbcf2f. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 18:49:42 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-896d3c9e-de4b-4709-a52a-e763d37bf908 req-79235b2d-f2da-40eb-8a7c-8a9d71bde956 service nova] Acquiring lock "refresh_cache-e1350bc4-558a-40ac-91e5-96da24f154f5" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 18:49:42 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-896d3c9e-de4b-4709-a52a-e763d37bf908 req-79235b2d-f2da-40eb-8a7c-8a9d71bde956 service nova] Acquired lock "refresh_cache-e1350bc4-558a-40ac-91e5-96da24f154f5" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 18:49:42 user nova-compute[75216]: DEBUG nova.network.neutron [req-896d3c9e-de4b-4709-a52a-e763d37bf908 req-79235b2d-f2da-40eb-8a7c-8a9d71bde956 service nova] [instance: e1350bc4-558a-40ac-91e5-96da24f154f5] Refreshing network info cache for port 87a8f08d-9d26-49e7-9111-8758d3bbcf2f {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 18:49:43 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:49:43 user nova-compute[75216]: DEBUG nova.network.neutron [req-896d3c9e-de4b-4709-a52a-e763d37bf908 req-79235b2d-f2da-40eb-8a7c-8a9d71bde956 service nova] [instance: e1350bc4-558a-40ac-91e5-96da24f154f5] Updated VIF entry in instance network info cache for port 87a8f08d-9d26-49e7-9111-8758d3bbcf2f. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 18:49:43 user nova-compute[75216]: DEBUG nova.network.neutron [req-896d3c9e-de4b-4709-a52a-e763d37bf908 req-79235b2d-f2da-40eb-8a7c-8a9d71bde956 service nova] [instance: e1350bc4-558a-40ac-91e5-96da24f154f5] Updating instance_info_cache with network_info: [{"id": "87a8f08d-9d26-49e7-9111-8758d3bbcf2f", "address": "fa:16:3e:96:a6:55", "network": {"id": "78d34574-c9cb-4054-9b54-15ab42a41a6d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-2015553211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3303a3ffcb5d4d1495f45a7c3cc9076a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87a8f08d-9d", "ovs_interfaceid": "87a8f08d-9d26-49e7-9111-8758d3bbcf2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 18:49:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-896d3c9e-de4b-4709-a52a-e763d37bf908 req-79235b2d-f2da-40eb-8a7c-8a9d71bde956 service nova] Releasing lock "refresh_cache-e1350bc4-558a-40ac-91e5-96da24f154f5" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 18:49:43 user nova-compute[75216]: DEBUG nova.compute.manager [req-896d3c9e-de4b-4709-a52a-e763d37bf908 req-79235b2d-f2da-40eb-8a7c-8a9d71bde956 service nova] [instance: d589d57e-de50-482a-843f-e8246b3d7528] Received event network-vif-plugged-87426a6f-0164-4df3-aad0-becbbbfe8310 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:49:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-896d3c9e-de4b-4709-a52a-e763d37bf908 req-79235b2d-f2da-40eb-8a7c-8a9d71bde956 service nova] Acquiring lock "d589d57e-de50-482a-843f-e8246b3d7528-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:49:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-896d3c9e-de4b-4709-a52a-e763d37bf908 req-79235b2d-f2da-40eb-8a7c-8a9d71bde956 service nova] Lock "d589d57e-de50-482a-843f-e8246b3d7528-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:49:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-896d3c9e-de4b-4709-a52a-e763d37bf908 req-79235b2d-f2da-40eb-8a7c-8a9d71bde956 service nova] Lock "d589d57e-de50-482a-843f-e8246b3d7528-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:49:43 user nova-compute[75216]: DEBUG nova.compute.manager [req-896d3c9e-de4b-4709-a52a-e763d37bf908 req-79235b2d-f2da-40eb-8a7c-8a9d71bde956 service nova] [instance: d589d57e-de50-482a-843f-e8246b3d7528] No waiting events found dispatching network-vif-plugged-87426a6f-0164-4df3-aad0-becbbbfe8310 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:49:43 user nova-compute[75216]: WARNING nova.compute.manager [req-896d3c9e-de4b-4709-a52a-e763d37bf908 req-79235b2d-f2da-40eb-8a7c-8a9d71bde956 service nova] [instance: d589d57e-de50-482a-843f-e8246b3d7528] Received unexpected event network-vif-plugged-87426a6f-0164-4df3-aad0-becbbbfe8310 for instance with vm_state rescued and task_state None.
Nov 13 18:49:43 user nova-compute[75216]: DEBUG nova.compute.manager [req-896d3c9e-de4b-4709-a52a-e763d37bf908 req-79235b2d-f2da-40eb-8a7c-8a9d71bde956 service nova] [instance: d589d57e-de50-482a-843f-e8246b3d7528] Received event network-vif-plugged-87426a6f-0164-4df3-aad0-becbbbfe8310 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:49:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-896d3c9e-de4b-4709-a52a-e763d37bf908 req-79235b2d-f2da-40eb-8a7c-8a9d71bde956 service nova] Acquiring lock "d589d57e-de50-482a-843f-e8246b3d7528-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:49:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-896d3c9e-de4b-4709-a52a-e763d37bf908 req-79235b2d-f2da-40eb-8a7c-8a9d71bde956 service nova] Lock "d589d57e-de50-482a-843f-e8246b3d7528-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:49:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-896d3c9e-de4b-4709-a52a-e763d37bf908 req-79235b2d-f2da-40eb-8a7c-8a9d71bde956 service nova] Lock "d589d57e-de50-482a-843f-e8246b3d7528-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:49:43 user nova-compute[75216]: DEBUG nova.compute.manager [req-896d3c9e-de4b-4709-a52a-e763d37bf908 req-79235b2d-f2da-40eb-8a7c-8a9d71bde956 service nova] [instance: d589d57e-de50-482a-843f-e8246b3d7528] No waiting events found dispatching network-vif-plugged-87426a6f-0164-4df3-aad0-becbbbfe8310 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:49:43 user nova-compute[75216]: WARNING nova.compute.manager [req-896d3c9e-de4b-4709-a52a-e763d37bf908 req-79235b2d-f2da-40eb-8a7c-8a9d71bde956 service nova] [instance: d589d57e-de50-482a-843f-e8246b3d7528] Received unexpected event network-vif-plugged-87426a6f-0164-4df3-aad0-becbbbfe8310 for instance with vm_state rescued and task_state None.
Nov 13 18:49:43 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:49:43 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:49:43 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:49:43 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:49:44 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:49:44 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:49:44 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:49:44 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:49:44 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:49:45 user nova-compute[75216]: DEBUG nova.compute.manager [req-73733ff8-9d85-40fc-aca3-052c8d3e9c88 req-8bf603cd-7278-4af1-9383-e766f9ae8edd service nova] [instance: e1350bc4-558a-40ac-91e5-96da24f154f5] Received event network-vif-plugged-87a8f08d-9d26-49e7-9111-8758d3bbcf2f {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:49:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-73733ff8-9d85-40fc-aca3-052c8d3e9c88 req-8bf603cd-7278-4af1-9383-e766f9ae8edd service nova] Acquiring lock "e1350bc4-558a-40ac-91e5-96da24f154f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:49:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-73733ff8-9d85-40fc-aca3-052c8d3e9c88 req-8bf603cd-7278-4af1-9383-e766f9ae8edd service nova] Lock "e1350bc4-558a-40ac-91e5-96da24f154f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:49:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-73733ff8-9d85-40fc-aca3-052c8d3e9c88 req-8bf603cd-7278-4af1-9383-e766f9ae8edd service nova] Lock "e1350bc4-558a-40ac-91e5-96da24f154f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:49:45 user nova-compute[75216]: DEBUG nova.compute.manager [req-73733ff8-9d85-40fc-aca3-052c8d3e9c88 req-8bf603cd-7278-4af1-9383-e766f9ae8edd service nova] [instance: e1350bc4-558a-40ac-91e5-96da24f154f5] No waiting events found dispatching network-vif-plugged-87a8f08d-9d26-49e7-9111-8758d3bbcf2f {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:49:45 user nova-compute[75216]: WARNING nova.compute.manager [req-73733ff8-9d85-40fc-aca3-052c8d3e9c88 req-8bf603cd-7278-4af1-9383-e766f9ae8edd service nova] [instance: e1350bc4-558a-40ac-91e5-96da24f154f5] Received unexpected event network-vif-plugged-87a8f08d-9d26-49e7-9111-8758d3bbcf2f for instance with vm_state building and task_state spawning.
Nov 13 18:49:46 user nova-compute[75216]: DEBUG nova.compute.manager [None req-e9f1128d-d951-48a0-99bf-8da897754545 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] [instance: e1350bc4-558a-40ac-91e5-96da24f154f5] Instance event wait completed in 0 seconds for  {{(pid=75216) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 18:49:46 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-e9f1128d-d951-48a0-99bf-8da897754545 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] [instance: e1350bc4-558a-40ac-91e5-96da24f154f5] Guest created on hypervisor {{(pid=75216) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 18:49:46 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: e1350bc4-558a-40ac-91e5-96da24f154f5] Instance spawned successfully.
Nov 13 18:49:46 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-e9f1128d-d951-48a0-99bf-8da897754545 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] [instance: e1350bc4-558a-40ac-91e5-96da24f154f5] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 18:49:46 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-e9f1128d-d951-48a0-99bf-8da897754545 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] [instance: e1350bc4-558a-40ac-91e5-96da24f154f5] Found default for hw_input_bus of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 18:49:46 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-e9f1128d-d951-48a0-99bf-8da897754545 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] [instance: e1350bc4-558a-40ac-91e5-96da24f154f5] Found default for hw_pointer_model of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 18:49:46 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-e9f1128d-d951-48a0-99bf-8da897754545 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] [instance: e1350bc4-558a-40ac-91e5-96da24f154f5] Found default for hw_video_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 18:49:46 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-e9f1128d-d951-48a0-99bf-8da897754545 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] [instance: e1350bc4-558a-40ac-91e5-96da24f154f5] Found default for hw_vif_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 18:49:46 user nova-compute[75216]: INFO nova.compute.manager [None req-e9f1128d-d951-48a0-99bf-8da897754545 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] [instance: e1350bc4-558a-40ac-91e5-96da24f154f5] Took 6.49 seconds to spawn the instance on the hypervisor.
Nov 13 18:49:46 user nova-compute[75216]: DEBUG nova.compute.manager [None req-e9f1128d-d951-48a0-99bf-8da897754545 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] [instance: e1350bc4-558a-40ac-91e5-96da24f154f5] Checking state {{(pid=75216) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 18:49:46 user nova-compute[75216]: INFO nova.compute.manager [None req-e9f1128d-d951-48a0-99bf-8da897754545 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] [instance: e1350bc4-558a-40ac-91e5-96da24f154f5] Took 7.33 seconds to build instance.
Nov 13 18:49:46 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e9f1128d-d951-48a0-99bf-8da897754545 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] Lock "e1350bc4-558a-40ac-91e5-96da24f154f5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.475s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:49:46 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:49:47 user nova-compute[75216]: DEBUG nova.compute.manager [req-887eae4c-8855-403d-990f-57f4369a4f80 req-2b8bf787-15fe-4d91-8eab-8f28b56bf68c service nova] [instance: e1350bc4-558a-40ac-91e5-96da24f154f5] Received event network-vif-plugged-87a8f08d-9d26-49e7-9111-8758d3bbcf2f {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:49:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-887eae4c-8855-403d-990f-57f4369a4f80 req-2b8bf787-15fe-4d91-8eab-8f28b56bf68c service nova] Acquiring lock "e1350bc4-558a-40ac-91e5-96da24f154f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:49:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-887eae4c-8855-403d-990f-57f4369a4f80 req-2b8bf787-15fe-4d91-8eab-8f28b56bf68c service nova] Lock "e1350bc4-558a-40ac-91e5-96da24f154f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:49:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-887eae4c-8855-403d-990f-57f4369a4f80 req-2b8bf787-15fe-4d91-8eab-8f28b56bf68c service nova] Lock "e1350bc4-558a-40ac-91e5-96da24f154f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:49:47 user nova-compute[75216]: DEBUG nova.compute.manager [req-887eae4c-8855-403d-990f-57f4369a4f80 req-2b8bf787-15fe-4d91-8eab-8f28b56bf68c service nova] [instance: e1350bc4-558a-40ac-91e5-96da24f154f5] No waiting events found dispatching network-vif-plugged-87a8f08d-9d26-49e7-9111-8758d3bbcf2f {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:49:47 user nova-compute[75216]: WARNING nova.compute.manager [req-887eae4c-8855-403d-990f-57f4369a4f80 req-2b8bf787-15fe-4d91-8eab-8f28b56bf68c service nova] [instance: e1350bc4-558a-40ac-91e5-96da24f154f5] Received unexpected event network-vif-plugged-87a8f08d-9d26-49e7-9111-8758d3bbcf2f for instance with vm_state active and task_state None.
Nov 13 18:49:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-d839fb1c-662a-4bd2-b871-948609620e2d tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Acquiring lock "91ea8a19-a365-484c-80c7-baf90e7dd1aa" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:49:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-d839fb1c-662a-4bd2-b871-948609620e2d tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Lock "91ea8a19-a365-484c-80c7-baf90e7dd1aa" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:49:47 user nova-compute[75216]: DEBUG nova.compute.manager [None req-d839fb1c-662a-4bd2-b871-948609620e2d tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] [instance: 91ea8a19-a365-484c-80c7-baf90e7dd1aa] Starting instance... {{(pid=75216) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 18:49:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-d839fb1c-662a-4bd2-b871-948609620e2d tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:49:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-d839fb1c-662a-4bd2-b871-948609620e2d tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:49:47 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-d839fb1c-662a-4bd2-b871-948609620e2d tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75216) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 18:49:47 user nova-compute[75216]: INFO nova.compute.claims [None req-d839fb1c-662a-4bd2-b871-948609620e2d tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] [instance: 91ea8a19-a365-484c-80c7-baf90e7dd1aa] Claim successful on node user
Nov 13 18:49:48 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:49:48 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-d839fb1c-662a-4bd2-b871-948609620e2d tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 18:49:48 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-d839fb1c-662a-4bd2-b871-948609620e2d tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 18:49:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-d839fb1c-662a-4bd2-b871-948609620e2d tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.502s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:49:48 user nova-compute[75216]: DEBUG nova.compute.manager [None req-d839fb1c-662a-4bd2-b871-948609620e2d tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] [instance: 91ea8a19-a365-484c-80c7-baf90e7dd1aa] Start building networks asynchronously for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 18:49:48 user nova-compute[75216]: DEBUG nova.compute.manager [None req-d839fb1c-662a-4bd2-b871-948609620e2d tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] [instance: 91ea8a19-a365-484c-80c7-baf90e7dd1aa] Allocating IP information in the background. {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 18:49:48 user nova-compute[75216]: DEBUG nova.network.neutron [None req-d839fb1c-662a-4bd2-b871-948609620e2d tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] [instance: 91ea8a19-a365-484c-80c7-baf90e7dd1aa] allocate_for_instance() {{(pid=75216) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 18:49:48 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-d839fb1c-662a-4bd2-b871-948609620e2d tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] [instance: 91ea8a19-a365-484c-80c7-baf90e7dd1aa] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 18:49:48 user nova-compute[75216]: DEBUG nova.compute.manager [None req-d839fb1c-662a-4bd2-b871-948609620e2d tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] [instance: 91ea8a19-a365-484c-80c7-baf90e7dd1aa] Start building block device mappings for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 18:49:48 user nova-compute[75216]: DEBUG nova.policy [None req-d839fb1c-662a-4bd2-b871-948609620e2d tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0543920a35a54c83bcc159b7a2b08a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0194e3c88e2b49c5ba9b9844f6048ea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75216) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 18:49:48 user nova-compute[75216]: DEBUG nova.compute.manager [None req-d839fb1c-662a-4bd2-b871-948609620e2d tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] [instance: 91ea8a19-a365-484c-80c7-baf90e7dd1aa] Start spawning the instance on the hypervisor. {{(pid=75216) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 18:49:48 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-d839fb1c-662a-4bd2-b871-948609620e2d tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] [instance: 91ea8a19-a365-484c-80c7-baf90e7dd1aa] Creating instance directory {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 18:49:48 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-d839fb1c-662a-4bd2-b871-948609620e2d tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] [instance: 91ea8a19-a365-484c-80c7-baf90e7dd1aa] Creating image(s)
Nov 13 18:49:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-d839fb1c-662a-4bd2-b871-948609620e2d tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Acquiring lock "/opt/stack/data/nova/instances/91ea8a19-a365-484c-80c7-baf90e7dd1aa/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:49:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-d839fb1c-662a-4bd2-b871-948609620e2d tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Lock "/opt/stack/data/nova/instances/91ea8a19-a365-484c-80c7-baf90e7dd1aa/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:49:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-d839fb1c-662a-4bd2-b871-948609620e2d tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Lock "/opt/stack/data/nova/instances/91ea8a19-a365-484c-80c7-baf90e7dd1aa/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:49:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-d839fb1c-662a-4bd2-b871-948609620e2d tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:49:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-d839fb1c-662a-4bd2-b871-948609620e2d tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json" returned: 0 in 0.183s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:49:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-d839fb1c-662a-4bd2-b871-948609620e2d tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Acquiring lock "88c50a45bec9d6b0427462b3242b9b8e5f49c2b6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:49:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-d839fb1c-662a-4bd2-b871-948609620e2d tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Lock "88c50a45bec9d6b0427462b3242b9b8e5f49c2b6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:49:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-d839fb1c-662a-4bd2-b871-948609620e2d tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:49:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-d839fb1c-662a-4bd2-b871-948609620e2d tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json" returned: 0 in 0.188s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:49:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-d839fb1c-662a-4bd2-b871-948609620e2d tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6,backing_fmt=raw /opt/stack/data/nova/instances/91ea8a19-a365-484c-80c7-baf90e7dd1aa/disk 1073741824 {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:49:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-d839fb1c-662a-4bd2-b871-948609620e2d tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6,backing_fmt=raw /opt/stack/data/nova/instances/91ea8a19-a365-484c-80c7-baf90e7dd1aa/disk 1073741824" returned: 0 in 0.054s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:49:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-d839fb1c-662a-4bd2-b871-948609620e2d tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Lock "88c50a45bec9d6b0427462b3242b9b8e5f49c2b6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.250s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:49:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-d839fb1c-662a-4bd2-b871-948609620e2d tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:49:49 user nova-compute[75216]: DEBUG nova.network.neutron [None req-d839fb1c-662a-4bd2-b871-948609620e2d tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] [instance: 91ea8a19-a365-484c-80c7-baf90e7dd1aa] Successfully created port: 2cfb645f-7bee-4657-b0d8-afcaa0298ac9 {{(pid=75216) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 18:49:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-d839fb1c-662a-4bd2-b871-948609620e2d tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json" returned: 0 in 0.191s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:49:49 user nova-compute[75216]: DEBUG nova.virt.disk.api [None req-d839fb1c-662a-4bd2-b871-948609620e2d tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Checking if we can resize image /opt/stack/data/nova/instances/91ea8a19-a365-484c-80c7-baf90e7dd1aa/disk. size=1073741824 {{(pid=75216) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 18:49:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-d839fb1c-662a-4bd2-b871-948609620e2d tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91ea8a19-a365-484c-80c7-baf90e7dd1aa/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:49:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-d839fb1c-662a-4bd2-b871-948609620e2d tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91ea8a19-a365-484c-80c7-baf90e7dd1aa/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:49:49 user nova-compute[75216]: DEBUG nova.virt.disk.api [None req-d839fb1c-662a-4bd2-b871-948609620e2d tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Cannot resize image /opt/stack/data/nova/instances/91ea8a19-a365-484c-80c7-baf90e7dd1aa/disk to a smaller size. {{(pid=75216) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 18:49:49 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-d839fb1c-662a-4bd2-b871-948609620e2d tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] [instance: 91ea8a19-a365-484c-80c7-baf90e7dd1aa] Created local disks {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 18:49:49 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-d839fb1c-662a-4bd2-b871-948609620e2d tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] [instance: 91ea8a19-a365-484c-80c7-baf90e7dd1aa] Ensure instance console log exists: /opt/stack/data/nova/instances/91ea8a19-a365-484c-80c7-baf90e7dd1aa/console.log {{(pid=75216) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 18:49:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-d839fb1c-662a-4bd2-b871-948609620e2d tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:49:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-d839fb1c-662a-4bd2-b871-948609620e2d tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:49:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-d839fb1c-662a-4bd2-b871-948609620e2d tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:49:50 user nova-compute[75216]: DEBUG nova.network.neutron [None req-d839fb1c-662a-4bd2-b871-948609620e2d tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] [instance: 91ea8a19-a365-484c-80c7-baf90e7dd1aa] Successfully updated port: 2cfb645f-7bee-4657-b0d8-afcaa0298ac9 {{(pid=75216) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 18:49:50 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-d839fb1c-662a-4bd2-b871-948609620e2d tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Acquiring lock "refresh_cache-91ea8a19-a365-484c-80c7-baf90e7dd1aa" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 18:49:50 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-d839fb1c-662a-4bd2-b871-948609620e2d tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Acquired lock "refresh_cache-91ea8a19-a365-484c-80c7-baf90e7dd1aa" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 18:49:50 user nova-compute[75216]: DEBUG nova.network.neutron [None req-d839fb1c-662a-4bd2-b871-948609620e2d tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] [instance: 91ea8a19-a365-484c-80c7-baf90e7dd1aa] Building network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 18:49:50 user nova-compute[75216]: DEBUG nova.compute.manager [req-60540aed-fbbf-4f82-aa2d-1f424a77410c req-b563500b-f9fd-4f23-a160-e1cb50fcb7e3 service nova] [instance: 91ea8a19-a365-484c-80c7-baf90e7dd1aa] Received event network-changed-2cfb645f-7bee-4657-b0d8-afcaa0298ac9 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:49:50 user nova-compute[75216]: DEBUG nova.compute.manager [req-60540aed-fbbf-4f82-aa2d-1f424a77410c req-b563500b-f9fd-4f23-a160-e1cb50fcb7e3 service nova] [instance: 91ea8a19-a365-484c-80c7-baf90e7dd1aa] Refreshing instance network info cache due to event network-changed-2cfb645f-7bee-4657-b0d8-afcaa0298ac9. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 18:49:50 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-60540aed-fbbf-4f82-aa2d-1f424a77410c req-b563500b-f9fd-4f23-a160-e1cb50fcb7e3 service nova] Acquiring lock "refresh_cache-91ea8a19-a365-484c-80c7-baf90e7dd1aa" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 18:49:50 user nova-compute[75216]: DEBUG nova.network.neutron [None req-d839fb1c-662a-4bd2-b871-948609620e2d tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] [instance: 91ea8a19-a365-484c-80c7-baf90e7dd1aa] Instance cache missing network info. {{(pid=75216) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 18:49:50 user nova-compute[75216]: DEBUG nova.network.neutron [None req-d839fb1c-662a-4bd2-b871-948609620e2d tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] [instance: 91ea8a19-a365-484c-80c7-baf90e7dd1aa] Updating instance_info_cache with network_info: [{"id": "2cfb645f-7bee-4657-b0d8-afcaa0298ac9", "address": "fa:16:3e:3e:1d:91", "network": {"id": "a9670fc3-8a8e-4a2b-a39f-d41042d3443d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1394481632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0194e3c88e2b49c5ba9b9844f6048ea9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cfb645f-7b", "ovs_interfaceid": "2cfb645f-7bee-4657-b0d8-afcaa0298ac9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 18:49:50 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-d839fb1c-662a-4bd2-b871-948609620e2d tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Releasing lock "refresh_cache-91ea8a19-a365-484c-80c7-baf90e7dd1aa" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 18:49:50 user nova-compute[75216]: DEBUG nova.compute.manager [None req-d839fb1c-662a-4bd2-b871-948609620e2d tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] [instance: 91ea8a19-a365-484c-80c7-baf90e7dd1aa] Instance network_info: |[{"id": "2cfb645f-7bee-4657-b0d8-afcaa0298ac9", "address": "fa:16:3e:3e:1d:91", "network": {"id": "a9670fc3-8a8e-4a2b-a39f-d41042d3443d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1394481632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0194e3c88e2b49c5ba9b9844f6048ea9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cfb645f-7b", "ovs_interfaceid": "2cfb645f-7bee-4657-b0d8-afcaa0298ac9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 18:49:50 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-60540aed-fbbf-4f82-aa2d-1f424a77410c req-b563500b-f9fd-4f23-a160-e1cb50fcb7e3 service nova] Acquired lock "refresh_cache-91ea8a19-a365-484c-80c7-baf90e7dd1aa" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 18:49:50 user nova-compute[75216]: DEBUG nova.network.neutron [req-60540aed-fbbf-4f82-aa2d-1f424a77410c req-b563500b-f9fd-4f23-a160-e1cb50fcb7e3 service nova] [instance: 91ea8a19-a365-484c-80c7-baf90e7dd1aa] Refreshing network info cache for port 2cfb645f-7bee-4657-b0d8-afcaa0298ac9 {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 18:49:50 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-d839fb1c-662a-4bd2-b871-948609620e2d tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] [instance: 91ea8a19-a365-484c-80c7-baf90e7dd1aa] Start _get_guest_xml network_info=[{"id": "2cfb645f-7bee-4657-b0d8-afcaa0298ac9", "address": "fa:16:3e:3e:1d:91", "network": {"id": "a9670fc3-8a8e-4a2b-a39f-d41042d3443d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1394481632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0194e3c88e2b49c5ba9b9844f6048ea9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cfb645f-7b", "ovs_interfaceid": "2cfb645f-7bee-4657-b0d8-afcaa0298ac9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T18:41:06Z,direct_url=<?>,disk_format='qcow2',id=77bcb5ba-8510-41ec-a88d-96097bb431de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c465b7c26ec44582b6d1b7169536ecc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T18:41:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'guest_format': None, 'boot_index': 0, 'image_id': '77bcb5ba-8510-41ec-a88d-96097bb431de'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 18:49:50 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-d839fb1c-662a-4bd2-b871-948609620e2d tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 18:49:50 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-d839fb1c-662a-4bd2-b871-948609620e2d tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 18:49:50 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-d839fb1c-662a-4bd2-b871-948609620e2d tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 18:49:50 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-d839fb1c-662a-4bd2-b871-948609620e2d tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] CPU controller missing on host. {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 18:49:50 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-d839fb1c-662a-4bd2-b871-948609620e2d tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 18:49:50 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-d839fb1c-662a-4bd2-b871-948609620e2d tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] CPU controller found on host. {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 18:49:50 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-d839fb1c-662a-4bd2-b871-948609620e2d tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75216) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 18:49:50 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-d839fb1c-662a-4bd2-b871-948609620e2d tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T18:40:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T18:41:06Z,direct_url=<?>,disk_format='qcow2',id=77bcb5ba-8510-41ec-a88d-96097bb431de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c465b7c26ec44582b6d1b7169536ecc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T18:41:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 18:49:50 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-d839fb1c-662a-4bd2-b871-948609620e2d tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Flavor limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 18:49:50 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-d839fb1c-662a-4bd2-b871-948609620e2d tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Image limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 18:49:50 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-d839fb1c-662a-4bd2-b871-948609620e2d tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Flavor pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 18:49:50 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-d839fb1c-662a-4bd2-b871-948609620e2d tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Image pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 18:49:50 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-d839fb1c-662a-4bd2-b871-948609620e2d tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 18:49:50 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-d839fb1c-662a-4bd2-b871-948609620e2d tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 18:49:50 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-d839fb1c-662a-4bd2-b871-948609620e2d tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 18:49:50 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-d839fb1c-662a-4bd2-b871-948609620e2d tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Got 1 possible topologies {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 18:49:50 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-d839fb1c-662a-4bd2-b871-948609620e2d tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 18:49:50 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-d839fb1c-662a-4bd2-b871-948609620e2d tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 18:49:50 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-d839fb1c-662a-4bd2-b871-948609620e2d tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T18:49:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2138583247',display_name='tempest-ServerActionsTestOtherB-server-2138583247',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2138583247',id=18,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAl4rrs8AsTXVVWOe2ej9Q0PBsZfl4SiBx6Z+7YBp2Q8nhbMLqhEEYWYCrwvKHOa1CVoqmRod9jN0d8asOX7OMqzQqSN/edxVDFYygCGcMd2W6HT1YDz1w3rZ0s5A43lWg==',key_name='tempest-keypair-1520178236',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0194e3c88e2b49c5ba9b9844f6048ea9',ramdisk_id='',reservation_id='r-z6obctyl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1164011898',owner_user_name='tempest-ServerActionsTestOtherB-1164011898-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T18:49:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0543920a35a54c83bcc159b7a2b08a80',uuid=91ea8a19-a365-484c-80c7-baf90e7dd1aa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2cfb645f-7bee-4657-b0d8-afcaa0298ac9", "address": "fa:16:3e:3e:1d:91", "network": {"id": "a9670fc3-8a8e-4a2b-a39f-d41042d3443d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1394481632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0194e3c88e2b49c5ba9b9844f6048ea9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cfb645f-7b", "ovs_interfaceid": "2cfb645f-7bee-4657-b0d8-afcaa0298ac9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75216) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 18:49:50 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-d839fb1c-662a-4bd2-b871-948609620e2d tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Converting VIF {"id": "2cfb645f-7bee-4657-b0d8-afcaa0298ac9", "address": "fa:16:3e:3e:1d:91", "network": {"id": "a9670fc3-8a8e-4a2b-a39f-d41042d3443d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1394481632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0194e3c88e2b49c5ba9b9844f6048ea9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cfb645f-7b", "ovs_interfaceid": "2cfb645f-7bee-4657-b0d8-afcaa0298ac9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 18:49:50 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-d839fb1c-662a-4bd2-b871-948609620e2d tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:1d:91,bridge_name='br-int',has_traffic_filtering=True,id=2cfb645f-7bee-4657-b0d8-afcaa0298ac9,network=Network(a9670fc3-8a8e-4a2b-a39f-d41042d3443d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cfb645f-7b') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 18:49:50 user nova-compute[75216]: DEBUG nova.objects.instance [None req-d839fb1c-662a-4bd2-b871-948609620e2d tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Lazy-loading 'pci_devices' on Instance uuid 91ea8a19-a365-484c-80c7-baf90e7dd1aa {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 18:49:50 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-d839fb1c-662a-4bd2-b871-948609620e2d tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] [instance: 91ea8a19-a365-484c-80c7-baf90e7dd1aa] End _get_guest_xml xml=<domain type="kvm">
Nov 13 18:49:50 user nova-compute[75216]:   <uuid>91ea8a19-a365-484c-80c7-baf90e7dd1aa</uuid>
Nov 13 18:49:50 user nova-compute[75216]:   <name>instance-00000012</name>
Nov 13 18:49:50 user nova-compute[75216]:   <memory>524288</memory>
Nov 13 18:49:50 user nova-compute[75216]:   <vcpu>1</vcpu>
Nov 13 18:49:50 user nova-compute[75216]:   <metadata>
Nov 13 18:49:50 user nova-compute[75216]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 18:49:50 user nova-compute[75216]:       <nova:package version="0.0.0"/>
Nov 13 18:49:50 user nova-compute[75216]:       <nova:name>tempest-ServerActionsTestOtherB-server-2138583247</nova:name>
Nov 13 18:49:50 user nova-compute[75216]:       <nova:creationTime>2023-11-13 18:49:50</nova:creationTime>
Nov 13 18:49:50 user nova-compute[75216]:       <nova:flavor name="m1.tiny">
Nov 13 18:49:50 user nova-compute[75216]:         <nova:memory>512</nova:memory>
Nov 13 18:49:50 user nova-compute[75216]:         <nova:disk>1</nova:disk>
Nov 13 18:49:50 user nova-compute[75216]:         <nova:swap>0</nova:swap>
Nov 13 18:49:50 user nova-compute[75216]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 18:49:50 user nova-compute[75216]:         <nova:vcpus>1</nova:vcpus>
Nov 13 18:49:50 user nova-compute[75216]:       </nova:flavor>
Nov 13 18:49:50 user nova-compute[75216]:       <nova:owner>
Nov 13 18:49:50 user nova-compute[75216]:         <nova:user uuid="0543920a35a54c83bcc159b7a2b08a80">tempest-ServerActionsTestOtherB-1164011898-project-member</nova:user>
Nov 13 18:49:50 user nova-compute[75216]:         <nova:project uuid="0194e3c88e2b49c5ba9b9844f6048ea9">tempest-ServerActionsTestOtherB-1164011898</nova:project>
Nov 13 18:49:50 user nova-compute[75216]:       </nova:owner>
Nov 13 18:49:50 user nova-compute[75216]:       <nova:root type="image" uuid="77bcb5ba-8510-41ec-a88d-96097bb431de"/>
Nov 13 18:49:50 user nova-compute[75216]:       <nova:ports>
Nov 13 18:49:50 user nova-compute[75216]:         <nova:port uuid="2cfb645f-7bee-4657-b0d8-afcaa0298ac9">
Nov 13 18:49:50 user nova-compute[75216]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 13 18:49:50 user nova-compute[75216]:         </nova:port>
Nov 13 18:49:50 user nova-compute[75216]:       </nova:ports>
Nov 13 18:49:50 user nova-compute[75216]:     </nova:instance>
Nov 13 18:49:50 user nova-compute[75216]:   </metadata>
Nov 13 18:49:50 user nova-compute[75216]:   <sysinfo type="smbios">
Nov 13 18:49:50 user nova-compute[75216]:     <system>
Nov 13 18:49:50 user nova-compute[75216]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 18:49:50 user nova-compute[75216]:       <entry name="product">OpenStack Nova</entry>
Nov 13 18:49:50 user nova-compute[75216]:       <entry name="version">0.0.0</entry>
Nov 13 18:49:50 user nova-compute[75216]:       <entry name="serial">91ea8a19-a365-484c-80c7-baf90e7dd1aa</entry>
Nov 13 18:49:50 user nova-compute[75216]:       <entry name="uuid">91ea8a19-a365-484c-80c7-baf90e7dd1aa</entry>
Nov 13 18:49:50 user nova-compute[75216]:       <entry name="family">Virtual Machine</entry>
Nov 13 18:49:50 user nova-compute[75216]:     </system>
Nov 13 18:49:50 user nova-compute[75216]:   </sysinfo>
Nov 13 18:49:50 user nova-compute[75216]:   <os>
Nov 13 18:49:50 user nova-compute[75216]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 18:49:50 user nova-compute[75216]:     <boot dev="hd"/>
Nov 13 18:49:50 user nova-compute[75216]:     <smbios mode="sysinfo"/>
Nov 13 18:49:50 user nova-compute[75216]:   </os>
Nov 13 18:49:50 user nova-compute[75216]:   <features>
Nov 13 18:49:50 user nova-compute[75216]:     <acpi/>
Nov 13 18:49:50 user nova-compute[75216]:     <apic/>
Nov 13 18:49:50 user nova-compute[75216]:     <vmcoreinfo/>
Nov 13 18:49:50 user nova-compute[75216]:   </features>
Nov 13 18:49:50 user nova-compute[75216]:   <clock offset="utc">
Nov 13 18:49:50 user nova-compute[75216]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 18:49:50 user nova-compute[75216]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 18:49:50 user nova-compute[75216]:     <timer name="hpet" present="no"/>
Nov 13 18:49:50 user nova-compute[75216]:   </clock>
Nov 13 18:49:50 user nova-compute[75216]:   <cpu mode="custom" match="exact">
Nov 13 18:49:50 user nova-compute[75216]:     <model>Nehalem</model>
Nov 13 18:49:50 user nova-compute[75216]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 18:49:50 user nova-compute[75216]:   </cpu>
Nov 13 18:49:50 user nova-compute[75216]:   <devices>
Nov 13 18:49:50 user nova-compute[75216]:     <disk type="file" device="disk">
Nov 13 18:49:50 user nova-compute[75216]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 18:49:50 user nova-compute[75216]:       <source file="/opt/stack/data/nova/instances/91ea8a19-a365-484c-80c7-baf90e7dd1aa/disk"/>
Nov 13 18:49:50 user nova-compute[75216]:       <target dev="vda" bus="virtio"/>
Nov 13 18:49:50 user nova-compute[75216]:     </disk>
Nov 13 18:49:50 user nova-compute[75216]:     <interface type="ethernet">
Nov 13 18:49:50 user nova-compute[75216]:       <mac address="fa:16:3e:3e:1d:91"/>
Nov 13 18:49:50 user nova-compute[75216]:       <model type="virtio"/>
Nov 13 18:49:50 user nova-compute[75216]:       <mtu size="1442"/>
Nov 13 18:49:50 user nova-compute[75216]:       <target dev="tap2cfb645f-7b"/>
Nov 13 18:49:50 user nova-compute[75216]:     </interface>
Nov 13 18:49:50 user nova-compute[75216]:     <serial type="pty">
Nov 13 18:49:50 user nova-compute[75216]:       <log file="/opt/stack/data/nova/instances/91ea8a19-a365-484c-80c7-baf90e7dd1aa/console.log" append="off"/>
Nov 13 18:49:50 user nova-compute[75216]:     </serial>
Nov 13 18:49:50 user nova-compute[75216]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 18:49:50 user nova-compute[75216]:     <video>
Nov 13 18:49:50 user nova-compute[75216]:       <model type="virtio"/>
Nov 13 18:49:50 user nova-compute[75216]:     </video>
Nov 13 18:49:50 user nova-compute[75216]:     <rng model="virtio">
Nov 13 18:49:50 user nova-compute[75216]:       <backend model="random">/dev/urandom</backend>
Nov 13 18:49:50 user nova-compute[75216]:     </rng>
Nov 13 18:49:50 user nova-compute[75216]:     <controller type="usb" index="0" model="none"/>
Nov 13 18:49:50 user nova-compute[75216]:     <memballoon model="virtio">
Nov 13 18:49:50 user nova-compute[75216]:       <stats period="10"/>
Nov 13 18:49:50 user nova-compute[75216]:     </memballoon>
Nov 13 18:49:50 user nova-compute[75216]:   </devices>
Nov 13 18:49:50 user nova-compute[75216]: </domain>
Nov 13 18:49:50 user nova-compute[75216]:  {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 18:49:50 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-d839fb1c-662a-4bd2-b871-948609620e2d tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T18:49:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2138583247',display_name='tempest-ServerActionsTestOtherB-server-2138583247',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2138583247',id=18,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAl4rrs8AsTXVVWOe2ej9Q0PBsZfl4SiBx6Z+7YBp2Q8nhbMLqhEEYWYCrwvKHOa1CVoqmRod9jN0d8asOX7OMqzQqSN/edxVDFYygCGcMd2W6HT1YDz1w3rZ0s5A43lWg==',key_name='tempest-keypair-1520178236',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0194e3c88e2b49c5ba9b9844f6048ea9',ramdisk_id='',reservation_id='r-z6obctyl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1164011898',owner_user_name='tempest-ServerActionsTestOtherB-1164011898-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T18:49:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0543920a35a54c83bcc159b7a2b08a80',uuid=91ea8a19-a365-484c-80c7-baf90e7dd1aa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2cfb645f-7bee-4657-b0d8-afcaa0298ac9", "address": "fa:16:3e:3e:1d:91", "network": {"id": "a9670fc3-8a8e-4a2b-a39f-d41042d3443d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1394481632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0194e3c88e2b49c5ba9b9844f6048ea9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cfb645f-7b", "ovs_interfaceid": "2cfb645f-7bee-4657-b0d8-afcaa0298ac9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 18:49:50 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-d839fb1c-662a-4bd2-b871-948609620e2d tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Converting VIF {"id": "2cfb645f-7bee-4657-b0d8-afcaa0298ac9", "address": "fa:16:3e:3e:1d:91", "network": {"id": "a9670fc3-8a8e-4a2b-a39f-d41042d3443d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1394481632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0194e3c88e2b49c5ba9b9844f6048ea9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cfb645f-7b", "ovs_interfaceid": "2cfb645f-7bee-4657-b0d8-afcaa0298ac9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 18:49:50 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-d839fb1c-662a-4bd2-b871-948609620e2d tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:1d:91,bridge_name='br-int',has_traffic_filtering=True,id=2cfb645f-7bee-4657-b0d8-afcaa0298ac9,network=Network(a9670fc3-8a8e-4a2b-a39f-d41042d3443d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cfb645f-7b') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 18:49:50 user nova-compute[75216]: DEBUG os_vif [None req-d839fb1c-662a-4bd2-b871-948609620e2d tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:1d:91,bridge_name='br-int',has_traffic_filtering=True,id=2cfb645f-7bee-4657-b0d8-afcaa0298ac9,network=Network(a9670fc3-8a8e-4a2b-a39f-d41042d3443d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cfb645f-7b') {{(pid=75216) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 18:49:50 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:49:50 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:49:50 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 18:49:50 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:49:50 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a4a5ac32-dbb0-5d2e-8045-b9124a42aeca', '_type': 'linux-noop'}}, row=False) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:49:50 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:49:50 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:49:50 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:49:50 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2cfb645f-7b, may_exist=True, interface_attrs={}) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:49:50 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2cfb645f-7b, col_values=(('qos', UUID('1ca4d8f7-94c8-4135-8b7c-f917143f6a83')),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:49:50 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2cfb645f-7b, col_values=(('external_ids', {'iface-id': '2cfb645f-7bee-4657-b0d8-afcaa0298ac9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3e:1d:91', 'vm-uuid': '91ea8a19-a365-484c-80c7-baf90e7dd1aa'}),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:49:50 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:49:50 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:49:50 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:49:50 user nova-compute[75216]: INFO os_vif [None req-d839fb1c-662a-4bd2-b871-948609620e2d tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:1d:91,bridge_name='br-int',has_traffic_filtering=True,id=2cfb645f-7bee-4657-b0d8-afcaa0298ac9,network=Network(a9670fc3-8a8e-4a2b-a39f-d41042d3443d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cfb645f-7b')
Nov 13 18:49:50 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-d839fb1c-662a-4bd2-b871-948609620e2d tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 18:49:50 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-d839fb1c-662a-4bd2-b871-948609620e2d tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] No VIF found with MAC fa:16:3e:3e:1d:91, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 18:49:50 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:49:50 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:49:50 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Starting heal instance info cache {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 18:49:50 user nova-compute[75216]: DEBUG nova.network.neutron [req-60540aed-fbbf-4f82-aa2d-1f424a77410c req-b563500b-f9fd-4f23-a160-e1cb50fcb7e3 service nova] [instance: 91ea8a19-a365-484c-80c7-baf90e7dd1aa] Updated VIF entry in instance network info cache for port 2cfb645f-7bee-4657-b0d8-afcaa0298ac9. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 18:49:50 user nova-compute[75216]: DEBUG nova.network.neutron [req-60540aed-fbbf-4f82-aa2d-1f424a77410c req-b563500b-f9fd-4f23-a160-e1cb50fcb7e3 service nova] [instance: 91ea8a19-a365-484c-80c7-baf90e7dd1aa] Updating instance_info_cache with network_info: [{"id": "2cfb645f-7bee-4657-b0d8-afcaa0298ac9", "address": "fa:16:3e:3e:1d:91", "network": {"id": "a9670fc3-8a8e-4a2b-a39f-d41042d3443d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1394481632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0194e3c88e2b49c5ba9b9844f6048ea9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cfb645f-7b", "ovs_interfaceid": "2cfb645f-7bee-4657-b0d8-afcaa0298ac9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 18:49:50 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-60540aed-fbbf-4f82-aa2d-1f424a77410c req-b563500b-f9fd-4f23-a160-e1cb50fcb7e3 service nova] Releasing lock "refresh_cache-91ea8a19-a365-484c-80c7-baf90e7dd1aa" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 18:49:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "refresh_cache-83fda249-9d28-4cc2-aeb0-103ce4f1faa4" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 18:49:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquired lock "refresh_cache-83fda249-9d28-4cc2-aeb0-103ce4f1faa4" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 18:49:51 user nova-compute[75216]: DEBUG nova.network.neutron [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: 83fda249-9d28-4cc2-aeb0-103ce4f1faa4] Forcefully refreshing network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 18:49:51 user nova-compute[75216]: DEBUG nova.network.neutron [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: 83fda249-9d28-4cc2-aeb0-103ce4f1faa4] Updating instance_info_cache with network_info: [{"id": "001a2459-5886-44be-aeb3-b2fb4ab71926", "address": "fa:16:3e:ea:a2:8e", "network": {"id": "3e05e26f-bb3f-48d7-a8cf-8974b02b1745", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-600263470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d63d01c37774af48f4d3e49901802f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap001a2459-58", "ovs_interfaceid": "001a2459-5886-44be-aeb3-b2fb4ab71926", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 18:49:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Releasing lock "refresh_cache-83fda249-9d28-4cc2-aeb0-103ce4f1faa4" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 18:49:51 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: 83fda249-9d28-4cc2-aeb0-103ce4f1faa4] Updated the network info_cache for instance {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 18:49:51 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:49:51 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:49:51 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:49:51 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:49:51 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:49:51 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:49:51 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75216) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 18:49:51 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:49:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:49:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:49:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:49:51 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Auditing locally available compute resources for user (node: user) {{(pid=75216) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 18:49:51 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:49:52 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:49:52 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:49:52 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:49:52 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:49:52 user nova-compute[75216]: DEBUG nova.compute.manager [req-3ac2d576-1112-40f0-96fe-0e483a96615b req-25518ffb-4542-4b47-9ab7-72da14db77bd service nova] [instance: 91ea8a19-a365-484c-80c7-baf90e7dd1aa] Received event network-vif-plugged-2cfb645f-7bee-4657-b0d8-afcaa0298ac9 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:49:52 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-3ac2d576-1112-40f0-96fe-0e483a96615b req-25518ffb-4542-4b47-9ab7-72da14db77bd service nova] Acquiring lock "91ea8a19-a365-484c-80c7-baf90e7dd1aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:49:52 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-3ac2d576-1112-40f0-96fe-0e483a96615b req-25518ffb-4542-4b47-9ab7-72da14db77bd service nova] Lock "91ea8a19-a365-484c-80c7-baf90e7dd1aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:49:52 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-3ac2d576-1112-40f0-96fe-0e483a96615b req-25518ffb-4542-4b47-9ab7-72da14db77bd service nova] Lock "91ea8a19-a365-484c-80c7-baf90e7dd1aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:49:52 user nova-compute[75216]: DEBUG nova.compute.manager [req-3ac2d576-1112-40f0-96fe-0e483a96615b req-25518ffb-4542-4b47-9ab7-72da14db77bd service nova] [instance: 91ea8a19-a365-484c-80c7-baf90e7dd1aa] No waiting events found dispatching network-vif-plugged-2cfb645f-7bee-4657-b0d8-afcaa0298ac9 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:49:52 user nova-compute[75216]: WARNING nova.compute.manager [req-3ac2d576-1112-40f0-96fe-0e483a96615b req-25518ffb-4542-4b47-9ab7-72da14db77bd service nova] [instance: 91ea8a19-a365-484c-80c7-baf90e7dd1aa] Received unexpected event network-vif-plugged-2cfb645f-7bee-4657-b0d8-afcaa0298ac9 for instance with vm_state building and task_state spawning.
Nov 13 18:49:52 user nova-compute[75216]: DEBUG nova.compute.manager [req-1ec0516b-0a8a-4377-8f94-8766eb2ce70f req-9d5b9bd8-dbb7-4be8-ace3-537a2914e158 service nova] [instance: 64dfe522-8b46-4df4-8032-591ce56900ec] Received event network-changed-2d12f254-7874-4622-a7cb-8180de961bd1 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:49:52 user nova-compute[75216]: DEBUG nova.compute.manager [req-1ec0516b-0a8a-4377-8f94-8766eb2ce70f req-9d5b9bd8-dbb7-4be8-ace3-537a2914e158 service nova] [instance: 64dfe522-8b46-4df4-8032-591ce56900ec] Refreshing instance network info cache due to event network-changed-2d12f254-7874-4622-a7cb-8180de961bd1. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 18:49:52 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-1ec0516b-0a8a-4377-8f94-8766eb2ce70f req-9d5b9bd8-dbb7-4be8-ace3-537a2914e158 service nova] Acquiring lock "refresh_cache-64dfe522-8b46-4df4-8032-591ce56900ec" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 18:49:52 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-1ec0516b-0a8a-4377-8f94-8766eb2ce70f req-9d5b9bd8-dbb7-4be8-ace3-537a2914e158 service nova] Acquired lock "refresh_cache-64dfe522-8b46-4df4-8032-591ce56900ec" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 18:49:52 user nova-compute[75216]: DEBUG nova.network.neutron [req-1ec0516b-0a8a-4377-8f94-8766eb2ce70f req-9d5b9bd8-dbb7-4be8-ace3-537a2914e158 service nova] [instance: 64dfe522-8b46-4df4-8032-591ce56900ec] Refreshing network info cache for port 2d12f254-7874-4622-a7cb-8180de961bd1 {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 18:49:52 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:49:52 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:49:52 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:49:52 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:49:53 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c862cfe7-6265-47be-9667-e1d09c5b5598 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] Acquiring lock "interface-64dfe522-8b46-4df4-8032-591ce56900ec-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:49:53 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c862cfe7-6265-47be-9667-e1d09c5b5598 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] Lock "interface-64dfe522-8b46-4df4-8032-591ce56900ec-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:49:53 user nova-compute[75216]: DEBUG nova.objects.instance [None req-c862cfe7-6265-47be-9667-e1d09c5b5598 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] Lazy-loading 'flavor' on Instance uuid 64dfe522-8b46-4df4-8032-591ce56900ec {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 18:49:53 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:49:53 user nova-compute[75216]: DEBUG nova.objects.instance [None req-c862cfe7-6265-47be-9667-e1d09c5b5598 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] Lazy-loading 'pci_requests' on Instance uuid 64dfe522-8b46-4df4-8032-591ce56900ec {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 18:49:53 user nova-compute[75216]: DEBUG nova.objects.base [None req-c862cfe7-6265-47be-9667-e1d09c5b5598 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] Object Instance<64dfe522-8b46-4df4-8032-591ce56900ec> lazy-loaded attributes: flavor,pci_requests {{(pid=75216) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 18:49:53 user nova-compute[75216]: DEBUG nova.network.neutron [None req-c862cfe7-6265-47be-9667-e1d09c5b5598 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] [instance: 64dfe522-8b46-4df4-8032-591ce56900ec] allocate_for_instance() {{(pid=75216) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 18:49:53 user nova-compute[75216]: DEBUG nova.network.neutron [req-1ec0516b-0a8a-4377-8f94-8766eb2ce70f req-9d5b9bd8-dbb7-4be8-ace3-537a2914e158 service nova] [instance: 64dfe522-8b46-4df4-8032-591ce56900ec] Updated VIF entry in instance network info cache for port 2d12f254-7874-4622-a7cb-8180de961bd1. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 18:49:53 user nova-compute[75216]: DEBUG nova.network.neutron [req-1ec0516b-0a8a-4377-8f94-8766eb2ce70f req-9d5b9bd8-dbb7-4be8-ace3-537a2914e158 service nova] [instance: 64dfe522-8b46-4df4-8032-591ce56900ec] Updating instance_info_cache with network_info: [{"id": "2d12f254-7874-4622-a7cb-8180de961bd1", "address": "fa:16:3e:a1:6b:92", "network": {"id": "0b64448d-5ece-4814-9bdc-de0167e921f9", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-67835474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ec18dd2e6ea476dbf3745d14a866190", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d12f254-78", "ovs_interfaceid": "2d12f254-7874-4622-a7cb-8180de961bd1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 18:49:53 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-1ec0516b-0a8a-4377-8f94-8766eb2ce70f req-9d5b9bd8-dbb7-4be8-ace3-537a2914e158 service nova] Releasing lock "refresh_cache-64dfe522-8b46-4df4-8032-591ce56900ec" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 18:49:53 user nova-compute[75216]: DEBUG nova.policy [None req-c862cfe7-6265-47be-9667-e1d09c5b5598 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '454caf80dd76487baead7c52f05df1a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ec18dd2e6ea476dbf3745d14a866190', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75216) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 18:49:54 user nova-compute[75216]: DEBUG nova.network.neutron [None req-c862cfe7-6265-47be-9667-e1d09c5b5598 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] [instance: 64dfe522-8b46-4df4-8032-591ce56900ec] Successfully created port: 0b5d79f8-fcb9-4bc8-b5e3-489fb6218824 {{(pid=75216) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 18:49:54 user nova-compute[75216]: DEBUG nova.compute.manager [req-19c231e9-bbb5-4418-bcbc-f0c22863fc0f req-0346c2e9-8510-4948-9710-cfdca845ad3e service nova] [instance: 91ea8a19-a365-484c-80c7-baf90e7dd1aa] Received event network-vif-plugged-2cfb645f-7bee-4657-b0d8-afcaa0298ac9 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:49:54 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-19c231e9-bbb5-4418-bcbc-f0c22863fc0f req-0346c2e9-8510-4948-9710-cfdca845ad3e service nova] Acquiring lock "91ea8a19-a365-484c-80c7-baf90e7dd1aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:49:54 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-19c231e9-bbb5-4418-bcbc-f0c22863fc0f req-0346c2e9-8510-4948-9710-cfdca845ad3e service nova] Lock "91ea8a19-a365-484c-80c7-baf90e7dd1aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:49:54 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-19c231e9-bbb5-4418-bcbc-f0c22863fc0f req-0346c2e9-8510-4948-9710-cfdca845ad3e service nova] Lock "91ea8a19-a365-484c-80c7-baf90e7dd1aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:49:54 user nova-compute[75216]: DEBUG nova.compute.manager [req-19c231e9-bbb5-4418-bcbc-f0c22863fc0f req-0346c2e9-8510-4948-9710-cfdca845ad3e service nova] [instance: 91ea8a19-a365-484c-80c7-baf90e7dd1aa] No waiting events found dispatching network-vif-plugged-2cfb645f-7bee-4657-b0d8-afcaa0298ac9 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:49:54 user nova-compute[75216]: WARNING nova.compute.manager [req-19c231e9-bbb5-4418-bcbc-f0c22863fc0f req-0346c2e9-8510-4948-9710-cfdca845ad3e service nova] [instance: 91ea8a19-a365-484c-80c7-baf90e7dd1aa] Received unexpected event network-vif-plugged-2cfb645f-7bee-4657-b0d8-afcaa0298ac9 for instance with vm_state building and task_state spawning.
Nov 13 18:49:54 user nova-compute[75216]: DEBUG nova.compute.manager [None req-d839fb1c-662a-4bd2-b871-948609620e2d tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] [instance: 91ea8a19-a365-484c-80c7-baf90e7dd1aa] Instance event wait completed in 0 seconds for  {{(pid=75216) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 18:49:54 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-d839fb1c-662a-4bd2-b871-948609620e2d tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] [instance: 91ea8a19-a365-484c-80c7-baf90e7dd1aa] Guest created on hypervisor {{(pid=75216) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 18:49:54 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 91ea8a19-a365-484c-80c7-baf90e7dd1aa] Instance spawned successfully.
Nov 13 18:49:54 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-d839fb1c-662a-4bd2-b871-948609620e2d tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] [instance: 91ea8a19-a365-484c-80c7-baf90e7dd1aa] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 18:49:54 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-d839fb1c-662a-4bd2-b871-948609620e2d tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] [instance: 91ea8a19-a365-484c-80c7-baf90e7dd1aa] Found default for hw_cdrom_bus of ide {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 18:49:54 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-d839fb1c-662a-4bd2-b871-948609620e2d tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] [instance: 91ea8a19-a365-484c-80c7-baf90e7dd1aa] Found default for hw_disk_bus of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 18:49:54 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-d839fb1c-662a-4bd2-b871-948609620e2d tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] [instance: 91ea8a19-a365-484c-80c7-baf90e7dd1aa] Found default for hw_input_bus of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 18:49:54 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-d839fb1c-662a-4bd2-b871-948609620e2d tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] [instance: 91ea8a19-a365-484c-80c7-baf90e7dd1aa] Found default for hw_pointer_model of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 18:49:54 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-d839fb1c-662a-4bd2-b871-948609620e2d tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] [instance: 91ea8a19-a365-484c-80c7-baf90e7dd1aa] Found default for hw_video_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 18:49:54 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-d839fb1c-662a-4bd2-b871-948609620e2d tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] [instance: 91ea8a19-a365-484c-80c7-baf90e7dd1aa] Found default for hw_vif_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 18:49:54 user nova-compute[75216]: INFO nova.compute.manager [None req-d839fb1c-662a-4bd2-b871-948609620e2d tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] [instance: 91ea8a19-a365-484c-80c7-baf90e7dd1aa] Took 6.06 seconds to spawn the instance on the hypervisor.
Nov 13 18:49:54 user nova-compute[75216]: DEBUG nova.compute.manager [None req-d839fb1c-662a-4bd2-b871-948609620e2d tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] [instance: 91ea8a19-a365-484c-80c7-baf90e7dd1aa] Checking state {{(pid=75216) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 18:49:54 user nova-compute[75216]: DEBUG nova.network.neutron [None req-c862cfe7-6265-47be-9667-e1d09c5b5598 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] [instance: 64dfe522-8b46-4df4-8032-591ce56900ec] Successfully updated port: 0b5d79f8-fcb9-4bc8-b5e3-489fb6218824 {{(pid=75216) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 18:49:54 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c862cfe7-6265-47be-9667-e1d09c5b5598 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] Acquiring lock "refresh_cache-64dfe522-8b46-4df4-8032-591ce56900ec" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 18:49:54 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c862cfe7-6265-47be-9667-e1d09c5b5598 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] Acquired lock "refresh_cache-64dfe522-8b46-4df4-8032-591ce56900ec" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 18:49:54 user nova-compute[75216]: DEBUG nova.network.neutron [None req-c862cfe7-6265-47be-9667-e1d09c5b5598 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] [instance: 64dfe522-8b46-4df4-8032-591ce56900ec] Building network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 18:49:54 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a3e849-6570-4820-97c8-75468b5bea4f/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:49:55 user nova-compute[75216]: DEBUG nova.compute.manager [req-b02097d3-ab76-41ee-b0db-23d61a4da4c4 req-2fc7eae8-6b26-461f-9401-2d4ba38db86c service nova] [instance: 64dfe522-8b46-4df4-8032-591ce56900ec] Received event network-changed-0b5d79f8-fcb9-4bc8-b5e3-489fb6218824 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:49:55 user nova-compute[75216]: DEBUG nova.compute.manager [req-b02097d3-ab76-41ee-b0db-23d61a4da4c4 req-2fc7eae8-6b26-461f-9401-2d4ba38db86c service nova] [instance: 64dfe522-8b46-4df4-8032-591ce56900ec] Refreshing instance network info cache due to event network-changed-0b5d79f8-fcb9-4bc8-b5e3-489fb6218824. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 18:49:55 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-b02097d3-ab76-41ee-b0db-23d61a4da4c4 req-2fc7eae8-6b26-461f-9401-2d4ba38db86c service nova] Acquiring lock "refresh_cache-64dfe522-8b46-4df4-8032-591ce56900ec" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 18:49:55 user nova-compute[75216]: INFO nova.compute.manager [None req-d839fb1c-662a-4bd2-b871-948609620e2d tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] [instance: 91ea8a19-a365-484c-80c7-baf90e7dd1aa] Took 7.10 seconds to build instance.
Nov 13 18:49:55 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-d839fb1c-662a-4bd2-b871-948609620e2d tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Lock "91ea8a19-a365-484c-80c7-baf90e7dd1aa" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.237s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:49:55 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a3e849-6570-4820-97c8-75468b5bea4f/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:49:55 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a3e849-6570-4820-97c8-75468b5bea4f/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:49:55 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a3e849-6570-4820-97c8-75468b5bea4f/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:49:55 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1350bc4-558a-40ac-91e5-96da24f154f5/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:49:55 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:49:55 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1350bc4-558a-40ac-91e5-96da24f154f5/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:49:55 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1350bc4-558a-40ac-91e5-96da24f154f5/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:49:55 user nova-compute[75216]: DEBUG nova.network.neutron [None req-c862cfe7-6265-47be-9667-e1d09c5b5598 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] [instance: 64dfe522-8b46-4df4-8032-591ce56900ec] Updating instance_info_cache with network_info: [{"id": "2d12f254-7874-4622-a7cb-8180de961bd1", "address": "fa:16:3e:a1:6b:92", "network": {"id": "0b64448d-5ece-4814-9bdc-de0167e921f9", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-67835474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ec18dd2e6ea476dbf3745d14a866190", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d12f254-78", "ovs_interfaceid": "2d12f254-7874-4622-a7cb-8180de961bd1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0b5d79f8-fcb9-4bc8-b5e3-489fb6218824", "address": "fa:16:3e:01:dc:62", "network": {"id": "cfd7855a-e494-456a-b9d4-02bab193fd03", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-66586289", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.117", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "0ec18dd2e6ea476dbf3745d14a866190", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b5d79f8-fc", "ovs_interfaceid": "0b5d79f8-fcb9-4bc8-b5e3-489fb6218824", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 18:49:55 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c862cfe7-6265-47be-9667-e1d09c5b5598 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] Releasing lock "refresh_cache-64dfe522-8b46-4df4-8032-591ce56900ec" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 18:49:55 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-b02097d3-ab76-41ee-b0db-23d61a4da4c4 req-2fc7eae8-6b26-461f-9401-2d4ba38db86c service nova] Acquired lock "refresh_cache-64dfe522-8b46-4df4-8032-591ce56900ec" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 18:49:55 user nova-compute[75216]: DEBUG nova.network.neutron [req-b02097d3-ab76-41ee-b0db-23d61a4da4c4 req-2fc7eae8-6b26-461f-9401-2d4ba38db86c service nova] [instance: 64dfe522-8b46-4df4-8032-591ce56900ec] Refreshing network info cache for port 0b5d79f8-fcb9-4bc8-b5e3-489fb6218824 {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 18:49:55 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-c862cfe7-6265-47be-9667-e1d09c5b5598 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T18:48:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-904595823',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-904595823',id=13,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAnoGBZDueYOh3xcWER1AMv30DIYxQxeWRDS2fRFXh6l4DZc8pD4qIgg0IjDLbUZuBfE7+vn5QgzB7ChiJAa+d1ltHilcpx/dg8eDxHVfO8o++kjL7IH7NIL3RYQDYV6Ew==',key_name='tempest-keypair-1295383460',keypairs=<?>,launch_index=0,launched_at=2023-11-13T18:48:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='0ec18dd2e6ea476dbf3745d14a866190',ramdisk_id='',reservation_id='r-0a499j0h',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-507898025',owner_user_name='tempest-TaggedAttachmentsTest-507898025-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T18:48:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='454caf80dd76487baead7c52f05df1a5',uuid=64dfe522-8b46-4df4-8032-591ce56900ec,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0b5d79f8-fcb9-4bc8-b5e3-489fb6218824", "address": "fa:16:3e:01:dc:62", "network": {"id": "cfd7855a-e494-456a-b9d4-02bab193fd03", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-66586289", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.117", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "0ec18dd2e6ea476dbf3745d14a866190", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b5d79f8-fc", "ovs_interfaceid": "0b5d79f8-fcb9-4bc8-b5e3-489fb6218824", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 18:49:55 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-c862cfe7-6265-47be-9667-e1d09c5b5598 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] Converting VIF {"id": "0b5d79f8-fcb9-4bc8-b5e3-489fb6218824", "address": "fa:16:3e:01:dc:62", "network": {"id": "cfd7855a-e494-456a-b9d4-02bab193fd03", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-66586289", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.117", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "0ec18dd2e6ea476dbf3745d14a866190", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b5d79f8-fc", "ovs_interfaceid": "0b5d79f8-fcb9-4bc8-b5e3-489fb6218824", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 18:49:55 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-c862cfe7-6265-47be-9667-e1d09c5b5598 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:dc:62,bridge_name='br-int',has_traffic_filtering=True,id=0b5d79f8-fcb9-4bc8-b5e3-489fb6218824,network=Network(cfd7855a-e494-456a-b9d4-02bab193fd03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b5d79f8-fc') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 18:49:55 user nova-compute[75216]: DEBUG os_vif [None req-c862cfe7-6265-47be-9667-e1d09c5b5598 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:dc:62,bridge_name='br-int',has_traffic_filtering=True,id=0b5d79f8-fcb9-4bc8-b5e3-489fb6218824,network=Network(cfd7855a-e494-456a-b9d4-02bab193fd03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b5d79f8-fc') {{(pid=75216) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 18:49:55 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:49:55 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:49:55 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 18:49:55 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:49:55 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1cea052e-d11f-583c-bbdc-c80c9f76bafb', '_type': 'linux-noop'}}, row=False) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:49:55 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:49:55 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:49:55 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:49:55 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0b5d79f8-fc, may_exist=True, interface_attrs={}) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:49:55 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0b5d79f8-fc, col_values=(('qos', UUID('d636f81e-8358-48fd-8264-887cd66ab01f')),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:49:55 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0b5d79f8-fc, col_values=(('external_ids', {'iface-id': '0b5d79f8-fcb9-4bc8-b5e3-489fb6218824', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:01:dc:62', 'vm-uuid': '64dfe522-8b46-4df4-8032-591ce56900ec'}),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:49:55 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:49:55 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:49:55 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:49:55 user nova-compute[75216]: INFO os_vif [None req-c862cfe7-6265-47be-9667-e1d09c5b5598 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:dc:62,bridge_name='br-int',has_traffic_filtering=True,id=0b5d79f8-fcb9-4bc8-b5e3-489fb6218824,network=Network(cfd7855a-e494-456a-b9d4-02bab193fd03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b5d79f8-fc')
Nov 13 18:49:55 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-c862cfe7-6265-47be-9667-e1d09c5b5598 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T18:48:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-904595823',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-904595823',id=13,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAnoGBZDueYOh3xcWER1AMv30DIYxQxeWRDS2fRFXh6l4DZc8pD4qIgg0IjDLbUZuBfE7+vn5QgzB7ChiJAa+d1ltHilcpx/dg8eDxHVfO8o++kjL7IH7NIL3RYQDYV6Ew==',key_name='tempest-keypair-1295383460',keypairs=<?>,launch_index=0,launched_at=2023-11-13T18:48:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='0ec18dd2e6ea476dbf3745d14a866190',ramdisk_id='',reservation_id='r-0a499j0h',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-507898025',owner_user_name='tempest-TaggedAttachmentsTest-507898025-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T18:48:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='454caf80dd76487baead7c52f05df1a5',uuid=64dfe522-8b46-4df4-8032-591ce56900ec,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0b5d79f8-fcb9-4bc8-b5e3-489fb6218824", "address": "fa:16:3e:01:dc:62", "network": {"id": "cfd7855a-e494-456a-b9d4-02bab193fd03", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-66586289", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.117", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "0ec18dd2e6ea476dbf3745d14a866190", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b5d79f8-fc", "ovs_interfaceid": "0b5d79f8-fcb9-4bc8-b5e3-489fb6218824", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75216) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 18:49:55 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-c862cfe7-6265-47be-9667-e1d09c5b5598 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] Converting VIF {"id": "0b5d79f8-fcb9-4bc8-b5e3-489fb6218824", "address": "fa:16:3e:01:dc:62", "network": {"id": "cfd7855a-e494-456a-b9d4-02bab193fd03", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-66586289", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.117", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "0ec18dd2e6ea476dbf3745d14a866190", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b5d79f8-fc", "ovs_interfaceid": "0b5d79f8-fcb9-4bc8-b5e3-489fb6218824", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 18:49:55 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-c862cfe7-6265-47be-9667-e1d09c5b5598 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:dc:62,bridge_name='br-int',has_traffic_filtering=True,id=0b5d79f8-fcb9-4bc8-b5e3-489fb6218824,network=Network(cfd7855a-e494-456a-b9d4-02bab193fd03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b5d79f8-fc') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 18:49:55 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-c862cfe7-6265-47be-9667-e1d09c5b5598 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] attach device xml: <interface type="ethernet">
Nov 13 18:49:55 user nova-compute[75216]:   <mac address="fa:16:3e:01:dc:62"/>
Nov 13 18:49:55 user nova-compute[75216]:   <model type="virtio"/>
Nov 13 18:49:55 user nova-compute[75216]:   <mtu size="1442"/>
Nov 13 18:49:55 user nova-compute[75216]:   <target dev="tap0b5d79f8-fc"/>
Nov 13 18:49:55 user nova-compute[75216]: </interface>
Nov 13 18:49:55 user nova-compute[75216]:  {{(pid=75216) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 13 18:49:55 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:49:55 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1350bc4-558a-40ac-91e5-96da24f154f5/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:49:55 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c9d9c1b-6df5-41ff-a696-871e70d04e07/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:49:55 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:49:55 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:49:56 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c9d9c1b-6df5-41ff-a696-871e70d04e07/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:49:56 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c9d9c1b-6df5-41ff-a696-871e70d04e07/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:49:56 user nova-compute[75216]: DEBUG nova.compute.manager [req-30ee14be-6864-48a0-a1a0-a8bf56f10cbd req-57a48377-fca4-44bc-bfab-350c635a1cfd service nova] [instance: 64dfe522-8b46-4df4-8032-591ce56900ec] Received event network-vif-plugged-0b5d79f8-fcb9-4bc8-b5e3-489fb6218824 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:49:56 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-30ee14be-6864-48a0-a1a0-a8bf56f10cbd req-57a48377-fca4-44bc-bfab-350c635a1cfd service nova] Acquiring lock "64dfe522-8b46-4df4-8032-591ce56900ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:49:56 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-30ee14be-6864-48a0-a1a0-a8bf56f10cbd req-57a48377-fca4-44bc-bfab-350c635a1cfd service nova] Lock "64dfe522-8b46-4df4-8032-591ce56900ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:49:56 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-30ee14be-6864-48a0-a1a0-a8bf56f10cbd req-57a48377-fca4-44bc-bfab-350c635a1cfd service nova] Lock "64dfe522-8b46-4df4-8032-591ce56900ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:49:56 user nova-compute[75216]: DEBUG nova.compute.manager [req-30ee14be-6864-48a0-a1a0-a8bf56f10cbd req-57a48377-fca4-44bc-bfab-350c635a1cfd service nova] [instance: 64dfe522-8b46-4df4-8032-591ce56900ec] No waiting events found dispatching network-vif-plugged-0b5d79f8-fcb9-4bc8-b5e3-489fb6218824 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:49:56 user nova-compute[75216]: WARNING nova.compute.manager [req-30ee14be-6864-48a0-a1a0-a8bf56f10cbd req-57a48377-fca4-44bc-bfab-350c635a1cfd service nova] [instance: 64dfe522-8b46-4df4-8032-591ce56900ec] Received unexpected event network-vif-plugged-0b5d79f8-fcb9-4bc8-b5e3-489fb6218824 for instance with vm_state active and task_state None.
Nov 13 18:49:56 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-c862cfe7-6265-47be-9667-e1d09c5b5598 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 18:49:56 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-c862cfe7-6265-47be-9667-e1d09c5b5598 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] No BDM found with device name hda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 18:49:56 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-c862cfe7-6265-47be-9667-e1d09c5b5598 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] No VIF found with MAC fa:16:3e:a1:6b:92, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 18:49:56 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c9d9c1b-6df5-41ff-a696-871e70d04e07/disk --force-share --output=json" returned: 0 in 0.263s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:49:56 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83fda249-9d28-4cc2-aeb0-103ce4f1faa4/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:49:56 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-c862cfe7-6265-47be-9667-e1d09c5b5598 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 18:49:56 user nova-compute[75216]:   <nova:package version="0.0.0"/>
Nov 13 18:49:56 user nova-compute[75216]:   <nova:name>tempest-device-tagging-server-904595823</nova:name>
Nov 13 18:49:56 user nova-compute[75216]:   <nova:creationTime>2023-11-13 18:49:56</nova:creationTime>
Nov 13 18:49:56 user nova-compute[75216]:   <nova:flavor name="m1.tiny">
Nov 13 18:49:56 user nova-compute[75216]:     <nova:memory>512</nova:memory>
Nov 13 18:49:56 user nova-compute[75216]:     <nova:disk>1</nova:disk>
Nov 13 18:49:56 user nova-compute[75216]:     <nova:swap>0</nova:swap>
Nov 13 18:49:56 user nova-compute[75216]:     <nova:ephemeral>0</nova:ephemeral>
Nov 13 18:49:56 user nova-compute[75216]:     <nova:vcpus>1</nova:vcpus>
Nov 13 18:49:56 user nova-compute[75216]:   </nova:flavor>
Nov 13 18:49:56 user nova-compute[75216]:   <nova:owner>
Nov 13 18:49:56 user nova-compute[75216]:     <nova:user uuid="454caf80dd76487baead7c52f05df1a5">tempest-TaggedAttachmentsTest-507898025-project-member</nova:user>
Nov 13 18:49:56 user nova-compute[75216]:     <nova:project uuid="0ec18dd2e6ea476dbf3745d14a866190">tempest-TaggedAttachmentsTest-507898025</nova:project>
Nov 13 18:49:56 user nova-compute[75216]:   </nova:owner>
Nov 13 18:49:56 user nova-compute[75216]:   <nova:root type="image" uuid="77bcb5ba-8510-41ec-a88d-96097bb431de"/>
Nov 13 18:49:56 user nova-compute[75216]:   <nova:ports>
Nov 13 18:49:56 user nova-compute[75216]:     <nova:port uuid="2d12f254-7874-4622-a7cb-8180de961bd1">
Nov 13 18:49:56 user nova-compute[75216]:       <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 13 18:49:56 user nova-compute[75216]:     </nova:port>
Nov 13 18:49:56 user nova-compute[75216]:     <nova:port uuid="0b5d79f8-fcb9-4bc8-b5e3-489fb6218824">
Nov 13 18:49:56 user nova-compute[75216]:       <nova:ip type="fixed" address="10.10.10.117" ipVersion="4"/>
Nov 13 18:49:56 user nova-compute[75216]:     </nova:port>
Nov 13 18:49:56 user nova-compute[75216]:   </nova:ports>
Nov 13 18:49:56 user nova-compute[75216]: </nova:instance>
Nov 13 18:49:56 user nova-compute[75216]:  {{(pid=75216) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 13 18:49:56 user nova-compute[75216]: DEBUG nova.network.neutron [req-b02097d3-ab76-41ee-b0db-23d61a4da4c4 req-2fc7eae8-6b26-461f-9401-2d4ba38db86c service nova] [instance: 64dfe522-8b46-4df4-8032-591ce56900ec] Updated VIF entry in instance network info cache for port 0b5d79f8-fcb9-4bc8-b5e3-489fb6218824. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 18:49:56 user nova-compute[75216]: DEBUG nova.network.neutron [req-b02097d3-ab76-41ee-b0db-23d61a4da4c4 req-2fc7eae8-6b26-461f-9401-2d4ba38db86c service nova] [instance: 64dfe522-8b46-4df4-8032-591ce56900ec] Updating instance_info_cache with network_info: [{"id": "2d12f254-7874-4622-a7cb-8180de961bd1", "address": "fa:16:3e:a1:6b:92", "network": {"id": "0b64448d-5ece-4814-9bdc-de0167e921f9", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-67835474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ec18dd2e6ea476dbf3745d14a866190", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d12f254-78", "ovs_interfaceid": "2d12f254-7874-4622-a7cb-8180de961bd1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0b5d79f8-fcb9-4bc8-b5e3-489fb6218824", "address": "fa:16:3e:01:dc:62", "network": {"id": "cfd7855a-e494-456a-b9d4-02bab193fd03", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-66586289", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.117", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "0ec18dd2e6ea476dbf3745d14a866190", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b5d79f8-fc", "ovs_interfaceid": "0b5d79f8-fcb9-4bc8-b5e3-489fb6218824", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 18:49:56 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-b02097d3-ab76-41ee-b0db-23d61a4da4c4 req-2fc7eae8-6b26-461f-9401-2d4ba38db86c service nova] Releasing lock "refresh_cache-64dfe522-8b46-4df4-8032-591ce56900ec" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 18:49:56 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c862cfe7-6265-47be-9667-e1d09c5b5598 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] Lock "interface-64dfe522-8b46-4df4-8032-591ce56900ec-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 3.440s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:49:56 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83fda249-9d28-4cc2-aeb0-103ce4f1faa4/disk --force-share --output=json" returned: 0 in 0.272s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:49:56 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83fda249-9d28-4cc2-aeb0-103ce4f1faa4/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:49:56 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:49:56 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:49:56 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:49:56 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:49:56 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83fda249-9d28-4cc2-aeb0-103ce4f1faa4/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:49:56 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d589d57e-de50-482a-843f-e8246b3d7528/disk.rescue --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:49:57 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f288c605-8ce7-4a75-8799-b37af2c5fa5b tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] Acquiring lock "64dfe522-8b46-4df4-8032-591ce56900ec" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:49:57 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f288c605-8ce7-4a75-8799-b37af2c5fa5b tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] Lock "64dfe522-8b46-4df4-8032-591ce56900ec" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:49:57 user nova-compute[75216]: DEBUG nova.objects.instance [None req-f288c605-8ce7-4a75-8799-b37af2c5fa5b tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] Lazy-loading 'flavor' on Instance uuid 64dfe522-8b46-4df4-8032-591ce56900ec {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 18:49:57 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f288c605-8ce7-4a75-8799-b37af2c5fa5b tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] Lock "64dfe522-8b46-4df4-8032-591ce56900ec" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.083s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:49:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d589d57e-de50-482a-843f-e8246b3d7528/disk.rescue --force-share --output=json" returned: 0 in 0.237s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:49:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d589d57e-de50-482a-843f-e8246b3d7528/disk.rescue --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:49:57 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f288c605-8ce7-4a75-8799-b37af2c5fa5b tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] Acquiring lock "64dfe522-8b46-4df4-8032-591ce56900ec" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:49:57 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f288c605-8ce7-4a75-8799-b37af2c5fa5b tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] Lock "64dfe522-8b46-4df4-8032-591ce56900ec" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:49:57 user nova-compute[75216]: INFO nova.compute.manager [None req-f288c605-8ce7-4a75-8799-b37af2c5fa5b tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] [instance: 64dfe522-8b46-4df4-8032-591ce56900ec] Attaching volume e31c9fc8-6279-4e4f-bb4a-eaf0e56ebcc5 to /dev/vdb
Nov 13 18:49:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d589d57e-de50-482a-843f-e8246b3d7528/disk.rescue --force-share --output=json" returned: 0 in 0.237s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:49:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d589d57e-de50-482a-843f-e8246b3d7528/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:49:57 user nova-compute[75216]: DEBUG os_brick.utils [None req-f288c605-8ce7-4a75-8799-b37af2c5fa5b tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 18:49:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:49:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:49:57 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[55279e23-5f3f-4b21-a42c-99648e1d4fbf]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aea6fcfe14b9\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:49:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:49:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:49:57 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[28b217f1-d7a2-44e4-96af-fef6326380c5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:49:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:49:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:49:57 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[c97a96e9-1055-4f0b-8eb8-c7746d16bca1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:49:57 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[6555734c-e9b0-4a38-82d3-fec37781b19d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:49:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-f288c605-8ce7-4a75-8799-b37af2c5fa5b tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] Running cmd (subprocess): nvme version {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:49:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-f288c605-8ce7-4a75-8799-b37af2c5fa5b tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] 'nvme version' failed. Not Retrying. {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 18:49:57 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f288c605-8ce7-4a75-8799-b37af2c5fa5b tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] nvme not present on system {{(pid=75216) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 18:49:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:49:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 18:49:57 user nova-compute[75216]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 18:49:57 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aeefbc9-1f61-4896-bbae-dcdda62a65d4]: (4, '') {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:49:57 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-f288c605-8ce7-4a75-8799-b37af2c5fa5b tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75216) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 18:49:57 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-f288c605-8ce7-4a75-8799-b37af2c5fa5b tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 18:49:57 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-f288c605-8ce7-4a75-8799-b37af2c5fa5b tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] LIGHTOS: no hostnqn found. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 18:49:57 user nova-compute[75216]: DEBUG os_brick.utils [None req-f288c605-8ce7-4a75-8799-b37af2c5fa5b tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] <== get_connector_properties: return (156ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aea6fcfe14b9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 18:49:57 user nova-compute[75216]: DEBUG nova.virt.block_device [None req-f288c605-8ce7-4a75-8799-b37af2c5fa5b tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] [instance: 64dfe522-8b46-4df4-8032-591ce56900ec] Updating existing volume attachment record: d6056d4f-f231-46ff-ac76-3bdfa87ed6cc {{(pid=75216) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 18:49:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d589d57e-de50-482a-843f-e8246b3d7528/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:49:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d589d57e-de50-482a-843f-e8246b3d7528/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:49:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d589d57e-de50-482a-843f-e8246b3d7528/disk --force-share --output=json" returned: 0 in 0.266s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:49:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b078f75-57f2-495a-abd5-f8adf72db80b/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:49:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b078f75-57f2-495a-abd5-f8adf72db80b/disk --force-share --output=json" returned: 0 in 0.271s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:49:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b078f75-57f2-495a-abd5-f8adf72db80b/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:49:58 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:49:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b078f75-57f2-495a-abd5-f8adf72db80b/disk --force-share --output=json" returned: 0 in 0.261s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:49:58 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 18:49:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b078f75-57f2-495a-abd5-f8adf72db80b/disk.rescue --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:49:58 user nova-compute[75216]: DEBUG nova.compute.manager [req-d6013981-e002-4ad4-9b76-6b7be1a76919 req-2ab8dddf-bdfc-47c3-9bfc-b82a53081b22 service nova] [instance: 64dfe522-8b46-4df4-8032-591ce56900ec] Received event network-vif-plugged-0b5d79f8-fcb9-4bc8-b5e3-489fb6218824 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:49:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-d6013981-e002-4ad4-9b76-6b7be1a76919 req-2ab8dddf-bdfc-47c3-9bfc-b82a53081b22 service nova] Acquiring lock "64dfe522-8b46-4df4-8032-591ce56900ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:49:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-d6013981-e002-4ad4-9b76-6b7be1a76919 req-2ab8dddf-bdfc-47c3-9bfc-b82a53081b22 service nova] Lock "64dfe522-8b46-4df4-8032-591ce56900ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:49:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-d6013981-e002-4ad4-9b76-6b7be1a76919 req-2ab8dddf-bdfc-47c3-9bfc-b82a53081b22 service nova] Lock "64dfe522-8b46-4df4-8032-591ce56900ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:49:58 user nova-compute[75216]: DEBUG nova.compute.manager [req-d6013981-e002-4ad4-9b76-6b7be1a76919 req-2ab8dddf-bdfc-47c3-9bfc-b82a53081b22 service nova] [instance: 64dfe522-8b46-4df4-8032-591ce56900ec] No waiting events found dispatching network-vif-plugged-0b5d79f8-fcb9-4bc8-b5e3-489fb6218824 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:49:58 user nova-compute[75216]: WARNING nova.compute.manager [req-d6013981-e002-4ad4-9b76-6b7be1a76919 req-2ab8dddf-bdfc-47c3-9bfc-b82a53081b22 service nova] [instance: 64dfe522-8b46-4df4-8032-591ce56900ec] Received unexpected event network-vif-plugged-0b5d79f8-fcb9-4bc8-b5e3-489fb6218824 for instance with vm_state active and task_state None.
Nov 13 18:49:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b078f75-57f2-495a-abd5-f8adf72db80b/disk.rescue --force-share --output=json" returned: 0 in 0.214s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:49:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b078f75-57f2-495a-abd5-f8adf72db80b/disk.rescue --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:49:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b078f75-57f2-495a-abd5-f8adf72db80b/disk.rescue --force-share --output=json" returned: 0 in 0.262s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:49:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91ea8a19-a365-484c-80c7-baf90e7dd1aa/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:49:59 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-303c877f-9266-4652-b6d4-bec230f310a2 tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] Acquiring lock "ed251b5e-5f1d-404c-a09b-156e5ed72e82" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:49:59 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-303c877f-9266-4652-b6d4-bec230f310a2 tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] Lock "ed251b5e-5f1d-404c-a09b-156e5ed72e82" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:49:59 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-303c877f-9266-4652-b6d4-bec230f310a2 tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] Acquiring lock "ed251b5e-5f1d-404c-a09b-156e5ed72e82-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:49:59 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-303c877f-9266-4652-b6d4-bec230f310a2 tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] Lock "ed251b5e-5f1d-404c-a09b-156e5ed72e82-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:49:59 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-303c877f-9266-4652-b6d4-bec230f310a2 tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] Lock "ed251b5e-5f1d-404c-a09b-156e5ed72e82-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:49:59 user nova-compute[75216]: INFO nova.compute.manager [None req-303c877f-9266-4652-b6d4-bec230f310a2 tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] [instance: ed251b5e-5f1d-404c-a09b-156e5ed72e82] Terminating instance
Nov 13 18:49:59 user nova-compute[75216]: DEBUG nova.compute.manager [None req-303c877f-9266-4652-b6d4-bec230f310a2 tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] [instance: ed251b5e-5f1d-404c-a09b-156e5ed72e82] Start destroying the instance on the hypervisor. {{(pid=75216) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 18:49:59 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:49:59 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:49:59 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91ea8a19-a365-484c-80c7-baf90e7dd1aa/disk --force-share --output=json" returned: 0 in 0.259s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:49:59 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91ea8a19-a365-484c-80c7-baf90e7dd1aa/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:49:59 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c8458832-c371-4d8e-8bf8-a01fd58cec57 tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] Acquiring lock "a3bcf65e-bd5b-4350-a222-5f4522418a67" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:49:59 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c8458832-c371-4d8e-8bf8-a01fd58cec57 tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] Lock "a3bcf65e-bd5b-4350-a222-5f4522418a67" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:49:59 user nova-compute[75216]: INFO nova.compute.manager [None req-c8458832-c371-4d8e-8bf8-a01fd58cec57 tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] [instance: a3bcf65e-bd5b-4350-a222-5f4522418a67] Unshelving
Nov 13 18:49:59 user nova-compute[75216]: INFO nova.virt.block_device [None req-c8458832-c371-4d8e-8bf8-a01fd58cec57 tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] [instance: a3bcf65e-bd5b-4350-a222-5f4522418a67] Booting with volume 84c721c0-dd26-494a-a193-5b302250edac at /dev/vda
Nov 13 18:49:59 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91ea8a19-a365-484c-80c7-baf90e7dd1aa/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:49:59 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:49:59 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 18:49:59 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85624c58-6c72-4490-8a3e-547953295ade/disk.rescue --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:49:59 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:49:59 user nova-compute[75216]: DEBUG os_brick.utils [None req-c8458832-c371-4d8e-8bf8-a01fd58cec57 tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 18:49:59 user nova-compute[75216]: DEBUG nova.compute.manager [req-4d20bd67-e6a5-4872-9edc-30854d65c75f req-33990c20-11b4-44e6-b713-15e1f2e78758 service nova] [instance: ed251b5e-5f1d-404c-a09b-156e5ed72e82] Received event network-vif-unplugged-d35d00b9-b4f6-4a81-8112-706ac49f4a21 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:49:59 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-4d20bd67-e6a5-4872-9edc-30854d65c75f req-33990c20-11b4-44e6-b713-15e1f2e78758 service nova] Acquiring lock "ed251b5e-5f1d-404c-a09b-156e5ed72e82-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:49:59 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-4d20bd67-e6a5-4872-9edc-30854d65c75f req-33990c20-11b4-44e6-b713-15e1f2e78758 service nova] Lock "ed251b5e-5f1d-404c-a09b-156e5ed72e82-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:49:59 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-4d20bd67-e6a5-4872-9edc-30854d65c75f req-33990c20-11b4-44e6-b713-15e1f2e78758 service nova] Lock "ed251b5e-5f1d-404c-a09b-156e5ed72e82-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:49:59 user nova-compute[75216]: DEBUG nova.compute.manager [req-4d20bd67-e6a5-4872-9edc-30854d65c75f req-33990c20-11b4-44e6-b713-15e1f2e78758 service nova] [instance: ed251b5e-5f1d-404c-a09b-156e5ed72e82] No waiting events found dispatching network-vif-unplugged-d35d00b9-b4f6-4a81-8112-706ac49f4a21 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:49:59 user nova-compute[75216]: DEBUG nova.compute.manager [req-4d20bd67-e6a5-4872-9edc-30854d65c75f req-33990c20-11b4-44e6-b713-15e1f2e78758 service nova] [instance: ed251b5e-5f1d-404c-a09b-156e5ed72e82] Received event network-vif-unplugged-d35d00b9-b4f6-4a81-8112-706ac49f4a21 for instance with task_state deleting. {{(pid=75216) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 18:49:59 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:49:59 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:49:59 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[1894b9e0-ed90-43b9-aa4f-4bf25956d1dc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aea6fcfe14b9\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:49:59 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:49:59 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.031s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:49:59 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[82647b42-27df-4d2b-ba62-ebf5a6302dbc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:49:59 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:49:59 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.025s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:49:59 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[b20df7ac-c94d-44cb-9db1-baee05022a65]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:49:59 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2413c21-0c50-4301-a820-72914f54f2e3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:49:59 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-c8458832-c371-4d8e-8bf8-a01fd58cec57 tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] Running cmd (subprocess): nvme version {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:49:59 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-c8458832-c371-4d8e-8bf8-a01fd58cec57 tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] 'nvme version' failed. Not Retrying. {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 18:49:59 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c8458832-c371-4d8e-8bf8-a01fd58cec57 tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] nvme not present on system {{(pid=75216) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 18:49:59 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:49:59 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 18:49:59 user nova-compute[75216]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 18:49:59 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[dde67125-6cd4-404f-b12e-c7b8bdb0b325]: (4, '') {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:49:59 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85624c58-6c72-4490-8a3e-547953295ade/disk.rescue --force-share --output=json" returned: 0 in 0.274s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:49:59 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-c8458832-c371-4d8e-8bf8-a01fd58cec57 tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75216) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 18:49:59 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-c8458832-c371-4d8e-8bf8-a01fd58cec57 tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 18:49:59 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-c8458832-c371-4d8e-8bf8-a01fd58cec57 tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] LIGHTOS: no hostnqn found. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 18:49:59 user nova-compute[75216]: DEBUG os_brick.utils [None req-c8458832-c371-4d8e-8bf8-a01fd58cec57 tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] <== get_connector_properties: return (186ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aea6fcfe14b9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 18:49:59 user nova-compute[75216]: DEBUG nova.virt.block_device [None req-c8458832-c371-4d8e-8bf8-a01fd58cec57 tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] [instance: a3bcf65e-bd5b-4350-a222-5f4522418a67] Updating existing volume attachment record: bdadceb9-0d80-49f5-b81f-317dd4b343f0 {{(pid=75216) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 18:49:59 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85624c58-6c72-4490-8a3e-547953295ade/disk.rescue --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:49:59 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: ed251b5e-5f1d-404c-a09b-156e5ed72e82] Instance destroyed successfully.
Nov 13 18:49:59 user nova-compute[75216]: DEBUG nova.objects.instance [None req-303c877f-9266-4652-b6d4-bec230f310a2 tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] Lazy-loading 'resources' on Instance uuid ed251b5e-5f1d-404c-a09b-156e5ed72e82 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 18:49:59 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-303c877f-9266-4652-b6d4-bec230f310a2 tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T18:48:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-627121455',display_name='tempest-VolumesAdminNegativeTest-server-627121455',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-627121455',id=14,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-13T18:48:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7d63d01c37774af48f4d3e49901802f9',ramdisk_id='',reservation_id='r-cfmxt4o0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-999712097',owner_user_name='tempest-VolumesAdminNegativeTest-999712097-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T18:48:11Z,user_data=None,user_id='9328187f980b430f9f65420eec9f8c98',uuid=ed251b5e-5f1d-404c-a09b-156e5ed72e82,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d35d00b9-b4f6-4a81-8112-706ac49f4a21", "address": "fa:16:3e:3a:d0:50", "network": {"id": "3e05e26f-bb3f-48d7-a8cf-8974b02b1745", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-600263470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d63d01c37774af48f4d3e49901802f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd35d00b9-b4", "ovs_interfaceid": "d35d00b9-b4f6-4a81-8112-706ac49f4a21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 18:49:59 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-303c877f-9266-4652-b6d4-bec230f310a2 tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] Converting VIF {"id": "d35d00b9-b4f6-4a81-8112-706ac49f4a21", "address": "fa:16:3e:3a:d0:50", "network": {"id": "3e05e26f-bb3f-48d7-a8cf-8974b02b1745", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-600263470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d63d01c37774af48f4d3e49901802f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd35d00b9-b4", "ovs_interfaceid": "d35d00b9-b4f6-4a81-8112-706ac49f4a21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 18:49:59 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-303c877f-9266-4652-b6d4-bec230f310a2 tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:d0:50,bridge_name='br-int',has_traffic_filtering=True,id=d35d00b9-b4f6-4a81-8112-706ac49f4a21,network=Network(3e05e26f-bb3f-48d7-a8cf-8974b02b1745),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd35d00b9-b4') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 18:49:59 user nova-compute[75216]: DEBUG os_vif [None req-303c877f-9266-4652-b6d4-bec230f310a2 tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:d0:50,bridge_name='br-int',has_traffic_filtering=True,id=d35d00b9-b4f6-4a81-8112-706ac49f4a21,network=Network(3e05e26f-bb3f-48d7-a8cf-8974b02b1745),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd35d00b9-b4') {{(pid=75216) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 18:49:59 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:49:59 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd35d00b9-b4, bridge=br-int, if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:49:59 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:49:59 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:49:59 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bafdb1af-9c72-4ecc-82dc-8be252a4b8a2) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:49:59 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:49:59 user nova-compute[75216]: INFO os_vif [None req-303c877f-9266-4652-b6d4-bec230f310a2 tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:d0:50,bridge_name='br-int',has_traffic_filtering=True,id=d35d00b9-b4f6-4a81-8112-706ac49f4a21,network=Network(3e05e26f-bb3f-48d7-a8cf-8974b02b1745),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd35d00b9-b4')
Nov 13 18:49:59 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-303c877f-9266-4652-b6d4-bec230f310a2 tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] [instance: ed251b5e-5f1d-404c-a09b-156e5ed72e82] Deleting instance files /opt/stack/data/nova/instances/ed251b5e-5f1d-404c-a09b-156e5ed72e82_del
Nov 13 18:49:59 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-303c877f-9266-4652-b6d4-bec230f310a2 tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] [instance: ed251b5e-5f1d-404c-a09b-156e5ed72e82] Deletion of /opt/stack/data/nova/instances/ed251b5e-5f1d-404c-a09b-156e5ed72e82_del complete
Nov 13 18:50:00 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85624c58-6c72-4490-8a3e-547953295ade/disk.rescue --force-share --output=json" returned: 0 in 0.261s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:50:00 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85624c58-6c72-4490-8a3e-547953295ade/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:50:00 user nova-compute[75216]: INFO nova.compute.manager [None req-303c877f-9266-4652-b6d4-bec230f310a2 tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] [instance: ed251b5e-5f1d-404c-a09b-156e5ed72e82] Took 1.08 seconds to destroy the instance on the hypervisor.
Nov 13 18:50:00 user nova-compute[75216]: DEBUG oslo.service.loopingcall [None req-303c877f-9266-4652-b6d4-bec230f310a2 tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75216) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 18:50:00 user nova-compute[75216]: DEBUG nova.compute.manager [-] [instance: ed251b5e-5f1d-404c-a09b-156e5ed72e82] Deallocating network for instance {{(pid=75216) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 18:50:00 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: ed251b5e-5f1d-404c-a09b-156e5ed72e82] deallocate_for_instance() {{(pid=75216) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 18:50:00 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85624c58-6c72-4490-8a3e-547953295ade/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:50:00 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85624c58-6c72-4490-8a3e-547953295ade/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:50:00 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85624c58-6c72-4490-8a3e-547953295ade/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:50:00 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64dfe522-8b46-4df4-8032-591ce56900ec/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:50:00 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: ed251b5e-5f1d-404c-a09b-156e5ed72e82] Updating instance_info_cache with network_info: [] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 18:50:00 user nova-compute[75216]: DEBUG nova.compute.manager [req-56b332c2-92b4-4702-b59f-40d91fdd2847 req-5fc52e2b-abd3-4505-913f-e9bae2fbdb0b service nova] [instance: ed251b5e-5f1d-404c-a09b-156e5ed72e82] Received event network-vif-deleted-d35d00b9-b4f6-4a81-8112-706ac49f4a21 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:50:00 user nova-compute[75216]: INFO nova.compute.manager [req-56b332c2-92b4-4702-b59f-40d91fdd2847 req-5fc52e2b-abd3-4505-913f-e9bae2fbdb0b service nova] [instance: ed251b5e-5f1d-404c-a09b-156e5ed72e82] Neutron deleted interface d35d00b9-b4f6-4a81-8112-706ac49f4a21; detaching it from the instance and deleting it from the info cache
Nov 13 18:50:00 user nova-compute[75216]: DEBUG nova.network.neutron [req-56b332c2-92b4-4702-b59f-40d91fdd2847 req-5fc52e2b-abd3-4505-913f-e9bae2fbdb0b service nova] [instance: ed251b5e-5f1d-404c-a09b-156e5ed72e82] Updating instance_info_cache with network_info: [] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 18:50:00 user nova-compute[75216]: INFO nova.compute.manager [-] [instance: ed251b5e-5f1d-404c-a09b-156e5ed72e82] Took 0.69 seconds to deallocate network for instance.
Nov 13 18:50:00 user nova-compute[75216]: DEBUG nova.compute.manager [req-56b332c2-92b4-4702-b59f-40d91fdd2847 req-5fc52e2b-abd3-4505-913f-e9bae2fbdb0b service nova] [instance: ed251b5e-5f1d-404c-a09b-156e5ed72e82] Detach interface failed, port_id=d35d00b9-b4f6-4a81-8112-706ac49f4a21, reason: Instance ed251b5e-5f1d-404c-a09b-156e5ed72e82 could not be found. {{(pid=75216) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 13 18:50:00 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64dfe522-8b46-4df4-8032-591ce56900ec/disk --force-share --output=json" returned: 0 in 0.261s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:50:00 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64dfe522-8b46-4df4-8032-591ce56900ec/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:50:00 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-303c877f-9266-4652-b6d4-bec230f310a2 tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:50:00 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-303c877f-9266-4652-b6d4-bec230f310a2 tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:50:01 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64dfe522-8b46-4df4-8032-591ce56900ec/disk --force-share --output=json" returned: 0 in 0.271s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:50:01 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Error from libvirt while getting description of instance-0000000e: [Error Code 42] Domain not found: no domain with matching uuid 'ed251b5e-5f1d-404c-a09b-156e5ed72e82' (instance-0000000e): libvirt.libvirtError: Domain not found: no domain with matching uuid 'ed251b5e-5f1d-404c-a09b-156e5ed72e82' (instance-0000000e)
Nov 13 18:50:01 user nova-compute[75216]: DEBUG nova.compute.manager [req-788bd51d-8942-4888-ae97-ac45652a73b8 req-740c85b9-643c-46ac-828b-3be12d8d32c3 service nova] [instance: ed251b5e-5f1d-404c-a09b-156e5ed72e82] Received event network-vif-plugged-d35d00b9-b4f6-4a81-8112-706ac49f4a21 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:50:01 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-788bd51d-8942-4888-ae97-ac45652a73b8 req-740c85b9-643c-46ac-828b-3be12d8d32c3 service nova] Acquiring lock "ed251b5e-5f1d-404c-a09b-156e5ed72e82-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:50:01 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-788bd51d-8942-4888-ae97-ac45652a73b8 req-740c85b9-643c-46ac-828b-3be12d8d32c3 service nova] Lock "ed251b5e-5f1d-404c-a09b-156e5ed72e82-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:50:01 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-788bd51d-8942-4888-ae97-ac45652a73b8 req-740c85b9-643c-46ac-828b-3be12d8d32c3 service nova] Lock "ed251b5e-5f1d-404c-a09b-156e5ed72e82-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:50:01 user nova-compute[75216]: DEBUG nova.compute.manager [req-788bd51d-8942-4888-ae97-ac45652a73b8 req-740c85b9-643c-46ac-828b-3be12d8d32c3 service nova] [instance: ed251b5e-5f1d-404c-a09b-156e5ed72e82] No waiting events found dispatching network-vif-plugged-d35d00b9-b4f6-4a81-8112-706ac49f4a21 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:50:01 user nova-compute[75216]: WARNING nova.compute.manager [req-788bd51d-8942-4888-ae97-ac45652a73b8 req-740c85b9-643c-46ac-828b-3be12d8d32c3 service nova] [instance: ed251b5e-5f1d-404c-a09b-156e5ed72e82] Received unexpected event network-vif-plugged-d35d00b9-b4f6-4a81-8112-706ac49f4a21 for instance with vm_state deleted and task_state None.
Nov 13 18:50:01 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 18:50:01 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 18:50:01 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Hypervisor/Node resource view: name=user free_ram=7356MB free_disk=25.4827880859375GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75216) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 18:50:01 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:50:02 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-303c877f-9266-4652-b6d4-bec230f310a2 tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 18:50:02 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-303c877f-9266-4652-b6d4-bec230f310a2 tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 18:50:02 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-303c877f-9266-4652-b6d4-bec230f310a2 tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.403s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:50:02 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.350s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:50:02 user nova-compute[75216]: INFO nova.scheduler.client.report [None req-303c877f-9266-4652-b6d4-bec230f310a2 tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] Deleted allocations for instance ed251b5e-5f1d-404c-a09b-156e5ed72e82
Nov 13 18:50:02 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-303c877f-9266-4652-b6d4-bec230f310a2 tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] Lock "ed251b5e-5f1d-404c-a09b-156e5ed72e82" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.449s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:50:02 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance a1a3e849-6570-4820-97c8-75468b5bea4f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 18:50:02 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance d589d57e-de50-482a-843f-e8246b3d7528 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 18:50:02 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance 85624c58-6c72-4490-8a3e-547953295ade actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 18:50:02 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance 9b078f75-57f2-495a-abd5-f8adf72db80b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 18:50:02 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance 83fda249-9d28-4cc2-aeb0-103ce4f1faa4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 18:50:02 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance 64dfe522-8b46-4df4-8032-591ce56900ec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 18:50:02 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance 7c9d9c1b-6df5-41ff-a696-871e70d04e07 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 18:50:02 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance 3679beb0-5244-443a-8512-38b29ccb62f0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 18:50:02 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance e1350bc4-558a-40ac-91e5-96da24f154f5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 18:50:02 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance 91ea8a19-a365-484c-80c7-baf90e7dd1aa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 18:50:02 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance a3bcf65e-bd5b-4350-a222-5f4522418a67 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 13 18:50:02 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 18:50:02 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 18:50:02 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 18:50:02 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 18:50:02 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Compute_service record updated for user:user {{(pid=75216) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 18:50:02 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.601s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:50:03 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f288c605-8ce7-4a75-8799-b37af2c5fa5b tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] [instance: 64dfe522-8b46-4df4-8032-591ce56900ec] Calling os-brick to attach iSCSI Volume {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 18:50:03 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f288c605-8ce7-4a75-8799-b37af2c5fa5b tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3a8669e40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e31c9fc8-6279-4e4f-bb4a-eaf0e56ebcc5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fwHPSobK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 18:50:03 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-f288c605-8ce7-4a75-8799-b37af2c5fa5b tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 18:50:03 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-f288c605-8ce7-4a75-8799-b37af2c5fa5b tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 18:50:03 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-f288c605-8ce7-4a75-8799-b37af2c5fa5b tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 18:50:03 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-f288c605-8ce7-4a75-8799-b37af2c5fa5b tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 18:50:03 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-f288c605-8ce7-4a75-8799-b37af2c5fa5b tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e31c9fc8-6279-4e4f-bb4a-eaf0e56ebcc5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 18:50:03 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-f288c605-8ce7-4a75-8799-b37af2c5fa5b tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e31c9fc8-6279-4e4f-bb4a-eaf0e56ebcc5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 18:50:03 user nova-compute[75216]: INFO os_brick.initiator.connectors.iscsi [None req-f288c605-8ce7-4a75-8799-b37af2c5fa5b tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 18:50:03 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e31c9fc8-6279-4e4f-bb4a-eaf0e56ebcc5 -p 172.16.0.220:3260 {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:50:03 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e31c9fc8-6279-4e4f-bb4a-eaf0e56ebcc5 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:50:03 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca29ab07-04e9-4416-bd69-ad2a4f929d64]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:50:03 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f288c605-8ce7-4a75-8799-b37af2c5fa5b tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 18:50:03 user nova-compute[75216]:  {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:50:03 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e31c9fc8-6279-4e4f-bb4a-eaf0e56ebcc5 -p 172.16.0.220:3260 --interface default --op new {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:50:03 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e31c9fc8-6279-4e4f-bb4a-eaf0e56ebcc5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:50:03 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[13eff623-5b0f-4724-90a3-e74926419394]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e31c9fc8-6279-4e4f-bb4a-eaf0e56ebcc5] added\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:50:03 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f288c605-8ce7-4a75-8799-b37af2c5fa5b tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e31c9fc8-6279-4e4f-bb4a-eaf0e56ebcc5] added
Nov 13 18:50:03 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:50:03 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e31c9fc8-6279-4e4f-bb4a-eaf0e56ebcc5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:50:03 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e31c9fc8-6279-4e4f-bb4a-eaf0e56ebcc5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:50:03 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[64631be8-3a98-4bd2-b80f-b128015314cc]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:50:03 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f288c605-8ce7-4a75-8799-b37af2c5fa5b tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:50:03 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e31c9fc8-6279-4e4f-bb4a-eaf0e56ebcc5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:50:03 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e31c9fc8-6279-4e4f-bb4a-eaf0e56ebcc5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:50:03 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3155244-6faa-493b-be61-1e635c88f336]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:50:03 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f288c605-8ce7-4a75-8799-b37af2c5fa5b tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:50:03 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e31c9fc8-6279-4e4f-bb4a-eaf0e56ebcc5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fwHPSobK {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:50:03 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e31c9fc8-6279-4e4f-bb4a-eaf0e56ebcc5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fwHPSobK" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:50:03 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7f68567-bc31-4149-a1aa-f868c79b23a0]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:50:03 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f288c605-8ce7-4a75-8799-b37af2c5fa5b tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fwHPSobK'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:50:03 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e31c9fc8-6279-4e4f-bb4a-eaf0e56ebcc5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:50:03 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e31c9fc8-6279-4e4f-bb4a-eaf0e56ebcc5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.034s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:50:03 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e60cd64-2d05-498a-b6f5-dc959f217a07]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:50:03 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f288c605-8ce7-4a75-8799-b37af2c5fa5b tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:50:03 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:50:03 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:50:03 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[749b44f2-8be1-4e22-b914-0d6712b0bacb]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf4e9e60-f40d-49e0-8234-ae45c23b695b (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae66a157-b0d3-4501-a728-a010d6a83a10 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b04cdffb-340c-4caa-ab34-692031598bed (non-flash)\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:50:03 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f288c605-8ce7-4a75-8799-b37af2c5fa5b tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf4e9e60-f40d-49e0-8234-ae45c23b695b (non-flash)
Nov 13 18:50:03 user nova-compute[75216]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae66a157-b0d3-4501-a728-a010d6a83a10 (non-flash)
Nov 13 18:50:03 user nova-compute[75216]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b04cdffb-340c-4caa-ab34-692031598bed (non-flash)
Nov 13 18:50:03 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 18:50:03 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f288c605-8ce7-4a75-8799-b37af2c5fa5b tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf4e9e60-f40d-49e0-8234-ae45c23b695b (non-flash)
Nov 13 18:50:03 user nova-compute[75216]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae66a157-b0d3-4501-a728-a010d6a83a10 (non-flash)
Nov 13 18:50:03 user nova-compute[75216]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b04cdffb-340c-4caa-ab34-692031598bed (non-flash)
Nov 13 18:50:03 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 18:50:03 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e31c9fc8-6279-4e4f-bb4a-eaf0e56ebcc5 -p 172.16.0.220:3260 --login {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:50:03 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e31c9fc8-6279-4e4f-bb4a-eaf0e56ebcc5 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:50:03 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:50:03 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[ace4401c-21fa-432d-8e24-35ca88706e60]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e31c9fc8-6279-4e4f-bb4a-eaf0e56ebcc5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e31c9fc8-6279-4e4f-bb4a-eaf0e56ebcc5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:50:03 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f288c605-8ce7-4a75-8799-b37af2c5fa5b tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e31c9fc8-6279-4e4f-bb4a-eaf0e56ebcc5, portal: 172.16.0.220,3260]
Nov 13 18:50:03 user nova-compute[75216]: Login to [iface: default, target: iqn.2010-10.org.openstack:e31c9fc8-6279-4e4f-bb4a-eaf0e56ebcc5, portal: 172.16.0.220,3260] successful.
Nov 13 18:50:03 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:50:03 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e31c9fc8-6279-4e4f-bb4a-eaf0e56ebcc5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:50:03 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e31c9fc8-6279-4e4f-bb4a-eaf0e56ebcc5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:50:03 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[f06bcffa-e867-4f35-9d49-fbca85d1af97]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:50:03 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f288c605-8ce7-4a75-8799-b37af2c5fa5b tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:50:03 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:50:03 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:50:03 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[a53b8319-aeb6-49a9-a00d-7641b29cd44c]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf4e9e60-f40d-49e0-8234-ae45c23b695b (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae66a157-b0d3-4501-a728-a010d6a83a10 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b04cdffb-340c-4caa-ab34-692031598bed (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e31c9fc8-6279-4e4f-bb4a-eaf0e56ebcc5 (non-flash)\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:50:03 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f288c605-8ce7-4a75-8799-b37af2c5fa5b tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf4e9e60-f40d-49e0-8234-ae45c23b695b (non-flash)
Nov 13 18:50:03 user nova-compute[75216]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae66a157-b0d3-4501-a728-a010d6a83a10 (non-flash)
Nov 13 18:50:03 user nova-compute[75216]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b04cdffb-340c-4caa-ab34-692031598bed (non-flash)
Nov 13 18:50:03 user nova-compute[75216]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e31c9fc8-6279-4e4f-bb4a-eaf0e56ebcc5 (non-flash)
Nov 13 18:50:03 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 18:50:03 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f288c605-8ce7-4a75-8799-b37af2c5fa5b tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf4e9e60-f40d-49e0-8234-ae45c23b695b (non-flash)
Nov 13 18:50:03 user nova-compute[75216]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae66a157-b0d3-4501-a728-a010d6a83a10 (non-flash)
Nov 13 18:50:03 user nova-compute[75216]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b04cdffb-340c-4caa-ab34-692031598bed (non-flash)
Nov 13 18:50:03 user nova-compute[75216]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e31c9fc8-6279-4e4f-bb4a-eaf0e56ebcc5 (non-flash)
Nov 13 18:50:03 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 18:50:03 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-f288c605-8ce7-4a75-8799-b37af2c5fa5b tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e31c9fc8-6279-4e4f-bb4a-eaf0e56ebcc5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.325s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 18:50:03 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f288c605-8ce7-4a75-8799-b37af2c5fa5b tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] Connected to 172.16.0.220:3260 {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 18:50:03 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-f288c605-8ce7-4a75-8799-b37af2c5fa5b tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] HCTL ('35', '-', '-', 0) found on session 20 with lun 0 {{(pid=75216) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 18:50:03 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-f288c605-8ce7-4a75-8799-b37af2c5fa5b tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75216) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 18:50:03 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:50:03 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.021s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:50:03 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e38d494-3de4-4195-be85-ed422d084a9e]: (4, ('- - 0', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:50:03 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-f288c605-8ce7-4a75-8799-b37af2c5fa5b tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] Searching for a device in session 20 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75216) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 18:50:03 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f288c605-8ce7-4a75-8799-b37af2c5fa5b tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:e31c9fc8-6279-4e4f-bb4a-eaf0e56ebcc5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fwHPSobK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 18:50:04 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-f288c605-8ce7-4a75-8799-b37af2c5fa5b tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.361s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 18:50:04 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f288c605-8ce7-4a75-8799-b37af2c5fa5b tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] <== connect_volume: return (1363ms) {'type': 'block', 'scsi_wwn': '26566656233373539', 'path': '/dev/sdd'} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 18:50:04 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f288c605-8ce7-4a75-8799-b37af2c5fa5b tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] [instance: 64dfe522-8b46-4df4-8032-591ce56900ec] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26566656233373539', 'path': '/dev/sdd'} {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 18:50:04 user nova-compute[75216]: DEBUG nova.objects.instance [None req-f288c605-8ce7-4a75-8799-b37af2c5fa5b tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] Lazy-loading 'flavor' on Instance uuid 64dfe522-8b46-4df4-8032-591ce56900ec {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 18:50:04 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-f288c605-8ce7-4a75-8799-b37af2c5fa5b tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] attach device xml: <disk type="block" device="disk">
Nov 13 18:50:04 user nova-compute[75216]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 18:50:04 user nova-compute[75216]:   <source dev="/dev/sdd"/>
Nov 13 18:50:04 user nova-compute[75216]:   <target dev="vdb" bus="virtio"/>
Nov 13 18:50:04 user nova-compute[75216]:   <serial>e31c9fc8-6279-4e4f-bb4a-eaf0e56ebcc5</serial>
Nov 13 18:50:04 user nova-compute[75216]: </disk>
Nov 13 18:50:04 user nova-compute[75216]:  {{(pid=75216) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 13 18:50:04 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-f288c605-8ce7-4a75-8799-b37af2c5fa5b tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 18:50:04 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-f288c605-8ce7-4a75-8799-b37af2c5fa5b tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] No BDM found with device name hda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 18:50:04 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-f288c605-8ce7-4a75-8799-b37af2c5fa5b tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] No VIF found with MAC fa:16:3e:a1:6b:92, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 18:50:04 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c8458832-c371-4d8e-8bf8-a01fd58cec57 tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:50:04 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c8458832-c371-4d8e-8bf8-a01fd58cec57 tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:50:04 user nova-compute[75216]: DEBUG nova.objects.instance [None req-c8458832-c371-4d8e-8bf8-a01fd58cec57 tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] Lazy-loading 'pci_requests' on Instance uuid a3bcf65e-bd5b-4350-a222-5f4522418a67 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 18:50:04 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:50:04 user nova-compute[75216]: DEBUG nova.objects.instance [None req-c8458832-c371-4d8e-8bf8-a01fd58cec57 tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] Lazy-loading 'numa_topology' on Instance uuid a3bcf65e-bd5b-4350-a222-5f4522418a67 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 18:50:05 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-c8458832-c371-4d8e-8bf8-a01fd58cec57 tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75216) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 18:50:05 user nova-compute[75216]: INFO nova.compute.claims [None req-c8458832-c371-4d8e-8bf8-a01fd58cec57 tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] [instance: a3bcf65e-bd5b-4350-a222-5f4522418a67] Claim successful on node user
Nov 13 18:50:05 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f288c605-8ce7-4a75-8799-b37af2c5fa5b tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] Lock "64dfe522-8b46-4df4-8032-591ce56900ec" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.709s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:50:05 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-c8458832-c371-4d8e-8bf8-a01fd58cec57 tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 18:50:05 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-c8458832-c371-4d8e-8bf8-a01fd58cec57 tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 18:50:05 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c8458832-c371-4d8e-8bf8-a01fd58cec57 tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.504s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:50:05 user nova-compute[75216]: INFO nova.network.neutron [None req-c8458832-c371-4d8e-8bf8-a01fd58cec57 tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] [instance: a3bcf65e-bd5b-4350-a222-5f4522418a67] Updating port c4ac5376-d559-4365-b2ce-d827fecd2d1a with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 13 18:50:06 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c8458832-c371-4d8e-8bf8-a01fd58cec57 tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] Acquiring lock "refresh_cache-a3bcf65e-bd5b-4350-a222-5f4522418a67" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 18:50:06 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c8458832-c371-4d8e-8bf8-a01fd58cec57 tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] Acquired lock "refresh_cache-a3bcf65e-bd5b-4350-a222-5f4522418a67" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 18:50:06 user nova-compute[75216]: DEBUG nova.network.neutron [None req-c8458832-c371-4d8e-8bf8-a01fd58cec57 tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] [instance: a3bcf65e-bd5b-4350-a222-5f4522418a67] Building network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 18:50:06 user nova-compute[75216]: DEBUG nova.compute.manager [req-b3ab2538-746a-47c0-910e-1a1726dc72de req-6b7f79b3-8e8f-41bc-9e92-e25d9c385cf9 service nova] [instance: a3bcf65e-bd5b-4350-a222-5f4522418a67] Received event network-changed-c4ac5376-d559-4365-b2ce-d827fecd2d1a {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:50:06 user nova-compute[75216]: DEBUG nova.compute.manager [req-b3ab2538-746a-47c0-910e-1a1726dc72de req-6b7f79b3-8e8f-41bc-9e92-e25d9c385cf9 service nova] [instance: a3bcf65e-bd5b-4350-a222-5f4522418a67] Refreshing instance network info cache due to event network-changed-c4ac5376-d559-4365-b2ce-d827fecd2d1a. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 18:50:06 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-b3ab2538-746a-47c0-910e-1a1726dc72de req-6b7f79b3-8e8f-41bc-9e92-e25d9c385cf9 service nova] Acquiring lock "refresh_cache-a3bcf65e-bd5b-4350-a222-5f4522418a67" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 18:50:06 user nova-compute[75216]: DEBUG nova.network.neutron [None req-c8458832-c371-4d8e-8bf8-a01fd58cec57 tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] [instance: a3bcf65e-bd5b-4350-a222-5f4522418a67] Updating instance_info_cache with network_info: [{"id": "c4ac5376-d559-4365-b2ce-d827fecd2d1a", "address": "fa:16:3e:f7:06:79", "network": {"id": "4f264ec8-b112-4549-aa16-029824a0fcb4", "bridge": "br-int", "label": "tempest-TestShelveInstance-1108623968-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2601440dcec64a86a539dbdddafc7a5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4ac5376-d5", "ovs_interfaceid": "c4ac5376-d559-4365-b2ce-d827fecd2d1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 18:50:06 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c8458832-c371-4d8e-8bf8-a01fd58cec57 tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] Releasing lock "refresh_cache-a3bcf65e-bd5b-4350-a222-5f4522418a67" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 18:50:06 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-c8458832-c371-4d8e-8bf8-a01fd58cec57 tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] [instance: a3bcf65e-bd5b-4350-a222-5f4522418a67] Creating instance directory {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 18:50:06 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-c8458832-c371-4d8e-8bf8-a01fd58cec57 tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] [instance: a3bcf65e-bd5b-4350-a222-5f4522418a67] Creating image(s)
Nov 13 18:50:06 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-c8458832-c371-4d8e-8bf8-a01fd58cec57 tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] [instance: a3bcf65e-bd5b-4350-a222-5f4522418a67] Did not create local disks {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 13 18:50:06 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-c8458832-c371-4d8e-8bf8-a01fd58cec57 tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] [instance: a3bcf65e-bd5b-4350-a222-5f4522418a67] Ensure instance console log exists: /opt/stack/data/nova/instances/a3bcf65e-bd5b-4350-a222-5f4522418a67/console.log {{(pid=75216) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 18:50:06 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c8458832-c371-4d8e-8bf8-a01fd58cec57 tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:50:06 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c8458832-c371-4d8e-8bf8-a01fd58cec57 tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:50:06 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c8458832-c371-4d8e-8bf8-a01fd58cec57 tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:50:06 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-c8458832-c371-4d8e-8bf8-a01fd58cec57 tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] [instance: a3bcf65e-bd5b-4350-a222-5f4522418a67] Start _get_guest_xml network_info=[{"id": "c4ac5376-d559-4365-b2ce-d827fecd2d1a", "address": "fa:16:3e:f7:06:79", "network": {"id": "4f264ec8-b112-4549-aa16-029824a0fcb4", "bridge": "br-int", "label": "tempest-TestShelveInstance-1108623968-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2601440dcec64a86a539dbdddafc7a5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4ac5376-d5", "ovs_interfaceid": "c4ac5376-d559-4365-b2ce-d827fecd2d1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OGxHvBQW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a3bcf65e-bd5b-4350-a222-5f4522418a67', 'attached_at': '', 'detached_at': '', 'volume_id': '84c721c0-dd26-494a-a193-5b302250edac', 'serial': '84c721c0-dd26-494a-a193-5b302250edac'}, 'attachment_id': 'bdadceb9-0d80-49f5-b81f-317dd4b343f0', 'guest_format': None, 'mount_device': '/dev/vda', 'delete_on_termination': True, 'boot_index': 0, 'volume_type': None} {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 18:50:06 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-b3ab2538-746a-47c0-910e-1a1726dc72de req-6b7f79b3-8e8f-41bc-9e92-e25d9c385cf9 service nova] Acquired lock "refresh_cache-a3bcf65e-bd5b-4350-a222-5f4522418a67" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 18:50:06 user nova-compute[75216]: DEBUG nova.network.neutron [req-b3ab2538-746a-47c0-910e-1a1726dc72de req-6b7f79b3-8e8f-41bc-9e92-e25d9c385cf9 service nova] [instance: a3bcf65e-bd5b-4350-a222-5f4522418a67] Refreshing network info cache for port c4ac5376-d559-4365-b2ce-d827fecd2d1a {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 18:50:06 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-c8458832-c371-4d8e-8bf8-a01fd58cec57 tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 18:50:06 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-c8458832-c371-4d8e-8bf8-a01fd58cec57 tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 18:50:06 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-c8458832-c371-4d8e-8bf8-a01fd58cec57 tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 18:50:06 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-c8458832-c371-4d8e-8bf8-a01fd58cec57 tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] CPU controller missing on host. {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 18:50:06 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-c8458832-c371-4d8e-8bf8-a01fd58cec57 tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 18:50:06 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-c8458832-c371-4d8e-8bf8-a01fd58cec57 tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] CPU controller found on host. {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 18:50:06 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-c8458832-c371-4d8e-8bf8-a01fd58cec57 tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75216) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 18:50:06 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-c8458832-c371-4d8e-8bf8-a01fd58cec57 tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T18:40:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 18:50:06 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-c8458832-c371-4d8e-8bf8-a01fd58cec57 tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] Flavor limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 18:50:06 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-c8458832-c371-4d8e-8bf8-a01fd58cec57 tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] Image limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 18:50:06 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-c8458832-c371-4d8e-8bf8-a01fd58cec57 tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] Flavor pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 18:50:06 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-c8458832-c371-4d8e-8bf8-a01fd58cec57 tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] Image pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 18:50:06 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-c8458832-c371-4d8e-8bf8-a01fd58cec57 tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 18:50:06 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-c8458832-c371-4d8e-8bf8-a01fd58cec57 tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 18:50:06 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-c8458832-c371-4d8e-8bf8-a01fd58cec57 tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 18:50:06 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-c8458832-c371-4d8e-8bf8-a01fd58cec57 tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] Got 1 possible topologies {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 18:50:06 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-c8458832-c371-4d8e-8bf8-a01fd58cec57 tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 18:50:06 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-c8458832-c371-4d8e-8bf8-a01fd58cec57 tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 18:50:06 user nova-compute[75216]: DEBUG nova.objects.instance [None req-c8458832-c371-4d8e-8bf8-a01fd58cec57 tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] Lazy-loading 'vcpu_model' on Instance uuid a3bcf65e-bd5b-4350-a222-5f4522418a67 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 18:50:06 user nova-compute[75216]: DEBUG nova.objects.base [None req-c8458832-c371-4d8e-8bf8-a01fd58cec57 tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] Object Instance<a3bcf65e-bd5b-4350-a222-5f4522418a67> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=75216) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 18:50:07 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c8458832-c371-4d8e-8bf8-a01fd58cec57 tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] [instance: a3bcf65e-bd5b-4350-a222-5f4522418a67] Calling os-brick to attach iSCSI Volume {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 18:50:07 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8458832-c371-4d8e-8bf8-a01fd58cec57 tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3a8669e40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OGxHvBQW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 18:50:07 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-c8458832-c371-4d8e-8bf8-a01fd58cec57 tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 18:50:07 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-c8458832-c371-4d8e-8bf8-a01fd58cec57 tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 18:50:07 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-c8458832-c371-4d8e-8bf8-a01fd58cec57 tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 18:50:07 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-c8458832-c371-4d8e-8bf8-a01fd58cec57 tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 18:50:07 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-c8458832-c371-4d8e-8bf8-a01fd58cec57 tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 18:50:07 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-c8458832-c371-4d8e-8bf8-a01fd58cec57 tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 18:50:07 user nova-compute[75216]: INFO os_brick.initiator.connectors.iscsi [None req-c8458832-c371-4d8e-8bf8-a01fd58cec57 tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 18:50:07 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-3ee340b5-a0aa-4d7b-8f41-e8d6f063aca1 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] Acquiring lock "64dfe522-8b46-4df4-8032-591ce56900ec" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:50:07 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-3ee340b5-a0aa-4d7b-8f41-e8d6f063aca1 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] Lock "64dfe522-8b46-4df4-8032-591ce56900ec" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:50:07 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac -p 172.16.0.220:3260 {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:50:07 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:50:07 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[17faf880-9c58-49d2-9f29-103b9a0b75b6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:50:07 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8458832-c371-4d8e-8bf8-a01fd58cec57 tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 18:50:07 user nova-compute[75216]:  {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:50:07 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac -p 172.16.0.220:3260 --interface default --op new {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:50:07 user nova-compute[75216]: INFO nova.compute.manager [None req-3ee340b5-a0aa-4d7b-8f41-e8d6f063aca1 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] [instance: 64dfe522-8b46-4df4-8032-591ce56900ec] Detaching volume e31c9fc8-6279-4e4f-bb4a-eaf0e56ebcc5
Nov 13 18:50:07 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:50:07 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ed53ea2-af10-43fa-be45-2170cfeb7d6e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac] added\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:50:07 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8458832-c371-4d8e-8bf8-a01fd58cec57 tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac] added
Nov 13 18:50:07 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:50:07 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:50:07 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:50:07 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[d785af60-941f-4b35-afee-3044ecaaa97d]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:50:07 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8458832-c371-4d8e-8bf8-a01fd58cec57 tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:50:07 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:50:07 user nova-compute[75216]: INFO nova.virt.block_device [None req-3ee340b5-a0aa-4d7b-8f41-e8d6f063aca1 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] [instance: 64dfe522-8b46-4df4-8032-591ce56900ec] Attempting to driver detach volume e31c9fc8-6279-4e4f-bb4a-eaf0e56ebcc5 from mountpoint /dev/vdb
Nov 13 18:50:07 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:50:07 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2050283-5afa-43ff-8829-bf29368bdcac]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:50:07 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8458832-c371-4d8e-8bf8-a01fd58cec57 tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:50:07 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OGxHvBQW {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:50:07 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-3ee340b5-a0aa-4d7b-8f41-e8d6f063aca1 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] Attempting to detach device vdb from instance 64dfe522-8b46-4df4-8032-591ce56900ec from the persistent domain config. {{(pid=75216) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 13 18:50:07 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-3ee340b5-a0aa-4d7b-8f41-e8d6f063aca1 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 18:50:07 user nova-compute[75216]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 18:50:07 user nova-compute[75216]:   <source dev="/dev/sdd"/>
Nov 13 18:50:07 user nova-compute[75216]:   <target dev="vdb" bus="virtio"/>
Nov 13 18:50:07 user nova-compute[75216]:   <serial>e31c9fc8-6279-4e4f-bb4a-eaf0e56ebcc5</serial>
Nov 13 18:50:07 user nova-compute[75216]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 13 18:50:07 user nova-compute[75216]: </disk>
Nov 13 18:50:07 user nova-compute[75216]:  {{(pid=75216) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 18:50:07 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-3ee340b5-a0aa-4d7b-8f41-e8d6f063aca1 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] Successfully detached device vdb from instance 64dfe522-8b46-4df4-8032-591ce56900ec from the persistent domain config.
Nov 13 18:50:07 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-3ee340b5-a0aa-4d7b-8f41-e8d6f063aca1 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 64dfe522-8b46-4df4-8032-591ce56900ec from the live domain config. {{(pid=75216) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 13 18:50:07 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-3ee340b5-a0aa-4d7b-8f41-e8d6f063aca1 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 18:50:07 user nova-compute[75216]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 18:50:07 user nova-compute[75216]:   <source dev="/dev/sdd"/>
Nov 13 18:50:07 user nova-compute[75216]:   <target dev="vdb" bus="virtio"/>
Nov 13 18:50:07 user nova-compute[75216]:   <serial>e31c9fc8-6279-4e4f-bb4a-eaf0e56ebcc5</serial>
Nov 13 18:50:07 user nova-compute[75216]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 13 18:50:07 user nova-compute[75216]: </disk>
Nov 13 18:50:07 user nova-compute[75216]:  {{(pid=75216) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 18:50:07 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OGxHvBQW" returned: 0 in 0.021s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:50:07 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd16c2e1-6f9c-4668-ac28-c9aa3e5269d4]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:50:07 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8458832-c371-4d8e-8bf8-a01fd58cec57 tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OGxHvBQW'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:50:07 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:50:07 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.035s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:50:07 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c1a6ee7-43a5-4ff4-a954-4c7e077e4a48]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:50:07 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8458832-c371-4d8e-8bf8-a01fd58cec57 tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:50:07 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:50:07 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:50:07 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec72393f-d575-46fa-8de4-ceac2ba782e3]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf4e9e60-f40d-49e0-8234-ae45c23b695b (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae66a157-b0d3-4501-a728-a010d6a83a10 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e31c9fc8-6279-4e4f-bb4a-eaf0e56ebcc5 (non-flash)\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:50:07 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8458832-c371-4d8e-8bf8-a01fd58cec57 tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf4e9e60-f40d-49e0-8234-ae45c23b695b (non-flash)
Nov 13 18:50:07 user nova-compute[75216]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae66a157-b0d3-4501-a728-a010d6a83a10 (non-flash)
Nov 13 18:50:07 user nova-compute[75216]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e31c9fc8-6279-4e4f-bb4a-eaf0e56ebcc5 (non-flash)
Nov 13 18:50:07 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 18:50:07 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8458832-c371-4d8e-8bf8-a01fd58cec57 tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf4e9e60-f40d-49e0-8234-ae45c23b695b (non-flash)
Nov 13 18:50:07 user nova-compute[75216]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae66a157-b0d3-4501-a728-a010d6a83a10 (non-flash)
Nov 13 18:50:07 user nova-compute[75216]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e31c9fc8-6279-4e4f-bb4a-eaf0e56ebcc5 (non-flash)
Nov 13 18:50:07 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 18:50:07 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac -p 172.16.0.220:3260 --login {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:50:07 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:50:07 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[d47bf625-14cc-4668-9436-d6f86f44ceff]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:50:07 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8458832-c371-4d8e-8bf8-a01fd58cec57 tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac, portal: 172.16.0.220,3260]
Nov 13 18:50:07 user nova-compute[75216]: Login to [iface: default, target: iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac, portal: 172.16.0.220,3260] successful.
Nov 13 18:50:07 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:50:07 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:50:07 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:50:07 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[059651f1-9c34-4c21-b028-fd04a1a99e36]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:50:07 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8458832-c371-4d8e-8bf8-a01fd58cec57 tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:50:07 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:50:07 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:50:07 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f8f0bec-0d4e-4abd-9369-d7fcfa8e0b58]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf4e9e60-f40d-49e0-8234-ae45c23b695b (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae66a157-b0d3-4501-a728-a010d6a83a10 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e31c9fc8-6279-4e4f-bb4a-eaf0e56ebcc5 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac (non-flash)\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:50:07 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8458832-c371-4d8e-8bf8-a01fd58cec57 tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf4e9e60-f40d-49e0-8234-ae45c23b695b (non-flash)
Nov 13 18:50:07 user nova-compute[75216]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae66a157-b0d3-4501-a728-a010d6a83a10 (non-flash)
Nov 13 18:50:07 user nova-compute[75216]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e31c9fc8-6279-4e4f-bb4a-eaf0e56ebcc5 (non-flash)
Nov 13 18:50:07 user nova-compute[75216]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac (non-flash)
Nov 13 18:50:07 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 18:50:07 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8458832-c371-4d8e-8bf8-a01fd58cec57 tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf4e9e60-f40d-49e0-8234-ae45c23b695b (non-flash)
Nov 13 18:50:07 user nova-compute[75216]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae66a157-b0d3-4501-a728-a010d6a83a10 (non-flash)
Nov 13 18:50:07 user nova-compute[75216]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e31c9fc8-6279-4e4f-bb4a-eaf0e56ebcc5 (non-flash)
Nov 13 18:50:07 user nova-compute[75216]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac (non-flash)
Nov 13 18:50:07 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 18:50:07 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-c8458832-c371-4d8e-8bf8-a01fd58cec57 tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.322s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 18:50:07 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8458832-c371-4d8e-8bf8-a01fd58cec57 tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] Connected to 172.16.0.220:3260 {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 18:50:07 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-c8458832-c371-4d8e-8bf8-a01fd58cec57 tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] HCTL ('36', '-', '-', 0) found on session 21 with lun 0 {{(pid=75216) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 18:50:07 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-c8458832-c371-4d8e-8bf8-a01fd58cec57 tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75216) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 18:50:07 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:50:07 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.021s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:50:07 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[73f94d1a-7e8a-46a0-9ed1-8f9bdfd82d92]: (4, ('- - 0', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:50:07 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-c8458832-c371-4d8e-8bf8-a01fd58cec57 tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] Searching for a device in session 21 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75216) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 18:50:07 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8458832-c371-4d8e-8bf8-a01fd58cec57 tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OGxHvBQW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 18:50:07 user nova-compute[75216]: DEBUG nova.network.neutron [req-b3ab2538-746a-47c0-910e-1a1726dc72de req-6b7f79b3-8e8f-41bc-9e92-e25d9c385cf9 service nova] [instance: a3bcf65e-bd5b-4350-a222-5f4522418a67] Updated VIF entry in instance network info cache for port c4ac5376-d559-4365-b2ce-d827fecd2d1a. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 18:50:07 user nova-compute[75216]: DEBUG nova.network.neutron [req-b3ab2538-746a-47c0-910e-1a1726dc72de req-6b7f79b3-8e8f-41bc-9e92-e25d9c385cf9 service nova] [instance: a3bcf65e-bd5b-4350-a222-5f4522418a67] Updating instance_info_cache with network_info: [{"id": "c4ac5376-d559-4365-b2ce-d827fecd2d1a", "address": "fa:16:3e:f7:06:79", "network": {"id": "4f264ec8-b112-4549-aa16-029824a0fcb4", "bridge": "br-int", "label": "tempest-TestShelveInstance-1108623968-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2601440dcec64a86a539dbdddafc7a5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4ac5376-d5", "ovs_interfaceid": "c4ac5376-d559-4365-b2ce-d827fecd2d1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 18:50:07 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-b3ab2538-746a-47c0-910e-1a1726dc72de req-6b7f79b3-8e8f-41bc-9e92-e25d9c385cf9 service nova] Releasing lock "refresh_cache-a3bcf65e-bd5b-4350-a222-5f4522418a67" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 18:50:07 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-3ee340b5-a0aa-4d7b-8f41-e8d6f063aca1 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 64dfe522-8b46-4df4-8032-591ce56900ec {{(pid=75216) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 13 18:50:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:50:08 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-c8458832-c371-4d8e-8bf8-a01fd58cec57 tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.361s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 18:50:08 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8458832-c371-4d8e-8bf8-a01fd58cec57 tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] <== connect_volume: return (1363ms) {'type': 'block', 'scsi_wwn': '23632343936363665', 'path': '/dev/sde'} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 18:50:08 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c8458832-c371-4d8e-8bf8-a01fd58cec57 tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] [instance: a3bcf65e-bd5b-4350-a222-5f4522418a67] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23632343936363665', 'path': '/dev/sde'} {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 18:50:08 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-c8458832-c371-4d8e-8bf8-a01fd58cec57 tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-13T18:46:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-87869039',display_name='tempest-TestShelveInstance-server-87869039',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-87869039',id=12,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-2022745159',keypairs=<?>,launch_index=0,launched_at=2023-11-13T18:46:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='2601440dcec64a86a539dbdddafc7a5d',ramdisk_id='',reservation_id='r-x2eeit0j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-55051446',owner_user_name='tempest-TestShelveInstance-55051446-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T18:49:59Z,user_data=None,user_id='59c263be93a143c3878bec0c4ae626af',uuid=a3bcf65e-bd5b-4350-a222-5f4522418a67,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "c4ac5376-d559-4365-b2ce-d827fecd2d1a", "address": "fa:16:3e:f7:06:79", "network": {"id": "4f264ec8-b112-4549-aa16-029824a0fcb4", "bridge": "br-int", "label": "tempest-TestShelveInstance-1108623968-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2601440dcec64a86a539dbdddafc7a5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4ac5376-d5", "ovs_interfaceid": "c4ac5376-d559-4365-b2ce-d827fecd2d1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75216) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 18:50:08 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-c8458832-c371-4d8e-8bf8-a01fd58cec57 tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] Converting VIF {"id": "c4ac5376-d559-4365-b2ce-d827fecd2d1a", "address": "fa:16:3e:f7:06:79", "network": {"id": "4f264ec8-b112-4549-aa16-029824a0fcb4", "bridge": "br-int", "label": "tempest-TestShelveInstance-1108623968-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2601440dcec64a86a539dbdddafc7a5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4ac5376-d5", "ovs_interfaceid": "c4ac5376-d559-4365-b2ce-d827fecd2d1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 18:50:08 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-c8458832-c371-4d8e-8bf8-a01fd58cec57 tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:06:79,bridge_name='br-int',has_traffic_filtering=True,id=c4ac5376-d559-4365-b2ce-d827fecd2d1a,network=Network(4f264ec8-b112-4549-aa16-029824a0fcb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4ac5376-d5') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 18:50:08 user nova-compute[75216]: DEBUG nova.objects.instance [None req-c8458832-c371-4d8e-8bf8-a01fd58cec57 tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] Lazy-loading 'pci_devices' on Instance uuid a3bcf65e-bd5b-4350-a222-5f4522418a67 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 18:50:08 user nova-compute[75216]: DEBUG nova.objects.base [None req-c8458832-c371-4d8e-8bf8-a01fd58cec57 tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] Object Instance<a3bcf65e-bd5b-4350-a222-5f4522418a67> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=75216) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 18:50:08 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-c8458832-c371-4d8e-8bf8-a01fd58cec57 tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] [instance: a3bcf65e-bd5b-4350-a222-5f4522418a67] End _get_guest_xml xml=<domain type="kvm">
Nov 13 18:50:08 user nova-compute[75216]:   <uuid>a3bcf65e-bd5b-4350-a222-5f4522418a67</uuid>
Nov 13 18:50:08 user nova-compute[75216]:   <name>instance-0000000c</name>
Nov 13 18:50:08 user nova-compute[75216]:   <memory>524288</memory>
Nov 13 18:50:08 user nova-compute[75216]:   <vcpu>1</vcpu>
Nov 13 18:50:08 user nova-compute[75216]:   <metadata>
Nov 13 18:50:08 user nova-compute[75216]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 18:50:08 user nova-compute[75216]:       <nova:package version="0.0.0"/>
Nov 13 18:50:08 user nova-compute[75216]:       <nova:name>tempest-TestShelveInstance-server-87869039</nova:name>
Nov 13 18:50:08 user nova-compute[75216]:       <nova:creationTime>2023-11-13 18:50:06</nova:creationTime>
Nov 13 18:50:08 user nova-compute[75216]:       <nova:flavor name="m1.tiny">
Nov 13 18:50:08 user nova-compute[75216]:         <nova:memory>512</nova:memory>
Nov 13 18:50:08 user nova-compute[75216]:         <nova:disk>1</nova:disk>
Nov 13 18:50:08 user nova-compute[75216]:         <nova:swap>0</nova:swap>
Nov 13 18:50:08 user nova-compute[75216]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 18:50:08 user nova-compute[75216]:         <nova:vcpus>1</nova:vcpus>
Nov 13 18:50:08 user nova-compute[75216]:       </nova:flavor>
Nov 13 18:50:08 user nova-compute[75216]:       <nova:owner>
Nov 13 18:50:08 user nova-compute[75216]:         <nova:user uuid="59c263be93a143c3878bec0c4ae626af">tempest-TestShelveInstance-55051446-project-member</nova:user>
Nov 13 18:50:08 user nova-compute[75216]:         <nova:project uuid="2601440dcec64a86a539dbdddafc7a5d">tempest-TestShelveInstance-55051446</nova:project>
Nov 13 18:50:08 user nova-compute[75216]:       </nova:owner>
Nov 13 18:50:08 user nova-compute[75216]:       <nova:ports>
Nov 13 18:50:08 user nova-compute[75216]:         <nova:port uuid="c4ac5376-d559-4365-b2ce-d827fecd2d1a">
Nov 13 18:50:08 user nova-compute[75216]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 13 18:50:08 user nova-compute[75216]:         </nova:port>
Nov 13 18:50:08 user nova-compute[75216]:       </nova:ports>
Nov 13 18:50:08 user nova-compute[75216]:     </nova:instance>
Nov 13 18:50:08 user nova-compute[75216]:   </metadata>
Nov 13 18:50:08 user nova-compute[75216]:   <sysinfo type="smbios">
Nov 13 18:50:08 user nova-compute[75216]:     <system>
Nov 13 18:50:08 user nova-compute[75216]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 18:50:08 user nova-compute[75216]:       <entry name="product">OpenStack Nova</entry>
Nov 13 18:50:08 user nova-compute[75216]:       <entry name="version">0.0.0</entry>
Nov 13 18:50:08 user nova-compute[75216]:       <entry name="serial">a3bcf65e-bd5b-4350-a222-5f4522418a67</entry>
Nov 13 18:50:08 user nova-compute[75216]:       <entry name="uuid">a3bcf65e-bd5b-4350-a222-5f4522418a67</entry>
Nov 13 18:50:08 user nova-compute[75216]:       <entry name="family">Virtual Machine</entry>
Nov 13 18:50:08 user nova-compute[75216]:     </system>
Nov 13 18:50:08 user nova-compute[75216]:   </sysinfo>
Nov 13 18:50:08 user nova-compute[75216]:   <os>
Nov 13 18:50:08 user nova-compute[75216]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 18:50:08 user nova-compute[75216]:     <boot dev="hd"/>
Nov 13 18:50:08 user nova-compute[75216]:     <smbios mode="sysinfo"/>
Nov 13 18:50:08 user nova-compute[75216]:   </os>
Nov 13 18:50:08 user nova-compute[75216]:   <features>
Nov 13 18:50:08 user nova-compute[75216]:     <acpi/>
Nov 13 18:50:08 user nova-compute[75216]:     <apic/>
Nov 13 18:50:08 user nova-compute[75216]:     <vmcoreinfo/>
Nov 13 18:50:08 user nova-compute[75216]:   </features>
Nov 13 18:50:08 user nova-compute[75216]:   <clock offset="utc">
Nov 13 18:50:08 user nova-compute[75216]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 18:50:08 user nova-compute[75216]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 18:50:08 user nova-compute[75216]:     <timer name="hpet" present="no"/>
Nov 13 18:50:08 user nova-compute[75216]:   </clock>
Nov 13 18:50:08 user nova-compute[75216]:   <cpu mode="custom" match="exact">
Nov 13 18:50:08 user nova-compute[75216]:     <model>Nehalem</model>
Nov 13 18:50:08 user nova-compute[75216]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 18:50:08 user nova-compute[75216]:   </cpu>
Nov 13 18:50:08 user nova-compute[75216]:   <devices>
Nov 13 18:50:08 user nova-compute[75216]:     <disk type="block" device="disk">
Nov 13 18:50:08 user nova-compute[75216]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 18:50:08 user nova-compute[75216]:       <source dev="/dev/sde"/>
Nov 13 18:50:08 user nova-compute[75216]:       <target dev="vda" bus="virtio"/>
Nov 13 18:50:08 user nova-compute[75216]:       <serial>84c721c0-dd26-494a-a193-5b302250edac</serial>
Nov 13 18:50:08 user nova-compute[75216]:     </disk>
Nov 13 18:50:08 user nova-compute[75216]:     <interface type="ethernet">
Nov 13 18:50:08 user nova-compute[75216]:       <mac address="fa:16:3e:f7:06:79"/>
Nov 13 18:50:08 user nova-compute[75216]:       <model type="virtio"/>
Nov 13 18:50:08 user nova-compute[75216]:       <mtu size="1442"/>
Nov 13 18:50:08 user nova-compute[75216]:       <target dev="tapc4ac5376-d5"/>
Nov 13 18:50:08 user nova-compute[75216]:     </interface>
Nov 13 18:50:08 user nova-compute[75216]:     <serial type="pty">
Nov 13 18:50:08 user nova-compute[75216]:       <log file="/opt/stack/data/nova/instances/a3bcf65e-bd5b-4350-a222-5f4522418a67/console.log" append="off"/>
Nov 13 18:50:08 user nova-compute[75216]:     </serial>
Nov 13 18:50:08 user nova-compute[75216]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 18:50:08 user nova-compute[75216]:     <video>
Nov 13 18:50:08 user nova-compute[75216]:       <model type="virtio"/>
Nov 13 18:50:08 user nova-compute[75216]:     </video>
Nov 13 18:50:08 user nova-compute[75216]:     <rng model="virtio">
Nov 13 18:50:08 user nova-compute[75216]:       <backend model="random">/dev/urandom</backend>
Nov 13 18:50:08 user nova-compute[75216]:     </rng>
Nov 13 18:50:08 user nova-compute[75216]:     <controller type="usb" index="0" model="none"/>
Nov 13 18:50:08 user nova-compute[75216]:     <memballoon model="virtio">
Nov 13 18:50:08 user nova-compute[75216]:       <stats period="10"/>
Nov 13 18:50:08 user nova-compute[75216]:     </memballoon>
Nov 13 18:50:08 user nova-compute[75216]:   </devices>
Nov 13 18:50:08 user nova-compute[75216]: </domain>
Nov 13 18:50:08 user nova-compute[75216]:  {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 18:50:08 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-c8458832-c371-4d8e-8bf8-a01fd58cec57 tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-13T18:46:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-87869039',display_name='tempest-TestShelveInstance-server-87869039',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-87869039',id=12,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-2022745159',keypairs=<?>,launch_index=0,launched_at=2023-11-13T18:46:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='2601440dcec64a86a539dbdddafc7a5d',ramdisk_id='',reservation_id='r-x2eeit0j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-55051446',owner_user_name='tempest-TestShelveInstance-55051446-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T18:49:59Z,user_data=None,user_id='59c263be93a143c3878bec0c4ae626af',uuid=a3bcf65e-bd5b-4350-a222-5f4522418a67,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "c4ac5376-d559-4365-b2ce-d827fecd2d1a", "address": "fa:16:3e:f7:06:79", "network": {"id": "4f264ec8-b112-4549-aa16-029824a0fcb4", "bridge": "br-int", "label": "tempest-TestShelveInstance-1108623968-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2601440dcec64a86a539dbdddafc7a5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4ac5376-d5", "ovs_interfaceid": "c4ac5376-d559-4365-b2ce-d827fecd2d1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 18:50:08 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-c8458832-c371-4d8e-8bf8-a01fd58cec57 tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] Converting VIF {"id": "c4ac5376-d559-4365-b2ce-d827fecd2d1a", "address": "fa:16:3e:f7:06:79", "network": {"id": "4f264ec8-b112-4549-aa16-029824a0fcb4", "bridge": "br-int", "label": "tempest-TestShelveInstance-1108623968-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2601440dcec64a86a539dbdddafc7a5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4ac5376-d5", "ovs_interfaceid": "c4ac5376-d559-4365-b2ce-d827fecd2d1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 18:50:08 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-c8458832-c371-4d8e-8bf8-a01fd58cec57 tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:06:79,bridge_name='br-int',has_traffic_filtering=True,id=c4ac5376-d559-4365-b2ce-d827fecd2d1a,network=Network(4f264ec8-b112-4549-aa16-029824a0fcb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4ac5376-d5') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 18:50:08 user nova-compute[75216]: DEBUG os_vif [None req-c8458832-c371-4d8e-8bf8-a01fd58cec57 tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:06:79,bridge_name='br-int',has_traffic_filtering=True,id=c4ac5376-d559-4365-b2ce-d827fecd2d1a,network=Network(4f264ec8-b112-4549-aa16-029824a0fcb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4ac5376-d5') {{(pid=75216) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 18:50:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:50:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:50:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 18:50:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:50:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b686b00d-0d44-5961-b5c7-a3ff7421f5c3', '_type': 'linux-noop'}}, row=False) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:50:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:50:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:50:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:50:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc4ac5376-d5, may_exist=True, interface_attrs={}) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:50:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc4ac5376-d5, col_values=(('qos', UUID('846b5fe9-968f-430e-8293-1d7e36bd9f0b')),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:50:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc4ac5376-d5, col_values=(('external_ids', {'iface-id': 'c4ac5376-d559-4365-b2ce-d827fecd2d1a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f7:06:79', 'vm-uuid': 'a3bcf65e-bd5b-4350-a222-5f4522418a67'}),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:50:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:50:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:50:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:50:08 user nova-compute[75216]: INFO os_vif [None req-c8458832-c371-4d8e-8bf8-a01fd58cec57 tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:06:79,bridge_name='br-int',has_traffic_filtering=True,id=c4ac5376-d559-4365-b2ce-d827fecd2d1a,network=Network(4f264ec8-b112-4549-aa16-029824a0fcb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4ac5376-d5')
Nov 13 18:50:08 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-c8458832-c371-4d8e-8bf8-a01fd58cec57 tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 18:50:08 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-c8458832-c371-4d8e-8bf8-a01fd58cec57 tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] No VIF found with MAC fa:16:3e:f7:06:79, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 18:50:09 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:50:09 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:50:09 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:50:10 user nova-compute[75216]: DEBUG nova.compute.manager [req-4866c023-4acc-400d-9358-b1ea24875a42 req-41326f04-49ad-4b66-aa76-fe7292db5cfa service nova] [instance: a3bcf65e-bd5b-4350-a222-5f4522418a67] Received event network-vif-plugged-c4ac5376-d559-4365-b2ce-d827fecd2d1a {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:50:10 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-4866c023-4acc-400d-9358-b1ea24875a42 req-41326f04-49ad-4b66-aa76-fe7292db5cfa service nova] Acquiring lock "a3bcf65e-bd5b-4350-a222-5f4522418a67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:50:10 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-4866c023-4acc-400d-9358-b1ea24875a42 req-41326f04-49ad-4b66-aa76-fe7292db5cfa service nova] Lock "a3bcf65e-bd5b-4350-a222-5f4522418a67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:50:10 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-4866c023-4acc-400d-9358-b1ea24875a42 req-41326f04-49ad-4b66-aa76-fe7292db5cfa service nova] Lock "a3bcf65e-bd5b-4350-a222-5f4522418a67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:50:10 user nova-compute[75216]: DEBUG nova.compute.manager [req-4866c023-4acc-400d-9358-b1ea24875a42 req-41326f04-49ad-4b66-aa76-fe7292db5cfa service nova] [instance: a3bcf65e-bd5b-4350-a222-5f4522418a67] No waiting events found dispatching network-vif-plugged-c4ac5376-d559-4365-b2ce-d827fecd2d1a {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:50:10 user nova-compute[75216]: WARNING nova.compute.manager [req-4866c023-4acc-400d-9358-b1ea24875a42 req-41326f04-49ad-4b66-aa76-fe7292db5cfa service nova] [instance: a3bcf65e-bd5b-4350-a222-5f4522418a67] Received unexpected event network-vif-plugged-c4ac5376-d559-4365-b2ce-d827fecd2d1a for instance with vm_state shelved_offloaded and task_state spawning.
Nov 13 18:50:10 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:50:10 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:50:10 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:50:12 user nova-compute[75216]: DEBUG nova.compute.manager [req-02812728-cace-41e6-8281-3218ca20cd4a req-c68c357c-fbef-4e63-8726-8d0295a0b935 service nova] [instance: a3bcf65e-bd5b-4350-a222-5f4522418a67] Received event network-vif-plugged-c4ac5376-d559-4365-b2ce-d827fecd2d1a {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:50:12 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-02812728-cace-41e6-8281-3218ca20cd4a req-c68c357c-fbef-4e63-8726-8d0295a0b935 service nova] Acquiring lock "a3bcf65e-bd5b-4350-a222-5f4522418a67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:50:12 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-02812728-cace-41e6-8281-3218ca20cd4a req-c68c357c-fbef-4e63-8726-8d0295a0b935 service nova] Lock "a3bcf65e-bd5b-4350-a222-5f4522418a67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:50:12 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-02812728-cace-41e6-8281-3218ca20cd4a req-c68c357c-fbef-4e63-8726-8d0295a0b935 service nova] Lock "a3bcf65e-bd5b-4350-a222-5f4522418a67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:50:12 user nova-compute[75216]: DEBUG nova.compute.manager [req-02812728-cace-41e6-8281-3218ca20cd4a req-c68c357c-fbef-4e63-8726-8d0295a0b935 service nova] [instance: a3bcf65e-bd5b-4350-a222-5f4522418a67] No waiting events found dispatching network-vif-plugged-c4ac5376-d559-4365-b2ce-d827fecd2d1a {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:50:12 user nova-compute[75216]: WARNING nova.compute.manager [req-02812728-cace-41e6-8281-3218ca20cd4a req-c68c357c-fbef-4e63-8726-8d0295a0b935 service nova] [instance: a3bcf65e-bd5b-4350-a222-5f4522418a67] Received unexpected event network-vif-plugged-c4ac5376-d559-4365-b2ce-d827fecd2d1a for instance with vm_state shelved_offloaded and task_state spawning.
Nov 13 18:50:12 user nova-compute[75216]: DEBUG nova.compute.manager [None req-c8458832-c371-4d8e-8bf8-a01fd58cec57 tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] [instance: a3bcf65e-bd5b-4350-a222-5f4522418a67] Instance event wait completed in 0 seconds for  {{(pid=75216) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 18:50:12 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-c8458832-c371-4d8e-8bf8-a01fd58cec57 tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] [instance: a3bcf65e-bd5b-4350-a222-5f4522418a67] Guest created on hypervisor {{(pid=75216) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 18:50:12 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: a3bcf65e-bd5b-4350-a222-5f4522418a67] Instance spawned successfully.
Nov 13 18:50:12 user nova-compute[75216]: DEBUG nova.compute.manager [None req-c8458832-c371-4d8e-8bf8-a01fd58cec57 tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] [instance: a3bcf65e-bd5b-4350-a222-5f4522418a67] Checking state {{(pid=75216) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 18:50:12 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c8458832-c371-4d8e-8bf8-a01fd58cec57 tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] Lock "a3bcf65e-bd5b-4350-a222-5f4522418a67" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 13.246s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:50:13 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:50:13 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:50:18 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:50:18 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:50:22 user nova-compute[75216]: DEBUG nova.compute.manager [req-baeae4f7-49f3-400f-8c8a-e6c805f449ec req-9443bb1c-d5cf-45eb-971c-c0db9a7a6508 service nova] [instance: 7c9d9c1b-6df5-41ff-a696-871e70d04e07] Received event network-changed-c7fc6ea1-71ae-4068-b4a4-e3432a82cfad {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:50:22 user nova-compute[75216]: DEBUG nova.compute.manager [req-baeae4f7-49f3-400f-8c8a-e6c805f449ec req-9443bb1c-d5cf-45eb-971c-c0db9a7a6508 service nova] [instance: 7c9d9c1b-6df5-41ff-a696-871e70d04e07] Refreshing instance network info cache due to event network-changed-c7fc6ea1-71ae-4068-b4a4-e3432a82cfad. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 18:50:22 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-baeae4f7-49f3-400f-8c8a-e6c805f449ec req-9443bb1c-d5cf-45eb-971c-c0db9a7a6508 service nova] Acquiring lock "refresh_cache-7c9d9c1b-6df5-41ff-a696-871e70d04e07" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 18:50:22 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-baeae4f7-49f3-400f-8c8a-e6c805f449ec req-9443bb1c-d5cf-45eb-971c-c0db9a7a6508 service nova] Acquired lock "refresh_cache-7c9d9c1b-6df5-41ff-a696-871e70d04e07" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 18:50:22 user nova-compute[75216]: DEBUG nova.network.neutron [req-baeae4f7-49f3-400f-8c8a-e6c805f449ec req-9443bb1c-d5cf-45eb-971c-c0db9a7a6508 service nova] [instance: 7c9d9c1b-6df5-41ff-a696-871e70d04e07] Refreshing network info cache for port c7fc6ea1-71ae-4068-b4a4-e3432a82cfad {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 18:50:23 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1d101c6f-61ea-42f6-a06e-4920ac699edc tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Acquiring lock "7c9d9c1b-6df5-41ff-a696-871e70d04e07" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:50:23 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1d101c6f-61ea-42f6-a06e-4920ac699edc tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Lock "7c9d9c1b-6df5-41ff-a696-871e70d04e07" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:50:23 user nova-compute[75216]: DEBUG nova.objects.instance [None req-1d101c6f-61ea-42f6-a06e-4920ac699edc tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Lazy-loading 'flavor' on Instance uuid 7c9d9c1b-6df5-41ff-a696-871e70d04e07 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 18:50:23 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1d101c6f-61ea-42f6-a06e-4920ac699edc tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Lock "7c9d9c1b-6df5-41ff-a696-871e70d04e07" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:50:23 user nova-compute[75216]: DEBUG nova.network.neutron [req-baeae4f7-49f3-400f-8c8a-e6c805f449ec req-9443bb1c-d5cf-45eb-971c-c0db9a7a6508 service nova] [instance: 7c9d9c1b-6df5-41ff-a696-871e70d04e07] Updated VIF entry in instance network info cache for port c7fc6ea1-71ae-4068-b4a4-e3432a82cfad. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 18:50:23 user nova-compute[75216]: DEBUG nova.network.neutron [req-baeae4f7-49f3-400f-8c8a-e6c805f449ec req-9443bb1c-d5cf-45eb-971c-c0db9a7a6508 service nova] [instance: 7c9d9c1b-6df5-41ff-a696-871e70d04e07] Updating instance_info_cache with network_info: [{"id": "c7fc6ea1-71ae-4068-b4a4-e3432a82cfad", "address": "fa:16:3e:57:f0:d2", "network": {"id": "d7a691f0-4495-40ad-a349-91b5dc9c635a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-961583097-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9b7e11038e54e368acd22d06e54a351", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7fc6ea1-71", "ovs_interfaceid": "c7fc6ea1-71ae-4068-b4a4-e3432a82cfad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 18:50:23 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-baeae4f7-49f3-400f-8c8a-e6c805f449ec req-9443bb1c-d5cf-45eb-971c-c0db9a7a6508 service nova] Releasing lock "refresh_cache-7c9d9c1b-6df5-41ff-a696-871e70d04e07" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 18:50:23 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1d101c6f-61ea-42f6-a06e-4920ac699edc tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Acquiring lock "7c9d9c1b-6df5-41ff-a696-871e70d04e07" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:50:23 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1d101c6f-61ea-42f6-a06e-4920ac699edc tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Lock "7c9d9c1b-6df5-41ff-a696-871e70d04e07" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:50:23 user nova-compute[75216]: INFO nova.compute.manager [None req-1d101c6f-61ea-42f6-a06e-4920ac699edc tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: 7c9d9c1b-6df5-41ff-a696-871e70d04e07] Attaching volume 6c711796-fc49-4e18-8fdd-eefe1e3b357c to /dev/vdb
Nov 13 18:50:23 user nova-compute[75216]: DEBUG os_brick.utils [None req-1d101c6f-61ea-42f6-a06e-4920ac699edc tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 18:50:23 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:50:23 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:50:23 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[42eab9c9-e3e8-486c-b7aa-32feec4e9ff5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aea6fcfe14b9\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:50:23 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:50:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:50:23 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:50:23 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c7f6fa6-76c5-423d-bd40-e53cfa3d8b2f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:50:23 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:50:23 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:50:23 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[20adb766-ff4c-46af-8fd2-dd9cfb34987b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:50:23 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dc4f66d-ca9f-418f-a144-cc816ba3820b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:50:23 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-1d101c6f-61ea-42f6-a06e-4920ac699edc tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Running cmd (subprocess): nvme version {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:50:23 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-1d101c6f-61ea-42f6-a06e-4920ac699edc tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] 'nvme version' failed. Not Retrying. {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 18:50:23 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1d101c6f-61ea-42f6-a06e-4920ac699edc tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] nvme not present on system {{(pid=75216) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 18:50:23 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:50:23 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 18:50:23 user nova-compute[75216]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 18:50:23 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5e407bd-0fa4-4eed-acf8-894a34c2e16f]: (4, '') {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:50:23 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-1d101c6f-61ea-42f6-a06e-4920ac699edc tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75216) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 18:50:23 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-1d101c6f-61ea-42f6-a06e-4920ac699edc tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 18:50:23 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-1d101c6f-61ea-42f6-a06e-4920ac699edc tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] LIGHTOS: no hostnqn found. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 18:50:23 user nova-compute[75216]: DEBUG os_brick.utils [None req-1d101c6f-61ea-42f6-a06e-4920ac699edc tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aea6fcfe14b9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 18:50:23 user nova-compute[75216]: DEBUG nova.virt.block_device [None req-1d101c6f-61ea-42f6-a06e-4920ac699edc tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: 7c9d9c1b-6df5-41ff-a696-871e70d04e07] Updating existing volume attachment record: e202130b-03e4-491e-80ff-30db67f223f8 {{(pid=75216) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 18:50:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:50:27 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1d101c6f-61ea-42f6-a06e-4920ac699edc tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: 7c9d9c1b-6df5-41ff-a696-871e70d04e07] Calling os-brick to attach iSCSI Volume {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 18:50:27 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d101c6f-61ea-42f6-a06e-4920ac699edc tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3a8669e40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6c711796-fc49-4e18-8fdd-eefe1e3b357c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yaDuxRtQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 18:50:27 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-1d101c6f-61ea-42f6-a06e-4920ac699edc tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 18:50:27 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-1d101c6f-61ea-42f6-a06e-4920ac699edc tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 18:50:27 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-1d101c6f-61ea-42f6-a06e-4920ac699edc tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 18:50:27 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-1d101c6f-61ea-42f6-a06e-4920ac699edc tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 18:50:27 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-1d101c6f-61ea-42f6-a06e-4920ac699edc tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6c711796-fc49-4e18-8fdd-eefe1e3b357c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 18:50:27 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-1d101c6f-61ea-42f6-a06e-4920ac699edc tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6c711796-fc49-4e18-8fdd-eefe1e3b357c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 18:50:27 user nova-compute[75216]: INFO os_brick.initiator.connectors.iscsi [None req-1d101c6f-61ea-42f6-a06e-4920ac699edc tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 18:50:27 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c711796-fc49-4e18-8fdd-eefe1e3b357c -p 172.16.0.220:3260 {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:50:27 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c711796-fc49-4e18-8fdd-eefe1e3b357c -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:50:27 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e66e928-d52b-4b95-888b-48c2dbdd1dee]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:50:27 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d101c6f-61ea-42f6-a06e-4920ac699edc tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 18:50:27 user nova-compute[75216]:  {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:50:27 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c711796-fc49-4e18-8fdd-eefe1e3b357c -p 172.16.0.220:3260 --interface default --op new {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:50:27 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c711796-fc49-4e18-8fdd-eefe1e3b357c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:50:27 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9846670-2a88-4c34-9233-bc846fe433a0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6c711796-fc49-4e18-8fdd-eefe1e3b357c] added\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:50:27 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d101c6f-61ea-42f6-a06e-4920ac699edc tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6c711796-fc49-4e18-8fdd-eefe1e3b357c] added
Nov 13 18:50:27 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:50:27 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c711796-fc49-4e18-8fdd-eefe1e3b357c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:50:27 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c711796-fc49-4e18-8fdd-eefe1e3b357c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:50:27 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[61e86d96-739e-4dfc-8bb0-4cbe186dcb24]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:50:27 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d101c6f-61ea-42f6-a06e-4920ac699edc tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:50:27 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c711796-fc49-4e18-8fdd-eefe1e3b357c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:50:27 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c711796-fc49-4e18-8fdd-eefe1e3b357c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:50:27 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f588791-be27-4e41-8828-a5ebecc993f4]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:50:27 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d101c6f-61ea-42f6-a06e-4920ac699edc tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:50:27 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c711796-fc49-4e18-8fdd-eefe1e3b357c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yaDuxRtQ {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:50:27 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c711796-fc49-4e18-8fdd-eefe1e3b357c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yaDuxRtQ" returned: 0 in 0.017s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:50:27 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[7836a1f7-0313-4d56-a2d0-2c1b5d65e6ac]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:50:27 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d101c6f-61ea-42f6-a06e-4920ac699edc tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yaDuxRtQ'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:50:27 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c711796-fc49-4e18-8fdd-eefe1e3b357c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:50:27 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c711796-fc49-4e18-8fdd-eefe1e3b357c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:50:27 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[b98619b5-8019-4f10-ac2c-8050f35541a0]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:50:27 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d101c6f-61ea-42f6-a06e-4920ac699edc tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:50:27 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:50:27 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-3ee340b5-a0aa-4d7b-8f41-e8d6f063aca1 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 64dfe522-8b46-4df4-8032-591ce56900ec is timed out.
Nov 13 18:50:27 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-3ee340b5-a0aa-4d7b-8f41-e8d6f063aca1 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] Successfully detached device vdb from instance 64dfe522-8b46-4df4-8032-591ce56900ec from the live domain config.
Nov 13 18:50:27 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:50:27 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[2603dcf9-8305-4d80-ad48-4750270974c4]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf4e9e60-f40d-49e0-8234-ae45c23b695b (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae66a157-b0d3-4501-a728-a010d6a83a10 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e31c9fc8-6279-4e4f-bb4a-eaf0e56ebcc5 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac (non-flash)\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:50:27 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d101c6f-61ea-42f6-a06e-4920ac699edc tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf4e9e60-f40d-49e0-8234-ae45c23b695b (non-flash)
Nov 13 18:50:27 user nova-compute[75216]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae66a157-b0d3-4501-a728-a010d6a83a10 (non-flash)
Nov 13 18:50:27 user nova-compute[75216]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e31c9fc8-6279-4e4f-bb4a-eaf0e56ebcc5 (non-flash)
Nov 13 18:50:27 user nova-compute[75216]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac (non-flash)
Nov 13 18:50:27 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 18:50:27 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d101c6f-61ea-42f6-a06e-4920ac699edc tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf4e9e60-f40d-49e0-8234-ae45c23b695b (non-flash)
Nov 13 18:50:27 user nova-compute[75216]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae66a157-b0d3-4501-a728-a010d6a83a10 (non-flash)
Nov 13 18:50:27 user nova-compute[75216]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e31c9fc8-6279-4e4f-bb4a-eaf0e56ebcc5 (non-flash)
Nov 13 18:50:27 user nova-compute[75216]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac (non-flash)
Nov 13 18:50:27 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 18:50:27 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c711796-fc49-4e18-8fdd-eefe1e3b357c -p 172.16.0.220:3260 --login {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:50:27 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3ee340b5-a0aa-4d7b-8f41-e8d6f063aca1 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] [instance: 64dfe522-8b46-4df4-8032-591ce56900ec] calling os-brick to detach iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 18:50:27 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ee340b5-a0aa-4d7b-8f41-e8d6f063aca1 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3a8669e40>, {'target_iqn': 'iqn.2010-10.org.openstack:e31c9fc8-6279-4e4f-bb4a-eaf0e56ebcc5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fwHPSobK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 18:50:27 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-3ee340b5-a0aa-4d7b-8f41-e8d6f063aca1 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 18:50:27 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-3ee340b5-a0aa-4d7b-8f41-e8d6f063aca1 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 18:50:27 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c711796-fc49-4e18-8fdd-eefe1e3b357c -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:50:27 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[347c58b8-89a3-42af-a993-4a40ebec501f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6c711796-fc49-4e18-8fdd-eefe1e3b357c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6c711796-fc49-4e18-8fdd-eefe1e3b357c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:50:27 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d101c6f-61ea-42f6-a06e-4920ac699edc tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6c711796-fc49-4e18-8fdd-eefe1e3b357c, portal: 172.16.0.220,3260]
Nov 13 18:50:27 user nova-compute[75216]: Login to [iface: default, target: iqn.2010-10.org.openstack:6c711796-fc49-4e18-8fdd-eefe1e3b357c, portal: 172.16.0.220,3260] successful.
Nov 13 18:50:27 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:50:27 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c711796-fc49-4e18-8fdd-eefe1e3b357c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:50:27 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c711796-fc49-4e18-8fdd-eefe1e3b357c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:50:27 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d1a24be-37e8-4b93-9e13-a605fb7e9b39]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:50:27 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d101c6f-61ea-42f6-a06e-4920ac699edc tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:50:27 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:50:27 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:50:27 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[010c250d-bf6b-4f12-b858-eb7e5dbaf31c]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf4e9e60-f40d-49e0-8234-ae45c23b695b (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae66a157-b0d3-4501-a728-a010d6a83a10 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e31c9fc8-6279-4e4f-bb4a-eaf0e56ebcc5 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c711796-fc49-4e18-8fdd-eefe1e3b357c (non-flash)\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:50:27 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d101c6f-61ea-42f6-a06e-4920ac699edc tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf4e9e60-f40d-49e0-8234-ae45c23b695b (non-flash)
Nov 13 18:50:27 user nova-compute[75216]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae66a157-b0d3-4501-a728-a010d6a83a10 (non-flash)
Nov 13 18:50:27 user nova-compute[75216]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e31c9fc8-6279-4e4f-bb4a-eaf0e56ebcc5 (non-flash)
Nov 13 18:50:27 user nova-compute[75216]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac (non-flash)
Nov 13 18:50:27 user nova-compute[75216]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c711796-fc49-4e18-8fdd-eefe1e3b357c (non-flash)
Nov 13 18:50:27 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 18:50:27 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d101c6f-61ea-42f6-a06e-4920ac699edc tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf4e9e60-f40d-49e0-8234-ae45c23b695b (non-flash)
Nov 13 18:50:27 user nova-compute[75216]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae66a157-b0d3-4501-a728-a010d6a83a10 (non-flash)
Nov 13 18:50:27 user nova-compute[75216]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e31c9fc8-6279-4e4f-bb4a-eaf0e56ebcc5 (non-flash)
Nov 13 18:50:27 user nova-compute[75216]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac (non-flash)
Nov 13 18:50:27 user nova-compute[75216]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c711796-fc49-4e18-8fdd-eefe1e3b357c (non-flash)
Nov 13 18:50:27 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 18:50:27 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-1d101c6f-61ea-42f6-a06e-4920ac699edc tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6c711796-fc49-4e18-8fdd-eefe1e3b357c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.287s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 18:50:27 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d101c6f-61ea-42f6-a06e-4920ac699edc tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Connected to 172.16.0.220:3260 {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 18:50:27 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-1d101c6f-61ea-42f6-a06e-4920ac699edc tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] HCTL ('37', '-', '-', 0) found on session 22 with lun 0 {{(pid=75216) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 18:50:27 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-1d101c6f-61ea-42f6-a06e-4920ac699edc tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75216) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 18:50:27 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:50:27 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.021s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:50:27 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[095c1cfe-c411-47ee-a0e4-86f454680071]: (4, ('- - 0', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:50:27 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-1d101c6f-61ea-42f6-a06e-4920ac699edc tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Searching for a device in session 22 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75216) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 18:50:27 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d101c6f-61ea-42f6-a06e-4920ac699edc tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:6c711796-fc49-4e18-8fdd-eefe1e3b357c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yaDuxRtQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 18:50:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:50:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:50:28 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-1d101c6f-61ea-42f6-a06e-4920ac699edc tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.324s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 18:50:28 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d101c6f-61ea-42f6-a06e-4920ac699edc tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] <== connect_volume: return (1326ms) {'type': 'block', 'scsi_wwn': '23663653965653233', 'path': '/dev/sdf'} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 18:50:28 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1d101c6f-61ea-42f6-a06e-4920ac699edc tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: 7c9d9c1b-6df5-41ff-a696-871e70d04e07] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23663653965653233', 'path': '/dev/sdf'} {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 18:50:28 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-3ee340b5-a0aa-4d7b-8f41-e8d6f063aca1 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.163s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 18:50:28 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:50:28 user nova-compute[75216]: DEBUG nova.objects.instance [None req-1d101c6f-61ea-42f6-a06e-4920ac699edc tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Lazy-loading 'flavor' on Instance uuid 7c9d9c1b-6df5-41ff-a696-871e70d04e07 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 18:50:28 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:50:28 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f47ea44-cbd6-4d03-a693-f2077a94d15b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bf4e9e60-f40d-49e0-8234-ae45c23b695b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e31c9fc8-6279-4e4f-bb4a-eaf0e56ebcc5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6c711796-fc49-4e18-8fdd-eefe1e3b357c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ae66a157-b0d3-4501-a728-a010d6a83a10\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:50:28 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ee340b5-a0aa-4d7b-8f41-e8d6f063aca1 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 18:50:28 user nova-compute[75216]: No targets found.
Nov 13 18:50:28 user nova-compute[75216]: iSNS:
Nov 13 18:50:28 user nova-compute[75216]: No targets found.
Nov 13 18:50:28 user nova-compute[75216]: STATIC:
Nov 13 18:50:28 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:bf4e9e60-f40d-49e0-8234-ae45c23b695b
Nov 13 18:50:28 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 18:50:28 user nova-compute[75216]:                 Iface Name: default
Nov 13 18:50:28 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:e31c9fc8-6279-4e4f-bb4a-eaf0e56ebcc5
Nov 13 18:50:28 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 18:50:28 user nova-compute[75216]:                 Iface Name: default
Nov 13 18:50:28 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:6c711796-fc49-4e18-8fdd-eefe1e3b357c
Nov 13 18:50:28 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 18:50:28 user nova-compute[75216]:                 Iface Name: default
Nov 13 18:50:28 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac
Nov 13 18:50:28 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 18:50:28 user nova-compute[75216]:                 Iface Name: default
Nov 13 18:50:28 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:ae66a157-b0d3-4501-a728-a010d6a83a10
Nov 13 18:50:28 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 18:50:28 user nova-compute[75216]:                 Iface Name: default
Nov 13 18:50:28 user nova-compute[75216]: FIRMWARE:
Nov 13 18:50:28 user nova-compute[75216]: No targets found.
Nov 13 18:50:28 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 18:50:28 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ee340b5-a0aa-4d7b-8f41-e8d6f063aca1 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 18:50:28 user nova-compute[75216]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 18:50:28 user nova-compute[75216]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75216) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 18:50:28 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ee340b5-a0aa-4d7b-8f41-e8d6f063aca1 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e31c9fc8-6279-4e4f-bb4a-eaf0e56ebcc5', 0)] {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 18:50:28 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:50:28 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-1d101c6f-61ea-42f6-a06e-4920ac699edc tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] attach device xml: <disk type="block" device="disk">
Nov 13 18:50:28 user nova-compute[75216]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 18:50:28 user nova-compute[75216]:   <source dev="/dev/sdf"/>
Nov 13 18:50:28 user nova-compute[75216]:   <target dev="vdb" bus="virtio"/>
Nov 13 18:50:28 user nova-compute[75216]:   <serial>6c711796-fc49-4e18-8fdd-eefe1e3b357c</serial>
Nov 13 18:50:28 user nova-compute[75216]: </disk>
Nov 13 18:50:28 user nova-compute[75216]:  {{(pid=75216) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 13 18:50:28 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:50:28 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3b5e6fb-457a-4211-8353-9ce7a5115ee7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6c711796-fc49-4e18-8fdd-eefe1e3b357c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ae66a157-b0d3-4501-a728-a010d6a83a10\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf4e9e60-f40d-49e0-8234-ae45c23b695b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e31c9fc8-6279-4e4f-bb4a-eaf0e56ebcc5\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:50:28 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:50:28 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:50:28 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[977c0212-9dc9-44bc-9f4c-dd0d261bb92f]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf4e9e60-f40d-49e0-8234-ae45c23b695b (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae66a157-b0d3-4501-a728-a010d6a83a10 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e31c9fc8-6279-4e4f-bb4a-eaf0e56ebcc5 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c711796-fc49-4e18-8fdd-eefe1e3b357c (non-flash)\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:50:28 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ee340b5-a0aa-4d7b-8f41-e8d6f063aca1 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf4e9e60-f40d-49e0-8234-ae45c23b695b (non-flash)
Nov 13 18:50:28 user nova-compute[75216]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae66a157-b0d3-4501-a728-a010d6a83a10 (non-flash)
Nov 13 18:50:28 user nova-compute[75216]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e31c9fc8-6279-4e4f-bb4a-eaf0e56ebcc5 (non-flash)
Nov 13 18:50:28 user nova-compute[75216]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac (non-flash)
Nov 13 18:50:28 user nova-compute[75216]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c711796-fc49-4e18-8fdd-eefe1e3b357c (non-flash)
Nov 13 18:50:28 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 18:50:28 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ee340b5-a0aa-4d7b-8f41-e8d6f063aca1 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf4e9e60-f40d-49e0-8234-ae45c23b695b (non-flash)
Nov 13 18:50:28 user nova-compute[75216]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae66a157-b0d3-4501-a728-a010d6a83a10 (non-flash)
Nov 13 18:50:28 user nova-compute[75216]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e31c9fc8-6279-4e4f-bb4a-eaf0e56ebcc5 (non-flash)
Nov 13 18:50:28 user nova-compute[75216]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac (non-flash)
Nov 13 18:50:28 user nova-compute[75216]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c711796-fc49-4e18-8fdd-eefe1e3b357c (non-flash)
Nov 13 18:50:28 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 18:50:28 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ee340b5-a0aa-4d7b-8f41-e8d6f063aca1 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe3a82c9120>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e31c9fc8-6279-4e4f-bb4a-eaf0e56ebcc5'): ({'sdd'}, set())}) {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 18:50:28 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-3ee340b5-a0aa-4d7b-8f41-e8d6f063aca1 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] Removing single pathed devices sdd {{(pid=75216) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 18:50:28 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:50:28 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:50:28 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec538f3c-d301-4a47-8894-cd6b885419a3]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:50:28 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:50:28 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.017s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:50:28 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[86ba835e-1bff-4fa9-abd5-ffdd2509af41]: (4, ('ok\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:50:28 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-3ee340b5-a0aa-4d7b-8f41-e8d6f063aca1 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] Flushing IO for device /dev/sdd {{(pid=75216) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 18:50:28 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:50:28 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.011s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:50:28 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4b30597-7d1a-412a-97df-169f1c2ba1e4]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:50:28 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-3ee340b5-a0aa-4d7b-8f41-e8d6f063aca1 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75216) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 18:50:28 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:50:28 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.036s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:50:28 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[1624e6a6-473d-4a30-bda3-eb713d5915e5]: (4, ('1', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:50:28 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-3ee340b5-a0aa-4d7b-8f41-e8d6f063aca1 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 18:50:28 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-3ee340b5-a0aa-4d7b-8f41-e8d6f063aca1 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] SCSI volumes sdd have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 18:50:28 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ee340b5-a0aa-4d7b-8f41-e8d6f063aca1 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e31c9fc8-6279-4e4f-bb4a-eaf0e56ebcc5')] {{(pid=75216) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 18:50:28 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e31c9fc8-6279-4e4f-bb4a-eaf0e56ebcc5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:50:28 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e31c9fc8-6279-4e4f-bb4a-eaf0e56ebcc5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:50:28 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8b67c14-5f9e-4595-8403-8f5864a11ff0]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:50:28 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ee340b5-a0aa-4d7b-8f41-e8d6f063aca1 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:50:28 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e31c9fc8-6279-4e4f-bb4a-eaf0e56ebcc5 -p 172.16.0.220:3260 --logout {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:50:29 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e31c9fc8-6279-4e4f-bb4a-eaf0e56ebcc5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:50:29 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e905a6d-4f1f-4dc4-809c-2ac77ade5340]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:e31c9fc8-6279-4e4f-bb4a-eaf0e56ebcc5, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:e31c9fc8-6279-4e4f-bb4a-eaf0e56ebcc5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:50:29 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ee340b5-a0aa-4d7b-8f41-e8d6f063aca1 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:e31c9fc8-6279-4e4f-bb4a-eaf0e56ebcc5, portal: 172.16.0.220,3260]
Nov 13 18:50:29 user nova-compute[75216]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:e31c9fc8-6279-4e4f-bb4a-eaf0e56ebcc5, portal: 172.16.0.220,3260] successful.
Nov 13 18:50:29 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:50:29 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e31c9fc8-6279-4e4f-bb4a-eaf0e56ebcc5 -p 172.16.0.220:3260 --op delete {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:50:29 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e31c9fc8-6279-4e4f-bb4a-eaf0e56ebcc5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:50:29 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[b791d8c7-113c-4715-a94f-147fa2ed9083]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:50:29 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ee340b5-a0aa-4d7b-8f41-e8d6f063aca1 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:50:29 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-3ee340b5-a0aa-4d7b-8f41-e8d6f063aca1 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.296s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 18:50:29 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ee340b5-a0aa-4d7b-8f41-e8d6f063aca1 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] <== disconnect_volume: return (1459ms) None {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 18:50:29 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3ee340b5-a0aa-4d7b-8f41-e8d6f063aca1 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] [instance: 64dfe522-8b46-4df4-8032-591ce56900ec] Disconnected iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 18:50:29 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-1d101c6f-61ea-42f6-a06e-4920ac699edc tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 18:50:29 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-1d101c6f-61ea-42f6-a06e-4920ac699edc tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 18:50:29 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-1d101c6f-61ea-42f6-a06e-4920ac699edc tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] No VIF found with MAC fa:16:3e:57:f0:d2, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 18:50:29 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1d101c6f-61ea-42f6-a06e-4920ac699edc tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Lock "7c9d9c1b-6df5-41ff-a696-871e70d04e07" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.143s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:50:29 user nova-compute[75216]: DEBUG nova.objects.instance [None req-3ee340b5-a0aa-4d7b-8f41-e8d6f063aca1 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] Lazy-loading 'flavor' on Instance uuid 64dfe522-8b46-4df4-8032-591ce56900ec {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 18:50:29 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-3ee340b5-a0aa-4d7b-8f41-e8d6f063aca1 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] Lock "64dfe522-8b46-4df4-8032-591ce56900ec" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.784s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:50:30 user nova-compute[75216]: INFO nova.compute.manager [None req-fb83f5f2-56de-47d0-921e-89df78a1e0d4 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: 7c9d9c1b-6df5-41ff-a696-871e70d04e07] Rebuilding instance
Nov 13 18:50:30 user nova-compute[75216]: DEBUG nova.compute.manager [None req-fb83f5f2-56de-47d0-921e-89df78a1e0d4 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: 7c9d9c1b-6df5-41ff-a696-871e70d04e07] Checking state {{(pid=75216) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 18:50:30 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-7a9eeb07-c962-402e-81d1-03558f4f7028 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] Acquiring lock "interface-64dfe522-8b46-4df4-8032-591ce56900ec-0b5d79f8-fcb9-4bc8-b5e3-489fb6218824" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:50:30 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-7a9eeb07-c962-402e-81d1-03558f4f7028 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] Lock "interface-64dfe522-8b46-4df4-8032-591ce56900ec-0b5d79f8-fcb9-4bc8-b5e3-489fb6218824" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:50:30 user nova-compute[75216]: DEBUG nova.objects.instance [None req-7a9eeb07-c962-402e-81d1-03558f4f7028 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] Lazy-loading 'flavor' on Instance uuid 64dfe522-8b46-4df4-8032-591ce56900ec {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 18:50:30 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:50:30 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-7a9eeb07-c962-402e-81d1-03558f4f7028 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T18:48:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-904595823',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-904595823',id=13,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAnoGBZDueYOh3xcWER1AMv30DIYxQxeWRDS2fRFXh6l4DZc8pD4qIgg0IjDLbUZuBfE7+vn5QgzB7ChiJAa+d1ltHilcpx/dg8eDxHVfO8o++kjL7IH7NIL3RYQDYV6Ew==',key_name='tempest-keypair-1295383460',keypairs=<?>,launch_index=0,launched_at=2023-11-13T18:48:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0ec18dd2e6ea476dbf3745d14a866190',ramdisk_id='',reservation_id='r-0a499j0h',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-507898025',owner_user_name='tempest-TaggedAttachmentsTest-507898025-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T18:48:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='454caf80dd76487baead7c52f05df1a5',uuid=64dfe522-8b46-4df4-8032-591ce56900ec,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0b5d79f8-fcb9-4bc8-b5e3-489fb6218824", "address": "fa:16:3e:01:dc:62", "network": {"id": "cfd7855a-e494-456a-b9d4-02bab193fd03", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-66586289", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.117", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "0ec18dd2e6ea476dbf3745d14a866190", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b5d79f8-fc", "ovs_interfaceid": "0b5d79f8-fcb9-4bc8-b5e3-489fb6218824", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75216) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 18:50:30 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-7a9eeb07-c962-402e-81d1-03558f4f7028 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] Converting VIF {"id": "0b5d79f8-fcb9-4bc8-b5e3-489fb6218824", "address": "fa:16:3e:01:dc:62", "network": {"id": "cfd7855a-e494-456a-b9d4-02bab193fd03", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-66586289", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.117", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "0ec18dd2e6ea476dbf3745d14a866190", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b5d79f8-fc", "ovs_interfaceid": "0b5d79f8-fcb9-4bc8-b5e3-489fb6218824", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 18:50:30 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-7a9eeb07-c962-402e-81d1-03558f4f7028 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:dc:62,bridge_name='br-int',has_traffic_filtering=True,id=0b5d79f8-fcb9-4bc8-b5e3-489fb6218824,network=Network(cfd7855a-e494-456a-b9d4-02bab193fd03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b5d79f8-fc') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 18:50:30 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-7a9eeb07-c962-402e-81d1-03558f4f7028 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:01:dc:62"/><model type="virtio"/><mtu size="1442"/><target dev="tap0b5d79f8-fc"/></interface> {{(pid=75216) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 13 18:50:30 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-7a9eeb07-c962-402e-81d1-03558f4f7028 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:01:dc:62"/><model type="virtio"/><mtu size="1442"/><target dev="tap0b5d79f8-fc"/></interface> {{(pid=75216) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 13 18:50:30 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-7a9eeb07-c962-402e-81d1-03558f4f7028 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] Attempting to detach device tap0b5d79f8-fc from instance 64dfe522-8b46-4df4-8032-591ce56900ec from the persistent domain config. {{(pid=75216) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 13 18:50:30 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-7a9eeb07-c962-402e-81d1-03558f4f7028 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] detach device xml: <interface type="ethernet">
Nov 13 18:50:30 user nova-compute[75216]:   <mac address="fa:16:3e:01:dc:62"/>
Nov 13 18:50:30 user nova-compute[75216]:   <model type="virtio"/>
Nov 13 18:50:30 user nova-compute[75216]:   <mtu size="1442"/>
Nov 13 18:50:30 user nova-compute[75216]:   <target dev="tap0b5d79f8-fc"/>
Nov 13 18:50:30 user nova-compute[75216]: </interface>
Nov 13 18:50:30 user nova-compute[75216]:  {{(pid=75216) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 18:50:30 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:50:30 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-7a9eeb07-c962-402e-81d1-03558f4f7028 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:01:dc:62"/><model type="virtio"/><mtu size="1442"/><target dev="tap0b5d79f8-fc"/></interface> {{(pid=75216) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 13 18:50:30 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-7a9eeb07-c962-402e-81d1-03558f4f7028 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:01:dc:62"/><model type="virtio"/><mtu size="1442"/><target dev="tap0b5d79f8-fc"/></interface>not found in domain: <domain type='kvm' id='14'>
Nov 13 18:50:30 user nova-compute[75216]:   <name>instance-0000000d</name>
Nov 13 18:50:30 user nova-compute[75216]:   <uuid>64dfe522-8b46-4df4-8032-591ce56900ec</uuid>
Nov 13 18:50:30 user nova-compute[75216]:   <metadata>
Nov 13 18:50:30 user nova-compute[75216]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 18:50:30 user nova-compute[75216]:   <nova:package version="0.0.0"/>
Nov 13 18:50:30 user nova-compute[75216]:   <nova:name>tempest-device-tagging-server-904595823</nova:name>
Nov 13 18:50:30 user nova-compute[75216]:   <nova:creationTime>2023-11-13 18:49:56</nova:creationTime>
Nov 13 18:50:30 user nova-compute[75216]:   <nova:flavor name="m1.tiny">
Nov 13 18:50:30 user nova-compute[75216]:     <nova:memory>512</nova:memory>
Nov 13 18:50:30 user nova-compute[75216]:     <nova:disk>1</nova:disk>
Nov 13 18:50:30 user nova-compute[75216]:     <nova:swap>0</nova:swap>
Nov 13 18:50:30 user nova-compute[75216]:     <nova:ephemeral>0</nova:ephemeral>
Nov 13 18:50:30 user nova-compute[75216]:     <nova:vcpus>1</nova:vcpus>
Nov 13 18:50:30 user nova-compute[75216]:   </nova:flavor>
Nov 13 18:50:30 user nova-compute[75216]:   <nova:owner>
Nov 13 18:50:30 user nova-compute[75216]:     <nova:user uuid="454caf80dd76487baead7c52f05df1a5">tempest-TaggedAttachmentsTest-507898025-project-member</nova:user>
Nov 13 18:50:30 user nova-compute[75216]:     <nova:project uuid="0ec18dd2e6ea476dbf3745d14a866190">tempest-TaggedAttachmentsTest-507898025</nova:project>
Nov 13 18:50:30 user nova-compute[75216]:   </nova:owner>
Nov 13 18:50:30 user nova-compute[75216]:   <nova:root type="image" uuid="77bcb5ba-8510-41ec-a88d-96097bb431de"/>
Nov 13 18:50:30 user nova-compute[75216]:   <nova:ports>
Nov 13 18:50:30 user nova-compute[75216]:     <nova:port uuid="2d12f254-7874-4622-a7cb-8180de961bd1">
Nov 13 18:50:30 user nova-compute[75216]:       <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 13 18:50:30 user nova-compute[75216]:     </nova:port>
Nov 13 18:50:30 user nova-compute[75216]:     <nova:port uuid="0b5d79f8-fcb9-4bc8-b5e3-489fb6218824">
Nov 13 18:50:30 user nova-compute[75216]:       <nova:ip type="fixed" address="10.10.10.117" ipVersion="4"/>
Nov 13 18:50:30 user nova-compute[75216]:     </nova:port>
Nov 13 18:50:30 user nova-compute[75216]:   </nova:ports>
Nov 13 18:50:30 user nova-compute[75216]: </nova:instance>
Nov 13 18:50:30 user nova-compute[75216]:   </metadata>
Nov 13 18:50:30 user nova-compute[75216]:   <memory unit='KiB'>524288</memory>
Nov 13 18:50:30 user nova-compute[75216]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 13 18:50:30 user nova-compute[75216]:   <vcpu placement='static'>1</vcpu>
Nov 13 18:50:30 user nova-compute[75216]:   <resource>
Nov 13 18:50:30 user nova-compute[75216]:     <partition>/machine</partition>
Nov 13 18:50:30 user nova-compute[75216]:   </resource>
Nov 13 18:50:30 user nova-compute[75216]:   <sysinfo type='smbios'>
Nov 13 18:50:30 user nova-compute[75216]:     <system>
Nov 13 18:50:30 user nova-compute[75216]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 13 18:50:30 user nova-compute[75216]:       <entry name='product'>OpenStack Nova</entry>
Nov 13 18:50:30 user nova-compute[75216]:       <entry name='version'>0.0.0</entry>
Nov 13 18:50:30 user nova-compute[75216]:       <entry name='serial'>64dfe522-8b46-4df4-8032-591ce56900ec</entry>
Nov 13 18:50:30 user nova-compute[75216]:       <entry name='uuid'>64dfe522-8b46-4df4-8032-591ce56900ec</entry>
Nov 13 18:50:30 user nova-compute[75216]:       <entry name='family'>Virtual Machine</entry>
Nov 13 18:50:30 user nova-compute[75216]:     </system>
Nov 13 18:50:30 user nova-compute[75216]:   </sysinfo>
Nov 13 18:50:30 user nova-compute[75216]:   <os>
Nov 13 18:50:30 user nova-compute[75216]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 13 18:50:30 user nova-compute[75216]:     <boot dev='hd'/>
Nov 13 18:50:30 user nova-compute[75216]:     <smbios mode='sysinfo'/>
Nov 13 18:50:30 user nova-compute[75216]:   </os>
Nov 13 18:50:30 user nova-compute[75216]:   <features>
Nov 13 18:50:30 user nova-compute[75216]:     <acpi/>
Nov 13 18:50:30 user nova-compute[75216]:     <apic/>
Nov 13 18:50:30 user nova-compute[75216]:     <vmcoreinfo state='on'/>
Nov 13 18:50:30 user nova-compute[75216]:   </features>
Nov 13 18:50:30 user nova-compute[75216]:   <cpu mode='custom' match='exact' check='full'>
Nov 13 18:50:30 user nova-compute[75216]:     <model fallback='forbid'>Nehalem</model>
Nov 13 18:50:30 user nova-compute[75216]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 13 18:50:30 user nova-compute[75216]:     <feature policy='require' name='vme'/>
Nov 13 18:50:30 user nova-compute[75216]:     <feature policy='require' name='x2apic'/>
Nov 13 18:50:30 user nova-compute[75216]:     <feature policy='require' name='hypervisor'/>
Nov 13 18:50:30 user nova-compute[75216]:   </cpu>
Nov 13 18:50:30 user nova-compute[75216]:   <clock offset='utc'>
Nov 13 18:50:30 user nova-compute[75216]:     <timer name='pit' tickpolicy='delay'/>
Nov 13 18:50:30 user nova-compute[75216]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 13 18:50:30 user nova-compute[75216]:     <timer name='hpet' present='no'/>
Nov 13 18:50:30 user nova-compute[75216]:   </clock>
Nov 13 18:50:30 user nova-compute[75216]:   <on_poweroff>destroy</on_poweroff>
Nov 13 18:50:30 user nova-compute[75216]:   <on_reboot>restart</on_reboot>
Nov 13 18:50:30 user nova-compute[75216]:   <on_crash>destroy</on_crash>
Nov 13 18:50:30 user nova-compute[75216]:   <devices>
Nov 13 18:50:30 user nova-compute[75216]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 13 18:50:30 user nova-compute[75216]:     <disk type='file' device='disk'>
Nov 13 18:50:30 user nova-compute[75216]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 13 18:50:30 user nova-compute[75216]:       <source file='/opt/stack/data/nova/instances/64dfe522-8b46-4df4-8032-591ce56900ec/disk' index='2'/>
Nov 13 18:50:30 user nova-compute[75216]:       <backingStore type='file' index='3'>
Nov 13 18:50:30 user nova-compute[75216]:         <format type='raw'/>
Nov 13 18:50:30 user nova-compute[75216]:         <source file='/opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6'/>
Nov 13 18:50:30 user nova-compute[75216]:         <backingStore/>
Nov 13 18:50:30 user nova-compute[75216]:       </backingStore>
Nov 13 18:50:30 user nova-compute[75216]:       <target dev='vda' bus='virtio'/>
Nov 13 18:50:30 user nova-compute[75216]:       <alias name='virtio-disk0'/>
Nov 13 18:50:30 user nova-compute[75216]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 13 18:50:30 user nova-compute[75216]:     </disk>
Nov 13 18:50:30 user nova-compute[75216]:     <disk type='file' device='cdrom'>
Nov 13 18:50:30 user nova-compute[75216]:       <driver name='qemu' type='raw' cache='none'/>
Nov 13 18:50:30 user nova-compute[75216]:       <source file='/opt/stack/data/nova/instances/64dfe522-8b46-4df4-8032-591ce56900ec/disk.config' index='1'/>
Nov 13 18:50:30 user nova-compute[75216]:       <backingStore/>
Nov 13 18:50:30 user nova-compute[75216]:       <target dev='hda' bus='ide'/>
Nov 13 18:50:30 user nova-compute[75216]:       <readonly/>
Nov 13 18:50:30 user nova-compute[75216]:       <alias name='ide0-0-0'/>
Nov 13 18:50:30 user nova-compute[75216]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 13 18:50:30 user nova-compute[75216]:     </disk>
Nov 13 18:50:30 user nova-compute[75216]:     <controller type='usb' index='0' model='none'>
Nov 13 18:50:30 user nova-compute[75216]:       <alias name='usb'/>
Nov 13 18:50:30 user nova-compute[75216]:     </controller>
Nov 13 18:50:30 user nova-compute[75216]:     <controller type='pci' index='0' model='pci-root'>
Nov 13 18:50:30 user nova-compute[75216]:       <alias name='pci.0'/>
Nov 13 18:50:30 user nova-compute[75216]:     </controller>
Nov 13 18:50:30 user nova-compute[75216]:     <controller type='ide' index='0'>
Nov 13 18:50:30 user nova-compute[75216]:       <alias name='ide'/>
Nov 13 18:50:30 user nova-compute[75216]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 13 18:50:30 user nova-compute[75216]:     </controller>
Nov 13 18:50:30 user nova-compute[75216]:     <interface type='ethernet'>
Nov 13 18:50:30 user nova-compute[75216]:       <mac address='fa:16:3e:a1:6b:92'/>
Nov 13 18:50:30 user nova-compute[75216]:       <target dev='tap2d12f254-78'/>
Nov 13 18:50:30 user nova-compute[75216]:       <model type='virtio'/>
Nov 13 18:50:30 user nova-compute[75216]:       <mtu size='1442'/>
Nov 13 18:50:30 user nova-compute[75216]:       <alias name='net0'/>
Nov 13 18:50:30 user nova-compute[75216]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 13 18:50:30 user nova-compute[75216]:     </interface>
Nov 13 18:50:30 user nova-compute[75216]:     <interface type='ethernet'>
Nov 13 18:50:30 user nova-compute[75216]:       <mac address='fa:16:3e:01:dc:62'/>
Nov 13 18:50:30 user nova-compute[75216]:       <target dev='tap0b5d79f8-fc'/>
Nov 13 18:50:30 user nova-compute[75216]:       <model type='virtio'/>
Nov 13 18:50:30 user nova-compute[75216]:       <mtu size='1442'/>
Nov 13 18:50:30 user nova-compute[75216]:       <alias name='net1'/>
Nov 13 18:50:30 user nova-compute[75216]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Nov 13 18:50:30 user nova-compute[75216]:     </interface>
Nov 13 18:50:30 user nova-compute[75216]:     <serial type='pty'>
Nov 13 18:50:30 user nova-compute[75216]:       <source path='/dev/pts/1'/>
Nov 13 18:50:30 user nova-compute[75216]:       <log file='/opt/stack/data/nova/instances/64dfe522-8b46-4df4-8032-591ce56900ec/console.log' append='off'/>
Nov 13 18:50:30 user nova-compute[75216]:       <target type='isa-serial' port='0'>
Nov 13 18:50:30 user nova-compute[75216]:         <model name='isa-serial'/>
Nov 13 18:50:30 user nova-compute[75216]:       </target>
Nov 13 18:50:30 user nova-compute[75216]:       <alias name='serial0'/>
Nov 13 18:50:30 user nova-compute[75216]:     </serial>
Nov 13 18:50:30 user nova-compute[75216]:     <console type='pty' tty='/dev/pts/1'>
Nov 13 18:50:30 user nova-compute[75216]:       <source path='/dev/pts/1'/>
Nov 13 18:50:30 user nova-compute[75216]:       <log file='/opt/stack/data/nova/instances/64dfe522-8b46-4df4-8032-591ce56900ec/console.log' append='off'/>
Nov 13 18:50:30 user nova-compute[75216]:       <target type='serial' port='0'/>
Nov 13 18:50:30 user nova-compute[75216]:       <alias name='serial0'/>
Nov 13 18:50:30 user nova-compute[75216]:     </console>
Nov 13 18:50:30 user nova-compute[75216]:     <input type='mouse' bus='ps2'>
Nov 13 18:50:30 user nova-compute[75216]:       <alias name='input0'/>
Nov 13 18:50:30 user nova-compute[75216]:     </input>
Nov 13 18:50:30 user nova-compute[75216]:     <input type='keyboard' bus='ps2'>
Nov 13 18:50:30 user nova-compute[75216]:       <alias name='input1'/>
Nov 13 18:50:30 user nova-compute[75216]:     </input>
Nov 13 18:50:30 user nova-compute[75216]:     <graphics type='vnc' port='5901' autoport='yes' listen='0.0.0.0'>
Nov 13 18:50:30 user nova-compute[75216]:       <listen type='address' address='0.0.0.0'/>
Nov 13 18:50:30 user nova-compute[75216]:     </graphics>
Nov 13 18:50:30 user nova-compute[75216]:     <audio id='1' type='none'/>
Nov 13 18:50:30 user nova-compute[75216]:     <video>
Nov 13 18:50:30 user nova-compute[75216]:       <model type='virtio' heads='1' primary='yes'/>
Nov 13 18:50:30 user nova-compute[75216]:       <alias name='video0'/>
Nov 13 18:50:30 user nova-compute[75216]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 13 18:50:30 user nova-compute[75216]:     </video>
Nov 13 18:50:30 user nova-compute[75216]:     <memballoon model='virtio'>
Nov 13 18:50:30 user nova-compute[75216]:       <stats period='10'/>
Nov 13 18:50:30 user nova-compute[75216]:       <alias name='balloon0'/>
Nov 13 18:50:30 user nova-compute[75216]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 13 18:50:30 user nova-compute[75216]:     </memballoon>
Nov 13 18:50:30 user nova-compute[75216]:     <rng model='virtio'>
Nov 13 18:50:30 user nova-compute[75216]:       <backend model='random'>/dev/urandom</backend>
Nov 13 18:50:30 user nova-compute[75216]:       <alias name='rng0'/>
Nov 13 18:50:30 user nova-compute[75216]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 13 18:50:30 user nova-compute[75216]:     </rng>
Nov 13 18:50:30 user nova-compute[75216]:   </devices>
Nov 13 18:50:30 user nova-compute[75216]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 13 18:50:30 user nova-compute[75216]:     <label>libvirt-64dfe522-8b46-4df4-8032-591ce56900ec</label>
Nov 13 18:50:30 user nova-compute[75216]:     <imagelabel>libvirt-64dfe522-8b46-4df4-8032-591ce56900ec</imagelabel>
Nov 13 18:50:30 user nova-compute[75216]:   </seclabel>
Nov 13 18:50:30 user nova-compute[75216]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 13 18:50:30 user nova-compute[75216]:     <label>+64055:+108</label>
Nov 13 18:50:30 user nova-compute[75216]:     <imagelabel>+64055:+108</imagelabel>
Nov 13 18:50:30 user nova-compute[75216]:   </seclabel>
Nov 13 18:50:30 user nova-compute[75216]: </domain>
Nov 13 18:50:30 user nova-compute[75216]:  {{(pid=75216) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 13 18:50:30 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-7a9eeb07-c962-402e-81d1-03558f4f7028 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] Successfully detached device tap0b5d79f8-fc from instance 64dfe522-8b46-4df4-8032-591ce56900ec from the persistent domain config.
Nov 13 18:50:30 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-7a9eeb07-c962-402e-81d1-03558f4f7028 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] (1/8): Attempting to detach device tap0b5d79f8-fc with device alias net1 from instance 64dfe522-8b46-4df4-8032-591ce56900ec from the live domain config. {{(pid=75216) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 13 18:50:30 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-7a9eeb07-c962-402e-81d1-03558f4f7028 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] detach device xml: <interface type="ethernet">
Nov 13 18:50:30 user nova-compute[75216]:   <mac address="fa:16:3e:01:dc:62"/>
Nov 13 18:50:30 user nova-compute[75216]:   <model type="virtio"/>
Nov 13 18:50:30 user nova-compute[75216]:   <mtu size="1442"/>
Nov 13 18:50:30 user nova-compute[75216]:   <target dev="tap0b5d79f8-fc"/>
Nov 13 18:50:30 user nova-compute[75216]: </interface>
Nov 13 18:50:30 user nova-compute[75216]:  {{(pid=75216) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 18:50:30 user nova-compute[75216]: DEBUG nova.compute.manager [req-1901ba3c-fb27-412c-9181-29fb672732dc req-585b71a7-4cc4-477b-b9c5-844667374c50 service nova] [instance: 7c9d9c1b-6df5-41ff-a696-871e70d04e07] Received event network-vif-unplugged-c7fc6ea1-71ae-4068-b4a4-e3432a82cfad {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:50:30 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-1901ba3c-fb27-412c-9181-29fb672732dc req-585b71a7-4cc4-477b-b9c5-844667374c50 service nova] Acquiring lock "7c9d9c1b-6df5-41ff-a696-871e70d04e07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:50:30 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-1901ba3c-fb27-412c-9181-29fb672732dc req-585b71a7-4cc4-477b-b9c5-844667374c50 service nova] Lock "7c9d9c1b-6df5-41ff-a696-871e70d04e07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:50:30 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-1901ba3c-fb27-412c-9181-29fb672732dc req-585b71a7-4cc4-477b-b9c5-844667374c50 service nova] Lock "7c9d9c1b-6df5-41ff-a696-871e70d04e07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:50:30 user nova-compute[75216]: DEBUG nova.compute.manager [req-1901ba3c-fb27-412c-9181-29fb672732dc req-585b71a7-4cc4-477b-b9c5-844667374c50 service nova] [instance: 7c9d9c1b-6df5-41ff-a696-871e70d04e07] No waiting events found dispatching network-vif-unplugged-c7fc6ea1-71ae-4068-b4a4-e3432a82cfad {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:50:30 user nova-compute[75216]: WARNING nova.compute.manager [req-1901ba3c-fb27-412c-9181-29fb672732dc req-585b71a7-4cc4-477b-b9c5-844667374c50 service nova] [instance: 7c9d9c1b-6df5-41ff-a696-871e70d04e07] Received unexpected event network-vif-unplugged-c7fc6ea1-71ae-4068-b4a4-e3432a82cfad for instance with vm_state active and task_state rebuilding.
Nov 13 18:50:30 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:50:30 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:50:31 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:50:31 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-7a9eeb07-c962-402e-81d1-03558f4f7028 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] Start waiting for the detach event from libvirt for device tap0b5d79f8-fc with device alias net1 for instance 64dfe522-8b46-4df4-8032-591ce56900ec {{(pid=75216) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 13 18:50:31 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:50:31 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:50:31 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:50:31 user nova-compute[75216]: DEBUG nova.compute.manager [req-b86430b9-87d9-4008-8085-bea94778e077 req-9e4b788c-6771-4217-ae28-e2cf6b8bbc62 service nova] [instance: 64dfe522-8b46-4df4-8032-591ce56900ec] Received event network-vif-unplugged-0b5d79f8-fcb9-4bc8-b5e3-489fb6218824 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:50:31 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-b86430b9-87d9-4008-8085-bea94778e077 req-9e4b788c-6771-4217-ae28-e2cf6b8bbc62 service nova] Acquiring lock "64dfe522-8b46-4df4-8032-591ce56900ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:50:31 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-b86430b9-87d9-4008-8085-bea94778e077 req-9e4b788c-6771-4217-ae28-e2cf6b8bbc62 service nova] Lock "64dfe522-8b46-4df4-8032-591ce56900ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:50:31 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-b86430b9-87d9-4008-8085-bea94778e077 req-9e4b788c-6771-4217-ae28-e2cf6b8bbc62 service nova] Lock "64dfe522-8b46-4df4-8032-591ce56900ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:50:31 user nova-compute[75216]: DEBUG nova.compute.manager [req-b86430b9-87d9-4008-8085-bea94778e077 req-9e4b788c-6771-4217-ae28-e2cf6b8bbc62 service nova] [instance: 64dfe522-8b46-4df4-8032-591ce56900ec] No waiting events found dispatching network-vif-unplugged-0b5d79f8-fcb9-4bc8-b5e3-489fb6218824 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:50:31 user nova-compute[75216]: WARNING nova.compute.manager [req-b86430b9-87d9-4008-8085-bea94778e077 req-9e4b788c-6771-4217-ae28-e2cf6b8bbc62 service nova] [instance: 64dfe522-8b46-4df4-8032-591ce56900ec] Received unexpected event network-vif-unplugged-0b5d79f8-fcb9-4bc8-b5e3-489fb6218824 for instance with vm_state active and task_state None.
Nov 13 18:50:31 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 7c9d9c1b-6df5-41ff-a696-871e70d04e07] Instance destroyed successfully.
Nov 13 18:50:31 user nova-compute[75216]: INFO nova.compute.manager [None req-fb83f5f2-56de-47d0-921e-89df78a1e0d4 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: 7c9d9c1b-6df5-41ff-a696-871e70d04e07] Detaching volume 6c711796-fc49-4e18-8fdd-eefe1e3b357c
Nov 13 18:50:31 user nova-compute[75216]: INFO nova.virt.block_device [None req-fb83f5f2-56de-47d0-921e-89df78a1e0d4 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: 7c9d9c1b-6df5-41ff-a696-871e70d04e07] Attempting to driver detach volume 6c711796-fc49-4e18-8fdd-eefe1e3b357c from mountpoint /dev/vdb
Nov 13 18:50:31 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-fb83f5f2-56de-47d0-921e-89df78a1e0d4 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Attempting to detach device vdb from instance 7c9d9c1b-6df5-41ff-a696-871e70d04e07 from the persistent domain config. {{(pid=75216) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 13 18:50:31 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-fb83f5f2-56de-47d0-921e-89df78a1e0d4 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 18:50:31 user nova-compute[75216]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 18:50:31 user nova-compute[75216]:   <source dev="/dev/sdf"/>
Nov 13 18:50:31 user nova-compute[75216]:   <target dev="vdb" bus="virtio"/>
Nov 13 18:50:31 user nova-compute[75216]:   <serial>6c711796-fc49-4e18-8fdd-eefe1e3b357c</serial>
Nov 13 18:50:31 user nova-compute[75216]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 18:50:31 user nova-compute[75216]: </disk>
Nov 13 18:50:31 user nova-compute[75216]:  {{(pid=75216) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 18:50:31 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-fb83f5f2-56de-47d0-921e-89df78a1e0d4 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Successfully detached device vdb from instance 7c9d9c1b-6df5-41ff-a696-871e70d04e07 from the persistent domain config.
Nov 13 18:50:31 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fb83f5f2-56de-47d0-921e-89df78a1e0d4 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: 7c9d9c1b-6df5-41ff-a696-871e70d04e07] calling os-brick to detach iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 18:50:31 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb83f5f2-56de-47d0-921e-89df78a1e0d4 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3a8669e40>, {'target_iqn': 'iqn.2010-10.org.openstack:6c711796-fc49-4e18-8fdd-eefe1e3b357c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yaDuxRtQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 18:50:31 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-fb83f5f2-56de-47d0-921e-89df78a1e0d4 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 13 18:50:31 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-fb83f5f2-56de-47d0-921e-89df78a1e0d4 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 18:50:31 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-fb83f5f2-56de-47d0-921e-89df78a1e0d4 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 18:50:31 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:50:31 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:50:31 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7f084c9-e42d-49c7-bbbb-3e42f2c6c62c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bf4e9e60-f40d-49e0-8234-ae45c23b695b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6c711796-fc49-4e18-8fdd-eefe1e3b357c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ae66a157-b0d3-4501-a728-a010d6a83a10\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:50:31 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb83f5f2-56de-47d0-921e-89df78a1e0d4 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 18:50:31 user nova-compute[75216]: No targets found.
Nov 13 18:50:31 user nova-compute[75216]: iSNS:
Nov 13 18:50:31 user nova-compute[75216]: No targets found.
Nov 13 18:50:31 user nova-compute[75216]: STATIC:
Nov 13 18:50:31 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:bf4e9e60-f40d-49e0-8234-ae45c23b695b
Nov 13 18:50:31 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 18:50:31 user nova-compute[75216]:                 Iface Name: default
Nov 13 18:50:31 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:6c711796-fc49-4e18-8fdd-eefe1e3b357c
Nov 13 18:50:31 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 18:50:31 user nova-compute[75216]:                 Iface Name: default
Nov 13 18:50:31 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac
Nov 13 18:50:31 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 18:50:31 user nova-compute[75216]:                 Iface Name: default
Nov 13 18:50:31 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:ae66a157-b0d3-4501-a728-a010d6a83a10
Nov 13 18:50:31 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 18:50:31 user nova-compute[75216]:                 Iface Name: default
Nov 13 18:50:31 user nova-compute[75216]: FIRMWARE:
Nov 13 18:50:31 user nova-compute[75216]: No targets found.
Nov 13 18:50:31 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 18:50:31 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb83f5f2-56de-47d0-921e-89df78a1e0d4 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 18:50:31 user nova-compute[75216]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 18:50:31 user nova-compute[75216]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75216) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 18:50:31 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb83f5f2-56de-47d0-921e-89df78a1e0d4 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6c711796-fc49-4e18-8fdd-eefe1e3b357c', 0)] {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 18:50:31 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:50:31 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:50:31 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[59e2b281-236d-44fb-94a6-e876ed8e2f69]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6c711796-fc49-4e18-8fdd-eefe1e3b357c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ae66a157-b0d3-4501-a728-a010d6a83a10\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf4e9e60-f40d-49e0-8234-ae45c23b695b\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:50:31 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:50:31 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:50:31 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bcdb02d-1736-46fe-91c5-ca6a992dfa6f]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf4e9e60-f40d-49e0-8234-ae45c23b695b (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae66a157-b0d3-4501-a728-a010d6a83a10 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c711796-fc49-4e18-8fdd-eefe1e3b357c (non-flash)\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:50:31 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb83f5f2-56de-47d0-921e-89df78a1e0d4 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf4e9e60-f40d-49e0-8234-ae45c23b695b (non-flash)
Nov 13 18:50:31 user nova-compute[75216]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae66a157-b0d3-4501-a728-a010d6a83a10 (non-flash)
Nov 13 18:50:31 user nova-compute[75216]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac (non-flash)
Nov 13 18:50:31 user nova-compute[75216]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c711796-fc49-4e18-8fdd-eefe1e3b357c (non-flash)
Nov 13 18:50:31 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 18:50:31 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb83f5f2-56de-47d0-921e-89df78a1e0d4 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf4e9e60-f40d-49e0-8234-ae45c23b695b (non-flash)
Nov 13 18:50:31 user nova-compute[75216]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae66a157-b0d3-4501-a728-a010d6a83a10 (non-flash)
Nov 13 18:50:31 user nova-compute[75216]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac (non-flash)
Nov 13 18:50:31 user nova-compute[75216]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c711796-fc49-4e18-8fdd-eefe1e3b357c (non-flash)
Nov 13 18:50:31 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 18:50:31 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb83f5f2-56de-47d0-921e-89df78a1e0d4 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe3a817ce50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6c711796-fc49-4e18-8fdd-eefe1e3b357c'): ({'sdf'}, set())}) {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 18:50:31 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-fb83f5f2-56de-47d0-921e-89df78a1e0d4 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Removing single pathed devices sdf {{(pid=75216) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 18:50:31 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:50:31 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:50:31 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[54f61e85-df15-48ea-af89-3baf6144c167]: (4, ('path checker states:\nup                  3\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:50:31 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:50:31 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:50:31 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a1553d8-68e9-410c-8f0f-d8cb98d85644]: (4, ('ok\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:50:31 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-fb83f5f2-56de-47d0-921e-89df78a1e0d4 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Flushing IO for device /dev/sdf {{(pid=75216) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 18:50:31 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:50:31 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:50:31 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef0acc04-25c9-4de1-97cc-b761594f533f]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:50:31 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-fb83f5f2-56de-47d0-921e-89df78a1e0d4 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75216) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 18:50:31 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:50:31 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.033s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:50:31 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[34a30b8b-9594-41e3-a1cf-e580ae7f2424]: (4, ('1', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:50:31 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-fb83f5f2-56de-47d0-921e-89df78a1e0d4 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 18:50:31 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-fb83f5f2-56de-47d0-921e-89df78a1e0d4 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] SCSI volumes sdf have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 18:50:31 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb83f5f2-56de-47d0-921e-89df78a1e0d4 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6c711796-fc49-4e18-8fdd-eefe1e3b357c')] {{(pid=75216) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 18:50:31 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c711796-fc49-4e18-8fdd-eefe1e3b357c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:50:31 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c711796-fc49-4e18-8fdd-eefe1e3b357c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:50:31 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d166862-9b0b-416d-bf63-d2a69b1c86aa]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:50:31 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb83f5f2-56de-47d0-921e-89df78a1e0d4 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:50:31 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c711796-fc49-4e18-8fdd-eefe1e3b357c -p 172.16.0.220:3260 --logout {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:50:31 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c711796-fc49-4e18-8fdd-eefe1e3b357c -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:50:31 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[b45ecc33-1ddd-459a-bfaa-74a5dac5ca6c]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:6c711796-fc49-4e18-8fdd-eefe1e3b357c, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:6c711796-fc49-4e18-8fdd-eefe1e3b357c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:50:31 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb83f5f2-56de-47d0-921e-89df78a1e0d4 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:6c711796-fc49-4e18-8fdd-eefe1e3b357c, portal: 172.16.0.220,3260]
Nov 13 18:50:31 user nova-compute[75216]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:6c711796-fc49-4e18-8fdd-eefe1e3b357c, portal: 172.16.0.220,3260] successful.
Nov 13 18:50:31 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:50:31 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c711796-fc49-4e18-8fdd-eefe1e3b357c -p 172.16.0.220:3260 --op delete {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:50:31 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c711796-fc49-4e18-8fdd-eefe1e3b357c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:50:31 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a15a702-f8ce-4c73-9d81-c1e346a47d16]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:50:31 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb83f5f2-56de-47d0-921e-89df78a1e0d4 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:50:31 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-fb83f5f2-56de-47d0-921e-89df78a1e0d4 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.270s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 18:50:31 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb83f5f2-56de-47d0-921e-89df78a1e0d4 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] <== disconnect_volume: return (272ms) None {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 18:50:31 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fb83f5f2-56de-47d0-921e-89df78a1e0d4 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: 7c9d9c1b-6df5-41ff-a696-871e70d04e07] Disconnected iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 18:50:32 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 7c9d9c1b-6df5-41ff-a696-871e70d04e07] Instance destroyed successfully.
Nov 13 18:50:32 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-fb83f5f2-56de-47d0-921e-89df78a1e0d4 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T18:48:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1402749069',display_name='tempest-ServerActionsTestOtherA-server-704140763',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1402749069',id=15,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB3Ae+ECFlA3sYuvUiY4zZUqwlHO9GOkN+S3EitsaTvPnKHRwjJAlSh4xDkptEhbxWjHAYqFkukQp4RTJQ+f+V7vYOIcvfMMYXH7rnQu72lMH/fbmDohZCVr2iSodUm4lA==',key_name='tempest-keypair-773824062',keypairs=<?>,launch_index=0,launched_at=2023-11-13T18:48:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b9b7e11038e54e368acd22d06e54a351',ramdisk_id='',reservation_id='r-2lvnqzq7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-537419316',owner_user_name='tempest-ServerActionsTestOtherA-537419316-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T18:50:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='23f029ff09464d699e5bd6dbf44a905d',uuid=7c9d9c1b-6df5-41ff-a696-871e70d04e07,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c7fc6ea1-71ae-4068-b4a4-e3432a82cfad", "address": "fa:16:3e:57:f0:d2", "network": {"id": "d7a691f0-4495-40ad-a349-91b5dc9c635a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-961583097-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9b7e11038e54e368acd22d06e54a351", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7fc6ea1-71", "ovs_interfaceid": "c7fc6ea1-71ae-4068-b4a4-e3432a82cfad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 18:50:32 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-fb83f5f2-56de-47d0-921e-89df78a1e0d4 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Converting VIF {"id": "c7fc6ea1-71ae-4068-b4a4-e3432a82cfad", "address": "fa:16:3e:57:f0:d2", "network": {"id": "d7a691f0-4495-40ad-a349-91b5dc9c635a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-961583097-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9b7e11038e54e368acd22d06e54a351", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7fc6ea1-71", "ovs_interfaceid": "c7fc6ea1-71ae-4068-b4a4-e3432a82cfad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 18:50:32 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-fb83f5f2-56de-47d0-921e-89df78a1e0d4 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:57:f0:d2,bridge_name='br-int',has_traffic_filtering=True,id=c7fc6ea1-71ae-4068-b4a4-e3432a82cfad,network=Network(d7a691f0-4495-40ad-a349-91b5dc9c635a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7fc6ea1-71') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 18:50:32 user nova-compute[75216]: DEBUG os_vif [None req-fb83f5f2-56de-47d0-921e-89df78a1e0d4 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:57:f0:d2,bridge_name='br-int',has_traffic_filtering=True,id=c7fc6ea1-71ae-4068-b4a4-e3432a82cfad,network=Network(d7a691f0-4495-40ad-a349-91b5dc9c635a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7fc6ea1-71') {{(pid=75216) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 18:50:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:50:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc7fc6ea1-71, bridge=br-int, if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:50:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:50:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:50:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:50:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:50:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b0501ac1-0741-499d-9db2-cf8889f1b954) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:50:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:50:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:50:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:50:32 user nova-compute[75216]: INFO os_vif [None req-fb83f5f2-56de-47d0-921e-89df78a1e0d4 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:57:f0:d2,bridge_name='br-int',has_traffic_filtering=True,id=c7fc6ea1-71ae-4068-b4a4-e3432a82cfad,network=Network(d7a691f0-4495-40ad-a349-91b5dc9c635a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7fc6ea1-71')
Nov 13 18:50:32 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fb83f5f2-56de-47d0-921e-89df78a1e0d4 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: 7c9d9c1b-6df5-41ff-a696-871e70d04e07] calling os-brick to detach iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 18:50:32 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb83f5f2-56de-47d0-921e-89df78a1e0d4 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3a8669e40>, {'target_iqn': 'iqn.2010-10.org.openstack:6c711796-fc49-4e18-8fdd-eefe1e3b357c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yaDuxRtQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 18:50:32 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-fb83f5f2-56de-47d0-921e-89df78a1e0d4 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 13 18:50:32 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-fb83f5f2-56de-47d0-921e-89df78a1e0d4 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 18:50:32 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-fb83f5f2-56de-47d0-921e-89df78a1e0d4 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 18:50:32 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:50:32 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:50:32 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a40a65f-7ab8-4b4d-982f-81d40eea6e46]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bf4e9e60-f40d-49e0-8234-ae45c23b695b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ae66a157-b0d3-4501-a728-a010d6a83a10\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:50:32 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb83f5f2-56de-47d0-921e-89df78a1e0d4 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 18:50:32 user nova-compute[75216]: No targets found.
Nov 13 18:50:32 user nova-compute[75216]: iSNS:
Nov 13 18:50:32 user nova-compute[75216]: No targets found.
Nov 13 18:50:32 user nova-compute[75216]: STATIC:
Nov 13 18:50:32 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:bf4e9e60-f40d-49e0-8234-ae45c23b695b
Nov 13 18:50:32 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 18:50:32 user nova-compute[75216]:                 Iface Name: default
Nov 13 18:50:32 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac
Nov 13 18:50:32 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 18:50:32 user nova-compute[75216]:                 Iface Name: default
Nov 13 18:50:32 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:ae66a157-b0d3-4501-a728-a010d6a83a10
Nov 13 18:50:32 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 18:50:32 user nova-compute[75216]:                 Iface Name: default
Nov 13 18:50:32 user nova-compute[75216]: FIRMWARE:
Nov 13 18:50:32 user nova-compute[75216]: No targets found.
Nov 13 18:50:32 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 18:50:32 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb83f5f2-56de-47d0-921e-89df78a1e0d4 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 18:50:32 user nova-compute[75216]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 18:50:32 user nova-compute[75216]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75216) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 18:50:32 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb83f5f2-56de-47d0-921e-89df78a1e0d4 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6c711796-fc49-4e18-8fdd-eefe1e3b357c', 0)] {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 18:50:32 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:50:32 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:50:32 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[045e77f9-e20a-4166-843d-0daf1761cb27]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ae66a157-b0d3-4501-a728-a010d6a83a10\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf4e9e60-f40d-49e0-8234-ae45c23b695b\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:50:32 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:50:32 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:50:32 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa31bd95-a9d7-45b5-b824-e13c6e6a5e2b]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf4e9e60-f40d-49e0-8234-ae45c23b695b (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae66a157-b0d3-4501-a728-a010d6a83a10 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac (non-flash)\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:50:32 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb83f5f2-56de-47d0-921e-89df78a1e0d4 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf4e9e60-f40d-49e0-8234-ae45c23b695b (non-flash)
Nov 13 18:50:32 user nova-compute[75216]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae66a157-b0d3-4501-a728-a010d6a83a10 (non-flash)
Nov 13 18:50:32 user nova-compute[75216]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac (non-flash)
Nov 13 18:50:32 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 18:50:32 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb83f5f2-56de-47d0-921e-89df78a1e0d4 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf4e9e60-f40d-49e0-8234-ae45c23b695b (non-flash)
Nov 13 18:50:32 user nova-compute[75216]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae66a157-b0d3-4501-a728-a010d6a83a10 (non-flash)
Nov 13 18:50:32 user nova-compute[75216]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac (non-flash)
Nov 13 18:50:32 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 18:50:32 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb83f5f2-56de-47d0-921e-89df78a1e0d4 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe3a817d3f0>, {}) {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 18:50:32 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb83f5f2-56de-47d0-921e-89df78a1e0d4 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Disconnecting from: [] {{(pid=75216) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 18:50:32 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-fb83f5f2-56de-47d0-921e-89df78a1e0d4 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.071s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 18:50:32 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb83f5f2-56de-47d0-921e-89df78a1e0d4 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] <== disconnect_volume: return (72ms) None {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 18:50:32 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fb83f5f2-56de-47d0-921e-89df78a1e0d4 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: 7c9d9c1b-6df5-41ff-a696-871e70d04e07] Disconnected iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 18:50:32 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-fb83f5f2-56de-47d0-921e-89df78a1e0d4 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: 7c9d9c1b-6df5-41ff-a696-871e70d04e07] Deleting instance files /opt/stack/data/nova/instances/7c9d9c1b-6df5-41ff-a696-871e70d04e07_del
Nov 13 18:50:32 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-fb83f5f2-56de-47d0-921e-89df78a1e0d4 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: 7c9d9c1b-6df5-41ff-a696-871e70d04e07] Deletion of /opt/stack/data/nova/instances/7c9d9c1b-6df5-41ff-a696-871e70d04e07_del complete
Nov 13 18:50:32 user nova-compute[75216]: INFO nova.virt.block_device [None req-fb83f5f2-56de-47d0-921e-89df78a1e0d4 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: 7c9d9c1b-6df5-41ff-a696-871e70d04e07] Booting with volume 6c711796-fc49-4e18-8fdd-eefe1e3b357c at /dev/vdb
Nov 13 18:50:32 user nova-compute[75216]: DEBUG nova.compute.manager [req-9a84126f-a47d-4366-b568-b605c0a61320 req-16e04b54-fbc1-49b3-b27a-f3db9e744ab7 service nova] [instance: 7c9d9c1b-6df5-41ff-a696-871e70d04e07] Received event network-vif-plugged-c7fc6ea1-71ae-4068-b4a4-e3432a82cfad {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:50:32 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-9a84126f-a47d-4366-b568-b605c0a61320 req-16e04b54-fbc1-49b3-b27a-f3db9e744ab7 service nova] Acquiring lock "7c9d9c1b-6df5-41ff-a696-871e70d04e07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:50:32 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-9a84126f-a47d-4366-b568-b605c0a61320 req-16e04b54-fbc1-49b3-b27a-f3db9e744ab7 service nova] Lock "7c9d9c1b-6df5-41ff-a696-871e70d04e07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:50:32 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-9a84126f-a47d-4366-b568-b605c0a61320 req-16e04b54-fbc1-49b3-b27a-f3db9e744ab7 service nova] Lock "7c9d9c1b-6df5-41ff-a696-871e70d04e07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:50:32 user nova-compute[75216]: DEBUG nova.compute.manager [req-9a84126f-a47d-4366-b568-b605c0a61320 req-16e04b54-fbc1-49b3-b27a-f3db9e744ab7 service nova] [instance: 7c9d9c1b-6df5-41ff-a696-871e70d04e07] No waiting events found dispatching network-vif-plugged-c7fc6ea1-71ae-4068-b4a4-e3432a82cfad {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:50:32 user nova-compute[75216]: WARNING nova.compute.manager [req-9a84126f-a47d-4366-b568-b605c0a61320 req-16e04b54-fbc1-49b3-b27a-f3db9e744ab7 service nova] [instance: 7c9d9c1b-6df5-41ff-a696-871e70d04e07] Received unexpected event network-vif-plugged-c7fc6ea1-71ae-4068-b4a4-e3432a82cfad for instance with vm_state active and task_state rebuild_block_device_mapping.
Nov 13 18:50:32 user nova-compute[75216]: DEBUG os_brick.utils [None req-fb83f5f2-56de-47d0-921e-89df78a1e0d4 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 18:50:32 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:50:32 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:50:32 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[57386df6-3bbd-4fa7-b2dd-6e6c52419b3e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aea6fcfe14b9\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:50:32 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:50:32 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:50:32 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[789ca091-1f0a-4d67-86a7-92de66e6cddf]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:50:32 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:50:32 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:50:32 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[d28ed21a-02fa-430b-8274-e09b30582e25]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:50:32 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[818abb0e-e638-46e4-befa-4b695a5a3a45]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:50:32 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-fb83f5f2-56de-47d0-921e-89df78a1e0d4 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Running cmd (subprocess): nvme version {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:50:32 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-fb83f5f2-56de-47d0-921e-89df78a1e0d4 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] 'nvme version' failed. Not Retrying. {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 18:50:32 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fb83f5f2-56de-47d0-921e-89df78a1e0d4 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] nvme not present on system {{(pid=75216) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 18:50:32 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:50:32 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 18:50:32 user nova-compute[75216]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 18:50:32 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[71303b18-3539-4161-82ab-59e765d0b826]: (4, '') {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:50:33 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-fb83f5f2-56de-47d0-921e-89df78a1e0d4 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75216) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 18:50:33 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-fb83f5f2-56de-47d0-921e-89df78a1e0d4 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 18:50:33 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-fb83f5f2-56de-47d0-921e-89df78a1e0d4 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] LIGHTOS: no hostnqn found. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 18:50:33 user nova-compute[75216]: DEBUG os_brick.utils [None req-fb83f5f2-56de-47d0-921e-89df78a1e0d4 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] <== get_connector_properties: return (107ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aea6fcfe14b9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 18:50:33 user nova-compute[75216]: DEBUG nova.virt.block_device [None req-fb83f5f2-56de-47d0-921e-89df78a1e0d4 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: 7c9d9c1b-6df5-41ff-a696-871e70d04e07] Updating existing volume attachment record: a66cd442-3583-46b0-a60a-5e24b1398721 {{(pid=75216) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 18:50:33 user nova-compute[75216]: DEBUG nova.compute.manager [req-84b6c39d-6ff3-496e-bcc8-017fb82ffebd req-9c684dc5-4019-4886-acc9-aaa7ee2cf5a0 service nova] [instance: 64dfe522-8b46-4df4-8032-591ce56900ec] Received event network-vif-plugged-0b5d79f8-fcb9-4bc8-b5e3-489fb6218824 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:50:33 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-84b6c39d-6ff3-496e-bcc8-017fb82ffebd req-9c684dc5-4019-4886-acc9-aaa7ee2cf5a0 service nova] Acquiring lock "64dfe522-8b46-4df4-8032-591ce56900ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:50:33 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-84b6c39d-6ff3-496e-bcc8-017fb82ffebd req-9c684dc5-4019-4886-acc9-aaa7ee2cf5a0 service nova] Lock "64dfe522-8b46-4df4-8032-591ce56900ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:50:33 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-84b6c39d-6ff3-496e-bcc8-017fb82ffebd req-9c684dc5-4019-4886-acc9-aaa7ee2cf5a0 service nova] Lock "64dfe522-8b46-4df4-8032-591ce56900ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:50:33 user nova-compute[75216]: DEBUG nova.compute.manager [req-84b6c39d-6ff3-496e-bcc8-017fb82ffebd req-9c684dc5-4019-4886-acc9-aaa7ee2cf5a0 service nova] [instance: 64dfe522-8b46-4df4-8032-591ce56900ec] No waiting events found dispatching network-vif-plugged-0b5d79f8-fcb9-4bc8-b5e3-489fb6218824 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:50:33 user nova-compute[75216]: WARNING nova.compute.manager [req-84b6c39d-6ff3-496e-bcc8-017fb82ffebd req-9c684dc5-4019-4886-acc9-aaa7ee2cf5a0 service nova] [instance: 64dfe522-8b46-4df4-8032-591ce56900ec] Received unexpected event network-vif-plugged-0b5d79f8-fcb9-4bc8-b5e3-489fb6218824 for instance with vm_state active and task_state None.
Nov 13 18:50:33 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:50:36 user nova-compute[75216]: DEBUG nova.compute.manager [req-9db8db60-166d-4771-899a-a384ab668def req-03d5070a-a8dd-42a0-958a-c0f708717813 service nova] [instance: 3679beb0-5244-443a-8512-38b29ccb62f0] Received event network-changed-9dd60454-c5ac-4afe-b6fc-ad9ba9b83423 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:50:36 user nova-compute[75216]: DEBUG nova.compute.manager [req-9db8db60-166d-4771-899a-a384ab668def req-03d5070a-a8dd-42a0-958a-c0f708717813 service nova] [instance: 3679beb0-5244-443a-8512-38b29ccb62f0] Refreshing instance network info cache due to event network-changed-9dd60454-c5ac-4afe-b6fc-ad9ba9b83423. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 18:50:36 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-9db8db60-166d-4771-899a-a384ab668def req-03d5070a-a8dd-42a0-958a-c0f708717813 service nova] Acquiring lock "refresh_cache-3679beb0-5244-443a-8512-38b29ccb62f0" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 18:50:36 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-9db8db60-166d-4771-899a-a384ab668def req-03d5070a-a8dd-42a0-958a-c0f708717813 service nova] Acquired lock "refresh_cache-3679beb0-5244-443a-8512-38b29ccb62f0" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 18:50:36 user nova-compute[75216]: DEBUG nova.network.neutron [req-9db8db60-166d-4771-899a-a384ab668def req-03d5070a-a8dd-42a0-958a-c0f708717813 service nova] [instance: 3679beb0-5244-443a-8512-38b29ccb62f0] Refreshing network info cache for port 9dd60454-c5ac-4afe-b6fc-ad9ba9b83423 {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 18:50:36 user nova-compute[75216]: DEBUG nova.network.neutron [req-9db8db60-166d-4771-899a-a384ab668def req-03d5070a-a8dd-42a0-958a-c0f708717813 service nova] [instance: 3679beb0-5244-443a-8512-38b29ccb62f0] Updated VIF entry in instance network info cache for port 9dd60454-c5ac-4afe-b6fc-ad9ba9b83423. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 18:50:36 user nova-compute[75216]: DEBUG nova.network.neutron [req-9db8db60-166d-4771-899a-a384ab668def req-03d5070a-a8dd-42a0-958a-c0f708717813 service nova] [instance: 3679beb0-5244-443a-8512-38b29ccb62f0] Updating instance_info_cache with network_info: [{"id": "9dd60454-c5ac-4afe-b6fc-ad9ba9b83423", "address": "fa:16:3e:f0:11:a2", "network": {"id": "36f9d4ef-d504-457e-be5c-873fd634988f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-998310827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f28b10790a0548b785d2242360d631b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dd60454-c5", "ovs_interfaceid": "9dd60454-c5ac-4afe-b6fc-ad9ba9b83423", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 18:50:36 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-9db8db60-166d-4771-899a-a384ab668def req-03d5070a-a8dd-42a0-958a-c0f708717813 service nova] Releasing lock "refresh_cache-3679beb0-5244-443a-8512-38b29ccb62f0" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 18:50:37 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-fb83f5f2-56de-47d0-921e-89df78a1e0d4 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: 7c9d9c1b-6df5-41ff-a696-871e70d04e07] Creating instance directory {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 18:50:37 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-fb83f5f2-56de-47d0-921e-89df78a1e0d4 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: 7c9d9c1b-6df5-41ff-a696-871e70d04e07] Creating image(s)
Nov 13 18:50:37 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-fb83f5f2-56de-47d0-921e-89df78a1e0d4 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Acquiring lock "/opt/stack/data/nova/instances/7c9d9c1b-6df5-41ff-a696-871e70d04e07/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:50:37 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-fb83f5f2-56de-47d0-921e-89df78a1e0d4 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Lock "/opt/stack/data/nova/instances/7c9d9c1b-6df5-41ff-a696-871e70d04e07/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:50:37 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-fb83f5f2-56de-47d0-921e-89df78a1e0d4 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Lock "/opt/stack/data/nova/instances/7c9d9c1b-6df5-41ff-a696-871e70d04e07/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:50:37 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-fb83f5f2-56de-47d0-921e-89df78a1e0d4 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:50:37 user nova-compute[75216]: INFO nova.compute.manager [None req-8a48967c-512e-49d6-84c1-3e2ed4ffcda4 tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] [instance: 3679beb0-5244-443a-8512-38b29ccb62f0] Rebuilding instance
Nov 13 18:50:37 user nova-compute[75216]: DEBUG nova.compute.manager [None req-8a48967c-512e-49d6-84c1-3e2ed4ffcda4 tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] [instance: 3679beb0-5244-443a-8512-38b29ccb62f0] Checking state {{(pid=75216) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 18:50:37 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-fb83f5f2-56de-47d0-921e-89df78a1e0d4 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json" returned: 0 in 0.182s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:50:37 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-fb83f5f2-56de-47d0-921e-89df78a1e0d4 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Acquiring lock "88c50a45bec9d6b0427462b3242b9b8e5f49c2b6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:50:37 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-fb83f5f2-56de-47d0-921e-89df78a1e0d4 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Lock "88c50a45bec9d6b0427462b3242b9b8e5f49c2b6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:50:37 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-fb83f5f2-56de-47d0-921e-89df78a1e0d4 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:50:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:50:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:50:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:50:37 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-fb83f5f2-56de-47d0-921e-89df78a1e0d4 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json" returned: 0 in 0.182s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:50:37 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-fb83f5f2-56de-47d0-921e-89df78a1e0d4 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6,backing_fmt=raw /opt/stack/data/nova/instances/7c9d9c1b-6df5-41ff-a696-871e70d04e07/disk 1073741824 {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:50:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:50:37 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-fb83f5f2-56de-47d0-921e-89df78a1e0d4 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6,backing_fmt=raw /opt/stack/data/nova/instances/7c9d9c1b-6df5-41ff-a696-871e70d04e07/disk 1073741824" returned: 0 in 0.059s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:50:37 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-fb83f5f2-56de-47d0-921e-89df78a1e0d4 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Lock "88c50a45bec9d6b0427462b3242b9b8e5f49c2b6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:50:37 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-fb83f5f2-56de-47d0-921e-89df78a1e0d4 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:50:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:50:37 user nova-compute[75216]: DEBUG nova.compute.manager [req-1ec2f345-47cf-47c8-9302-ddd245fb0ae1 req-5ec614b5-5251-44f9-bacb-77fa7e562430 service nova] [instance: 3679beb0-5244-443a-8512-38b29ccb62f0] Received event network-vif-unplugged-9dd60454-c5ac-4afe-b6fc-ad9ba9b83423 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:50:37 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-1ec2f345-47cf-47c8-9302-ddd245fb0ae1 req-5ec614b5-5251-44f9-bacb-77fa7e562430 service nova] Acquiring lock "3679beb0-5244-443a-8512-38b29ccb62f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:50:37 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-1ec2f345-47cf-47c8-9302-ddd245fb0ae1 req-5ec614b5-5251-44f9-bacb-77fa7e562430 service nova] Lock "3679beb0-5244-443a-8512-38b29ccb62f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:50:37 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-1ec2f345-47cf-47c8-9302-ddd245fb0ae1 req-5ec614b5-5251-44f9-bacb-77fa7e562430 service nova] Lock "3679beb0-5244-443a-8512-38b29ccb62f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:50:37 user nova-compute[75216]: DEBUG nova.compute.manager [req-1ec2f345-47cf-47c8-9302-ddd245fb0ae1 req-5ec614b5-5251-44f9-bacb-77fa7e562430 service nova] [instance: 3679beb0-5244-443a-8512-38b29ccb62f0] No waiting events found dispatching network-vif-unplugged-9dd60454-c5ac-4afe-b6fc-ad9ba9b83423 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:50:37 user nova-compute[75216]: WARNING nova.compute.manager [req-1ec2f345-47cf-47c8-9302-ddd245fb0ae1 req-5ec614b5-5251-44f9-bacb-77fa7e562430 service nova] [instance: 3679beb0-5244-443a-8512-38b29ccb62f0] Received unexpected event network-vif-unplugged-9dd60454-c5ac-4afe-b6fc-ad9ba9b83423 for instance with vm_state active and task_state rebuilding.
Nov 13 18:50:37 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-fb83f5f2-56de-47d0-921e-89df78a1e0d4 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json" returned: 0 in 0.177s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:50:37 user nova-compute[75216]: DEBUG nova.virt.disk.api [None req-fb83f5f2-56de-47d0-921e-89df78a1e0d4 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7c9d9c1b-6df5-41ff-a696-871e70d04e07/disk. size=1073741824 {{(pid=75216) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 18:50:37 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-fb83f5f2-56de-47d0-921e-89df78a1e0d4 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c9d9c1b-6df5-41ff-a696-871e70d04e07/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:50:37 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-fb83f5f2-56de-47d0-921e-89df78a1e0d4 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c9d9c1b-6df5-41ff-a696-871e70d04e07/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:50:37 user nova-compute[75216]: DEBUG nova.virt.disk.api [None req-fb83f5f2-56de-47d0-921e-89df78a1e0d4 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Cannot resize image /opt/stack/data/nova/instances/7c9d9c1b-6df5-41ff-a696-871e70d04e07/disk to a smaller size. {{(pid=75216) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 18:50:37 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-fb83f5f2-56de-47d0-921e-89df78a1e0d4 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: 7c9d9c1b-6df5-41ff-a696-871e70d04e07] Created local disks {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 18:50:37 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-fb83f5f2-56de-47d0-921e-89df78a1e0d4 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: 7c9d9c1b-6df5-41ff-a696-871e70d04e07] Ensure instance console log exists: /opt/stack/data/nova/instances/7c9d9c1b-6df5-41ff-a696-871e70d04e07/console.log {{(pid=75216) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 18:50:37 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-fb83f5f2-56de-47d0-921e-89df78a1e0d4 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:50:37 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-fb83f5f2-56de-47d0-921e-89df78a1e0d4 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:50:37 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-fb83f5f2-56de-47d0-921e-89df78a1e0d4 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:50:37 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-fb83f5f2-56de-47d0-921e-89df78a1e0d4 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: 7c9d9c1b-6df5-41ff-a696-871e70d04e07] Start _get_guest_xml network_info=[{"id": "c7fc6ea1-71ae-4068-b4a4-e3432a82cfad", "address": "fa:16:3e:57:f0:d2", "network": {"id": "d7a691f0-4495-40ad-a349-91b5dc9c635a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-961583097-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9b7e11038e54e368acd22d06e54a351", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7fc6ea1-71", "ovs_interfaceid": "c7fc6ea1-71ae-4068-b4a4-e3432a82cfad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T18:41:06Z,direct_url=<?>,disk_format='qcow2',id=77bcb5ba-8510-41ec-a88d-96097bb431de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c465b7c26ec44582b6d1b7169536ecc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T18:41:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'guest_format': None, 'boot_index': 0, 'image_id': '77bcb5ba-8510-41ec-a88d-96097bb431de'}], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6c711796-fc49-4e18-8fdd-eefe1e3b357c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yaDuxRtQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7c9d9c1b-6df5-41ff-a696-871e70d04e07', 'attached_at': '', 'detached_at': '', 'volume_id': '6c711796-fc49-4e18-8fdd-eefe1e3b357c', 'serial': '6c711796-fc49-4e18-8fdd-eefe1e3b357c'}, 'attachment_id': 'a66cd442-3583-46b0-a60a-5e24b1398721', 'guest_format': None, 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'boot_index': None, 'volume_type': None} {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 18:50:37 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-fb83f5f2-56de-47d0-921e-89df78a1e0d4 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 13 18:50:37 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-fb83f5f2-56de-47d0-921e-89df78a1e0d4 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 13 18:50:37 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-fb83f5f2-56de-47d0-921e-89df78a1e0d4 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 18:50:37 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-fb83f5f2-56de-47d0-921e-89df78a1e0d4 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] CPU controller missing on host. {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 18:50:38 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-fb83f5f2-56de-47d0-921e-89df78a1e0d4 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 18:50:38 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-fb83f5f2-56de-47d0-921e-89df78a1e0d4 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] CPU controller found on host. {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 18:50:38 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-fb83f5f2-56de-47d0-921e-89df78a1e0d4 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75216) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 18:50:38 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-fb83f5f2-56de-47d0-921e-89df78a1e0d4 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T18:40:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T18:41:06Z,direct_url=<?>,disk_format='qcow2',id=77bcb5ba-8510-41ec-a88d-96097bb431de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c465b7c26ec44582b6d1b7169536ecc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T18:41:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 18:50:38 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-fb83f5f2-56de-47d0-921e-89df78a1e0d4 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Flavor limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 18:50:38 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-fb83f5f2-56de-47d0-921e-89df78a1e0d4 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Image limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 18:50:38 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-fb83f5f2-56de-47d0-921e-89df78a1e0d4 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Flavor pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 18:50:38 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-fb83f5f2-56de-47d0-921e-89df78a1e0d4 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Image pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 18:50:38 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-fb83f5f2-56de-47d0-921e-89df78a1e0d4 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 18:50:38 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-fb83f5f2-56de-47d0-921e-89df78a1e0d4 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 18:50:38 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-fb83f5f2-56de-47d0-921e-89df78a1e0d4 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 18:50:38 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-fb83f5f2-56de-47d0-921e-89df78a1e0d4 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Got 1 possible topologies {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 18:50:38 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-fb83f5f2-56de-47d0-921e-89df78a1e0d4 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 18:50:38 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-fb83f5f2-56de-47d0-921e-89df78a1e0d4 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 18:50:38 user nova-compute[75216]: DEBUG nova.objects.instance [None req-fb83f5f2-56de-47d0-921e-89df78a1e0d4 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Lazy-loading 'vcpu_model' on Instance uuid 7c9d9c1b-6df5-41ff-a696-871e70d04e07 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 18:50:38 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fb83f5f2-56de-47d0-921e-89df78a1e0d4 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: 7c9d9c1b-6df5-41ff-a696-871e70d04e07] Calling os-brick to attach iSCSI Volume {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 18:50:38 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb83f5f2-56de-47d0-921e-89df78a1e0d4 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3a8669e40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6c711796-fc49-4e18-8fdd-eefe1e3b357c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yaDuxRtQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 18:50:38 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-fb83f5f2-56de-47d0-921e-89df78a1e0d4 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 13 18:50:38 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-fb83f5f2-56de-47d0-921e-89df78a1e0d4 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 18:50:38 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-fb83f5f2-56de-47d0-921e-89df78a1e0d4 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 18:50:38 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-fb83f5f2-56de-47d0-921e-89df78a1e0d4 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 13 18:50:38 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-fb83f5f2-56de-47d0-921e-89df78a1e0d4 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6c711796-fc49-4e18-8fdd-eefe1e3b357c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 18:50:38 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-fb83f5f2-56de-47d0-921e-89df78a1e0d4 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6c711796-fc49-4e18-8fdd-eefe1e3b357c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 18:50:38 user nova-compute[75216]: INFO os_brick.initiator.connectors.iscsi [None req-fb83f5f2-56de-47d0-921e-89df78a1e0d4 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 18:50:38 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c711796-fc49-4e18-8fdd-eefe1e3b357c -p 172.16.0.220:3260 {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:50:38 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c711796-fc49-4e18-8fdd-eefe1e3b357c -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:50:38 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aad31c4-04dd-40df-9a89-2452efcfc656]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:50:38 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb83f5f2-56de-47d0-921e-89df78a1e0d4 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 18:50:38 user nova-compute[75216]:  {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:50:38 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c711796-fc49-4e18-8fdd-eefe1e3b357c -p 172.16.0.220:3260 --interface default --op new {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:50:38 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c711796-fc49-4e18-8fdd-eefe1e3b357c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:50:38 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[a78b2981-996e-4cc7-b5b3-08ce6b994aa8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6c711796-fc49-4e18-8fdd-eefe1e3b357c] added\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:50:38 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb83f5f2-56de-47d0-921e-89df78a1e0d4 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6c711796-fc49-4e18-8fdd-eefe1e3b357c] added
Nov 13 18:50:38 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:50:38 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c711796-fc49-4e18-8fdd-eefe1e3b357c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:50:38 user nova-compute[75216]: INFO nova.compute.manager [None req-b0999384-a23f-4d92-87c7-26af329a2181 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] [instance: 9b078f75-57f2-495a-abd5-f8adf72db80b] Unrescuing
Nov 13 18:50:38 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-b0999384-a23f-4d92-87c7-26af329a2181 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] Acquiring lock "refresh_cache-9b078f75-57f2-495a-abd5-f8adf72db80b" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 18:50:38 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-b0999384-a23f-4d92-87c7-26af329a2181 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] Acquired lock "refresh_cache-9b078f75-57f2-495a-abd5-f8adf72db80b" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 18:50:38 user nova-compute[75216]: DEBUG nova.network.neutron [None req-b0999384-a23f-4d92-87c7-26af329a2181 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] [instance: 9b078f75-57f2-495a-abd5-f8adf72db80b] Building network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 18:50:38 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c711796-fc49-4e18-8fdd-eefe1e3b357c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:50:38 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[99ae7e0a-64a5-41b9-a227-ca9c2f5bbd9d]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:50:38 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb83f5f2-56de-47d0-921e-89df78a1e0d4 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:50:38 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c711796-fc49-4e18-8fdd-eefe1e3b357c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:50:38 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 3679beb0-5244-443a-8512-38b29ccb62f0] Instance destroyed successfully.
Nov 13 18:50:38 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c711796-fc49-4e18-8fdd-eefe1e3b357c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:50:38 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ddde93e-9abd-459f-90c9-39a1667a2c5d]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:50:38 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb83f5f2-56de-47d0-921e-89df78a1e0d4 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:50:38 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c711796-fc49-4e18-8fdd-eefe1e3b357c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yaDuxRtQ {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:50:38 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 3679beb0-5244-443a-8512-38b29ccb62f0] Instance destroyed successfully.
Nov 13 18:50:38 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-8a48967c-512e-49d6-84c1-3e2ed4ffcda4 tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T18:48:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1810454113',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1139702488',id=16,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMERu/g7S2xD4fYqmzFAJXYDR7hKcSuIXV2v7GsKW6Fvu41/rKIsCoqYwYjeLuX+94gqfUJqutarG8qQbb/uJ1X4T/7CELwQc16iiSCVbNPYMOIZbGoMv5QgSdk5IEn2iA==',key_name='tempest-keypair-810733778',keypairs=<?>,launch_index=0,launched_at=2023-11-13T18:48:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f28b10790a0548b785d2242360d631b1',ramdisk_id='',reservation_id='r-gqrzdq0g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-980167634',owner_user_name='tempest-ServerActionsV293TestJSON-980167634-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T18:50:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b245d24d053e4504baa2670a3fe0b2b1',uuid=3679beb0-5244-443a-8512-38b29ccb62f0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9dd60454-c5ac-4afe-b6fc-ad9ba9b83423", "address": "fa:16:3e:f0:11:a2", "network": {"id": "36f9d4ef-d504-457e-be5c-873fd634988f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-998310827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f28b10790a0548b785d2242360d631b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dd60454-c5", "ovs_interfaceid": "9dd60454-c5ac-4afe-b6fc-ad9ba9b83423", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 18:50:38 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-8a48967c-512e-49d6-84c1-3e2ed4ffcda4 tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] Converting VIF {"id": "9dd60454-c5ac-4afe-b6fc-ad9ba9b83423", "address": "fa:16:3e:f0:11:a2", "network": {"id": "36f9d4ef-d504-457e-be5c-873fd634988f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-998310827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f28b10790a0548b785d2242360d631b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dd60454-c5", "ovs_interfaceid": "9dd60454-c5ac-4afe-b6fc-ad9ba9b83423", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 18:50:38 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-8a48967c-512e-49d6-84c1-3e2ed4ffcda4 tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f0:11:a2,bridge_name='br-int',has_traffic_filtering=True,id=9dd60454-c5ac-4afe-b6fc-ad9ba9b83423,network=Network(36f9d4ef-d504-457e-be5c-873fd634988f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9dd60454-c5') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 18:50:38 user nova-compute[75216]: DEBUG os_vif [None req-8a48967c-512e-49d6-84c1-3e2ed4ffcda4 tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f0:11:a2,bridge_name='br-int',has_traffic_filtering=True,id=9dd60454-c5ac-4afe-b6fc-ad9ba9b83423,network=Network(36f9d4ef-d504-457e-be5c-873fd634988f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9dd60454-c5') {{(pid=75216) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 18:50:38 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:50:38 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9dd60454-c5, bridge=br-int, if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:50:38 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c711796-fc49-4e18-8fdd-eefe1e3b357c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yaDuxRtQ" returned: 0 in 0.027s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:50:38 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1650aac-3fa6-4085-bdf2-3528f319d6c5]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:50:38 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb83f5f2-56de-47d0-921e-89df78a1e0d4 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yaDuxRtQ'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:50:38 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:50:38 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c711796-fc49-4e18-8fdd-eefe1e3b357c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:50:38 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:50:38 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:50:38 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8e7bf507-f7dc-495f-be3d-65ef292fa757) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:50:38 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:50:38 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:50:38 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:50:38 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c711796-fc49-4e18-8fdd-eefe1e3b357c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:50:38 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[6372d0f4-9737-4078-b3ff-2bf804987719]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:50:38 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb83f5f2-56de-47d0-921e-89df78a1e0d4 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:50:38 user nova-compute[75216]: INFO os_vif [None req-8a48967c-512e-49d6-84c1-3e2ed4ffcda4 tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f0:11:a2,bridge_name='br-int',has_traffic_filtering=True,id=9dd60454-c5ac-4afe-b6fc-ad9ba9b83423,network=Network(36f9d4ef-d504-457e-be5c-873fd634988f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9dd60454-c5')
Nov 13 18:50:38 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:50:38 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a48967c-512e-49d6-84c1-3e2ed4ffcda4 tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] [instance: 3679beb0-5244-443a-8512-38b29ccb62f0] calling os-brick to detach iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 18:50:38 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a48967c-512e-49d6-84c1-3e2ed4ffcda4 tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3a8669e40>, {'target_iqn': 'iqn.2010-10.org.openstack:ae66a157-b0d3-4501-a728-a010d6a83a10', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'buEowZlO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 18:50:38 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-8a48967c-512e-49d6-84c1-3e2ed4ffcda4 tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 13 18:50:38 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-8a48967c-512e-49d6-84c1-3e2ed4ffcda4 tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 18:50:38 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:50:38 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[07c9de88-564c-48f3-8599-43fe0874a2ac]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf4e9e60-f40d-49e0-8234-ae45c23b695b (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae66a157-b0d3-4501-a728-a010d6a83a10 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac (non-flash)\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:50:38 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb83f5f2-56de-47d0-921e-89df78a1e0d4 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf4e9e60-f40d-49e0-8234-ae45c23b695b (non-flash)
Nov 13 18:50:38 user nova-compute[75216]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae66a157-b0d3-4501-a728-a010d6a83a10 (non-flash)
Nov 13 18:50:38 user nova-compute[75216]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac (non-flash)
Nov 13 18:50:38 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 18:50:38 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb83f5f2-56de-47d0-921e-89df78a1e0d4 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf4e9e60-f40d-49e0-8234-ae45c23b695b (non-flash)
Nov 13 18:50:38 user nova-compute[75216]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae66a157-b0d3-4501-a728-a010d6a83a10 (non-flash)
Nov 13 18:50:38 user nova-compute[75216]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac (non-flash)
Nov 13 18:50:38 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 18:50:38 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c711796-fc49-4e18-8fdd-eefe1e3b357c -p 172.16.0.220:3260 --login {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:50:38 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:50:38 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c711796-fc49-4e18-8fdd-eefe1e3b357c -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:50:38 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c9d5947-d400-42f1-93df-58565e72635f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6c711796-fc49-4e18-8fdd-eefe1e3b357c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6c711796-fc49-4e18-8fdd-eefe1e3b357c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:50:38 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb83f5f2-56de-47d0-921e-89df78a1e0d4 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6c711796-fc49-4e18-8fdd-eefe1e3b357c, portal: 172.16.0.220,3260]
Nov 13 18:50:38 user nova-compute[75216]: Login to [iface: default, target: iqn.2010-10.org.openstack:6c711796-fc49-4e18-8fdd-eefe1e3b357c, portal: 172.16.0.220,3260] successful.
Nov 13 18:50:38 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:50:38 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c711796-fc49-4e18-8fdd-eefe1e3b357c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:50:38 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c711796-fc49-4e18-8fdd-eefe1e3b357c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:50:38 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[32e2ebb0-5d7a-4d54-8d8f-8a50b7f1f8c6]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:50:38 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb83f5f2-56de-47d0-921e-89df78a1e0d4 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:50:38 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:50:38 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:50:38 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[64826234-895d-4c9e-8ef3-ff5e8e497ed5]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf4e9e60-f40d-49e0-8234-ae45c23b695b (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae66a157-b0d3-4501-a728-a010d6a83a10 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c711796-fc49-4e18-8fdd-eefe1e3b357c (non-flash)\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:50:38 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb83f5f2-56de-47d0-921e-89df78a1e0d4 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf4e9e60-f40d-49e0-8234-ae45c23b695b (non-flash)
Nov 13 18:50:38 user nova-compute[75216]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae66a157-b0d3-4501-a728-a010d6a83a10 (non-flash)
Nov 13 18:50:38 user nova-compute[75216]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac (non-flash)
Nov 13 18:50:38 user nova-compute[75216]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c711796-fc49-4e18-8fdd-eefe1e3b357c (non-flash)
Nov 13 18:50:38 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 18:50:38 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb83f5f2-56de-47d0-921e-89df78a1e0d4 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf4e9e60-f40d-49e0-8234-ae45c23b695b (non-flash)
Nov 13 18:50:38 user nova-compute[75216]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae66a157-b0d3-4501-a728-a010d6a83a10 (non-flash)
Nov 13 18:50:38 user nova-compute[75216]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac (non-flash)
Nov 13 18:50:38 user nova-compute[75216]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c711796-fc49-4e18-8fdd-eefe1e3b357c (non-flash)
Nov 13 18:50:38 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 18:50:38 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-fb83f5f2-56de-47d0-921e-89df78a1e0d4 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6c711796-fc49-4e18-8fdd-eefe1e3b357c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.329s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 18:50:38 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb83f5f2-56de-47d0-921e-89df78a1e0d4 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Connected to 172.16.0.220:3260 {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 18:50:38 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-fb83f5f2-56de-47d0-921e-89df78a1e0d4 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] HCTL ('35', '-', '-', 0) found on session 23 with lun 0 {{(pid=75216) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 18:50:38 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-fb83f5f2-56de-47d0-921e-89df78a1e0d4 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75216) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 18:50:38 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:50:38 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:50:38 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75216) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 13 18:50:38 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:50:38 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[eae69aa7-e060-4b92-89bb-fa5cd87fe9a8]: (4, ('- - 0', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:50:38 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-fb83f5f2-56de-47d0-921e-89df78a1e0d4 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Searching for a device in session 23 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75216) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 18:50:38 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb83f5f2-56de-47d0-921e-89df78a1e0d4 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:6c711796-fc49-4e18-8fdd-eefe1e3b357c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yaDuxRtQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 18:50:38 user nova-compute[75216]: DEBUG nova.network.neutron [None req-b0999384-a23f-4d92-87c7-26af329a2181 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] [instance: 9b078f75-57f2-495a-abd5-f8adf72db80b] Updating instance_info_cache with network_info: [{"id": "96bda2a6-53d1-4052-9230-4907fe60d70b", "address": "fa:16:3e:30:88:c4", "network": {"id": "eac74a7f-b8a0-4653-82a9-1113186e7682", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1781360101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e76353a038ca478598ddd984f4503e34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96bda2a6-53", "ovs_interfaceid": "96bda2a6-53d1-4052-9230-4907fe60d70b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 18:50:38 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-b0999384-a23f-4d92-87c7-26af329a2181 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] Releasing lock "refresh_cache-9b078f75-57f2-495a-abd5-f8adf72db80b" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 18:50:38 user nova-compute[75216]: DEBUG nova.objects.instance [None req-b0999384-a23f-4d92-87c7-26af329a2181 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] Lazy-loading 'flavor' on Instance uuid 9b078f75-57f2-495a-abd5-f8adf72db80b {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 18:50:38 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:50:38 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:50:38 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:50:38 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:50:39 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-fb83f5f2-56de-47d0-921e-89df78a1e0d4 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.367s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 18:50:39 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb83f5f2-56de-47d0-921e-89df78a1e0d4 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] <== connect_volume: return (1369ms) {'type': 'block', 'scsi_wwn': '23663653965653233', 'path': '/dev/sdd'} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 18:50:39 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fb83f5f2-56de-47d0-921e-89df78a1e0d4 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: 7c9d9c1b-6df5-41ff-a696-871e70d04e07] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23663653965653233', 'path': '/dev/sdd'} {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 18:50:39 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-8a48967c-512e-49d6-84c1-3e2ed4ffcda4 tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.188s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 18:50:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:50:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:50:39 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[2df09e7e-afc8-407b-826a-ce69584efdfb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bf4e9e60-f40d-49e0-8234-ae45c23b695b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6c711796-fc49-4e18-8fdd-eefe1e3b357c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ae66a157-b0d3-4501-a728-a010d6a83a10\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:50:39 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a48967c-512e-49d6-84c1-3e2ed4ffcda4 tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 18:50:39 user nova-compute[75216]: No targets found.
Nov 13 18:50:39 user nova-compute[75216]: iSNS:
Nov 13 18:50:39 user nova-compute[75216]: No targets found.
Nov 13 18:50:39 user nova-compute[75216]: STATIC:
Nov 13 18:50:39 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:bf4e9e60-f40d-49e0-8234-ae45c23b695b
Nov 13 18:50:39 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 18:50:39 user nova-compute[75216]:                 Iface Name: default
Nov 13 18:50:39 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:6c711796-fc49-4e18-8fdd-eefe1e3b357c
Nov 13 18:50:39 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 18:50:39 user nova-compute[75216]:                 Iface Name: default
Nov 13 18:50:39 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac
Nov 13 18:50:39 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 18:50:39 user nova-compute[75216]:                 Iface Name: default
Nov 13 18:50:39 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:ae66a157-b0d3-4501-a728-a010d6a83a10
Nov 13 18:50:39 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 18:50:39 user nova-compute[75216]:                 Iface Name: default
Nov 13 18:50:39 user nova-compute[75216]: FIRMWARE:
Nov 13 18:50:39 user nova-compute[75216]: No targets found.
Nov 13 18:50:39 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 18:50:39 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a48967c-512e-49d6-84c1-3e2ed4ffcda4 tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 18:50:39 user nova-compute[75216]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 18:50:39 user nova-compute[75216]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75216) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 18:50:39 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a48967c-512e-49d6-84c1-3e2ed4ffcda4 tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ae66a157-b0d3-4501-a728-a010d6a83a10', 0)] {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 18:50:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:50:39 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-fb83f5f2-56de-47d0-921e-89df78a1e0d4 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-13T18:48:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1402749069',display_name='tempest-ServerActionsTestOtherA-server-704140763',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1402749069',id=15,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB3Ae+ECFlA3sYuvUiY4zZUqwlHO9GOkN+S3EitsaTvPnKHRwjJAlSh4xDkptEhbxWjHAYqFkukQp4RTJQ+f+V7vYOIcvfMMYXH7rnQu72lMH/fbmDohZCVr2iSodUm4lA==',key_name='tempest-keypair-773824062',keypairs=<?>,launch_index=0,launched_at=2023-11-13T18:48:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b9b7e11038e54e368acd22d06e54a351',ramdisk_id='',reservation_id='r-2lvnqzq7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-537419316',owner_user_name='tempest-ServerActionsTestOtherA-537419316-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T18:50:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='23f029ff09464d699e5bd6dbf44a905d',uuid=7c9d9c1b-6df5-41ff-a696-871e70d04e07,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c7fc6ea1-71ae-4068-b4a4-e3432a82cfad", "address": "fa:16:3e:57:f0:d2", "network": {"id": "d7a691f0-4495-40ad-a349-91b5dc9c635a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-961583097-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9b7e11038e54e368acd22d06e54a351", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7fc6ea1-71", "ovs_interfaceid": "c7fc6ea1-71ae-4068-b4a4-e3432a82cfad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75216) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 18:50:39 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-fb83f5f2-56de-47d0-921e-89df78a1e0d4 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Converting VIF {"id": "c7fc6ea1-71ae-4068-b4a4-e3432a82cfad", "address": "fa:16:3e:57:f0:d2", "network": {"id": "d7a691f0-4495-40ad-a349-91b5dc9c635a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-961583097-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9b7e11038e54e368acd22d06e54a351", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7fc6ea1-71", "ovs_interfaceid": "c7fc6ea1-71ae-4068-b4a4-e3432a82cfad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 18:50:39 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-fb83f5f2-56de-47d0-921e-89df78a1e0d4 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:57:f0:d2,bridge_name='br-int',has_traffic_filtering=True,id=c7fc6ea1-71ae-4068-b4a4-e3432a82cfad,network=Network(d7a691f0-4495-40ad-a349-91b5dc9c635a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7fc6ea1-71') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 18:50:39 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-fb83f5f2-56de-47d0-921e-89df78a1e0d4 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: 7c9d9c1b-6df5-41ff-a696-871e70d04e07] End _get_guest_xml xml=<domain type="kvm">
Nov 13 18:50:39 user nova-compute[75216]:   <uuid>7c9d9c1b-6df5-41ff-a696-871e70d04e07</uuid>
Nov 13 18:50:39 user nova-compute[75216]:   <name>instance-0000000f</name>
Nov 13 18:50:39 user nova-compute[75216]:   <memory>524288</memory>
Nov 13 18:50:39 user nova-compute[75216]:   <vcpu>1</vcpu>
Nov 13 18:50:39 user nova-compute[75216]:   <metadata>
Nov 13 18:50:39 user nova-compute[75216]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 18:50:39 user nova-compute[75216]:       <nova:package version="0.0.0"/>
Nov 13 18:50:39 user nova-compute[75216]:       <nova:name>tempest-ServerActionsTestOtherA-server-704140763</nova:name>
Nov 13 18:50:39 user nova-compute[75216]:       <nova:creationTime>2023-11-13 18:50:37</nova:creationTime>
Nov 13 18:50:39 user nova-compute[75216]:       <nova:flavor name="m1.tiny">
Nov 13 18:50:39 user nova-compute[75216]:         <nova:memory>512</nova:memory>
Nov 13 18:50:39 user nova-compute[75216]:         <nova:disk>1</nova:disk>
Nov 13 18:50:39 user nova-compute[75216]:         <nova:swap>0</nova:swap>
Nov 13 18:50:39 user nova-compute[75216]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 18:50:39 user nova-compute[75216]:         <nova:vcpus>1</nova:vcpus>
Nov 13 18:50:39 user nova-compute[75216]:       </nova:flavor>
Nov 13 18:50:39 user nova-compute[75216]:       <nova:owner>
Nov 13 18:50:39 user nova-compute[75216]:         <nova:user uuid="23f029ff09464d699e5bd6dbf44a905d">tempest-ServerActionsTestOtherA-537419316-project-member</nova:user>
Nov 13 18:50:39 user nova-compute[75216]:         <nova:project uuid="b9b7e11038e54e368acd22d06e54a351">tempest-ServerActionsTestOtherA-537419316</nova:project>
Nov 13 18:50:39 user nova-compute[75216]:       </nova:owner>
Nov 13 18:50:39 user nova-compute[75216]:       <nova:root type="image" uuid="77bcb5ba-8510-41ec-a88d-96097bb431de"/>
Nov 13 18:50:39 user nova-compute[75216]:       <nova:ports>
Nov 13 18:50:39 user nova-compute[75216]:         <nova:port uuid="c7fc6ea1-71ae-4068-b4a4-e3432a82cfad">
Nov 13 18:50:39 user nova-compute[75216]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 13 18:50:39 user nova-compute[75216]:         </nova:port>
Nov 13 18:50:39 user nova-compute[75216]:       </nova:ports>
Nov 13 18:50:39 user nova-compute[75216]:     </nova:instance>
Nov 13 18:50:39 user nova-compute[75216]:   </metadata>
Nov 13 18:50:39 user nova-compute[75216]:   <sysinfo type="smbios">
Nov 13 18:50:39 user nova-compute[75216]:     <system>
Nov 13 18:50:39 user nova-compute[75216]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 18:50:39 user nova-compute[75216]:       <entry name="product">OpenStack Nova</entry>
Nov 13 18:50:39 user nova-compute[75216]:       <entry name="version">0.0.0</entry>
Nov 13 18:50:39 user nova-compute[75216]:       <entry name="serial">7c9d9c1b-6df5-41ff-a696-871e70d04e07</entry>
Nov 13 18:50:39 user nova-compute[75216]:       <entry name="uuid">7c9d9c1b-6df5-41ff-a696-871e70d04e07</entry>
Nov 13 18:50:39 user nova-compute[75216]:       <entry name="family">Virtual Machine</entry>
Nov 13 18:50:39 user nova-compute[75216]:     </system>
Nov 13 18:50:39 user nova-compute[75216]:   </sysinfo>
Nov 13 18:50:39 user nova-compute[75216]:   <os>
Nov 13 18:50:39 user nova-compute[75216]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 18:50:39 user nova-compute[75216]:     <boot dev="hd"/>
Nov 13 18:50:39 user nova-compute[75216]:     <smbios mode="sysinfo"/>
Nov 13 18:50:39 user nova-compute[75216]:   </os>
Nov 13 18:50:39 user nova-compute[75216]:   <features>
Nov 13 18:50:39 user nova-compute[75216]:     <acpi/>
Nov 13 18:50:39 user nova-compute[75216]:     <apic/>
Nov 13 18:50:39 user nova-compute[75216]:     <vmcoreinfo/>
Nov 13 18:50:39 user nova-compute[75216]:   </features>
Nov 13 18:50:39 user nova-compute[75216]:   <clock offset="utc">
Nov 13 18:50:39 user nova-compute[75216]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 18:50:39 user nova-compute[75216]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 18:50:39 user nova-compute[75216]:     <timer name="hpet" present="no"/>
Nov 13 18:50:39 user nova-compute[75216]:   </clock>
Nov 13 18:50:39 user nova-compute[75216]:   <cpu mode="custom" match="exact">
Nov 13 18:50:39 user nova-compute[75216]:     <model>Nehalem</model>
Nov 13 18:50:39 user nova-compute[75216]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 18:50:39 user nova-compute[75216]:   </cpu>
Nov 13 18:50:39 user nova-compute[75216]:   <devices>
Nov 13 18:50:39 user nova-compute[75216]:     <disk type="file" device="disk">
Nov 13 18:50:39 user nova-compute[75216]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 18:50:39 user nova-compute[75216]:       <source file="/opt/stack/data/nova/instances/7c9d9c1b-6df5-41ff-a696-871e70d04e07/disk"/>
Nov 13 18:50:39 user nova-compute[75216]:       <target dev="vda" bus="virtio"/>
Nov 13 18:50:39 user nova-compute[75216]:     </disk>
Nov 13 18:50:39 user nova-compute[75216]:     <disk type="block" device="disk">
Nov 13 18:50:39 user nova-compute[75216]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 18:50:39 user nova-compute[75216]:       <source dev="/dev/sdd"/>
Nov 13 18:50:39 user nova-compute[75216]:       <target dev="vdb" bus="virtio"/>
Nov 13 18:50:39 user nova-compute[75216]:       <serial>6c711796-fc49-4e18-8fdd-eefe1e3b357c</serial>
Nov 13 18:50:39 user nova-compute[75216]:     </disk>
Nov 13 18:50:39 user nova-compute[75216]:     <interface type="ethernet">
Nov 13 18:50:39 user nova-compute[75216]:       <mac address="fa:16:3e:57:f0:d2"/>
Nov 13 18:50:39 user nova-compute[75216]:       <model type="virtio"/>
Nov 13 18:50:39 user nova-compute[75216]:       <mtu size="1442"/>
Nov 13 18:50:39 user nova-compute[75216]:       <target dev="tapc7fc6ea1-71"/>
Nov 13 18:50:39 user nova-compute[75216]:     </interface>
Nov 13 18:50:39 user nova-compute[75216]:     <serial type="pty">
Nov 13 18:50:39 user nova-compute[75216]:       <log file="/opt/stack/data/nova/instances/7c9d9c1b-6df5-41ff-a696-871e70d04e07/console.log" append="off"/>
Nov 13 18:50:39 user nova-compute[75216]:     </serial>
Nov 13 18:50:39 user nova-compute[75216]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 18:50:39 user nova-compute[75216]:     <video>
Nov 13 18:50:39 user nova-compute[75216]:       <model type="virtio"/>
Nov 13 18:50:39 user nova-compute[75216]:     </video>
Nov 13 18:50:39 user nova-compute[75216]:     <rng model="virtio">
Nov 13 18:50:39 user nova-compute[75216]:       <backend model="random">/dev/urandom</backend>
Nov 13 18:50:39 user nova-compute[75216]:     </rng>
Nov 13 18:50:39 user nova-compute[75216]:     <controller type="usb" index="0" model="none"/>
Nov 13 18:50:39 user nova-compute[75216]:     <memballoon model="virtio">
Nov 13 18:50:39 user nova-compute[75216]:       <stats period="10"/>
Nov 13 18:50:39 user nova-compute[75216]:     </memballoon>
Nov 13 18:50:39 user nova-compute[75216]:   </devices>
Nov 13 18:50:39 user nova-compute[75216]: </domain>
Nov 13 18:50:39 user nova-compute[75216]:  {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 18:50:39 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-fb83f5f2-56de-47d0-921e-89df78a1e0d4 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-13T18:48:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1402749069',display_name='tempest-ServerActionsTestOtherA-server-704140763',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1402749069',id=15,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB3Ae+ECFlA3sYuvUiY4zZUqwlHO9GOkN+S3EitsaTvPnKHRwjJAlSh4xDkptEhbxWjHAYqFkukQp4RTJQ+f+V7vYOIcvfMMYXH7rnQu72lMH/fbmDohZCVr2iSodUm4lA==',key_name='tempest-keypair-773824062',keypairs=<?>,launch_index=0,launched_at=2023-11-13T18:48:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b9b7e11038e54e368acd22d06e54a351',ramdisk_id='',reservation_id='r-2lvnqzq7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-537419316',owner_user_name='tempest-ServerActionsTestOtherA-537419316-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T18:50:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='23f029ff09464d699e5bd6dbf44a905d',uuid=7c9d9c1b-6df5-41ff-a696-871e70d04e07,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c7fc6ea1-71ae-4068-b4a4-e3432a82cfad", "address": "fa:16:3e:57:f0:d2", "network": {"id": "d7a691f0-4495-40ad-a349-91b5dc9c635a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-961583097-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9b7e11038e54e368acd22d06e54a351", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7fc6ea1-71", "ovs_interfaceid": "c7fc6ea1-71ae-4068-b4a4-e3432a82cfad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 18:50:39 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-fb83f5f2-56de-47d0-921e-89df78a1e0d4 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Converting VIF {"id": "c7fc6ea1-71ae-4068-b4a4-e3432a82cfad", "address": "fa:16:3e:57:f0:d2", "network": {"id": "d7a691f0-4495-40ad-a349-91b5dc9c635a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-961583097-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9b7e11038e54e368acd22d06e54a351", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7fc6ea1-71", "ovs_interfaceid": "c7fc6ea1-71ae-4068-b4a4-e3432a82cfad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 18:50:39 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-fb83f5f2-56de-47d0-921e-89df78a1e0d4 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:57:f0:d2,bridge_name='br-int',has_traffic_filtering=True,id=c7fc6ea1-71ae-4068-b4a4-e3432a82cfad,network=Network(d7a691f0-4495-40ad-a349-91b5dc9c635a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7fc6ea1-71') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 18:50:39 user nova-compute[75216]: DEBUG os_vif [None req-fb83f5f2-56de-47d0-921e-89df78a1e0d4 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:57:f0:d2,bridge_name='br-int',has_traffic_filtering=True,id=c7fc6ea1-71ae-4068-b4a4-e3432a82cfad,network=Network(d7a691f0-4495-40ad-a349-91b5dc9c635a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7fc6ea1-71') {{(pid=75216) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 18:50:39 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:50:39 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:50:39 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 18:50:39 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:50:39 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3a435999-c5e3-575f-a6bc-3d7ae3db48f5', '_type': 'linux-noop'}}, row=False) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:50:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:50:39 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe17046f-e582-431f-ab3d-3e9c8c739824]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6c711796-fc49-4e18-8fdd-eefe1e3b357c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ae66a157-b0d3-4501-a728-a010d6a83a10\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf4e9e60-f40d-49e0-8234-ae45c23b695b\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:50:39 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:50:39 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:50:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:50:39 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 9b078f75-57f2-495a-abd5-f8adf72db80b] Instance destroyed successfully.
Nov 13 18:50:39 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:50:39 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:50:39 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc7fc6ea1-71, may_exist=True, interface_attrs={}) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:50:39 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc7fc6ea1-71, col_values=(('qos', UUID('1c79d41a-4805-4654-9766-b99dd39a1b6c')),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:50:39 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc7fc6ea1-71, col_values=(('external_ids', {'iface-id': 'c7fc6ea1-71ae-4068-b4a4-e3432a82cfad', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:57:f0:d2', 'vm-uuid': '7c9d9c1b-6df5-41ff-a696-871e70d04e07'}),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:50:39 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:50:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:50:39 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a9c2b06-894f-4eec-bde8-82a16ff57516]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf4e9e60-f40d-49e0-8234-ae45c23b695b (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae66a157-b0d3-4501-a728-a010d6a83a10 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c711796-fc49-4e18-8fdd-eefe1e3b357c (non-flash)\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:50:39 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a48967c-512e-49d6-84c1-3e2ed4ffcda4 tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf4e9e60-f40d-49e0-8234-ae45c23b695b (non-flash)
Nov 13 18:50:39 user nova-compute[75216]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae66a157-b0d3-4501-a728-a010d6a83a10 (non-flash)
Nov 13 18:50:39 user nova-compute[75216]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac (non-flash)
Nov 13 18:50:39 user nova-compute[75216]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c711796-fc49-4e18-8fdd-eefe1e3b357c (non-flash)
Nov 13 18:50:39 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 18:50:39 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a48967c-512e-49d6-84c1-3e2ed4ffcda4 tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf4e9e60-f40d-49e0-8234-ae45c23b695b (non-flash)
Nov 13 18:50:39 user nova-compute[75216]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae66a157-b0d3-4501-a728-a010d6a83a10 (non-flash)
Nov 13 18:50:39 user nova-compute[75216]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac (non-flash)
Nov 13 18:50:39 user nova-compute[75216]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c711796-fc49-4e18-8fdd-eefe1e3b357c (non-flash)
Nov 13 18:50:39 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 18:50:39 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a48967c-512e-49d6-84c1-3e2ed4ffcda4 tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe3c01b9e10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ae66a157-b0d3-4501-a728-a010d6a83a10'): ({'sdc'}, set())}) {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 18:50:39 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-8a48967c-512e-49d6-84c1-3e2ed4ffcda4 tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] Removing single pathed devices sdc {{(pid=75216) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 18:50:39 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:50:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:50:39 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:50:39 user nova-compute[75216]: INFO os_vif [None req-fb83f5f2-56de-47d0-921e-89df78a1e0d4 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:57:f0:d2,bridge_name='br-int',has_traffic_filtering=True,id=c7fc6ea1-71ae-4068-b4a4-e3432a82cfad,network=Network(d7a691f0-4495-40ad-a349-91b5dc9c635a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7fc6ea1-71')
Nov 13 18:50:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.036s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:50:39 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[03b52b84-ba0c-42f3-b1e2-9cb11e7ee6a6]: (4, ('path checker states:\nup                  3\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:50:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:50:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.017s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:50:39 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cbaa89b-3c53-4896-a97b-b33ede3df7e6]: (4, ('ok\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:50:39 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-8a48967c-512e-49d6-84c1-3e2ed4ffcda4 tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] Flushing IO for device /dev/sdc {{(pid=75216) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 18:50:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:50:39 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-fb83f5f2-56de-47d0-921e-89df78a1e0d4 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 18:50:39 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-fb83f5f2-56de-47d0-921e-89df78a1e0d4 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 18:50:39 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-fb83f5f2-56de-47d0-921e-89df78a1e0d4 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] No VIF found with MAC fa:16:3e:57:f0:d2, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 18:50:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:50:39 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a98bdc6-2d48-4d71-8963-f7805a40d81b]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:50:39 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-8a48967c-512e-49d6-84c1-3e2ed4ffcda4 tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75216) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 18:50:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:50:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.038s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:50:39 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[b21d77c8-c39f-4877-a4a5-4333da88942e]: (4, ('1', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:50:39 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-8a48967c-512e-49d6-84c1-3e2ed4ffcda4 tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 18:50:39 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-8a48967c-512e-49d6-84c1-3e2ed4ffcda4 tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] SCSI volumes sdc have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 18:50:39 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a48967c-512e-49d6-84c1-3e2ed4ffcda4 tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ae66a157-b0d3-4501-a728-a010d6a83a10')] {{(pid=75216) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 18:50:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae66a157-b0d3-4501-a728-a010d6a83a10 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:50:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae66a157-b0d3-4501-a728-a010d6a83a10 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:50:39 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c2675e7-b9c5-410e-9ccf-5c14cce8f861]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:50:39 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a48967c-512e-49d6-84c1-3e2ed4ffcda4 tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:50:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae66a157-b0d3-4501-a728-a010d6a83a10 -p 172.16.0.220:3260 --logout {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:50:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae66a157-b0d3-4501-a728-a010d6a83a10 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:50:39 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[b83be64c-6b87-4850-8bc8-72f33688046b]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:ae66a157-b0d3-4501-a728-a010d6a83a10, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:ae66a157-b0d3-4501-a728-a010d6a83a10, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:50:39 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a48967c-512e-49d6-84c1-3e2ed4ffcda4 tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:ae66a157-b0d3-4501-a728-a010d6a83a10, portal: 172.16.0.220,3260]
Nov 13 18:50:39 user nova-compute[75216]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:ae66a157-b0d3-4501-a728-a010d6a83a10, portal: 172.16.0.220,3260] successful.
Nov 13 18:50:39 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:50:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae66a157-b0d3-4501-a728-a010d6a83a10 -p 172.16.0.220:3260 --op delete {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:50:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae66a157-b0d3-4501-a728-a010d6a83a10 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:50:39 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[62bf1a26-f9b7-41d8-b5c0-df187f11e87f]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:50:39 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a48967c-512e-49d6-84c1-3e2ed4ffcda4 tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:50:39 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-8a48967c-512e-49d6-84c1-3e2ed4ffcda4 tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.322s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 18:50:39 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a48967c-512e-49d6-84c1-3e2ed4ffcda4 tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] <== disconnect_volume: return (1510ms) None {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 18:50:39 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a48967c-512e-49d6-84c1-3e2ed4ffcda4 tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] [instance: 3679beb0-5244-443a-8512-38b29ccb62f0] Disconnected iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 18:50:39 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-8a48967c-512e-49d6-84c1-3e2ed4ffcda4 tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] [instance: 3679beb0-5244-443a-8512-38b29ccb62f0] Deleting instance files /opt/stack/data/nova/instances/3679beb0-5244-443a-8512-38b29ccb62f0_del
Nov 13 18:50:39 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-8a48967c-512e-49d6-84c1-3e2ed4ffcda4 tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] [instance: 3679beb0-5244-443a-8512-38b29ccb62f0] Deletion of /opt/stack/data/nova/instances/3679beb0-5244-443a-8512-38b29ccb62f0_del complete
Nov 13 18:50:39 user nova-compute[75216]: DEBUG nova.compute.manager [req-be311ebb-395c-4f77-a7a4-0d71b5bffc32 req-d561505a-9a70-4d42-816e-82fc8464b2a8 service nova] [instance: 3679beb0-5244-443a-8512-38b29ccb62f0] Received event network-vif-plugged-9dd60454-c5ac-4afe-b6fc-ad9ba9b83423 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:50:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-be311ebb-395c-4f77-a7a4-0d71b5bffc32 req-d561505a-9a70-4d42-816e-82fc8464b2a8 service nova] Acquiring lock "3679beb0-5244-443a-8512-38b29ccb62f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:50:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-be311ebb-395c-4f77-a7a4-0d71b5bffc32 req-d561505a-9a70-4d42-816e-82fc8464b2a8 service nova] Lock "3679beb0-5244-443a-8512-38b29ccb62f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:50:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-be311ebb-395c-4f77-a7a4-0d71b5bffc32 req-d561505a-9a70-4d42-816e-82fc8464b2a8 service nova] Lock "3679beb0-5244-443a-8512-38b29ccb62f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:50:39 user nova-compute[75216]: DEBUG nova.compute.manager [req-be311ebb-395c-4f77-a7a4-0d71b5bffc32 req-d561505a-9a70-4d42-816e-82fc8464b2a8 service nova] [instance: 3679beb0-5244-443a-8512-38b29ccb62f0] No waiting events found dispatching network-vif-plugged-9dd60454-c5ac-4afe-b6fc-ad9ba9b83423 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:50:39 user nova-compute[75216]: WARNING nova.compute.manager [req-be311ebb-395c-4f77-a7a4-0d71b5bffc32 req-d561505a-9a70-4d42-816e-82fc8464b2a8 service nova] [instance: 3679beb0-5244-443a-8512-38b29ccb62f0] Received unexpected event network-vif-plugged-9dd60454-c5ac-4afe-b6fc-ad9ba9b83423 for instance with vm_state active and task_state rebuilding.
Nov 13 18:50:39 user nova-compute[75216]: DEBUG nova.compute.manager [req-be311ebb-395c-4f77-a7a4-0d71b5bffc32 req-d561505a-9a70-4d42-816e-82fc8464b2a8 service nova] [instance: 9b078f75-57f2-495a-abd5-f8adf72db80b] Received event network-vif-unplugged-96bda2a6-53d1-4052-9230-4907fe60d70b {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:50:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-be311ebb-395c-4f77-a7a4-0d71b5bffc32 req-d561505a-9a70-4d42-816e-82fc8464b2a8 service nova] Acquiring lock "9b078f75-57f2-495a-abd5-f8adf72db80b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:50:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-be311ebb-395c-4f77-a7a4-0d71b5bffc32 req-d561505a-9a70-4d42-816e-82fc8464b2a8 service nova] Lock "9b078f75-57f2-495a-abd5-f8adf72db80b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:50:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-be311ebb-395c-4f77-a7a4-0d71b5bffc32 req-d561505a-9a70-4d42-816e-82fc8464b2a8 service nova] Lock "9b078f75-57f2-495a-abd5-f8adf72db80b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:50:39 user nova-compute[75216]: DEBUG nova.compute.manager [req-be311ebb-395c-4f77-a7a4-0d71b5bffc32 req-d561505a-9a70-4d42-816e-82fc8464b2a8 service nova] [instance: 9b078f75-57f2-495a-abd5-f8adf72db80b] No waiting events found dispatching network-vif-unplugged-96bda2a6-53d1-4052-9230-4907fe60d70b {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:50:39 user nova-compute[75216]: WARNING nova.compute.manager [req-be311ebb-395c-4f77-a7a4-0d71b5bffc32 req-d561505a-9a70-4d42-816e-82fc8464b2a8 service nova] [instance: 9b078f75-57f2-495a-abd5-f8adf72db80b] Received unexpected event network-vif-unplugged-96bda2a6-53d1-4052-9230-4907fe60d70b for instance with vm_state rescued and task_state unrescuing.
Nov 13 18:50:39 user nova-compute[75216]: DEBUG nova.compute.manager [req-be311ebb-395c-4f77-a7a4-0d71b5bffc32 req-d561505a-9a70-4d42-816e-82fc8464b2a8 service nova] [instance: 9b078f75-57f2-495a-abd5-f8adf72db80b] Received event network-changed-96bda2a6-53d1-4052-9230-4907fe60d70b {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:50:39 user nova-compute[75216]: DEBUG nova.compute.manager [req-be311ebb-395c-4f77-a7a4-0d71b5bffc32 req-d561505a-9a70-4d42-816e-82fc8464b2a8 service nova] [instance: 9b078f75-57f2-495a-abd5-f8adf72db80b] Refreshing instance network info cache due to event network-changed-96bda2a6-53d1-4052-9230-4907fe60d70b. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 18:50:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-be311ebb-395c-4f77-a7a4-0d71b5bffc32 req-d561505a-9a70-4d42-816e-82fc8464b2a8 service nova] Acquiring lock "refresh_cache-9b078f75-57f2-495a-abd5-f8adf72db80b" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 18:50:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-be311ebb-395c-4f77-a7a4-0d71b5bffc32 req-d561505a-9a70-4d42-816e-82fc8464b2a8 service nova] Acquired lock "refresh_cache-9b078f75-57f2-495a-abd5-f8adf72db80b" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 18:50:39 user nova-compute[75216]: DEBUG nova.network.neutron [req-be311ebb-395c-4f77-a7a4-0d71b5bffc32 req-d561505a-9a70-4d42-816e-82fc8464b2a8 service nova] [instance: 9b078f75-57f2-495a-abd5-f8adf72db80b] Refreshing network info cache for port 96bda2a6-53d1-4052-9230-4907fe60d70b {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 18:50:39 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-8a48967c-512e-49d6-84c1-3e2ed4ffcda4 tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] [instance: 3679beb0-5244-443a-8512-38b29ccb62f0] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 3679beb0-5244-443a-8512-38b29ccb62f0 could not be found.
Nov 13 18:50:39 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a48967c-512e-49d6-84c1-3e2ed4ffcda4 tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] [instance: 3679beb0-5244-443a-8512-38b29ccb62f0] calling os-brick to detach iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 18:50:39 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a48967c-512e-49d6-84c1-3e2ed4ffcda4 tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3a8669e40>, {'target_iqn': 'iqn.2010-10.org.openstack:ae66a157-b0d3-4501-a728-a010d6a83a10', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'buEowZlO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 18:50:39 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-8a48967c-512e-49d6-84c1-3e2ed4ffcda4 tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 13 18:50:39 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-8a48967c-512e-49d6-84c1-3e2ed4ffcda4 tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 18:50:39 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-8a48967c-512e-49d6-84c1-3e2ed4ffcda4 tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 18:50:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:50:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:50:39 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[07b9ceaa-9417-4463-b3d8-83c93d7d9bca]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bf4e9e60-f40d-49e0-8234-ae45c23b695b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6c711796-fc49-4e18-8fdd-eefe1e3b357c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:50:39 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a48967c-512e-49d6-84c1-3e2ed4ffcda4 tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 18:50:39 user nova-compute[75216]: No targets found.
Nov 13 18:50:39 user nova-compute[75216]: iSNS:
Nov 13 18:50:39 user nova-compute[75216]: No targets found.
Nov 13 18:50:39 user nova-compute[75216]: STATIC:
Nov 13 18:50:39 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:bf4e9e60-f40d-49e0-8234-ae45c23b695b
Nov 13 18:50:39 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 18:50:39 user nova-compute[75216]:                 Iface Name: default
Nov 13 18:50:39 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:6c711796-fc49-4e18-8fdd-eefe1e3b357c
Nov 13 18:50:39 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 18:50:39 user nova-compute[75216]:                 Iface Name: default
Nov 13 18:50:39 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac
Nov 13 18:50:39 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 18:50:39 user nova-compute[75216]:                 Iface Name: default
Nov 13 18:50:39 user nova-compute[75216]: FIRMWARE:
Nov 13 18:50:39 user nova-compute[75216]: No targets found.
Nov 13 18:50:39 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 18:50:39 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a48967c-512e-49d6-84c1-3e2ed4ffcda4 tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 18:50:39 user nova-compute[75216]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 18:50:39 user nova-compute[75216]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75216) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 18:50:39 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a48967c-512e-49d6-84c1-3e2ed4ffcda4 tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ae66a157-b0d3-4501-a728-a010d6a83a10', 0)] {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 18:50:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:50:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:50:39 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[e757ba2c-2bf5-4f1c-858b-3642d47dcf6a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6c711796-fc49-4e18-8fdd-eefe1e3b357c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf4e9e60-f40d-49e0-8234-ae45c23b695b\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:50:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:50:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:50:40 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[49a4d89a-6785-46f0-bb39-a38007d2e60a]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf4e9e60-f40d-49e0-8234-ae45c23b695b (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c711796-fc49-4e18-8fdd-eefe1e3b357c (non-flash)\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:50:40 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a48967c-512e-49d6-84c1-3e2ed4ffcda4 tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf4e9e60-f40d-49e0-8234-ae45c23b695b (non-flash)
Nov 13 18:50:40 user nova-compute[75216]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac (non-flash)
Nov 13 18:50:40 user nova-compute[75216]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c711796-fc49-4e18-8fdd-eefe1e3b357c (non-flash)
Nov 13 18:50:40 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 18:50:40 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a48967c-512e-49d6-84c1-3e2ed4ffcda4 tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf4e9e60-f40d-49e0-8234-ae45c23b695b (non-flash)
Nov 13 18:50:40 user nova-compute[75216]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac (non-flash)
Nov 13 18:50:40 user nova-compute[75216]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c711796-fc49-4e18-8fdd-eefe1e3b357c (non-flash)
Nov 13 18:50:40 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 18:50:40 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a48967c-512e-49d6-84c1-3e2ed4ffcda4 tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe3a81dd120>, {}) {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 18:50:40 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a48967c-512e-49d6-84c1-3e2ed4ffcda4 tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] Disconnecting from: [] {{(pid=75216) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 18:50:40 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-8a48967c-512e-49d6-84c1-3e2ed4ffcda4 tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.070s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 18:50:40 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a48967c-512e-49d6-84c1-3e2ed4ffcda4 tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] <== disconnect_volume: return (71ms) None {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 18:50:40 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a48967c-512e-49d6-84c1-3e2ed4ffcda4 tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] [instance: 3679beb0-5244-443a-8512-38b29ccb62f0] Disconnected iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 18:50:40 user nova-compute[75216]: DEBUG nova.network.neutron [req-be311ebb-395c-4f77-a7a4-0d71b5bffc32 req-d561505a-9a70-4d42-816e-82fc8464b2a8 service nova] [instance: 9b078f75-57f2-495a-abd5-f8adf72db80b] Updated VIF entry in instance network info cache for port 96bda2a6-53d1-4052-9230-4907fe60d70b. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 18:50:40 user nova-compute[75216]: DEBUG nova.network.neutron [req-be311ebb-395c-4f77-a7a4-0d71b5bffc32 req-d561505a-9a70-4d42-816e-82fc8464b2a8 service nova] [instance: 9b078f75-57f2-495a-abd5-f8adf72db80b] Updating instance_info_cache with network_info: [{"id": "96bda2a6-53d1-4052-9230-4907fe60d70b", "address": "fa:16:3e:30:88:c4", "network": {"id": "eac74a7f-b8a0-4653-82a9-1113186e7682", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1781360101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e76353a038ca478598ddd984f4503e34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96bda2a6-53", "ovs_interfaceid": "96bda2a6-53d1-4052-9230-4907fe60d70b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 18:50:40 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-be311ebb-395c-4f77-a7a4-0d71b5bffc32 req-d561505a-9a70-4d42-816e-82fc8464b2a8 service nova] Releasing lock "refresh_cache-9b078f75-57f2-495a-abd5-f8adf72db80b" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 18:50:40 user nova-compute[75216]: DEBUG nova.compute.manager [req-be311ebb-395c-4f77-a7a4-0d71b5bffc32 req-d561505a-9a70-4d42-816e-82fc8464b2a8 service nova] [instance: 9b078f75-57f2-495a-abd5-f8adf72db80b] Received event network-changed-96bda2a6-53d1-4052-9230-4907fe60d70b {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:50:40 user nova-compute[75216]: DEBUG nova.compute.manager [req-be311ebb-395c-4f77-a7a4-0d71b5bffc32 req-d561505a-9a70-4d42-816e-82fc8464b2a8 service nova] [instance: 9b078f75-57f2-495a-abd5-f8adf72db80b] Refreshing instance network info cache due to event network-changed-96bda2a6-53d1-4052-9230-4907fe60d70b. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 18:50:40 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-be311ebb-395c-4f77-a7a4-0d71b5bffc32 req-d561505a-9a70-4d42-816e-82fc8464b2a8 service nova] Acquiring lock "refresh_cache-9b078f75-57f2-495a-abd5-f8adf72db80b" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 18:50:40 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-be311ebb-395c-4f77-a7a4-0d71b5bffc32 req-d561505a-9a70-4d42-816e-82fc8464b2a8 service nova] Acquired lock "refresh_cache-9b078f75-57f2-495a-abd5-f8adf72db80b" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 18:50:40 user nova-compute[75216]: DEBUG nova.network.neutron [req-be311ebb-395c-4f77-a7a4-0d71b5bffc32 req-d561505a-9a70-4d42-816e-82fc8464b2a8 service nova] [instance: 9b078f75-57f2-495a-abd5-f8adf72db80b] Refreshing network info cache for port 96bda2a6-53d1-4052-9230-4907fe60d70b {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 18:50:40 user nova-compute[75216]: DEBUG nova.network.neutron [req-be311ebb-395c-4f77-a7a4-0d71b5bffc32 req-d561505a-9a70-4d42-816e-82fc8464b2a8 service nova] [instance: 9b078f75-57f2-495a-abd5-f8adf72db80b] Updated VIF entry in instance network info cache for port 96bda2a6-53d1-4052-9230-4907fe60d70b. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 18:50:40 user nova-compute[75216]: DEBUG nova.network.neutron [req-be311ebb-395c-4f77-a7a4-0d71b5bffc32 req-d561505a-9a70-4d42-816e-82fc8464b2a8 service nova] [instance: 9b078f75-57f2-495a-abd5-f8adf72db80b] Updating instance_info_cache with network_info: [{"id": "96bda2a6-53d1-4052-9230-4907fe60d70b", "address": "fa:16:3e:30:88:c4", "network": {"id": "eac74a7f-b8a0-4653-82a9-1113186e7682", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1781360101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e76353a038ca478598ddd984f4503e34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96bda2a6-53", "ovs_interfaceid": "96bda2a6-53d1-4052-9230-4907fe60d70b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 18:50:40 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-be311ebb-395c-4f77-a7a4-0d71b5bffc32 req-d561505a-9a70-4d42-816e-82fc8464b2a8 service nova] Releasing lock "refresh_cache-9b078f75-57f2-495a-abd5-f8adf72db80b" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 18:50:40 user nova-compute[75216]: DEBUG nova.compute.manager [req-be311ebb-395c-4f77-a7a4-0d71b5bffc32 req-d561505a-9a70-4d42-816e-82fc8464b2a8 service nova] [instance: 9b078f75-57f2-495a-abd5-f8adf72db80b] Received event network-vif-plugged-96bda2a6-53d1-4052-9230-4907fe60d70b {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:50:40 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-be311ebb-395c-4f77-a7a4-0d71b5bffc32 req-d561505a-9a70-4d42-816e-82fc8464b2a8 service nova] Acquiring lock "9b078f75-57f2-495a-abd5-f8adf72db80b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:50:40 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-be311ebb-395c-4f77-a7a4-0d71b5bffc32 req-d561505a-9a70-4d42-816e-82fc8464b2a8 service nova] Lock "9b078f75-57f2-495a-abd5-f8adf72db80b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:50:40 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-be311ebb-395c-4f77-a7a4-0d71b5bffc32 req-d561505a-9a70-4d42-816e-82fc8464b2a8 service nova] Lock "9b078f75-57f2-495a-abd5-f8adf72db80b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:50:40 user nova-compute[75216]: DEBUG nova.compute.manager [req-be311ebb-395c-4f77-a7a4-0d71b5bffc32 req-d561505a-9a70-4d42-816e-82fc8464b2a8 service nova] [instance: 9b078f75-57f2-495a-abd5-f8adf72db80b] No waiting events found dispatching network-vif-plugged-96bda2a6-53d1-4052-9230-4907fe60d70b {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:50:40 user nova-compute[75216]: WARNING nova.compute.manager [req-be311ebb-395c-4f77-a7a4-0d71b5bffc32 req-d561505a-9a70-4d42-816e-82fc8464b2a8 service nova] [instance: 9b078f75-57f2-495a-abd5-f8adf72db80b] Received unexpected event network-vif-plugged-96bda2a6-53d1-4052-9230-4907fe60d70b for instance with vm_state rescued and task_state unrescuing.
Nov 13 18:50:40 user nova-compute[75216]: DEBUG nova.compute.manager [None req-8a48967c-512e-49d6-84c1-3e2ed4ffcda4 tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] [instance: 3679beb0-5244-443a-8512-38b29ccb62f0] Preparing to wait for external event volume-reimaged-ae66a157-b0d3-4501-a728-a010d6a83a10 {{(pid=75216) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Nov 13 18:50:40 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-8a48967c-512e-49d6-84c1-3e2ed4ffcda4 tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] Acquiring lock "3679beb0-5244-443a-8512-38b29ccb62f0-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:50:40 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-8a48967c-512e-49d6-84c1-3e2ed4ffcda4 tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] Lock "3679beb0-5244-443a-8512-38b29ccb62f0-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:50:40 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-8a48967c-512e-49d6-84c1-3e2ed4ffcda4 tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] Lock "3679beb0-5244-443a-8512-38b29ccb62f0-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:50:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:50:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:50:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:50:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:50:41 user nova-compute[75216]: DEBUG nova.compute.manager [req-c25d3c28-b2ae-4fc9-9a4b-691362ac0c60 req-683c2513-eb02-400c-82c4-2bc89daf7e9e service nova] [instance: 7c9d9c1b-6df5-41ff-a696-871e70d04e07] Received event network-vif-plugged-c7fc6ea1-71ae-4068-b4a4-e3432a82cfad {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:50:41 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-c25d3c28-b2ae-4fc9-9a4b-691362ac0c60 req-683c2513-eb02-400c-82c4-2bc89daf7e9e service nova] Acquiring lock "7c9d9c1b-6df5-41ff-a696-871e70d04e07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:50:41 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-c25d3c28-b2ae-4fc9-9a4b-691362ac0c60 req-683c2513-eb02-400c-82c4-2bc89daf7e9e service nova] Lock "7c9d9c1b-6df5-41ff-a696-871e70d04e07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:50:41 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-c25d3c28-b2ae-4fc9-9a4b-691362ac0c60 req-683c2513-eb02-400c-82c4-2bc89daf7e9e service nova] Lock "7c9d9c1b-6df5-41ff-a696-871e70d04e07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:50:41 user nova-compute[75216]: DEBUG nova.compute.manager [req-c25d3c28-b2ae-4fc9-9a4b-691362ac0c60 req-683c2513-eb02-400c-82c4-2bc89daf7e9e service nova] [instance: 7c9d9c1b-6df5-41ff-a696-871e70d04e07] No waiting events found dispatching network-vif-plugged-c7fc6ea1-71ae-4068-b4a4-e3432a82cfad {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:50:41 user nova-compute[75216]: WARNING nova.compute.manager [req-c25d3c28-b2ae-4fc9-9a4b-691362ac0c60 req-683c2513-eb02-400c-82c4-2bc89daf7e9e service nova] [instance: 7c9d9c1b-6df5-41ff-a696-871e70d04e07] Received unexpected event network-vif-plugged-c7fc6ea1-71ae-4068-b4a4-e3432a82cfad for instance with vm_state active and task_state rebuild_spawning.
Nov 13 18:50:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:50:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:50:42 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:50:42 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:50:42 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:50:42 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:50:42 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:50:42 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:50:42 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:50:43 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:50:43 user nova-compute[75216]: DEBUG nova.compute.manager [req-ca1b1a09-476a-4ebc-8072-99c8f2a2e191 req-7efdec20-5795-48e8-bc9a-104add689fde service nova] [instance: 7c9d9c1b-6df5-41ff-a696-871e70d04e07] Received event network-vif-plugged-c7fc6ea1-71ae-4068-b4a4-e3432a82cfad {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:50:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-ca1b1a09-476a-4ebc-8072-99c8f2a2e191 req-7efdec20-5795-48e8-bc9a-104add689fde service nova] Acquiring lock "7c9d9c1b-6df5-41ff-a696-871e70d04e07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:50:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-ca1b1a09-476a-4ebc-8072-99c8f2a2e191 req-7efdec20-5795-48e8-bc9a-104add689fde service nova] Lock "7c9d9c1b-6df5-41ff-a696-871e70d04e07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:50:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-ca1b1a09-476a-4ebc-8072-99c8f2a2e191 req-7efdec20-5795-48e8-bc9a-104add689fde service nova] Lock "7c9d9c1b-6df5-41ff-a696-871e70d04e07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:50:43 user nova-compute[75216]: DEBUG nova.compute.manager [req-ca1b1a09-476a-4ebc-8072-99c8f2a2e191 req-7efdec20-5795-48e8-bc9a-104add689fde service nova] [instance: 7c9d9c1b-6df5-41ff-a696-871e70d04e07] No waiting events found dispatching network-vif-plugged-c7fc6ea1-71ae-4068-b4a4-e3432a82cfad {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:50:43 user nova-compute[75216]: WARNING nova.compute.manager [req-ca1b1a09-476a-4ebc-8072-99c8f2a2e191 req-7efdec20-5795-48e8-bc9a-104add689fde service nova] [instance: 7c9d9c1b-6df5-41ff-a696-871e70d04e07] Received unexpected event network-vif-plugged-c7fc6ea1-71ae-4068-b4a4-e3432a82cfad for instance with vm_state active and task_state rebuild_spawning.
Nov 13 18:50:43 user nova-compute[75216]: DEBUG nova.compute.manager [req-ca1b1a09-476a-4ebc-8072-99c8f2a2e191 req-7efdec20-5795-48e8-bc9a-104add689fde service nova] [instance: 9b078f75-57f2-495a-abd5-f8adf72db80b] Received event network-vif-plugged-96bda2a6-53d1-4052-9230-4907fe60d70b {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:50:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-ca1b1a09-476a-4ebc-8072-99c8f2a2e191 req-7efdec20-5795-48e8-bc9a-104add689fde service nova] Acquiring lock "9b078f75-57f2-495a-abd5-f8adf72db80b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:50:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-ca1b1a09-476a-4ebc-8072-99c8f2a2e191 req-7efdec20-5795-48e8-bc9a-104add689fde service nova] Lock "9b078f75-57f2-495a-abd5-f8adf72db80b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:50:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-ca1b1a09-476a-4ebc-8072-99c8f2a2e191 req-7efdec20-5795-48e8-bc9a-104add689fde service nova] Lock "9b078f75-57f2-495a-abd5-f8adf72db80b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:50:43 user nova-compute[75216]: DEBUG nova.compute.manager [req-ca1b1a09-476a-4ebc-8072-99c8f2a2e191 req-7efdec20-5795-48e8-bc9a-104add689fde service nova] [instance: 9b078f75-57f2-495a-abd5-f8adf72db80b] No waiting events found dispatching network-vif-plugged-96bda2a6-53d1-4052-9230-4907fe60d70b {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:50:43 user nova-compute[75216]: WARNING nova.compute.manager [req-ca1b1a09-476a-4ebc-8072-99c8f2a2e191 req-7efdec20-5795-48e8-bc9a-104add689fde service nova] [instance: 9b078f75-57f2-495a-abd5-f8adf72db80b] Received unexpected event network-vif-plugged-96bda2a6-53d1-4052-9230-4907fe60d70b for instance with vm_state rescued and task_state unrescuing.
Nov 13 18:50:43 user nova-compute[75216]: DEBUG nova.compute.manager [req-ca1b1a09-476a-4ebc-8072-99c8f2a2e191 req-7efdec20-5795-48e8-bc9a-104add689fde service nova] [instance: 9b078f75-57f2-495a-abd5-f8adf72db80b] Received event network-vif-plugged-96bda2a6-53d1-4052-9230-4907fe60d70b {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:50:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-ca1b1a09-476a-4ebc-8072-99c8f2a2e191 req-7efdec20-5795-48e8-bc9a-104add689fde service nova] Acquiring lock "9b078f75-57f2-495a-abd5-f8adf72db80b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:50:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-ca1b1a09-476a-4ebc-8072-99c8f2a2e191 req-7efdec20-5795-48e8-bc9a-104add689fde service nova] Lock "9b078f75-57f2-495a-abd5-f8adf72db80b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:50:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-ca1b1a09-476a-4ebc-8072-99c8f2a2e191 req-7efdec20-5795-48e8-bc9a-104add689fde service nova] Lock "9b078f75-57f2-495a-abd5-f8adf72db80b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:50:43 user nova-compute[75216]: DEBUG nova.compute.manager [req-ca1b1a09-476a-4ebc-8072-99c8f2a2e191 req-7efdec20-5795-48e8-bc9a-104add689fde service nova] [instance: 9b078f75-57f2-495a-abd5-f8adf72db80b] No waiting events found dispatching network-vif-plugged-96bda2a6-53d1-4052-9230-4907fe60d70b {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:50:43 user nova-compute[75216]: WARNING nova.compute.manager [req-ca1b1a09-476a-4ebc-8072-99c8f2a2e191 req-7efdec20-5795-48e8-bc9a-104add689fde service nova] [instance: 9b078f75-57f2-495a-abd5-f8adf72db80b] Received unexpected event network-vif-plugged-96bda2a6-53d1-4052-9230-4907fe60d70b for instance with vm_state rescued and task_state unrescuing.
Nov 13 18:50:44 user nova-compute[75216]: DEBUG nova.compute.manager [None req-b0999384-a23f-4d92-87c7-26af329a2181 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] [instance: 9b078f75-57f2-495a-abd5-f8adf72db80b] Checking state {{(pid=75216) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 18:50:44 user nova-compute[75216]: DEBUG nova.compute.manager [None req-fb83f5f2-56de-47d0-921e-89df78a1e0d4 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: 7c9d9c1b-6df5-41ff-a696-871e70d04e07] Instance event wait completed in 0 seconds for  {{(pid=75216) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 18:50:44 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-fb83f5f2-56de-47d0-921e-89df78a1e0d4 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: 7c9d9c1b-6df5-41ff-a696-871e70d04e07] Guest created on hypervisor {{(pid=75216) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 18:50:44 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:50:44 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 7c9d9c1b-6df5-41ff-a696-871e70d04e07] Instance spawned successfully.
Nov 13 18:50:44 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-fb83f5f2-56de-47d0-921e-89df78a1e0d4 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: 7c9d9c1b-6df5-41ff-a696-871e70d04e07] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 18:50:44 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-fb83f5f2-56de-47d0-921e-89df78a1e0d4 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: 7c9d9c1b-6df5-41ff-a696-871e70d04e07] Found default for hw_cdrom_bus of ide {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 18:50:44 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-fb83f5f2-56de-47d0-921e-89df78a1e0d4 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: 7c9d9c1b-6df5-41ff-a696-871e70d04e07] Found default for hw_disk_bus of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 18:50:44 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-fb83f5f2-56de-47d0-921e-89df78a1e0d4 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: 7c9d9c1b-6df5-41ff-a696-871e70d04e07] Found default for hw_input_bus of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 18:50:44 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-fb83f5f2-56de-47d0-921e-89df78a1e0d4 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: 7c9d9c1b-6df5-41ff-a696-871e70d04e07] Found default for hw_pointer_model of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 18:50:44 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-fb83f5f2-56de-47d0-921e-89df78a1e0d4 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: 7c9d9c1b-6df5-41ff-a696-871e70d04e07] Found default for hw_video_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 18:50:44 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-fb83f5f2-56de-47d0-921e-89df78a1e0d4 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: 7c9d9c1b-6df5-41ff-a696-871e70d04e07] Found default for hw_vif_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 18:50:44 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:50:44 user nova-compute[75216]: DEBUG nova.compute.manager [None req-fb83f5f2-56de-47d0-921e-89df78a1e0d4 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: 7c9d9c1b-6df5-41ff-a696-871e70d04e07] Checking state {{(pid=75216) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 18:50:44 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-fb83f5f2-56de-47d0-921e-89df78a1e0d4 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:50:44 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-fb83f5f2-56de-47d0-921e-89df78a1e0d4 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.004s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:50:44 user nova-compute[75216]: DEBUG nova.objects.instance [None req-fb83f5f2-56de-47d0-921e-89df78a1e0d4 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: 7c9d9c1b-6df5-41ff-a696-871e70d04e07] Trying to apply a migration context that does not seem to be set for this instance {{(pid=75216) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 13 18:50:44 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-fb83f5f2-56de-47d0-921e-89df78a1e0d4 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.081s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:50:45 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:50:45 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:50:45 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:50:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:50:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:50:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:50:45 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Auditing locally available compute resources for user (node: user) {{(pid=75216) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 18:50:45 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a3e849-6570-4820-97c8-75468b5bea4f/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:50:46 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a3e849-6570-4820-97c8-75468b5bea4f/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:50:46 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a3e849-6570-4820-97c8-75468b5bea4f/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:50:46 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a3e849-6570-4820-97c8-75468b5bea4f/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:50:46 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1350bc4-558a-40ac-91e5-96da24f154f5/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:50:46 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1350bc4-558a-40ac-91e5-96da24f154f5/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:50:46 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1350bc4-558a-40ac-91e5-96da24f154f5/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:50:46 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1350bc4-558a-40ac-91e5-96da24f154f5/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:50:46 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83fda249-9d28-4cc2-aeb0-103ce4f1faa4/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:50:46 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83fda249-9d28-4cc2-aeb0-103ce4f1faa4/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:50:46 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83fda249-9d28-4cc2-aeb0-103ce4f1faa4/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:50:47 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83fda249-9d28-4cc2-aeb0-103ce4f1faa4/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:50:47 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d589d57e-de50-482a-843f-e8246b3d7528/disk.rescue --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:50:47 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d589d57e-de50-482a-843f-e8246b3d7528/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:50:47 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d589d57e-de50-482a-843f-e8246b3d7528/disk.rescue --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:50:47 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d589d57e-de50-482a-843f-e8246b3d7528/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:50:47 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d589d57e-de50-482a-843f-e8246b3d7528/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:50:47 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d589d57e-de50-482a-843f-e8246b3d7528/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:50:47 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d589d57e-de50-482a-843f-e8246b3d7528/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:50:47 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d589d57e-de50-482a-843f-e8246b3d7528/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:50:47 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b078f75-57f2-495a-abd5-f8adf72db80b/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:50:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b078f75-57f2-495a-abd5-f8adf72db80b/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:50:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b078f75-57f2-495a-abd5-f8adf72db80b/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:50:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b078f75-57f2-495a-abd5-f8adf72db80b/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:50:48 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 18:50:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91ea8a19-a365-484c-80c7-baf90e7dd1aa/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:50:48 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:50:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91ea8a19-a365-484c-80c7-baf90e7dd1aa/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:50:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91ea8a19-a365-484c-80c7-baf90e7dd1aa/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:50:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91ea8a19-a365-484c-80c7-baf90e7dd1aa/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:50:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85624c58-6c72-4490-8a3e-547953295ade/disk.rescue --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:50:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85624c58-6c72-4490-8a3e-547953295ade/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:50:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85624c58-6c72-4490-8a3e-547953295ade/disk.rescue --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:50:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85624c58-6c72-4490-8a3e-547953295ade/disk.rescue --force-share --output=json" returned: 0 in 0.198s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:50:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85624c58-6c72-4490-8a3e-547953295ade/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:50:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85624c58-6c72-4490-8a3e-547953295ade/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:50:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85624c58-6c72-4490-8a3e-547953295ade/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:50:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85624c58-6c72-4490-8a3e-547953295ade/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:50:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64dfe522-8b46-4df4-8032-591ce56900ec/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:50:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:50:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64dfe522-8b46-4df4-8032-591ce56900ec/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:50:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64dfe522-8b46-4df4-8032-591ce56900ec/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:50:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64dfe522-8b46-4df4-8032-591ce56900ec/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:50:49 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 18:50:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c9d9c1b-6df5-41ff-a696-871e70d04e07/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:50:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c9d9c1b-6df5-41ff-a696-871e70d04e07/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:50:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c9d9c1b-6df5-41ff-a696-871e70d04e07/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:50:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c9d9c1b-6df5-41ff-a696-871e70d04e07/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:50:50 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 18:50:50 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 18:50:50 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 18:50:50 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Hypervisor/Node resource view: name=user free_ram=7556MB free_disk=25.46198272705078GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75216) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 18:50:50 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:50:50 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:50:51 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-7a9eeb07-c962-402e-81d1-03558f4f7028 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] Waiting for libvirt event about the detach of device tap0b5d79f8-fc with device alias net1 from instance 64dfe522-8b46-4df4-8032-591ce56900ec is timed out.
Nov 13 18:50:51 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-7a9eeb07-c962-402e-81d1-03558f4f7028 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:01:dc:62"/><model type="virtio"/><mtu size="1442"/><target dev="tap0b5d79f8-fc"/></interface> {{(pid=75216) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 13 18:50:51 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance a1a3e849-6570-4820-97c8-75468b5bea4f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 18:50:51 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance d589d57e-de50-482a-843f-e8246b3d7528 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 18:50:51 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance 85624c58-6c72-4490-8a3e-547953295ade actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 18:50:51 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance 9b078f75-57f2-495a-abd5-f8adf72db80b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 18:50:51 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance 83fda249-9d28-4cc2-aeb0-103ce4f1faa4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 18:50:51 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance 64dfe522-8b46-4df4-8032-591ce56900ec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 18:50:51 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance 7c9d9c1b-6df5-41ff-a696-871e70d04e07 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 18:50:51 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance 3679beb0-5244-443a-8512-38b29ccb62f0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 18:50:51 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance e1350bc4-558a-40ac-91e5-96da24f154f5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 18:50:51 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance 91ea8a19-a365-484c-80c7-baf90e7dd1aa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 18:50:51 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance a3bcf65e-bd5b-4350-a222-5f4522418a67 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 18:50:51 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 18:50:51 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 18:50:51 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-7a9eeb07-c962-402e-81d1-03558f4f7028 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:01:dc:62"/><model type="virtio"/><mtu size="1442"/><target dev="tap0b5d79f8-fc"/></interface>not found in domain: <domain type='kvm' id='14'>
Nov 13 18:50:51 user nova-compute[75216]:   <name>instance-0000000d</name>
Nov 13 18:50:51 user nova-compute[75216]:   <uuid>64dfe522-8b46-4df4-8032-591ce56900ec</uuid>
Nov 13 18:50:51 user nova-compute[75216]:   <metadata>
Nov 13 18:50:51 user nova-compute[75216]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 18:50:51 user nova-compute[75216]:   <nova:package version="0.0.0"/>
Nov 13 18:50:51 user nova-compute[75216]:   <nova:name>tempest-device-tagging-server-904595823</nova:name>
Nov 13 18:50:51 user nova-compute[75216]:   <nova:creationTime>2023-11-13 18:49:56</nova:creationTime>
Nov 13 18:50:51 user nova-compute[75216]:   <nova:flavor name="m1.tiny">
Nov 13 18:50:51 user nova-compute[75216]:     <nova:memory>512</nova:memory>
Nov 13 18:50:51 user nova-compute[75216]:     <nova:disk>1</nova:disk>
Nov 13 18:50:51 user nova-compute[75216]:     <nova:swap>0</nova:swap>
Nov 13 18:50:51 user nova-compute[75216]:     <nova:ephemeral>0</nova:ephemeral>
Nov 13 18:50:51 user nova-compute[75216]:     <nova:vcpus>1</nova:vcpus>
Nov 13 18:50:51 user nova-compute[75216]:   </nova:flavor>
Nov 13 18:50:51 user nova-compute[75216]:   <nova:owner>
Nov 13 18:50:51 user nova-compute[75216]:     <nova:user uuid="454caf80dd76487baead7c52f05df1a5">tempest-TaggedAttachmentsTest-507898025-project-member</nova:user>
Nov 13 18:50:51 user nova-compute[75216]:     <nova:project uuid="0ec18dd2e6ea476dbf3745d14a866190">tempest-TaggedAttachmentsTest-507898025</nova:project>
Nov 13 18:50:51 user nova-compute[75216]:   </nova:owner>
Nov 13 18:50:51 user nova-compute[75216]:   <nova:root type="image" uuid="77bcb5ba-8510-41ec-a88d-96097bb431de"/>
Nov 13 18:50:51 user nova-compute[75216]:   <nova:ports>
Nov 13 18:50:51 user nova-compute[75216]:     <nova:port uuid="2d12f254-7874-4622-a7cb-8180de961bd1">
Nov 13 18:50:51 user nova-compute[75216]:       <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 13 18:50:51 user nova-compute[75216]:     </nova:port>
Nov 13 18:50:51 user nova-compute[75216]:     <nova:port uuid="0b5d79f8-fcb9-4bc8-b5e3-489fb6218824">
Nov 13 18:50:51 user nova-compute[75216]:       <nova:ip type="fixed" address="10.10.10.117" ipVersion="4"/>
Nov 13 18:50:51 user nova-compute[75216]:     </nova:port>
Nov 13 18:50:51 user nova-compute[75216]:   </nova:ports>
Nov 13 18:50:51 user nova-compute[75216]: </nova:instance>
Nov 13 18:50:51 user nova-compute[75216]:   </metadata>
Nov 13 18:50:51 user nova-compute[75216]:   <memory unit='KiB'>524288</memory>
Nov 13 18:50:51 user nova-compute[75216]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 13 18:50:51 user nova-compute[75216]:   <vcpu placement='static'>1</vcpu>
Nov 13 18:50:51 user nova-compute[75216]:   <resource>
Nov 13 18:50:51 user nova-compute[75216]:     <partition>/machine</partition>
Nov 13 18:50:51 user nova-compute[75216]:   </resource>
Nov 13 18:50:51 user nova-compute[75216]:   <sysinfo type='smbios'>
Nov 13 18:50:51 user nova-compute[75216]:     <system>
Nov 13 18:50:51 user nova-compute[75216]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 13 18:50:51 user nova-compute[75216]:       <entry name='product'>OpenStack Nova</entry>
Nov 13 18:50:51 user nova-compute[75216]:       <entry name='version'>0.0.0</entry>
Nov 13 18:50:51 user nova-compute[75216]:       <entry name='serial'>64dfe522-8b46-4df4-8032-591ce56900ec</entry>
Nov 13 18:50:51 user nova-compute[75216]:       <entry name='uuid'>64dfe522-8b46-4df4-8032-591ce56900ec</entry>
Nov 13 18:50:51 user nova-compute[75216]:       <entry name='family'>Virtual Machine</entry>
Nov 13 18:50:51 user nova-compute[75216]:     </system>
Nov 13 18:50:51 user nova-compute[75216]:   </sysinfo>
Nov 13 18:50:51 user nova-compute[75216]:   <os>
Nov 13 18:50:51 user nova-compute[75216]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 13 18:50:51 user nova-compute[75216]:     <boot dev='hd'/>
Nov 13 18:50:51 user nova-compute[75216]:     <smbios mode='sysinfo'/>
Nov 13 18:50:51 user nova-compute[75216]:   </os>
Nov 13 18:50:51 user nova-compute[75216]:   <features>
Nov 13 18:50:51 user nova-compute[75216]:     <acpi/>
Nov 13 18:50:51 user nova-compute[75216]:     <apic/>
Nov 13 18:50:51 user nova-compute[75216]:     <vmcoreinfo state='on'/>
Nov 13 18:50:51 user nova-compute[75216]:   </features>
Nov 13 18:50:51 user nova-compute[75216]:   <cpu mode='custom' match='exact' check='full'>
Nov 13 18:50:51 user nova-compute[75216]:     <model fallback='forbid'>Nehalem</model>
Nov 13 18:50:51 user nova-compute[75216]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 13 18:50:51 user nova-compute[75216]:     <feature policy='require' name='vme'/>
Nov 13 18:50:51 user nova-compute[75216]:     <feature policy='require' name='x2apic'/>
Nov 13 18:50:51 user nova-compute[75216]:     <feature policy='require' name='hypervisor'/>
Nov 13 18:50:51 user nova-compute[75216]:   </cpu>
Nov 13 18:50:51 user nova-compute[75216]:   <clock offset='utc'>
Nov 13 18:50:51 user nova-compute[75216]:     <timer name='pit' tickpolicy='delay'/>
Nov 13 18:50:51 user nova-compute[75216]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 13 18:50:51 user nova-compute[75216]:     <timer name='hpet' present='no'/>
Nov 13 18:50:51 user nova-compute[75216]:   </clock>
Nov 13 18:50:51 user nova-compute[75216]:   <on_poweroff>destroy</on_poweroff>
Nov 13 18:50:51 user nova-compute[75216]:   <on_reboot>restart</on_reboot>
Nov 13 18:50:51 user nova-compute[75216]:   <on_crash>destroy</on_crash>
Nov 13 18:50:51 user nova-compute[75216]:   <devices>
Nov 13 18:50:51 user nova-compute[75216]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 13 18:50:51 user nova-compute[75216]:     <disk type='file' device='disk'>
Nov 13 18:50:51 user nova-compute[75216]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 13 18:50:51 user nova-compute[75216]:       <source file='/opt/stack/data/nova/instances/64dfe522-8b46-4df4-8032-591ce56900ec/disk' index='2'/>
Nov 13 18:50:51 user nova-compute[75216]:       <backingStore type='file' index='3'>
Nov 13 18:50:51 user nova-compute[75216]:         <format type='raw'/>
Nov 13 18:50:51 user nova-compute[75216]:         <source file='/opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6'/>
Nov 13 18:50:51 user nova-compute[75216]:         <backingStore/>
Nov 13 18:50:51 user nova-compute[75216]:       </backingStore>
Nov 13 18:50:51 user nova-compute[75216]:       <target dev='vda' bus='virtio'/>
Nov 13 18:50:51 user nova-compute[75216]:       <alias name='virtio-disk0'/>
Nov 13 18:50:51 user nova-compute[75216]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 13 18:50:51 user nova-compute[75216]:     </disk>
Nov 13 18:50:51 user nova-compute[75216]:     <disk type='file' device='cdrom'>
Nov 13 18:50:51 user nova-compute[75216]:       <driver name='qemu' type='raw' cache='none'/>
Nov 13 18:50:51 user nova-compute[75216]:       <source file='/opt/stack/data/nova/instances/64dfe522-8b46-4df4-8032-591ce56900ec/disk.config' index='1'/>
Nov 13 18:50:51 user nova-compute[75216]:       <backingStore/>
Nov 13 18:50:51 user nova-compute[75216]:       <target dev='hda' bus='ide'/>
Nov 13 18:50:51 user nova-compute[75216]:       <readonly/>
Nov 13 18:50:51 user nova-compute[75216]:       <alias name='ide0-0-0'/>
Nov 13 18:50:51 user nova-compute[75216]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 13 18:50:51 user nova-compute[75216]:     </disk>
Nov 13 18:50:51 user nova-compute[75216]:     <controller type='usb' index='0' model='none'>
Nov 13 18:50:51 user nova-compute[75216]:       <alias name='usb'/>
Nov 13 18:50:51 user nova-compute[75216]:     </controller>
Nov 13 18:50:51 user nova-compute[75216]:     <controller type='pci' index='0' model='pci-root'>
Nov 13 18:50:51 user nova-compute[75216]:       <alias name='pci.0'/>
Nov 13 18:50:51 user nova-compute[75216]:     </controller>
Nov 13 18:50:51 user nova-compute[75216]:     <controller type='ide' index='0'>
Nov 13 18:50:51 user nova-compute[75216]:       <alias name='ide'/>
Nov 13 18:50:51 user nova-compute[75216]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 13 18:50:51 user nova-compute[75216]:     </controller>
Nov 13 18:50:51 user nova-compute[75216]:     <interface type='ethernet'>
Nov 13 18:50:51 user nova-compute[75216]:       <mac address='fa:16:3e:a1:6b:92'/>
Nov 13 18:50:51 user nova-compute[75216]:       <target dev='tap2d12f254-78'/>
Nov 13 18:50:51 user nova-compute[75216]:       <model type='virtio'/>
Nov 13 18:50:51 user nova-compute[75216]:       <mtu size='1442'/>
Nov 13 18:50:51 user nova-compute[75216]:       <alias name='net0'/>
Nov 13 18:50:51 user nova-compute[75216]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 13 18:50:51 user nova-compute[75216]:     </interface>
Nov 13 18:50:51 user nova-compute[75216]:     <serial type='pty'>
Nov 13 18:50:51 user nova-compute[75216]:       <source path='/dev/pts/1'/>
Nov 13 18:50:51 user nova-compute[75216]:       <log file='/opt/stack/data/nova/instances/64dfe522-8b46-4df4-8032-591ce56900ec/console.log' append='off'/>
Nov 13 18:50:51 user nova-compute[75216]:       <target type='isa-serial' port='0'>
Nov 13 18:50:51 user nova-compute[75216]:         <model name='isa-serial'/>
Nov 13 18:50:51 user nova-compute[75216]:       </target>
Nov 13 18:50:51 user nova-compute[75216]:       <alias name='serial0'/>
Nov 13 18:50:51 user nova-compute[75216]:     </serial>
Nov 13 18:50:51 user nova-compute[75216]:     <console type='pty' tty='/dev/pts/1'>
Nov 13 18:50:51 user nova-compute[75216]:       <source path='/dev/pts/1'/>
Nov 13 18:50:51 user nova-compute[75216]:       <log file='/opt/stack/data/nova/instances/64dfe522-8b46-4df4-8032-591ce56900ec/console.log' append='off'/>
Nov 13 18:50:51 user nova-compute[75216]:       <target type='serial' port='0'/>
Nov 13 18:50:51 user nova-compute[75216]:       <alias name='serial0'/>
Nov 13 18:50:51 user nova-compute[75216]:     </console>
Nov 13 18:50:51 user nova-compute[75216]:     <input type='mouse' bus='ps2'>
Nov 13 18:50:51 user nova-compute[75216]:       <alias name='input0'/>
Nov 13 18:50:51 user nova-compute[75216]:     </input>
Nov 13 18:50:51 user nova-compute[75216]:     <input type='keyboard' bus='ps2'>
Nov 13 18:50:51 user nova-compute[75216]:       <alias name='input1'/>
Nov 13 18:50:51 user nova-compute[75216]:     </input>
Nov 13 18:50:51 user nova-compute[75216]:     <graphics type='vnc' port='5901' autoport='yes' listen='0.0.0.0'>
Nov 13 18:50:51 user nova-compute[75216]:       <listen type='address' address='0.0.0.0'/>
Nov 13 18:50:51 user nova-compute[75216]:     </graphics>
Nov 13 18:50:51 user nova-compute[75216]:     <audio id='1' type='none'/>
Nov 13 18:50:51 user nova-compute[75216]:     <video>
Nov 13 18:50:51 user nova-compute[75216]:       <model type='virtio' heads='1' primary='yes'/>
Nov 13 18:50:51 user nova-compute[75216]:       <alias name='video0'/>
Nov 13 18:50:51 user nova-compute[75216]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 13 18:50:51 user nova-compute[75216]:     </video>
Nov 13 18:50:51 user nova-compute[75216]:     <memballoon model='virtio'>
Nov 13 18:50:51 user nova-compute[75216]:       <stats period='10'/>
Nov 13 18:50:51 user nova-compute[75216]:       <alias name='balloon0'/>
Nov 13 18:50:51 user nova-compute[75216]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 13 18:50:51 user nova-compute[75216]:     </memballoon>
Nov 13 18:50:51 user nova-compute[75216]:     <rng model='virtio'>
Nov 13 18:50:51 user nova-compute[75216]:       <backend model='random'>/dev/urandom</backend>
Nov 13 18:50:51 user nova-compute[75216]:       <alias name='rng0'/>
Nov 13 18:50:51 user nova-compute[75216]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 13 18:50:51 user nova-compute[75216]:     </rng>
Nov 13 18:50:51 user nova-compute[75216]:   </devices>
Nov 13 18:50:51 user nova-compute[75216]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 13 18:50:51 user nova-compute[75216]:     <label>libvirt-64dfe522-8b46-4df4-8032-591ce56900ec</label>
Nov 13 18:50:51 user nova-compute[75216]:     <imagelabel>libvirt-64dfe522-8b46-4df4-8032-591ce56900ec</imagelabel>
Nov 13 18:50:51 user nova-compute[75216]:   </seclabel>
Nov 13 18:50:51 user nova-compute[75216]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 13 18:50:51 user nova-compute[75216]:     <label>+64055:+108</label>
Nov 13 18:50:51 user nova-compute[75216]:     <imagelabel>+64055:+108</imagelabel>
Nov 13 18:50:51 user nova-compute[75216]:   </seclabel>
Nov 13 18:50:51 user nova-compute[75216]: </domain>
Nov 13 18:50:51 user nova-compute[75216]:  {{(pid=75216) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 13 18:50:51 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-7a9eeb07-c962-402e-81d1-03558f4f7028 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] Successfully detached device tap0b5d79f8-fc from instance 64dfe522-8b46-4df4-8032-591ce56900ec from the live domain config.
Nov 13 18:50:51 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-7a9eeb07-c962-402e-81d1-03558f4f7028 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T18:48:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-904595823',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-904595823',id=13,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAnoGBZDueYOh3xcWER1AMv30DIYxQxeWRDS2fRFXh6l4DZc8pD4qIgg0IjDLbUZuBfE7+vn5QgzB7ChiJAa+d1ltHilcpx/dg8eDxHVfO8o++kjL7IH7NIL3RYQDYV6Ew==',key_name='tempest-keypair-1295383460',keypairs=<?>,launch_index=0,launched_at=2023-11-13T18:48:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0ec18dd2e6ea476dbf3745d14a866190',ramdisk_id='',reservation_id='r-0a499j0h',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-507898025',owner_user_name='tempest-TaggedAttachmentsTest-507898025-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T18:48:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='454caf80dd76487baead7c52f05df1a5',uuid=64dfe522-8b46-4df4-8032-591ce56900ec,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0b5d79f8-fcb9-4bc8-b5e3-489fb6218824", "address": "fa:16:3e:01:dc:62", "network": {"id": "cfd7855a-e494-456a-b9d4-02bab193fd03", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-66586289", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.117", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "0ec18dd2e6ea476dbf3745d14a866190", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b5d79f8-fc", "ovs_interfaceid": "0b5d79f8-fcb9-4bc8-b5e3-489fb6218824", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 18:50:51 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-7a9eeb07-c962-402e-81d1-03558f4f7028 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] Converting VIF {"id": "0b5d79f8-fcb9-4bc8-b5e3-489fb6218824", "address": "fa:16:3e:01:dc:62", "network": {"id": "cfd7855a-e494-456a-b9d4-02bab193fd03", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-66586289", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.117", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "0ec18dd2e6ea476dbf3745d14a866190", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b5d79f8-fc", "ovs_interfaceid": "0b5d79f8-fcb9-4bc8-b5e3-489fb6218824", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 18:50:51 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-7a9eeb07-c962-402e-81d1-03558f4f7028 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:dc:62,bridge_name='br-int',has_traffic_filtering=True,id=0b5d79f8-fcb9-4bc8-b5e3-489fb6218824,network=Network(cfd7855a-e494-456a-b9d4-02bab193fd03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b5d79f8-fc') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 18:50:51 user nova-compute[75216]: DEBUG os_vif [None req-7a9eeb07-c962-402e-81d1-03558f4f7028 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:dc:62,bridge_name='br-int',has_traffic_filtering=True,id=0b5d79f8-fcb9-4bc8-b5e3-489fb6218824,network=Network(cfd7855a-e494-456a-b9d4-02bab193fd03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b5d79f8-fc') {{(pid=75216) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 18:50:51 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:50:51 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0b5d79f8-fc, bridge=br-int, if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:50:51 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:50:51 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:50:51 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:50:51 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d636f81e-8358-48fd-8264-887cd66ab01f) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:50:51 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:50:51 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:50:51 user nova-compute[75216]: INFO os_vif [None req-7a9eeb07-c962-402e-81d1-03558f4f7028 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:dc:62,bridge_name='br-int',has_traffic_filtering=True,id=0b5d79f8-fcb9-4bc8-b5e3-489fb6218824,network=Network(cfd7855a-e494-456a-b9d4-02bab193fd03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b5d79f8-fc')
Nov 13 18:50:51 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-7a9eeb07-c962-402e-81d1-03558f4f7028 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 18:50:51 user nova-compute[75216]:   <nova:package version="0.0.0"/>
Nov 13 18:50:51 user nova-compute[75216]:   <nova:name>tempest-device-tagging-server-904595823</nova:name>
Nov 13 18:50:51 user nova-compute[75216]:   <nova:creationTime>2023-11-13 18:50:51</nova:creationTime>
Nov 13 18:50:51 user nova-compute[75216]:   <nova:flavor name="m1.tiny">
Nov 13 18:50:51 user nova-compute[75216]:     <nova:memory>512</nova:memory>
Nov 13 18:50:51 user nova-compute[75216]:     <nova:disk>1</nova:disk>
Nov 13 18:50:51 user nova-compute[75216]:     <nova:swap>0</nova:swap>
Nov 13 18:50:51 user nova-compute[75216]:     <nova:ephemeral>0</nova:ephemeral>
Nov 13 18:50:51 user nova-compute[75216]:     <nova:vcpus>1</nova:vcpus>
Nov 13 18:50:51 user nova-compute[75216]:   </nova:flavor>
Nov 13 18:50:51 user nova-compute[75216]:   <nova:owner>
Nov 13 18:50:51 user nova-compute[75216]:     <nova:user uuid="454caf80dd76487baead7c52f05df1a5">tempest-TaggedAttachmentsTest-507898025-project-member</nova:user>
Nov 13 18:50:51 user nova-compute[75216]:     <nova:project uuid="0ec18dd2e6ea476dbf3745d14a866190">tempest-TaggedAttachmentsTest-507898025</nova:project>
Nov 13 18:50:51 user nova-compute[75216]:   </nova:owner>
Nov 13 18:50:51 user nova-compute[75216]:   <nova:root type="image" uuid="77bcb5ba-8510-41ec-a88d-96097bb431de"/>
Nov 13 18:50:51 user nova-compute[75216]:   <nova:ports>
Nov 13 18:50:51 user nova-compute[75216]:     <nova:port uuid="2d12f254-7874-4622-a7cb-8180de961bd1">
Nov 13 18:50:51 user nova-compute[75216]:       <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 13 18:50:51 user nova-compute[75216]:     </nova:port>
Nov 13 18:50:51 user nova-compute[75216]:   </nova:ports>
Nov 13 18:50:51 user nova-compute[75216]: </nova:instance>
Nov 13 18:50:51 user nova-compute[75216]:  {{(pid=75216) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 13 18:50:51 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Refreshing inventories for resource provider d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 13 18:50:51 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Updating ProviderTree inventory for provider d927e00d-5a8b-43f7-ac04-6437958fac1f from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 13 18:50:51 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Updating inventory in ProviderTree for provider d927e00d-5a8b-43f7-ac04-6437958fac1f with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 13 18:50:51 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Refreshing aggregate associations for resource provider d927e00d-5a8b-43f7-ac04-6437958fac1f, aggregates: None {{(pid=75216) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 13 18:50:51 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Refreshing trait associations for resource provider d927e00d-5a8b-43f7-ac04-6437958fac1f, traits: COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_MMX {{(pid=75216) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 13 18:50:51 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 18:50:51 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 18:50:51 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Compute_service record updated for user:user {{(pid=75216) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 18:50:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.870s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:50:51 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:50:51 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Cleaning up deleted instances {{(pid=75216) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 13 18:50:51 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] There are 0 instances to clean {{(pid=75216) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 13 18:50:51 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:50:51 user nova-compute[75216]: DEBUG nova.compute.manager [req-6281c0f0-a3e6-4be7-a806-b0d2ff41d202 req-44c82a09-05fb-4f0f-814e-7866b4a3b8fe service nova] [instance: 64dfe522-8b46-4df4-8032-591ce56900ec] Received event network-vif-deleted-0b5d79f8-fcb9-4bc8-b5e3-489fb6218824 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:50:51 user nova-compute[75216]: INFO nova.compute.manager [req-6281c0f0-a3e6-4be7-a806-b0d2ff41d202 req-44c82a09-05fb-4f0f-814e-7866b4a3b8fe service nova] [instance: 64dfe522-8b46-4df4-8032-591ce56900ec] Neutron deleted interface 0b5d79f8-fcb9-4bc8-b5e3-489fb6218824; detaching it from the instance and deleting it from the info cache
Nov 13 18:50:51 user nova-compute[75216]: DEBUG nova.network.neutron [req-6281c0f0-a3e6-4be7-a806-b0d2ff41d202 req-44c82a09-05fb-4f0f-814e-7866b4a3b8fe service nova] [instance: 64dfe522-8b46-4df4-8032-591ce56900ec] Updating instance_info_cache with network_info: [{"id": "2d12f254-7874-4622-a7cb-8180de961bd1", "address": "fa:16:3e:a1:6b:92", "network": {"id": "0b64448d-5ece-4814-9bdc-de0167e921f9", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-67835474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ec18dd2e6ea476dbf3745d14a866190", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d12f254-78", "ovs_interfaceid": "2d12f254-7874-4622-a7cb-8180de961bd1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 18:50:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-7a9eeb07-c962-402e-81d1-03558f4f7028 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] Acquiring lock "refresh_cache-64dfe522-8b46-4df4-8032-591ce56900ec" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 18:50:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-7a9eeb07-c962-402e-81d1-03558f4f7028 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] Acquired lock "refresh_cache-64dfe522-8b46-4df4-8032-591ce56900ec" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 18:50:51 user nova-compute[75216]: DEBUG nova.network.neutron [None req-7a9eeb07-c962-402e-81d1-03558f4f7028 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] [instance: 64dfe522-8b46-4df4-8032-591ce56900ec] Building network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 18:50:51 user nova-compute[75216]: DEBUG nova.objects.instance [req-6281c0f0-a3e6-4be7-a806-b0d2ff41d202 req-44c82a09-05fb-4f0f-814e-7866b4a3b8fe service nova] Lazy-loading 'system_metadata' on Instance uuid 64dfe522-8b46-4df4-8032-591ce56900ec {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 18:50:51 user nova-compute[75216]: DEBUG nova.objects.instance [req-6281c0f0-a3e6-4be7-a806-b0d2ff41d202 req-44c82a09-05fb-4f0f-814e-7866b4a3b8fe service nova] Lazy-loading 'flavor' on Instance uuid 64dfe522-8b46-4df4-8032-591ce56900ec {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 18:50:51 user nova-compute[75216]: DEBUG nova.objects.base [req-6281c0f0-a3e6-4be7-a806-b0d2ff41d202 req-44c82a09-05fb-4f0f-814e-7866b4a3b8fe service nova] Object Instance<64dfe522-8b46-4df4-8032-591ce56900ec> lazy-loaded attributes: system_metadata,flavor {{(pid=75216) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 18:50:51 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [req-6281c0f0-a3e6-4be7-a806-b0d2ff41d202 req-44c82a09-05fb-4f0f-814e-7866b4a3b8fe service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T18:48:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-904595823',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-904595823',id=13,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAnoGBZDueYOh3xcWER1AMv30DIYxQxeWRDS2fRFXh6l4DZc8pD4qIgg0IjDLbUZuBfE7+vn5QgzB7ChiJAa+d1ltHilcpx/dg8eDxHVfO8o++kjL7IH7NIL3RYQDYV6Ew==',key_name='tempest-keypair-1295383460',keypairs=<?>,launch_index=0,launched_at=2023-11-13T18:48:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0ec18dd2e6ea476dbf3745d14a866190',ramdisk_id='',reservation_id='r-0a499j0h',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-507898025',owner_user_name='tempest-TaggedAttachmentsTest-507898025-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T18:48:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='454caf80dd76487baead7c52f05df1a5',uuid=64dfe522-8b46-4df4-8032-591ce56900ec,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0b5d79f8-fcb9-4bc8-b5e3-489fb6218824", "address": "fa:16:3e:01:dc:62", "network": {"id": "cfd7855a-e494-456a-b9d4-02bab193fd03", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-66586289", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.117", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "0ec18dd2e6ea476dbf3745d14a866190", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b5d79f8-fc", "ovs_interfaceid": "0b5d79f8-fcb9-4bc8-b5e3-489fb6218824", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75216) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 18:50:51 user nova-compute[75216]: DEBUG nova.network.os_vif_util [req-6281c0f0-a3e6-4be7-a806-b0d2ff41d202 req-44c82a09-05fb-4f0f-814e-7866b4a3b8fe service nova] Converting VIF {"id": "0b5d79f8-fcb9-4bc8-b5e3-489fb6218824", "address": "fa:16:3e:01:dc:62", "network": {"id": "cfd7855a-e494-456a-b9d4-02bab193fd03", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-66586289", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.117", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "0ec18dd2e6ea476dbf3745d14a866190", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b5d79f8-fc", "ovs_interfaceid": "0b5d79f8-fcb9-4bc8-b5e3-489fb6218824", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 18:50:51 user nova-compute[75216]: DEBUG nova.network.os_vif_util [req-6281c0f0-a3e6-4be7-a806-b0d2ff41d202 req-44c82a09-05fb-4f0f-814e-7866b4a3b8fe service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:dc:62,bridge_name='br-int',has_traffic_filtering=True,id=0b5d79f8-fcb9-4bc8-b5e3-489fb6218824,network=Network(cfd7855a-e494-456a-b9d4-02bab193fd03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b5d79f8-fc') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 18:50:51 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [req-6281c0f0-a3e6-4be7-a806-b0d2ff41d202 req-44c82a09-05fb-4f0f-814e-7866b4a3b8fe service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:01:dc:62"/><model type="virtio"/><mtu size="1442"/><target dev="tap0b5d79f8-fc"/></interface> {{(pid=75216) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 13 18:50:51 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [req-6281c0f0-a3e6-4be7-a806-b0d2ff41d202 req-44c82a09-05fb-4f0f-814e-7866b4a3b8fe service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:01:dc:62"/><model type="virtio"/><mtu size="1442"/><target dev="tap0b5d79f8-fc"/></interface>not found in domain: <domain type='kvm' id='14'>
Nov 13 18:50:51 user nova-compute[75216]:   <name>instance-0000000d</name>
Nov 13 18:50:51 user nova-compute[75216]:   <uuid>64dfe522-8b46-4df4-8032-591ce56900ec</uuid>
Nov 13 18:50:51 user nova-compute[75216]:   <metadata>
Nov 13 18:50:51 user nova-compute[75216]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 18:50:51 user nova-compute[75216]:   <nova:package version="0.0.0"/>
Nov 13 18:50:51 user nova-compute[75216]:   <nova:name>tempest-device-tagging-server-904595823</nova:name>
Nov 13 18:50:51 user nova-compute[75216]:   <nova:creationTime>2023-11-13 18:50:51</nova:creationTime>
Nov 13 18:50:51 user nova-compute[75216]:   <nova:flavor name="m1.tiny">
Nov 13 18:50:51 user nova-compute[75216]:     <nova:memory>512</nova:memory>
Nov 13 18:50:51 user nova-compute[75216]:     <nova:disk>1</nova:disk>
Nov 13 18:50:51 user nova-compute[75216]:     <nova:swap>0</nova:swap>
Nov 13 18:50:51 user nova-compute[75216]:     <nova:ephemeral>0</nova:ephemeral>
Nov 13 18:50:51 user nova-compute[75216]:     <nova:vcpus>1</nova:vcpus>
Nov 13 18:50:51 user nova-compute[75216]:   </nova:flavor>
Nov 13 18:50:51 user nova-compute[75216]:   <nova:owner>
Nov 13 18:50:51 user nova-compute[75216]:     <nova:user uuid="454caf80dd76487baead7c52f05df1a5">tempest-TaggedAttachmentsTest-507898025-project-member</nova:user>
Nov 13 18:50:51 user nova-compute[75216]:     <nova:project uuid="0ec18dd2e6ea476dbf3745d14a866190">tempest-TaggedAttachmentsTest-507898025</nova:project>
Nov 13 18:50:51 user nova-compute[75216]:   </nova:owner>
Nov 13 18:50:51 user nova-compute[75216]:   <nova:root type="image" uuid="77bcb5ba-8510-41ec-a88d-96097bb431de"/>
Nov 13 18:50:51 user nova-compute[75216]:   <nova:ports>
Nov 13 18:50:51 user nova-compute[75216]:     <nova:port uuid="2d12f254-7874-4622-a7cb-8180de961bd1">
Nov 13 18:50:51 user nova-compute[75216]:       <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 13 18:50:51 user nova-compute[75216]:     </nova:port>
Nov 13 18:50:51 user nova-compute[75216]:   </nova:ports>
Nov 13 18:50:51 user nova-compute[75216]: </nova:instance>
Nov 13 18:50:51 user nova-compute[75216]:   </metadata>
Nov 13 18:50:51 user nova-compute[75216]:   <memory unit='KiB'>524288</memory>
Nov 13 18:50:51 user nova-compute[75216]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 13 18:50:51 user nova-compute[75216]:   <vcpu placement='static'>1</vcpu>
Nov 13 18:50:51 user nova-compute[75216]:   <resource>
Nov 13 18:50:51 user nova-compute[75216]:     <partition>/machine</partition>
Nov 13 18:50:51 user nova-compute[75216]:   </resource>
Nov 13 18:50:51 user nova-compute[75216]:   <sysinfo type='smbios'>
Nov 13 18:50:51 user nova-compute[75216]:     <system>
Nov 13 18:50:51 user nova-compute[75216]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 13 18:50:51 user nova-compute[75216]:       <entry name='product'>OpenStack Nova</entry>
Nov 13 18:50:51 user nova-compute[75216]:       <entry name='version'>0.0.0</entry>
Nov 13 18:50:51 user nova-compute[75216]:       <entry name='serial'>64dfe522-8b46-4df4-8032-591ce56900ec</entry>
Nov 13 18:50:51 user nova-compute[75216]:       <entry name='uuid'>64dfe522-8b46-4df4-8032-591ce56900ec</entry>
Nov 13 18:50:51 user nova-compute[75216]:       <entry name='family'>Virtual Machine</entry>
Nov 13 18:50:51 user nova-compute[75216]:     </system>
Nov 13 18:50:51 user nova-compute[75216]:   </sysinfo>
Nov 13 18:50:51 user nova-compute[75216]:   <os>
Nov 13 18:50:51 user nova-compute[75216]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 13 18:50:51 user nova-compute[75216]:     <boot dev='hd'/>
Nov 13 18:50:51 user nova-compute[75216]:     <smbios mode='sysinfo'/>
Nov 13 18:50:51 user nova-compute[75216]:   </os>
Nov 13 18:50:51 user nova-compute[75216]:   <features>
Nov 13 18:50:51 user nova-compute[75216]:     <acpi/>
Nov 13 18:50:51 user nova-compute[75216]:     <apic/>
Nov 13 18:50:51 user nova-compute[75216]:     <vmcoreinfo state='on'/>
Nov 13 18:50:51 user nova-compute[75216]:   </features>
Nov 13 18:50:51 user nova-compute[75216]:   <cpu mode='custom' match='exact' check='full'>
Nov 13 18:50:51 user nova-compute[75216]:     <model fallback='forbid'>Nehalem</model>
Nov 13 18:50:51 user nova-compute[75216]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 13 18:50:51 user nova-compute[75216]:     <feature policy='require' name='vme'/>
Nov 13 18:50:51 user nova-compute[75216]:     <feature policy='require' name='x2apic'/>
Nov 13 18:50:51 user nova-compute[75216]:     <feature policy='require' name='hypervisor'/>
Nov 13 18:50:51 user nova-compute[75216]:   </cpu>
Nov 13 18:50:51 user nova-compute[75216]:   <clock offset='utc'>
Nov 13 18:50:51 user nova-compute[75216]:     <timer name='pit' tickpolicy='delay'/>
Nov 13 18:50:51 user nova-compute[75216]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 13 18:50:51 user nova-compute[75216]:     <timer name='hpet' present='no'/>
Nov 13 18:50:51 user nova-compute[75216]:   </clock>
Nov 13 18:50:51 user nova-compute[75216]:   <on_poweroff>destroy</on_poweroff>
Nov 13 18:50:51 user nova-compute[75216]:   <on_reboot>restart</on_reboot>
Nov 13 18:50:51 user nova-compute[75216]:   <on_crash>destroy</on_crash>
Nov 13 18:50:51 user nova-compute[75216]:   <devices>
Nov 13 18:50:51 user nova-compute[75216]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 13 18:50:51 user nova-compute[75216]:     <disk type='file' device='disk'>
Nov 13 18:50:51 user nova-compute[75216]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 13 18:50:51 user nova-compute[75216]:       <source file='/opt/stack/data/nova/instances/64dfe522-8b46-4df4-8032-591ce56900ec/disk' index='2'/>
Nov 13 18:50:51 user nova-compute[75216]:       <backingStore type='file' index='3'>
Nov 13 18:50:51 user nova-compute[75216]:         <format type='raw'/>
Nov 13 18:50:51 user nova-compute[75216]:         <source file='/opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6'/>
Nov 13 18:50:51 user nova-compute[75216]:         <backingStore/>
Nov 13 18:50:51 user nova-compute[75216]:       </backingStore>
Nov 13 18:50:51 user nova-compute[75216]:       <target dev='vda' bus='virtio'/>
Nov 13 18:50:51 user nova-compute[75216]:       <alias name='virtio-disk0'/>
Nov 13 18:50:51 user nova-compute[75216]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 13 18:50:51 user nova-compute[75216]:     </disk>
Nov 13 18:50:51 user nova-compute[75216]:     <disk type='file' device='cdrom'>
Nov 13 18:50:51 user nova-compute[75216]:       <driver name='qemu' type='raw' cache='none'/>
Nov 13 18:50:51 user nova-compute[75216]:       <source file='/opt/stack/data/nova/instances/64dfe522-8b46-4df4-8032-591ce56900ec/disk.config' index='1'/>
Nov 13 18:50:51 user nova-compute[75216]:       <backingStore/>
Nov 13 18:50:51 user nova-compute[75216]:       <target dev='hda' bus='ide'/>
Nov 13 18:50:51 user nova-compute[75216]:       <readonly/>
Nov 13 18:50:51 user nova-compute[75216]:       <alias name='ide0-0-0'/>
Nov 13 18:50:51 user nova-compute[75216]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 13 18:50:51 user nova-compute[75216]:     </disk>
Nov 13 18:50:51 user nova-compute[75216]:     <controller type='usb' index='0' model='none'>
Nov 13 18:50:51 user nova-compute[75216]:       <alias name='usb'/>
Nov 13 18:50:51 user nova-compute[75216]:     </controller>
Nov 13 18:50:51 user nova-compute[75216]:     <controller type='pci' index='0' model='pci-root'>
Nov 13 18:50:51 user nova-compute[75216]:       <alias name='pci.0'/>
Nov 13 18:50:51 user nova-compute[75216]:     </controller>
Nov 13 18:50:51 user nova-compute[75216]:     <controller type='ide' index='0'>
Nov 13 18:50:51 user nova-compute[75216]:       <alias name='ide'/>
Nov 13 18:50:51 user nova-compute[75216]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 13 18:50:51 user nova-compute[75216]:     </controller>
Nov 13 18:50:51 user nova-compute[75216]:     <interface type='ethernet'>
Nov 13 18:50:51 user nova-compute[75216]:       <mac address='fa:16:3e:a1:6b:92'/>
Nov 13 18:50:51 user nova-compute[75216]:       <target dev='tap2d12f254-78'/>
Nov 13 18:50:51 user nova-compute[75216]:       <model type='virtio'/>
Nov 13 18:50:51 user nova-compute[75216]:       <mtu size='1442'/>
Nov 13 18:50:51 user nova-compute[75216]:       <alias name='net0'/>
Nov 13 18:50:51 user nova-compute[75216]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 13 18:50:51 user nova-compute[75216]:     </interface>
Nov 13 18:50:51 user nova-compute[75216]:     <serial type='pty'>
Nov 13 18:50:51 user nova-compute[75216]:       <source path='/dev/pts/1'/>
Nov 13 18:50:51 user nova-compute[75216]:       <log file='/opt/stack/data/nova/instances/64dfe522-8b46-4df4-8032-591ce56900ec/console.log' append='off'/>
Nov 13 18:50:51 user nova-compute[75216]:       <target type='isa-serial' port='0'>
Nov 13 18:50:51 user nova-compute[75216]:         <model name='isa-serial'/>
Nov 13 18:50:51 user nova-compute[75216]:       </target>
Nov 13 18:50:51 user nova-compute[75216]:       <alias name='serial0'/>
Nov 13 18:50:51 user nova-compute[75216]:     </serial>
Nov 13 18:50:51 user nova-compute[75216]:     <console type='pty' tty='/dev/pts/1'>
Nov 13 18:50:51 user nova-compute[75216]:       <source path='/dev/pts/1'/>
Nov 13 18:50:51 user nova-compute[75216]:       <log file='/opt/stack/data/nova/instances/64dfe522-8b46-4df4-8032-591ce56900ec/console.log' append='off'/>
Nov 13 18:50:51 user nova-compute[75216]:       <target type='serial' port='0'/>
Nov 13 18:50:51 user nova-compute[75216]:       <alias name='serial0'/>
Nov 13 18:50:51 user nova-compute[75216]:     </console>
Nov 13 18:50:51 user nova-compute[75216]:     <input type='mouse' bus='ps2'>
Nov 13 18:50:51 user nova-compute[75216]:       <alias name='input0'/>
Nov 13 18:50:51 user nova-compute[75216]:     </input>
Nov 13 18:50:51 user nova-compute[75216]:     <input type='keyboard' bus='ps2'>
Nov 13 18:50:51 user nova-compute[75216]:       <alias name='input1'/>
Nov 13 18:50:51 user nova-compute[75216]:     </input>
Nov 13 18:50:51 user nova-compute[75216]:     <graphics type='vnc' port='5901' autoport='yes' listen='0.0.0.0'>
Nov 13 18:50:51 user nova-compute[75216]:       <listen type='address' address='0.0.0.0'/>
Nov 13 18:50:51 user nova-compute[75216]:     </graphics>
Nov 13 18:50:51 user nova-compute[75216]:     <audio id='1' type='none'/>
Nov 13 18:50:51 user nova-compute[75216]:     <video>
Nov 13 18:50:51 user nova-compute[75216]:       <model type='virtio' heads='1' primary='yes'/>
Nov 13 18:50:51 user nova-compute[75216]:       <alias name='video0'/>
Nov 13 18:50:51 user nova-compute[75216]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 13 18:50:51 user nova-compute[75216]:     </video>
Nov 13 18:50:51 user nova-compute[75216]:     <memballoon model='virtio'>
Nov 13 18:50:51 user nova-compute[75216]:       <stats period='10'/>
Nov 13 18:50:51 user nova-compute[75216]:       <alias name='balloon0'/>
Nov 13 18:50:51 user nova-compute[75216]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 13 18:50:51 user nova-compute[75216]:     </memballoon>
Nov 13 18:50:51 user nova-compute[75216]:     <rng model='virtio'>
Nov 13 18:50:51 user nova-compute[75216]:       <backend model='random'>/dev/urandom</backend>
Nov 13 18:50:51 user nova-compute[75216]:       <alias name='rng0'/>
Nov 13 18:50:51 user nova-compute[75216]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 13 18:50:51 user nova-compute[75216]:     </rng>
Nov 13 18:50:51 user nova-compute[75216]:   </devices>
Nov 13 18:50:51 user nova-compute[75216]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 13 18:50:51 user nova-compute[75216]:     <label>libvirt-64dfe522-8b46-4df4-8032-591ce56900ec</label>
Nov 13 18:50:51 user nova-compute[75216]:     <imagelabel>libvirt-64dfe522-8b46-4df4-8032-591ce56900ec</imagelabel>
Nov 13 18:50:51 user nova-compute[75216]:   </seclabel>
Nov 13 18:50:51 user nova-compute[75216]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 13 18:50:51 user nova-compute[75216]:     <label>+64055:+108</label>
Nov 13 18:50:51 user nova-compute[75216]:     <imagelabel>+64055:+108</imagelabel>
Nov 13 18:50:51 user nova-compute[75216]:   </seclabel>
Nov 13 18:50:51 user nova-compute[75216]: </domain>
Nov 13 18:50:51 user nova-compute[75216]:  {{(pid=75216) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 13 18:50:51 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [req-6281c0f0-a3e6-4be7-a806-b0d2ff41d202 req-44c82a09-05fb-4f0f-814e-7866b4a3b8fe service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:01:dc:62"/><model type="virtio"/><mtu size="1442"/><target dev="tap0b5d79f8-fc"/></interface> {{(pid=75216) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 13 18:50:51 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [req-6281c0f0-a3e6-4be7-a806-b0d2ff41d202 req-44c82a09-05fb-4f0f-814e-7866b4a3b8fe service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:01:dc:62"/><model type="virtio"/><mtu size="1442"/><target dev="tap0b5d79f8-fc"/></interface>not found in domain: <domain type='kvm' id='14'>
Nov 13 18:50:51 user nova-compute[75216]:   <name>instance-0000000d</name>
Nov 13 18:50:51 user nova-compute[75216]:   <uuid>64dfe522-8b46-4df4-8032-591ce56900ec</uuid>
Nov 13 18:50:51 user nova-compute[75216]:   <metadata>
Nov 13 18:50:51 user nova-compute[75216]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 18:50:51 user nova-compute[75216]:   <nova:package version="0.0.0"/>
Nov 13 18:50:51 user nova-compute[75216]:   <nova:name>tempest-device-tagging-server-904595823</nova:name>
Nov 13 18:50:51 user nova-compute[75216]:   <nova:creationTime>2023-11-13 18:50:51</nova:creationTime>
Nov 13 18:50:51 user nova-compute[75216]:   <nova:flavor name="m1.tiny">
Nov 13 18:50:51 user nova-compute[75216]:     <nova:memory>512</nova:memory>
Nov 13 18:50:51 user nova-compute[75216]:     <nova:disk>1</nova:disk>
Nov 13 18:50:51 user nova-compute[75216]:     <nova:swap>0</nova:swap>
Nov 13 18:50:51 user nova-compute[75216]:     <nova:ephemeral>0</nova:ephemeral>
Nov 13 18:50:51 user nova-compute[75216]:     <nova:vcpus>1</nova:vcpus>
Nov 13 18:50:51 user nova-compute[75216]:   </nova:flavor>
Nov 13 18:50:51 user nova-compute[75216]:   <nova:owner>
Nov 13 18:50:51 user nova-compute[75216]:     <nova:user uuid="454caf80dd76487baead7c52f05df1a5">tempest-TaggedAttachmentsTest-507898025-project-member</nova:user>
Nov 13 18:50:51 user nova-compute[75216]:     <nova:project uuid="0ec18dd2e6ea476dbf3745d14a866190">tempest-TaggedAttachmentsTest-507898025</nova:project>
Nov 13 18:50:51 user nova-compute[75216]:   </nova:owner>
Nov 13 18:50:51 user nova-compute[75216]:   <nova:root type="image" uuid="77bcb5ba-8510-41ec-a88d-96097bb431de"/>
Nov 13 18:50:51 user nova-compute[75216]:   <nova:ports>
Nov 13 18:50:51 user nova-compute[75216]:     <nova:port uuid="2d12f254-7874-4622-a7cb-8180de961bd1">
Nov 13 18:50:51 user nova-compute[75216]:       <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 13 18:50:51 user nova-compute[75216]:     </nova:port>
Nov 13 18:50:51 user nova-compute[75216]:   </nova:ports>
Nov 13 18:50:51 user nova-compute[75216]: </nova:instance>
Nov 13 18:50:51 user nova-compute[75216]:   </metadata>
Nov 13 18:50:51 user nova-compute[75216]:   <memory unit='KiB'>524288</memory>
Nov 13 18:50:51 user nova-compute[75216]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 13 18:50:51 user nova-compute[75216]:   <vcpu placement='static'>1</vcpu>
Nov 13 18:50:51 user nova-compute[75216]:   <resource>
Nov 13 18:50:51 user nova-compute[75216]:     <partition>/machine</partition>
Nov 13 18:50:51 user nova-compute[75216]:   </resource>
Nov 13 18:50:51 user nova-compute[75216]:   <sysinfo type='smbios'>
Nov 13 18:50:51 user nova-compute[75216]:     <system>
Nov 13 18:50:51 user nova-compute[75216]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 13 18:50:51 user nova-compute[75216]:       <entry name='product'>OpenStack Nova</entry>
Nov 13 18:50:51 user nova-compute[75216]:       <entry name='version'>0.0.0</entry>
Nov 13 18:50:51 user nova-compute[75216]:       <entry name='serial'>64dfe522-8b46-4df4-8032-591ce56900ec</entry>
Nov 13 18:50:51 user nova-compute[75216]:       <entry name='uuid'>64dfe522-8b46-4df4-8032-591ce56900ec</entry>
Nov 13 18:50:51 user nova-compute[75216]:       <entry name='family'>Virtual Machine</entry>
Nov 13 18:50:51 user nova-compute[75216]:     </system>
Nov 13 18:50:51 user nova-compute[75216]:   </sysinfo>
Nov 13 18:50:51 user nova-compute[75216]:   <os>
Nov 13 18:50:51 user nova-compute[75216]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 13 18:50:51 user nova-compute[75216]:     <boot dev='hd'/>
Nov 13 18:50:51 user nova-compute[75216]:     <smbios mode='sysinfo'/>
Nov 13 18:50:51 user nova-compute[75216]:   </os>
Nov 13 18:50:51 user nova-compute[75216]:   <features>
Nov 13 18:50:51 user nova-compute[75216]:     <acpi/>
Nov 13 18:50:51 user nova-compute[75216]:     <apic/>
Nov 13 18:50:51 user nova-compute[75216]:     <vmcoreinfo state='on'/>
Nov 13 18:50:51 user nova-compute[75216]:   </features>
Nov 13 18:50:51 user nova-compute[75216]:   <cpu mode='custom' match='exact' check='full'>
Nov 13 18:50:51 user nova-compute[75216]:     <model fallback='forbid'>Nehalem</model>
Nov 13 18:50:51 user nova-compute[75216]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 13 18:50:51 user nova-compute[75216]:     <feature policy='require' name='vme'/>
Nov 13 18:50:51 user nova-compute[75216]:     <feature policy='require' name='x2apic'/>
Nov 13 18:50:51 user nova-compute[75216]:     <feature policy='require' name='hypervisor'/>
Nov 13 18:50:51 user nova-compute[75216]:   </cpu>
Nov 13 18:50:51 user nova-compute[75216]:   <clock offset='utc'>
Nov 13 18:50:51 user nova-compute[75216]:     <timer name='pit' tickpolicy='delay'/>
Nov 13 18:50:51 user nova-compute[75216]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 13 18:50:51 user nova-compute[75216]:     <timer name='hpet' present='no'/>
Nov 13 18:50:51 user nova-compute[75216]:   </clock>
Nov 13 18:50:51 user nova-compute[75216]:   <on_poweroff>destroy</on_poweroff>
Nov 13 18:50:51 user nova-compute[75216]:   <on_reboot>restart</on_reboot>
Nov 13 18:50:51 user nova-compute[75216]:   <on_crash>destroy</on_crash>
Nov 13 18:50:51 user nova-compute[75216]:   <devices>
Nov 13 18:50:51 user nova-compute[75216]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 13 18:50:51 user nova-compute[75216]:     <disk type='file' device='disk'>
Nov 13 18:50:51 user nova-compute[75216]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 13 18:50:51 user nova-compute[75216]:       <source file='/opt/stack/data/nova/instances/64dfe522-8b46-4df4-8032-591ce56900ec/disk' index='2'/>
Nov 13 18:50:51 user nova-compute[75216]:       <backingStore type='file' index='3'>
Nov 13 18:50:51 user nova-compute[75216]:         <format type='raw'/>
Nov 13 18:50:51 user nova-compute[75216]:         <source file='/opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6'/>
Nov 13 18:50:51 user nova-compute[75216]:         <backingStore/>
Nov 13 18:50:51 user nova-compute[75216]:       </backingStore>
Nov 13 18:50:51 user nova-compute[75216]:       <target dev='vda' bus='virtio'/>
Nov 13 18:50:51 user nova-compute[75216]:       <alias name='virtio-disk0'/>
Nov 13 18:50:51 user nova-compute[75216]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 13 18:50:51 user nova-compute[75216]:     </disk>
Nov 13 18:50:51 user nova-compute[75216]:     <disk type='file' device='cdrom'>
Nov 13 18:50:51 user nova-compute[75216]:       <driver name='qemu' type='raw' cache='none'/>
Nov 13 18:50:51 user nova-compute[75216]:       <source file='/opt/stack/data/nova/instances/64dfe522-8b46-4df4-8032-591ce56900ec/disk.config' index='1'/>
Nov 13 18:50:51 user nova-compute[75216]:       <backingStore/>
Nov 13 18:50:51 user nova-compute[75216]:       <target dev='hda' bus='ide'/>
Nov 13 18:50:51 user nova-compute[75216]:       <readonly/>
Nov 13 18:50:51 user nova-compute[75216]:       <alias name='ide0-0-0'/>
Nov 13 18:50:51 user nova-compute[75216]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 13 18:50:51 user nova-compute[75216]:     </disk>
Nov 13 18:50:51 user nova-compute[75216]:     <controller type='usb' index='0' model='none'>
Nov 13 18:50:51 user nova-compute[75216]:       <alias name='usb'/>
Nov 13 18:50:51 user nova-compute[75216]:     </controller>
Nov 13 18:50:51 user nova-compute[75216]:     <controller type='pci' index='0' model='pci-root'>
Nov 13 18:50:51 user nova-compute[75216]:       <alias name='pci.0'/>
Nov 13 18:50:51 user nova-compute[75216]:     </controller>
Nov 13 18:50:51 user nova-compute[75216]:     <controller type='ide' index='0'>
Nov 13 18:50:51 user nova-compute[75216]:       <alias name='ide'/>
Nov 13 18:50:51 user nova-compute[75216]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 13 18:50:51 user nova-compute[75216]:     </controller>
Nov 13 18:50:51 user nova-compute[75216]:     <interface type='ethernet'>
Nov 13 18:50:51 user nova-compute[75216]:       <mac address='fa:16:3e:a1:6b:92'/>
Nov 13 18:50:51 user nova-compute[75216]:       <target dev='tap2d12f254-78'/>
Nov 13 18:50:51 user nova-compute[75216]:       <model type='virtio'/>
Nov 13 18:50:51 user nova-compute[75216]:       <mtu size='1442'/>
Nov 13 18:50:51 user nova-compute[75216]:       <alias name='net0'/>
Nov 13 18:50:51 user nova-compute[75216]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 13 18:50:51 user nova-compute[75216]:     </interface>
Nov 13 18:50:51 user nova-compute[75216]:     <serial type='pty'>
Nov 13 18:50:51 user nova-compute[75216]:       <source path='/dev/pts/1'/>
Nov 13 18:50:51 user nova-compute[75216]:       <log file='/opt/stack/data/nova/instances/64dfe522-8b46-4df4-8032-591ce56900ec/console.log' append='off'/>
Nov 13 18:50:51 user nova-compute[75216]:       <target type='isa-serial' port='0'>
Nov 13 18:50:51 user nova-compute[75216]:         <model name='isa-serial'/>
Nov 13 18:50:51 user nova-compute[75216]:       </target>
Nov 13 18:50:51 user nova-compute[75216]:       <alias name='serial0'/>
Nov 13 18:50:51 user nova-compute[75216]:     </serial>
Nov 13 18:50:51 user nova-compute[75216]:     <console type='pty' tty='/dev/pts/1'>
Nov 13 18:50:51 user nova-compute[75216]:       <source path='/dev/pts/1'/>
Nov 13 18:50:51 user nova-compute[75216]:       <log file='/opt/stack/data/nova/instances/64dfe522-8b46-4df4-8032-591ce56900ec/console.log' append='off'/>
Nov 13 18:50:51 user nova-compute[75216]:       <target type='serial' port='0'/>
Nov 13 18:50:51 user nova-compute[75216]:       <alias name='serial0'/>
Nov 13 18:50:51 user nova-compute[75216]:     </console>
Nov 13 18:50:51 user nova-compute[75216]:     <input type='mouse' bus='ps2'>
Nov 13 18:50:51 user nova-compute[75216]:       <alias name='input0'/>
Nov 13 18:50:51 user nova-compute[75216]:     </input>
Nov 13 18:50:51 user nova-compute[75216]:     <input type='keyboard' bus='ps2'>
Nov 13 18:50:51 user nova-compute[75216]:       <alias name='input1'/>
Nov 13 18:50:51 user nova-compute[75216]:     </input>
Nov 13 18:50:51 user nova-compute[75216]:     <graphics type='vnc' port='5901' autoport='yes' listen='0.0.0.0'>
Nov 13 18:50:51 user nova-compute[75216]:       <listen type='address' address='0.0.0.0'/>
Nov 13 18:50:51 user nova-compute[75216]:     </graphics>
Nov 13 18:50:51 user nova-compute[75216]:     <audio id='1' type='none'/>
Nov 13 18:50:51 user nova-compute[75216]:     <video>
Nov 13 18:50:51 user nova-compute[75216]:       <model type='virtio' heads='1' primary='yes'/>
Nov 13 18:50:51 user nova-compute[75216]:       <alias name='video0'/>
Nov 13 18:50:51 user nova-compute[75216]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 13 18:50:51 user nova-compute[75216]:     </video>
Nov 13 18:50:51 user nova-compute[75216]:     <memballoon model='virtio'>
Nov 13 18:50:51 user nova-compute[75216]:       <stats period='10'/>
Nov 13 18:50:51 user nova-compute[75216]:       <alias name='balloon0'/>
Nov 13 18:50:51 user nova-compute[75216]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 13 18:50:51 user nova-compute[75216]:     </memballoon>
Nov 13 18:50:51 user nova-compute[75216]:     <rng model='virtio'>
Nov 13 18:50:51 user nova-compute[75216]:       <backend model='random'>/dev/urandom</backend>
Nov 13 18:50:51 user nova-compute[75216]:       <alias name='rng0'/>
Nov 13 18:50:51 user nova-compute[75216]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 13 18:50:51 user nova-compute[75216]:     </rng>
Nov 13 18:50:51 user nova-compute[75216]:   </devices>
Nov 13 18:50:51 user nova-compute[75216]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 13 18:50:51 user nova-compute[75216]:     <label>libvirt-64dfe522-8b46-4df4-8032-591ce56900ec</label>
Nov 13 18:50:51 user nova-compute[75216]:     <imagelabel>libvirt-64dfe522-8b46-4df4-8032-591ce56900ec</imagelabel>
Nov 13 18:50:51 user nova-compute[75216]:   </seclabel>
Nov 13 18:50:51 user nova-compute[75216]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 13 18:50:51 user nova-compute[75216]:     <label>+64055:+108</label>
Nov 13 18:50:51 user nova-compute[75216]:     <imagelabel>+64055:+108</imagelabel>
Nov 13 18:50:51 user nova-compute[75216]:   </seclabel>
Nov 13 18:50:51 user nova-compute[75216]: </domain>
Nov 13 18:50:51 user nova-compute[75216]:  {{(pid=75216) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 13 18:50:51 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [req-6281c0f0-a3e6-4be7-a806-b0d2ff41d202 req-44c82a09-05fb-4f0f-814e-7866b4a3b8fe service nova] [instance: 64dfe522-8b46-4df4-8032-591ce56900ec] Detaching interface fa:16:3e:01:dc:62 failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tap0b5d79f8-fc' not found.
Nov 13 18:50:51 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [req-6281c0f0-a3e6-4be7-a806-b0d2ff41d202 req-44c82a09-05fb-4f0f-814e-7866b4a3b8fe service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T18:48:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-904595823',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-904595823',id=13,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAnoGBZDueYOh3xcWER1AMv30DIYxQxeWRDS2fRFXh6l4DZc8pD4qIgg0IjDLbUZuBfE7+vn5QgzB7ChiJAa+d1ltHilcpx/dg8eDxHVfO8o++kjL7IH7NIL3RYQDYV6Ew==',key_name='tempest-keypair-1295383460',keypairs=<?>,launch_index=0,launched_at=2023-11-13T18:48:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0ec18dd2e6ea476dbf3745d14a866190',ramdisk_id='',reservation_id='r-0a499j0h',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-507898025',owner_user_name='tempest-TaggedAttachmentsTest-507898025-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T18:48:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='454caf80dd76487baead7c52f05df1a5',uuid=64dfe522-8b46-4df4-8032-591ce56900ec,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0b5d79f8-fcb9-4bc8-b5e3-489fb6218824", "address": "fa:16:3e:01:dc:62", "network": {"id": "cfd7855a-e494-456a-b9d4-02bab193fd03", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-66586289", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.117", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "0ec18dd2e6ea476dbf3745d14a866190", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b5d79f8-fc", "ovs_interfaceid": "0b5d79f8-fcb9-4bc8-b5e3-489fb6218824", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 18:50:51 user nova-compute[75216]: DEBUG nova.network.os_vif_util [req-6281c0f0-a3e6-4be7-a806-b0d2ff41d202 req-44c82a09-05fb-4f0f-814e-7866b4a3b8fe service nova] Converting VIF {"id": "0b5d79f8-fcb9-4bc8-b5e3-489fb6218824", "address": "fa:16:3e:01:dc:62", "network": {"id": "cfd7855a-e494-456a-b9d4-02bab193fd03", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-66586289", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.117", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "0ec18dd2e6ea476dbf3745d14a866190", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b5d79f8-fc", "ovs_interfaceid": "0b5d79f8-fcb9-4bc8-b5e3-489fb6218824", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 18:50:51 user nova-compute[75216]: DEBUG nova.network.os_vif_util [req-6281c0f0-a3e6-4be7-a806-b0d2ff41d202 req-44c82a09-05fb-4f0f-814e-7866b4a3b8fe service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:dc:62,bridge_name='br-int',has_traffic_filtering=True,id=0b5d79f8-fcb9-4bc8-b5e3-489fb6218824,network=Network(cfd7855a-e494-456a-b9d4-02bab193fd03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b5d79f8-fc') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 18:50:51 user nova-compute[75216]: DEBUG os_vif [req-6281c0f0-a3e6-4be7-a806-b0d2ff41d202 req-44c82a09-05fb-4f0f-814e-7866b4a3b8fe service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:dc:62,bridge_name='br-int',has_traffic_filtering=True,id=0b5d79f8-fcb9-4bc8-b5e3-489fb6218824,network=Network(cfd7855a-e494-456a-b9d4-02bab193fd03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b5d79f8-fc') {{(pid=75216) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 18:50:51 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:50:51 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0b5d79f8-fc, bridge=br-int, if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:50:51 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 18:50:51 user nova-compute[75216]: INFO os_vif [req-6281c0f0-a3e6-4be7-a806-b0d2ff41d202 req-44c82a09-05fb-4f0f-814e-7866b4a3b8fe service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:dc:62,bridge_name='br-int',has_traffic_filtering=True,id=0b5d79f8-fcb9-4bc8-b5e3-489fb6218824,network=Network(cfd7855a-e494-456a-b9d4-02bab193fd03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b5d79f8-fc')
Nov 13 18:50:51 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [req-6281c0f0-a3e6-4be7-a806-b0d2ff41d202 req-44c82a09-05fb-4f0f-814e-7866b4a3b8fe service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 18:50:51 user nova-compute[75216]:   <nova:package version="0.0.0"/>
Nov 13 18:50:51 user nova-compute[75216]:   <nova:name>tempest-device-tagging-server-904595823</nova:name>
Nov 13 18:50:51 user nova-compute[75216]:   <nova:creationTime>2023-11-13 18:50:51</nova:creationTime>
Nov 13 18:50:51 user nova-compute[75216]:   <nova:flavor name="m1.tiny">
Nov 13 18:50:51 user nova-compute[75216]:     <nova:memory>512</nova:memory>
Nov 13 18:50:51 user nova-compute[75216]:     <nova:disk>1</nova:disk>
Nov 13 18:50:51 user nova-compute[75216]:     <nova:swap>0</nova:swap>
Nov 13 18:50:51 user nova-compute[75216]:     <nova:ephemeral>0</nova:ephemeral>
Nov 13 18:50:51 user nova-compute[75216]:     <nova:vcpus>1</nova:vcpus>
Nov 13 18:50:51 user nova-compute[75216]:   </nova:flavor>
Nov 13 18:50:51 user nova-compute[75216]:   <nova:owner>
Nov 13 18:50:51 user nova-compute[75216]:     <nova:user uuid="454caf80dd76487baead7c52f05df1a5">tempest-TaggedAttachmentsTest-507898025-project-member</nova:user>
Nov 13 18:50:51 user nova-compute[75216]:     <nova:project uuid="0ec18dd2e6ea476dbf3745d14a866190">tempest-TaggedAttachmentsTest-507898025</nova:project>
Nov 13 18:50:51 user nova-compute[75216]:   </nova:owner>
Nov 13 18:50:51 user nova-compute[75216]:   <nova:root type="image" uuid="77bcb5ba-8510-41ec-a88d-96097bb431de"/>
Nov 13 18:50:51 user nova-compute[75216]:   <nova:ports>
Nov 13 18:50:51 user nova-compute[75216]:     <nova:port uuid="2d12f254-7874-4622-a7cb-8180de961bd1">
Nov 13 18:50:51 user nova-compute[75216]:       <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 13 18:50:51 user nova-compute[75216]:     </nova:port>
Nov 13 18:50:51 user nova-compute[75216]:   </nova:ports>
Nov 13 18:50:51 user nova-compute[75216]: </nova:instance>
Nov 13 18:50:51 user nova-compute[75216]:  {{(pid=75216) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 13 18:50:52 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-bbde43d7-3250-4559-b648-bf9170f5dd18 tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] Acquiring lock "83fda249-9d28-4cc2-aeb0-103ce4f1faa4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:50:52 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-bbde43d7-3250-4559-b648-bf9170f5dd18 tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] Lock "83fda249-9d28-4cc2-aeb0-103ce4f1faa4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:50:52 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-bbde43d7-3250-4559-b648-bf9170f5dd18 tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] Acquiring lock "83fda249-9d28-4cc2-aeb0-103ce4f1faa4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:50:52 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-bbde43d7-3250-4559-b648-bf9170f5dd18 tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] Lock "83fda249-9d28-4cc2-aeb0-103ce4f1faa4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:50:52 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-bbde43d7-3250-4559-b648-bf9170f5dd18 tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] Lock "83fda249-9d28-4cc2-aeb0-103ce4f1faa4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:50:52 user nova-compute[75216]: INFO nova.compute.manager [None req-bbde43d7-3250-4559-b648-bf9170f5dd18 tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] [instance: 83fda249-9d28-4cc2-aeb0-103ce4f1faa4] Terminating instance
Nov 13 18:50:52 user nova-compute[75216]: DEBUG nova.compute.manager [None req-bbde43d7-3250-4559-b648-bf9170f5dd18 tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] [instance: 83fda249-9d28-4cc2-aeb0-103ce4f1faa4] Start destroying the instance on the hypervisor. {{(pid=75216) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 18:50:52 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:50:52 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:50:52 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:50:52 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:50:52 user nova-compute[75216]: INFO nova.network.neutron [None req-7a9eeb07-c962-402e-81d1-03558f4f7028 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] [instance: 64dfe522-8b46-4df4-8032-591ce56900ec] Port 0b5d79f8-fcb9-4bc8-b5e3-489fb6218824 from network info_cache is no longer associated with instance in Neutron. Removing from network info_cache.
Nov 13 18:50:52 user nova-compute[75216]: DEBUG nova.network.neutron [None req-7a9eeb07-c962-402e-81d1-03558f4f7028 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] [instance: 64dfe522-8b46-4df4-8032-591ce56900ec] Updating instance_info_cache with network_info: [{"id": "2d12f254-7874-4622-a7cb-8180de961bd1", "address": "fa:16:3e:a1:6b:92", "network": {"id": "0b64448d-5ece-4814-9bdc-de0167e921f9", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-67835474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ec18dd2e6ea476dbf3745d14a866190", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d12f254-78", "ovs_interfaceid": "2d12f254-7874-4622-a7cb-8180de961bd1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 18:50:52 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-7a9eeb07-c962-402e-81d1-03558f4f7028 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] Releasing lock "refresh_cache-64dfe522-8b46-4df4-8032-591ce56900ec" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 18:50:52 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:50:52 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Starting heal instance info cache {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 18:50:52 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-7a9eeb07-c962-402e-81d1-03558f4f7028 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] Lock "interface-64dfe522-8b46-4df4-8032-591ce56900ec-0b5d79f8-fcb9-4bc8-b5e3-489fb6218824" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 22.050s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:50:52 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Didn't find any instances for network info cache update. {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 13 18:50:52 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:50:52 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:50:52 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:50:52 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:50:52 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:50:52 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75216) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 18:50:52 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:50:52 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:50:52 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 83fda249-9d28-4cc2-aeb0-103ce4f1faa4] Instance destroyed successfully.
Nov 13 18:50:52 user nova-compute[75216]: DEBUG nova.objects.instance [None req-bbde43d7-3250-4559-b648-bf9170f5dd18 tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] Lazy-loading 'resources' on Instance uuid 83fda249-9d28-4cc2-aeb0-103ce4f1faa4 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 18:50:52 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-bbde43d7-3250-4559-b648-bf9170f5dd18 tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T18:45:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1853317358',display_name='tempest-VolumesAdminNegativeTest-server-1853317358',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1853317358',id=6,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPlyOd+Qzgrkoc6K4VHy5EGS0XxO0NXm0cLoAg3Ce4zQw96sR95u6n2SqXekqvD63+hyK5YN1zygJDiPVXhUShgpdx9F4/x3gi2NmsXBdoMqxxJoyLAPD8XOmfkauPpHkA==',key_name='tempest-keypair-499332356',keypairs=<?>,launch_index=0,launched_at=2023-11-13T18:45:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7d63d01c37774af48f4d3e49901802f9',ramdisk_id='',reservation_id='r-w5zf5g8e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-999712097',owner_user_name='tempest-VolumesAdminNegativeTest-999712097-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T18:45:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9328187f980b430f9f65420eec9f8c98',uuid=83fda249-9d28-4cc2-aeb0-103ce4f1faa4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "001a2459-5886-44be-aeb3-b2fb4ab71926", "address": "fa:16:3e:ea:a2:8e", "network": {"id": "3e05e26f-bb3f-48d7-a8cf-8974b02b1745", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-600263470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d63d01c37774af48f4d3e49901802f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap001a2459-58", "ovs_interfaceid": "001a2459-5886-44be-aeb3-b2fb4ab71926", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 18:50:52 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-bbde43d7-3250-4559-b648-bf9170f5dd18 tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] Converting VIF {"id": "001a2459-5886-44be-aeb3-b2fb4ab71926", "address": "fa:16:3e:ea:a2:8e", "network": {"id": "3e05e26f-bb3f-48d7-a8cf-8974b02b1745", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-600263470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d63d01c37774af48f4d3e49901802f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap001a2459-58", "ovs_interfaceid": "001a2459-5886-44be-aeb3-b2fb4ab71926", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 18:50:52 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-bbde43d7-3250-4559-b648-bf9170f5dd18 tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ea:a2:8e,bridge_name='br-int',has_traffic_filtering=True,id=001a2459-5886-44be-aeb3-b2fb4ab71926,network=Network(3e05e26f-bb3f-48d7-a8cf-8974b02b1745),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap001a2459-58') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 18:50:52 user nova-compute[75216]: DEBUG os_vif [None req-bbde43d7-3250-4559-b648-bf9170f5dd18 tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ea:a2:8e,bridge_name='br-int',has_traffic_filtering=True,id=001a2459-5886-44be-aeb3-b2fb4ab71926,network=Network(3e05e26f-bb3f-48d7-a8cf-8974b02b1745),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap001a2459-58') {{(pid=75216) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 18:50:52 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:50:52 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap001a2459-58, bridge=br-int, if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:50:52 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:50:52 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:50:52 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:50:52 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f04cfa0e-1461-4a48-8c8d-2c1a7e0c33c3) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:50:52 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:50:52 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:50:52 user nova-compute[75216]: INFO os_vif [None req-bbde43d7-3250-4559-b648-bf9170f5dd18 tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ea:a2:8e,bridge_name='br-int',has_traffic_filtering=True,id=001a2459-5886-44be-aeb3-b2fb4ab71926,network=Network(3e05e26f-bb3f-48d7-a8cf-8974b02b1745),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap001a2459-58')
Nov 13 18:50:52 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-bbde43d7-3250-4559-b648-bf9170f5dd18 tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] [instance: 83fda249-9d28-4cc2-aeb0-103ce4f1faa4] Deleting instance files /opt/stack/data/nova/instances/83fda249-9d28-4cc2-aeb0-103ce4f1faa4_del
Nov 13 18:50:52 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-bbde43d7-3250-4559-b648-bf9170f5dd18 tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] [instance: 83fda249-9d28-4cc2-aeb0-103ce4f1faa4] Deletion of /opt/stack/data/nova/instances/83fda249-9d28-4cc2-aeb0-103ce4f1faa4_del complete
Nov 13 18:50:52 user nova-compute[75216]: INFO nova.compute.manager [None req-bbde43d7-3250-4559-b648-bf9170f5dd18 tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] [instance: 83fda249-9d28-4cc2-aeb0-103ce4f1faa4] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 13 18:50:52 user nova-compute[75216]: DEBUG oslo.service.loopingcall [None req-bbde43d7-3250-4559-b648-bf9170f5dd18 tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75216) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 18:50:52 user nova-compute[75216]: DEBUG nova.compute.manager [-] [instance: 83fda249-9d28-4cc2-aeb0-103ce4f1faa4] Deallocating network for instance {{(pid=75216) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 18:50:52 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: 83fda249-9d28-4cc2-aeb0-103ce4f1faa4] deallocate_for_instance() {{(pid=75216) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 18:50:53 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:50:53 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: 83fda249-9d28-4cc2-aeb0-103ce4f1faa4] Updating instance_info_cache with network_info: [] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 18:50:53 user nova-compute[75216]: INFO nova.compute.manager [-] [instance: 83fda249-9d28-4cc2-aeb0-103ce4f1faa4] Took 0.72 seconds to deallocate network for instance.
Nov 13 18:50:53 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-bbde43d7-3250-4559-b648-bf9170f5dd18 tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:50:53 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-bbde43d7-3250-4559-b648-bf9170f5dd18 tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:50:53 user nova-compute[75216]: DEBUG nova.compute.manager [req-a4c4e3f7-893c-41dd-94c2-63e6db88edb3 req-6540e6c3-0e6b-4231-817f-62ff7da223bb service nova] [instance: 83fda249-9d28-4cc2-aeb0-103ce4f1faa4] Received event network-vif-unplugged-001a2459-5886-44be-aeb3-b2fb4ab71926 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:50:53 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-a4c4e3f7-893c-41dd-94c2-63e6db88edb3 req-6540e6c3-0e6b-4231-817f-62ff7da223bb service nova] Acquiring lock "83fda249-9d28-4cc2-aeb0-103ce4f1faa4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:50:53 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-a4c4e3f7-893c-41dd-94c2-63e6db88edb3 req-6540e6c3-0e6b-4231-817f-62ff7da223bb service nova] Lock "83fda249-9d28-4cc2-aeb0-103ce4f1faa4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:50:53 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-a4c4e3f7-893c-41dd-94c2-63e6db88edb3 req-6540e6c3-0e6b-4231-817f-62ff7da223bb service nova] Lock "83fda249-9d28-4cc2-aeb0-103ce4f1faa4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:50:53 user nova-compute[75216]: DEBUG nova.compute.manager [req-a4c4e3f7-893c-41dd-94c2-63e6db88edb3 req-6540e6c3-0e6b-4231-817f-62ff7da223bb service nova] [instance: 83fda249-9d28-4cc2-aeb0-103ce4f1faa4] No waiting events found dispatching network-vif-unplugged-001a2459-5886-44be-aeb3-b2fb4ab71926 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:50:53 user nova-compute[75216]: WARNING nova.compute.manager [req-a4c4e3f7-893c-41dd-94c2-63e6db88edb3 req-6540e6c3-0e6b-4231-817f-62ff7da223bb service nova] [instance: 83fda249-9d28-4cc2-aeb0-103ce4f1faa4] Received unexpected event network-vif-unplugged-001a2459-5886-44be-aeb3-b2fb4ab71926 for instance with vm_state deleted and task_state None.
Nov 13 18:50:53 user nova-compute[75216]: DEBUG nova.compute.manager [req-a4c4e3f7-893c-41dd-94c2-63e6db88edb3 req-6540e6c3-0e6b-4231-817f-62ff7da223bb service nova] [instance: 83fda249-9d28-4cc2-aeb0-103ce4f1faa4] Received event network-vif-plugged-001a2459-5886-44be-aeb3-b2fb4ab71926 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:50:53 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-a4c4e3f7-893c-41dd-94c2-63e6db88edb3 req-6540e6c3-0e6b-4231-817f-62ff7da223bb service nova] Acquiring lock "83fda249-9d28-4cc2-aeb0-103ce4f1faa4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:50:53 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-a4c4e3f7-893c-41dd-94c2-63e6db88edb3 req-6540e6c3-0e6b-4231-817f-62ff7da223bb service nova] Lock "83fda249-9d28-4cc2-aeb0-103ce4f1faa4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:50:53 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-a4c4e3f7-893c-41dd-94c2-63e6db88edb3 req-6540e6c3-0e6b-4231-817f-62ff7da223bb service nova] Lock "83fda249-9d28-4cc2-aeb0-103ce4f1faa4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:50:53 user nova-compute[75216]: DEBUG nova.compute.manager [req-a4c4e3f7-893c-41dd-94c2-63e6db88edb3 req-6540e6c3-0e6b-4231-817f-62ff7da223bb service nova] [instance: 83fda249-9d28-4cc2-aeb0-103ce4f1faa4] No waiting events found dispatching network-vif-plugged-001a2459-5886-44be-aeb3-b2fb4ab71926 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:50:53 user nova-compute[75216]: WARNING nova.compute.manager [req-a4c4e3f7-893c-41dd-94c2-63e6db88edb3 req-6540e6c3-0e6b-4231-817f-62ff7da223bb service nova] [instance: 83fda249-9d28-4cc2-aeb0-103ce4f1faa4] Received unexpected event network-vif-plugged-001a2459-5886-44be-aeb3-b2fb4ab71926 for instance with vm_state deleted and task_state None.
Nov 13 18:50:53 user nova-compute[75216]: DEBUG nova.compute.manager [req-a4c4e3f7-893c-41dd-94c2-63e6db88edb3 req-6540e6c3-0e6b-4231-817f-62ff7da223bb service nova] [instance: 83fda249-9d28-4cc2-aeb0-103ce4f1faa4] Received event network-vif-deleted-001a2459-5886-44be-aeb3-b2fb4ab71926 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:50:53 user nova-compute[75216]: DEBUG nova.compute.manager [req-8a48967c-512e-49d6-84c1-3e2ed4ffcda4 req-cb13546c-9a61-45a3-be15-17307ccedcc0 service nova] [instance: 3679beb0-5244-443a-8512-38b29ccb62f0] Received event volume-reimaged-ae66a157-b0d3-4501-a728-a010d6a83a10 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:50:53 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-8a48967c-512e-49d6-84c1-3e2ed4ffcda4 req-cb13546c-9a61-45a3-be15-17307ccedcc0 service nova] Acquiring lock "3679beb0-5244-443a-8512-38b29ccb62f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:50:53 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-8a48967c-512e-49d6-84c1-3e2ed4ffcda4 req-cb13546c-9a61-45a3-be15-17307ccedcc0 service nova] Lock "3679beb0-5244-443a-8512-38b29ccb62f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:50:53 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-8a48967c-512e-49d6-84c1-3e2ed4ffcda4 req-cb13546c-9a61-45a3-be15-17307ccedcc0 service nova] Lock "3679beb0-5244-443a-8512-38b29ccb62f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:50:53 user nova-compute[75216]: DEBUG nova.compute.manager [req-8a48967c-512e-49d6-84c1-3e2ed4ffcda4 req-cb13546c-9a61-45a3-be15-17307ccedcc0 service nova] [instance: 3679beb0-5244-443a-8512-38b29ccb62f0] Processing event volume-reimaged-ae66a157-b0d3-4501-a728-a010d6a83a10 {{(pid=75216) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10872}}
Nov 13 18:50:53 user nova-compute[75216]: DEBUG nova.compute.manager [None req-8a48967c-512e-49d6-84c1-3e2ed4ffcda4 tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] [instance: 3679beb0-5244-443a-8512-38b29ccb62f0] Instance event wait completed in 12 seconds for volume-reimaged {{(pid=75216) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 18:50:53 user nova-compute[75216]: INFO nova.virt.block_device [None req-8a48967c-512e-49d6-84c1-3e2ed4ffcda4 tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] [instance: 3679beb0-5244-443a-8512-38b29ccb62f0] Booting with volume ae66a157-b0d3-4501-a728-a010d6a83a10 at /dev/vda
Nov 13 18:50:53 user nova-compute[75216]: DEBUG os_brick.utils [None req-8a48967c-512e-49d6-84c1-3e2ed4ffcda4 tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 18:50:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:50:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:50:53 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcf4df7d-a74c-4f63-9e93-203be28bb7fc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aea6fcfe14b9\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:50:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:50:53 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-bbde43d7-3250-4559-b648-bf9170f5dd18 tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 18:50:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:50:53 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[7195c590-ce57-48fa-9946-9e05062b9259]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:50:53 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-bbde43d7-3250-4559-b648-bf9170f5dd18 tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 18:50:54 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:50:54 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:50:54 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c5f88cd-5b4f-40b6-ad7c-b0e828f70929]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:50:54 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[55afaaad-4a9b-4743-a522-67cfc91026c5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:50:54 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-8a48967c-512e-49d6-84c1-3e2ed4ffcda4 tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] Running cmd (subprocess): nvme version {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:50:54 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-8a48967c-512e-49d6-84c1-3e2ed4ffcda4 tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] 'nvme version' failed. Not Retrying. {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 18:50:54 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8a48967c-512e-49d6-84c1-3e2ed4ffcda4 tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] nvme not present on system {{(pid=75216) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 18:50:54 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-bbde43d7-3250-4559-b648-bf9170f5dd18 tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.381s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:50:54 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:50:54 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 18:50:54 user nova-compute[75216]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 18:50:54 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[d44d95f8-9ba4-4153-a48d-01c74c0ab94d]: (4, '') {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:50:54 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-8a48967c-512e-49d6-84c1-3e2ed4ffcda4 tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75216) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 18:50:54 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-8a48967c-512e-49d6-84c1-3e2ed4ffcda4 tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 18:50:54 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-8a48967c-512e-49d6-84c1-3e2ed4ffcda4 tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] LIGHTOS: no hostnqn found. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 18:50:54 user nova-compute[75216]: DEBUG os_brick.utils [None req-8a48967c-512e-49d6-84c1-3e2ed4ffcda4 tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aea6fcfe14b9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 18:50:54 user nova-compute[75216]: DEBUG nova.virt.block_device [None req-8a48967c-512e-49d6-84c1-3e2ed4ffcda4 tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] [instance: 3679beb0-5244-443a-8512-38b29ccb62f0] Updating existing volume attachment record: 79931e30-14c9-454b-bf2e-8382dde2696f {{(pid=75216) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 18:50:54 user nova-compute[75216]: INFO nova.scheduler.client.report [None req-bbde43d7-3250-4559-b648-bf9170f5dd18 tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] Deleted allocations for instance 83fda249-9d28-4cc2-aeb0-103ce4f1faa4
Nov 13 18:50:54 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-bbde43d7-3250-4559-b648-bf9170f5dd18 tempest-VolumesAdminNegativeTest-999712097 tempest-VolumesAdminNegativeTest-999712097-project-member] Lock "83fda249-9d28-4cc2-aeb0-103ce4f1faa4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.193s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:50:57 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:50:57 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:50:57 user nova-compute[75216]: WARNING nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] While synchronizing instance power states, found 10 instances in the database and 9 instances on the hypervisor.
Nov 13 18:50:57 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Triggering sync for uuid a1a3e849-6570-4820-97c8-75468b5bea4f {{(pid=75216) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 13 18:50:57 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Triggering sync for uuid d589d57e-de50-482a-843f-e8246b3d7528 {{(pid=75216) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 13 18:50:57 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Triggering sync for uuid 85624c58-6c72-4490-8a3e-547953295ade {{(pid=75216) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 13 18:50:57 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Triggering sync for uuid 9b078f75-57f2-495a-abd5-f8adf72db80b {{(pid=75216) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 13 18:50:57 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Triggering sync for uuid 64dfe522-8b46-4df4-8032-591ce56900ec {{(pid=75216) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 13 18:50:57 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Triggering sync for uuid e1350bc4-558a-40ac-91e5-96da24f154f5 {{(pid=75216) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 13 18:50:57 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Triggering sync for uuid 91ea8a19-a365-484c-80c7-baf90e7dd1aa {{(pid=75216) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 13 18:50:57 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Triggering sync for uuid a3bcf65e-bd5b-4350-a222-5f4522418a67 {{(pid=75216) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 13 18:50:57 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Triggering sync for uuid 7c9d9c1b-6df5-41ff-a696-871e70d04e07 {{(pid=75216) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 13 18:50:57 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Triggering sync for uuid 3679beb0-5244-443a-8512-38b29ccb62f0 {{(pid=75216) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 13 18:50:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "a1a3e849-6570-4820-97c8-75468b5bea4f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:50:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "a1a3e849-6570-4820-97c8-75468b5bea4f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:50:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "d589d57e-de50-482a-843f-e8246b3d7528" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:50:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "d589d57e-de50-482a-843f-e8246b3d7528" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:50:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "85624c58-6c72-4490-8a3e-547953295ade" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:50:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "85624c58-6c72-4490-8a3e-547953295ade" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:50:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "9b078f75-57f2-495a-abd5-f8adf72db80b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:50:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "9b078f75-57f2-495a-abd5-f8adf72db80b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:50:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "64dfe522-8b46-4df4-8032-591ce56900ec" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:50:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "64dfe522-8b46-4df4-8032-591ce56900ec" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:50:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "e1350bc4-558a-40ac-91e5-96da24f154f5" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:50:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "e1350bc4-558a-40ac-91e5-96da24f154f5" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:50:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "91ea8a19-a365-484c-80c7-baf90e7dd1aa" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:50:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "91ea8a19-a365-484c-80c7-baf90e7dd1aa" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:50:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "a3bcf65e-bd5b-4350-a222-5f4522418a67" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:50:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "a3bcf65e-bd5b-4350-a222-5f4522418a67" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:50:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "7c9d9c1b-6df5-41ff-a696-871e70d04e07" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:50:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "7c9d9c1b-6df5-41ff-a696-871e70d04e07" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:50:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "3679beb0-5244-443a-8512-38b29ccb62f0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:50:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "3679beb0-5244-443a-8512-38b29ccb62f0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:50:58 user nova-compute[75216]: INFO nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: 3679beb0-5244-443a-8512-38b29ccb62f0] During sync_power_state the instance has a pending task (rebuild_block_device_mapping). Skip.
Nov 13 18:50:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "3679beb0-5244-443a-8512-38b29ccb62f0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:50:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "85624c58-6c72-4490-8a3e-547953295ade" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.065s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:50:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "d589d57e-de50-482a-843f-e8246b3d7528" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.079s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:50:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "a1a3e849-6570-4820-97c8-75468b5bea4f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.081s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:50:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "91ea8a19-a365-484c-80c7-baf90e7dd1aa" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.094s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:50:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "a3bcf65e-bd5b-4350-a222-5f4522418a67" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.095s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:50:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "9b078f75-57f2-495a-abd5-f8adf72db80b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.100s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:50:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "64dfe522-8b46-4df4-8032-591ce56900ec" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.101s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:50:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "e1350bc4-558a-40ac-91e5-96da24f154f5" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.103s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:50:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "7c9d9c1b-6df5-41ff-a696-871e70d04e07" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.105s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:50:58 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:50:58 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-8a48967c-512e-49d6-84c1-3e2ed4ffcda4 tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] [instance: 3679beb0-5244-443a-8512-38b29ccb62f0] Creating instance directory {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 18:50:58 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-8a48967c-512e-49d6-84c1-3e2ed4ffcda4 tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] [instance: 3679beb0-5244-443a-8512-38b29ccb62f0] Creating image(s)
Nov 13 18:50:58 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-8a48967c-512e-49d6-84c1-3e2ed4ffcda4 tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] [instance: 3679beb0-5244-443a-8512-38b29ccb62f0] Did not create local disks {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 13 18:50:58 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-8a48967c-512e-49d6-84c1-3e2ed4ffcda4 tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] [instance: 3679beb0-5244-443a-8512-38b29ccb62f0] Ensure instance console log exists: /opt/stack/data/nova/instances/3679beb0-5244-443a-8512-38b29ccb62f0/console.log {{(pid=75216) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 18:50:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-8a48967c-512e-49d6-84c1-3e2ed4ffcda4 tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:50:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-8a48967c-512e-49d6-84c1-3e2ed4ffcda4 tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:50:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-8a48967c-512e-49d6-84c1-3e2ed4ffcda4 tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:50:58 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-8a48967c-512e-49d6-84c1-3e2ed4ffcda4 tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] [instance: 3679beb0-5244-443a-8512-38b29ccb62f0] Start _get_guest_xml network_info=[{"id": "9dd60454-c5ac-4afe-b6fc-ad9ba9b83423", "address": "fa:16:3e:f0:11:a2", "network": {"id": "36f9d4ef-d504-457e-be5c-873fd634988f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-998310827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f28b10790a0548b785d2242360d631b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dd60454-c5", "ovs_interfaceid": "9dd60454-c5ac-4afe-b6fc-ad9ba9b83423", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T18:41:06Z,direct_url=<?>,disk_format='qcow2',id=77bcb5ba-8510-41ec-a88d-96097bb431de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c465b7c26ec44582b6d1b7169536ecc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T18:41:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ae66a157-b0d3-4501-a728-a010d6a83a10', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'buEowZlO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3679beb0-5244-443a-8512-38b29ccb62f0', 'attached_at': '', 'detached_at': '', 'volume_id': 'ae66a157-b0d3-4501-a728-a010d6a83a10', 'serial': 'ae66a157-b0d3-4501-a728-a010d6a83a10'}, 'attachment_id': '79931e30-14c9-454b-bf2e-8382dde2696f', 'guest_format': None, 'mount_device': '/dev/vda', 'delete_on_termination': True, 'boot_index': 0, 'volume_type': None} {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 18:50:58 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-8a48967c-512e-49d6-84c1-3e2ed4ffcda4 tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 13 18:50:58 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-8a48967c-512e-49d6-84c1-3e2ed4ffcda4 tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 13 18:50:58 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-8a48967c-512e-49d6-84c1-3e2ed4ffcda4 tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 18:50:58 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-8a48967c-512e-49d6-84c1-3e2ed4ffcda4 tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] CPU controller missing on host. {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 18:50:58 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-8a48967c-512e-49d6-84c1-3e2ed4ffcda4 tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 18:50:58 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-8a48967c-512e-49d6-84c1-3e2ed4ffcda4 tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] CPU controller found on host. {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 18:50:58 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-8a48967c-512e-49d6-84c1-3e2ed4ffcda4 tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75216) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 18:50:58 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-8a48967c-512e-49d6-84c1-3e2ed4ffcda4 tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T18:40:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T18:41:06Z,direct_url=<?>,disk_format='qcow2',id=77bcb5ba-8510-41ec-a88d-96097bb431de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c465b7c26ec44582b6d1b7169536ecc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T18:41:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 18:50:58 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-8a48967c-512e-49d6-84c1-3e2ed4ffcda4 tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] Flavor limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 18:50:58 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-8a48967c-512e-49d6-84c1-3e2ed4ffcda4 tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] Image limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 18:50:58 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-8a48967c-512e-49d6-84c1-3e2ed4ffcda4 tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] Flavor pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 18:50:58 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-8a48967c-512e-49d6-84c1-3e2ed4ffcda4 tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] Image pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 18:50:58 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-8a48967c-512e-49d6-84c1-3e2ed4ffcda4 tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 18:50:58 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-8a48967c-512e-49d6-84c1-3e2ed4ffcda4 tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 18:50:58 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-8a48967c-512e-49d6-84c1-3e2ed4ffcda4 tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 18:50:58 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-8a48967c-512e-49d6-84c1-3e2ed4ffcda4 tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] Got 1 possible topologies {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 18:50:58 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-8a48967c-512e-49d6-84c1-3e2ed4ffcda4 tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 18:50:58 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-8a48967c-512e-49d6-84c1-3e2ed4ffcda4 tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 18:50:58 user nova-compute[75216]: DEBUG nova.objects.instance [None req-8a48967c-512e-49d6-84c1-3e2ed4ffcda4 tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] Lazy-loading 'vcpu_model' on Instance uuid 3679beb0-5244-443a-8512-38b29ccb62f0 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 18:50:58 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a48967c-512e-49d6-84c1-3e2ed4ffcda4 tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] [instance: 3679beb0-5244-443a-8512-38b29ccb62f0] Calling os-brick to attach iSCSI Volume {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 18:50:58 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a48967c-512e-49d6-84c1-3e2ed4ffcda4 tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3a8669e40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ae66a157-b0d3-4501-a728-a010d6a83a10', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'buEowZlO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 18:50:58 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-8a48967c-512e-49d6-84c1-3e2ed4ffcda4 tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 13 18:50:58 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-8a48967c-512e-49d6-84c1-3e2ed4ffcda4 tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 18:50:58 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-8a48967c-512e-49d6-84c1-3e2ed4ffcda4 tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 18:50:58 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-8a48967c-512e-49d6-84c1-3e2ed4ffcda4 tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 13 18:50:58 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-8a48967c-512e-49d6-84c1-3e2ed4ffcda4 tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ae66a157-b0d3-4501-a728-a010d6a83a10" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 18:50:58 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-8a48967c-512e-49d6-84c1-3e2ed4ffcda4 tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ae66a157-b0d3-4501-a728-a010d6a83a10" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 18:50:58 user nova-compute[75216]: INFO os_brick.initiator.connectors.iscsi [None req-8a48967c-512e-49d6-84c1-3e2ed4ffcda4 tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 18:50:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae66a157-b0d3-4501-a728-a010d6a83a10 -p 172.16.0.220:3260 {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:50:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae66a157-b0d3-4501-a728-a010d6a83a10 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:50:58 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1a73c46-2ce6-48fd-8581-6c738bfca39a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:50:58 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a48967c-512e-49d6-84c1-3e2ed4ffcda4 tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 18:50:58 user nova-compute[75216]:  {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:50:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae66a157-b0d3-4501-a728-a010d6a83a10 -p 172.16.0.220:3260 --interface default --op new {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:50:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae66a157-b0d3-4501-a728-a010d6a83a10 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:50:58 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd611329-f719-49f0-b4e4-646356b6d6cf]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ae66a157-b0d3-4501-a728-a010d6a83a10] added\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:50:58 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a48967c-512e-49d6-84c1-3e2ed4ffcda4 tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ae66a157-b0d3-4501-a728-a010d6a83a10] added
Nov 13 18:50:58 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:50:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae66a157-b0d3-4501-a728-a010d6a83a10 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:50:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae66a157-b0d3-4501-a728-a010d6a83a10 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:50:58 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[81f96223-103c-4cf8-9f44-35e86d82ae96]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:50:58 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a48967c-512e-49d6-84c1-3e2ed4ffcda4 tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:50:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae66a157-b0d3-4501-a728-a010d6a83a10 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:50:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae66a157-b0d3-4501-a728-a010d6a83a10 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:50:58 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[06a2d2ac-5a72-418f-9720-055ec68931ce]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:50:58 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a48967c-512e-49d6-84c1-3e2ed4ffcda4 tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:50:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae66a157-b0d3-4501-a728-a010d6a83a10 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v buEowZlO {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:50:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae66a157-b0d3-4501-a728-a010d6a83a10 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v buEowZlO" returned: 0 in 0.029s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:50:58 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[01c39331-7da0-4a93-b64a-112e5bdb1356]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:50:58 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a48967c-512e-49d6-84c1-3e2ed4ffcda4 tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'buEowZlO'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:50:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae66a157-b0d3-4501-a728-a010d6a83a10 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:50:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae66a157-b0d3-4501-a728-a010d6a83a10 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:50:58 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[3098a9b7-354e-47e1-a99c-51bb780f93f3]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:50:58 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a48967c-512e-49d6-84c1-3e2ed4ffcda4 tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:50:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:50:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:50:58 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[94e2ac83-cff7-427f-b7ac-0b04b46d8a3c]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf4e9e60-f40d-49e0-8234-ae45c23b695b (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c711796-fc49-4e18-8fdd-eefe1e3b357c (non-flash)\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:50:58 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a48967c-512e-49d6-84c1-3e2ed4ffcda4 tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf4e9e60-f40d-49e0-8234-ae45c23b695b (non-flash)
Nov 13 18:50:58 user nova-compute[75216]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac (non-flash)
Nov 13 18:50:58 user nova-compute[75216]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c711796-fc49-4e18-8fdd-eefe1e3b357c (non-flash)
Nov 13 18:50:58 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 18:50:58 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a48967c-512e-49d6-84c1-3e2ed4ffcda4 tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf4e9e60-f40d-49e0-8234-ae45c23b695b (non-flash)
Nov 13 18:50:58 user nova-compute[75216]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac (non-flash)
Nov 13 18:50:58 user nova-compute[75216]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c711796-fc49-4e18-8fdd-eefe1e3b357c (non-flash)
Nov 13 18:50:58 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 18:50:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae66a157-b0d3-4501-a728-a010d6a83a10 -p 172.16.0.220:3260 --login {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:50:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae66a157-b0d3-4501-a728-a010d6a83a10 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:50:58 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[6563ad3a-fa6d-478e-8520-f80604dfe4e4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ae66a157-b0d3-4501-a728-a010d6a83a10, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ae66a157-b0d3-4501-a728-a010d6a83a10, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:50:58 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a48967c-512e-49d6-84c1-3e2ed4ffcda4 tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ae66a157-b0d3-4501-a728-a010d6a83a10, portal: 172.16.0.220,3260]
Nov 13 18:50:58 user nova-compute[75216]: Login to [iface: default, target: iqn.2010-10.org.openstack:ae66a157-b0d3-4501-a728-a010d6a83a10, portal: 172.16.0.220,3260] successful.
Nov 13 18:50:58 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:50:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae66a157-b0d3-4501-a728-a010d6a83a10 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:50:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae66a157-b0d3-4501-a728-a010d6a83a10 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:50:58 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[81150658-13dc-48b9-92fc-2537e232df5a]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:50:58 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a48967c-512e-49d6-84c1-3e2ed4ffcda4 tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:50:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:50:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:50:58 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e480c91-28b0-4fdb-9fcf-7ae7fdcf6a17]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf4e9e60-f40d-49e0-8234-ae45c23b695b (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c711796-fc49-4e18-8fdd-eefe1e3b357c (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae66a157-b0d3-4501-a728-a010d6a83a10 (non-flash)\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:50:58 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a48967c-512e-49d6-84c1-3e2ed4ffcda4 tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf4e9e60-f40d-49e0-8234-ae45c23b695b (non-flash)
Nov 13 18:50:58 user nova-compute[75216]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac (non-flash)
Nov 13 18:50:58 user nova-compute[75216]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c711796-fc49-4e18-8fdd-eefe1e3b357c (non-flash)
Nov 13 18:50:58 user nova-compute[75216]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae66a157-b0d3-4501-a728-a010d6a83a10 (non-flash)
Nov 13 18:50:58 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 18:50:58 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a48967c-512e-49d6-84c1-3e2ed4ffcda4 tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf4e9e60-f40d-49e0-8234-ae45c23b695b (non-flash)
Nov 13 18:50:58 user nova-compute[75216]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac (non-flash)
Nov 13 18:50:58 user nova-compute[75216]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c711796-fc49-4e18-8fdd-eefe1e3b357c (non-flash)
Nov 13 18:50:58 user nova-compute[75216]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae66a157-b0d3-4501-a728-a010d6a83a10 (non-flash)
Nov 13 18:50:58 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 18:50:58 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-8a48967c-512e-49d6-84c1-3e2ed4ffcda4 tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ae66a157-b0d3-4501-a728-a010d6a83a10" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.305s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 18:50:58 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a48967c-512e-49d6-84c1-3e2ed4ffcda4 tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] Connected to 172.16.0.220:3260 {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 18:50:58 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-8a48967c-512e-49d6-84c1-3e2ed4ffcda4 tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] HCTL ('34', '-', '-', 0) found on session 25 with lun 0 {{(pid=75216) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 18:50:58 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-8a48967c-512e-49d6-84c1-3e2ed4ffcda4 tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75216) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 18:50:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:50:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:50:58 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ea800ad-b30c-4189-84e1-3c8b80de37b2]: (4, ('- - 0', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:50:58 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-8a48967c-512e-49d6-84c1-3e2ed4ffcda4 tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] Searching for a device in session 25 and hctl ['34', '*', '*', 0] yield: None {{(pid=75216) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 18:50:59 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-8a48967c-512e-49d6-84c1-3e2ed4ffcda4 tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] Searching for a device in session 25 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75216) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 18:50:59 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a48967c-512e-49d6-84c1-3e2ed4ffcda4 tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:ae66a157-b0d3-4501-a728-a010d6a83a10', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'buEowZlO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 18:50:59 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-8a48967c-512e-49d6-84c1-3e2ed4ffcda4 tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.334s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 18:50:59 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a48967c-512e-49d6-84c1-3e2ed4ffcda4 tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] <== connect_volume: return (1336ms) {'type': 'block', 'scsi_wwn': '26462643636356565', 'path': '/dev/sdc'} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 18:50:59 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a48967c-512e-49d6-84c1-3e2ed4ffcda4 tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] [instance: 3679beb0-5244-443a-8512-38b29ccb62f0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26462643636356565', 'path': '/dev/sdc'} {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 18:50:59 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-8a48967c-512e-49d6-84c1-3e2ed4ffcda4 tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-13T18:48:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1810454113',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1139702488',id=16,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMERu/g7S2xD4fYqmzFAJXYDR7hKcSuIXV2v7GsKW6Fvu41/rKIsCoqYwYjeLuX+94gqfUJqutarG8qQbb/uJ1X4T/7CELwQc16iiSCVbNPYMOIZbGoMv5QgSdk5IEn2iA==',key_name='tempest-keypair-810733778',keypairs=<?>,launch_index=0,launched_at=2023-11-13T18:48:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f28b10790a0548b785d2242360d631b1',ramdisk_id='',reservation_id='r-gqrzdq0g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-980167634',owner_user_name='tempest-ServerActionsV293TestJSON-980167634-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T18:50:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b245d24d053e4504baa2670a3fe0b2b1',uuid=3679beb0-5244-443a-8512-38b29ccb62f0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9dd60454-c5ac-4afe-b6fc-ad9ba9b83423", "address": "fa:16:3e:f0:11:a2", "network": {"id": "36f9d4ef-d504-457e-be5c-873fd634988f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-998310827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f28b10790a0548b785d2242360d631b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dd60454-c5", "ovs_interfaceid": "9dd60454-c5ac-4afe-b6fc-ad9ba9b83423", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75216) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 18:50:59 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-8a48967c-512e-49d6-84c1-3e2ed4ffcda4 tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] Converting VIF {"id": "9dd60454-c5ac-4afe-b6fc-ad9ba9b83423", "address": "fa:16:3e:f0:11:a2", "network": {"id": "36f9d4ef-d504-457e-be5c-873fd634988f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-998310827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f28b10790a0548b785d2242360d631b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dd60454-c5", "ovs_interfaceid": "9dd60454-c5ac-4afe-b6fc-ad9ba9b83423", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 18:50:59 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-8a48967c-512e-49d6-84c1-3e2ed4ffcda4 tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f0:11:a2,bridge_name='br-int',has_traffic_filtering=True,id=9dd60454-c5ac-4afe-b6fc-ad9ba9b83423,network=Network(36f9d4ef-d504-457e-be5c-873fd634988f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9dd60454-c5') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 18:50:59 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-8a48967c-512e-49d6-84c1-3e2ed4ffcda4 tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] [instance: 3679beb0-5244-443a-8512-38b29ccb62f0] End _get_guest_xml xml=<domain type="kvm">
Nov 13 18:50:59 user nova-compute[75216]:   <uuid>3679beb0-5244-443a-8512-38b29ccb62f0</uuid>
Nov 13 18:50:59 user nova-compute[75216]:   <name>instance-00000010</name>
Nov 13 18:50:59 user nova-compute[75216]:   <memory>524288</memory>
Nov 13 18:50:59 user nova-compute[75216]:   <vcpu>1</vcpu>
Nov 13 18:50:59 user nova-compute[75216]:   <metadata>
Nov 13 18:50:59 user nova-compute[75216]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 18:50:59 user nova-compute[75216]:       <nova:package version="0.0.0"/>
Nov 13 18:50:59 user nova-compute[75216]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1810454113</nova:name>
Nov 13 18:50:59 user nova-compute[75216]:       <nova:creationTime>2023-11-13 18:50:58</nova:creationTime>
Nov 13 18:50:59 user nova-compute[75216]:       <nova:flavor name="m1.tiny">
Nov 13 18:50:59 user nova-compute[75216]:         <nova:memory>512</nova:memory>
Nov 13 18:50:59 user nova-compute[75216]:         <nova:disk>1</nova:disk>
Nov 13 18:50:59 user nova-compute[75216]:         <nova:swap>0</nova:swap>
Nov 13 18:50:59 user nova-compute[75216]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 18:50:59 user nova-compute[75216]:         <nova:vcpus>1</nova:vcpus>
Nov 13 18:50:59 user nova-compute[75216]:       </nova:flavor>
Nov 13 18:50:59 user nova-compute[75216]:       <nova:owner>
Nov 13 18:50:59 user nova-compute[75216]:         <nova:user uuid="b245d24d053e4504baa2670a3fe0b2b1">tempest-ServerActionsV293TestJSON-980167634-project-member</nova:user>
Nov 13 18:50:59 user nova-compute[75216]:         <nova:project uuid="f28b10790a0548b785d2242360d631b1">tempest-ServerActionsV293TestJSON-980167634</nova:project>
Nov 13 18:50:59 user nova-compute[75216]:       </nova:owner>
Nov 13 18:50:59 user nova-compute[75216]:       <nova:ports>
Nov 13 18:50:59 user nova-compute[75216]:         <nova:port uuid="9dd60454-c5ac-4afe-b6fc-ad9ba9b83423">
Nov 13 18:50:59 user nova-compute[75216]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 13 18:50:59 user nova-compute[75216]:         </nova:port>
Nov 13 18:50:59 user nova-compute[75216]:       </nova:ports>
Nov 13 18:50:59 user nova-compute[75216]:     </nova:instance>
Nov 13 18:50:59 user nova-compute[75216]:   </metadata>
Nov 13 18:50:59 user nova-compute[75216]:   <sysinfo type="smbios">
Nov 13 18:50:59 user nova-compute[75216]:     <system>
Nov 13 18:50:59 user nova-compute[75216]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 18:50:59 user nova-compute[75216]:       <entry name="product">OpenStack Nova</entry>
Nov 13 18:50:59 user nova-compute[75216]:       <entry name="version">0.0.0</entry>
Nov 13 18:50:59 user nova-compute[75216]:       <entry name="serial">3679beb0-5244-443a-8512-38b29ccb62f0</entry>
Nov 13 18:50:59 user nova-compute[75216]:       <entry name="uuid">3679beb0-5244-443a-8512-38b29ccb62f0</entry>
Nov 13 18:50:59 user nova-compute[75216]:       <entry name="family">Virtual Machine</entry>
Nov 13 18:50:59 user nova-compute[75216]:     </system>
Nov 13 18:50:59 user nova-compute[75216]:   </sysinfo>
Nov 13 18:50:59 user nova-compute[75216]:   <os>
Nov 13 18:50:59 user nova-compute[75216]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 18:50:59 user nova-compute[75216]:     <boot dev="hd"/>
Nov 13 18:50:59 user nova-compute[75216]:     <smbios mode="sysinfo"/>
Nov 13 18:50:59 user nova-compute[75216]:   </os>
Nov 13 18:50:59 user nova-compute[75216]:   <features>
Nov 13 18:50:59 user nova-compute[75216]:     <acpi/>
Nov 13 18:50:59 user nova-compute[75216]:     <apic/>
Nov 13 18:50:59 user nova-compute[75216]:     <vmcoreinfo/>
Nov 13 18:50:59 user nova-compute[75216]:   </features>
Nov 13 18:50:59 user nova-compute[75216]:   <clock offset="utc">
Nov 13 18:50:59 user nova-compute[75216]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 18:50:59 user nova-compute[75216]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 18:50:59 user nova-compute[75216]:     <timer name="hpet" present="no"/>
Nov 13 18:50:59 user nova-compute[75216]:   </clock>
Nov 13 18:50:59 user nova-compute[75216]:   <cpu mode="custom" match="exact">
Nov 13 18:50:59 user nova-compute[75216]:     <model>Nehalem</model>
Nov 13 18:50:59 user nova-compute[75216]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 18:50:59 user nova-compute[75216]:   </cpu>
Nov 13 18:50:59 user nova-compute[75216]:   <devices>
Nov 13 18:50:59 user nova-compute[75216]:     <disk type="block" device="disk">
Nov 13 18:50:59 user nova-compute[75216]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 18:50:59 user nova-compute[75216]:       <source dev="/dev/sdc"/>
Nov 13 18:50:59 user nova-compute[75216]:       <target dev="vda" bus="virtio"/>
Nov 13 18:50:59 user nova-compute[75216]:       <serial>ae66a157-b0d3-4501-a728-a010d6a83a10</serial>
Nov 13 18:50:59 user nova-compute[75216]:     </disk>
Nov 13 18:50:59 user nova-compute[75216]:     <interface type="ethernet">
Nov 13 18:50:59 user nova-compute[75216]:       <mac address="fa:16:3e:f0:11:a2"/>
Nov 13 18:50:59 user nova-compute[75216]:       <model type="virtio"/>
Nov 13 18:50:59 user nova-compute[75216]:       <mtu size="1442"/>
Nov 13 18:50:59 user nova-compute[75216]:       <target dev="tap9dd60454-c5"/>
Nov 13 18:50:59 user nova-compute[75216]:     </interface>
Nov 13 18:50:59 user nova-compute[75216]:     <serial type="pty">
Nov 13 18:50:59 user nova-compute[75216]:       <log file="/opt/stack/data/nova/instances/3679beb0-5244-443a-8512-38b29ccb62f0/console.log" append="off"/>
Nov 13 18:50:59 user nova-compute[75216]:     </serial>
Nov 13 18:50:59 user nova-compute[75216]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 18:50:59 user nova-compute[75216]:     <video>
Nov 13 18:50:59 user nova-compute[75216]:       <model type="virtio"/>
Nov 13 18:50:59 user nova-compute[75216]:     </video>
Nov 13 18:50:59 user nova-compute[75216]:     <rng model="virtio">
Nov 13 18:50:59 user nova-compute[75216]:       <backend model="random">/dev/urandom</backend>
Nov 13 18:50:59 user nova-compute[75216]:     </rng>
Nov 13 18:50:59 user nova-compute[75216]:     <controller type="usb" index="0" model="none"/>
Nov 13 18:50:59 user nova-compute[75216]:     <memballoon model="virtio">
Nov 13 18:50:59 user nova-compute[75216]:       <stats period="10"/>
Nov 13 18:50:59 user nova-compute[75216]:     </memballoon>
Nov 13 18:50:59 user nova-compute[75216]:   </devices>
Nov 13 18:50:59 user nova-compute[75216]: </domain>
Nov 13 18:50:59 user nova-compute[75216]:  {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 18:50:59 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-8a48967c-512e-49d6-84c1-3e2ed4ffcda4 tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-13T18:48:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1810454113',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1139702488',id=16,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMERu/g7S2xD4fYqmzFAJXYDR7hKcSuIXV2v7GsKW6Fvu41/rKIsCoqYwYjeLuX+94gqfUJqutarG8qQbb/uJ1X4T/7CELwQc16iiSCVbNPYMOIZbGoMv5QgSdk5IEn2iA==',key_name='tempest-keypair-810733778',keypairs=<?>,launch_index=0,launched_at=2023-11-13T18:48:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f28b10790a0548b785d2242360d631b1',ramdisk_id='',reservation_id='r-gqrzdq0g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-980167634',owner_user_name='tempest-ServerActionsV293TestJSON-980167634-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T18:50:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b245d24d053e4504baa2670a3fe0b2b1',uuid=3679beb0-5244-443a-8512-38b29ccb62f0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9dd60454-c5ac-4afe-b6fc-ad9ba9b83423", "address": "fa:16:3e:f0:11:a2", "network": {"id": "36f9d4ef-d504-457e-be5c-873fd634988f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-998310827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f28b10790a0548b785d2242360d631b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dd60454-c5", "ovs_interfaceid": "9dd60454-c5ac-4afe-b6fc-ad9ba9b83423", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 18:50:59 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-8a48967c-512e-49d6-84c1-3e2ed4ffcda4 tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] Converting VIF {"id": "9dd60454-c5ac-4afe-b6fc-ad9ba9b83423", "address": "fa:16:3e:f0:11:a2", "network": {"id": "36f9d4ef-d504-457e-be5c-873fd634988f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-998310827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f28b10790a0548b785d2242360d631b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dd60454-c5", "ovs_interfaceid": "9dd60454-c5ac-4afe-b6fc-ad9ba9b83423", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 18:50:59 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-8a48967c-512e-49d6-84c1-3e2ed4ffcda4 tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f0:11:a2,bridge_name='br-int',has_traffic_filtering=True,id=9dd60454-c5ac-4afe-b6fc-ad9ba9b83423,network=Network(36f9d4ef-d504-457e-be5c-873fd634988f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9dd60454-c5') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 18:50:59 user nova-compute[75216]: DEBUG os_vif [None req-8a48967c-512e-49d6-84c1-3e2ed4ffcda4 tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f0:11:a2,bridge_name='br-int',has_traffic_filtering=True,id=9dd60454-c5ac-4afe-b6fc-ad9ba9b83423,network=Network(36f9d4ef-d504-457e-be5c-873fd634988f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9dd60454-c5') {{(pid=75216) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 18:50:59 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:50:59 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:50:59 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 18:50:59 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:50:59 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd2866df7-68fe-54dd-93bd-1b19a0eb227a', '_type': 'linux-noop'}}, row=False) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:50:59 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:50:59 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:50:59 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:50:59 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9dd60454-c5, may_exist=True, interface_attrs={}) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:50:59 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9dd60454-c5, col_values=(('qos', UUID('da21da7d-5b88-4392-857c-8c554d1adf9b')),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:50:59 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9dd60454-c5, col_values=(('external_ids', {'iface-id': '9dd60454-c5ac-4afe-b6fc-ad9ba9b83423', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f0:11:a2', 'vm-uuid': '3679beb0-5244-443a-8512-38b29ccb62f0'}),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:50:59 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:50:59 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:50:59 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:50:59 user nova-compute[75216]: INFO os_vif [None req-8a48967c-512e-49d6-84c1-3e2ed4ffcda4 tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f0:11:a2,bridge_name='br-int',has_traffic_filtering=True,id=9dd60454-c5ac-4afe-b6fc-ad9ba9b83423,network=Network(36f9d4ef-d504-457e-be5c-873fd634988f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9dd60454-c5')
Nov 13 18:50:59 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-8a48967c-512e-49d6-84c1-3e2ed4ffcda4 tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 18:50:59 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-8a48967c-512e-49d6-84c1-3e2ed4ffcda4 tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] No VIF found with MAC fa:16:3e:f0:11:a2, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 18:51:01 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:51:01 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:51:01 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:51:01 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:51:01 user nova-compute[75216]: DEBUG nova.compute.manager [req-f0b041da-9e3f-46f4-82d4-c75174568f96 req-a940efa4-d342-4323-941d-8a8195b628b3 service nova] [instance: 3679beb0-5244-443a-8512-38b29ccb62f0] Received event network-vif-plugged-9dd60454-c5ac-4afe-b6fc-ad9ba9b83423 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:51:01 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-f0b041da-9e3f-46f4-82d4-c75174568f96 req-a940efa4-d342-4323-941d-8a8195b628b3 service nova] Acquiring lock "3679beb0-5244-443a-8512-38b29ccb62f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:51:01 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-f0b041da-9e3f-46f4-82d4-c75174568f96 req-a940efa4-d342-4323-941d-8a8195b628b3 service nova] Lock "3679beb0-5244-443a-8512-38b29ccb62f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:51:01 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-f0b041da-9e3f-46f4-82d4-c75174568f96 req-a940efa4-d342-4323-941d-8a8195b628b3 service nova] Lock "3679beb0-5244-443a-8512-38b29ccb62f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:51:01 user nova-compute[75216]: DEBUG nova.compute.manager [req-f0b041da-9e3f-46f4-82d4-c75174568f96 req-a940efa4-d342-4323-941d-8a8195b628b3 service nova] [instance: 3679beb0-5244-443a-8512-38b29ccb62f0] No waiting events found dispatching network-vif-plugged-9dd60454-c5ac-4afe-b6fc-ad9ba9b83423 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:51:01 user nova-compute[75216]: WARNING nova.compute.manager [req-f0b041da-9e3f-46f4-82d4-c75174568f96 req-a940efa4-d342-4323-941d-8a8195b628b3 service nova] [instance: 3679beb0-5244-443a-8512-38b29ccb62f0] Received unexpected event network-vif-plugged-9dd60454-c5ac-4afe-b6fc-ad9ba9b83423 for instance with vm_state active and task_state rebuild_spawning.
Nov 13 18:51:01 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:51:01 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:51:03 user nova-compute[75216]: DEBUG nova.compute.manager [None req-8a48967c-512e-49d6-84c1-3e2ed4ffcda4 tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] [instance: 3679beb0-5244-443a-8512-38b29ccb62f0] Instance event wait completed in 0 seconds for  {{(pid=75216) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 18:51:03 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-8a48967c-512e-49d6-84c1-3e2ed4ffcda4 tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] [instance: 3679beb0-5244-443a-8512-38b29ccb62f0] Guest created on hypervisor {{(pid=75216) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 18:51:03 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 3679beb0-5244-443a-8512-38b29ccb62f0] Instance spawned successfully.
Nov 13 18:51:03 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-8a48967c-512e-49d6-84c1-3e2ed4ffcda4 tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] [instance: 3679beb0-5244-443a-8512-38b29ccb62f0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 18:51:03 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-8a48967c-512e-49d6-84c1-3e2ed4ffcda4 tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] [instance: 3679beb0-5244-443a-8512-38b29ccb62f0] Found default for hw_cdrom_bus of ide {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 18:51:03 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-8a48967c-512e-49d6-84c1-3e2ed4ffcda4 tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] [instance: 3679beb0-5244-443a-8512-38b29ccb62f0] Found default for hw_disk_bus of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 18:51:03 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-8a48967c-512e-49d6-84c1-3e2ed4ffcda4 tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] [instance: 3679beb0-5244-443a-8512-38b29ccb62f0] Found default for hw_input_bus of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 18:51:03 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-8a48967c-512e-49d6-84c1-3e2ed4ffcda4 tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] [instance: 3679beb0-5244-443a-8512-38b29ccb62f0] Found default for hw_pointer_model of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 18:51:03 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-8a48967c-512e-49d6-84c1-3e2ed4ffcda4 tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] [instance: 3679beb0-5244-443a-8512-38b29ccb62f0] Found default for hw_video_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 18:51:03 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-8a48967c-512e-49d6-84c1-3e2ed4ffcda4 tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] [instance: 3679beb0-5244-443a-8512-38b29ccb62f0] Found default for hw_vif_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 18:51:03 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:51:03 user nova-compute[75216]: DEBUG nova.compute.manager [None req-8a48967c-512e-49d6-84c1-3e2ed4ffcda4 tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] [instance: 3679beb0-5244-443a-8512-38b29ccb62f0] Checking state {{(pid=75216) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 18:51:03 user nova-compute[75216]: DEBUG nova.compute.manager [req-cc42fb2b-5045-4090-bb81-31bd18f0b9a9 req-8216a3e8-bc9a-4770-8b65-0e90758190ee service nova] [instance: 3679beb0-5244-443a-8512-38b29ccb62f0] Received event network-vif-plugged-9dd60454-c5ac-4afe-b6fc-ad9ba9b83423 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:51:03 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-cc42fb2b-5045-4090-bb81-31bd18f0b9a9 req-8216a3e8-bc9a-4770-8b65-0e90758190ee service nova] Acquiring lock "3679beb0-5244-443a-8512-38b29ccb62f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:51:03 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-cc42fb2b-5045-4090-bb81-31bd18f0b9a9 req-8216a3e8-bc9a-4770-8b65-0e90758190ee service nova] Lock "3679beb0-5244-443a-8512-38b29ccb62f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:51:03 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-cc42fb2b-5045-4090-bb81-31bd18f0b9a9 req-8216a3e8-bc9a-4770-8b65-0e90758190ee service nova] Lock "3679beb0-5244-443a-8512-38b29ccb62f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:51:03 user nova-compute[75216]: DEBUG nova.compute.manager [req-cc42fb2b-5045-4090-bb81-31bd18f0b9a9 req-8216a3e8-bc9a-4770-8b65-0e90758190ee service nova] [instance: 3679beb0-5244-443a-8512-38b29ccb62f0] No waiting events found dispatching network-vif-plugged-9dd60454-c5ac-4afe-b6fc-ad9ba9b83423 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:51:03 user nova-compute[75216]: WARNING nova.compute.manager [req-cc42fb2b-5045-4090-bb81-31bd18f0b9a9 req-8216a3e8-bc9a-4770-8b65-0e90758190ee service nova] [instance: 3679beb0-5244-443a-8512-38b29ccb62f0] Received unexpected event network-vif-plugged-9dd60454-c5ac-4afe-b6fc-ad9ba9b83423 for instance with vm_state active and task_state rebuild_spawning.
Nov 13 18:51:03 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-8a48967c-512e-49d6-84c1-3e2ed4ffcda4 tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:51:03 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-8a48967c-512e-49d6-84c1-3e2ed4ffcda4 tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:51:03 user nova-compute[75216]: DEBUG nova.objects.instance [None req-8a48967c-512e-49d6-84c1-3e2ed4ffcda4 tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] [instance: 3679beb0-5244-443a-8512-38b29ccb62f0] Trying to apply a migration context that does not seem to be set for this instance {{(pid=75216) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 13 18:51:03 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-8a48967c-512e-49d6-84c1-3e2ed4ffcda4 tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.129s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:51:04 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:51:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:51:09 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:51:11 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1ccba794-742e-4dc8-a548-1bbf4d844b6b tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] Acquiring lock "9b078f75-57f2-495a-abd5-f8adf72db80b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:51:11 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1ccba794-742e-4dc8-a548-1bbf4d844b6b tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] Lock "9b078f75-57f2-495a-abd5-f8adf72db80b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:51:11 user nova-compute[75216]: INFO nova.compute.manager [None req-1ccba794-742e-4dc8-a548-1bbf4d844b6b tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] [instance: 9b078f75-57f2-495a-abd5-f8adf72db80b] Detaching volume bf4e9e60-f40d-49e0-8234-ae45c23b695b
Nov 13 18:51:11 user nova-compute[75216]: INFO nova.virt.block_device [None req-1ccba794-742e-4dc8-a548-1bbf4d844b6b tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] [instance: 9b078f75-57f2-495a-abd5-f8adf72db80b] Attempting to driver detach volume bf4e9e60-f40d-49e0-8234-ae45c23b695b from mountpoint /dev/vdb
Nov 13 18:51:11 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-1ccba794-742e-4dc8-a548-1bbf4d844b6b tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] Attempting to detach device vdb from instance 9b078f75-57f2-495a-abd5-f8adf72db80b from the persistent domain config. {{(pid=75216) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 13 18:51:11 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-1ccba794-742e-4dc8-a548-1bbf4d844b6b tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 18:51:11 user nova-compute[75216]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 18:51:11 user nova-compute[75216]:   <source dev="/dev/sdb"/>
Nov 13 18:51:11 user nova-compute[75216]:   <target dev="vdb" bus="virtio"/>
Nov 13 18:51:11 user nova-compute[75216]:   <serial>bf4e9e60-f40d-49e0-8234-ae45c23b695b</serial>
Nov 13 18:51:11 user nova-compute[75216]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 18:51:11 user nova-compute[75216]: </disk>
Nov 13 18:51:11 user nova-compute[75216]:  {{(pid=75216) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 18:51:11 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-1ccba794-742e-4dc8-a548-1bbf4d844b6b tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] Successfully detached device vdb from instance 9b078f75-57f2-495a-abd5-f8adf72db80b from the persistent domain config.
Nov 13 18:51:11 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-1ccba794-742e-4dc8-a548-1bbf4d844b6b tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9b078f75-57f2-495a-abd5-f8adf72db80b from the live domain config. {{(pid=75216) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 13 18:51:11 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-1ccba794-742e-4dc8-a548-1bbf4d844b6b tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 18:51:11 user nova-compute[75216]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 18:51:11 user nova-compute[75216]:   <source dev="/dev/sdb"/>
Nov 13 18:51:11 user nova-compute[75216]:   <target dev="vdb" bus="virtio"/>
Nov 13 18:51:11 user nova-compute[75216]:   <serial>bf4e9e60-f40d-49e0-8234-ae45c23b695b</serial>
Nov 13 18:51:11 user nova-compute[75216]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 18:51:11 user nova-compute[75216]: </disk>
Nov 13 18:51:11 user nova-compute[75216]:  {{(pid=75216) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 18:51:11 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-1ccba794-742e-4dc8-a548-1bbf4d844b6b tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9b078f75-57f2-495a-abd5-f8adf72db80b {{(pid=75216) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 13 18:51:13 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:51:14 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:51:18 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:51:19 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:51:21 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-da0d0d32-f85f-4638-8bb7-14e6634bba11 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] Acquiring lock "64dfe522-8b46-4df4-8032-591ce56900ec" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:51:21 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-da0d0d32-f85f-4638-8bb7-14e6634bba11 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] Lock "64dfe522-8b46-4df4-8032-591ce56900ec" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:51:21 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-da0d0d32-f85f-4638-8bb7-14e6634bba11 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] Acquiring lock "64dfe522-8b46-4df4-8032-591ce56900ec-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:51:21 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-da0d0d32-f85f-4638-8bb7-14e6634bba11 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] Lock "64dfe522-8b46-4df4-8032-591ce56900ec-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:51:21 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-da0d0d32-f85f-4638-8bb7-14e6634bba11 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] Lock "64dfe522-8b46-4df4-8032-591ce56900ec-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:51:21 user nova-compute[75216]: INFO nova.compute.manager [None req-da0d0d32-f85f-4638-8bb7-14e6634bba11 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] [instance: 64dfe522-8b46-4df4-8032-591ce56900ec] Terminating instance
Nov 13 18:51:21 user nova-compute[75216]: DEBUG nova.compute.manager [None req-da0d0d32-f85f-4638-8bb7-14e6634bba11 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] [instance: 64dfe522-8b46-4df4-8032-591ce56900ec] Start destroying the instance on the hypervisor. {{(pid=75216) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 18:51:21 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:51:21 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:51:21 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:51:21 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:51:21 user nova-compute[75216]: DEBUG nova.compute.manager [req-739b61fe-85ba-43d1-88da-f34492f54664 req-1c21dc82-a6d4-4d33-92ae-62159d7e789c service nova] [instance: 64dfe522-8b46-4df4-8032-591ce56900ec] Received event network-vif-unplugged-2d12f254-7874-4622-a7cb-8180de961bd1 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:51:21 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-739b61fe-85ba-43d1-88da-f34492f54664 req-1c21dc82-a6d4-4d33-92ae-62159d7e789c service nova] Acquiring lock "64dfe522-8b46-4df4-8032-591ce56900ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:51:21 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-739b61fe-85ba-43d1-88da-f34492f54664 req-1c21dc82-a6d4-4d33-92ae-62159d7e789c service nova] Lock "64dfe522-8b46-4df4-8032-591ce56900ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:51:21 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-739b61fe-85ba-43d1-88da-f34492f54664 req-1c21dc82-a6d4-4d33-92ae-62159d7e789c service nova] Lock "64dfe522-8b46-4df4-8032-591ce56900ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:51:21 user nova-compute[75216]: DEBUG nova.compute.manager [req-739b61fe-85ba-43d1-88da-f34492f54664 req-1c21dc82-a6d4-4d33-92ae-62159d7e789c service nova] [instance: 64dfe522-8b46-4df4-8032-591ce56900ec] No waiting events found dispatching network-vif-unplugged-2d12f254-7874-4622-a7cb-8180de961bd1 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:51:21 user nova-compute[75216]: DEBUG nova.compute.manager [req-739b61fe-85ba-43d1-88da-f34492f54664 req-1c21dc82-a6d4-4d33-92ae-62159d7e789c service nova] [instance: 64dfe522-8b46-4df4-8032-591ce56900ec] Received event network-vif-unplugged-2d12f254-7874-4622-a7cb-8180de961bd1 for instance with task_state deleting. {{(pid=75216) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 18:51:21 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:51:22 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:51:22 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 64dfe522-8b46-4df4-8032-591ce56900ec] Instance destroyed successfully.
Nov 13 18:51:22 user nova-compute[75216]: DEBUG nova.objects.instance [None req-da0d0d32-f85f-4638-8bb7-14e6634bba11 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] Lazy-loading 'resources' on Instance uuid 64dfe522-8b46-4df4-8032-591ce56900ec {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 18:51:22 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-da0d0d32-f85f-4638-8bb7-14e6634bba11 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T18:48:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-904595823',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-904595823',id=13,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAnoGBZDueYOh3xcWER1AMv30DIYxQxeWRDS2fRFXh6l4DZc8pD4qIgg0IjDLbUZuBfE7+vn5QgzB7ChiJAa+d1ltHilcpx/dg8eDxHVfO8o++kjL7IH7NIL3RYQDYV6Ew==',key_name='tempest-keypair-1295383460',keypairs=<?>,launch_index=0,launched_at=2023-11-13T18:48:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0ec18dd2e6ea476dbf3745d14a866190',ramdisk_id='',reservation_id='r-0a499j0h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-507898025',owner_user_name='tempest-TaggedAttachmentsTest-507898025-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T18:48:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='454caf80dd76487baead7c52f05df1a5',uuid=64dfe522-8b46-4df4-8032-591ce56900ec,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2d12f254-7874-4622-a7cb-8180de961bd1", "address": "fa:16:3e:a1:6b:92", "network": {"id": "0b64448d-5ece-4814-9bdc-de0167e921f9", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-67835474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ec18dd2e6ea476dbf3745d14a866190", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d12f254-78", "ovs_interfaceid": "2d12f254-7874-4622-a7cb-8180de961bd1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 18:51:22 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-da0d0d32-f85f-4638-8bb7-14e6634bba11 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] Converting VIF {"id": "2d12f254-7874-4622-a7cb-8180de961bd1", "address": "fa:16:3e:a1:6b:92", "network": {"id": "0b64448d-5ece-4814-9bdc-de0167e921f9", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-67835474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ec18dd2e6ea476dbf3745d14a866190", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d12f254-78", "ovs_interfaceid": "2d12f254-7874-4622-a7cb-8180de961bd1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 18:51:22 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-da0d0d32-f85f-4638-8bb7-14e6634bba11 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a1:6b:92,bridge_name='br-int',has_traffic_filtering=True,id=2d12f254-7874-4622-a7cb-8180de961bd1,network=Network(0b64448d-5ece-4814-9bdc-de0167e921f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d12f254-78') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 18:51:22 user nova-compute[75216]: DEBUG os_vif [None req-da0d0d32-f85f-4638-8bb7-14e6634bba11 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a1:6b:92,bridge_name='br-int',has_traffic_filtering=True,id=2d12f254-7874-4622-a7cb-8180de961bd1,network=Network(0b64448d-5ece-4814-9bdc-de0167e921f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d12f254-78') {{(pid=75216) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 18:51:22 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:51:22 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2d12f254-78, bridge=br-int, if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:51:22 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:51:22 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:51:22 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:51:22 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6199eed4-5e88-44f5-9a47-ef8a95e33420) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:51:22 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:51:22 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:51:22 user nova-compute[75216]: INFO os_vif [None req-da0d0d32-f85f-4638-8bb7-14e6634bba11 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a1:6b:92,bridge_name='br-int',has_traffic_filtering=True,id=2d12f254-7874-4622-a7cb-8180de961bd1,network=Network(0b64448d-5ece-4814-9bdc-de0167e921f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d12f254-78')
Nov 13 18:51:22 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-da0d0d32-f85f-4638-8bb7-14e6634bba11 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] [instance: 64dfe522-8b46-4df4-8032-591ce56900ec] Deleting instance files /opt/stack/data/nova/instances/64dfe522-8b46-4df4-8032-591ce56900ec_del
Nov 13 18:51:22 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-da0d0d32-f85f-4638-8bb7-14e6634bba11 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] [instance: 64dfe522-8b46-4df4-8032-591ce56900ec] Deletion of /opt/stack/data/nova/instances/64dfe522-8b46-4df4-8032-591ce56900ec_del complete
Nov 13 18:51:22 user nova-compute[75216]: INFO nova.compute.manager [None req-da0d0d32-f85f-4638-8bb7-14e6634bba11 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] [instance: 64dfe522-8b46-4df4-8032-591ce56900ec] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 13 18:51:22 user nova-compute[75216]: DEBUG oslo.service.loopingcall [None req-da0d0d32-f85f-4638-8bb7-14e6634bba11 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75216) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 18:51:22 user nova-compute[75216]: DEBUG nova.compute.manager [-] [instance: 64dfe522-8b46-4df4-8032-591ce56900ec] Deallocating network for instance {{(pid=75216) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 18:51:22 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: 64dfe522-8b46-4df4-8032-591ce56900ec] deallocate_for_instance() {{(pid=75216) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 18:51:22 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: 64dfe522-8b46-4df4-8032-591ce56900ec] Updating instance_info_cache with network_info: [] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 18:51:22 user nova-compute[75216]: INFO nova.compute.manager [-] [instance: 64dfe522-8b46-4df4-8032-591ce56900ec] Took 0.72 seconds to deallocate network for instance.
Nov 13 18:51:22 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-da0d0d32-f85f-4638-8bb7-14e6634bba11 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:51:22 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-da0d0d32-f85f-4638-8bb7-14e6634bba11 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:51:23 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-da0d0d32-f85f-4638-8bb7-14e6634bba11 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 18:51:23 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-da0d0d32-f85f-4638-8bb7-14e6634bba11 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 18:51:23 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-da0d0d32-f85f-4638-8bb7-14e6634bba11 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.312s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:51:23 user nova-compute[75216]: INFO nova.scheduler.client.report [None req-da0d0d32-f85f-4638-8bb7-14e6634bba11 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] Deleted allocations for instance 64dfe522-8b46-4df4-8032-591ce56900ec
Nov 13 18:51:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:51:23 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-da0d0d32-f85f-4638-8bb7-14e6634bba11 tempest-TaggedAttachmentsTest-507898025 tempest-TaggedAttachmentsTest-507898025-project-member] Lock "64dfe522-8b46-4df4-8032-591ce56900ec" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.108s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:51:23 user nova-compute[75216]: DEBUG nova.compute.manager [req-40eddd11-40a8-48ce-b3f6-55bcee0fe0b2 req-e70c9c87-cd66-43a6-a873-b143580f3d93 service nova] [instance: 64dfe522-8b46-4df4-8032-591ce56900ec] Received event network-vif-plugged-2d12f254-7874-4622-a7cb-8180de961bd1 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:51:23 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-40eddd11-40a8-48ce-b3f6-55bcee0fe0b2 req-e70c9c87-cd66-43a6-a873-b143580f3d93 service nova] Acquiring lock "64dfe522-8b46-4df4-8032-591ce56900ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:51:23 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-40eddd11-40a8-48ce-b3f6-55bcee0fe0b2 req-e70c9c87-cd66-43a6-a873-b143580f3d93 service nova] Lock "64dfe522-8b46-4df4-8032-591ce56900ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:51:23 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-40eddd11-40a8-48ce-b3f6-55bcee0fe0b2 req-e70c9c87-cd66-43a6-a873-b143580f3d93 service nova] Lock "64dfe522-8b46-4df4-8032-591ce56900ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:51:23 user nova-compute[75216]: DEBUG nova.compute.manager [req-40eddd11-40a8-48ce-b3f6-55bcee0fe0b2 req-e70c9c87-cd66-43a6-a873-b143580f3d93 service nova] [instance: 64dfe522-8b46-4df4-8032-591ce56900ec] No waiting events found dispatching network-vif-plugged-2d12f254-7874-4622-a7cb-8180de961bd1 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:51:23 user nova-compute[75216]: WARNING nova.compute.manager [req-40eddd11-40a8-48ce-b3f6-55bcee0fe0b2 req-e70c9c87-cd66-43a6-a873-b143580f3d93 service nova] [instance: 64dfe522-8b46-4df4-8032-591ce56900ec] Received unexpected event network-vif-plugged-2d12f254-7874-4622-a7cb-8180de961bd1 for instance with vm_state deleted and task_state None.
Nov 13 18:51:23 user nova-compute[75216]: DEBUG nova.compute.manager [req-40eddd11-40a8-48ce-b3f6-55bcee0fe0b2 req-e70c9c87-cd66-43a6-a873-b143580f3d93 service nova] [instance: 64dfe522-8b46-4df4-8032-591ce56900ec] Received event network-vif-deleted-2d12f254-7874-4622-a7cb-8180de961bd1 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:51:25 user nova-compute[75216]: INFO nova.compute.manager [None req-a0983eb5-5081-4607-a3fe-e60a9ec398a3 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] [instance: d589d57e-de50-482a-843f-e8246b3d7528] Unrescuing
Nov 13 18:51:25 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a0983eb5-5081-4607-a3fe-e60a9ec398a3 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Acquiring lock "refresh_cache-d589d57e-de50-482a-843f-e8246b3d7528" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 18:51:25 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a0983eb5-5081-4607-a3fe-e60a9ec398a3 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Acquired lock "refresh_cache-d589d57e-de50-482a-843f-e8246b3d7528" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 18:51:25 user nova-compute[75216]: DEBUG nova.network.neutron [None req-a0983eb5-5081-4607-a3fe-e60a9ec398a3 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] [instance: d589d57e-de50-482a-843f-e8246b3d7528] Building network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 18:51:26 user nova-compute[75216]: DEBUG nova.network.neutron [None req-a0983eb5-5081-4607-a3fe-e60a9ec398a3 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] [instance: d589d57e-de50-482a-843f-e8246b3d7528] Updating instance_info_cache with network_info: [{"id": "87426a6f-0164-4df3-aad0-becbbbfe8310", "address": "fa:16:3e:64:4d:81", "network": {"id": "6d182db1-03b5-4d1b-86cf-b9367921b7b0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1877006951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2efafc26c47c4050bd367c47469999fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87426a6f-01", "ovs_interfaceid": "87426a6f-0164-4df3-aad0-becbbbfe8310", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 18:51:26 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a0983eb5-5081-4607-a3fe-e60a9ec398a3 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Releasing lock "refresh_cache-d589d57e-de50-482a-843f-e8246b3d7528" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 18:51:26 user nova-compute[75216]: DEBUG nova.objects.instance [None req-a0983eb5-5081-4607-a3fe-e60a9ec398a3 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Lazy-loading 'flavor' on Instance uuid d589d57e-de50-482a-843f-e8246b3d7528 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 18:51:26 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:51:26 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:51:26 user nova-compute[75216]: DEBUG nova.compute.manager [req-52b00da3-52d8-4949-862e-17e9d88e961e req-b05b2a46-396b-4b41-9391-d77b41a39194 service nova] [instance: d589d57e-de50-482a-843f-e8246b3d7528] Received event network-vif-unplugged-87426a6f-0164-4df3-aad0-becbbbfe8310 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:51:26 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-52b00da3-52d8-4949-862e-17e9d88e961e req-b05b2a46-396b-4b41-9391-d77b41a39194 service nova] Acquiring lock "d589d57e-de50-482a-843f-e8246b3d7528-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:51:26 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-52b00da3-52d8-4949-862e-17e9d88e961e req-b05b2a46-396b-4b41-9391-d77b41a39194 service nova] Lock "d589d57e-de50-482a-843f-e8246b3d7528-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:51:26 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-52b00da3-52d8-4949-862e-17e9d88e961e req-b05b2a46-396b-4b41-9391-d77b41a39194 service nova] Lock "d589d57e-de50-482a-843f-e8246b3d7528-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:51:26 user nova-compute[75216]: DEBUG nova.compute.manager [req-52b00da3-52d8-4949-862e-17e9d88e961e req-b05b2a46-396b-4b41-9391-d77b41a39194 service nova] [instance: d589d57e-de50-482a-843f-e8246b3d7528] No waiting events found dispatching network-vif-unplugged-87426a6f-0164-4df3-aad0-becbbbfe8310 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:51:26 user nova-compute[75216]: WARNING nova.compute.manager [req-52b00da3-52d8-4949-862e-17e9d88e961e req-b05b2a46-396b-4b41-9391-d77b41a39194 service nova] [instance: d589d57e-de50-482a-843f-e8246b3d7528] Received unexpected event network-vif-unplugged-87426a6f-0164-4df3-aad0-becbbbfe8310 for instance with vm_state rescued and task_state unrescuing.
Nov 13 18:51:26 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:51:26 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:51:26 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: d589d57e-de50-482a-843f-e8246b3d7528] Instance destroyed successfully.
Nov 13 18:51:27 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:51:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:51:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:51:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:51:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:51:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:51:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:51:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:51:28 user nova-compute[75216]: DEBUG nova.compute.manager [req-2e637699-b19b-47c9-b9f8-74f1043009c5 req-3c6cfdbd-995b-48ad-a1a4-dcb737f8d563 service nova] [instance: d589d57e-de50-482a-843f-e8246b3d7528] Received event network-vif-plugged-87426a6f-0164-4df3-aad0-becbbbfe8310 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:51:28 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-2e637699-b19b-47c9-b9f8-74f1043009c5 req-3c6cfdbd-995b-48ad-a1a4-dcb737f8d563 service nova] Acquiring lock "d589d57e-de50-482a-843f-e8246b3d7528-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:51:28 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-2e637699-b19b-47c9-b9f8-74f1043009c5 req-3c6cfdbd-995b-48ad-a1a4-dcb737f8d563 service nova] Lock "d589d57e-de50-482a-843f-e8246b3d7528-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:51:28 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-2e637699-b19b-47c9-b9f8-74f1043009c5 req-3c6cfdbd-995b-48ad-a1a4-dcb737f8d563 service nova] Lock "d589d57e-de50-482a-843f-e8246b3d7528-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:51:28 user nova-compute[75216]: DEBUG nova.compute.manager [req-2e637699-b19b-47c9-b9f8-74f1043009c5 req-3c6cfdbd-995b-48ad-a1a4-dcb737f8d563 service nova] [instance: d589d57e-de50-482a-843f-e8246b3d7528] No waiting events found dispatching network-vif-plugged-87426a6f-0164-4df3-aad0-becbbbfe8310 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:51:28 user nova-compute[75216]: WARNING nova.compute.manager [req-2e637699-b19b-47c9-b9f8-74f1043009c5 req-3c6cfdbd-995b-48ad-a1a4-dcb737f8d563 service nova] [instance: d589d57e-de50-482a-843f-e8246b3d7528] Received unexpected event network-vif-plugged-87426a6f-0164-4df3-aad0-becbbbfe8310 for instance with vm_state rescued and task_state unrescuing.
Nov 13 18:51:28 user nova-compute[75216]: DEBUG nova.compute.manager [req-2e637699-b19b-47c9-b9f8-74f1043009c5 req-3c6cfdbd-995b-48ad-a1a4-dcb737f8d563 service nova] [instance: d589d57e-de50-482a-843f-e8246b3d7528] Received event network-vif-plugged-87426a6f-0164-4df3-aad0-becbbbfe8310 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:51:28 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-2e637699-b19b-47c9-b9f8-74f1043009c5 req-3c6cfdbd-995b-48ad-a1a4-dcb737f8d563 service nova] Acquiring lock "d589d57e-de50-482a-843f-e8246b3d7528-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:51:28 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-2e637699-b19b-47c9-b9f8-74f1043009c5 req-3c6cfdbd-995b-48ad-a1a4-dcb737f8d563 service nova] Lock "d589d57e-de50-482a-843f-e8246b3d7528-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:51:28 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-2e637699-b19b-47c9-b9f8-74f1043009c5 req-3c6cfdbd-995b-48ad-a1a4-dcb737f8d563 service nova] Lock "d589d57e-de50-482a-843f-e8246b3d7528-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:51:28 user nova-compute[75216]: DEBUG nova.compute.manager [req-2e637699-b19b-47c9-b9f8-74f1043009c5 req-3c6cfdbd-995b-48ad-a1a4-dcb737f8d563 service nova] [instance: d589d57e-de50-482a-843f-e8246b3d7528] No waiting events found dispatching network-vif-plugged-87426a6f-0164-4df3-aad0-becbbbfe8310 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:51:28 user nova-compute[75216]: WARNING nova.compute.manager [req-2e637699-b19b-47c9-b9f8-74f1043009c5 req-3c6cfdbd-995b-48ad-a1a4-dcb737f8d563 service nova] [instance: d589d57e-de50-482a-843f-e8246b3d7528] Received unexpected event network-vif-plugged-87426a6f-0164-4df3-aad0-becbbbfe8310 for instance with vm_state rescued and task_state unrescuing.
Nov 13 18:51:30 user nova-compute[75216]: DEBUG nova.compute.manager [None req-a0983eb5-5081-4607-a3fe-e60a9ec398a3 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] [instance: d589d57e-de50-482a-843f-e8246b3d7528] Checking state {{(pid=75216) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 18:51:30 user nova-compute[75216]: DEBUG nova.compute.manager [req-eca724f0-7dfc-42e5-9973-f20f5a300d1b req-27fbdf8d-2bb6-4508-a01c-a7c176cd0984 service nova] [instance: d589d57e-de50-482a-843f-e8246b3d7528] Received event network-vif-plugged-87426a6f-0164-4df3-aad0-becbbbfe8310 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:51:30 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-eca724f0-7dfc-42e5-9973-f20f5a300d1b req-27fbdf8d-2bb6-4508-a01c-a7c176cd0984 service nova] Acquiring lock "d589d57e-de50-482a-843f-e8246b3d7528-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:51:30 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-eca724f0-7dfc-42e5-9973-f20f5a300d1b req-27fbdf8d-2bb6-4508-a01c-a7c176cd0984 service nova] Lock "d589d57e-de50-482a-843f-e8246b3d7528-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:51:30 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-eca724f0-7dfc-42e5-9973-f20f5a300d1b req-27fbdf8d-2bb6-4508-a01c-a7c176cd0984 service nova] Lock "d589d57e-de50-482a-843f-e8246b3d7528-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:51:30 user nova-compute[75216]: DEBUG nova.compute.manager [req-eca724f0-7dfc-42e5-9973-f20f5a300d1b req-27fbdf8d-2bb6-4508-a01c-a7c176cd0984 service nova] [instance: d589d57e-de50-482a-843f-e8246b3d7528] No waiting events found dispatching network-vif-plugged-87426a6f-0164-4df3-aad0-becbbbfe8310 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:51:30 user nova-compute[75216]: WARNING nova.compute.manager [req-eca724f0-7dfc-42e5-9973-f20f5a300d1b req-27fbdf8d-2bb6-4508-a01c-a7c176cd0984 service nova] [instance: d589d57e-de50-482a-843f-e8246b3d7528] Received unexpected event network-vif-plugged-87426a6f-0164-4df3-aad0-becbbbfe8310 for instance with vm_state active and task_state None.
Nov 13 18:51:30 user nova-compute[75216]: DEBUG nova.compute.manager [req-eca724f0-7dfc-42e5-9973-f20f5a300d1b req-27fbdf8d-2bb6-4508-a01c-a7c176cd0984 service nova] [instance: e1350bc4-558a-40ac-91e5-96da24f154f5] Received event network-changed-87a8f08d-9d26-49e7-9111-8758d3bbcf2f {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:51:30 user nova-compute[75216]: DEBUG nova.compute.manager [req-eca724f0-7dfc-42e5-9973-f20f5a300d1b req-27fbdf8d-2bb6-4508-a01c-a7c176cd0984 service nova] [instance: e1350bc4-558a-40ac-91e5-96da24f154f5] Refreshing instance network info cache due to event network-changed-87a8f08d-9d26-49e7-9111-8758d3bbcf2f. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 18:51:30 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-eca724f0-7dfc-42e5-9973-f20f5a300d1b req-27fbdf8d-2bb6-4508-a01c-a7c176cd0984 service nova] Acquiring lock "refresh_cache-e1350bc4-558a-40ac-91e5-96da24f154f5" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 18:51:30 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-eca724f0-7dfc-42e5-9973-f20f5a300d1b req-27fbdf8d-2bb6-4508-a01c-a7c176cd0984 service nova] Acquired lock "refresh_cache-e1350bc4-558a-40ac-91e5-96da24f154f5" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 18:51:30 user nova-compute[75216]: DEBUG nova.network.neutron [req-eca724f0-7dfc-42e5-9973-f20f5a300d1b req-27fbdf8d-2bb6-4508-a01c-a7c176cd0984 service nova] [instance: e1350bc4-558a-40ac-91e5-96da24f154f5] Refreshing network info cache for port 87a8f08d-9d26-49e7-9111-8758d3bbcf2f {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 18:51:31 user nova-compute[75216]: DEBUG nova.network.neutron [req-eca724f0-7dfc-42e5-9973-f20f5a300d1b req-27fbdf8d-2bb6-4508-a01c-a7c176cd0984 service nova] [instance: e1350bc4-558a-40ac-91e5-96da24f154f5] Updated VIF entry in instance network info cache for port 87a8f08d-9d26-49e7-9111-8758d3bbcf2f. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 18:51:31 user nova-compute[75216]: DEBUG nova.network.neutron [req-eca724f0-7dfc-42e5-9973-f20f5a300d1b req-27fbdf8d-2bb6-4508-a01c-a7c176cd0984 service nova] [instance: e1350bc4-558a-40ac-91e5-96da24f154f5] Updating instance_info_cache with network_info: [{"id": "87a8f08d-9d26-49e7-9111-8758d3bbcf2f", "address": "fa:16:3e:96:a6:55", "network": {"id": "78d34574-c9cb-4054-9b54-15ab42a41a6d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-2015553211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3303a3ffcb5d4d1495f45a7c3cc9076a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87a8f08d-9d", "ovs_interfaceid": "87a8f08d-9d26-49e7-9111-8758d3bbcf2f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 18:51:31 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-eca724f0-7dfc-42e5-9973-f20f5a300d1b req-27fbdf8d-2bb6-4508-a01c-a7c176cd0984 service nova] Releasing lock "refresh_cache-e1350bc4-558a-40ac-91e5-96da24f154f5" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 18:51:31 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f23cbf62-820d-4291-a579-a6af660dd544 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] Acquiring lock "e1350bc4-558a-40ac-91e5-96da24f154f5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:51:31 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f23cbf62-820d-4291-a579-a6af660dd544 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] Lock "e1350bc4-558a-40ac-91e5-96da24f154f5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:51:31 user nova-compute[75216]: DEBUG nova.objects.instance [None req-f23cbf62-820d-4291-a579-a6af660dd544 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] Lazy-loading 'flavor' on Instance uuid e1350bc4-558a-40ac-91e5-96da24f154f5 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 18:51:31 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f23cbf62-820d-4291-a579-a6af660dd544 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] Lock "e1350bc4-558a-40ac-91e5-96da24f154f5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:51:31 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f23cbf62-820d-4291-a579-a6af660dd544 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] Acquiring lock "e1350bc4-558a-40ac-91e5-96da24f154f5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:51:31 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f23cbf62-820d-4291-a579-a6af660dd544 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] Lock "e1350bc4-558a-40ac-91e5-96da24f154f5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:51:31 user nova-compute[75216]: INFO nova.compute.manager [None req-f23cbf62-820d-4291-a579-a6af660dd544 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] [instance: e1350bc4-558a-40ac-91e5-96da24f154f5] Attaching volume 4b15037c-4bb7-47be-9097-c49c67552d83 to /dev/sdc
Nov 13 18:51:31 user nova-compute[75216]: DEBUG os_brick.utils [None req-f23cbf62-820d-4291-a579-a6af660dd544 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 18:51:31 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:51:31 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:51:31 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[a64e274b-7372-4319-b7dc-aab23fbee0b7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aea6fcfe14b9\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:51:31 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:51:31 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:51:31 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[eac21d5b-5970-4be9-8e8f-b40912ab34ab]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:51:31 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:51:31 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:51:31 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[079f120c-c80c-4385-ad89-12b1eedac6a1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:51:31 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aa86907-bc20-4119-b786-700b69252a2e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:51:31 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-f23cbf62-820d-4291-a579-a6af660dd544 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] Running cmd (subprocess): nvme version {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:51:31 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-f23cbf62-820d-4291-a579-a6af660dd544 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] 'nvme version' failed. Not Retrying. {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 18:51:31 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-1ccba794-742e-4dc8-a548-1bbf4d844b6b tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 9b078f75-57f2-495a-abd5-f8adf72db80b is timed out.
Nov 13 18:51:31 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f23cbf62-820d-4291-a579-a6af660dd544 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] nvme not present on system {{(pid=75216) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 18:51:31 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-1ccba794-742e-4dc8-a548-1bbf4d844b6b tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] Successfully detached device vdb from instance 9b078f75-57f2-495a-abd5-f8adf72db80b from the live domain config.
Nov 13 18:51:31 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:51:31 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1ccba794-742e-4dc8-a548-1bbf4d844b6b tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] [instance: 9b078f75-57f2-495a-abd5-f8adf72db80b] calling os-brick to detach iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 18:51:31 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ccba794-742e-4dc8-a548-1bbf4d844b6b tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3a8669e40>, {'target_iqn': 'iqn.2010-10.org.openstack:bf4e9e60-f40d-49e0-8234-ae45c23b695b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vWqlSnQN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 18:51:31 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-1ccba794-742e-4dc8-a548-1bbf4d844b6b tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 18:51:31 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-1ccba794-742e-4dc8-a548-1bbf4d844b6b tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 18:51:31 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-1ccba794-742e-4dc8-a548-1bbf4d844b6b tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 18:51:31 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:51:31 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 18:51:31 user nova-compute[75216]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 18:51:31 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1fdd00a-a5d9-4555-89ca-ec2e957cbd6e]: (4, '') {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:51:31 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-f23cbf62-820d-4291-a579-a6af660dd544 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75216) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 18:51:31 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-f23cbf62-820d-4291-a579-a6af660dd544 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 18:51:31 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-f23cbf62-820d-4291-a579-a6af660dd544 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] LIGHTOS: no hostnqn found. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 18:51:31 user nova-compute[75216]: DEBUG os_brick.utils [None req-f23cbf62-820d-4291-a579-a6af660dd544 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aea6fcfe14b9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 18:51:31 user nova-compute[75216]: DEBUG nova.virt.block_device [None req-f23cbf62-820d-4291-a579-a6af660dd544 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] [instance: e1350bc4-558a-40ac-91e5-96da24f154f5] Updating existing volume attachment record: dd263673-3079-4a85-b564-a3e4aeef8612 {{(pid=75216) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 18:51:31 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:51:31 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffdeb07e-690b-4ed6-bd47-daaadac61cc5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bf4e9e60-f40d-49e0-8234-ae45c23b695b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6c711796-fc49-4e18-8fdd-eefe1e3b357c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ae66a157-b0d3-4501-a728-a010d6a83a10\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:51:31 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ccba794-742e-4dc8-a548-1bbf4d844b6b tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 18:51:31 user nova-compute[75216]: No targets found.
Nov 13 18:51:31 user nova-compute[75216]: iSNS:
Nov 13 18:51:31 user nova-compute[75216]: No targets found.
Nov 13 18:51:31 user nova-compute[75216]: STATIC:
Nov 13 18:51:31 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:bf4e9e60-f40d-49e0-8234-ae45c23b695b
Nov 13 18:51:31 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 18:51:31 user nova-compute[75216]:                 Iface Name: default
Nov 13 18:51:31 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:6c711796-fc49-4e18-8fdd-eefe1e3b357c
Nov 13 18:51:31 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 18:51:31 user nova-compute[75216]:                 Iface Name: default
Nov 13 18:51:31 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac
Nov 13 18:51:31 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 18:51:31 user nova-compute[75216]:                 Iface Name: default
Nov 13 18:51:31 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:ae66a157-b0d3-4501-a728-a010d6a83a10
Nov 13 18:51:31 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 18:51:31 user nova-compute[75216]:                 Iface Name: default
Nov 13 18:51:31 user nova-compute[75216]: FIRMWARE:
Nov 13 18:51:31 user nova-compute[75216]: No targets found.
Nov 13 18:51:31 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 18:51:31 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ccba794-742e-4dc8-a548-1bbf4d844b6b tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 18:51:31 user nova-compute[75216]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 18:51:31 user nova-compute[75216]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75216) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 18:51:31 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ccba794-742e-4dc8-a548-1bbf4d844b6b tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bf4e9e60-f40d-49e0-8234-ae45c23b695b', 0)] {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 18:51:31 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:51:31 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:51:31 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[6722346b-1d76-413f-b208-2ca32082a817]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6c711796-fc49-4e18-8fdd-eefe1e3b357c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ae66a157-b0d3-4501-a728-a010d6a83a10\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf4e9e60-f40d-49e0-8234-ae45c23b695b\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:51:31 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:51:31 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:51:31 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca7a214e-fb36-4be8-b99d-db559eee3d81]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf4e9e60-f40d-49e0-8234-ae45c23b695b (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c711796-fc49-4e18-8fdd-eefe1e3b357c (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae66a157-b0d3-4501-a728-a010d6a83a10 (non-flash)\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:51:31 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ccba794-742e-4dc8-a548-1bbf4d844b6b tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf4e9e60-f40d-49e0-8234-ae45c23b695b (non-flash)
Nov 13 18:51:31 user nova-compute[75216]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac (non-flash)
Nov 13 18:51:31 user nova-compute[75216]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c711796-fc49-4e18-8fdd-eefe1e3b357c (non-flash)
Nov 13 18:51:31 user nova-compute[75216]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae66a157-b0d3-4501-a728-a010d6a83a10 (non-flash)
Nov 13 18:51:31 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 18:51:31 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ccba794-742e-4dc8-a548-1bbf4d844b6b tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf4e9e60-f40d-49e0-8234-ae45c23b695b (non-flash)
Nov 13 18:51:31 user nova-compute[75216]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac (non-flash)
Nov 13 18:51:31 user nova-compute[75216]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c711796-fc49-4e18-8fdd-eefe1e3b357c (non-flash)
Nov 13 18:51:31 user nova-compute[75216]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae66a157-b0d3-4501-a728-a010d6a83a10 (non-flash)
Nov 13 18:51:31 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 18:51:31 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ccba794-742e-4dc8-a548-1bbf4d844b6b tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe3a857ae60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bf4e9e60-f40d-49e0-8234-ae45c23b695b'): ({'sdb'}, set())}) {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 18:51:31 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-1ccba794-742e-4dc8-a548-1bbf4d844b6b tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] Removing single pathed devices sdb {{(pid=75216) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 18:51:31 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:51:31 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:51:31 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[e37e793e-e5c8-47ef-b4b2-b495d145493e]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:51:31 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:51:31 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:51:31 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab2d58ad-c008-4c5b-89af-3291660ce1e1]: (4, ('ok\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:51:31 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-1ccba794-742e-4dc8-a548-1bbf4d844b6b tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] Flushing IO for device /dev/sdb {{(pid=75216) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 18:51:31 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:51:31 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:51:31 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2d5a87d-b47d-45a8-b4dc-33548d07c1b5]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:51:31 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-1ccba794-742e-4dc8-a548-1bbf4d844b6b tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75216) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 18:51:31 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:51:31 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:51:31 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[eceab812-cf27-450f-889a-975e0f9848d6]: (4, ('1', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:51:31 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-1ccba794-742e-4dc8-a548-1bbf4d844b6b tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 18:51:31 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-1ccba794-742e-4dc8-a548-1bbf4d844b6b tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] SCSI volumes sdb have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 18:51:31 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ccba794-742e-4dc8-a548-1bbf4d844b6b tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bf4e9e60-f40d-49e0-8234-ae45c23b695b')] {{(pid=75216) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 18:51:31 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf4e9e60-f40d-49e0-8234-ae45c23b695b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:51:31 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf4e9e60-f40d-49e0-8234-ae45c23b695b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:51:31 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[17cfa605-f944-47ea-9595-ed65b4679139]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:51:31 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ccba794-742e-4dc8-a548-1bbf4d844b6b tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:51:31 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf4e9e60-f40d-49e0-8234-ae45c23b695b -p 172.16.0.220:3260 --logout {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:51:31 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf4e9e60-f40d-49e0-8234-ae45c23b695b -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:51:31 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[64833ae0-e04d-4703-b9d0-00d17070c05e]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:bf4e9e60-f40d-49e0-8234-ae45c23b695b, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:bf4e9e60-f40d-49e0-8234-ae45c23b695b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:51:31 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ccba794-742e-4dc8-a548-1bbf4d844b6b tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:bf4e9e60-f40d-49e0-8234-ae45c23b695b, portal: 172.16.0.220,3260]
Nov 13 18:51:31 user nova-compute[75216]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:bf4e9e60-f40d-49e0-8234-ae45c23b695b, portal: 172.16.0.220,3260] successful.
Nov 13 18:51:31 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:51:31 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf4e9e60-f40d-49e0-8234-ae45c23b695b -p 172.16.0.220:3260 --op delete {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:51:31 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf4e9e60-f40d-49e0-8234-ae45c23b695b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:51:31 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[16530142-25cc-4e94-b5d6-1297f6998551]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:51:31 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ccba794-742e-4dc8-a548-1bbf4d844b6b tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:51:31 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-1ccba794-742e-4dc8-a548-1bbf4d844b6b tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.319s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 18:51:31 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ccba794-742e-4dc8-a548-1bbf4d844b6b tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] <== disconnect_volume: return (322ms) None {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 18:51:31 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1ccba794-742e-4dc8-a548-1bbf4d844b6b tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] [instance: 9b078f75-57f2-495a-abd5-f8adf72db80b] Disconnected iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 18:51:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:51:32 user nova-compute[75216]: DEBUG nova.objects.instance [None req-1ccba794-742e-4dc8-a548-1bbf4d844b6b tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] Lazy-loading 'flavor' on Instance uuid 9b078f75-57f2-495a-abd5-f8adf72db80b {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 18:51:32 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1ccba794-742e-4dc8-a548-1bbf4d844b6b tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] Lock "9b078f75-57f2-495a-abd5-f8adf72db80b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.874s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:51:33 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:51:35 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f23cbf62-820d-4291-a579-a6af660dd544 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] [instance: e1350bc4-558a-40ac-91e5-96da24f154f5] Calling os-brick to attach iSCSI Volume {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 18:51:35 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f23cbf62-820d-4291-a579-a6af660dd544 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3a8669e40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4b15037c-4bb7-47be-9097-c49c67552d83', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nJQsKMSZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 18:51:35 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-f23cbf62-820d-4291-a579-a6af660dd544 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 18:51:35 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-f23cbf62-820d-4291-a579-a6af660dd544 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 18:51:35 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-f23cbf62-820d-4291-a579-a6af660dd544 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 18:51:35 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-f23cbf62-820d-4291-a579-a6af660dd544 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 18:51:35 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-f23cbf62-820d-4291-a579-a6af660dd544 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4b15037c-4bb7-47be-9097-c49c67552d83" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 18:51:35 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-f23cbf62-820d-4291-a579-a6af660dd544 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4b15037c-4bb7-47be-9097-c49c67552d83" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 18:51:35 user nova-compute[75216]: INFO os_brick.initiator.connectors.iscsi [None req-f23cbf62-820d-4291-a579-a6af660dd544 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 18:51:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b15037c-4bb7-47be-9097-c49c67552d83 -p 172.16.0.220:3260 {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:51:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b15037c-4bb7-47be-9097-c49c67552d83 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:51:35 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6e9931b-d9ef-4d6f-b070-2582c146c905]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:51:35 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f23cbf62-820d-4291-a579-a6af660dd544 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 18:51:35 user nova-compute[75216]:  {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:51:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b15037c-4bb7-47be-9097-c49c67552d83 -p 172.16.0.220:3260 --interface default --op new {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:51:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b15037c-4bb7-47be-9097-c49c67552d83 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:51:35 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[be3a54d9-b843-425e-b1cb-62a5aeb63dfc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4b15037c-4bb7-47be-9097-c49c67552d83] added\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:51:35 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f23cbf62-820d-4291-a579-a6af660dd544 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4b15037c-4bb7-47be-9097-c49c67552d83] added
Nov 13 18:51:35 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:51:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b15037c-4bb7-47be-9097-c49c67552d83 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:51:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b15037c-4bb7-47be-9097-c49c67552d83 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:51:35 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[5020625b-79a8-4fe1-8c08-343fdddbaa92]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:51:35 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f23cbf62-820d-4291-a579-a6af660dd544 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:51:36 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b15037c-4bb7-47be-9097-c49c67552d83 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:51:36 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b15037c-4bb7-47be-9097-c49c67552d83 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:51:36 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[812ea155-9bd3-4017-bebe-6f8061f6b669]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:51:36 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f23cbf62-820d-4291-a579-a6af660dd544 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:51:36 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b15037c-4bb7-47be-9097-c49c67552d83 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nJQsKMSZ {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:51:36 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b15037c-4bb7-47be-9097-c49c67552d83 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nJQsKMSZ" returned: 0 in 0.020s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:51:36 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[d38a0b36-758a-497a-9ea8-18f64614230b]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:51:36 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f23cbf62-820d-4291-a579-a6af660dd544 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nJQsKMSZ'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:51:36 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b15037c-4bb7-47be-9097-c49c67552d83 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:51:36 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b15037c-4bb7-47be-9097-c49c67552d83 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:51:36 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[92f2ec18-7af5-46a9-868d-7d89b3912574]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:51:36 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f23cbf62-820d-4291-a579-a6af660dd544 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:51:36 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:51:36 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:51:36 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bc370b7-3448-41f2-8ccb-8416d094820b]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c711796-fc49-4e18-8fdd-eefe1e3b357c (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae66a157-b0d3-4501-a728-a010d6a83a10 (non-flash)\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:51:36 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f23cbf62-820d-4291-a579-a6af660dd544 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac (non-flash)
Nov 13 18:51:36 user nova-compute[75216]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c711796-fc49-4e18-8fdd-eefe1e3b357c (non-flash)
Nov 13 18:51:36 user nova-compute[75216]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae66a157-b0d3-4501-a728-a010d6a83a10 (non-flash)
Nov 13 18:51:36 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 18:51:36 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f23cbf62-820d-4291-a579-a6af660dd544 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac (non-flash)
Nov 13 18:51:36 user nova-compute[75216]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c711796-fc49-4e18-8fdd-eefe1e3b357c (non-flash)
Nov 13 18:51:36 user nova-compute[75216]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae66a157-b0d3-4501-a728-a010d6a83a10 (non-flash)
Nov 13 18:51:36 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 18:51:36 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b15037c-4bb7-47be-9097-c49c67552d83 -p 172.16.0.220:3260 --login {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:51:36 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b15037c-4bb7-47be-9097-c49c67552d83 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:51:36 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[a492dd6e-ce1c-487e-9794-cfcc34dfe9d8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4b15037c-4bb7-47be-9097-c49c67552d83, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4b15037c-4bb7-47be-9097-c49c67552d83, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:51:36 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f23cbf62-820d-4291-a579-a6af660dd544 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4b15037c-4bb7-47be-9097-c49c67552d83, portal: 172.16.0.220,3260]
Nov 13 18:51:36 user nova-compute[75216]: Login to [iface: default, target: iqn.2010-10.org.openstack:4b15037c-4bb7-47be-9097-c49c67552d83, portal: 172.16.0.220,3260] successful.
Nov 13 18:51:36 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:51:36 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b15037c-4bb7-47be-9097-c49c67552d83 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:51:36 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b15037c-4bb7-47be-9097-c49c67552d83 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:51:36 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[25180fff-88dc-4649-80e2-6ab5b4351c1c]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:51:36 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f23cbf62-820d-4291-a579-a6af660dd544 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:51:36 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:51:36 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:51:36 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[5553f665-0cbb-4df8-bd27-e85974891a62]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c711796-fc49-4e18-8fdd-eefe1e3b357c (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae66a157-b0d3-4501-a728-a010d6a83a10 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b15037c-4bb7-47be-9097-c49c67552d83 (non-flash)\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:51:36 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f23cbf62-820d-4291-a579-a6af660dd544 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac (non-flash)
Nov 13 18:51:36 user nova-compute[75216]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c711796-fc49-4e18-8fdd-eefe1e3b357c (non-flash)
Nov 13 18:51:36 user nova-compute[75216]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae66a157-b0d3-4501-a728-a010d6a83a10 (non-flash)
Nov 13 18:51:36 user nova-compute[75216]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b15037c-4bb7-47be-9097-c49c67552d83 (non-flash)
Nov 13 18:51:36 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 18:51:36 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f23cbf62-820d-4291-a579-a6af660dd544 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac (non-flash)
Nov 13 18:51:36 user nova-compute[75216]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c711796-fc49-4e18-8fdd-eefe1e3b357c (non-flash)
Nov 13 18:51:36 user nova-compute[75216]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae66a157-b0d3-4501-a728-a010d6a83a10 (non-flash)
Nov 13 18:51:36 user nova-compute[75216]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b15037c-4bb7-47be-9097-c49c67552d83 (non-flash)
Nov 13 18:51:36 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 18:51:36 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-f23cbf62-820d-4291-a579-a6af660dd544 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4b15037c-4bb7-47be-9097-c49c67552d83" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.288s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 18:51:36 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f23cbf62-820d-4291-a579-a6af660dd544 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] Connected to 172.16.0.220:3260 {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 18:51:36 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-f23cbf62-820d-4291-a579-a6af660dd544 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] HCTL ('33', '-', '-', 0) found on session 26 with lun 0 {{(pid=75216) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 18:51:36 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-f23cbf62-820d-4291-a579-a6af660dd544 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75216) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 18:51:36 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:51:36 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:51:36 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[e99c996b-9f07-41b6-a367-a4d4e2e7765c]: (4, ('- - 0', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:51:36 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-f23cbf62-820d-4291-a579-a6af660dd544 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] Searching for a device in session 26 and hctl ['33', '*', '*', 0] yield: None {{(pid=75216) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 18:51:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:51:37 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-f23cbf62-820d-4291-a579-a6af660dd544 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] Searching for a device in session 26 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75216) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 18:51:37 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f23cbf62-820d-4291-a579-a6af660dd544 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:4b15037c-4bb7-47be-9097-c49c67552d83', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nJQsKMSZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 18:51:37 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-f23cbf62-820d-4291-a579-a6af660dd544 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.316s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 18:51:37 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f23cbf62-820d-4291-a579-a6af660dd544 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] <== connect_volume: return (1317ms) {'type': 'block', 'scsi_wwn': '26461653861393237', 'path': '/dev/sdb'} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 18:51:37 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f23cbf62-820d-4291-a579-a6af660dd544 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] [instance: e1350bc4-558a-40ac-91e5-96da24f154f5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26461653861393237', 'path': '/dev/sdb'} {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 18:51:37 user nova-compute[75216]: DEBUG nova.objects.instance [None req-f23cbf62-820d-4291-a579-a6af660dd544 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] Lazy-loading 'flavor' on Instance uuid e1350bc4-558a-40ac-91e5-96da24f154f5 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 18:51:37 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-f23cbf62-820d-4291-a579-a6af660dd544 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] attach device xml: <disk type="block" device="disk">
Nov 13 18:51:37 user nova-compute[75216]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 18:51:37 user nova-compute[75216]:   <source dev="/dev/sdb"/>
Nov 13 18:51:37 user nova-compute[75216]:   <target dev="sdc" bus="scsi"/>
Nov 13 18:51:37 user nova-compute[75216]:   <serial>4b15037c-4bb7-47be-9097-c49c67552d83</serial>
Nov 13 18:51:37 user nova-compute[75216]:   <address type="drive" controller="0" unit="2"/>
Nov 13 18:51:37 user nova-compute[75216]: </disk>
Nov 13 18:51:37 user nova-compute[75216]:  {{(pid=75216) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 13 18:51:37 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-f23cbf62-820d-4291-a579-a6af660dd544 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] No BDM found with device name sda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 18:51:37 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-f23cbf62-820d-4291-a579-a6af660dd544 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] No BDM found with device name sdb, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 18:51:37 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-f23cbf62-820d-4291-a579-a6af660dd544 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] No BDM found with device name sdc, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 18:51:37 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-f23cbf62-820d-4291-a579-a6af660dd544 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] No VIF found with MAC fa:16:3e:96:a6:55, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 18:51:37 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f23cbf62-820d-4291-a579-a6af660dd544 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] Lock "e1350bc4-558a-40ac-91e5-96da24f154f5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.398s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:51:38 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:51:38 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e942be0d-2b85-4273-aebe-49ec552f740f tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] Acquiring lock "e1350bc4-558a-40ac-91e5-96da24f154f5" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:51:38 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e942be0d-2b85-4273-aebe-49ec552f740f tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] Lock "e1350bc4-558a-40ac-91e5-96da24f154f5" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:51:38 user nova-compute[75216]: INFO nova.compute.manager [None req-e942be0d-2b85-4273-aebe-49ec552f740f tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] [instance: e1350bc4-558a-40ac-91e5-96da24f154f5] Detaching volume 4b15037c-4bb7-47be-9097-c49c67552d83
Nov 13 18:51:38 user nova-compute[75216]: INFO nova.virt.block_device [None req-e942be0d-2b85-4273-aebe-49ec552f740f tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] [instance: e1350bc4-558a-40ac-91e5-96da24f154f5] Attempting to driver detach volume 4b15037c-4bb7-47be-9097-c49c67552d83 from mountpoint /dev/sdc
Nov 13 18:51:38 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-e942be0d-2b85-4273-aebe-49ec552f740f tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] Attempting to detach device sdc from instance e1350bc4-558a-40ac-91e5-96da24f154f5 from the persistent domain config. {{(pid=75216) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 13 18:51:38 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-e942be0d-2b85-4273-aebe-49ec552f740f tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 18:51:38 user nova-compute[75216]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 18:51:38 user nova-compute[75216]:   <source dev="/dev/sdb"/>
Nov 13 18:51:38 user nova-compute[75216]:   <target dev="sdc" bus="scsi"/>
Nov 13 18:51:38 user nova-compute[75216]:   <serial>4b15037c-4bb7-47be-9097-c49c67552d83</serial>
Nov 13 18:51:38 user nova-compute[75216]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 13 18:51:38 user nova-compute[75216]: </disk>
Nov 13 18:51:38 user nova-compute[75216]:  {{(pid=75216) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 18:51:38 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-e942be0d-2b85-4273-aebe-49ec552f740f tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] Successfully detached device sdc from instance e1350bc4-558a-40ac-91e5-96da24f154f5 from the persistent domain config.
Nov 13 18:51:38 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-e942be0d-2b85-4273-aebe-49ec552f740f tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance e1350bc4-558a-40ac-91e5-96da24f154f5 from the live domain config. {{(pid=75216) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 13 18:51:38 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-e942be0d-2b85-4273-aebe-49ec552f740f tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 18:51:38 user nova-compute[75216]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 18:51:38 user nova-compute[75216]:   <source dev="/dev/sdb"/>
Nov 13 18:51:38 user nova-compute[75216]:   <target dev="sdc" bus="scsi"/>
Nov 13 18:51:38 user nova-compute[75216]:   <serial>4b15037c-4bb7-47be-9097-c49c67552d83</serial>
Nov 13 18:51:38 user nova-compute[75216]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 13 18:51:38 user nova-compute[75216]: </disk>
Nov 13 18:51:38 user nova-compute[75216]:  {{(pid=75216) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 18:51:38 user nova-compute[75216]: DEBUG nova.compute.manager [req-2810308e-7ea2-4d01-9545-5c38a7b2bb72 req-5e15c512-226a-4568-88a2-2549382e78d2 service nova] [instance: 91ea8a19-a365-484c-80c7-baf90e7dd1aa] Received event network-changed-2cfb645f-7bee-4657-b0d8-afcaa0298ac9 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:51:38 user nova-compute[75216]: DEBUG nova.compute.manager [req-2810308e-7ea2-4d01-9545-5c38a7b2bb72 req-5e15c512-226a-4568-88a2-2549382e78d2 service nova] [instance: 91ea8a19-a365-484c-80c7-baf90e7dd1aa] Refreshing instance network info cache due to event network-changed-2cfb645f-7bee-4657-b0d8-afcaa0298ac9. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 18:51:38 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-2810308e-7ea2-4d01-9545-5c38a7b2bb72 req-5e15c512-226a-4568-88a2-2549382e78d2 service nova] Acquiring lock "refresh_cache-91ea8a19-a365-484c-80c7-baf90e7dd1aa" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 18:51:38 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-2810308e-7ea2-4d01-9545-5c38a7b2bb72 req-5e15c512-226a-4568-88a2-2549382e78d2 service nova] Acquired lock "refresh_cache-91ea8a19-a365-484c-80c7-baf90e7dd1aa" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 18:51:38 user nova-compute[75216]: DEBUG nova.network.neutron [req-2810308e-7ea2-4d01-9545-5c38a7b2bb72 req-5e15c512-226a-4568-88a2-2549382e78d2 service nova] [instance: 91ea8a19-a365-484c-80c7-baf90e7dd1aa] Refreshing network info cache for port 2cfb645f-7bee-4657-b0d8-afcaa0298ac9 {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 18:51:38 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-e942be0d-2b85-4273-aebe-49ec552f740f tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance e1350bc4-558a-40ac-91e5-96da24f154f5 {{(pid=75216) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 13 18:51:39 user nova-compute[75216]: DEBUG nova.network.neutron [req-2810308e-7ea2-4d01-9545-5c38a7b2bb72 req-5e15c512-226a-4568-88a2-2549382e78d2 service nova] [instance: 91ea8a19-a365-484c-80c7-baf90e7dd1aa] Updated VIF entry in instance network info cache for port 2cfb645f-7bee-4657-b0d8-afcaa0298ac9. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 18:51:39 user nova-compute[75216]: DEBUG nova.network.neutron [req-2810308e-7ea2-4d01-9545-5c38a7b2bb72 req-5e15c512-226a-4568-88a2-2549382e78d2 service nova] [instance: 91ea8a19-a365-484c-80c7-baf90e7dd1aa] Updating instance_info_cache with network_info: [{"id": "2cfb645f-7bee-4657-b0d8-afcaa0298ac9", "address": "fa:16:3e:3e:1d:91", "network": {"id": "a9670fc3-8a8e-4a2b-a39f-d41042d3443d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1394481632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0194e3c88e2b49c5ba9b9844f6048ea9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cfb645f-7b", "ovs_interfaceid": "2cfb645f-7bee-4657-b0d8-afcaa0298ac9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 18:51:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-2810308e-7ea2-4d01-9545-5c38a7b2bb72 req-5e15c512-226a-4568-88a2-2549382e78d2 service nova] Releasing lock "refresh_cache-91ea8a19-a365-484c-80c7-baf90e7dd1aa" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 18:51:42 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:51:43 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:51:44 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:51:45 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:51:46 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:51:46 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:51:47 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:51:47 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:51:47 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Starting heal instance info cache {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 18:51:47 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Rebuilding the list of instances to heal {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 13 18:51:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "refresh_cache-a1a3e849-6570-4820-97c8-75468b5bea4f" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 18:51:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquired lock "refresh_cache-a1a3e849-6570-4820-97c8-75468b5bea4f" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 18:51:47 user nova-compute[75216]: DEBUG nova.network.neutron [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: a1a3e849-6570-4820-97c8-75468b5bea4f] Forcefully refreshing network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 18:51:47 user nova-compute[75216]: DEBUG nova.objects.instance [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lazy-loading 'info_cache' on Instance uuid a1a3e849-6570-4820-97c8-75468b5bea4f {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 18:51:48 user nova-compute[75216]: DEBUG nova.network.neutron [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: a1a3e849-6570-4820-97c8-75468b5bea4f] Updating instance_info_cache with network_info: [{"id": "3544d3e3-8dfa-4043-b225-77f690cd3760", "address": "fa:16:3e:9e:b9:f7", "network": {"id": "d7a691f0-4495-40ad-a349-91b5dc9c635a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-961583097-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9b7e11038e54e368acd22d06e54a351", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3544d3e3-8d", "ovs_interfaceid": "3544d3e3-8dfa-4043-b225-77f690cd3760", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 18:51:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Releasing lock "refresh_cache-a1a3e849-6570-4820-97c8-75468b5bea4f" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 18:51:48 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: a1a3e849-6570-4820-97c8-75468b5bea4f] Updated the network info_cache for instance {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 18:51:48 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:51:48 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:51:48 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75216) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 18:51:48 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:51:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:51:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:51:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:51:48 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Auditing locally available compute resources for user (node: user) {{(pid=75216) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 18:51:48 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:51:48 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:51:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a3e849-6570-4820-97c8-75468b5bea4f/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:51:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a3e849-6570-4820-97c8-75468b5bea4f/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:51:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a3e849-6570-4820-97c8-75468b5bea4f/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:51:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a3e849-6570-4820-97c8-75468b5bea4f/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:51:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1350bc4-558a-40ac-91e5-96da24f154f5/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:51:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1350bc4-558a-40ac-91e5-96da24f154f5/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:51:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1350bc4-558a-40ac-91e5-96da24f154f5/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:51:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1350bc4-558a-40ac-91e5-96da24f154f5/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:51:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d589d57e-de50-482a-843f-e8246b3d7528/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:51:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d589d57e-de50-482a-843f-e8246b3d7528/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:51:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d589d57e-de50-482a-843f-e8246b3d7528/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:51:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d589d57e-de50-482a-843f-e8246b3d7528/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:51:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b078f75-57f2-495a-abd5-f8adf72db80b/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:51:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b078f75-57f2-495a-abd5-f8adf72db80b/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:51:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b078f75-57f2-495a-abd5-f8adf72db80b/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:51:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b078f75-57f2-495a-abd5-f8adf72db80b/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:51:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91ea8a19-a365-484c-80c7-baf90e7dd1aa/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:51:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91ea8a19-a365-484c-80c7-baf90e7dd1aa/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:51:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91ea8a19-a365-484c-80c7-baf90e7dd1aa/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:51:50 user nova-compute[75216]: DEBUG nova.compute.manager [req-7b7ad355-a7b7-4153-b816-9b237f992c70 req-fd9fb1a6-54f5-4e90-87ec-54c15075b45c service nova] [instance: a3bcf65e-bd5b-4350-a222-5f4522418a67] Received event network-changed-c4ac5376-d559-4365-b2ce-d827fecd2d1a {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:51:50 user nova-compute[75216]: DEBUG nova.compute.manager [req-7b7ad355-a7b7-4153-b816-9b237f992c70 req-fd9fb1a6-54f5-4e90-87ec-54c15075b45c service nova] [instance: a3bcf65e-bd5b-4350-a222-5f4522418a67] Refreshing instance network info cache due to event network-changed-c4ac5376-d559-4365-b2ce-d827fecd2d1a. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 18:51:50 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-7b7ad355-a7b7-4153-b816-9b237f992c70 req-fd9fb1a6-54f5-4e90-87ec-54c15075b45c service nova] Acquiring lock "refresh_cache-a3bcf65e-bd5b-4350-a222-5f4522418a67" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 18:51:50 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-7b7ad355-a7b7-4153-b816-9b237f992c70 req-fd9fb1a6-54f5-4e90-87ec-54c15075b45c service nova] Acquired lock "refresh_cache-a3bcf65e-bd5b-4350-a222-5f4522418a67" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 18:51:50 user nova-compute[75216]: DEBUG nova.network.neutron [req-7b7ad355-a7b7-4153-b816-9b237f992c70 req-fd9fb1a6-54f5-4e90-87ec-54c15075b45c service nova] [instance: a3bcf65e-bd5b-4350-a222-5f4522418a67] Refreshing network info cache for port c4ac5376-d559-4365-b2ce-d827fecd2d1a {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 18:51:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91ea8a19-a365-484c-80c7-baf90e7dd1aa/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:51:50 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-91a7d06a-5070-4d5e-9dd2-691dc346f12b tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] Acquiring lock "a3bcf65e-bd5b-4350-a222-5f4522418a67" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:51:50 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-91a7d06a-5070-4d5e-9dd2-691dc346f12b tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] Lock "a3bcf65e-bd5b-4350-a222-5f4522418a67" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:51:50 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-91a7d06a-5070-4d5e-9dd2-691dc346f12b tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] Acquiring lock "a3bcf65e-bd5b-4350-a222-5f4522418a67-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:51:50 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-91a7d06a-5070-4d5e-9dd2-691dc346f12b tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] Lock "a3bcf65e-bd5b-4350-a222-5f4522418a67-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:51:50 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-91a7d06a-5070-4d5e-9dd2-691dc346f12b tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] Lock "a3bcf65e-bd5b-4350-a222-5f4522418a67-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:51:50 user nova-compute[75216]: INFO nova.compute.manager [None req-91a7d06a-5070-4d5e-9dd2-691dc346f12b tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] [instance: a3bcf65e-bd5b-4350-a222-5f4522418a67] Terminating instance
Nov 13 18:51:50 user nova-compute[75216]: DEBUG nova.compute.manager [None req-91a7d06a-5070-4d5e-9dd2-691dc346f12b tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] [instance: a3bcf65e-bd5b-4350-a222-5f4522418a67] Start destroying the instance on the hypervisor. {{(pid=75216) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 18:51:50 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 18:51:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85624c58-6c72-4490-8a3e-547953295ade/disk.rescue --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:51:50 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:51:50 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:51:50 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:51:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85624c58-6c72-4490-8a3e-547953295ade/disk.rescue --force-share --output=json" returned: 0 in 0.254s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:51:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85624c58-6c72-4490-8a3e-547953295ade/disk.rescue --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:51:50 user nova-compute[75216]: DEBUG nova.compute.manager [req-9dab0698-7b20-46c2-a8f1-05f2457635d3 req-6abc68f4-e6ac-40ee-b723-4b540900e5bb service nova] [instance: a3bcf65e-bd5b-4350-a222-5f4522418a67] Received event network-vif-unplugged-c4ac5376-d559-4365-b2ce-d827fecd2d1a {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:51:50 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-9dab0698-7b20-46c2-a8f1-05f2457635d3 req-6abc68f4-e6ac-40ee-b723-4b540900e5bb service nova] Acquiring lock "a3bcf65e-bd5b-4350-a222-5f4522418a67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:51:50 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-9dab0698-7b20-46c2-a8f1-05f2457635d3 req-6abc68f4-e6ac-40ee-b723-4b540900e5bb service nova] Lock "a3bcf65e-bd5b-4350-a222-5f4522418a67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:51:50 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-9dab0698-7b20-46c2-a8f1-05f2457635d3 req-6abc68f4-e6ac-40ee-b723-4b540900e5bb service nova] Lock "a3bcf65e-bd5b-4350-a222-5f4522418a67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:51:50 user nova-compute[75216]: DEBUG nova.compute.manager [req-9dab0698-7b20-46c2-a8f1-05f2457635d3 req-6abc68f4-e6ac-40ee-b723-4b540900e5bb service nova] [instance: a3bcf65e-bd5b-4350-a222-5f4522418a67] No waiting events found dispatching network-vif-unplugged-c4ac5376-d559-4365-b2ce-d827fecd2d1a {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:51:50 user nova-compute[75216]: DEBUG nova.compute.manager [req-9dab0698-7b20-46c2-a8f1-05f2457635d3 req-6abc68f4-e6ac-40ee-b723-4b540900e5bb service nova] [instance: a3bcf65e-bd5b-4350-a222-5f4522418a67] Received event network-vif-unplugged-c4ac5376-d559-4365-b2ce-d827fecd2d1a for instance with task_state deleting. {{(pid=75216) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 18:51:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85624c58-6c72-4490-8a3e-547953295ade/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:51:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85624c58-6c72-4490-8a3e-547953295ade/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:51:50 user nova-compute[75216]: DEBUG nova.network.neutron [req-7b7ad355-a7b7-4153-b816-9b237f992c70 req-fd9fb1a6-54f5-4e90-87ec-54c15075b45c service nova] [instance: a3bcf65e-bd5b-4350-a222-5f4522418a67] Updated VIF entry in instance network info cache for port c4ac5376-d559-4365-b2ce-d827fecd2d1a. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 18:51:50 user nova-compute[75216]: DEBUG nova.network.neutron [req-7b7ad355-a7b7-4153-b816-9b237f992c70 req-fd9fb1a6-54f5-4e90-87ec-54c15075b45c service nova] [instance: a3bcf65e-bd5b-4350-a222-5f4522418a67] Updating instance_info_cache with network_info: [{"id": "c4ac5376-d559-4365-b2ce-d827fecd2d1a", "address": "fa:16:3e:f7:06:79", "network": {"id": "4f264ec8-b112-4549-aa16-029824a0fcb4", "bridge": "br-int", "label": "tempest-TestShelveInstance-1108623968-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2601440dcec64a86a539dbdddafc7a5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4ac5376-d5", "ovs_interfaceid": "c4ac5376-d559-4365-b2ce-d827fecd2d1a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 18:51:50 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-7b7ad355-a7b7-4153-b816-9b237f992c70 req-fd9fb1a6-54f5-4e90-87ec-54c15075b45c service nova] Releasing lock "refresh_cache-a3bcf65e-bd5b-4350-a222-5f4522418a67" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 18:51:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85624c58-6c72-4490-8a3e-547953295ade/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:51:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85624c58-6c72-4490-8a3e-547953295ade/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:51:51 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: a3bcf65e-bd5b-4350-a222-5f4522418a67] Instance destroyed successfully.
Nov 13 18:51:51 user nova-compute[75216]: DEBUG nova.objects.instance [None req-91a7d06a-5070-4d5e-9dd2-691dc346f12b tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] Lazy-loading 'resources' on Instance uuid a3bcf65e-bd5b-4350-a222-5f4522418a67 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 18:51:51 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-91a7d06a-5070-4d5e-9dd2-691dc346f12b tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-13T18:46:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-87869039',display_name='tempest-TestShelveInstance-server-87869039',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-87869039',id=12,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPf0Z5pKlRRYrkYQFZZ0LACxhlQS1FSX42rZOPJMyvxKGvcaboPCfNe3ktO1Wd/Ubb0iNMpYVdQ715G8FRIzu5wlnhJ6jeanXKJe8TuPRmnvCmt4lh2Ehwnc7Gc7HtYc2Q==',key_name='tempest-TestShelveInstance-2022745159',keypairs=<?>,launch_index=0,launched_at=2023-11-13T18:50:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2601440dcec64a86a539dbdddafc7a5d',ramdisk_id='',reservation_id='r-x2eeit0j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-55051446',owner_user_name='tempest-TestShelveInstance-55051446-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T18:50:13Z,user_data=None,user_id='59c263be93a143c3878bec0c4ae626af',uuid=a3bcf65e-bd5b-4350-a222-5f4522418a67,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c4ac5376-d559-4365-b2ce-d827fecd2d1a", "address": "fa:16:3e:f7:06:79", "network": {"id": "4f264ec8-b112-4549-aa16-029824a0fcb4", "bridge": "br-int", "label": "tempest-TestShelveInstance-1108623968-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2601440dcec64a86a539dbdddafc7a5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4ac5376-d5", "ovs_interfaceid": "c4ac5376-d559-4365-b2ce-d827fecd2d1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 18:51:51 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-91a7d06a-5070-4d5e-9dd2-691dc346f12b tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] Converting VIF {"id": "c4ac5376-d559-4365-b2ce-d827fecd2d1a", "address": "fa:16:3e:f7:06:79", "network": {"id": "4f264ec8-b112-4549-aa16-029824a0fcb4", "bridge": "br-int", "label": "tempest-TestShelveInstance-1108623968-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2601440dcec64a86a539dbdddafc7a5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4ac5376-d5", "ovs_interfaceid": "c4ac5376-d559-4365-b2ce-d827fecd2d1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 18:51:51 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-91a7d06a-5070-4d5e-9dd2-691dc346f12b tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:06:79,bridge_name='br-int',has_traffic_filtering=True,id=c4ac5376-d559-4365-b2ce-d827fecd2d1a,network=Network(4f264ec8-b112-4549-aa16-029824a0fcb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4ac5376-d5') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 18:51:51 user nova-compute[75216]: DEBUG os_vif [None req-91a7d06a-5070-4d5e-9dd2-691dc346f12b tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:06:79,bridge_name='br-int',has_traffic_filtering=True,id=c4ac5376-d559-4365-b2ce-d827fecd2d1a,network=Network(4f264ec8-b112-4549-aa16-029824a0fcb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4ac5376-d5') {{(pid=75216) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 18:51:51 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:51:51 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc4ac5376-d5, bridge=br-int, if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:51:51 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:51:51 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:51:51 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:51:51 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=846b5fe9-968f-430e-8293-1d7e36bd9f0b) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:51:51 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:51:51 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:51:51 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:51:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85624c58-6c72-4490-8a3e-547953295ade/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:51:51 user nova-compute[75216]: INFO os_vif [None req-91a7d06a-5070-4d5e-9dd2-691dc346f12b tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:06:79,bridge_name='br-int',has_traffic_filtering=True,id=c4ac5376-d559-4365-b2ce-d827fecd2d1a,network=Network(4f264ec8-b112-4549-aa16-029824a0fcb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4ac5376-d5')
Nov 13 18:51:51 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 18:51:51 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-91a7d06a-5070-4d5e-9dd2-691dc346f12b tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] [instance: a3bcf65e-bd5b-4350-a222-5f4522418a67] calling os-brick to detach iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 18:51:51 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-91a7d06a-5070-4d5e-9dd2-691dc346f12b tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3a8669e40>, {'target_iqn': 'iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OGxHvBQW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 18:51:51 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-91a7d06a-5070-4d5e-9dd2-691dc346f12b tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 18:51:51 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-91a7d06a-5070-4d5e-9dd2-691dc346f12b tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 18:51:51 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-91a7d06a-5070-4d5e-9dd2-691dc346f12b tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 18:51:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:51:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c9d9c1b-6df5-41ff-a696-871e70d04e07/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:51:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:51:51 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[90b9bbcd-69dc-4944-ad11-a31691f39d99]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4b15037c-4bb7-47be-9097-c49c67552d83\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6c711796-fc49-4e18-8fdd-eefe1e3b357c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ae66a157-b0d3-4501-a728-a010d6a83a10\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:51:51 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-91a7d06a-5070-4d5e-9dd2-691dc346f12b tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 18:51:51 user nova-compute[75216]: No targets found.
Nov 13 18:51:51 user nova-compute[75216]: iSNS:
Nov 13 18:51:51 user nova-compute[75216]: No targets found.
Nov 13 18:51:51 user nova-compute[75216]: STATIC:
Nov 13 18:51:51 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:4b15037c-4bb7-47be-9097-c49c67552d83
Nov 13 18:51:51 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 18:51:51 user nova-compute[75216]:                 Iface Name: default
Nov 13 18:51:51 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:6c711796-fc49-4e18-8fdd-eefe1e3b357c
Nov 13 18:51:51 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 18:51:51 user nova-compute[75216]:                 Iface Name: default
Nov 13 18:51:51 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac
Nov 13 18:51:51 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 18:51:51 user nova-compute[75216]:                 Iface Name: default
Nov 13 18:51:51 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:ae66a157-b0d3-4501-a728-a010d6a83a10
Nov 13 18:51:51 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 18:51:51 user nova-compute[75216]:                 Iface Name: default
Nov 13 18:51:51 user nova-compute[75216]: FIRMWARE:
Nov 13 18:51:51 user nova-compute[75216]: No targets found.
Nov 13 18:51:51 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 18:51:51 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-91a7d06a-5070-4d5e-9dd2-691dc346f12b tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 18:51:51 user nova-compute[75216]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 18:51:51 user nova-compute[75216]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75216) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 18:51:51 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-91a7d06a-5070-4d5e-9dd2-691dc346f12b tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac', 0)] {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 18:51:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:51:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:51:51 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3b815d3-2bc2-4817-b61a-db746f6f59e1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4b15037c-4bb7-47be-9097-c49c67552d83\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6c711796-fc49-4e18-8fdd-eefe1e3b357c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ae66a157-b0d3-4501-a728-a010d6a83a10\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:51:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:51:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:51:51 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[24e8c134-c13f-437f-a3a5-ee879a419a37]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c711796-fc49-4e18-8fdd-eefe1e3b357c (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae66a157-b0d3-4501-a728-a010d6a83a10 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b15037c-4bb7-47be-9097-c49c67552d83 (non-flash)\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:51:51 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-91a7d06a-5070-4d5e-9dd2-691dc346f12b tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac (non-flash)
Nov 13 18:51:51 user nova-compute[75216]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c711796-fc49-4e18-8fdd-eefe1e3b357c (non-flash)
Nov 13 18:51:51 user nova-compute[75216]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae66a157-b0d3-4501-a728-a010d6a83a10 (non-flash)
Nov 13 18:51:51 user nova-compute[75216]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b15037c-4bb7-47be-9097-c49c67552d83 (non-flash)
Nov 13 18:51:51 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 18:51:51 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-91a7d06a-5070-4d5e-9dd2-691dc346f12b tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac (non-flash)
Nov 13 18:51:51 user nova-compute[75216]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c711796-fc49-4e18-8fdd-eefe1e3b357c (non-flash)
Nov 13 18:51:51 user nova-compute[75216]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae66a157-b0d3-4501-a728-a010d6a83a10 (non-flash)
Nov 13 18:51:51 user nova-compute[75216]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b15037c-4bb7-47be-9097-c49c67552d83 (non-flash)
Nov 13 18:51:51 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 18:51:51 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-91a7d06a-5070-4d5e-9dd2-691dc346f12b tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe3a834f370>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac'): ({'sde'}, set())}) {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 18:51:51 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-91a7d06a-5070-4d5e-9dd2-691dc346f12b tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] Removing single pathed devices sde {{(pid=75216) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 18:51:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:51:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:51:51 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0611256-c329-4dd8-9e61-4ad780c146b4]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:51:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:51:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:51:51 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4a18bf2-0359-4b7a-b6c0-3abcc6936fda]: (4, ('ok\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:51:51 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-91a7d06a-5070-4d5e-9dd2-691dc346f12b tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] Flushing IO for device /dev/sde {{(pid=75216) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 18:51:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:51:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c9d9c1b-6df5-41ff-a696-871e70d04e07/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:51:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c9d9c1b-6df5-41ff-a696-871e70d04e07/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:51:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.019s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:51:51 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[2446f225-550f-4ae2-b0cd-a90c973a9ffe]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:51:51 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-91a7d06a-5070-4d5e-9dd2-691dc346f12b tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75216) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 18:51:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:51:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.048s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:51:51 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9d08f34-3282-46f7-9996-404e1eadba9c]: (4, ('1', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:51:51 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-91a7d06a-5070-4d5e-9dd2-691dc346f12b tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 18:51:51 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-91a7d06a-5070-4d5e-9dd2-691dc346f12b tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] SCSI volumes sde have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 18:51:51 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-91a7d06a-5070-4d5e-9dd2-691dc346f12b tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac')] {{(pid=75216) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 18:51:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:51:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:51:51 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf394d61-4761-4799-b3a3-aac654127718]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:51:51 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-91a7d06a-5070-4d5e-9dd2-691dc346f12b tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:51:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac -p 172.16.0.220:3260 --logout {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:51:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:51:51 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e28217c-e2a9-4e38-bb8c-e9217c345ab5]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:51:51 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-91a7d06a-5070-4d5e-9dd2-691dc346f12b tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac, portal: 172.16.0.220,3260]
Nov 13 18:51:51 user nova-compute[75216]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac, portal: 172.16.0.220,3260] successful.
Nov 13 18:51:51 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:51:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac -p 172.16.0.220:3260 --op delete {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:51:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c9d9c1b-6df5-41ff-a696-871e70d04e07/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:51:51 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 18:51:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84c721c0-dd26-494a-a193-5b302250edac -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:51:51 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[5567bbc6-f79b-425c-8315-5da549bb0651]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:51:51 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-91a7d06a-5070-4d5e-9dd2-691dc346f12b tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:51:51 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-91a7d06a-5070-4d5e-9dd2-691dc346f12b tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.413s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 18:51:51 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-91a7d06a-5070-4d5e-9dd2-691dc346f12b tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] <== disconnect_volume: return (416ms) None {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 18:51:51 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-91a7d06a-5070-4d5e-9dd2-691dc346f12b tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] [instance: a3bcf65e-bd5b-4350-a222-5f4522418a67] Disconnected iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 18:51:51 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-91a7d06a-5070-4d5e-9dd2-691dc346f12b tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] [instance: a3bcf65e-bd5b-4350-a222-5f4522418a67] Deleting instance files /opt/stack/data/nova/instances/a3bcf65e-bd5b-4350-a222-5f4522418a67_del
Nov 13 18:51:51 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-91a7d06a-5070-4d5e-9dd2-691dc346f12b tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] [instance: a3bcf65e-bd5b-4350-a222-5f4522418a67] Deletion of /opt/stack/data/nova/instances/a3bcf65e-bd5b-4350-a222-5f4522418a67_del complete
Nov 13 18:51:52 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 18:51:52 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 18:51:52 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Hypervisor/Node resource view: name=user free_ram=7438MB free_disk=25.47903060913086GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75216) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 18:51:52 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:51:52 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:51:52 user nova-compute[75216]: INFO nova.compute.manager [None req-91a7d06a-5070-4d5e-9dd2-691dc346f12b tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] [instance: a3bcf65e-bd5b-4350-a222-5f4522418a67] Took 1.64 seconds to destroy the instance on the hypervisor.
Nov 13 18:51:52 user nova-compute[75216]: DEBUG oslo.service.loopingcall [None req-91a7d06a-5070-4d5e-9dd2-691dc346f12b tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75216) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 18:51:52 user nova-compute[75216]: DEBUG nova.compute.manager [-] [instance: a3bcf65e-bd5b-4350-a222-5f4522418a67] Deallocating network for instance {{(pid=75216) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 18:51:52 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: a3bcf65e-bd5b-4350-a222-5f4522418a67] deallocate_for_instance() {{(pid=75216) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 18:51:52 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance a1a3e849-6570-4820-97c8-75468b5bea4f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 18:51:52 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance d589d57e-de50-482a-843f-e8246b3d7528 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 18:51:52 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance 85624c58-6c72-4490-8a3e-547953295ade actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 18:51:52 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance 9b078f75-57f2-495a-abd5-f8adf72db80b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 18:51:52 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance 7c9d9c1b-6df5-41ff-a696-871e70d04e07 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 18:51:52 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance 3679beb0-5244-443a-8512-38b29ccb62f0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 18:51:52 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance e1350bc4-558a-40ac-91e5-96da24f154f5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 18:51:52 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance 91ea8a19-a365-484c-80c7-baf90e7dd1aa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 18:51:52 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance a3bcf65e-bd5b-4350-a222-5f4522418a67 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 18:51:52 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 18:51:52 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 18:51:52 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 18:51:52 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 18:51:52 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Compute_service record updated for user:user {{(pid=75216) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 18:51:52 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.421s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:51:52 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: a3bcf65e-bd5b-4350-a222-5f4522418a67] Updating instance_info_cache with network_info: [] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 18:51:52 user nova-compute[75216]: INFO nova.compute.manager [-] [instance: a3bcf65e-bd5b-4350-a222-5f4522418a67] Took 0.51 seconds to deallocate network for instance.
Nov 13 18:51:52 user nova-compute[75216]: DEBUG nova.compute.manager [req-24bdf854-a7c9-42b2-88e8-bf80c17e2dea req-c874a6d9-0751-4b46-9bae-807caec0a354 service nova] [instance: a3bcf65e-bd5b-4350-a222-5f4522418a67] Received event network-vif-deleted-c4ac5376-d559-4365-b2ce-d827fecd2d1a {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:51:52 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:51:52 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:51:52 user nova-compute[75216]: DEBUG nova.compute.manager [req-6aea0812-ee26-4eaa-8ace-b7b7ac567926 req-a8c6b6ee-edaf-4a40-aa1d-606d8fef2dd1 service nova] [instance: a3bcf65e-bd5b-4350-a222-5f4522418a67] Received event network-vif-plugged-c4ac5376-d559-4365-b2ce-d827fecd2d1a {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:51:52 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-6aea0812-ee26-4eaa-8ace-b7b7ac567926 req-a8c6b6ee-edaf-4a40-aa1d-606d8fef2dd1 service nova] Acquiring lock "a3bcf65e-bd5b-4350-a222-5f4522418a67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:51:52 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-6aea0812-ee26-4eaa-8ace-b7b7ac567926 req-a8c6b6ee-edaf-4a40-aa1d-606d8fef2dd1 service nova] Lock "a3bcf65e-bd5b-4350-a222-5f4522418a67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:51:52 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-6aea0812-ee26-4eaa-8ace-b7b7ac567926 req-a8c6b6ee-edaf-4a40-aa1d-606d8fef2dd1 service nova] Lock "a3bcf65e-bd5b-4350-a222-5f4522418a67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:51:52 user nova-compute[75216]: DEBUG nova.compute.manager [req-6aea0812-ee26-4eaa-8ace-b7b7ac567926 req-a8c6b6ee-edaf-4a40-aa1d-606d8fef2dd1 service nova] [instance: a3bcf65e-bd5b-4350-a222-5f4522418a67] No waiting events found dispatching network-vif-plugged-c4ac5376-d559-4365-b2ce-d827fecd2d1a {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:51:52 user nova-compute[75216]: WARNING nova.compute.manager [req-6aea0812-ee26-4eaa-8ace-b7b7ac567926 req-a8c6b6ee-edaf-4a40-aa1d-606d8fef2dd1 service nova] [instance: a3bcf65e-bd5b-4350-a222-5f4522418a67] Received unexpected event network-vif-plugged-c4ac5376-d559-4365-b2ce-d827fecd2d1a for instance with vm_state active and task_state deleting.
Nov 13 18:51:53 user nova-compute[75216]: INFO nova.compute.manager [None req-91a7d06a-5070-4d5e-9dd2-691dc346f12b tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] [instance: a3bcf65e-bd5b-4350-a222-5f4522418a67] Took 0.85 seconds to detach 1 volumes for instance.
Nov 13 18:51:53 user nova-compute[75216]: DEBUG nova.compute.manager [None req-91a7d06a-5070-4d5e-9dd2-691dc346f12b tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] [instance: a3bcf65e-bd5b-4350-a222-5f4522418a67] Deleting volume: 84c721c0-dd26-494a-a193-5b302250edac {{(pid=75216) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 13 18:51:53 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:51:53 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-91a7d06a-5070-4d5e-9dd2-691dc346f12b tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:51:53 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-91a7d06a-5070-4d5e-9dd2-691dc346f12b tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:51:53 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-91a7d06a-5070-4d5e-9dd2-691dc346f12b tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 18:51:53 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-91a7d06a-5070-4d5e-9dd2-691dc346f12b tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 18:51:53 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-91a7d06a-5070-4d5e-9dd2-691dc346f12b tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.306s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:51:53 user nova-compute[75216]: INFO nova.scheduler.client.report [None req-91a7d06a-5070-4d5e-9dd2-691dc346f12b tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] Deleted allocations for instance a3bcf65e-bd5b-4350-a222-5f4522418a67
Nov 13 18:51:53 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-91a7d06a-5070-4d5e-9dd2-691dc346f12b tempest-TestShelveInstance-55051446 tempest-TestShelveInstance-55051446-project-member] Lock "a3bcf65e-bd5b-4350-a222-5f4522418a67" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.573s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:51:54 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:51:56 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:51:57 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-962c02e4-ecdc-4378-bf37-c79a8e828868 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] Acquiring lock "14d378b0-79ba-4161-a795-6288939c6fef" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:51:57 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-962c02e4-ecdc-4378-bf37-c79a8e828868 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] Lock "14d378b0-79ba-4161-a795-6288939c6fef" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:51:57 user nova-compute[75216]: DEBUG nova.compute.manager [None req-962c02e4-ecdc-4378-bf37-c79a8e828868 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] [instance: 14d378b0-79ba-4161-a795-6288939c6fef] Starting instance... {{(pid=75216) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 18:51:57 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-962c02e4-ecdc-4378-bf37-c79a8e828868 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:51:57 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-962c02e4-ecdc-4378-bf37-c79a8e828868 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:51:57 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-962c02e4-ecdc-4378-bf37-c79a8e828868 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75216) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 18:51:57 user nova-compute[75216]: INFO nova.compute.claims [None req-962c02e4-ecdc-4378-bf37-c79a8e828868 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] [instance: 14d378b0-79ba-4161-a795-6288939c6fef] Claim successful on node user
Nov 13 18:51:57 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-962c02e4-ecdc-4378-bf37-c79a8e828868 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 18:51:57 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-962c02e4-ecdc-4378-bf37-c79a8e828868 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 18:51:57 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-962c02e4-ecdc-4378-bf37-c79a8e828868 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.345s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:51:57 user nova-compute[75216]: DEBUG nova.compute.manager [None req-962c02e4-ecdc-4378-bf37-c79a8e828868 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] [instance: 14d378b0-79ba-4161-a795-6288939c6fef] Start building networks asynchronously for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 18:51:58 user nova-compute[75216]: DEBUG nova.compute.manager [None req-962c02e4-ecdc-4378-bf37-c79a8e828868 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] [instance: 14d378b0-79ba-4161-a795-6288939c6fef] Allocating IP information in the background. {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 18:51:58 user nova-compute[75216]: DEBUG nova.network.neutron [None req-962c02e4-ecdc-4378-bf37-c79a8e828868 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] [instance: 14d378b0-79ba-4161-a795-6288939c6fef] allocate_for_instance() {{(pid=75216) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 18:51:58 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-962c02e4-ecdc-4378-bf37-c79a8e828868 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] [instance: 14d378b0-79ba-4161-a795-6288939c6fef] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 18:51:58 user nova-compute[75216]: DEBUG nova.compute.manager [None req-962c02e4-ecdc-4378-bf37-c79a8e828868 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] [instance: 14d378b0-79ba-4161-a795-6288939c6fef] Start building block device mappings for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 18:51:58 user nova-compute[75216]: DEBUG nova.policy [None req-962c02e4-ecdc-4378-bf37-c79a8e828868 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '14638ac21d6f4b0e9fa526934c8eb7ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847a509c4d34004a89158b45ec469fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75216) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 18:51:58 user nova-compute[75216]: DEBUG nova.compute.manager [None req-962c02e4-ecdc-4378-bf37-c79a8e828868 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] [instance: 14d378b0-79ba-4161-a795-6288939c6fef] Start spawning the instance on the hypervisor. {{(pid=75216) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 18:51:58 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-962c02e4-ecdc-4378-bf37-c79a8e828868 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] [instance: 14d378b0-79ba-4161-a795-6288939c6fef] Creating instance directory {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 18:51:58 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-962c02e4-ecdc-4378-bf37-c79a8e828868 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] [instance: 14d378b0-79ba-4161-a795-6288939c6fef] Creating image(s)
Nov 13 18:51:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-962c02e4-ecdc-4378-bf37-c79a8e828868 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] Acquiring lock "/opt/stack/data/nova/instances/14d378b0-79ba-4161-a795-6288939c6fef/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:51:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-962c02e4-ecdc-4378-bf37-c79a8e828868 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] Lock "/opt/stack/data/nova/instances/14d378b0-79ba-4161-a795-6288939c6fef/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:51:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-962c02e4-ecdc-4378-bf37-c79a8e828868 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] Lock "/opt/stack/data/nova/instances/14d378b0-79ba-4161-a795-6288939c6fef/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:51:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-962c02e4-ecdc-4378-bf37-c79a8e828868 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:51:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-962c02e4-ecdc-4378-bf37-c79a8e828868 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json" returned: 0 in 0.168s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:51:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-962c02e4-ecdc-4378-bf37-c79a8e828868 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] Acquiring lock "88c50a45bec9d6b0427462b3242b9b8e5f49c2b6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:51:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-962c02e4-ecdc-4378-bf37-c79a8e828868 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] Lock "88c50a45bec9d6b0427462b3242b9b8e5f49c2b6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:51:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-962c02e4-ecdc-4378-bf37-c79a8e828868 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:51:58 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:51:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-962c02e4-ecdc-4378-bf37-c79a8e828868 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json" returned: 0 in 0.198s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:51:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-962c02e4-ecdc-4378-bf37-c79a8e828868 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6,backing_fmt=raw /opt/stack/data/nova/instances/14d378b0-79ba-4161-a795-6288939c6fef/disk 1073741824 {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:51:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-962c02e4-ecdc-4378-bf37-c79a8e828868 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6,backing_fmt=raw /opt/stack/data/nova/instances/14d378b0-79ba-4161-a795-6288939c6fef/disk 1073741824" returned: 0 in 0.046s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:51:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-962c02e4-ecdc-4378-bf37-c79a8e828868 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] Lock "88c50a45bec9d6b0427462b3242b9b8e5f49c2b6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:51:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-962c02e4-ecdc-4378-bf37-c79a8e828868 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:51:58 user nova-compute[75216]: DEBUG nova.network.neutron [None req-962c02e4-ecdc-4378-bf37-c79a8e828868 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] [instance: 14d378b0-79ba-4161-a795-6288939c6fef] Successfully created port: 7ac04b47-1761-46fb-8193-7eb1dd278710 {{(pid=75216) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 18:51:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-962c02e4-ecdc-4378-bf37-c79a8e828868 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json" returned: 0 in 0.178s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:51:58 user nova-compute[75216]: DEBUG nova.virt.disk.api [None req-962c02e4-ecdc-4378-bf37-c79a8e828868 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] Checking if we can resize image /opt/stack/data/nova/instances/14d378b0-79ba-4161-a795-6288939c6fef/disk. size=1073741824 {{(pid=75216) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 18:51:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-962c02e4-ecdc-4378-bf37-c79a8e828868 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14d378b0-79ba-4161-a795-6288939c6fef/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:51:58 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-e942be0d-2b85-4273-aebe-49ec552f740f tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] Waiting for libvirt event about the detach of device sdc with device alias scsi0-0-0-2 from instance e1350bc4-558a-40ac-91e5-96da24f154f5 is timed out.
Nov 13 18:51:58 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-e942be0d-2b85-4273-aebe-49ec552f740f tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] Successfully detached device sdc from instance e1350bc4-558a-40ac-91e5-96da24f154f5 from the live domain config.
Nov 13 18:51:58 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e942be0d-2b85-4273-aebe-49ec552f740f tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] [instance: e1350bc4-558a-40ac-91e5-96da24f154f5] calling os-brick to detach iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 18:51:58 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e942be0d-2b85-4273-aebe-49ec552f740f tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3a8669e40>, {'target_iqn': 'iqn.2010-10.org.openstack:4b15037c-4bb7-47be-9097-c49c67552d83', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nJQsKMSZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 18:51:58 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-e942be0d-2b85-4273-aebe-49ec552f740f tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 18:51:58 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-e942be0d-2b85-4273-aebe-49ec552f740f tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 18:51:58 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-e942be0d-2b85-4273-aebe-49ec552f740f tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 18:51:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-962c02e4-ecdc-4378-bf37-c79a8e828868 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14d378b0-79ba-4161-a795-6288939c6fef/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:51:58 user nova-compute[75216]: DEBUG nova.virt.disk.api [None req-962c02e4-ecdc-4378-bf37-c79a8e828868 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] Cannot resize image /opt/stack/data/nova/instances/14d378b0-79ba-4161-a795-6288939c6fef/disk to a smaller size. {{(pid=75216) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 18:51:58 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-962c02e4-ecdc-4378-bf37-c79a8e828868 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] [instance: 14d378b0-79ba-4161-a795-6288939c6fef] Created local disks {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 18:51:58 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-962c02e4-ecdc-4378-bf37-c79a8e828868 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] [instance: 14d378b0-79ba-4161-a795-6288939c6fef] Ensure instance console log exists: /opt/stack/data/nova/instances/14d378b0-79ba-4161-a795-6288939c6fef/console.log {{(pid=75216) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 18:51:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-962c02e4-ecdc-4378-bf37-c79a8e828868 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:51:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-962c02e4-ecdc-4378-bf37-c79a8e828868 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:51:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-962c02e4-ecdc-4378-bf37-c79a8e828868 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:51:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:51:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:51:58 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[51c5f1ae-6d54-45c6-ab79-323b22c986fa]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4b15037c-4bb7-47be-9097-c49c67552d83\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6c711796-fc49-4e18-8fdd-eefe1e3b357c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ae66a157-b0d3-4501-a728-a010d6a83a10\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:51:58 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e942be0d-2b85-4273-aebe-49ec552f740f tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 18:51:58 user nova-compute[75216]: No targets found.
Nov 13 18:51:58 user nova-compute[75216]: iSNS:
Nov 13 18:51:58 user nova-compute[75216]: No targets found.
Nov 13 18:51:58 user nova-compute[75216]: STATIC:
Nov 13 18:51:58 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:4b15037c-4bb7-47be-9097-c49c67552d83
Nov 13 18:51:58 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 18:51:58 user nova-compute[75216]:                 Iface Name: default
Nov 13 18:51:58 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:6c711796-fc49-4e18-8fdd-eefe1e3b357c
Nov 13 18:51:58 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 18:51:58 user nova-compute[75216]:                 Iface Name: default
Nov 13 18:51:58 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:ae66a157-b0d3-4501-a728-a010d6a83a10
Nov 13 18:51:58 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 18:51:58 user nova-compute[75216]:                 Iface Name: default
Nov 13 18:51:58 user nova-compute[75216]: FIRMWARE:
Nov 13 18:51:58 user nova-compute[75216]: No targets found.
Nov 13 18:51:58 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 18:51:58 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e942be0d-2b85-4273-aebe-49ec552f740f tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 18:51:58 user nova-compute[75216]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 18:51:58 user nova-compute[75216]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75216) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 18:51:58 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e942be0d-2b85-4273-aebe-49ec552f740f tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4b15037c-4bb7-47be-9097-c49c67552d83', 0)] {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 18:51:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:51:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:51:58 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d08b963-2484-48a2-af7b-00837bba4562]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4b15037c-4bb7-47be-9097-c49c67552d83\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6c711796-fc49-4e18-8fdd-eefe1e3b357c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ae66a157-b0d3-4501-a728-a010d6a83a10\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:51:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:51:59 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:51:59 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[7758ff37-e4e8-46be-9a4d-18567538894c]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c711796-fc49-4e18-8fdd-eefe1e3b357c (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae66a157-b0d3-4501-a728-a010d6a83a10 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b15037c-4bb7-47be-9097-c49c67552d83 (non-flash)\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:51:59 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e942be0d-2b85-4273-aebe-49ec552f740f tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c711796-fc49-4e18-8fdd-eefe1e3b357c (non-flash)
Nov 13 18:51:59 user nova-compute[75216]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae66a157-b0d3-4501-a728-a010d6a83a10 (non-flash)
Nov 13 18:51:59 user nova-compute[75216]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b15037c-4bb7-47be-9097-c49c67552d83 (non-flash)
Nov 13 18:51:59 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 18:51:59 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e942be0d-2b85-4273-aebe-49ec552f740f tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c711796-fc49-4e18-8fdd-eefe1e3b357c (non-flash)
Nov 13 18:51:59 user nova-compute[75216]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae66a157-b0d3-4501-a728-a010d6a83a10 (non-flash)
Nov 13 18:51:59 user nova-compute[75216]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b15037c-4bb7-47be-9097-c49c67552d83 (non-flash)
Nov 13 18:51:59 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 18:51:59 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e942be0d-2b85-4273-aebe-49ec552f740f tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe3a8313ac0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4b15037c-4bb7-47be-9097-c49c67552d83'): ({'sdb'}, set())}) {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 18:51:59 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-e942be0d-2b85-4273-aebe-49ec552f740f tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] Removing single pathed devices sdb {{(pid=75216) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 18:51:59 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:51:59 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:51:59 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ab42cd5-29cf-40d2-9582-0da1de2c40de]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:51:59 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:51:59 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:51:59 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd847320-fd09-4735-a1b2-dc278d4bdb45]: (4, ('ok\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:51:59 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-e942be0d-2b85-4273-aebe-49ec552f740f tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] Flushing IO for device /dev/sdb {{(pid=75216) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 18:51:59 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:51:59 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:51:59 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4d177a5-b160-4a3c-9f59-2f898acabbb5]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:51:59 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-e942be0d-2b85-4273-aebe-49ec552f740f tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75216) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 18:51:59 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:51:59 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:51:59 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d201204-f359-4715-be36-18096fbf850d]: (4, ('1', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:51:59 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-e942be0d-2b85-4273-aebe-49ec552f740f tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 18:51:59 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-e942be0d-2b85-4273-aebe-49ec552f740f tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] SCSI volumes sdb have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 18:51:59 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e942be0d-2b85-4273-aebe-49ec552f740f tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4b15037c-4bb7-47be-9097-c49c67552d83')] {{(pid=75216) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 18:51:59 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b15037c-4bb7-47be-9097-c49c67552d83 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:51:59 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b15037c-4bb7-47be-9097-c49c67552d83 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:51:59 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[907eb7f2-da5e-42c3-92bf-eebc79a2d862]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:51:59 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e942be0d-2b85-4273-aebe-49ec552f740f tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:51:59 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b15037c-4bb7-47be-9097-c49c67552d83 -p 172.16.0.220:3260 --logout {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:51:59 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b15037c-4bb7-47be-9097-c49c67552d83 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:51:59 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[af00d8b1-5813-4467-b128-a6e4c541d08d]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:4b15037c-4bb7-47be-9097-c49c67552d83, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:4b15037c-4bb7-47be-9097-c49c67552d83, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:51:59 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e942be0d-2b85-4273-aebe-49ec552f740f tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:4b15037c-4bb7-47be-9097-c49c67552d83, portal: 172.16.0.220,3260]
Nov 13 18:51:59 user nova-compute[75216]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:4b15037c-4bb7-47be-9097-c49c67552d83, portal: 172.16.0.220,3260] successful.
Nov 13 18:51:59 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:51:59 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b15037c-4bb7-47be-9097-c49c67552d83 -p 172.16.0.220:3260 --op delete {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:51:59 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b15037c-4bb7-47be-9097-c49c67552d83 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:51:59 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[4adaa703-8b26-4793-9fc0-637141f3e3fc]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:51:59 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e942be0d-2b85-4273-aebe-49ec552f740f tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:51:59 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-e942be0d-2b85-4273-aebe-49ec552f740f tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.288s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 18:51:59 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e942be0d-2b85-4273-aebe-49ec552f740f tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] <== disconnect_volume: return (290ms) None {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 18:51:59 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e942be0d-2b85-4273-aebe-49ec552f740f tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] [instance: e1350bc4-558a-40ac-91e5-96da24f154f5] Disconnected iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 18:51:59 user nova-compute[75216]: DEBUG nova.network.neutron [None req-962c02e4-ecdc-4378-bf37-c79a8e828868 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] [instance: 14d378b0-79ba-4161-a795-6288939c6fef] Successfully updated port: 7ac04b47-1761-46fb-8193-7eb1dd278710 {{(pid=75216) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 18:51:59 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-962c02e4-ecdc-4378-bf37-c79a8e828868 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] Acquiring lock "refresh_cache-14d378b0-79ba-4161-a795-6288939c6fef" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 18:51:59 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-962c02e4-ecdc-4378-bf37-c79a8e828868 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] Acquired lock "refresh_cache-14d378b0-79ba-4161-a795-6288939c6fef" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 18:51:59 user nova-compute[75216]: DEBUG nova.network.neutron [None req-962c02e4-ecdc-4378-bf37-c79a8e828868 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] [instance: 14d378b0-79ba-4161-a795-6288939c6fef] Building network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 18:51:59 user nova-compute[75216]: DEBUG nova.compute.manager [req-0a56f5f4-d138-49a9-97bc-d0ae7cf1ee7d req-f207e9fa-0fc0-47bc-bfcb-24691d3aaef4 service nova] [instance: 14d378b0-79ba-4161-a795-6288939c6fef] Received event network-changed-7ac04b47-1761-46fb-8193-7eb1dd278710 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:51:59 user nova-compute[75216]: DEBUG nova.compute.manager [req-0a56f5f4-d138-49a9-97bc-d0ae7cf1ee7d req-f207e9fa-0fc0-47bc-bfcb-24691d3aaef4 service nova] [instance: 14d378b0-79ba-4161-a795-6288939c6fef] Refreshing instance network info cache due to event network-changed-7ac04b47-1761-46fb-8193-7eb1dd278710. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 18:51:59 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-0a56f5f4-d138-49a9-97bc-d0ae7cf1ee7d req-f207e9fa-0fc0-47bc-bfcb-24691d3aaef4 service nova] Acquiring lock "refresh_cache-14d378b0-79ba-4161-a795-6288939c6fef" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 18:51:59 user nova-compute[75216]: DEBUG nova.network.neutron [None req-962c02e4-ecdc-4378-bf37-c79a8e828868 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] [instance: 14d378b0-79ba-4161-a795-6288939c6fef] Instance cache missing network info. {{(pid=75216) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 18:51:59 user nova-compute[75216]: DEBUG nova.objects.instance [None req-e942be0d-2b85-4273-aebe-49ec552f740f tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] Lazy-loading 'flavor' on Instance uuid e1350bc4-558a-40ac-91e5-96da24f154f5 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 18:51:59 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e942be0d-2b85-4273-aebe-49ec552f740f tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] Lock "e1350bc4-558a-40ac-91e5-96da24f154f5" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.542s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:52:00 user nova-compute[75216]: DEBUG nova.network.neutron [None req-962c02e4-ecdc-4378-bf37-c79a8e828868 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] [instance: 14d378b0-79ba-4161-a795-6288939c6fef] Updating instance_info_cache with network_info: [{"id": "7ac04b47-1761-46fb-8193-7eb1dd278710", "address": "fa:16:3e:6e:00:d7", "network": {"id": "bf647e60-7de3-41d4-abe5-a8ddf56be0f2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2101256065-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a847a509c4d34004a89158b45ec469fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ac04b47-17", "ovs_interfaceid": "7ac04b47-1761-46fb-8193-7eb1dd278710", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 18:52:00 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-962c02e4-ecdc-4378-bf37-c79a8e828868 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] Releasing lock "refresh_cache-14d378b0-79ba-4161-a795-6288939c6fef" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 18:52:00 user nova-compute[75216]: DEBUG nova.compute.manager [None req-962c02e4-ecdc-4378-bf37-c79a8e828868 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] [instance: 14d378b0-79ba-4161-a795-6288939c6fef] Instance network_info: |[{"id": "7ac04b47-1761-46fb-8193-7eb1dd278710", "address": "fa:16:3e:6e:00:d7", "network": {"id": "bf647e60-7de3-41d4-abe5-a8ddf56be0f2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2101256065-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a847a509c4d34004a89158b45ec469fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ac04b47-17", "ovs_interfaceid": "7ac04b47-1761-46fb-8193-7eb1dd278710", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 18:52:00 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-0a56f5f4-d138-49a9-97bc-d0ae7cf1ee7d req-f207e9fa-0fc0-47bc-bfcb-24691d3aaef4 service nova] Acquired lock "refresh_cache-14d378b0-79ba-4161-a795-6288939c6fef" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 18:52:00 user nova-compute[75216]: DEBUG nova.network.neutron [req-0a56f5f4-d138-49a9-97bc-d0ae7cf1ee7d req-f207e9fa-0fc0-47bc-bfcb-24691d3aaef4 service nova] [instance: 14d378b0-79ba-4161-a795-6288939c6fef] Refreshing network info cache for port 7ac04b47-1761-46fb-8193-7eb1dd278710 {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 18:52:00 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-962c02e4-ecdc-4378-bf37-c79a8e828868 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] [instance: 14d378b0-79ba-4161-a795-6288939c6fef] Start _get_guest_xml network_info=[{"id": "7ac04b47-1761-46fb-8193-7eb1dd278710", "address": "fa:16:3e:6e:00:d7", "network": {"id": "bf647e60-7de3-41d4-abe5-a8ddf56be0f2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2101256065-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a847a509c4d34004a89158b45ec469fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ac04b47-17", "ovs_interfaceid": "7ac04b47-1761-46fb-8193-7eb1dd278710", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T18:41:06Z,direct_url=<?>,disk_format='qcow2',id=77bcb5ba-8510-41ec-a88d-96097bb431de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c465b7c26ec44582b6d1b7169536ecc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T18:41:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'guest_format': None, 'boot_index': 0, 'image_id': '77bcb5ba-8510-41ec-a88d-96097bb431de'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 18:52:00 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-962c02e4-ecdc-4378-bf37-c79a8e828868 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 18:52:00 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-962c02e4-ecdc-4378-bf37-c79a8e828868 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 18:52:00 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-962c02e4-ecdc-4378-bf37-c79a8e828868 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 18:52:00 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-962c02e4-ecdc-4378-bf37-c79a8e828868 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] CPU controller missing on host. {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 18:52:00 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-962c02e4-ecdc-4378-bf37-c79a8e828868 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 18:52:00 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-962c02e4-ecdc-4378-bf37-c79a8e828868 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] CPU controller found on host. {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 18:52:00 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-962c02e4-ecdc-4378-bf37-c79a8e828868 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75216) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 18:52:00 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-962c02e4-ecdc-4378-bf37-c79a8e828868 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T18:40:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T18:41:06Z,direct_url=<?>,disk_format='qcow2',id=77bcb5ba-8510-41ec-a88d-96097bb431de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c465b7c26ec44582b6d1b7169536ecc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T18:41:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 18:52:00 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-962c02e4-ecdc-4378-bf37-c79a8e828868 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] Flavor limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 18:52:00 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-962c02e4-ecdc-4378-bf37-c79a8e828868 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] Image limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 18:52:00 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-962c02e4-ecdc-4378-bf37-c79a8e828868 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] Flavor pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 18:52:00 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-962c02e4-ecdc-4378-bf37-c79a8e828868 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] Image pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 18:52:00 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-962c02e4-ecdc-4378-bf37-c79a8e828868 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 18:52:00 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-962c02e4-ecdc-4378-bf37-c79a8e828868 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 18:52:00 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-962c02e4-ecdc-4378-bf37-c79a8e828868 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 18:52:00 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-962c02e4-ecdc-4378-bf37-c79a8e828868 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] Got 1 possible topologies {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 18:52:00 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-962c02e4-ecdc-4378-bf37-c79a8e828868 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 18:52:00 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-962c02e4-ecdc-4378-bf37-c79a8e828868 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 18:52:00 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-962c02e4-ecdc-4378-bf37-c79a8e828868 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T18:51:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1612928989',display_name='tempest-ServersNegativeTestJSON-server-1612928989',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1612928989',id=19,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a847a509c4d34004a89158b45ec469fb',ramdisk_id='',reservation_id='r-hngd993m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-950650335',owner_user_name='tempest-ServersNegativeTestJSON-950650335-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T18:51:58Z,user_data=None,user_id='14638ac21d6f4b0e9fa526934c8eb7ea',uuid=14d378b0-79ba-4161-a795-6288939c6fef,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7ac04b47-1761-46fb-8193-7eb1dd278710", "address": "fa:16:3e:6e:00:d7", "network": {"id": "bf647e60-7de3-41d4-abe5-a8ddf56be0f2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2101256065-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a847a509c4d34004a89158b45ec469fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ac04b47-17", "ovs_interfaceid": "7ac04b47-1761-46fb-8193-7eb1dd278710", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75216) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 18:52:00 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-962c02e4-ecdc-4378-bf37-c79a8e828868 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] Converting VIF {"id": "7ac04b47-1761-46fb-8193-7eb1dd278710", "address": "fa:16:3e:6e:00:d7", "network": {"id": "bf647e60-7de3-41d4-abe5-a8ddf56be0f2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2101256065-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a847a509c4d34004a89158b45ec469fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ac04b47-17", "ovs_interfaceid": "7ac04b47-1761-46fb-8193-7eb1dd278710", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 18:52:00 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-962c02e4-ecdc-4378-bf37-c79a8e828868 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:00:d7,bridge_name='br-int',has_traffic_filtering=True,id=7ac04b47-1761-46fb-8193-7eb1dd278710,network=Network(bf647e60-7de3-41d4-abe5-a8ddf56be0f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ac04b47-17') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 18:52:00 user nova-compute[75216]: DEBUG nova.objects.instance [None req-962c02e4-ecdc-4378-bf37-c79a8e828868 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] Lazy-loading 'pci_devices' on Instance uuid 14d378b0-79ba-4161-a795-6288939c6fef {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 18:52:00 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-962c02e4-ecdc-4378-bf37-c79a8e828868 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] [instance: 14d378b0-79ba-4161-a795-6288939c6fef] End _get_guest_xml xml=<domain type="kvm">
Nov 13 18:52:00 user nova-compute[75216]:   <uuid>14d378b0-79ba-4161-a795-6288939c6fef</uuid>
Nov 13 18:52:00 user nova-compute[75216]:   <name>instance-00000013</name>
Nov 13 18:52:00 user nova-compute[75216]:   <memory>524288</memory>
Nov 13 18:52:00 user nova-compute[75216]:   <vcpu>1</vcpu>
Nov 13 18:52:00 user nova-compute[75216]:   <metadata>
Nov 13 18:52:00 user nova-compute[75216]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 18:52:00 user nova-compute[75216]:       <nova:package version="0.0.0"/>
Nov 13 18:52:00 user nova-compute[75216]:       <nova:name>tempest-ServersNegativeTestJSON-server-1612928989</nova:name>
Nov 13 18:52:00 user nova-compute[75216]:       <nova:creationTime>2023-11-13 18:52:00</nova:creationTime>
Nov 13 18:52:00 user nova-compute[75216]:       <nova:flavor name="m1.tiny">
Nov 13 18:52:00 user nova-compute[75216]:         <nova:memory>512</nova:memory>
Nov 13 18:52:00 user nova-compute[75216]:         <nova:disk>1</nova:disk>
Nov 13 18:52:00 user nova-compute[75216]:         <nova:swap>0</nova:swap>
Nov 13 18:52:00 user nova-compute[75216]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 18:52:00 user nova-compute[75216]:         <nova:vcpus>1</nova:vcpus>
Nov 13 18:52:00 user nova-compute[75216]:       </nova:flavor>
Nov 13 18:52:00 user nova-compute[75216]:       <nova:owner>
Nov 13 18:52:00 user nova-compute[75216]:         <nova:user uuid="14638ac21d6f4b0e9fa526934c8eb7ea">tempest-ServersNegativeTestJSON-950650335-project-member</nova:user>
Nov 13 18:52:00 user nova-compute[75216]:         <nova:project uuid="a847a509c4d34004a89158b45ec469fb">tempest-ServersNegativeTestJSON-950650335</nova:project>
Nov 13 18:52:00 user nova-compute[75216]:       </nova:owner>
Nov 13 18:52:00 user nova-compute[75216]:       <nova:root type="image" uuid="77bcb5ba-8510-41ec-a88d-96097bb431de"/>
Nov 13 18:52:00 user nova-compute[75216]:       <nova:ports>
Nov 13 18:52:00 user nova-compute[75216]:         <nova:port uuid="7ac04b47-1761-46fb-8193-7eb1dd278710">
Nov 13 18:52:00 user nova-compute[75216]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 13 18:52:00 user nova-compute[75216]:         </nova:port>
Nov 13 18:52:00 user nova-compute[75216]:       </nova:ports>
Nov 13 18:52:00 user nova-compute[75216]:     </nova:instance>
Nov 13 18:52:00 user nova-compute[75216]:   </metadata>
Nov 13 18:52:00 user nova-compute[75216]:   <sysinfo type="smbios">
Nov 13 18:52:00 user nova-compute[75216]:     <system>
Nov 13 18:52:00 user nova-compute[75216]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 18:52:00 user nova-compute[75216]:       <entry name="product">OpenStack Nova</entry>
Nov 13 18:52:00 user nova-compute[75216]:       <entry name="version">0.0.0</entry>
Nov 13 18:52:00 user nova-compute[75216]:       <entry name="serial">14d378b0-79ba-4161-a795-6288939c6fef</entry>
Nov 13 18:52:00 user nova-compute[75216]:       <entry name="uuid">14d378b0-79ba-4161-a795-6288939c6fef</entry>
Nov 13 18:52:00 user nova-compute[75216]:       <entry name="family">Virtual Machine</entry>
Nov 13 18:52:00 user nova-compute[75216]:     </system>
Nov 13 18:52:00 user nova-compute[75216]:   </sysinfo>
Nov 13 18:52:00 user nova-compute[75216]:   <os>
Nov 13 18:52:00 user nova-compute[75216]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 18:52:00 user nova-compute[75216]:     <boot dev="hd"/>
Nov 13 18:52:00 user nova-compute[75216]:     <smbios mode="sysinfo"/>
Nov 13 18:52:00 user nova-compute[75216]:   </os>
Nov 13 18:52:00 user nova-compute[75216]:   <features>
Nov 13 18:52:00 user nova-compute[75216]:     <acpi/>
Nov 13 18:52:00 user nova-compute[75216]:     <apic/>
Nov 13 18:52:00 user nova-compute[75216]:     <vmcoreinfo/>
Nov 13 18:52:00 user nova-compute[75216]:   </features>
Nov 13 18:52:00 user nova-compute[75216]:   <clock offset="utc">
Nov 13 18:52:00 user nova-compute[75216]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 18:52:00 user nova-compute[75216]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 18:52:00 user nova-compute[75216]:     <timer name="hpet" present="no"/>
Nov 13 18:52:00 user nova-compute[75216]:   </clock>
Nov 13 18:52:00 user nova-compute[75216]:   <cpu mode="custom" match="exact">
Nov 13 18:52:00 user nova-compute[75216]:     <model>Nehalem</model>
Nov 13 18:52:00 user nova-compute[75216]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 18:52:00 user nova-compute[75216]:   </cpu>
Nov 13 18:52:00 user nova-compute[75216]:   <devices>
Nov 13 18:52:00 user nova-compute[75216]:     <disk type="file" device="disk">
Nov 13 18:52:00 user nova-compute[75216]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 18:52:00 user nova-compute[75216]:       <source file="/opt/stack/data/nova/instances/14d378b0-79ba-4161-a795-6288939c6fef/disk"/>
Nov 13 18:52:00 user nova-compute[75216]:       <target dev="vda" bus="virtio"/>
Nov 13 18:52:00 user nova-compute[75216]:     </disk>
Nov 13 18:52:00 user nova-compute[75216]:     <interface type="ethernet">
Nov 13 18:52:00 user nova-compute[75216]:       <mac address="fa:16:3e:6e:00:d7"/>
Nov 13 18:52:00 user nova-compute[75216]:       <model type="virtio"/>
Nov 13 18:52:00 user nova-compute[75216]:       <mtu size="1442"/>
Nov 13 18:52:00 user nova-compute[75216]:       <target dev="tap7ac04b47-17"/>
Nov 13 18:52:00 user nova-compute[75216]:     </interface>
Nov 13 18:52:00 user nova-compute[75216]:     <serial type="pty">
Nov 13 18:52:00 user nova-compute[75216]:       <log file="/opt/stack/data/nova/instances/14d378b0-79ba-4161-a795-6288939c6fef/console.log" append="off"/>
Nov 13 18:52:00 user nova-compute[75216]:     </serial>
Nov 13 18:52:00 user nova-compute[75216]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 18:52:00 user nova-compute[75216]:     <video>
Nov 13 18:52:00 user nova-compute[75216]:       <model type="virtio"/>
Nov 13 18:52:00 user nova-compute[75216]:     </video>
Nov 13 18:52:00 user nova-compute[75216]:     <rng model="virtio">
Nov 13 18:52:00 user nova-compute[75216]:       <backend model="random">/dev/urandom</backend>
Nov 13 18:52:00 user nova-compute[75216]:     </rng>
Nov 13 18:52:00 user nova-compute[75216]:     <controller type="usb" index="0" model="none"/>
Nov 13 18:52:00 user nova-compute[75216]:     <memballoon model="virtio">
Nov 13 18:52:00 user nova-compute[75216]:       <stats period="10"/>
Nov 13 18:52:00 user nova-compute[75216]:     </memballoon>
Nov 13 18:52:00 user nova-compute[75216]:   </devices>
Nov 13 18:52:00 user nova-compute[75216]: </domain>
Nov 13 18:52:00 user nova-compute[75216]:  {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 18:52:00 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-962c02e4-ecdc-4378-bf37-c79a8e828868 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T18:51:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1612928989',display_name='tempest-ServersNegativeTestJSON-server-1612928989',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1612928989',id=19,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a847a509c4d34004a89158b45ec469fb',ramdisk_id='',reservation_id='r-hngd993m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-950650335',owner_user_name='tempest-ServersNegativeTestJSON-950650335-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T18:51:58Z,user_data=None,user_id='14638ac21d6f4b0e9fa526934c8eb7ea',uuid=14d378b0-79ba-4161-a795-6288939c6fef,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7ac04b47-1761-46fb-8193-7eb1dd278710", "address": "fa:16:3e:6e:00:d7", "network": {"id": "bf647e60-7de3-41d4-abe5-a8ddf56be0f2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2101256065-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a847a509c4d34004a89158b45ec469fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ac04b47-17", "ovs_interfaceid": "7ac04b47-1761-46fb-8193-7eb1dd278710", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 18:52:00 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-962c02e4-ecdc-4378-bf37-c79a8e828868 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] Converting VIF {"id": "7ac04b47-1761-46fb-8193-7eb1dd278710", "address": "fa:16:3e:6e:00:d7", "network": {"id": "bf647e60-7de3-41d4-abe5-a8ddf56be0f2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2101256065-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a847a509c4d34004a89158b45ec469fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ac04b47-17", "ovs_interfaceid": "7ac04b47-1761-46fb-8193-7eb1dd278710", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 18:52:00 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-962c02e4-ecdc-4378-bf37-c79a8e828868 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:00:d7,bridge_name='br-int',has_traffic_filtering=True,id=7ac04b47-1761-46fb-8193-7eb1dd278710,network=Network(bf647e60-7de3-41d4-abe5-a8ddf56be0f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ac04b47-17') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 18:52:00 user nova-compute[75216]: DEBUG os_vif [None req-962c02e4-ecdc-4378-bf37-c79a8e828868 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:00:d7,bridge_name='br-int',has_traffic_filtering=True,id=7ac04b47-1761-46fb-8193-7eb1dd278710,network=Network(bf647e60-7de3-41d4-abe5-a8ddf56be0f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ac04b47-17') {{(pid=75216) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 18:52:00 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:52:00 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:52:00 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 18:52:00 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:52:00 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '984011f5-31c1-58f7-8e8c-3be837277578', '_type': 'linux-noop'}}, row=False) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:52:00 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:52:00 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:52:00 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7ac04b47-17, may_exist=True, interface_attrs={}) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:52:00 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7ac04b47-17, col_values=(('qos', UUID('9f1ef6b3-bc12-4a49-9782-69161429ab7b')),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:52:00 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7ac04b47-17, col_values=(('external_ids', {'iface-id': '7ac04b47-1761-46fb-8193-7eb1dd278710', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6e:00:d7', 'vm-uuid': '14d378b0-79ba-4161-a795-6288939c6fef'}),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:52:00 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:52:00 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:52:00 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:52:00 user nova-compute[75216]: INFO os_vif [None req-962c02e4-ecdc-4378-bf37-c79a8e828868 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:00:d7,bridge_name='br-int',has_traffic_filtering=True,id=7ac04b47-1761-46fb-8193-7eb1dd278710,network=Network(bf647e60-7de3-41d4-abe5-a8ddf56be0f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ac04b47-17')
Nov 13 18:52:00 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-962c02e4-ecdc-4378-bf37-c79a8e828868 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 18:52:00 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-962c02e4-ecdc-4378-bf37-c79a8e828868 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] No VIF found with MAC fa:16:3e:6e:00:d7, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 18:52:00 user nova-compute[75216]: DEBUG nova.network.neutron [req-0a56f5f4-d138-49a9-97bc-d0ae7cf1ee7d req-f207e9fa-0fc0-47bc-bfcb-24691d3aaef4 service nova] [instance: 14d378b0-79ba-4161-a795-6288939c6fef] Updated VIF entry in instance network info cache for port 7ac04b47-1761-46fb-8193-7eb1dd278710. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 18:52:00 user nova-compute[75216]: DEBUG nova.network.neutron [req-0a56f5f4-d138-49a9-97bc-d0ae7cf1ee7d req-f207e9fa-0fc0-47bc-bfcb-24691d3aaef4 service nova] [instance: 14d378b0-79ba-4161-a795-6288939c6fef] Updating instance_info_cache with network_info: [{"id": "7ac04b47-1761-46fb-8193-7eb1dd278710", "address": "fa:16:3e:6e:00:d7", "network": {"id": "bf647e60-7de3-41d4-abe5-a8ddf56be0f2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2101256065-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a847a509c4d34004a89158b45ec469fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ac04b47-17", "ovs_interfaceid": "7ac04b47-1761-46fb-8193-7eb1dd278710", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 18:52:00 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-0a56f5f4-d138-49a9-97bc-d0ae7cf1ee7d req-f207e9fa-0fc0-47bc-bfcb-24691d3aaef4 service nova] Releasing lock "refresh_cache-14d378b0-79ba-4161-a795-6288939c6fef" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 18:52:01 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-fb0f6557-2fa3-4fc2-b12b-3d7184b65006 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] Acquiring lock "e1350bc4-558a-40ac-91e5-96da24f154f5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:52:01 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-fb0f6557-2fa3-4fc2-b12b-3d7184b65006 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] Lock "e1350bc4-558a-40ac-91e5-96da24f154f5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:52:01 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-fb0f6557-2fa3-4fc2-b12b-3d7184b65006 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] Acquiring lock "e1350bc4-558a-40ac-91e5-96da24f154f5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:52:01 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-fb0f6557-2fa3-4fc2-b12b-3d7184b65006 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] Lock "e1350bc4-558a-40ac-91e5-96da24f154f5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:52:01 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-fb0f6557-2fa3-4fc2-b12b-3d7184b65006 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] Lock "e1350bc4-558a-40ac-91e5-96da24f154f5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:52:01 user nova-compute[75216]: INFO nova.compute.manager [None req-fb0f6557-2fa3-4fc2-b12b-3d7184b65006 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] [instance: e1350bc4-558a-40ac-91e5-96da24f154f5] Terminating instance
Nov 13 18:52:01 user nova-compute[75216]: DEBUG nova.compute.manager [None req-fb0f6557-2fa3-4fc2-b12b-3d7184b65006 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] [instance: e1350bc4-558a-40ac-91e5-96da24f154f5] Start destroying the instance on the hypervisor. {{(pid=75216) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 18:52:01 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:52:01 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:52:01 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:52:01 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:52:01 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:52:01 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:52:01 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:52:01 user nova-compute[75216]: DEBUG nova.compute.manager [req-4718708a-1253-4f15-9ac9-46c603b504af req-2f6c1950-93eb-4fc8-b811-2a83751a33b4 service nova] [instance: e1350bc4-558a-40ac-91e5-96da24f154f5] Received event network-vif-unplugged-87a8f08d-9d26-49e7-9111-8758d3bbcf2f {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:52:01 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-4718708a-1253-4f15-9ac9-46c603b504af req-2f6c1950-93eb-4fc8-b811-2a83751a33b4 service nova] Acquiring lock "e1350bc4-558a-40ac-91e5-96da24f154f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:52:01 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-4718708a-1253-4f15-9ac9-46c603b504af req-2f6c1950-93eb-4fc8-b811-2a83751a33b4 service nova] Lock "e1350bc4-558a-40ac-91e5-96da24f154f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:52:01 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-4718708a-1253-4f15-9ac9-46c603b504af req-2f6c1950-93eb-4fc8-b811-2a83751a33b4 service nova] Lock "e1350bc4-558a-40ac-91e5-96da24f154f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:52:01 user nova-compute[75216]: DEBUG nova.compute.manager [req-4718708a-1253-4f15-9ac9-46c603b504af req-2f6c1950-93eb-4fc8-b811-2a83751a33b4 service nova] [instance: e1350bc4-558a-40ac-91e5-96da24f154f5] No waiting events found dispatching network-vif-unplugged-87a8f08d-9d26-49e7-9111-8758d3bbcf2f {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:52:01 user nova-compute[75216]: DEBUG nova.compute.manager [req-4718708a-1253-4f15-9ac9-46c603b504af req-2f6c1950-93eb-4fc8-b811-2a83751a33b4 service nova] [instance: e1350bc4-558a-40ac-91e5-96da24f154f5] Received event network-vif-unplugged-87a8f08d-9d26-49e7-9111-8758d3bbcf2f for instance with task_state deleting. {{(pid=75216) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 18:52:01 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-2454a3c4-a853-4d20-8c6c-5be0de2e2b74 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] Acquiring lock "9b078f75-57f2-495a-abd5-f8adf72db80b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:52:01 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-2454a3c4-a853-4d20-8c6c-5be0de2e2b74 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] Lock "9b078f75-57f2-495a-abd5-f8adf72db80b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:52:01 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-2454a3c4-a853-4d20-8c6c-5be0de2e2b74 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] Acquiring lock "9b078f75-57f2-495a-abd5-f8adf72db80b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:52:01 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-2454a3c4-a853-4d20-8c6c-5be0de2e2b74 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] Lock "9b078f75-57f2-495a-abd5-f8adf72db80b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:52:01 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-2454a3c4-a853-4d20-8c6c-5be0de2e2b74 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] Lock "9b078f75-57f2-495a-abd5-f8adf72db80b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:52:01 user nova-compute[75216]: INFO nova.compute.manager [None req-2454a3c4-a853-4d20-8c6c-5be0de2e2b74 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] [instance: 9b078f75-57f2-495a-abd5-f8adf72db80b] Terminating instance
Nov 13 18:52:01 user nova-compute[75216]: DEBUG nova.compute.manager [None req-2454a3c4-a853-4d20-8c6c-5be0de2e2b74 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] [instance: 9b078f75-57f2-495a-abd5-f8adf72db80b] Start destroying the instance on the hypervisor. {{(pid=75216) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 18:52:01 user nova-compute[75216]: DEBUG nova.compute.manager [req-c6997037-013e-45bb-b02d-46f5920b7904 req-9a866153-5ae9-4cb6-9a7a-3bc8e3bc328e service nova] [instance: 14d378b0-79ba-4161-a795-6288939c6fef] Received event network-vif-plugged-7ac04b47-1761-46fb-8193-7eb1dd278710 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:52:01 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-c6997037-013e-45bb-b02d-46f5920b7904 req-9a866153-5ae9-4cb6-9a7a-3bc8e3bc328e service nova] Acquiring lock "14d378b0-79ba-4161-a795-6288939c6fef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:52:01 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-c6997037-013e-45bb-b02d-46f5920b7904 req-9a866153-5ae9-4cb6-9a7a-3bc8e3bc328e service nova] Lock "14d378b0-79ba-4161-a795-6288939c6fef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:52:01 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-c6997037-013e-45bb-b02d-46f5920b7904 req-9a866153-5ae9-4cb6-9a7a-3bc8e3bc328e service nova] Lock "14d378b0-79ba-4161-a795-6288939c6fef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:52:01 user nova-compute[75216]: DEBUG nova.compute.manager [req-c6997037-013e-45bb-b02d-46f5920b7904 req-9a866153-5ae9-4cb6-9a7a-3bc8e3bc328e service nova] [instance: 14d378b0-79ba-4161-a795-6288939c6fef] No waiting events found dispatching network-vif-plugged-7ac04b47-1761-46fb-8193-7eb1dd278710 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:52:01 user nova-compute[75216]: WARNING nova.compute.manager [req-c6997037-013e-45bb-b02d-46f5920b7904 req-9a866153-5ae9-4cb6-9a7a-3bc8e3bc328e service nova] [instance: 14d378b0-79ba-4161-a795-6288939c6fef] Received unexpected event network-vif-plugged-7ac04b47-1761-46fb-8193-7eb1dd278710 for instance with vm_state building and task_state spawning.
Nov 13 18:52:01 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:52:01 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:52:02 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:52:02 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:52:02 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:52:02 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:52:02 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:52:02 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:52:02 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:52:02 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:52:02 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:52:02 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: e1350bc4-558a-40ac-91e5-96da24f154f5] Instance destroyed successfully.
Nov 13 18:52:02 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:52:02 user nova-compute[75216]: DEBUG nova.objects.instance [None req-fb0f6557-2fa3-4fc2-b12b-3d7184b65006 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] Lazy-loading 'resources' on Instance uuid e1350bc4-558a-40ac-91e5-96da24f154f5 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 18:52:02 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-fb0f6557-2fa3-4fc2-b12b-3d7184b65006 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T18:49:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-529468211',display_name='tempest-AttachSCSIVolumeTestJSON-server-529468211',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-529468211',id=17,image_ref='d64c4c49-a469-4642-ae7c-29858896ff0d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPB5htGRf8NhiIPLr8eOrgxloOYLp5TkNhpR6mTQWG6uAqBLI/87B6kEefWqRX1VvhVG3RLYOcrRZ6ZP4R0fBedkJ8nBgor9P1bXRGfTN4XWv6AcTT6wB54THMNFO4Djvg==',key_name='tempest-keypair-270475825',keypairs=<?>,launch_index=0,launched_at=2023-11-13T18:49:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3303a3ffcb5d4d1495f45a7c3cc9076a',ramdisk_id='',reservation_id='r-91g4y0qg',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d64c4c49-a469-4642-ae7c-29858896ff0d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-913042882',owner_user_name='tempest-AttachSCSIVolumeTestJSON-913042882-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T18:49:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a2dca87196c74236b3df1cc4eed57cd4',uuid=e1350bc4-558a-40ac-91e5-96da24f154f5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "87a8f08d-9d26-49e7-9111-8758d3bbcf2f", "address": "fa:16:3e:96:a6:55", "network": {"id": "78d34574-c9cb-4054-9b54-15ab42a41a6d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-2015553211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3303a3ffcb5d4d1495f45a7c3cc9076a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87a8f08d-9d", "ovs_interfaceid": "87a8f08d-9d26-49e7-9111-8758d3bbcf2f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 18:52:02 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-fb0f6557-2fa3-4fc2-b12b-3d7184b65006 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] Converting VIF {"id": "87a8f08d-9d26-49e7-9111-8758d3bbcf2f", "address": "fa:16:3e:96:a6:55", "network": {"id": "78d34574-c9cb-4054-9b54-15ab42a41a6d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-2015553211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3303a3ffcb5d4d1495f45a7c3cc9076a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87a8f08d-9d", "ovs_interfaceid": "87a8f08d-9d26-49e7-9111-8758d3bbcf2f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 18:52:02 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-fb0f6557-2fa3-4fc2-b12b-3d7184b65006 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:96:a6:55,bridge_name='br-int',has_traffic_filtering=True,id=87a8f08d-9d26-49e7-9111-8758d3bbcf2f,network=Network(78d34574-c9cb-4054-9b54-15ab42a41a6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87a8f08d-9d') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 18:52:02 user nova-compute[75216]: DEBUG os_vif [None req-fb0f6557-2fa3-4fc2-b12b-3d7184b65006 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:96:a6:55,bridge_name='br-int',has_traffic_filtering=True,id=87a8f08d-9d26-49e7-9111-8758d3bbcf2f,network=Network(78d34574-c9cb-4054-9b54-15ab42a41a6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87a8f08d-9d') {{(pid=75216) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 18:52:02 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:52:02 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap87a8f08d-9d, bridge=br-int, if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:52:02 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:52:02 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:52:02 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 9b078f75-57f2-495a-abd5-f8adf72db80b] Instance destroyed successfully.
Nov 13 18:52:02 user nova-compute[75216]: DEBUG nova.objects.instance [None req-2454a3c4-a853-4d20-8c6c-5be0de2e2b74 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] Lazy-loading 'resources' on Instance uuid 9b078f75-57f2-495a-abd5-f8adf72db80b {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 18:52:02 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-2454a3c4-a853-4d20-8c6c-5be0de2e2b74 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T18:44:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-2037924683',display_name='tempest-ServerStableDeviceRescueTest-server-2037924683',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-2037924683',id=5,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDyNRjKkEXE946W7ATv6X8QWLmngeHlSnPG/JxUF3ZiVINBi3q8Kko9NDXYQqGAv1e8V8a0QDwPM0ffhuobkkIWKpFKPb2hwJDWRakg7VKmbTavuHCqEjEADGU4Zo+roSw==',key_name='tempest-keypair-1672182613',keypairs=<?>,launch_index=0,launched_at=2023-11-13T18:48:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e76353a038ca478598ddd984f4503e34',ramdisk_id='',reservation_id='r-n2dzdbze',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-689881972',owner_user_name='tempest-ServerStableDeviceRescueTest-689881972-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T18:50:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b114ba28a4124b14a9376346953075bf',uuid=9b078f75-57f2-495a-abd5-f8adf72db80b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "96bda2a6-53d1-4052-9230-4907fe60d70b", "address": "fa:16:3e:30:88:c4", "network": {"id": "eac74a7f-b8a0-4653-82a9-1113186e7682", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1781360101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e76353a038ca478598ddd984f4503e34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96bda2a6-53", "ovs_interfaceid": "96bda2a6-53d1-4052-9230-4907fe60d70b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 18:52:02 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-2454a3c4-a853-4d20-8c6c-5be0de2e2b74 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] Converting VIF {"id": "96bda2a6-53d1-4052-9230-4907fe60d70b", "address": "fa:16:3e:30:88:c4", "network": {"id": "eac74a7f-b8a0-4653-82a9-1113186e7682", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1781360101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e76353a038ca478598ddd984f4503e34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96bda2a6-53", "ovs_interfaceid": "96bda2a6-53d1-4052-9230-4907fe60d70b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 18:52:02 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-2454a3c4-a853-4d20-8c6c-5be0de2e2b74 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:88:c4,bridge_name='br-int',has_traffic_filtering=True,id=96bda2a6-53d1-4052-9230-4907fe60d70b,network=Network(eac74a7f-b8a0-4653-82a9-1113186e7682),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96bda2a6-53') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 18:52:02 user nova-compute[75216]: DEBUG os_vif [None req-2454a3c4-a853-4d20-8c6c-5be0de2e2b74 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:88:c4,bridge_name='br-int',has_traffic_filtering=True,id=96bda2a6-53d1-4052-9230-4907fe60d70b,network=Network(eac74a7f-b8a0-4653-82a9-1113186e7682),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96bda2a6-53') {{(pid=75216) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 18:52:02 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:52:02 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:52:02 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:52:02 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap96bda2a6-53, bridge=br-int, if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:52:02 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:52:02 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:52:02 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:52:02 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:52:02 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e00df094-82cc-482b-8b31-ef193e5d0771) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:52:02 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:52:02 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:52:02 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:52:02 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9364d39d-6774-4e15-ade6-41de231b093b) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:52:02 user nova-compute[75216]: INFO os_vif [None req-fb0f6557-2fa3-4fc2-b12b-3d7184b65006 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:96:a6:55,bridge_name='br-int',has_traffic_filtering=True,id=87a8f08d-9d26-49e7-9111-8758d3bbcf2f,network=Network(78d34574-c9cb-4054-9b54-15ab42a41a6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87a8f08d-9d')
Nov 13 18:52:02 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-fb0f6557-2fa3-4fc2-b12b-3d7184b65006 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] [instance: e1350bc4-558a-40ac-91e5-96da24f154f5] Deleting instance files /opt/stack/data/nova/instances/e1350bc4-558a-40ac-91e5-96da24f154f5_del
Nov 13 18:52:02 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-fb0f6557-2fa3-4fc2-b12b-3d7184b65006 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] [instance: e1350bc4-558a-40ac-91e5-96da24f154f5] Deletion of /opt/stack/data/nova/instances/e1350bc4-558a-40ac-91e5-96da24f154f5_del complete
Nov 13 18:52:02 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:52:02 user nova-compute[75216]: INFO os_vif [None req-2454a3c4-a853-4d20-8c6c-5be0de2e2b74 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:88:c4,bridge_name='br-int',has_traffic_filtering=True,id=96bda2a6-53d1-4052-9230-4907fe60d70b,network=Network(eac74a7f-b8a0-4653-82a9-1113186e7682),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96bda2a6-53')
Nov 13 18:52:02 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-2454a3c4-a853-4d20-8c6c-5be0de2e2b74 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] [instance: 9b078f75-57f2-495a-abd5-f8adf72db80b] Deleting instance files /opt/stack/data/nova/instances/9b078f75-57f2-495a-abd5-f8adf72db80b_del
Nov 13 18:52:02 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-2454a3c4-a853-4d20-8c6c-5be0de2e2b74 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] [instance: 9b078f75-57f2-495a-abd5-f8adf72db80b] Deletion of /opt/stack/data/nova/instances/9b078f75-57f2-495a-abd5-f8adf72db80b_del complete
Nov 13 18:52:02 user nova-compute[75216]: INFO nova.compute.manager [None req-fb0f6557-2fa3-4fc2-b12b-3d7184b65006 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] [instance: e1350bc4-558a-40ac-91e5-96da24f154f5] Took 1.33 seconds to destroy the instance on the hypervisor.
Nov 13 18:52:02 user nova-compute[75216]: DEBUG oslo.service.loopingcall [None req-fb0f6557-2fa3-4fc2-b12b-3d7184b65006 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75216) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 18:52:02 user nova-compute[75216]: DEBUG nova.compute.manager [-] [instance: e1350bc4-558a-40ac-91e5-96da24f154f5] Deallocating network for instance {{(pid=75216) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 18:52:02 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: e1350bc4-558a-40ac-91e5-96da24f154f5] deallocate_for_instance() {{(pid=75216) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 18:52:02 user nova-compute[75216]: INFO nova.compute.manager [None req-2454a3c4-a853-4d20-8c6c-5be0de2e2b74 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] [instance: 9b078f75-57f2-495a-abd5-f8adf72db80b] Took 0.97 seconds to destroy the instance on the hypervisor.
Nov 13 18:52:02 user nova-compute[75216]: DEBUG oslo.service.loopingcall [None req-2454a3c4-a853-4d20-8c6c-5be0de2e2b74 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75216) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 18:52:02 user nova-compute[75216]: DEBUG nova.compute.manager [-] [instance: 9b078f75-57f2-495a-abd5-f8adf72db80b] Deallocating network for instance {{(pid=75216) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 18:52:02 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: 9b078f75-57f2-495a-abd5-f8adf72db80b] deallocate_for_instance() {{(pid=75216) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 18:52:03 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:52:03 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: 9b078f75-57f2-495a-abd5-f8adf72db80b] Updating instance_info_cache with network_info: [] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 18:52:03 user nova-compute[75216]: INFO nova.compute.manager [-] [instance: 9b078f75-57f2-495a-abd5-f8adf72db80b] Took 0.91 seconds to deallocate network for instance.
Nov 13 18:52:03 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-2454a3c4-a853-4d20-8c6c-5be0de2e2b74 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:52:03 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-2454a3c4-a853-4d20-8c6c-5be0de2e2b74 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:52:03 user nova-compute[75216]: DEBUG nova.compute.manager [req-f0b238e1-af88-4ac7-b06e-3c1eba4dd230 req-ee38b7af-5f32-484a-88ef-78f1732e246f service nova] [instance: e1350bc4-558a-40ac-91e5-96da24f154f5] Received event network-vif-plugged-87a8f08d-9d26-49e7-9111-8758d3bbcf2f {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:52:03 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-f0b238e1-af88-4ac7-b06e-3c1eba4dd230 req-ee38b7af-5f32-484a-88ef-78f1732e246f service nova] Acquiring lock "e1350bc4-558a-40ac-91e5-96da24f154f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:52:03 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-f0b238e1-af88-4ac7-b06e-3c1eba4dd230 req-ee38b7af-5f32-484a-88ef-78f1732e246f service nova] Lock "e1350bc4-558a-40ac-91e5-96da24f154f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:52:03 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-f0b238e1-af88-4ac7-b06e-3c1eba4dd230 req-ee38b7af-5f32-484a-88ef-78f1732e246f service nova] Lock "e1350bc4-558a-40ac-91e5-96da24f154f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:52:03 user nova-compute[75216]: DEBUG nova.compute.manager [req-f0b238e1-af88-4ac7-b06e-3c1eba4dd230 req-ee38b7af-5f32-484a-88ef-78f1732e246f service nova] [instance: e1350bc4-558a-40ac-91e5-96da24f154f5] No waiting events found dispatching network-vif-plugged-87a8f08d-9d26-49e7-9111-8758d3bbcf2f {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:52:03 user nova-compute[75216]: WARNING nova.compute.manager [req-f0b238e1-af88-4ac7-b06e-3c1eba4dd230 req-ee38b7af-5f32-484a-88ef-78f1732e246f service nova] [instance: e1350bc4-558a-40ac-91e5-96da24f154f5] Received unexpected event network-vif-plugged-87a8f08d-9d26-49e7-9111-8758d3bbcf2f for instance with vm_state active and task_state deleting.
Nov 13 18:52:03 user nova-compute[75216]: DEBUG nova.compute.manager [req-f0b238e1-af88-4ac7-b06e-3c1eba4dd230 req-ee38b7af-5f32-484a-88ef-78f1732e246f service nova] [instance: e1350bc4-558a-40ac-91e5-96da24f154f5] Received event network-vif-plugged-87a8f08d-9d26-49e7-9111-8758d3bbcf2f {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:52:03 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-f0b238e1-af88-4ac7-b06e-3c1eba4dd230 req-ee38b7af-5f32-484a-88ef-78f1732e246f service nova] Acquiring lock "e1350bc4-558a-40ac-91e5-96da24f154f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:52:03 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-f0b238e1-af88-4ac7-b06e-3c1eba4dd230 req-ee38b7af-5f32-484a-88ef-78f1732e246f service nova] Lock "e1350bc4-558a-40ac-91e5-96da24f154f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:52:03 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-f0b238e1-af88-4ac7-b06e-3c1eba4dd230 req-ee38b7af-5f32-484a-88ef-78f1732e246f service nova] Lock "e1350bc4-558a-40ac-91e5-96da24f154f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:52:03 user nova-compute[75216]: DEBUG nova.compute.manager [req-f0b238e1-af88-4ac7-b06e-3c1eba4dd230 req-ee38b7af-5f32-484a-88ef-78f1732e246f service nova] [instance: e1350bc4-558a-40ac-91e5-96da24f154f5] No waiting events found dispatching network-vif-plugged-87a8f08d-9d26-49e7-9111-8758d3bbcf2f {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:52:03 user nova-compute[75216]: WARNING nova.compute.manager [req-f0b238e1-af88-4ac7-b06e-3c1eba4dd230 req-ee38b7af-5f32-484a-88ef-78f1732e246f service nova] [instance: e1350bc4-558a-40ac-91e5-96da24f154f5] Received unexpected event network-vif-plugged-87a8f08d-9d26-49e7-9111-8758d3bbcf2f for instance with vm_state active and task_state deleting.
Nov 13 18:52:03 user nova-compute[75216]: DEBUG nova.compute.manager [req-f0b238e1-af88-4ac7-b06e-3c1eba4dd230 req-ee38b7af-5f32-484a-88ef-78f1732e246f service nova] [instance: e1350bc4-558a-40ac-91e5-96da24f154f5] Received event network-vif-plugged-87a8f08d-9d26-49e7-9111-8758d3bbcf2f {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:52:03 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-f0b238e1-af88-4ac7-b06e-3c1eba4dd230 req-ee38b7af-5f32-484a-88ef-78f1732e246f service nova] Acquiring lock "e1350bc4-558a-40ac-91e5-96da24f154f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:52:03 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-f0b238e1-af88-4ac7-b06e-3c1eba4dd230 req-ee38b7af-5f32-484a-88ef-78f1732e246f service nova] Lock "e1350bc4-558a-40ac-91e5-96da24f154f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:52:03 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-f0b238e1-af88-4ac7-b06e-3c1eba4dd230 req-ee38b7af-5f32-484a-88ef-78f1732e246f service nova] Lock "e1350bc4-558a-40ac-91e5-96da24f154f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:52:03 user nova-compute[75216]: DEBUG nova.compute.manager [req-f0b238e1-af88-4ac7-b06e-3c1eba4dd230 req-ee38b7af-5f32-484a-88ef-78f1732e246f service nova] [instance: e1350bc4-558a-40ac-91e5-96da24f154f5] No waiting events found dispatching network-vif-plugged-87a8f08d-9d26-49e7-9111-8758d3bbcf2f {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:52:03 user nova-compute[75216]: WARNING nova.compute.manager [req-f0b238e1-af88-4ac7-b06e-3c1eba4dd230 req-ee38b7af-5f32-484a-88ef-78f1732e246f service nova] [instance: e1350bc4-558a-40ac-91e5-96da24f154f5] Received unexpected event network-vif-plugged-87a8f08d-9d26-49e7-9111-8758d3bbcf2f for instance with vm_state active and task_state deleting.
Nov 13 18:52:03 user nova-compute[75216]: DEBUG nova.compute.manager [req-f0b238e1-af88-4ac7-b06e-3c1eba4dd230 req-ee38b7af-5f32-484a-88ef-78f1732e246f service nova] [instance: e1350bc4-558a-40ac-91e5-96da24f154f5] Received event network-vif-unplugged-87a8f08d-9d26-49e7-9111-8758d3bbcf2f {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:52:03 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-f0b238e1-af88-4ac7-b06e-3c1eba4dd230 req-ee38b7af-5f32-484a-88ef-78f1732e246f service nova] Acquiring lock "e1350bc4-558a-40ac-91e5-96da24f154f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:52:03 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-f0b238e1-af88-4ac7-b06e-3c1eba4dd230 req-ee38b7af-5f32-484a-88ef-78f1732e246f service nova] Lock "e1350bc4-558a-40ac-91e5-96da24f154f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:52:03 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-f0b238e1-af88-4ac7-b06e-3c1eba4dd230 req-ee38b7af-5f32-484a-88ef-78f1732e246f service nova] Lock "e1350bc4-558a-40ac-91e5-96da24f154f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:52:03 user nova-compute[75216]: DEBUG nova.compute.manager [req-f0b238e1-af88-4ac7-b06e-3c1eba4dd230 req-ee38b7af-5f32-484a-88ef-78f1732e246f service nova] [instance: e1350bc4-558a-40ac-91e5-96da24f154f5] No waiting events found dispatching network-vif-unplugged-87a8f08d-9d26-49e7-9111-8758d3bbcf2f {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:52:03 user nova-compute[75216]: DEBUG nova.compute.manager [req-f0b238e1-af88-4ac7-b06e-3c1eba4dd230 req-ee38b7af-5f32-484a-88ef-78f1732e246f service nova] [instance: e1350bc4-558a-40ac-91e5-96da24f154f5] Received event network-vif-unplugged-87a8f08d-9d26-49e7-9111-8758d3bbcf2f for instance with task_state deleting. {{(pid=75216) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 18:52:03 user nova-compute[75216]: DEBUG nova.compute.manager [req-f0b238e1-af88-4ac7-b06e-3c1eba4dd230 req-ee38b7af-5f32-484a-88ef-78f1732e246f service nova] [instance: e1350bc4-558a-40ac-91e5-96da24f154f5] Received event network-vif-plugged-87a8f08d-9d26-49e7-9111-8758d3bbcf2f {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:52:03 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-f0b238e1-af88-4ac7-b06e-3c1eba4dd230 req-ee38b7af-5f32-484a-88ef-78f1732e246f service nova] Acquiring lock "e1350bc4-558a-40ac-91e5-96da24f154f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:52:03 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-f0b238e1-af88-4ac7-b06e-3c1eba4dd230 req-ee38b7af-5f32-484a-88ef-78f1732e246f service nova] Lock "e1350bc4-558a-40ac-91e5-96da24f154f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:52:03 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-f0b238e1-af88-4ac7-b06e-3c1eba4dd230 req-ee38b7af-5f32-484a-88ef-78f1732e246f service nova] Lock "e1350bc4-558a-40ac-91e5-96da24f154f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:52:03 user nova-compute[75216]: DEBUG nova.compute.manager [req-f0b238e1-af88-4ac7-b06e-3c1eba4dd230 req-ee38b7af-5f32-484a-88ef-78f1732e246f service nova] [instance: e1350bc4-558a-40ac-91e5-96da24f154f5] No waiting events found dispatching network-vif-plugged-87a8f08d-9d26-49e7-9111-8758d3bbcf2f {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:52:03 user nova-compute[75216]: WARNING nova.compute.manager [req-f0b238e1-af88-4ac7-b06e-3c1eba4dd230 req-ee38b7af-5f32-484a-88ef-78f1732e246f service nova] [instance: e1350bc4-558a-40ac-91e5-96da24f154f5] Received unexpected event network-vif-plugged-87a8f08d-9d26-49e7-9111-8758d3bbcf2f for instance with vm_state active and task_state deleting.
Nov 13 18:52:03 user nova-compute[75216]: DEBUG nova.compute.manager [req-a572d061-9365-47b4-8986-b74acd290a7d req-d06f6b38-3b2b-4fce-a026-14fa04ab66ea service nova] [instance: 14d378b0-79ba-4161-a795-6288939c6fef] Received event network-vif-plugged-7ac04b47-1761-46fb-8193-7eb1dd278710 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:52:03 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-a572d061-9365-47b4-8986-b74acd290a7d req-d06f6b38-3b2b-4fce-a026-14fa04ab66ea service nova] Acquiring lock "14d378b0-79ba-4161-a795-6288939c6fef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:52:03 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-a572d061-9365-47b4-8986-b74acd290a7d req-d06f6b38-3b2b-4fce-a026-14fa04ab66ea service nova] Lock "14d378b0-79ba-4161-a795-6288939c6fef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:52:03 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-a572d061-9365-47b4-8986-b74acd290a7d req-d06f6b38-3b2b-4fce-a026-14fa04ab66ea service nova] Lock "14d378b0-79ba-4161-a795-6288939c6fef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:52:03 user nova-compute[75216]: DEBUG nova.compute.manager [req-a572d061-9365-47b4-8986-b74acd290a7d req-d06f6b38-3b2b-4fce-a026-14fa04ab66ea service nova] [instance: 14d378b0-79ba-4161-a795-6288939c6fef] No waiting events found dispatching network-vif-plugged-7ac04b47-1761-46fb-8193-7eb1dd278710 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:52:03 user nova-compute[75216]: WARNING nova.compute.manager [req-a572d061-9365-47b4-8986-b74acd290a7d req-d06f6b38-3b2b-4fce-a026-14fa04ab66ea service nova] [instance: 14d378b0-79ba-4161-a795-6288939c6fef] Received unexpected event network-vif-plugged-7ac04b47-1761-46fb-8193-7eb1dd278710 for instance with vm_state building and task_state spawning.
Nov 13 18:52:03 user nova-compute[75216]: DEBUG nova.compute.manager [req-a572d061-9365-47b4-8986-b74acd290a7d req-d06f6b38-3b2b-4fce-a026-14fa04ab66ea service nova] [instance: 9b078f75-57f2-495a-abd5-f8adf72db80b] Received event network-vif-unplugged-96bda2a6-53d1-4052-9230-4907fe60d70b {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:52:03 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-a572d061-9365-47b4-8986-b74acd290a7d req-d06f6b38-3b2b-4fce-a026-14fa04ab66ea service nova] Acquiring lock "9b078f75-57f2-495a-abd5-f8adf72db80b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:52:03 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-a572d061-9365-47b4-8986-b74acd290a7d req-d06f6b38-3b2b-4fce-a026-14fa04ab66ea service nova] Lock "9b078f75-57f2-495a-abd5-f8adf72db80b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:52:03 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-a572d061-9365-47b4-8986-b74acd290a7d req-d06f6b38-3b2b-4fce-a026-14fa04ab66ea service nova] Lock "9b078f75-57f2-495a-abd5-f8adf72db80b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:52:03 user nova-compute[75216]: DEBUG nova.compute.manager [req-a572d061-9365-47b4-8986-b74acd290a7d req-d06f6b38-3b2b-4fce-a026-14fa04ab66ea service nova] [instance: 9b078f75-57f2-495a-abd5-f8adf72db80b] No waiting events found dispatching network-vif-unplugged-96bda2a6-53d1-4052-9230-4907fe60d70b {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:52:03 user nova-compute[75216]: WARNING nova.compute.manager [req-a572d061-9365-47b4-8986-b74acd290a7d req-d06f6b38-3b2b-4fce-a026-14fa04ab66ea service nova] [instance: 9b078f75-57f2-495a-abd5-f8adf72db80b] Received unexpected event network-vif-unplugged-96bda2a6-53d1-4052-9230-4907fe60d70b for instance with vm_state deleted and task_state None.
Nov 13 18:52:03 user nova-compute[75216]: DEBUG nova.compute.manager [req-a572d061-9365-47b4-8986-b74acd290a7d req-d06f6b38-3b2b-4fce-a026-14fa04ab66ea service nova] [instance: 9b078f75-57f2-495a-abd5-f8adf72db80b] Received event network-vif-plugged-96bda2a6-53d1-4052-9230-4907fe60d70b {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:52:03 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-a572d061-9365-47b4-8986-b74acd290a7d req-d06f6b38-3b2b-4fce-a026-14fa04ab66ea service nova] Acquiring lock "9b078f75-57f2-495a-abd5-f8adf72db80b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:52:03 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-a572d061-9365-47b4-8986-b74acd290a7d req-d06f6b38-3b2b-4fce-a026-14fa04ab66ea service nova] Lock "9b078f75-57f2-495a-abd5-f8adf72db80b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:52:03 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-a572d061-9365-47b4-8986-b74acd290a7d req-d06f6b38-3b2b-4fce-a026-14fa04ab66ea service nova] Lock "9b078f75-57f2-495a-abd5-f8adf72db80b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:52:03 user nova-compute[75216]: DEBUG nova.compute.manager [req-a572d061-9365-47b4-8986-b74acd290a7d req-d06f6b38-3b2b-4fce-a026-14fa04ab66ea service nova] [instance: 9b078f75-57f2-495a-abd5-f8adf72db80b] No waiting events found dispatching network-vif-plugged-96bda2a6-53d1-4052-9230-4907fe60d70b {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:52:03 user nova-compute[75216]: WARNING nova.compute.manager [req-a572d061-9365-47b4-8986-b74acd290a7d req-d06f6b38-3b2b-4fce-a026-14fa04ab66ea service nova] [instance: 9b078f75-57f2-495a-abd5-f8adf72db80b] Received unexpected event network-vif-plugged-96bda2a6-53d1-4052-9230-4907fe60d70b for instance with vm_state deleted and task_state None.
Nov 13 18:52:03 user nova-compute[75216]: DEBUG nova.compute.manager [req-a572d061-9365-47b4-8986-b74acd290a7d req-d06f6b38-3b2b-4fce-a026-14fa04ab66ea service nova] [instance: 9b078f75-57f2-495a-abd5-f8adf72db80b] Received event network-vif-deleted-96bda2a6-53d1-4052-9230-4907fe60d70b {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:52:03 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: e1350bc4-558a-40ac-91e5-96da24f154f5] Updating instance_info_cache with network_info: [] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 18:52:03 user nova-compute[75216]: INFO nova.compute.manager [-] [instance: e1350bc4-558a-40ac-91e5-96da24f154f5] Took 1.21 seconds to deallocate network for instance.
Nov 13 18:52:03 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-2454a3c4-a853-4d20-8c6c-5be0de2e2b74 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 18:52:03 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-fb0f6557-2fa3-4fc2-b12b-3d7184b65006 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:52:03 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-2454a3c4-a853-4d20-8c6c-5be0de2e2b74 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 18:52:03 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-2454a3c4-a853-4d20-8c6c-5be0de2e2b74 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.341s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:52:03 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-fb0f6557-2fa3-4fc2-b12b-3d7184b65006 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.051s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:52:04 user nova-compute[75216]: INFO nova.scheduler.client.report [None req-2454a3c4-a853-4d20-8c6c-5be0de2e2b74 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] Deleted allocations for instance 9b078f75-57f2-495a-abd5-f8adf72db80b
Nov 13 18:52:04 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-2454a3c4-a853-4d20-8c6c-5be0de2e2b74 tempest-ServerStableDeviceRescueTest-689881972 tempest-ServerStableDeviceRescueTest-689881972-project-member] Lock "9b078f75-57f2-495a-abd5-f8adf72db80b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.431s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:52:04 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-fb0f6557-2fa3-4fc2-b12b-3d7184b65006 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 18:52:04 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-fb0f6557-2fa3-4fc2-b12b-3d7184b65006 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 18:52:04 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-fb0f6557-2fa3-4fc2-b12b-3d7184b65006 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.279s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:52:04 user nova-compute[75216]: INFO nova.scheduler.client.report [None req-fb0f6557-2fa3-4fc2-b12b-3d7184b65006 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] Deleted allocations for instance e1350bc4-558a-40ac-91e5-96da24f154f5
Nov 13 18:52:04 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-fb0f6557-2fa3-4fc2-b12b-3d7184b65006 tempest-AttachSCSIVolumeTestJSON-913042882 tempest-AttachSCSIVolumeTestJSON-913042882-project-member] Lock "e1350bc4-558a-40ac-91e5-96da24f154f5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.070s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:52:04 user nova-compute[75216]: DEBUG nova.compute.manager [None req-962c02e4-ecdc-4378-bf37-c79a8e828868 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] [instance: 14d378b0-79ba-4161-a795-6288939c6fef] Instance event wait completed in 0 seconds for  {{(pid=75216) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 18:52:04 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-962c02e4-ecdc-4378-bf37-c79a8e828868 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] [instance: 14d378b0-79ba-4161-a795-6288939c6fef] Guest created on hypervisor {{(pid=75216) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 18:52:04 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 14d378b0-79ba-4161-a795-6288939c6fef] Instance spawned successfully.
Nov 13 18:52:04 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-962c02e4-ecdc-4378-bf37-c79a8e828868 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] [instance: 14d378b0-79ba-4161-a795-6288939c6fef] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 18:52:04 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-962c02e4-ecdc-4378-bf37-c79a8e828868 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] [instance: 14d378b0-79ba-4161-a795-6288939c6fef] Found default for hw_cdrom_bus of ide {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 18:52:04 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-962c02e4-ecdc-4378-bf37-c79a8e828868 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] [instance: 14d378b0-79ba-4161-a795-6288939c6fef] Found default for hw_disk_bus of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 18:52:04 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-962c02e4-ecdc-4378-bf37-c79a8e828868 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] [instance: 14d378b0-79ba-4161-a795-6288939c6fef] Found default for hw_input_bus of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 18:52:04 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-962c02e4-ecdc-4378-bf37-c79a8e828868 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] [instance: 14d378b0-79ba-4161-a795-6288939c6fef] Found default for hw_pointer_model of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 18:52:04 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-962c02e4-ecdc-4378-bf37-c79a8e828868 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] [instance: 14d378b0-79ba-4161-a795-6288939c6fef] Found default for hw_video_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 18:52:04 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-962c02e4-ecdc-4378-bf37-c79a8e828868 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] [instance: 14d378b0-79ba-4161-a795-6288939c6fef] Found default for hw_vif_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 18:52:04 user nova-compute[75216]: INFO nova.compute.manager [None req-962c02e4-ecdc-4378-bf37-c79a8e828868 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] [instance: 14d378b0-79ba-4161-a795-6288939c6fef] Took 6.35 seconds to spawn the instance on the hypervisor.
Nov 13 18:52:04 user nova-compute[75216]: DEBUG nova.compute.manager [None req-962c02e4-ecdc-4378-bf37-c79a8e828868 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] [instance: 14d378b0-79ba-4161-a795-6288939c6fef] Checking state {{(pid=75216) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 18:52:04 user nova-compute[75216]: INFO nova.compute.manager [None req-962c02e4-ecdc-4378-bf37-c79a8e828868 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] [instance: 14d378b0-79ba-4161-a795-6288939c6fef] Took 7.00 seconds to build instance.
Nov 13 18:52:04 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-962c02e4-ecdc-4378-bf37-c79a8e828868 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] Lock "14d378b0-79ba-4161-a795-6288939c6fef" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.087s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:52:05 user nova-compute[75216]: DEBUG nova.compute.manager [req-d9c134fb-1f62-4024-ac08-ca3fb20ee68a req-cb916a77-8809-4bbc-8e50-3993730cb682 service nova] [instance: e1350bc4-558a-40ac-91e5-96da24f154f5] Received event network-vif-deleted-87a8f08d-9d26-49e7-9111-8758d3bbcf2f {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:52:07 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:52:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:52:12 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:52:13 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:52:16 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:52:17 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:52:18 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:52:19 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:52:22 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:52:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:52:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:52:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:52:26 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:52:27 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:52:28 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-03c677a8-b56e-46fe-b386-96ebd424bd91 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Acquiring lock "f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:52:28 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-03c677a8-b56e-46fe-b386-96ebd424bd91 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Lock "f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:52:28 user nova-compute[75216]: DEBUG nova.compute.manager [None req-03c677a8-b56e-46fe-b386-96ebd424bd91 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1] Starting instance... {{(pid=75216) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 18:52:28 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-03c677a8-b56e-46fe-b386-96ebd424bd91 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:52:28 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-03c677a8-b56e-46fe-b386-96ebd424bd91 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:52:28 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-03c677a8-b56e-46fe-b386-96ebd424bd91 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75216) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 18:52:28 user nova-compute[75216]: INFO nova.compute.claims [None req-03c677a8-b56e-46fe-b386-96ebd424bd91 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1] Claim successful on node user
Nov 13 18:52:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:52:28 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-03c677a8-b56e-46fe-b386-96ebd424bd91 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 18:52:28 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-03c677a8-b56e-46fe-b386-96ebd424bd91 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 18:52:28 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-03c677a8-b56e-46fe-b386-96ebd424bd91 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.357s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:52:28 user nova-compute[75216]: DEBUG nova.compute.manager [None req-03c677a8-b56e-46fe-b386-96ebd424bd91 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1] Start building networks asynchronously for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 18:52:28 user nova-compute[75216]: DEBUG nova.compute.manager [None req-03c677a8-b56e-46fe-b386-96ebd424bd91 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1] Allocating IP information in the background. {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 18:52:28 user nova-compute[75216]: DEBUG nova.network.neutron [None req-03c677a8-b56e-46fe-b386-96ebd424bd91 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1] allocate_for_instance() {{(pid=75216) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 18:52:28 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-03c677a8-b56e-46fe-b386-96ebd424bd91 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 18:52:28 user nova-compute[75216]: DEBUG nova.compute.manager [None req-03c677a8-b56e-46fe-b386-96ebd424bd91 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1] Start building block device mappings for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 18:52:29 user nova-compute[75216]: DEBUG nova.policy [None req-03c677a8-b56e-46fe-b386-96ebd424bd91 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b381ea98871846b1bfb29a202a058208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '903397a6c0474cfd8bd1a4fb338528aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75216) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 18:52:29 user nova-compute[75216]: DEBUG nova.compute.manager [None req-03c677a8-b56e-46fe-b386-96ebd424bd91 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1] Start spawning the instance on the hypervisor. {{(pid=75216) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 18:52:29 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-03c677a8-b56e-46fe-b386-96ebd424bd91 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1] Creating instance directory {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 18:52:29 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-03c677a8-b56e-46fe-b386-96ebd424bd91 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1] Creating image(s)
Nov 13 18:52:29 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-03c677a8-b56e-46fe-b386-96ebd424bd91 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Acquiring lock "/opt/stack/data/nova/instances/f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:52:29 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-03c677a8-b56e-46fe-b386-96ebd424bd91 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Lock "/opt/stack/data/nova/instances/f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:52:29 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-03c677a8-b56e-46fe-b386-96ebd424bd91 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Lock "/opt/stack/data/nova/instances/f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:52:29 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-03c677a8-b56e-46fe-b386-96ebd424bd91 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:52:29 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e9a0a26d-f7ce-4fb2-ad6b-ef24d3bdfeff tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] Acquiring lock "3679beb0-5244-443a-8512-38b29ccb62f0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:52:29 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e9a0a26d-f7ce-4fb2-ad6b-ef24d3bdfeff tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] Lock "3679beb0-5244-443a-8512-38b29ccb62f0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:52:29 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e9a0a26d-f7ce-4fb2-ad6b-ef24d3bdfeff tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] Acquiring lock "3679beb0-5244-443a-8512-38b29ccb62f0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:52:29 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e9a0a26d-f7ce-4fb2-ad6b-ef24d3bdfeff tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] Lock "3679beb0-5244-443a-8512-38b29ccb62f0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:52:29 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e9a0a26d-f7ce-4fb2-ad6b-ef24d3bdfeff tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] Lock "3679beb0-5244-443a-8512-38b29ccb62f0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:52:29 user nova-compute[75216]: INFO nova.compute.manager [None req-e9a0a26d-f7ce-4fb2-ad6b-ef24d3bdfeff tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] [instance: 3679beb0-5244-443a-8512-38b29ccb62f0] Terminating instance
Nov 13 18:52:29 user nova-compute[75216]: DEBUG nova.compute.manager [None req-e9a0a26d-f7ce-4fb2-ad6b-ef24d3bdfeff tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] [instance: 3679beb0-5244-443a-8512-38b29ccb62f0] Start destroying the instance on the hypervisor. {{(pid=75216) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 18:52:29 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-03c677a8-b56e-46fe-b386-96ebd424bd91 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json" returned: 0 in 0.186s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:52:29 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-03c677a8-b56e-46fe-b386-96ebd424bd91 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Acquiring lock "88c50a45bec9d6b0427462b3242b9b8e5f49c2b6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:52:29 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-03c677a8-b56e-46fe-b386-96ebd424bd91 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Lock "88c50a45bec9d6b0427462b3242b9b8e5f49c2b6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:52:29 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-03c677a8-b56e-46fe-b386-96ebd424bd91 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:52:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:52:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:52:29 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-03c677a8-b56e-46fe-b386-96ebd424bd91 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json" returned: 0 in 0.186s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:52:29 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-03c677a8-b56e-46fe-b386-96ebd424bd91 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6,backing_fmt=raw /opt/stack/data/nova/instances/f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1/disk 1073741824 {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:52:29 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-03c677a8-b56e-46fe-b386-96ebd424bd91 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6,backing_fmt=raw /opt/stack/data/nova/instances/f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1/disk 1073741824" returned: 0 in 0.048s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:52:29 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-03c677a8-b56e-46fe-b386-96ebd424bd91 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Lock "88c50a45bec9d6b0427462b3242b9b8e5f49c2b6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:52:29 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-03c677a8-b56e-46fe-b386-96ebd424bd91 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:52:29 user nova-compute[75216]: DEBUG nova.network.neutron [None req-03c677a8-b56e-46fe-b386-96ebd424bd91 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1] Successfully created port: 5419f8b4-31da-434a-b131-6476134a71bf {{(pid=75216) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 18:52:29 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-03c677a8-b56e-46fe-b386-96ebd424bd91 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json" returned: 0 in 0.190s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:52:29 user nova-compute[75216]: DEBUG nova.virt.disk.api [None req-03c677a8-b56e-46fe-b386-96ebd424bd91 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1/disk. size=1073741824 {{(pid=75216) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 18:52:29 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-03c677a8-b56e-46fe-b386-96ebd424bd91 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:52:29 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-03c677a8-b56e-46fe-b386-96ebd424bd91 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:52:29 user nova-compute[75216]: DEBUG nova.virt.disk.api [None req-03c677a8-b56e-46fe-b386-96ebd424bd91 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Cannot resize image /opt/stack/data/nova/instances/f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1/disk to a smaller size. {{(pid=75216) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 18:52:29 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-03c677a8-b56e-46fe-b386-96ebd424bd91 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1] Created local disks {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 18:52:29 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-03c677a8-b56e-46fe-b386-96ebd424bd91 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1] Ensure instance console log exists: /opt/stack/data/nova/instances/f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1/console.log {{(pid=75216) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 18:52:29 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-03c677a8-b56e-46fe-b386-96ebd424bd91 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:52:29 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-03c677a8-b56e-46fe-b386-96ebd424bd91 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:52:29 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-03c677a8-b56e-46fe-b386-96ebd424bd91 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:52:29 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 3679beb0-5244-443a-8512-38b29ccb62f0] Instance destroyed successfully.
Nov 13 18:52:29 user nova-compute[75216]: DEBUG nova.objects.instance [None req-e9a0a26d-f7ce-4fb2-ad6b-ef24d3bdfeff tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] Lazy-loading 'resources' on Instance uuid 3679beb0-5244-443a-8512-38b29ccb62f0 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 18:52:29 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-e9a0a26d-f7ce-4fb2-ad6b-ef24d3bdfeff tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-13T18:48:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1810454113',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1139702488',id=16,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMERu/g7S2xD4fYqmzFAJXYDR7hKcSuIXV2v7GsKW6Fvu41/rKIsCoqYwYjeLuX+94gqfUJqutarG8qQbb/uJ1X4T/7CELwQc16iiSCVbNPYMOIZbGoMv5QgSdk5IEn2iA==',key_name='tempest-keypair-810733778',keypairs=<?>,launch_index=0,launched_at=2023-11-13T18:51:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f28b10790a0548b785d2242360d631b1',ramdisk_id='',reservation_id='r-gqrzdq0g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-980167634',owner_user_name='tempest-ServerActionsV293TestJSON-980167634-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T18:51:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b245d24d053e4504baa2670a3fe0b2b1',uuid=3679beb0-5244-443a-8512-38b29ccb62f0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9dd60454-c5ac-4afe-b6fc-ad9ba9b83423", "address": "fa:16:3e:f0:11:a2", "network": {"id": "36f9d4ef-d504-457e-be5c-873fd634988f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-998310827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f28b10790a0548b785d2242360d631b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dd60454-c5", "ovs_interfaceid": "9dd60454-c5ac-4afe-b6fc-ad9ba9b83423", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 18:52:29 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-e9a0a26d-f7ce-4fb2-ad6b-ef24d3bdfeff tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] Converting VIF {"id": "9dd60454-c5ac-4afe-b6fc-ad9ba9b83423", "address": "fa:16:3e:f0:11:a2", "network": {"id": "36f9d4ef-d504-457e-be5c-873fd634988f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-998310827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f28b10790a0548b785d2242360d631b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dd60454-c5", "ovs_interfaceid": "9dd60454-c5ac-4afe-b6fc-ad9ba9b83423", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 18:52:29 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-e9a0a26d-f7ce-4fb2-ad6b-ef24d3bdfeff tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f0:11:a2,bridge_name='br-int',has_traffic_filtering=True,id=9dd60454-c5ac-4afe-b6fc-ad9ba9b83423,network=Network(36f9d4ef-d504-457e-be5c-873fd634988f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9dd60454-c5') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 18:52:29 user nova-compute[75216]: DEBUG os_vif [None req-e9a0a26d-f7ce-4fb2-ad6b-ef24d3bdfeff tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f0:11:a2,bridge_name='br-int',has_traffic_filtering=True,id=9dd60454-c5ac-4afe-b6fc-ad9ba9b83423,network=Network(36f9d4ef-d504-457e-be5c-873fd634988f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9dd60454-c5') {{(pid=75216) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 18:52:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:52:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9dd60454-c5, bridge=br-int, if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:52:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:52:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:52:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:52:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=da21da7d-5b88-4392-857c-8c554d1adf9b) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:52:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:52:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:52:29 user nova-compute[75216]: INFO os_vif [None req-e9a0a26d-f7ce-4fb2-ad6b-ef24d3bdfeff tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f0:11:a2,bridge_name='br-int',has_traffic_filtering=True,id=9dd60454-c5ac-4afe-b6fc-ad9ba9b83423,network=Network(36f9d4ef-d504-457e-be5c-873fd634988f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9dd60454-c5')
Nov 13 18:52:29 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e9a0a26d-f7ce-4fb2-ad6b-ef24d3bdfeff tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] [instance: 3679beb0-5244-443a-8512-38b29ccb62f0] calling os-brick to detach iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 18:52:29 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9a0a26d-f7ce-4fb2-ad6b-ef24d3bdfeff tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3a8669e40>, {'target_iqn': 'iqn.2010-10.org.openstack:ae66a157-b0d3-4501-a728-a010d6a83a10', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'buEowZlO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 18:52:29 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-e9a0a26d-f7ce-4fb2-ad6b-ef24d3bdfeff tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 18:52:29 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-e9a0a26d-f7ce-4fb2-ad6b-ef24d3bdfeff tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 18:52:29 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-e9a0a26d-f7ce-4fb2-ad6b-ef24d3bdfeff tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 18:52:29 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:52:29 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:52:29 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[de71e1b5-2006-4b29-bfe9-2060a362384c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6c711796-fc49-4e18-8fdd-eefe1e3b357c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ae66a157-b0d3-4501-a728-a010d6a83a10\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:52:29 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9a0a26d-f7ce-4fb2-ad6b-ef24d3bdfeff tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 18:52:29 user nova-compute[75216]: No targets found.
Nov 13 18:52:29 user nova-compute[75216]: iSNS:
Nov 13 18:52:29 user nova-compute[75216]: No targets found.
Nov 13 18:52:29 user nova-compute[75216]: STATIC:
Nov 13 18:52:29 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:6c711796-fc49-4e18-8fdd-eefe1e3b357c
Nov 13 18:52:29 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 18:52:29 user nova-compute[75216]:                 Iface Name: default
Nov 13 18:52:29 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:ae66a157-b0d3-4501-a728-a010d6a83a10
Nov 13 18:52:29 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 18:52:29 user nova-compute[75216]:                 Iface Name: default
Nov 13 18:52:29 user nova-compute[75216]: FIRMWARE:
Nov 13 18:52:29 user nova-compute[75216]: No targets found.
Nov 13 18:52:29 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 18:52:29 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9a0a26d-f7ce-4fb2-ad6b-ef24d3bdfeff tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 18:52:29 user nova-compute[75216]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 18:52:29 user nova-compute[75216]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75216) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 18:52:29 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9a0a26d-f7ce-4fb2-ad6b-ef24d3bdfeff tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ae66a157-b0d3-4501-a728-a010d6a83a10', 0)] {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 18:52:29 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:52:29 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:52:29 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[0335459f-8f25-4298-b00c-c16453ea5c3e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6c711796-fc49-4e18-8fdd-eefe1e3b357c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ae66a157-b0d3-4501-a728-a010d6a83a10\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:52:29 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:52:30 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:52:30 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ebed98e-83e0-4ea4-86b5-35a1e465822c]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c711796-fc49-4e18-8fdd-eefe1e3b357c (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae66a157-b0d3-4501-a728-a010d6a83a10 (non-flash)\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:52:30 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9a0a26d-f7ce-4fb2-ad6b-ef24d3bdfeff tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c711796-fc49-4e18-8fdd-eefe1e3b357c (non-flash)
Nov 13 18:52:30 user nova-compute[75216]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae66a157-b0d3-4501-a728-a010d6a83a10 (non-flash)
Nov 13 18:52:30 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 18:52:30 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9a0a26d-f7ce-4fb2-ad6b-ef24d3bdfeff tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c711796-fc49-4e18-8fdd-eefe1e3b357c (non-flash)
Nov 13 18:52:30 user nova-compute[75216]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae66a157-b0d3-4501-a728-a010d6a83a10 (non-flash)
Nov 13 18:52:30 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 18:52:30 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9a0a26d-f7ce-4fb2-ad6b-ef24d3bdfeff tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe3a834ee60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ae66a157-b0d3-4501-a728-a010d6a83a10'): ({'sdc'}, set())}) {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 18:52:30 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-e9a0a26d-f7ce-4fb2-ad6b-ef24d3bdfeff tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] Removing single pathed devices sdc {{(pid=75216) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 18:52:30 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:52:30 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:52:30 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[66f3f85d-a0fb-4693-b25a-1510d64d3b8f]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:52:30 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:52:30 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:52:30 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d6f48da-6d78-4796-92e2-c8072d230d37]: (4, ('ok\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:52:30 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-e9a0a26d-f7ce-4fb2-ad6b-ef24d3bdfeff tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] Flushing IO for device /dev/sdc {{(pid=75216) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 18:52:30 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:52:30 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:52:30 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[704eb162-92f8-4d5c-8e1a-09d4692eac96]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:52:30 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-e9a0a26d-f7ce-4fb2-ad6b-ef24d3bdfeff tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75216) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 18:52:30 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:52:30 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:52:30 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[af120d18-e410-4d0e-bd8e-900c5c4c492c]: (4, ('1', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:52:30 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-e9a0a26d-f7ce-4fb2-ad6b-ef24d3bdfeff tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 18:52:30 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-e9a0a26d-f7ce-4fb2-ad6b-ef24d3bdfeff tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] SCSI volumes sdc have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 18:52:30 user nova-compute[75216]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26462643636356565', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_144bec1e', '/dev/disk/by-id/scsi-1SCST_BIO144bec1e-dbd665ee5a55068c') {{(pid=85984) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 13 18:52:30 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd130208-93a7-482f-9e7d-7509d2fd548d]: (4, None) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:52:30 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9a0a26d-f7ce-4fb2-ad6b-ef24d3bdfeff tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ae66a157-b0d3-4501-a728-a010d6a83a10')] {{(pid=75216) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 18:52:30 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae66a157-b0d3-4501-a728-a010d6a83a10 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:52:30 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae66a157-b0d3-4501-a728-a010d6a83a10 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:52:30 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4d5daae-d38a-4629-893c-80b7a59f8dac]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:52:30 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9a0a26d-f7ce-4fb2-ad6b-ef24d3bdfeff tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:52:30 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae66a157-b0d3-4501-a728-a010d6a83a10 -p 172.16.0.220:3260 --logout {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:52:30 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae66a157-b0d3-4501-a728-a010d6a83a10 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:52:30 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[d86db3d1-7711-4d64-9f3e-2412160de160]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:ae66a157-b0d3-4501-a728-a010d6a83a10, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:ae66a157-b0d3-4501-a728-a010d6a83a10, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:52:30 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9a0a26d-f7ce-4fb2-ad6b-ef24d3bdfeff tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:ae66a157-b0d3-4501-a728-a010d6a83a10, portal: 172.16.0.220,3260]
Nov 13 18:52:30 user nova-compute[75216]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:ae66a157-b0d3-4501-a728-a010d6a83a10, portal: 172.16.0.220,3260] successful.
Nov 13 18:52:30 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:52:30 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae66a157-b0d3-4501-a728-a010d6a83a10 -p 172.16.0.220:3260 --op delete {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:52:30 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae66a157-b0d3-4501-a728-a010d6a83a10 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:52:30 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbe3f942-9ae3-46c9-9a14-64ecf40f9942]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:52:30 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9a0a26d-f7ce-4fb2-ad6b-ef24d3bdfeff tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:52:30 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-e9a0a26d-f7ce-4fb2-ad6b-ef24d3bdfeff tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.296s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 18:52:30 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9a0a26d-f7ce-4fb2-ad6b-ef24d3bdfeff tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] <== disconnect_volume: return (297ms) None {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 18:52:30 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e9a0a26d-f7ce-4fb2-ad6b-ef24d3bdfeff tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] [instance: 3679beb0-5244-443a-8512-38b29ccb62f0] Disconnected iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 18:52:30 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-e9a0a26d-f7ce-4fb2-ad6b-ef24d3bdfeff tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] [instance: 3679beb0-5244-443a-8512-38b29ccb62f0] Deleting instance files /opt/stack/data/nova/instances/3679beb0-5244-443a-8512-38b29ccb62f0_del
Nov 13 18:52:30 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-e9a0a26d-f7ce-4fb2-ad6b-ef24d3bdfeff tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] [instance: 3679beb0-5244-443a-8512-38b29ccb62f0] Deletion of /opt/stack/data/nova/instances/3679beb0-5244-443a-8512-38b29ccb62f0_del complete
Nov 13 18:52:30 user nova-compute[75216]: INFO nova.compute.manager [None req-e9a0a26d-f7ce-4fb2-ad6b-ef24d3bdfeff tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] [instance: 3679beb0-5244-443a-8512-38b29ccb62f0] Took 1.17 seconds to destroy the instance on the hypervisor.
Nov 13 18:52:30 user nova-compute[75216]: DEBUG oslo.service.loopingcall [None req-e9a0a26d-f7ce-4fb2-ad6b-ef24d3bdfeff tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75216) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 18:52:30 user nova-compute[75216]: DEBUG nova.compute.manager [-] [instance: 3679beb0-5244-443a-8512-38b29ccb62f0] Deallocating network for instance {{(pid=75216) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 18:52:30 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: 3679beb0-5244-443a-8512-38b29ccb62f0] deallocate_for_instance() {{(pid=75216) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 18:52:30 user nova-compute[75216]: DEBUG nova.network.neutron [None req-03c677a8-b56e-46fe-b386-96ebd424bd91 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1] Successfully updated port: 5419f8b4-31da-434a-b131-6476134a71bf {{(pid=75216) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 18:52:30 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-03c677a8-b56e-46fe-b386-96ebd424bd91 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Acquiring lock "refresh_cache-f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 18:52:30 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-03c677a8-b56e-46fe-b386-96ebd424bd91 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Acquired lock "refresh_cache-f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 18:52:30 user nova-compute[75216]: DEBUG nova.network.neutron [None req-03c677a8-b56e-46fe-b386-96ebd424bd91 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1] Building network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 18:52:30 user nova-compute[75216]: DEBUG nova.compute.manager [req-9a94a602-4c63-4751-b34c-6f9b9b8cc5e2 req-e1c2c9dd-2533-462e-a424-3c986e526d12 service nova] [instance: f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1] Received event network-changed-5419f8b4-31da-434a-b131-6476134a71bf {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:52:30 user nova-compute[75216]: DEBUG nova.compute.manager [req-9a94a602-4c63-4751-b34c-6f9b9b8cc5e2 req-e1c2c9dd-2533-462e-a424-3c986e526d12 service nova] [instance: f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1] Refreshing instance network info cache due to event network-changed-5419f8b4-31da-434a-b131-6476134a71bf. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 18:52:30 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-9a94a602-4c63-4751-b34c-6f9b9b8cc5e2 req-e1c2c9dd-2533-462e-a424-3c986e526d12 service nova] Acquiring lock "refresh_cache-f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 18:52:30 user nova-compute[75216]: DEBUG nova.network.neutron [None req-03c677a8-b56e-46fe-b386-96ebd424bd91 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1] Instance cache missing network info. {{(pid=75216) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 18:52:31 user nova-compute[75216]: DEBUG nova.network.neutron [None req-03c677a8-b56e-46fe-b386-96ebd424bd91 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1] Updating instance_info_cache with network_info: [{"id": "5419f8b4-31da-434a-b131-6476134a71bf", "address": "fa:16:3e:9a:08:ac", "network": {"id": "f8b821ef-8fae-42b9-9055-a9ea7be955ab", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-50594548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "903397a6c0474cfd8bd1a4fb338528aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5419f8b4-31", "ovs_interfaceid": "5419f8b4-31da-434a-b131-6476134a71bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 18:52:31 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-03c677a8-b56e-46fe-b386-96ebd424bd91 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Releasing lock "refresh_cache-f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 18:52:31 user nova-compute[75216]: DEBUG nova.compute.manager [None req-03c677a8-b56e-46fe-b386-96ebd424bd91 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1] Instance network_info: |[{"id": "5419f8b4-31da-434a-b131-6476134a71bf", "address": "fa:16:3e:9a:08:ac", "network": {"id": "f8b821ef-8fae-42b9-9055-a9ea7be955ab", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-50594548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "903397a6c0474cfd8bd1a4fb338528aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5419f8b4-31", "ovs_interfaceid": "5419f8b4-31da-434a-b131-6476134a71bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 18:52:31 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-9a94a602-4c63-4751-b34c-6f9b9b8cc5e2 req-e1c2c9dd-2533-462e-a424-3c986e526d12 service nova] Acquired lock "refresh_cache-f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 18:52:31 user nova-compute[75216]: DEBUG nova.network.neutron [req-9a94a602-4c63-4751-b34c-6f9b9b8cc5e2 req-e1c2c9dd-2533-462e-a424-3c986e526d12 service nova] [instance: f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1] Refreshing network info cache for port 5419f8b4-31da-434a-b131-6476134a71bf {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 18:52:31 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-03c677a8-b56e-46fe-b386-96ebd424bd91 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1] Start _get_guest_xml network_info=[{"id": "5419f8b4-31da-434a-b131-6476134a71bf", "address": "fa:16:3e:9a:08:ac", "network": {"id": "f8b821ef-8fae-42b9-9055-a9ea7be955ab", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-50594548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "903397a6c0474cfd8bd1a4fb338528aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5419f8b4-31", "ovs_interfaceid": "5419f8b4-31da-434a-b131-6476134a71bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T18:41:06Z,direct_url=<?>,disk_format='qcow2',id=77bcb5ba-8510-41ec-a88d-96097bb431de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c465b7c26ec44582b6d1b7169536ecc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T18:41:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'guest_format': None, 'boot_index': 0, 'image_id': '77bcb5ba-8510-41ec-a88d-96097bb431de'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 18:52:31 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-03c677a8-b56e-46fe-b386-96ebd424bd91 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 18:52:31 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-03c677a8-b56e-46fe-b386-96ebd424bd91 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 18:52:31 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-03c677a8-b56e-46fe-b386-96ebd424bd91 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 18:52:31 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-03c677a8-b56e-46fe-b386-96ebd424bd91 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] CPU controller missing on host. {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 18:52:31 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-03c677a8-b56e-46fe-b386-96ebd424bd91 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 18:52:31 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-03c677a8-b56e-46fe-b386-96ebd424bd91 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] CPU controller found on host. {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 18:52:31 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-03c677a8-b56e-46fe-b386-96ebd424bd91 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75216) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 18:52:31 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-03c677a8-b56e-46fe-b386-96ebd424bd91 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T18:40:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T18:41:06Z,direct_url=<?>,disk_format='qcow2',id=77bcb5ba-8510-41ec-a88d-96097bb431de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c465b7c26ec44582b6d1b7169536ecc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T18:41:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 18:52:31 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-03c677a8-b56e-46fe-b386-96ebd424bd91 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Flavor limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 18:52:31 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-03c677a8-b56e-46fe-b386-96ebd424bd91 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Image limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 18:52:31 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-03c677a8-b56e-46fe-b386-96ebd424bd91 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Flavor pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 18:52:31 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-03c677a8-b56e-46fe-b386-96ebd424bd91 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Image pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 18:52:31 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-03c677a8-b56e-46fe-b386-96ebd424bd91 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 18:52:31 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-03c677a8-b56e-46fe-b386-96ebd424bd91 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 18:52:31 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-03c677a8-b56e-46fe-b386-96ebd424bd91 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 18:52:31 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-03c677a8-b56e-46fe-b386-96ebd424bd91 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Got 1 possible topologies {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 18:52:31 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-03c677a8-b56e-46fe-b386-96ebd424bd91 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 18:52:31 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-03c677a8-b56e-46fe-b386-96ebd424bd91 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 18:52:31 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-03c677a8-b56e-46fe-b386-96ebd424bd91 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T18:52:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1341845563',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1341845563',id=20,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='903397a6c0474cfd8bd1a4fb338528aa',ramdisk_id='',reservation_id='r-e0igk0ig',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-197527955',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T18:52:29Z,user_data=None,user_id='b381ea98871846b1bfb29a202a058208',uuid=f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5419f8b4-31da-434a-b131-6476134a71bf", "address": "fa:16:3e:9a:08:ac", "network": {"id": "f8b821ef-8fae-42b9-9055-a9ea7be955ab", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-50594548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "903397a6c0474cfd8bd1a4fb338528aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5419f8b4-31", "ovs_interfaceid": "5419f8b4-31da-434a-b131-6476134a71bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75216) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 18:52:31 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-03c677a8-b56e-46fe-b386-96ebd424bd91 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Converting VIF {"id": "5419f8b4-31da-434a-b131-6476134a71bf", "address": "fa:16:3e:9a:08:ac", "network": {"id": "f8b821ef-8fae-42b9-9055-a9ea7be955ab", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-50594548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "903397a6c0474cfd8bd1a4fb338528aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5419f8b4-31", "ovs_interfaceid": "5419f8b4-31da-434a-b131-6476134a71bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 18:52:31 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-03c677a8-b56e-46fe-b386-96ebd424bd91 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:08:ac,bridge_name='br-int',has_traffic_filtering=True,id=5419f8b4-31da-434a-b131-6476134a71bf,network=Network(f8b821ef-8fae-42b9-9055-a9ea7be955ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5419f8b4-31') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 18:52:31 user nova-compute[75216]: DEBUG nova.objects.instance [None req-03c677a8-b56e-46fe-b386-96ebd424bd91 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Lazy-loading 'pci_devices' on Instance uuid f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 18:52:31 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-03c677a8-b56e-46fe-b386-96ebd424bd91 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1] End _get_guest_xml xml=<domain type="kvm">
Nov 13 18:52:31 user nova-compute[75216]:   <uuid>f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1</uuid>
Nov 13 18:52:31 user nova-compute[75216]:   <name>instance-00000014</name>
Nov 13 18:52:31 user nova-compute[75216]:   <memory>524288</memory>
Nov 13 18:52:31 user nova-compute[75216]:   <vcpu>1</vcpu>
Nov 13 18:52:31 user nova-compute[75216]:   <metadata>
Nov 13 18:52:31 user nova-compute[75216]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 18:52:31 user nova-compute[75216]:       <nova:package version="0.0.0"/>
Nov 13 18:52:31 user nova-compute[75216]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1341845563</nova:name>
Nov 13 18:52:31 user nova-compute[75216]:       <nova:creationTime>2023-11-13 18:52:31</nova:creationTime>
Nov 13 18:52:31 user nova-compute[75216]:       <nova:flavor name="m1.tiny">
Nov 13 18:52:31 user nova-compute[75216]:         <nova:memory>512</nova:memory>
Nov 13 18:52:31 user nova-compute[75216]:         <nova:disk>1</nova:disk>
Nov 13 18:52:31 user nova-compute[75216]:         <nova:swap>0</nova:swap>
Nov 13 18:52:31 user nova-compute[75216]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 18:52:31 user nova-compute[75216]:         <nova:vcpus>1</nova:vcpus>
Nov 13 18:52:31 user nova-compute[75216]:       </nova:flavor>
Nov 13 18:52:31 user nova-compute[75216]:       <nova:owner>
Nov 13 18:52:31 user nova-compute[75216]:         <nova:user uuid="b381ea98871846b1bfb29a202a058208">tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member</nova:user>
Nov 13 18:52:31 user nova-compute[75216]:         <nova:project uuid="903397a6c0474cfd8bd1a4fb338528aa">tempest-ServerBootFromVolumeStableRescueTest-197527955</nova:project>
Nov 13 18:52:31 user nova-compute[75216]:       </nova:owner>
Nov 13 18:52:31 user nova-compute[75216]:       <nova:root type="image" uuid="77bcb5ba-8510-41ec-a88d-96097bb431de"/>
Nov 13 18:52:31 user nova-compute[75216]:       <nova:ports>
Nov 13 18:52:31 user nova-compute[75216]:         <nova:port uuid="5419f8b4-31da-434a-b131-6476134a71bf">
Nov 13 18:52:31 user nova-compute[75216]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 13 18:52:31 user nova-compute[75216]:         </nova:port>
Nov 13 18:52:31 user nova-compute[75216]:       </nova:ports>
Nov 13 18:52:31 user nova-compute[75216]:     </nova:instance>
Nov 13 18:52:31 user nova-compute[75216]:   </metadata>
Nov 13 18:52:31 user nova-compute[75216]:   <sysinfo type="smbios">
Nov 13 18:52:31 user nova-compute[75216]:     <system>
Nov 13 18:52:31 user nova-compute[75216]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 18:52:31 user nova-compute[75216]:       <entry name="product">OpenStack Nova</entry>
Nov 13 18:52:31 user nova-compute[75216]:       <entry name="version">0.0.0</entry>
Nov 13 18:52:31 user nova-compute[75216]:       <entry name="serial">f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1</entry>
Nov 13 18:52:31 user nova-compute[75216]:       <entry name="uuid">f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1</entry>
Nov 13 18:52:31 user nova-compute[75216]:       <entry name="family">Virtual Machine</entry>
Nov 13 18:52:31 user nova-compute[75216]:     </system>
Nov 13 18:52:31 user nova-compute[75216]:   </sysinfo>
Nov 13 18:52:31 user nova-compute[75216]:   <os>
Nov 13 18:52:31 user nova-compute[75216]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 18:52:31 user nova-compute[75216]:     <boot dev="hd"/>
Nov 13 18:52:31 user nova-compute[75216]:     <smbios mode="sysinfo"/>
Nov 13 18:52:31 user nova-compute[75216]:   </os>
Nov 13 18:52:31 user nova-compute[75216]:   <features>
Nov 13 18:52:31 user nova-compute[75216]:     <acpi/>
Nov 13 18:52:31 user nova-compute[75216]:     <apic/>
Nov 13 18:52:31 user nova-compute[75216]:     <vmcoreinfo/>
Nov 13 18:52:31 user nova-compute[75216]:   </features>
Nov 13 18:52:31 user nova-compute[75216]:   <clock offset="utc">
Nov 13 18:52:31 user nova-compute[75216]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 18:52:31 user nova-compute[75216]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 18:52:31 user nova-compute[75216]:     <timer name="hpet" present="no"/>
Nov 13 18:52:31 user nova-compute[75216]:   </clock>
Nov 13 18:52:31 user nova-compute[75216]:   <cpu mode="custom" match="exact">
Nov 13 18:52:31 user nova-compute[75216]:     <model>Nehalem</model>
Nov 13 18:52:31 user nova-compute[75216]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 18:52:31 user nova-compute[75216]:   </cpu>
Nov 13 18:52:31 user nova-compute[75216]:   <devices>
Nov 13 18:52:31 user nova-compute[75216]:     <disk type="file" device="disk">
Nov 13 18:52:31 user nova-compute[75216]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 18:52:31 user nova-compute[75216]:       <source file="/opt/stack/data/nova/instances/f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1/disk"/>
Nov 13 18:52:31 user nova-compute[75216]:       <target dev="vda" bus="virtio"/>
Nov 13 18:52:31 user nova-compute[75216]:     </disk>
Nov 13 18:52:31 user nova-compute[75216]:     <interface type="ethernet">
Nov 13 18:52:31 user nova-compute[75216]:       <mac address="fa:16:3e:9a:08:ac"/>
Nov 13 18:52:31 user nova-compute[75216]:       <model type="virtio"/>
Nov 13 18:52:31 user nova-compute[75216]:       <mtu size="1442"/>
Nov 13 18:52:31 user nova-compute[75216]:       <target dev="tap5419f8b4-31"/>
Nov 13 18:52:31 user nova-compute[75216]:     </interface>
Nov 13 18:52:31 user nova-compute[75216]:     <serial type="pty">
Nov 13 18:52:31 user nova-compute[75216]:       <log file="/opt/stack/data/nova/instances/f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1/console.log" append="off"/>
Nov 13 18:52:31 user nova-compute[75216]:     </serial>
Nov 13 18:52:31 user nova-compute[75216]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 18:52:31 user nova-compute[75216]:     <video>
Nov 13 18:52:31 user nova-compute[75216]:       <model type="virtio"/>
Nov 13 18:52:31 user nova-compute[75216]:     </video>
Nov 13 18:52:31 user nova-compute[75216]:     <rng model="virtio">
Nov 13 18:52:31 user nova-compute[75216]:       <backend model="random">/dev/urandom</backend>
Nov 13 18:52:31 user nova-compute[75216]:     </rng>
Nov 13 18:52:31 user nova-compute[75216]:     <controller type="usb" index="0" model="none"/>
Nov 13 18:52:31 user nova-compute[75216]:     <memballoon model="virtio">
Nov 13 18:52:31 user nova-compute[75216]:       <stats period="10"/>
Nov 13 18:52:31 user nova-compute[75216]:     </memballoon>
Nov 13 18:52:31 user nova-compute[75216]:   </devices>
Nov 13 18:52:31 user nova-compute[75216]: </domain>
Nov 13 18:52:31 user nova-compute[75216]:  {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 18:52:31 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-03c677a8-b56e-46fe-b386-96ebd424bd91 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T18:52:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1341845563',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1341845563',id=20,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='903397a6c0474cfd8bd1a4fb338528aa',ramdisk_id='',reservation_id='r-e0igk0ig',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-197527955',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T18:52:29Z,user_data=None,user_id='b381ea98871846b1bfb29a202a058208',uuid=f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5419f8b4-31da-434a-b131-6476134a71bf", "address": "fa:16:3e:9a:08:ac", "network": {"id": "f8b821ef-8fae-42b9-9055-a9ea7be955ab", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-50594548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "903397a6c0474cfd8bd1a4fb338528aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5419f8b4-31", "ovs_interfaceid": "5419f8b4-31da-434a-b131-6476134a71bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 18:52:31 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-03c677a8-b56e-46fe-b386-96ebd424bd91 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Converting VIF {"id": "5419f8b4-31da-434a-b131-6476134a71bf", "address": "fa:16:3e:9a:08:ac", "network": {"id": "f8b821ef-8fae-42b9-9055-a9ea7be955ab", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-50594548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "903397a6c0474cfd8bd1a4fb338528aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5419f8b4-31", "ovs_interfaceid": "5419f8b4-31da-434a-b131-6476134a71bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 18:52:31 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-03c677a8-b56e-46fe-b386-96ebd424bd91 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:08:ac,bridge_name='br-int',has_traffic_filtering=True,id=5419f8b4-31da-434a-b131-6476134a71bf,network=Network(f8b821ef-8fae-42b9-9055-a9ea7be955ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5419f8b4-31') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 18:52:31 user nova-compute[75216]: DEBUG os_vif [None req-03c677a8-b56e-46fe-b386-96ebd424bd91 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:08:ac,bridge_name='br-int',has_traffic_filtering=True,id=5419f8b4-31da-434a-b131-6476134a71bf,network=Network(f8b821ef-8fae-42b9-9055-a9ea7be955ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5419f8b4-31') {{(pid=75216) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 18:52:31 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:52:31 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:52:31 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 18:52:31 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:52:31 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '608ba46e-d5f3-51c9-a653-6adbb7f77d60', '_type': 'linux-noop'}}, row=False) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:52:31 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:52:31 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:52:31 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:52:31 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5419f8b4-31, may_exist=True, interface_attrs={}) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:52:31 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5419f8b4-31, col_values=(('qos', UUID('05650d0d-ec7f-4f1f-a7ff-7a75ae31e11e')),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:52:31 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5419f8b4-31, col_values=(('external_ids', {'iface-id': '5419f8b4-31da-434a-b131-6476134a71bf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9a:08:ac', 'vm-uuid': 'f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1'}),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:52:31 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:52:31 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:52:31 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:52:31 user nova-compute[75216]: INFO os_vif [None req-03c677a8-b56e-46fe-b386-96ebd424bd91 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:08:ac,bridge_name='br-int',has_traffic_filtering=True,id=5419f8b4-31da-434a-b131-6476134a71bf,network=Network(f8b821ef-8fae-42b9-9055-a9ea7be955ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5419f8b4-31')
Nov 13 18:52:31 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: 3679beb0-5244-443a-8512-38b29ccb62f0] Updating instance_info_cache with network_info: [] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 18:52:31 user nova-compute[75216]: INFO nova.compute.manager [-] [instance: 3679beb0-5244-443a-8512-38b29ccb62f0] Took 0.85 seconds to deallocate network for instance.
Nov 13 18:52:31 user nova-compute[75216]: DEBUG nova.compute.manager [req-e29930b3-0278-4e99-bbcd-1a1c07fa148e req-e6f553c5-3c31-4680-8b85-27a603e47148 service nova] [instance: 3679beb0-5244-443a-8512-38b29ccb62f0] Received event network-vif-deleted-9dd60454-c5ac-4afe-b6fc-ad9ba9b83423 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:52:31 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-03c677a8-b56e-46fe-b386-96ebd424bd91 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 18:52:31 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-03c677a8-b56e-46fe-b386-96ebd424bd91 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] No VIF found with MAC fa:16:3e:9a:08:ac, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 18:52:31 user nova-compute[75216]: DEBUG nova.network.neutron [req-9a94a602-4c63-4751-b34c-6f9b9b8cc5e2 req-e1c2c9dd-2533-462e-a424-3c986e526d12 service nova] [instance: f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1] Updated VIF entry in instance network info cache for port 5419f8b4-31da-434a-b131-6476134a71bf. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 18:52:31 user nova-compute[75216]: DEBUG nova.network.neutron [req-9a94a602-4c63-4751-b34c-6f9b9b8cc5e2 req-e1c2c9dd-2533-462e-a424-3c986e526d12 service nova] [instance: f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1] Updating instance_info_cache with network_info: [{"id": "5419f8b4-31da-434a-b131-6476134a71bf", "address": "fa:16:3e:9a:08:ac", "network": {"id": "f8b821ef-8fae-42b9-9055-a9ea7be955ab", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-50594548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "903397a6c0474cfd8bd1a4fb338528aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5419f8b4-31", "ovs_interfaceid": "5419f8b4-31da-434a-b131-6476134a71bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 18:52:31 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-9a94a602-4c63-4751-b34c-6f9b9b8cc5e2 req-e1c2c9dd-2533-462e-a424-3c986e526d12 service nova] Releasing lock "refresh_cache-f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 18:52:31 user nova-compute[75216]: INFO nova.compute.manager [None req-e9a0a26d-f7ce-4fb2-ad6b-ef24d3bdfeff tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] [instance: 3679beb0-5244-443a-8512-38b29ccb62f0] Took 0.75 seconds to detach 1 volumes for instance.
Nov 13 18:52:31 user nova-compute[75216]: DEBUG nova.compute.manager [None req-e9a0a26d-f7ce-4fb2-ad6b-ef24d3bdfeff tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] [instance: 3679beb0-5244-443a-8512-38b29ccb62f0] Deleting volume: ae66a157-b0d3-4501-a728-a010d6a83a10 {{(pid=75216) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 13 18:52:32 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e9a0a26d-f7ce-4fb2-ad6b-ef24d3bdfeff tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:52:32 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e9a0a26d-f7ce-4fb2-ad6b-ef24d3bdfeff tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:52:32 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-e9a0a26d-f7ce-4fb2-ad6b-ef24d3bdfeff tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 18:52:32 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-e9a0a26d-f7ce-4fb2-ad6b-ef24d3bdfeff tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 18:52:32 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e9a0a26d-f7ce-4fb2-ad6b-ef24d3bdfeff tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.318s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:52:32 user nova-compute[75216]: INFO nova.scheduler.client.report [None req-e9a0a26d-f7ce-4fb2-ad6b-ef24d3bdfeff tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] Deleted allocations for instance 3679beb0-5244-443a-8512-38b29ccb62f0
Nov 13 18:52:32 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e9a0a26d-f7ce-4fb2-ad6b-ef24d3bdfeff tempest-ServerActionsV293TestJSON-980167634 tempest-ServerActionsV293TestJSON-980167634-project-member] Lock "3679beb0-5244-443a-8512-38b29ccb62f0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.353s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:52:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:52:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:52:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:52:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:52:33 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:52:33 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:52:33 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:52:33 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:52:33 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:52:34 user nova-compute[75216]: DEBUG nova.compute.manager [req-b6fdcd5c-a503-4da5-a82a-8e13e8a8f90e req-c8021cb4-4687-4694-9820-3a6d82e614ee service nova] [instance: f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1] Received event network-vif-plugged-5419f8b4-31da-434a-b131-6476134a71bf {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:52:34 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-b6fdcd5c-a503-4da5-a82a-8e13e8a8f90e req-c8021cb4-4687-4694-9820-3a6d82e614ee service nova] Acquiring lock "f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:52:34 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-b6fdcd5c-a503-4da5-a82a-8e13e8a8f90e req-c8021cb4-4687-4694-9820-3a6d82e614ee service nova] Lock "f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:52:34 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-b6fdcd5c-a503-4da5-a82a-8e13e8a8f90e req-c8021cb4-4687-4694-9820-3a6d82e614ee service nova] Lock "f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:52:34 user nova-compute[75216]: DEBUG nova.compute.manager [req-b6fdcd5c-a503-4da5-a82a-8e13e8a8f90e req-c8021cb4-4687-4694-9820-3a6d82e614ee service nova] [instance: f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1] No waiting events found dispatching network-vif-plugged-5419f8b4-31da-434a-b131-6476134a71bf {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:52:34 user nova-compute[75216]: WARNING nova.compute.manager [req-b6fdcd5c-a503-4da5-a82a-8e13e8a8f90e req-c8021cb4-4687-4694-9820-3a6d82e614ee service nova] [instance: f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1] Received unexpected event network-vif-plugged-5419f8b4-31da-434a-b131-6476134a71bf for instance with vm_state building and task_state spawning.
Nov 13 18:52:34 user nova-compute[75216]: DEBUG nova.compute.manager [None req-03c677a8-b56e-46fe-b386-96ebd424bd91 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1] Instance event wait completed in 0 seconds for  {{(pid=75216) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 18:52:34 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-03c677a8-b56e-46fe-b386-96ebd424bd91 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1] Guest created on hypervisor {{(pid=75216) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 18:52:34 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1] Instance spawned successfully.
Nov 13 18:52:34 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-03c677a8-b56e-46fe-b386-96ebd424bd91 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 18:52:34 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-03c677a8-b56e-46fe-b386-96ebd424bd91 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1] Found default for hw_cdrom_bus of ide {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 18:52:34 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-03c677a8-b56e-46fe-b386-96ebd424bd91 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1] Found default for hw_disk_bus of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 18:52:34 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-03c677a8-b56e-46fe-b386-96ebd424bd91 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1] Found default for hw_input_bus of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 18:52:34 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-03c677a8-b56e-46fe-b386-96ebd424bd91 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1] Found default for hw_pointer_model of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 18:52:34 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-03c677a8-b56e-46fe-b386-96ebd424bd91 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1] Found default for hw_video_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 18:52:34 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-03c677a8-b56e-46fe-b386-96ebd424bd91 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1] Found default for hw_vif_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 18:52:34 user nova-compute[75216]: INFO nova.compute.manager [None req-03c677a8-b56e-46fe-b386-96ebd424bd91 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1] Took 5.77 seconds to spawn the instance on the hypervisor.
Nov 13 18:52:34 user nova-compute[75216]: DEBUG nova.compute.manager [None req-03c677a8-b56e-46fe-b386-96ebd424bd91 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1] Checking state {{(pid=75216) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 18:52:34 user nova-compute[75216]: INFO nova.compute.manager [None req-03c677a8-b56e-46fe-b386-96ebd424bd91 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1] Took 6.46 seconds to build instance.
Nov 13 18:52:34 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-03c677a8-b56e-46fe-b386-96ebd424bd91 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Lock "f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.571s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:52:36 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:52:36 user nova-compute[75216]: DEBUG nova.compute.manager [req-7b358917-b68d-4856-aced-35271b3bce34 req-9ac2057f-523e-4c44-b5ab-2400fc63b040 service nova] [instance: f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1] Received event network-vif-plugged-5419f8b4-31da-434a-b131-6476134a71bf {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:52:36 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-7b358917-b68d-4856-aced-35271b3bce34 req-9ac2057f-523e-4c44-b5ab-2400fc63b040 service nova] Acquiring lock "f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:52:36 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-7b358917-b68d-4856-aced-35271b3bce34 req-9ac2057f-523e-4c44-b5ab-2400fc63b040 service nova] Lock "f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:52:36 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-7b358917-b68d-4856-aced-35271b3bce34 req-9ac2057f-523e-4c44-b5ab-2400fc63b040 service nova] Lock "f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:52:36 user nova-compute[75216]: DEBUG nova.compute.manager [req-7b358917-b68d-4856-aced-35271b3bce34 req-9ac2057f-523e-4c44-b5ab-2400fc63b040 service nova] [instance: f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1] No waiting events found dispatching network-vif-plugged-5419f8b4-31da-434a-b131-6476134a71bf {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:52:36 user nova-compute[75216]: WARNING nova.compute.manager [req-7b358917-b68d-4856-aced-35271b3bce34 req-9ac2057f-523e-4c44-b5ab-2400fc63b040 service nova] [instance: f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1] Received unexpected event network-vif-plugged-5419f8b4-31da-434a-b131-6476134a71bf for instance with vm_state active and task_state None.
Nov 13 18:52:38 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:52:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:52:43 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:52:43 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:52:46 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:52:46 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:52:46 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:52:46 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:52:46 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:52:47 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:52:48 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:52:48 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:52:48 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75216) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 18:52:48 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:52:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:52:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:52:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:52:48 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Auditing locally available compute resources for user (node: user) {{(pid=75216) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 18:52:48 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:52:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a3e849-6570-4820-97c8-75468b5bea4f/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:52:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a3e849-6570-4820-97c8-75468b5bea4f/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:52:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a3e849-6570-4820-97c8-75468b5bea4f/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:52:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a3e849-6570-4820-97c8-75468b5bea4f/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:52:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14d378b0-79ba-4161-a795-6288939c6fef/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:52:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14d378b0-79ba-4161-a795-6288939c6fef/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:52:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14d378b0-79ba-4161-a795-6288939c6fef/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:52:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14d378b0-79ba-4161-a795-6288939c6fef/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:52:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d589d57e-de50-482a-843f-e8246b3d7528/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:52:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d589d57e-de50-482a-843f-e8246b3d7528/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:52:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d589d57e-de50-482a-843f-e8246b3d7528/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:52:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d589d57e-de50-482a-843f-e8246b3d7528/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:52:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:52:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:52:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:52:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:52:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91ea8a19-a365-484c-80c7-baf90e7dd1aa/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:52:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91ea8a19-a365-484c-80c7-baf90e7dd1aa/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:52:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91ea8a19-a365-484c-80c7-baf90e7dd1aa/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:52:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91ea8a19-a365-484c-80c7-baf90e7dd1aa/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:52:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85624c58-6c72-4490-8a3e-547953295ade/disk.rescue --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:52:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85624c58-6c72-4490-8a3e-547953295ade/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:52:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85624c58-6c72-4490-8a3e-547953295ade/disk.rescue --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:52:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85624c58-6c72-4490-8a3e-547953295ade/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:52:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85624c58-6c72-4490-8a3e-547953295ade/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:52:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85624c58-6c72-4490-8a3e-547953295ade/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:52:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85624c58-6c72-4490-8a3e-547953295ade/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:52:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85624c58-6c72-4490-8a3e-547953295ade/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:52:51 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:52:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c9d9c1b-6df5-41ff-a696-871e70d04e07/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:52:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c9d9c1b-6df5-41ff-a696-871e70d04e07/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:52:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c9d9c1b-6df5-41ff-a696-871e70d04e07/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:52:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c9d9c1b-6df5-41ff-a696-871e70d04e07/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:52:51 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 18:52:51 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 18:52:51 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 18:52:51 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Hypervisor/Node resource view: name=user free_ram=7884MB free_disk=25.564964294433594GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75216) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 18:52:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:52:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:52:52 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance a1a3e849-6570-4820-97c8-75468b5bea4f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 18:52:52 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance d589d57e-de50-482a-843f-e8246b3d7528 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 18:52:52 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance 85624c58-6c72-4490-8a3e-547953295ade actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 18:52:52 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance 7c9d9c1b-6df5-41ff-a696-871e70d04e07 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 18:52:52 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance 91ea8a19-a365-484c-80c7-baf90e7dd1aa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 18:52:52 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance 14d378b0-79ba-4161-a795-6288939c6fef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 18:52:52 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 18:52:52 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 18:52:52 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 18:52:52 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 18:52:52 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 18:52:52 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Compute_service record updated for user:user {{(pid=75216) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 18:52:52 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.358s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:52:53 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:52:53 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Starting heal instance info cache {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 18:52:53 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "refresh_cache-d589d57e-de50-482a-843f-e8246b3d7528" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 18:52:53 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquired lock "refresh_cache-d589d57e-de50-482a-843f-e8246b3d7528" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 18:52:53 user nova-compute[75216]: DEBUG nova.network.neutron [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: d589d57e-de50-482a-843f-e8246b3d7528] Forcefully refreshing network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 18:52:53 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:52:53 user nova-compute[75216]: DEBUG nova.network.neutron [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: d589d57e-de50-482a-843f-e8246b3d7528] Updating instance_info_cache with network_info: [{"id": "87426a6f-0164-4df3-aad0-becbbbfe8310", "address": "fa:16:3e:64:4d:81", "network": {"id": "6d182db1-03b5-4d1b-86cf-b9367921b7b0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1877006951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2efafc26c47c4050bd367c47469999fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87426a6f-01", "ovs_interfaceid": "87426a6f-0164-4df3-aad0-becbbbfe8310", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 18:52:53 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Releasing lock "refresh_cache-d589d57e-de50-482a-843f-e8246b3d7528" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 18:52:53 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: d589d57e-de50-482a-843f-e8246b3d7528] Updated the network info_cache for instance {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 18:52:53 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:52:53 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:52:56 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:52:56 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:52:56 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:52:58 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:52:59 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:53:01 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:53:03 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:53:06 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:53:11 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:53:11 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:53:11 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75216) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 18:53:11 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 18:53:11 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 18:53:11 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:53:16 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:53:16 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:53:16 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75216) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 18:53:16 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 18:53:16 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 18:53:16 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:53:20 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-d70aea5f-b5f2-409d-bcee-9fca42d7049f tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Acquiring lock "d9a1edfb-c2ac-4e67-abac-c915ea22a15c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:53:20 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-d70aea5f-b5f2-409d-bcee-9fca42d7049f tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Lock "d9a1edfb-c2ac-4e67-abac-c915ea22a15c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:53:20 user nova-compute[75216]: DEBUG nova.compute.manager [None req-d70aea5f-b5f2-409d-bcee-9fca42d7049f tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] [instance: d9a1edfb-c2ac-4e67-abac-c915ea22a15c] Starting instance... {{(pid=75216) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 18:53:20 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-d70aea5f-b5f2-409d-bcee-9fca42d7049f tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:53:20 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-d70aea5f-b5f2-409d-bcee-9fca42d7049f tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:53:20 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-d70aea5f-b5f2-409d-bcee-9fca42d7049f tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75216) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 18:53:20 user nova-compute[75216]: INFO nova.compute.claims [None req-d70aea5f-b5f2-409d-bcee-9fca42d7049f tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] [instance: d9a1edfb-c2ac-4e67-abac-c915ea22a15c] Claim successful on node user
Nov 13 18:53:21 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-d70aea5f-b5f2-409d-bcee-9fca42d7049f tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 18:53:21 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-d70aea5f-b5f2-409d-bcee-9fca42d7049f tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 18:53:21 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-d70aea5f-b5f2-409d-bcee-9fca42d7049f tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.443s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:53:21 user nova-compute[75216]: DEBUG nova.compute.manager [None req-d70aea5f-b5f2-409d-bcee-9fca42d7049f tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] [instance: d9a1edfb-c2ac-4e67-abac-c915ea22a15c] Start building networks asynchronously for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 18:53:21 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:53:21 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:53:21 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5007 ms, sending inactivity probe {{(pid=75216) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 18:53:21 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 18:53:21 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 18:53:21 user nova-compute[75216]: DEBUG nova.compute.manager [None req-d70aea5f-b5f2-409d-bcee-9fca42d7049f tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] [instance: d9a1edfb-c2ac-4e67-abac-c915ea22a15c] Allocating IP information in the background. {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 18:53:21 user nova-compute[75216]: DEBUG nova.network.neutron [None req-d70aea5f-b5f2-409d-bcee-9fca42d7049f tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] [instance: d9a1edfb-c2ac-4e67-abac-c915ea22a15c] allocate_for_instance() {{(pid=75216) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 18:53:21 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:53:21 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-d70aea5f-b5f2-409d-bcee-9fca42d7049f tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] [instance: d9a1edfb-c2ac-4e67-abac-c915ea22a15c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 18:53:21 user nova-compute[75216]: DEBUG nova.compute.manager [None req-d70aea5f-b5f2-409d-bcee-9fca42d7049f tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] [instance: d9a1edfb-c2ac-4e67-abac-c915ea22a15c] Start building block device mappings for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 18:53:21 user nova-compute[75216]: DEBUG nova.policy [None req-d70aea5f-b5f2-409d-bcee-9fca42d7049f tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3587565f5b56450e95f2bd572d7e4f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efafc26c47c4050bd367c47469999fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75216) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 18:53:21 user nova-compute[75216]: DEBUG nova.compute.manager [None req-d70aea5f-b5f2-409d-bcee-9fca42d7049f tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] [instance: d9a1edfb-c2ac-4e67-abac-c915ea22a15c] Start spawning the instance on the hypervisor. {{(pid=75216) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 18:53:21 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-d70aea5f-b5f2-409d-bcee-9fca42d7049f tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] [instance: d9a1edfb-c2ac-4e67-abac-c915ea22a15c] Creating instance directory {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 18:53:21 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-d70aea5f-b5f2-409d-bcee-9fca42d7049f tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] [instance: d9a1edfb-c2ac-4e67-abac-c915ea22a15c] Creating image(s)
Nov 13 18:53:21 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-d70aea5f-b5f2-409d-bcee-9fca42d7049f tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Acquiring lock "/opt/stack/data/nova/instances/d9a1edfb-c2ac-4e67-abac-c915ea22a15c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:53:21 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-d70aea5f-b5f2-409d-bcee-9fca42d7049f tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Lock "/opt/stack/data/nova/instances/d9a1edfb-c2ac-4e67-abac-c915ea22a15c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:53:21 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-d70aea5f-b5f2-409d-bcee-9fca42d7049f tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Lock "/opt/stack/data/nova/instances/d9a1edfb-c2ac-4e67-abac-c915ea22a15c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:53:21 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-d70aea5f-b5f2-409d-bcee-9fca42d7049f tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:53:21 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-d70aea5f-b5f2-409d-bcee-9fca42d7049f tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json" returned: 0 in 0.173s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:53:21 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-d70aea5f-b5f2-409d-bcee-9fca42d7049f tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Acquiring lock "88c50a45bec9d6b0427462b3242b9b8e5f49c2b6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:53:21 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-d70aea5f-b5f2-409d-bcee-9fca42d7049f tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Lock "88c50a45bec9d6b0427462b3242b9b8e5f49c2b6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:53:21 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-d70aea5f-b5f2-409d-bcee-9fca42d7049f tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:53:21 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-d70aea5f-b5f2-409d-bcee-9fca42d7049f tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json" returned: 0 in 0.231s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:53:21 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-d70aea5f-b5f2-409d-bcee-9fca42d7049f tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6,backing_fmt=raw /opt/stack/data/nova/instances/d9a1edfb-c2ac-4e67-abac-c915ea22a15c/disk 1073741824 {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:53:21 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-d70aea5f-b5f2-409d-bcee-9fca42d7049f tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6,backing_fmt=raw /opt/stack/data/nova/instances/d9a1edfb-c2ac-4e67-abac-c915ea22a15c/disk 1073741824" returned: 0 in 0.054s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:53:21 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-d70aea5f-b5f2-409d-bcee-9fca42d7049f tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Lock "88c50a45bec9d6b0427462b3242b9b8e5f49c2b6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.292s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:53:21 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-d70aea5f-b5f2-409d-bcee-9fca42d7049f tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:53:22 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-d70aea5f-b5f2-409d-bcee-9fca42d7049f tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json" returned: 0 in 0.185s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:53:22 user nova-compute[75216]: DEBUG nova.virt.disk.api [None req-d70aea5f-b5f2-409d-bcee-9fca42d7049f tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d9a1edfb-c2ac-4e67-abac-c915ea22a15c/disk. size=1073741824 {{(pid=75216) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 18:53:22 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-d70aea5f-b5f2-409d-bcee-9fca42d7049f tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9a1edfb-c2ac-4e67-abac-c915ea22a15c/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:53:22 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e82f6dba-8384-49ad-b6ac-700bac44e3fc tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Acquiring lock "7c9d9c1b-6df5-41ff-a696-871e70d04e07" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:53:22 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e82f6dba-8384-49ad-b6ac-700bac44e3fc tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Lock "7c9d9c1b-6df5-41ff-a696-871e70d04e07" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:53:22 user nova-compute[75216]: INFO nova.compute.manager [None req-e82f6dba-8384-49ad-b6ac-700bac44e3fc tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: 7c9d9c1b-6df5-41ff-a696-871e70d04e07] Detaching volume 6c711796-fc49-4e18-8fdd-eefe1e3b357c
Nov 13 18:53:22 user nova-compute[75216]: INFO nova.virt.block_device [None req-e82f6dba-8384-49ad-b6ac-700bac44e3fc tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: 7c9d9c1b-6df5-41ff-a696-871e70d04e07] Attempting to driver detach volume 6c711796-fc49-4e18-8fdd-eefe1e3b357c from mountpoint /dev/vdb
Nov 13 18:53:22 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-e82f6dba-8384-49ad-b6ac-700bac44e3fc tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Attempting to detach device vdb from instance 7c9d9c1b-6df5-41ff-a696-871e70d04e07 from the persistent domain config. {{(pid=75216) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 13 18:53:22 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-e82f6dba-8384-49ad-b6ac-700bac44e3fc tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 18:53:22 user nova-compute[75216]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 18:53:22 user nova-compute[75216]:   <source dev="/dev/sdd"/>
Nov 13 18:53:22 user nova-compute[75216]:   <target dev="vdb" bus="virtio"/>
Nov 13 18:53:22 user nova-compute[75216]:   <serial>6c711796-fc49-4e18-8fdd-eefe1e3b357c</serial>
Nov 13 18:53:22 user nova-compute[75216]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 13 18:53:22 user nova-compute[75216]: </disk>
Nov 13 18:53:22 user nova-compute[75216]:  {{(pid=75216) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 18:53:22 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-d70aea5f-b5f2-409d-bcee-9fca42d7049f tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9a1edfb-c2ac-4e67-abac-c915ea22a15c/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:53:22 user nova-compute[75216]: DEBUG nova.virt.disk.api [None req-d70aea5f-b5f2-409d-bcee-9fca42d7049f tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Cannot resize image /opt/stack/data/nova/instances/d9a1edfb-c2ac-4e67-abac-c915ea22a15c/disk to a smaller size. {{(pid=75216) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 18:53:22 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-d70aea5f-b5f2-409d-bcee-9fca42d7049f tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] [instance: d9a1edfb-c2ac-4e67-abac-c915ea22a15c] Created local disks {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 18:53:22 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-d70aea5f-b5f2-409d-bcee-9fca42d7049f tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] [instance: d9a1edfb-c2ac-4e67-abac-c915ea22a15c] Ensure instance console log exists: /opt/stack/data/nova/instances/d9a1edfb-c2ac-4e67-abac-c915ea22a15c/console.log {{(pid=75216) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 18:53:22 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-d70aea5f-b5f2-409d-bcee-9fca42d7049f tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:53:22 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-d70aea5f-b5f2-409d-bcee-9fca42d7049f tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:53:22 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-d70aea5f-b5f2-409d-bcee-9fca42d7049f tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:53:22 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-e82f6dba-8384-49ad-b6ac-700bac44e3fc tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Successfully detached device vdb from instance 7c9d9c1b-6df5-41ff-a696-871e70d04e07 from the persistent domain config.
Nov 13 18:53:22 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-e82f6dba-8384-49ad-b6ac-700bac44e3fc tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7c9d9c1b-6df5-41ff-a696-871e70d04e07 from the live domain config. {{(pid=75216) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 13 18:53:22 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-e82f6dba-8384-49ad-b6ac-700bac44e3fc tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 18:53:22 user nova-compute[75216]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 18:53:22 user nova-compute[75216]:   <source dev="/dev/sdd"/>
Nov 13 18:53:22 user nova-compute[75216]:   <target dev="vdb" bus="virtio"/>
Nov 13 18:53:22 user nova-compute[75216]:   <serial>6c711796-fc49-4e18-8fdd-eefe1e3b357c</serial>
Nov 13 18:53:22 user nova-compute[75216]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 13 18:53:22 user nova-compute[75216]: </disk>
Nov 13 18:53:22 user nova-compute[75216]:  {{(pid=75216) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 18:53:22 user nova-compute[75216]: DEBUG nova.network.neutron [None req-d70aea5f-b5f2-409d-bcee-9fca42d7049f tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] [instance: d9a1edfb-c2ac-4e67-abac-c915ea22a15c] Successfully created port: eb2895a9-124a-4504-b197-bb2022f3f55f {{(pid=75216) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 18:53:22 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-e82f6dba-8384-49ad-b6ac-700bac44e3fc tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7c9d9c1b-6df5-41ff-a696-871e70d04e07 {{(pid=75216) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 13 18:53:23 user nova-compute[75216]: DEBUG nova.network.neutron [None req-d70aea5f-b5f2-409d-bcee-9fca42d7049f tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] [instance: d9a1edfb-c2ac-4e67-abac-c915ea22a15c] Successfully updated port: eb2895a9-124a-4504-b197-bb2022f3f55f {{(pid=75216) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 18:53:23 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-d70aea5f-b5f2-409d-bcee-9fca42d7049f tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Acquiring lock "refresh_cache-d9a1edfb-c2ac-4e67-abac-c915ea22a15c" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 18:53:23 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-d70aea5f-b5f2-409d-bcee-9fca42d7049f tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Acquired lock "refresh_cache-d9a1edfb-c2ac-4e67-abac-c915ea22a15c" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 18:53:23 user nova-compute[75216]: DEBUG nova.network.neutron [None req-d70aea5f-b5f2-409d-bcee-9fca42d7049f tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] [instance: d9a1edfb-c2ac-4e67-abac-c915ea22a15c] Building network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 18:53:23 user nova-compute[75216]: DEBUG nova.compute.manager [req-5ae3fabe-14dc-461b-9ce7-945704d84e4c req-15c46f6f-f940-491c-84af-2d32398e94d0 service nova] [instance: d9a1edfb-c2ac-4e67-abac-c915ea22a15c] Received event network-changed-eb2895a9-124a-4504-b197-bb2022f3f55f {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:53:23 user nova-compute[75216]: DEBUG nova.compute.manager [req-5ae3fabe-14dc-461b-9ce7-945704d84e4c req-15c46f6f-f940-491c-84af-2d32398e94d0 service nova] [instance: d9a1edfb-c2ac-4e67-abac-c915ea22a15c] Refreshing instance network info cache due to event network-changed-eb2895a9-124a-4504-b197-bb2022f3f55f. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 18:53:23 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-5ae3fabe-14dc-461b-9ce7-945704d84e4c req-15c46f6f-f940-491c-84af-2d32398e94d0 service nova] Acquiring lock "refresh_cache-d9a1edfb-c2ac-4e67-abac-c915ea22a15c" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 18:53:23 user nova-compute[75216]: DEBUG nova.network.neutron [None req-d70aea5f-b5f2-409d-bcee-9fca42d7049f tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] [instance: d9a1edfb-c2ac-4e67-abac-c915ea22a15c] Instance cache missing network info. {{(pid=75216) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 18:53:23 user nova-compute[75216]: DEBUG nova.network.neutron [None req-d70aea5f-b5f2-409d-bcee-9fca42d7049f tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] [instance: d9a1edfb-c2ac-4e67-abac-c915ea22a15c] Updating instance_info_cache with network_info: [{"id": "eb2895a9-124a-4504-b197-bb2022f3f55f", "address": "fa:16:3e:8d:84:60", "network": {"id": "6d182db1-03b5-4d1b-86cf-b9367921b7b0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1877006951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2efafc26c47c4050bd367c47469999fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb2895a9-12", "ovs_interfaceid": "eb2895a9-124a-4504-b197-bb2022f3f55f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 18:53:23 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-d70aea5f-b5f2-409d-bcee-9fca42d7049f tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Releasing lock "refresh_cache-d9a1edfb-c2ac-4e67-abac-c915ea22a15c" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 18:53:23 user nova-compute[75216]: DEBUG nova.compute.manager [None req-d70aea5f-b5f2-409d-bcee-9fca42d7049f tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] [instance: d9a1edfb-c2ac-4e67-abac-c915ea22a15c] Instance network_info: |[{"id": "eb2895a9-124a-4504-b197-bb2022f3f55f", "address": "fa:16:3e:8d:84:60", "network": {"id": "6d182db1-03b5-4d1b-86cf-b9367921b7b0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1877006951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2efafc26c47c4050bd367c47469999fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb2895a9-12", "ovs_interfaceid": "eb2895a9-124a-4504-b197-bb2022f3f55f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 18:53:23 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-5ae3fabe-14dc-461b-9ce7-945704d84e4c req-15c46f6f-f940-491c-84af-2d32398e94d0 service nova] Acquired lock "refresh_cache-d9a1edfb-c2ac-4e67-abac-c915ea22a15c" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 18:53:23 user nova-compute[75216]: DEBUG nova.network.neutron [req-5ae3fabe-14dc-461b-9ce7-945704d84e4c req-15c46f6f-f940-491c-84af-2d32398e94d0 service nova] [instance: d9a1edfb-c2ac-4e67-abac-c915ea22a15c] Refreshing network info cache for port eb2895a9-124a-4504-b197-bb2022f3f55f {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 18:53:23 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-d70aea5f-b5f2-409d-bcee-9fca42d7049f tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] [instance: d9a1edfb-c2ac-4e67-abac-c915ea22a15c] Start _get_guest_xml network_info=[{"id": "eb2895a9-124a-4504-b197-bb2022f3f55f", "address": "fa:16:3e:8d:84:60", "network": {"id": "6d182db1-03b5-4d1b-86cf-b9367921b7b0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1877006951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2efafc26c47c4050bd367c47469999fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb2895a9-12", "ovs_interfaceid": "eb2895a9-124a-4504-b197-bb2022f3f55f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T18:41:06Z,direct_url=<?>,disk_format='qcow2',id=77bcb5ba-8510-41ec-a88d-96097bb431de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c465b7c26ec44582b6d1b7169536ecc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T18:41:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'guest_format': None, 'boot_index': 0, 'image_id': '77bcb5ba-8510-41ec-a88d-96097bb431de'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 18:53:23 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-d70aea5f-b5f2-409d-bcee-9fca42d7049f tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 18:53:23 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-d70aea5f-b5f2-409d-bcee-9fca42d7049f tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 18:53:23 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-d70aea5f-b5f2-409d-bcee-9fca42d7049f tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 18:53:23 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-d70aea5f-b5f2-409d-bcee-9fca42d7049f tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] CPU controller missing on host. {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 18:53:23 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-d70aea5f-b5f2-409d-bcee-9fca42d7049f tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 18:53:23 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-d70aea5f-b5f2-409d-bcee-9fca42d7049f tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] CPU controller found on host. {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 18:53:23 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-d70aea5f-b5f2-409d-bcee-9fca42d7049f tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75216) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 18:53:23 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-d70aea5f-b5f2-409d-bcee-9fca42d7049f tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T18:40:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T18:41:06Z,direct_url=<?>,disk_format='qcow2',id=77bcb5ba-8510-41ec-a88d-96097bb431de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c465b7c26ec44582b6d1b7169536ecc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T18:41:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 18:53:23 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-d70aea5f-b5f2-409d-bcee-9fca42d7049f tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Flavor limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 18:53:23 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-d70aea5f-b5f2-409d-bcee-9fca42d7049f tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Image limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 18:53:23 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-d70aea5f-b5f2-409d-bcee-9fca42d7049f tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Flavor pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 18:53:23 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-d70aea5f-b5f2-409d-bcee-9fca42d7049f tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Image pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 18:53:23 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-d70aea5f-b5f2-409d-bcee-9fca42d7049f tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 18:53:23 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-d70aea5f-b5f2-409d-bcee-9fca42d7049f tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 18:53:23 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-d70aea5f-b5f2-409d-bcee-9fca42d7049f tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 18:53:23 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-d70aea5f-b5f2-409d-bcee-9fca42d7049f tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Got 1 possible topologies {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 18:53:23 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-d70aea5f-b5f2-409d-bcee-9fca42d7049f tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 18:53:23 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-d70aea5f-b5f2-409d-bcee-9fca42d7049f tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 18:53:23 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-d70aea5f-b5f2-409d-bcee-9fca42d7049f tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T18:53:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-592596084',display_name='tempest-ServerRescueNegativeTestJSON-server-592596084',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-592596084',id=21,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK+2PkxKKa7trQ91oahynfsb+ED4eBrX/gngy0uUVn/I9HNQHRE/MYLJgkcv2KjmmoqwoAll/FQqq9eo5uxBEri6NDF/QBB2CwxMJWgUT8869feJBRIceiVszXyooPeT3Q==',key_name='tempest-keypair-1092347516',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2efafc26c47c4050bd367c47469999fb',ramdisk_id='',reservation_id='r-5rr602jn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-165310019',owner_user_name='tempest-ServerRescueNegativeTestJSON-165310019-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T18:53:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3587565f5b56450e95f2bd572d7e4f88',uuid=d9a1edfb-c2ac-4e67-abac-c915ea22a15c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eb2895a9-124a-4504-b197-bb2022f3f55f", "address": "fa:16:3e:8d:84:60", "network": {"id": "6d182db1-03b5-4d1b-86cf-b9367921b7b0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1877006951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2efafc26c47c4050bd367c47469999fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb2895a9-12", "ovs_interfaceid": "eb2895a9-124a-4504-b197-bb2022f3f55f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75216) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 18:53:23 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-d70aea5f-b5f2-409d-bcee-9fca42d7049f tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Converting VIF {"id": "eb2895a9-124a-4504-b197-bb2022f3f55f", "address": "fa:16:3e:8d:84:60", "network": {"id": "6d182db1-03b5-4d1b-86cf-b9367921b7b0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1877006951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2efafc26c47c4050bd367c47469999fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb2895a9-12", "ovs_interfaceid": "eb2895a9-124a-4504-b197-bb2022f3f55f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 18:53:23 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-d70aea5f-b5f2-409d-bcee-9fca42d7049f tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:84:60,bridge_name='br-int',has_traffic_filtering=True,id=eb2895a9-124a-4504-b197-bb2022f3f55f,network=Network(6d182db1-03b5-4d1b-86cf-b9367921b7b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb2895a9-12') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 18:53:23 user nova-compute[75216]: DEBUG nova.objects.instance [None req-d70aea5f-b5f2-409d-bcee-9fca42d7049f tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Lazy-loading 'pci_devices' on Instance uuid d9a1edfb-c2ac-4e67-abac-c915ea22a15c {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 18:53:23 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-d70aea5f-b5f2-409d-bcee-9fca42d7049f tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] [instance: d9a1edfb-c2ac-4e67-abac-c915ea22a15c] End _get_guest_xml xml=<domain type="kvm">
Nov 13 18:53:23 user nova-compute[75216]:   <uuid>d9a1edfb-c2ac-4e67-abac-c915ea22a15c</uuid>
Nov 13 18:53:23 user nova-compute[75216]:   <name>instance-00000015</name>
Nov 13 18:53:23 user nova-compute[75216]:   <memory>524288</memory>
Nov 13 18:53:23 user nova-compute[75216]:   <vcpu>1</vcpu>
Nov 13 18:53:23 user nova-compute[75216]:   <metadata>
Nov 13 18:53:23 user nova-compute[75216]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 18:53:23 user nova-compute[75216]:       <nova:package version="0.0.0"/>
Nov 13 18:53:23 user nova-compute[75216]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-592596084</nova:name>
Nov 13 18:53:23 user nova-compute[75216]:       <nova:creationTime>2023-11-13 18:53:23</nova:creationTime>
Nov 13 18:53:23 user nova-compute[75216]:       <nova:flavor name="m1.tiny">
Nov 13 18:53:23 user nova-compute[75216]:         <nova:memory>512</nova:memory>
Nov 13 18:53:23 user nova-compute[75216]:         <nova:disk>1</nova:disk>
Nov 13 18:53:23 user nova-compute[75216]:         <nova:swap>0</nova:swap>
Nov 13 18:53:23 user nova-compute[75216]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 18:53:23 user nova-compute[75216]:         <nova:vcpus>1</nova:vcpus>
Nov 13 18:53:23 user nova-compute[75216]:       </nova:flavor>
Nov 13 18:53:23 user nova-compute[75216]:       <nova:owner>
Nov 13 18:53:23 user nova-compute[75216]:         <nova:user uuid="3587565f5b56450e95f2bd572d7e4f88">tempest-ServerRescueNegativeTestJSON-165310019-project-member</nova:user>
Nov 13 18:53:23 user nova-compute[75216]:         <nova:project uuid="2efafc26c47c4050bd367c47469999fb">tempest-ServerRescueNegativeTestJSON-165310019</nova:project>
Nov 13 18:53:23 user nova-compute[75216]:       </nova:owner>
Nov 13 18:53:23 user nova-compute[75216]:       <nova:root type="image" uuid="77bcb5ba-8510-41ec-a88d-96097bb431de"/>
Nov 13 18:53:23 user nova-compute[75216]:       <nova:ports>
Nov 13 18:53:23 user nova-compute[75216]:         <nova:port uuid="eb2895a9-124a-4504-b197-bb2022f3f55f">
Nov 13 18:53:23 user nova-compute[75216]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 13 18:53:23 user nova-compute[75216]:         </nova:port>
Nov 13 18:53:23 user nova-compute[75216]:       </nova:ports>
Nov 13 18:53:23 user nova-compute[75216]:     </nova:instance>
Nov 13 18:53:23 user nova-compute[75216]:   </metadata>
Nov 13 18:53:23 user nova-compute[75216]:   <sysinfo type="smbios">
Nov 13 18:53:23 user nova-compute[75216]:     <system>
Nov 13 18:53:23 user nova-compute[75216]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 18:53:23 user nova-compute[75216]:       <entry name="product">OpenStack Nova</entry>
Nov 13 18:53:23 user nova-compute[75216]:       <entry name="version">0.0.0</entry>
Nov 13 18:53:23 user nova-compute[75216]:       <entry name="serial">d9a1edfb-c2ac-4e67-abac-c915ea22a15c</entry>
Nov 13 18:53:23 user nova-compute[75216]:       <entry name="uuid">d9a1edfb-c2ac-4e67-abac-c915ea22a15c</entry>
Nov 13 18:53:23 user nova-compute[75216]:       <entry name="family">Virtual Machine</entry>
Nov 13 18:53:23 user nova-compute[75216]:     </system>
Nov 13 18:53:23 user nova-compute[75216]:   </sysinfo>
Nov 13 18:53:23 user nova-compute[75216]:   <os>
Nov 13 18:53:23 user nova-compute[75216]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 18:53:23 user nova-compute[75216]:     <boot dev="hd"/>
Nov 13 18:53:23 user nova-compute[75216]:     <smbios mode="sysinfo"/>
Nov 13 18:53:23 user nova-compute[75216]:   </os>
Nov 13 18:53:23 user nova-compute[75216]:   <features>
Nov 13 18:53:23 user nova-compute[75216]:     <acpi/>
Nov 13 18:53:23 user nova-compute[75216]:     <apic/>
Nov 13 18:53:23 user nova-compute[75216]:     <vmcoreinfo/>
Nov 13 18:53:23 user nova-compute[75216]:   </features>
Nov 13 18:53:23 user nova-compute[75216]:   <clock offset="utc">
Nov 13 18:53:23 user nova-compute[75216]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 18:53:23 user nova-compute[75216]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 18:53:23 user nova-compute[75216]:     <timer name="hpet" present="no"/>
Nov 13 18:53:23 user nova-compute[75216]:   </clock>
Nov 13 18:53:23 user nova-compute[75216]:   <cpu mode="custom" match="exact">
Nov 13 18:53:23 user nova-compute[75216]:     <model>Nehalem</model>
Nov 13 18:53:23 user nova-compute[75216]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 18:53:23 user nova-compute[75216]:   </cpu>
Nov 13 18:53:23 user nova-compute[75216]:   <devices>
Nov 13 18:53:23 user nova-compute[75216]:     <disk type="file" device="disk">
Nov 13 18:53:23 user nova-compute[75216]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 18:53:23 user nova-compute[75216]:       <source file="/opt/stack/data/nova/instances/d9a1edfb-c2ac-4e67-abac-c915ea22a15c/disk"/>
Nov 13 18:53:23 user nova-compute[75216]:       <target dev="vda" bus="virtio"/>
Nov 13 18:53:23 user nova-compute[75216]:     </disk>
Nov 13 18:53:23 user nova-compute[75216]:     <interface type="ethernet">
Nov 13 18:53:23 user nova-compute[75216]:       <mac address="fa:16:3e:8d:84:60"/>
Nov 13 18:53:23 user nova-compute[75216]:       <model type="virtio"/>
Nov 13 18:53:23 user nova-compute[75216]:       <mtu size="1442"/>
Nov 13 18:53:23 user nova-compute[75216]:       <target dev="tapeb2895a9-12"/>
Nov 13 18:53:23 user nova-compute[75216]:     </interface>
Nov 13 18:53:23 user nova-compute[75216]:     <serial type="pty">
Nov 13 18:53:23 user nova-compute[75216]:       <log file="/opt/stack/data/nova/instances/d9a1edfb-c2ac-4e67-abac-c915ea22a15c/console.log" append="off"/>
Nov 13 18:53:23 user nova-compute[75216]:     </serial>
Nov 13 18:53:23 user nova-compute[75216]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 18:53:23 user nova-compute[75216]:     <video>
Nov 13 18:53:23 user nova-compute[75216]:       <model type="virtio"/>
Nov 13 18:53:23 user nova-compute[75216]:     </video>
Nov 13 18:53:23 user nova-compute[75216]:     <rng model="virtio">
Nov 13 18:53:23 user nova-compute[75216]:       <backend model="random">/dev/urandom</backend>
Nov 13 18:53:23 user nova-compute[75216]:     </rng>
Nov 13 18:53:23 user nova-compute[75216]:     <controller type="usb" index="0" model="none"/>
Nov 13 18:53:23 user nova-compute[75216]:     <memballoon model="virtio">
Nov 13 18:53:23 user nova-compute[75216]:       <stats period="10"/>
Nov 13 18:53:23 user nova-compute[75216]:     </memballoon>
Nov 13 18:53:23 user nova-compute[75216]:   </devices>
Nov 13 18:53:23 user nova-compute[75216]: </domain>
Nov 13 18:53:23 user nova-compute[75216]:  {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 18:53:23 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-d70aea5f-b5f2-409d-bcee-9fca42d7049f tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T18:53:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-592596084',display_name='tempest-ServerRescueNegativeTestJSON-server-592596084',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-592596084',id=21,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK+2PkxKKa7trQ91oahynfsb+ED4eBrX/gngy0uUVn/I9HNQHRE/MYLJgkcv2KjmmoqwoAll/FQqq9eo5uxBEri6NDF/QBB2CwxMJWgUT8869feJBRIceiVszXyooPeT3Q==',key_name='tempest-keypair-1092347516',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2efafc26c47c4050bd367c47469999fb',ramdisk_id='',reservation_id='r-5rr602jn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-165310019',owner_user_name='tempest-ServerRescueNegativeTestJSON-165310019-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T18:53:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3587565f5b56450e95f2bd572d7e4f88',uuid=d9a1edfb-c2ac-4e67-abac-c915ea22a15c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eb2895a9-124a-4504-b197-bb2022f3f55f", "address": "fa:16:3e:8d:84:60", "network": {"id": "6d182db1-03b5-4d1b-86cf-b9367921b7b0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1877006951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2efafc26c47c4050bd367c47469999fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb2895a9-12", "ovs_interfaceid": "eb2895a9-124a-4504-b197-bb2022f3f55f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 18:53:23 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-d70aea5f-b5f2-409d-bcee-9fca42d7049f tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Converting VIF {"id": "eb2895a9-124a-4504-b197-bb2022f3f55f", "address": "fa:16:3e:8d:84:60", "network": {"id": "6d182db1-03b5-4d1b-86cf-b9367921b7b0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1877006951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2efafc26c47c4050bd367c47469999fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb2895a9-12", "ovs_interfaceid": "eb2895a9-124a-4504-b197-bb2022f3f55f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 18:53:23 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-d70aea5f-b5f2-409d-bcee-9fca42d7049f tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:84:60,bridge_name='br-int',has_traffic_filtering=True,id=eb2895a9-124a-4504-b197-bb2022f3f55f,network=Network(6d182db1-03b5-4d1b-86cf-b9367921b7b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb2895a9-12') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 18:53:23 user nova-compute[75216]: DEBUG os_vif [None req-d70aea5f-b5f2-409d-bcee-9fca42d7049f tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:84:60,bridge_name='br-int',has_traffic_filtering=True,id=eb2895a9-124a-4504-b197-bb2022f3f55f,network=Network(6d182db1-03b5-4d1b-86cf-b9367921b7b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb2895a9-12') {{(pid=75216) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 18:53:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:53:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:53:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 18:53:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:53:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9ee9b238-6d37-59c9-a33a-a9db438b3cad', '_type': 'linux-noop'}}, row=False) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:53:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:53:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:53:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapeb2895a9-12, may_exist=True, interface_attrs={}) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:53:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapeb2895a9-12, col_values=(('qos', UUID('67dd2b28-2adf-4fbb-8eaa-70bc35558799')),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:53:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapeb2895a9-12, col_values=(('external_ids', {'iface-id': 'eb2895a9-124a-4504-b197-bb2022f3f55f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8d:84:60', 'vm-uuid': 'd9a1edfb-c2ac-4e67-abac-c915ea22a15c'}),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:53:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:53:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:53:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:53:23 user nova-compute[75216]: INFO os_vif [None req-d70aea5f-b5f2-409d-bcee-9fca42d7049f tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:84:60,bridge_name='br-int',has_traffic_filtering=True,id=eb2895a9-124a-4504-b197-bb2022f3f55f,network=Network(6d182db1-03b5-4d1b-86cf-b9367921b7b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb2895a9-12')
Nov 13 18:53:23 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-d70aea5f-b5f2-409d-bcee-9fca42d7049f tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 18:53:23 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-d70aea5f-b5f2-409d-bcee-9fca42d7049f tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] No VIF found with MAC fa:16:3e:8d:84:60, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 18:53:24 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:53:24 user nova-compute[75216]: DEBUG nova.network.neutron [req-5ae3fabe-14dc-461b-9ce7-945704d84e4c req-15c46f6f-f940-491c-84af-2d32398e94d0 service nova] [instance: d9a1edfb-c2ac-4e67-abac-c915ea22a15c] Updated VIF entry in instance network info cache for port eb2895a9-124a-4504-b197-bb2022f3f55f. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 18:53:24 user nova-compute[75216]: DEBUG nova.network.neutron [req-5ae3fabe-14dc-461b-9ce7-945704d84e4c req-15c46f6f-f940-491c-84af-2d32398e94d0 service nova] [instance: d9a1edfb-c2ac-4e67-abac-c915ea22a15c] Updating instance_info_cache with network_info: [{"id": "eb2895a9-124a-4504-b197-bb2022f3f55f", "address": "fa:16:3e:8d:84:60", "network": {"id": "6d182db1-03b5-4d1b-86cf-b9367921b7b0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1877006951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2efafc26c47c4050bd367c47469999fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb2895a9-12", "ovs_interfaceid": "eb2895a9-124a-4504-b197-bb2022f3f55f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 18:53:24 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-5ae3fabe-14dc-461b-9ce7-945704d84e4c req-15c46f6f-f940-491c-84af-2d32398e94d0 service nova] Releasing lock "refresh_cache-d9a1edfb-c2ac-4e67-abac-c915ea22a15c" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 18:53:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:53:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:53:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:53:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:53:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:53:25 user nova-compute[75216]: DEBUG nova.compute.manager [req-18432dfa-5a18-476b-ab3f-a15e2cd3021b req-784f12d0-6724-4fb3-9a4f-8ae0697f8cf1 service nova] [instance: d9a1edfb-c2ac-4e67-abac-c915ea22a15c] Received event network-vif-plugged-eb2895a9-124a-4504-b197-bb2022f3f55f {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:53:25 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-18432dfa-5a18-476b-ab3f-a15e2cd3021b req-784f12d0-6724-4fb3-9a4f-8ae0697f8cf1 service nova] Acquiring lock "d9a1edfb-c2ac-4e67-abac-c915ea22a15c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:53:25 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-18432dfa-5a18-476b-ab3f-a15e2cd3021b req-784f12d0-6724-4fb3-9a4f-8ae0697f8cf1 service nova] Lock "d9a1edfb-c2ac-4e67-abac-c915ea22a15c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:53:25 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-18432dfa-5a18-476b-ab3f-a15e2cd3021b req-784f12d0-6724-4fb3-9a4f-8ae0697f8cf1 service nova] Lock "d9a1edfb-c2ac-4e67-abac-c915ea22a15c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:53:25 user nova-compute[75216]: DEBUG nova.compute.manager [req-18432dfa-5a18-476b-ab3f-a15e2cd3021b req-784f12d0-6724-4fb3-9a4f-8ae0697f8cf1 service nova] [instance: d9a1edfb-c2ac-4e67-abac-c915ea22a15c] No waiting events found dispatching network-vif-plugged-eb2895a9-124a-4504-b197-bb2022f3f55f {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:53:25 user nova-compute[75216]: WARNING nova.compute.manager [req-18432dfa-5a18-476b-ab3f-a15e2cd3021b req-784f12d0-6724-4fb3-9a4f-8ae0697f8cf1 service nova] [instance: d9a1edfb-c2ac-4e67-abac-c915ea22a15c] Received unexpected event network-vif-plugged-eb2895a9-124a-4504-b197-bb2022f3f55f for instance with vm_state building and task_state spawning.
Nov 13 18:53:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:53:27 user nova-compute[75216]: DEBUG nova.compute.manager [None req-d70aea5f-b5f2-409d-bcee-9fca42d7049f tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] [instance: d9a1edfb-c2ac-4e67-abac-c915ea22a15c] Instance event wait completed in 0 seconds for  {{(pid=75216) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 18:53:27 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-d70aea5f-b5f2-409d-bcee-9fca42d7049f tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] [instance: d9a1edfb-c2ac-4e67-abac-c915ea22a15c] Guest created on hypervisor {{(pid=75216) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 18:53:27 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: d9a1edfb-c2ac-4e67-abac-c915ea22a15c] Instance spawned successfully.
Nov 13 18:53:27 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-d70aea5f-b5f2-409d-bcee-9fca42d7049f tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] [instance: d9a1edfb-c2ac-4e67-abac-c915ea22a15c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 18:53:27 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-d70aea5f-b5f2-409d-bcee-9fca42d7049f tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] [instance: d9a1edfb-c2ac-4e67-abac-c915ea22a15c] Found default for hw_cdrom_bus of ide {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 18:53:27 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-d70aea5f-b5f2-409d-bcee-9fca42d7049f tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] [instance: d9a1edfb-c2ac-4e67-abac-c915ea22a15c] Found default for hw_disk_bus of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 18:53:27 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-d70aea5f-b5f2-409d-bcee-9fca42d7049f tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] [instance: d9a1edfb-c2ac-4e67-abac-c915ea22a15c] Found default for hw_input_bus of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 18:53:27 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-d70aea5f-b5f2-409d-bcee-9fca42d7049f tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] [instance: d9a1edfb-c2ac-4e67-abac-c915ea22a15c] Found default for hw_pointer_model of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 18:53:27 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-d70aea5f-b5f2-409d-bcee-9fca42d7049f tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] [instance: d9a1edfb-c2ac-4e67-abac-c915ea22a15c] Found default for hw_video_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 18:53:27 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-d70aea5f-b5f2-409d-bcee-9fca42d7049f tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] [instance: d9a1edfb-c2ac-4e67-abac-c915ea22a15c] Found default for hw_vif_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 18:53:27 user nova-compute[75216]: INFO nova.compute.manager [None req-d70aea5f-b5f2-409d-bcee-9fca42d7049f tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] [instance: d9a1edfb-c2ac-4e67-abac-c915ea22a15c] Took 6.08 seconds to spawn the instance on the hypervisor.
Nov 13 18:53:27 user nova-compute[75216]: DEBUG nova.compute.manager [None req-d70aea5f-b5f2-409d-bcee-9fca42d7049f tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] [instance: d9a1edfb-c2ac-4e67-abac-c915ea22a15c] Checking state {{(pid=75216) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 18:53:27 user nova-compute[75216]: DEBUG nova.compute.manager [req-7620b2ea-2ff8-445f-bd9c-3c64a99a4581 req-65b02f11-5bf5-40c8-aec8-f67ba5e507bd service nova] [instance: d9a1edfb-c2ac-4e67-abac-c915ea22a15c] Received event network-vif-plugged-eb2895a9-124a-4504-b197-bb2022f3f55f {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:53:27 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-7620b2ea-2ff8-445f-bd9c-3c64a99a4581 req-65b02f11-5bf5-40c8-aec8-f67ba5e507bd service nova] Acquiring lock "d9a1edfb-c2ac-4e67-abac-c915ea22a15c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:53:27 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-7620b2ea-2ff8-445f-bd9c-3c64a99a4581 req-65b02f11-5bf5-40c8-aec8-f67ba5e507bd service nova] Lock "d9a1edfb-c2ac-4e67-abac-c915ea22a15c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:53:27 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-7620b2ea-2ff8-445f-bd9c-3c64a99a4581 req-65b02f11-5bf5-40c8-aec8-f67ba5e507bd service nova] Lock "d9a1edfb-c2ac-4e67-abac-c915ea22a15c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:53:27 user nova-compute[75216]: DEBUG nova.compute.manager [req-7620b2ea-2ff8-445f-bd9c-3c64a99a4581 req-65b02f11-5bf5-40c8-aec8-f67ba5e507bd service nova] [instance: d9a1edfb-c2ac-4e67-abac-c915ea22a15c] No waiting events found dispatching network-vif-plugged-eb2895a9-124a-4504-b197-bb2022f3f55f {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:53:27 user nova-compute[75216]: WARNING nova.compute.manager [req-7620b2ea-2ff8-445f-bd9c-3c64a99a4581 req-65b02f11-5bf5-40c8-aec8-f67ba5e507bd service nova] [instance: d9a1edfb-c2ac-4e67-abac-c915ea22a15c] Received unexpected event network-vif-plugged-eb2895a9-124a-4504-b197-bb2022f3f55f for instance with vm_state building and task_state spawning.
Nov 13 18:53:27 user nova-compute[75216]: INFO nova.compute.manager [None req-d70aea5f-b5f2-409d-bcee-9fca42d7049f tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] [instance: d9a1edfb-c2ac-4e67-abac-c915ea22a15c] Took 6.87 seconds to build instance.
Nov 13 18:53:27 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-d70aea5f-b5f2-409d-bcee-9fca42d7049f tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Lock "d9a1edfb-c2ac-4e67-abac-c915ea22a15c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.003s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:53:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:53:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:53:31 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e6636549-0f1e-4de7-a620-49510e442988 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Acquiring lock "91ea8a19-a365-484c-80c7-baf90e7dd1aa" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:53:31 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e6636549-0f1e-4de7-a620-49510e442988 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Lock "91ea8a19-a365-484c-80c7-baf90e7dd1aa" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:53:31 user nova-compute[75216]: DEBUG nova.objects.instance [None req-e6636549-0f1e-4de7-a620-49510e442988 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Lazy-loading 'flavor' on Instance uuid 91ea8a19-a365-484c-80c7-baf90e7dd1aa {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 18:53:31 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e6636549-0f1e-4de7-a620-49510e442988 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Lock "91ea8a19-a365-484c-80c7-baf90e7dd1aa" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.160s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:53:32 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e6636549-0f1e-4de7-a620-49510e442988 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Acquiring lock "91ea8a19-a365-484c-80c7-baf90e7dd1aa" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:53:32 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e6636549-0f1e-4de7-a620-49510e442988 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Lock "91ea8a19-a365-484c-80c7-baf90e7dd1aa" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:53:32 user nova-compute[75216]: INFO nova.compute.manager [None req-e6636549-0f1e-4de7-a620-49510e442988 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] [instance: 91ea8a19-a365-484c-80c7-baf90e7dd1aa] Attaching volume 82de1607-b976-408c-b503-062b8569f72d to /dev/vdb
Nov 13 18:53:32 user nova-compute[75216]: DEBUG os_brick.utils [None req-e6636549-0f1e-4de7-a620-49510e442988 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 18:53:32 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:53:32 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:53:32 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a6b466e-01cd-4212-af82-a8b28333ff6f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aea6fcfe14b9\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:53:32 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:53:32 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:53:32 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[74b86b03-7c67-4efa-b70c-393eaab3c914]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:53:32 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:53:32 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:53:32 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[47aa58bc-6ee8-449b-9c92-4799ff6b4479]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:53:32 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff6652c1-6c72-4292-a16f-46c2949beb5b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:53:32 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-e6636549-0f1e-4de7-a620-49510e442988 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Running cmd (subprocess): nvme version {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:53:32 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-e6636549-0f1e-4de7-a620-49510e442988 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] 'nvme version' failed. Not Retrying. {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 18:53:32 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e6636549-0f1e-4de7-a620-49510e442988 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] nvme not present on system {{(pid=75216) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 18:53:32 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:53:32 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 18:53:32 user nova-compute[75216]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 18:53:32 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dabe4b1-29ba-4073-80b6-e5788847f639]: (4, '') {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:53:32 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-e6636549-0f1e-4de7-a620-49510e442988 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75216) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 18:53:32 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-e6636549-0f1e-4de7-a620-49510e442988 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 18:53:32 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-e6636549-0f1e-4de7-a620-49510e442988 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] LIGHTOS: no hostnqn found. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 18:53:32 user nova-compute[75216]: DEBUG os_brick.utils [None req-e6636549-0f1e-4de7-a620-49510e442988 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aea6fcfe14b9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 18:53:32 user nova-compute[75216]: DEBUG nova.virt.block_device [None req-e6636549-0f1e-4de7-a620-49510e442988 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] [instance: 91ea8a19-a365-484c-80c7-baf90e7dd1aa] Updating existing volume attachment record: 41ca25af-bf1d-4f75-a6bc-bbfd64562bac {{(pid=75216) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 18:53:33 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:53:35 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:53:37 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e6636549-0f1e-4de7-a620-49510e442988 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] [instance: 91ea8a19-a365-484c-80c7-baf90e7dd1aa] Calling os-brick to attach iSCSI Volume {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 18:53:37 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6636549-0f1e-4de7-a620-49510e442988 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3a8669e40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JvBCenjA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 18:53:37 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-e6636549-0f1e-4de7-a620-49510e442988 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 18:53:37 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-e6636549-0f1e-4de7-a620-49510e442988 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 18:53:37 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-e6636549-0f1e-4de7-a620-49510e442988 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 18:53:37 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-e6636549-0f1e-4de7-a620-49510e442988 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 18:53:37 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-e6636549-0f1e-4de7-a620-49510e442988 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 18:53:37 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-e6636549-0f1e-4de7-a620-49510e442988 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 18:53:37 user nova-compute[75216]: INFO os_brick.initiator.connectors.iscsi [None req-e6636549-0f1e-4de7-a620-49510e442988 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 18:53:37 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d -p 172.16.0.220:3260 {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:53:37 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:53:37 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[c91d5377-a809-491d-9d4c-d5673cb05639]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:53:37 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6636549-0f1e-4de7-a620-49510e442988 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 18:53:37 user nova-compute[75216]:  {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:53:37 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d -p 172.16.0.220:3260 --interface default --op new {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:53:37 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:53:37 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a220954-6093-48a3-b819-3ba3591770b3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d] added\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:53:37 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6636549-0f1e-4de7-a620-49510e442988 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d] added
Nov 13 18:53:37 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:53:37 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:53:37 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:53:37 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[48e6c5a2-cab0-4763-8bd6-33d4e513d84f]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:53:37 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6636549-0f1e-4de7-a620-49510e442988 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:53:37 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:53:37 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:53:37 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[44d10497-83c1-49eb-8ad5-a5dcae7f7686]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:53:37 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6636549-0f1e-4de7-a620-49510e442988 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:53:37 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JvBCenjA {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:53:37 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JvBCenjA" returned: 0 in 0.031s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:53:37 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[193d519d-abba-47ff-9267-750ebe45ada2]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:53:37 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6636549-0f1e-4de7-a620-49510e442988 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JvBCenjA'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:53:37 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:53:37 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:53:37 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6ea4b9e-4455-49a5-a92c-68e45ab2fe30]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:53:37 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6636549-0f1e-4de7-a620-49510e442988 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:53:37 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:53:37 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:53:37 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[28133a46-fa1a-466d-9b23-d3b05904d9e8]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c711796-fc49-4e18-8fdd-eefe1e3b357c (non-flash)\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:53:37 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6636549-0f1e-4de7-a620-49510e442988 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c711796-fc49-4e18-8fdd-eefe1e3b357c (non-flash)
Nov 13 18:53:37 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 18:53:37 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6636549-0f1e-4de7-a620-49510e442988 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c711796-fc49-4e18-8fdd-eefe1e3b357c (non-flash)
Nov 13 18:53:37 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 18:53:37 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d -p 172.16.0.220:3260 --login {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:53:37 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:53:37 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[43689914-63c9-4f2f-beda-0fbf6edaf4c9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:53:37 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6636549-0f1e-4de7-a620-49510e442988 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d, portal: 172.16.0.220,3260]
Nov 13 18:53:37 user nova-compute[75216]: Login to [iface: default, target: iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d, portal: 172.16.0.220,3260] successful.
Nov 13 18:53:37 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:53:37 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:53:37 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:53:37 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[3129d38d-a114-4751-8700-25f0041c43e8]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:53:37 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6636549-0f1e-4de7-a620-49510e442988 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:53:37 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:53:37 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:53:37 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfe9192a-5032-42b6-b4ef-078eb764c712]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c711796-fc49-4e18-8fdd-eefe1e3b357c (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d (non-flash)\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:53:37 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6636549-0f1e-4de7-a620-49510e442988 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c711796-fc49-4e18-8fdd-eefe1e3b357c (non-flash)
Nov 13 18:53:37 user nova-compute[75216]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d (non-flash)
Nov 13 18:53:37 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 18:53:37 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6636549-0f1e-4de7-a620-49510e442988 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c711796-fc49-4e18-8fdd-eefe1e3b357c (non-flash)
Nov 13 18:53:37 user nova-compute[75216]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d (non-flash)
Nov 13 18:53:37 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 18:53:37 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-e6636549-0f1e-4de7-a620-49510e442988 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.314s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 18:53:37 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6636549-0f1e-4de7-a620-49510e442988 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Connected to 172.16.0.220:3260 {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 18:53:37 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-e6636549-0f1e-4de7-a620-49510e442988 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] HCTL ('33', '-', '-', 0) found on session 27 with lun 0 {{(pid=75216) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 18:53:37 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-e6636549-0f1e-4de7-a620-49510e442988 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75216) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 18:53:37 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:53:37 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:53:37 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[58e980cd-a57a-4aa6-b736-bfafba055420]: (4, ('- - 0', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:53:37 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-e6636549-0f1e-4de7-a620-49510e442988 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Searching for a device in session 27 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75216) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 18:53:37 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6636549-0f1e-4de7-a620-49510e442988 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JvBCenjA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 18:53:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:53:38 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-e6636549-0f1e-4de7-a620-49510e442988 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.351s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 18:53:38 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6636549-0f1e-4de7-a620-49510e442988 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] <== connect_volume: return (1353ms) {'type': 'block', 'scsi_wwn': '26539373964636136', 'path': '/dev/sdb'} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 18:53:38 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e6636549-0f1e-4de7-a620-49510e442988 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] [instance: 91ea8a19-a365-484c-80c7-baf90e7dd1aa] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26539373964636136', 'path': '/dev/sdb'} {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 18:53:38 user nova-compute[75216]: DEBUG nova.objects.instance [None req-e6636549-0f1e-4de7-a620-49510e442988 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Lazy-loading 'flavor' on Instance uuid 91ea8a19-a365-484c-80c7-baf90e7dd1aa {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 18:53:38 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-e6636549-0f1e-4de7-a620-49510e442988 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] attach device xml: <disk type="block" device="disk">
Nov 13 18:53:38 user nova-compute[75216]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 18:53:38 user nova-compute[75216]:   <source dev="/dev/sdb"/>
Nov 13 18:53:38 user nova-compute[75216]:   <target dev="vdb" bus="virtio"/>
Nov 13 18:53:38 user nova-compute[75216]:   <serial>82de1607-b976-408c-b503-062b8569f72d</serial>
Nov 13 18:53:38 user nova-compute[75216]: </disk>
Nov 13 18:53:38 user nova-compute[75216]:  {{(pid=75216) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 13 18:53:38 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:53:38 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:53:38 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-e6636549-0f1e-4de7-a620-49510e442988 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 18:53:38 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-e6636549-0f1e-4de7-a620-49510e442988 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 18:53:38 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-e6636549-0f1e-4de7-a620-49510e442988 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] No VIF found with MAC fa:16:3e:3e:1d:91, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 18:53:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e6636549-0f1e-4de7-a620-49510e442988 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Lock "91ea8a19-a365-484c-80c7-baf90e7dd1aa" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.970s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:53:41 user nova-compute[75216]: DEBUG nova.compute.manager [None req-40e625e0-9112-4deb-8e2e-695e767786db tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] [instance: 91ea8a19-a365-484c-80c7-baf90e7dd1aa] Stashing vm_state: active {{(pid=75216) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 13 18:53:41 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-40e625e0-9112-4deb-8e2e-695e767786db tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:53:41 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-40e625e0-9112-4deb-8e2e-695e767786db tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:53:41 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-40e625e0-9112-4deb-8e2e-695e767786db tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75216) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 18:53:41 user nova-compute[75216]: INFO nova.compute.claims [None req-40e625e0-9112-4deb-8e2e-695e767786db tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] [instance: 91ea8a19-a365-484c-80c7-baf90e7dd1aa] Claim successful on node user
Nov 13 18:53:41 user nova-compute[75216]: INFO nova.compute.resource_tracker [None req-40e625e0-9112-4deb-8e2e-695e767786db tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] [instance: 91ea8a19-a365-484c-80c7-baf90e7dd1aa] Updating resource usage from migration 0ae048ac-88ae-4635-acf7-90c85c69f04d
Nov 13 18:53:42 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:53:42 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-40e625e0-9112-4deb-8e2e-695e767786db tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 18:53:42 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-40e625e0-9112-4deb-8e2e-695e767786db tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 18:53:42 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-40e625e0-9112-4deb-8e2e-695e767786db tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.412s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:53:42 user nova-compute[75216]: INFO nova.compute.manager [None req-40e625e0-9112-4deb-8e2e-695e767786db tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] [instance: 91ea8a19-a365-484c-80c7-baf90e7dd1aa] Migrating
Nov 13 18:53:42 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-40e625e0-9112-4deb-8e2e-695e767786db tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 18:53:42 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-40e625e0-9112-4deb-8e2e-695e767786db tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Acquired lock "compute-rpcapi-router" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 18:53:42 user nova-compute[75216]: INFO nova.compute.rpcapi [None req-40e625e0-9112-4deb-8e2e-695e767786db tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Nov 13 18:53:42 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-40e625e0-9112-4deb-8e2e-695e767786db tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Releasing lock "compute-rpcapi-router" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 18:53:42 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-40e625e0-9112-4deb-8e2e-695e767786db tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Acquiring lock "refresh_cache-91ea8a19-a365-484c-80c7-baf90e7dd1aa" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 18:53:42 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-40e625e0-9112-4deb-8e2e-695e767786db tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Acquired lock "refresh_cache-91ea8a19-a365-484c-80c7-baf90e7dd1aa" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 18:53:42 user nova-compute[75216]: DEBUG nova.network.neutron [None req-40e625e0-9112-4deb-8e2e-695e767786db tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] [instance: 91ea8a19-a365-484c-80c7-baf90e7dd1aa] Building network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 18:53:42 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-e82f6dba-8384-49ad-b6ac-700bac44e3fc tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 7c9d9c1b-6df5-41ff-a696-871e70d04e07 is timed out.
Nov 13 18:53:42 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-e82f6dba-8384-49ad-b6ac-700bac44e3fc tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Successfully detached device vdb from instance 7c9d9c1b-6df5-41ff-a696-871e70d04e07 from the live domain config.
Nov 13 18:53:42 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e82f6dba-8384-49ad-b6ac-700bac44e3fc tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: 7c9d9c1b-6df5-41ff-a696-871e70d04e07] calling os-brick to detach iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 18:53:42 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e82f6dba-8384-49ad-b6ac-700bac44e3fc tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3a8669e40>, {'target_iqn': 'iqn.2010-10.org.openstack:6c711796-fc49-4e18-8fdd-eefe1e3b357c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yaDuxRtQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 18:53:42 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-e82f6dba-8384-49ad-b6ac-700bac44e3fc tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 18:53:42 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-e82f6dba-8384-49ad-b6ac-700bac44e3fc tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 18:53:42 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-e82f6dba-8384-49ad-b6ac-700bac44e3fc tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 18:53:42 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:53:42 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:53:42 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[3faab407-fa2d-4b07-a9a5-70a7b553b418]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6c711796-fc49-4e18-8fdd-eefe1e3b357c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:53:42 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e82f6dba-8384-49ad-b6ac-700bac44e3fc tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 18:53:42 user nova-compute[75216]: No targets found.
Nov 13 18:53:42 user nova-compute[75216]: iSNS:
Nov 13 18:53:42 user nova-compute[75216]: No targets found.
Nov 13 18:53:42 user nova-compute[75216]: STATIC:
Nov 13 18:53:42 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d
Nov 13 18:53:42 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 18:53:42 user nova-compute[75216]:                 Iface Name: default
Nov 13 18:53:42 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:6c711796-fc49-4e18-8fdd-eefe1e3b357c
Nov 13 18:53:42 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 18:53:42 user nova-compute[75216]:                 Iface Name: default
Nov 13 18:53:42 user nova-compute[75216]: FIRMWARE:
Nov 13 18:53:42 user nova-compute[75216]: No targets found.
Nov 13 18:53:42 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 18:53:42 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e82f6dba-8384-49ad-b6ac-700bac44e3fc tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 18:53:42 user nova-compute[75216]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 18:53:42 user nova-compute[75216]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75216) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 18:53:42 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e82f6dba-8384-49ad-b6ac-700bac44e3fc tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6c711796-fc49-4e18-8fdd-eefe1e3b357c', 0)] {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 18:53:42 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:53:42 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:53:42 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[93bde8b0-8494-4c8b-ac22-ab77ca940541]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6c711796-fc49-4e18-8fdd-eefe1e3b357c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:53:42 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:53:42 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:53:42 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[804d1604-522f-46aa-921b-36963b8df195]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c711796-fc49-4e18-8fdd-eefe1e3b357c (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d (non-flash)\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:53:42 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e82f6dba-8384-49ad-b6ac-700bac44e3fc tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c711796-fc49-4e18-8fdd-eefe1e3b357c (non-flash)
Nov 13 18:53:42 user nova-compute[75216]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d (non-flash)
Nov 13 18:53:42 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 18:53:42 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e82f6dba-8384-49ad-b6ac-700bac44e3fc tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c711796-fc49-4e18-8fdd-eefe1e3b357c (non-flash)
Nov 13 18:53:42 user nova-compute[75216]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d (non-flash)
Nov 13 18:53:42 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 18:53:42 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e82f6dba-8384-49ad-b6ac-700bac44e3fc tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe3c029acb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6c711796-fc49-4e18-8fdd-eefe1e3b357c'): ({'sdd'}, set())}) {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 18:53:42 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-e82f6dba-8384-49ad-b6ac-700bac44e3fc tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Removing single pathed devices sdd {{(pid=75216) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 18:53:42 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:53:42 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:53:42 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[efb9144b-f317-4cb7-a9fe-df97e5d855ed]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:53:42 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:53:42 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:53:42 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f9f5502-0dd9-48f0-bd2f-88cc2a8276ba]: (4, ('ok\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:53:42 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-e82f6dba-8384-49ad-b6ac-700bac44e3fc tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Flushing IO for device /dev/sdd {{(pid=75216) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 18:53:42 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:53:42 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:53:42 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[6711c6ff-de25-48cd-8fa0-d0351180b940]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:53:42 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-e82f6dba-8384-49ad-b6ac-700bac44e3fc tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75216) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 18:53:42 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:53:42 user nova-compute[75216]: DEBUG nova.network.neutron [None req-40e625e0-9112-4deb-8e2e-695e767786db tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] [instance: 91ea8a19-a365-484c-80c7-baf90e7dd1aa] Updating instance_info_cache with network_info: [{"id": "2cfb645f-7bee-4657-b0d8-afcaa0298ac9", "address": "fa:16:3e:3e:1d:91", "network": {"id": "a9670fc3-8a8e-4a2b-a39f-d41042d3443d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1394481632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0194e3c88e2b49c5ba9b9844f6048ea9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cfb645f-7b", "ovs_interfaceid": "2cfb645f-7bee-4657-b0d8-afcaa0298ac9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 18:53:42 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-40e625e0-9112-4deb-8e2e-695e767786db tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Releasing lock "refresh_cache-91ea8a19-a365-484c-80c7-baf90e7dd1aa" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 18:53:42 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.051s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:53:42 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e59ef43-31e5-4681-bb26-64551962ded5]: (4, ('1', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:53:42 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-e82f6dba-8384-49ad-b6ac-700bac44e3fc tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 18:53:42 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-e82f6dba-8384-49ad-b6ac-700bac44e3fc tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] SCSI volumes sdd have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 18:53:42 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e82f6dba-8384-49ad-b6ac-700bac44e3fc tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6c711796-fc49-4e18-8fdd-eefe1e3b357c')] {{(pid=75216) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 18:53:42 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c711796-fc49-4e18-8fdd-eefe1e3b357c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:53:42 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c711796-fc49-4e18-8fdd-eefe1e3b357c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.031s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:53:42 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[95cc53c6-9300-404f-9f9d-71b057633141]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:53:42 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e82f6dba-8384-49ad-b6ac-700bac44e3fc tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:53:42 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c711796-fc49-4e18-8fdd-eefe1e3b357c -p 172.16.0.220:3260 --logout {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:53:43 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c711796-fc49-4e18-8fdd-eefe1e3b357c -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:53:43 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4f64e11-7183-451f-b0e7-4fea7e9fc2a7]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:6c711796-fc49-4e18-8fdd-eefe1e3b357c, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:6c711796-fc49-4e18-8fdd-eefe1e3b357c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:53:43 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e82f6dba-8384-49ad-b6ac-700bac44e3fc tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:6c711796-fc49-4e18-8fdd-eefe1e3b357c, portal: 172.16.0.220,3260]
Nov 13 18:53:43 user nova-compute[75216]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:6c711796-fc49-4e18-8fdd-eefe1e3b357c, portal: 172.16.0.220,3260] successful.
Nov 13 18:53:43 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:53:43 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c711796-fc49-4e18-8fdd-eefe1e3b357c -p 172.16.0.220:3260 --op delete {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:53:43 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c711796-fc49-4e18-8fdd-eefe1e3b357c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:53:43 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[82c0b247-3f83-4010-a465-d9beeffc6bd4]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:53:43 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e82f6dba-8384-49ad-b6ac-700bac44e3fc tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:53:43 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-e82f6dba-8384-49ad-b6ac-700bac44e3fc tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.335s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 18:53:43 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e82f6dba-8384-49ad-b6ac-700bac44e3fc tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] <== disconnect_volume: return (336ms) None {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 18:53:43 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e82f6dba-8384-49ad-b6ac-700bac44e3fc tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: 7c9d9c1b-6df5-41ff-a696-871e70d04e07] Disconnected iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 18:53:43 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-40e625e0-9112-4deb-8e2e-695e767786db tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] [instance: 91ea8a19-a365-484c-80c7-baf90e7dd1aa] Starting migrate_disk_and_power_off {{(pid=75216) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Nov 13 18:53:43 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:53:43 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:53:43 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:53:43 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:53:43 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:53:43 user nova-compute[75216]: DEBUG nova.compute.manager [req-f436d40e-5ae9-4662-a519-f27777632cc1 req-c28a4585-1b8b-43d4-ad22-f02fd43de734 service nova] [instance: 91ea8a19-a365-484c-80c7-baf90e7dd1aa] Received event network-vif-unplugged-2cfb645f-7bee-4657-b0d8-afcaa0298ac9 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:53:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-f436d40e-5ae9-4662-a519-f27777632cc1 req-c28a4585-1b8b-43d4-ad22-f02fd43de734 service nova] Acquiring lock "91ea8a19-a365-484c-80c7-baf90e7dd1aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:53:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-f436d40e-5ae9-4662-a519-f27777632cc1 req-c28a4585-1b8b-43d4-ad22-f02fd43de734 service nova] Lock "91ea8a19-a365-484c-80c7-baf90e7dd1aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:53:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-f436d40e-5ae9-4662-a519-f27777632cc1 req-c28a4585-1b8b-43d4-ad22-f02fd43de734 service nova] Lock "91ea8a19-a365-484c-80c7-baf90e7dd1aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:53:43 user nova-compute[75216]: DEBUG nova.compute.manager [req-f436d40e-5ae9-4662-a519-f27777632cc1 req-c28a4585-1b8b-43d4-ad22-f02fd43de734 service nova] [instance: 91ea8a19-a365-484c-80c7-baf90e7dd1aa] No waiting events found dispatching network-vif-unplugged-2cfb645f-7bee-4657-b0d8-afcaa0298ac9 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:53:43 user nova-compute[75216]: WARNING nova.compute.manager [req-f436d40e-5ae9-4662-a519-f27777632cc1 req-c28a4585-1b8b-43d4-ad22-f02fd43de734 service nova] [instance: 91ea8a19-a365-484c-80c7-baf90e7dd1aa] Received unexpected event network-vif-unplugged-2cfb645f-7bee-4657-b0d8-afcaa0298ac9 for instance with vm_state active and task_state resize_migrating.
Nov 13 18:53:43 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:53:43 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 91ea8a19-a365-484c-80c7-baf90e7dd1aa] Instance destroyed successfully.
Nov 13 18:53:43 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-40e625e0-9112-4deb-8e2e-695e767786db tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T18:49:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2138583247',display_name='tempest-ServerActionsTestOtherB-server-2138583247',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2138583247',id=18,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAl4rrs8AsTXVVWOe2ej9Q0PBsZfl4SiBx6Z+7YBp2Q8nhbMLqhEEYWYCrwvKHOa1CVoqmRod9jN0d8asOX7OMqzQqSN/edxVDFYygCGcMd2W6HT1YDz1w3rZ0s5A43lWg==',key_name='tempest-keypair-1520178236',keypairs=<?>,launch_index=0,launched_at=2023-11-13T18:49:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='0194e3c88e2b49c5ba9b9844f6048ea9',ramdisk_id='',reservation_id='r-z6obctyl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1164011898',owner_user_name='tempest-ServerActionsTestOtherB-1164011898-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T18:53:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0543920a35a54c83bcc159b7a2b08a80',uuid=91ea8a19-a365-484c-80c7-baf90e7dd1aa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2cfb645f-7bee-4657-b0d8-afcaa0298ac9", "address": "fa:16:3e:3e:1d:91", "network": {"id": "a9670fc3-8a8e-4a2b-a39f-d41042d3443d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1394481632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1394481632-network", "vif_mac": "fa:16:3e:3e:1d:91"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0194e3c88e2b49c5ba9b9844f6048ea9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cfb645f-7b", "ovs_interfaceid": "2cfb645f-7bee-4657-b0d8-afcaa0298ac9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 18:53:43 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-40e625e0-9112-4deb-8e2e-695e767786db tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Converting VIF {"id": "2cfb645f-7bee-4657-b0d8-afcaa0298ac9", "address": "fa:16:3e:3e:1d:91", "network": {"id": "a9670fc3-8a8e-4a2b-a39f-d41042d3443d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1394481632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1394481632-network", "vif_mac": "fa:16:3e:3e:1d:91"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0194e3c88e2b49c5ba9b9844f6048ea9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cfb645f-7b", "ovs_interfaceid": "2cfb645f-7bee-4657-b0d8-afcaa0298ac9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 18:53:43 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-40e625e0-9112-4deb-8e2e-695e767786db tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3e:1d:91,bridge_name='br-int',has_traffic_filtering=True,id=2cfb645f-7bee-4657-b0d8-afcaa0298ac9,network=Network(a9670fc3-8a8e-4a2b-a39f-d41042d3443d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cfb645f-7b') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 18:53:43 user nova-compute[75216]: DEBUG os_vif [None req-40e625e0-9112-4deb-8e2e-695e767786db tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3e:1d:91,bridge_name='br-int',has_traffic_filtering=True,id=2cfb645f-7bee-4657-b0d8-afcaa0298ac9,network=Network(a9670fc3-8a8e-4a2b-a39f-d41042d3443d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cfb645f-7b') {{(pid=75216) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 18:53:43 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:53:43 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2cfb645f-7b, bridge=br-int, if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:53:43 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:53:43 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:53:43 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:53:43 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1ca4d8f7-94c8-4135-8b7c-f917143f6a83) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:53:43 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:53:43 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:53:43 user nova-compute[75216]: INFO os_vif [None req-40e625e0-9112-4deb-8e2e-695e767786db tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3e:1d:91,bridge_name='br-int',has_traffic_filtering=True,id=2cfb645f-7bee-4657-b0d8-afcaa0298ac9,network=Network(a9670fc3-8a8e-4a2b-a39f-d41042d3443d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cfb645f-7b')
Nov 13 18:53:43 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-40e625e0-9112-4deb-8e2e-695e767786db tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] [instance: 91ea8a19-a365-484c-80c7-baf90e7dd1aa] calling os-brick to detach iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 18:53:43 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-40e625e0-9112-4deb-8e2e-695e767786db tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3a8669e40>, {'target_iqn': 'iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JvBCenjA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 18:53:43 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-40e625e0-9112-4deb-8e2e-695e767786db tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 18:53:43 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-40e625e0-9112-4deb-8e2e-695e767786db tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 18:53:43 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-40e625e0-9112-4deb-8e2e-695e767786db tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 18:53:43 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:53:43 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:53:43 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[05640918-b7ce-4107-95e5-78ef96cc8eef]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:53:43 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-40e625e0-9112-4deb-8e2e-695e767786db tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 18:53:43 user nova-compute[75216]: No targets found.
Nov 13 18:53:43 user nova-compute[75216]: iSNS:
Nov 13 18:53:43 user nova-compute[75216]: No targets found.
Nov 13 18:53:43 user nova-compute[75216]: STATIC:
Nov 13 18:53:43 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d
Nov 13 18:53:43 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 18:53:43 user nova-compute[75216]:                 Iface Name: default
Nov 13 18:53:43 user nova-compute[75216]: FIRMWARE:
Nov 13 18:53:43 user nova-compute[75216]: No targets found.
Nov 13 18:53:43 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 18:53:43 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-40e625e0-9112-4deb-8e2e-695e767786db tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 18:53:43 user nova-compute[75216]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 18:53:43 user nova-compute[75216]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75216) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 18:53:43 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-40e625e0-9112-4deb-8e2e-695e767786db tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d', 0)] {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 18:53:43 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:53:43 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:53:43 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[db7f82df-0c13-4d12-a190-f1f93f7856d1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:53:43 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:53:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:53:44 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[98a5f817-2aa7-48be-8461-fec7022c9db8]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d (non-flash)\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:53:44 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-40e625e0-9112-4deb-8e2e-695e767786db tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d (non-flash)
Nov 13 18:53:44 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 18:53:44 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-40e625e0-9112-4deb-8e2e-695e767786db tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d (non-flash)
Nov 13 18:53:44 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 18:53:44 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-40e625e0-9112-4deb-8e2e-695e767786db tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe3a82b1b40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d'): ({'sdb'}, set())}) {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 18:53:44 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-40e625e0-9112-4deb-8e2e-695e767786db tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Removing single pathed devices sdb {{(pid=75216) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 18:53:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:53:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:53:44 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f9779ec-5873-4126-8e34-13de2e1a0540]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:53:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:53:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.025s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:53:44 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f523e07-7511-463a-817a-78acbc008f8b]: (4, ('ok\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:53:44 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-40e625e0-9112-4deb-8e2e-695e767786db tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Flushing IO for device /dev/sdb {{(pid=75216) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 18:53:44 user nova-compute[75216]: DEBUG nova.objects.instance [None req-e82f6dba-8384-49ad-b6ac-700bac44e3fc tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Lazy-loading 'flavor' on Instance uuid 7c9d9c1b-6df5-41ff-a696-871e70d04e07 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 18:53:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:53:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:53:44 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8178ee2-a8b2-474f-ac79-b3b03bb950b0]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:53:44 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-40e625e0-9112-4deb-8e2e-695e767786db tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75216) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 18:53:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:53:44 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e82f6dba-8384-49ad-b6ac-700bac44e3fc tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Lock "7c9d9c1b-6df5-41ff-a696-871e70d04e07" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.038s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:53:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:53:44 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[0739f30b-42bb-4c1d-bab9-5ab793ebc3e9]: (4, ('1', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:53:44 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-40e625e0-9112-4deb-8e2e-695e767786db tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 18:53:44 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-40e625e0-9112-4deb-8e2e-695e767786db tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] SCSI volumes sdb have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 18:53:44 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-40e625e0-9112-4deb-8e2e-695e767786db tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d')] {{(pid=75216) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 18:53:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:53:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:53:44 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf6ccf9d-58ac-4af6-b48a-d65249683c78]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:53:44 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-40e625e0-9112-4deb-8e2e-695e767786db tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:53:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d -p 172.16.0.220:3260 --logout {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:53:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:53:44 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[50ef13c2-5c6e-4586-a4cf-9843ce8846dd]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:53:44 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-40e625e0-9112-4deb-8e2e-695e767786db tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d, portal: 172.16.0.220,3260]
Nov 13 18:53:44 user nova-compute[75216]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d, portal: 172.16.0.220,3260] successful.
Nov 13 18:53:44 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:53:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d -p 172.16.0.220:3260 --op delete {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:53:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:53:44 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a0b75b1-5732-41fc-be39-75883baa558e]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:53:44 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-40e625e0-9112-4deb-8e2e-695e767786db tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:53:44 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-40e625e0-9112-4deb-8e2e-695e767786db tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.315s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 18:53:44 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-40e625e0-9112-4deb-8e2e-695e767786db tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] <== disconnect_volume: return (317ms) None {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 18:53:44 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-40e625e0-9112-4deb-8e2e-695e767786db tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] [instance: 91ea8a19-a365-484c-80c7-baf90e7dd1aa] Disconnected iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 18:53:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-40e625e0-9112-4deb-8e2e-695e767786db tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91ea8a19-a365-484c-80c7-baf90e7dd1aa/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:53:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-40e625e0-9112-4deb-8e2e-695e767786db tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91ea8a19-a365-484c-80c7-baf90e7dd1aa/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:53:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-40e625e0-9112-4deb-8e2e-695e767786db tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91ea8a19-a365-484c-80c7-baf90e7dd1aa/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:53:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-40e625e0-9112-4deb-8e2e-695e767786db tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91ea8a19-a365-484c-80c7-baf90e7dd1aa/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:53:44 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-40e625e0-9112-4deb-8e2e-695e767786db tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 18:53:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-40e625e0-9112-4deb-8e2e-695e767786db tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/91ea8a19-a365-484c-80c7-baf90e7dd1aa_resize/disk /opt/stack/data/nova/instances/91ea8a19-a365-484c-80c7-baf90e7dd1aa/disk {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:53:44 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:53:45 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-40e625e0-9112-4deb-8e2e-695e767786db tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] CMD "cp -r /opt/stack/data/nova/instances/91ea8a19-a365-484c-80c7-baf90e7dd1aa_resize/disk /opt/stack/data/nova/instances/91ea8a19-a365-484c-80c7-baf90e7dd1aa/disk" returned: 0 in 0.609s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:53:45 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-40e625e0-9112-4deb-8e2e-695e767786db tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/91ea8a19-a365-484c-80c7-baf90e7dd1aa_resize/disk.info /opt/stack/data/nova/instances/91ea8a19-a365-484c-80c7-baf90e7dd1aa/disk.info {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:53:45 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-40e625e0-9112-4deb-8e2e-695e767786db tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] CMD "cp -r /opt/stack/data/nova/instances/91ea8a19-a365-484c-80c7-baf90e7dd1aa_resize/disk.info /opt/stack/data/nova/instances/91ea8a19-a365-484c-80c7-baf90e7dd1aa/disk.info" returned: 0 in 0.035s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:53:45 user nova-compute[75216]: DEBUG nova.compute.manager [req-11a324f2-3289-42db-89fc-bd137cb9aee7 req-5405ab2a-d1de-45de-8e4a-6e69fa12c171 service nova] [instance: 91ea8a19-a365-484c-80c7-baf90e7dd1aa] Received event network-vif-plugged-2cfb645f-7bee-4657-b0d8-afcaa0298ac9 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:53:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-11a324f2-3289-42db-89fc-bd137cb9aee7 req-5405ab2a-d1de-45de-8e4a-6e69fa12c171 service nova] Acquiring lock "91ea8a19-a365-484c-80c7-baf90e7dd1aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:53:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-11a324f2-3289-42db-89fc-bd137cb9aee7 req-5405ab2a-d1de-45de-8e4a-6e69fa12c171 service nova] Lock "91ea8a19-a365-484c-80c7-baf90e7dd1aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:53:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-11a324f2-3289-42db-89fc-bd137cb9aee7 req-5405ab2a-d1de-45de-8e4a-6e69fa12c171 service nova] Lock "91ea8a19-a365-484c-80c7-baf90e7dd1aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:53:45 user nova-compute[75216]: DEBUG nova.compute.manager [req-11a324f2-3289-42db-89fc-bd137cb9aee7 req-5405ab2a-d1de-45de-8e4a-6e69fa12c171 service nova] [instance: 91ea8a19-a365-484c-80c7-baf90e7dd1aa] No waiting events found dispatching network-vif-plugged-2cfb645f-7bee-4657-b0d8-afcaa0298ac9 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:53:45 user nova-compute[75216]: WARNING nova.compute.manager [req-11a324f2-3289-42db-89fc-bd137cb9aee7 req-5405ab2a-d1de-45de-8e4a-6e69fa12c171 service nova] [instance: 91ea8a19-a365-484c-80c7-baf90e7dd1aa] Received unexpected event network-vif-plugged-2cfb645f-7bee-4657-b0d8-afcaa0298ac9 for instance with vm_state active and task_state resize_migrating.
Nov 13 18:53:46 user nova-compute[75216]: DEBUG nova.network.neutron [None req-40e625e0-9112-4deb-8e2e-695e767786db tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] [instance: 91ea8a19-a365-484c-80c7-baf90e7dd1aa] Port 2cfb645f-7bee-4657-b0d8-afcaa0298ac9 binding to destination host user is already ACTIVE {{(pid=75216) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 13 18:53:46 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-40e625e0-9112-4deb-8e2e-695e767786db tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Acquiring lock "91ea8a19-a365-484c-80c7-baf90e7dd1aa-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:53:46 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-40e625e0-9112-4deb-8e2e-695e767786db tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Lock "91ea8a19-a365-484c-80c7-baf90e7dd1aa-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:53:46 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-40e625e0-9112-4deb-8e2e-695e767786db tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Lock "91ea8a19-a365-484c-80c7-baf90e7dd1aa-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:53:46 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-40e625e0-9112-4deb-8e2e-695e767786db tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Acquiring lock "refresh_cache-91ea8a19-a365-484c-80c7-baf90e7dd1aa" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 18:53:46 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-40e625e0-9112-4deb-8e2e-695e767786db tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Acquired lock "refresh_cache-91ea8a19-a365-484c-80c7-baf90e7dd1aa" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 18:53:46 user nova-compute[75216]: DEBUG nova.network.neutron [None req-40e625e0-9112-4deb-8e2e-695e767786db tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] [instance: 91ea8a19-a365-484c-80c7-baf90e7dd1aa] Building network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 18:53:46 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:53:46 user nova-compute[75216]: DEBUG nova.network.neutron [None req-40e625e0-9112-4deb-8e2e-695e767786db tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] [instance: 91ea8a19-a365-484c-80c7-baf90e7dd1aa] Updating instance_info_cache with network_info: [{"id": "2cfb645f-7bee-4657-b0d8-afcaa0298ac9", "address": "fa:16:3e:3e:1d:91", "network": {"id": "a9670fc3-8a8e-4a2b-a39f-d41042d3443d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1394481632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0194e3c88e2b49c5ba9b9844f6048ea9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cfb645f-7b", "ovs_interfaceid": "2cfb645f-7bee-4657-b0d8-afcaa0298ac9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 18:53:46 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-40e625e0-9112-4deb-8e2e-695e767786db tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Releasing lock "refresh_cache-91ea8a19-a365-484c-80c7-baf90e7dd1aa" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 18:53:47 user nova-compute[75216]: DEBUG os_brick.utils [None req-40e625e0-9112-4deb-8e2e-695e767786db tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 18:53:47 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:53:47 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:53:47 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d11bf06-2196-41c6-97eb-1147628a24f6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aea6fcfe14b9\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:53:47 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:53:47 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:53:47 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[518376ff-b0e4-43c5-b861-3634796481ca]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:53:47 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:53:47 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:53:47 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[09b107ca-f31c-42c2-829b-a35f021825eb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:53:47 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[11c2daba-c802-4bc9-80ca-776a12890548]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:53:47 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-40e625e0-9112-4deb-8e2e-695e767786db tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Running cmd (subprocess): nvme version {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:53:47 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-40e625e0-9112-4deb-8e2e-695e767786db tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] 'nvme version' failed. Not Retrying. {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 18:53:47 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.nvmeof [None req-40e625e0-9112-4deb-8e2e-695e767786db tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] nvme not present on system {{(pid=75216) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 18:53:47 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:53:47 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 18:53:47 user nova-compute[75216]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 18:53:47 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[37be64d1-c870-4a94-a951-baec759b95ec]: (4, '') {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:53:47 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-40e625e0-9112-4deb-8e2e-695e767786db tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75216) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 18:53:47 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-40e625e0-9112-4deb-8e2e-695e767786db tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 18:53:47 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-40e625e0-9112-4deb-8e2e-695e767786db tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] LIGHTOS: no hostnqn found. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 18:53:47 user nova-compute[75216]: DEBUG os_brick.utils [None req-40e625e0-9112-4deb-8e2e-695e767786db tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aea6fcfe14b9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 18:53:47 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:53:48 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:53:48 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:53:48 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:53:48 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75216) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 18:53:48 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:53:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:53:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:53:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:53:48 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Auditing locally available compute resources for user (node: user) {{(pid=75216) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 18:53:48 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:53:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a3e849-6570-4820-97c8-75468b5bea4f/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:53:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a3e849-6570-4820-97c8-75468b5bea4f/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:53:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a3e849-6570-4820-97c8-75468b5bea4f/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:53:48 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:53:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-7692a0ee-5f44-457a-8dcb-b0a79aec8331 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] Acquiring lock "ded8f476-cf44-4c5e-8f6b-f36a9ee9a78b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:53:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-7692a0ee-5f44-457a-8dcb-b0a79aec8331 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] Lock "ded8f476-cf44-4c5e-8f6b-f36a9ee9a78b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:53:48 user nova-compute[75216]: DEBUG nova.compute.manager [None req-7692a0ee-5f44-457a-8dcb-b0a79aec8331 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] [instance: ded8f476-cf44-4c5e-8f6b-f36a9ee9a78b] Starting instance... {{(pid=75216) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 18:53:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a3e849-6570-4820-97c8-75468b5bea4f/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:53:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9a1edfb-c2ac-4e67-abac-c915ea22a15c/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:53:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-7692a0ee-5f44-457a-8dcb-b0a79aec8331 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:53:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-7692a0ee-5f44-457a-8dcb-b0a79aec8331 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:53:49 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-7692a0ee-5f44-457a-8dcb-b0a79aec8331 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75216) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 18:53:49 user nova-compute[75216]: INFO nova.compute.claims [None req-7692a0ee-5f44-457a-8dcb-b0a79aec8331 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] [instance: ded8f476-cf44-4c5e-8f6b-f36a9ee9a78b] Claim successful on node user
Nov 13 18:53:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9a1edfb-c2ac-4e67-abac-c915ea22a15c/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:53:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9a1edfb-c2ac-4e67-abac-c915ea22a15c/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:53:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-619aa454-647c-4a07-ab23-447aa33cf4d8 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Acquiring lock "3f08c061-312d-42d3-a811-e98ace4e7a63" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:53:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-619aa454-647c-4a07-ab23-447aa33cf4d8 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Lock "3f08c061-312d-42d3-a811-e98ace4e7a63" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:53:49 user nova-compute[75216]: DEBUG nova.compute.manager [None req-619aa454-647c-4a07-ab23-447aa33cf4d8 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] [instance: 3f08c061-312d-42d3-a811-e98ace4e7a63] Starting instance... {{(pid=75216) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 18:53:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9a1edfb-c2ac-4e67-abac-c915ea22a15c/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:53:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-619aa454-647c-4a07-ab23-447aa33cf4d8 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:53:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14d378b0-79ba-4161-a795-6288939c6fef/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:53:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14d378b0-79ba-4161-a795-6288939c6fef/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:53:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14d378b0-79ba-4161-a795-6288939c6fef/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:53:49 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-7692a0ee-5f44-457a-8dcb-b0a79aec8331 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 18:53:49 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-7692a0ee-5f44-457a-8dcb-b0a79aec8331 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 18:53:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-7692a0ee-5f44-457a-8dcb-b0a79aec8331 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.694s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:53:49 user nova-compute[75216]: DEBUG nova.compute.manager [None req-7692a0ee-5f44-457a-8dcb-b0a79aec8331 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] [instance: ded8f476-cf44-4c5e-8f6b-f36a9ee9a78b] Start building networks asynchronously for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 18:53:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-619aa454-647c-4a07-ab23-447aa33cf4d8 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.327s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:53:49 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-619aa454-647c-4a07-ab23-447aa33cf4d8 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75216) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 18:53:49 user nova-compute[75216]: INFO nova.compute.claims [None req-619aa454-647c-4a07-ab23-447aa33cf4d8 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] [instance: 3f08c061-312d-42d3-a811-e98ace4e7a63] Claim successful on node user
Nov 13 18:53:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14d378b0-79ba-4161-a795-6288939c6fef/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:53:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d589d57e-de50-482a-843f-e8246b3d7528/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:53:49 user nova-compute[75216]: DEBUG nova.compute.manager [None req-7692a0ee-5f44-457a-8dcb-b0a79aec8331 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] [instance: ded8f476-cf44-4c5e-8f6b-f36a9ee9a78b] Allocating IP information in the background. {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 18:53:49 user nova-compute[75216]: DEBUG nova.network.neutron [None req-7692a0ee-5f44-457a-8dcb-b0a79aec8331 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] [instance: ded8f476-cf44-4c5e-8f6b-f36a9ee9a78b] allocate_for_instance() {{(pid=75216) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 18:53:49 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-7692a0ee-5f44-457a-8dcb-b0a79aec8331 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] [instance: ded8f476-cf44-4c5e-8f6b-f36a9ee9a78b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 18:53:49 user nova-compute[75216]: DEBUG nova.compute.manager [None req-7692a0ee-5f44-457a-8dcb-b0a79aec8331 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] [instance: ded8f476-cf44-4c5e-8f6b-f36a9ee9a78b] Start building block device mappings for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 18:53:50 user nova-compute[75216]: DEBUG nova.policy [None req-7692a0ee-5f44-457a-8dcb-b0a79aec8331 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '14638ac21d6f4b0e9fa526934c8eb7ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847a509c4d34004a89158b45ec469fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75216) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 18:53:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d589d57e-de50-482a-843f-e8246b3d7528/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:53:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d589d57e-de50-482a-843f-e8246b3d7528/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:53:50 user nova-compute[75216]: DEBUG nova.compute.manager [None req-7692a0ee-5f44-457a-8dcb-b0a79aec8331 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] [instance: ded8f476-cf44-4c5e-8f6b-f36a9ee9a78b] Start spawning the instance on the hypervisor. {{(pid=75216) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 18:53:50 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-7692a0ee-5f44-457a-8dcb-b0a79aec8331 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] [instance: ded8f476-cf44-4c5e-8f6b-f36a9ee9a78b] Creating instance directory {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 18:53:50 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-7692a0ee-5f44-457a-8dcb-b0a79aec8331 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] [instance: ded8f476-cf44-4c5e-8f6b-f36a9ee9a78b] Creating image(s)
Nov 13 18:53:50 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-7692a0ee-5f44-457a-8dcb-b0a79aec8331 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] Acquiring lock "/opt/stack/data/nova/instances/ded8f476-cf44-4c5e-8f6b-f36a9ee9a78b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:53:50 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-7692a0ee-5f44-457a-8dcb-b0a79aec8331 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] Lock "/opt/stack/data/nova/instances/ded8f476-cf44-4c5e-8f6b-f36a9ee9a78b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:53:50 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-7692a0ee-5f44-457a-8dcb-b0a79aec8331 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] Lock "/opt/stack/data/nova/instances/ded8f476-cf44-4c5e-8f6b-f36a9ee9a78b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:53:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-7692a0ee-5f44-457a-8dcb-b0a79aec8331 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:53:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d589d57e-de50-482a-843f-e8246b3d7528/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:53:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:53:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-7692a0ee-5f44-457a-8dcb-b0a79aec8331 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json" returned: 0 in 0.218s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:53:50 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-7692a0ee-5f44-457a-8dcb-b0a79aec8331 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] Acquiring lock "88c50a45bec9d6b0427462b3242b9b8e5f49c2b6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:53:50 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-7692a0ee-5f44-457a-8dcb-b0a79aec8331 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] Lock "88c50a45bec9d6b0427462b3242b9b8e5f49c2b6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:53:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-7692a0ee-5f44-457a-8dcb-b0a79aec8331 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:53:50 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-619aa454-647c-4a07-ab23-447aa33cf4d8 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 18:53:50 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-619aa454-647c-4a07-ab23-447aa33cf4d8 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 18:53:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:53:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:53:50 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-619aa454-647c-4a07-ab23-447aa33cf4d8 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.768s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:53:50 user nova-compute[75216]: DEBUG nova.compute.manager [None req-619aa454-647c-4a07-ab23-447aa33cf4d8 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] [instance: 3f08c061-312d-42d3-a811-e98ace4e7a63] Start building networks asynchronously for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 18:53:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-7692a0ee-5f44-457a-8dcb-b0a79aec8331 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json" returned: 0 in 0.205s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:53:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-7692a0ee-5f44-457a-8dcb-b0a79aec8331 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6,backing_fmt=raw /opt/stack/data/nova/instances/ded8f476-cf44-4c5e-8f6b-f36a9ee9a78b/disk 1073741824 {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:53:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-7692a0ee-5f44-457a-8dcb-b0a79aec8331 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6,backing_fmt=raw /opt/stack/data/nova/instances/ded8f476-cf44-4c5e-8f6b-f36a9ee9a78b/disk 1073741824" returned: 0 in 0.090s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:53:50 user nova-compute[75216]: DEBUG nova.compute.manager [None req-619aa454-647c-4a07-ab23-447aa33cf4d8 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] [instance: 3f08c061-312d-42d3-a811-e98ace4e7a63] Allocating IP information in the background. {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 18:53:50 user nova-compute[75216]: DEBUG nova.network.neutron [None req-619aa454-647c-4a07-ab23-447aa33cf4d8 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] [instance: 3f08c061-312d-42d3-a811-e98ace4e7a63] allocate_for_instance() {{(pid=75216) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 18:53:50 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-7692a0ee-5f44-457a-8dcb-b0a79aec8331 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] Lock "88c50a45bec9d6b0427462b3242b9b8e5f49c2b6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.322s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:53:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-7692a0ee-5f44-457a-8dcb-b0a79aec8331 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:53:50 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-619aa454-647c-4a07-ab23-447aa33cf4d8 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] [instance: 3f08c061-312d-42d3-a811-e98ace4e7a63] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 18:53:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:53:50 user nova-compute[75216]: DEBUG nova.network.neutron [None req-7692a0ee-5f44-457a-8dcb-b0a79aec8331 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] [instance: ded8f476-cf44-4c5e-8f6b-f36a9ee9a78b] Successfully created port: 88b781a1-8dbb-455d-b138-79f2568d050a {{(pid=75216) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 18:53:50 user nova-compute[75216]: DEBUG nova.compute.manager [None req-619aa454-647c-4a07-ab23-447aa33cf4d8 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] [instance: 3f08c061-312d-42d3-a811-e98ace4e7a63] Start building block device mappings for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 18:53:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91ea8a19-a365-484c-80c7-baf90e7dd1aa/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:53:50 user nova-compute[75216]: DEBUG nova.policy [None req-619aa454-647c-4a07-ab23-447aa33cf4d8 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '83cc10163cd04fffb40b36e6c0cdd484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d0223a97ff4ecab9bf4273e3e465a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75216) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 18:53:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-7692a0ee-5f44-457a-8dcb-b0a79aec8331 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json" returned: 0 in 0.236s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:53:50 user nova-compute[75216]: DEBUG nova.virt.disk.api [None req-7692a0ee-5f44-457a-8dcb-b0a79aec8331 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ded8f476-cf44-4c5e-8f6b-f36a9ee9a78b/disk. size=1073741824 {{(pid=75216) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 18:53:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-7692a0ee-5f44-457a-8dcb-b0a79aec8331 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ded8f476-cf44-4c5e-8f6b-f36a9ee9a78b/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:53:50 user nova-compute[75216]: DEBUG nova.compute.manager [None req-619aa454-647c-4a07-ab23-447aa33cf4d8 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] [instance: 3f08c061-312d-42d3-a811-e98ace4e7a63] Start spawning the instance on the hypervisor. {{(pid=75216) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 18:53:50 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-619aa454-647c-4a07-ab23-447aa33cf4d8 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] [instance: 3f08c061-312d-42d3-a811-e98ace4e7a63] Creating instance directory {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 18:53:50 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-619aa454-647c-4a07-ab23-447aa33cf4d8 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] [instance: 3f08c061-312d-42d3-a811-e98ace4e7a63] Creating image(s)
Nov 13 18:53:50 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-619aa454-647c-4a07-ab23-447aa33cf4d8 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Acquiring lock "/opt/stack/data/nova/instances/3f08c061-312d-42d3-a811-e98ace4e7a63/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:53:50 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-619aa454-647c-4a07-ab23-447aa33cf4d8 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Lock "/opt/stack/data/nova/instances/3f08c061-312d-42d3-a811-e98ace4e7a63/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:53:50 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-619aa454-647c-4a07-ab23-447aa33cf4d8 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Lock "/opt/stack/data/nova/instances/3f08c061-312d-42d3-a811-e98ace4e7a63/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:53:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-619aa454-647c-4a07-ab23-447aa33cf4d8 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Acquiring lock "9b24ed58ad40c754c777e9542268c55a0d7b7833" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:53:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-619aa454-647c-4a07-ab23-447aa33cf4d8 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Lock "9b24ed58ad40c754c777e9542268c55a0d7b7833" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:53:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91ea8a19-a365-484c-80c7-baf90e7dd1aa/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:53:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91ea8a19-a365-484c-80c7-baf90e7dd1aa/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:53:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-619aa454-647c-4a07-ab23-447aa33cf4d8 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9b24ed58ad40c754c777e9542268c55a0d7b7833.part --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:53:51 user nova-compute[75216]: DEBUG nova.network.neutron [None req-7692a0ee-5f44-457a-8dcb-b0a79aec8331 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] [instance: ded8f476-cf44-4c5e-8f6b-f36a9ee9a78b] Successfully updated port: 88b781a1-8dbb-455d-b138-79f2568d050a {{(pid=75216) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 18:53:51 user nova-compute[75216]: DEBUG nova.compute.manager [req-9323a43a-97aa-4292-ad46-f36f6c5ea973 req-ca45e57f-3103-45c0-9b98-f4efbe08a300 service nova] [instance: ded8f476-cf44-4c5e-8f6b-f36a9ee9a78b] Received event network-changed-88b781a1-8dbb-455d-b138-79f2568d050a {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:53:51 user nova-compute[75216]: DEBUG nova.compute.manager [req-9323a43a-97aa-4292-ad46-f36f6c5ea973 req-ca45e57f-3103-45c0-9b98-f4efbe08a300 service nova] [instance: ded8f476-cf44-4c5e-8f6b-f36a9ee9a78b] Refreshing instance network info cache due to event network-changed-88b781a1-8dbb-455d-b138-79f2568d050a. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 18:53:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-9323a43a-97aa-4292-ad46-f36f6c5ea973 req-ca45e57f-3103-45c0-9b98-f4efbe08a300 service nova] Acquiring lock "refresh_cache-ded8f476-cf44-4c5e-8f6b-f36a9ee9a78b" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 18:53:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-9323a43a-97aa-4292-ad46-f36f6c5ea973 req-ca45e57f-3103-45c0-9b98-f4efbe08a300 service nova] Acquired lock "refresh_cache-ded8f476-cf44-4c5e-8f6b-f36a9ee9a78b" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 18:53:51 user nova-compute[75216]: DEBUG nova.network.neutron [req-9323a43a-97aa-4292-ad46-f36f6c5ea973 req-ca45e57f-3103-45c0-9b98-f4efbe08a300 service nova] [instance: ded8f476-cf44-4c5e-8f6b-f36a9ee9a78b] Refreshing network info cache for port 88b781a1-8dbb-455d-b138-79f2568d050a {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 18:53:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91ea8a19-a365-484c-80c7-baf90e7dd1aa/disk --force-share --output=json" returned: 0 in 0.688s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:53:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-7692a0ee-5f44-457a-8dcb-b0a79aec8331 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ded8f476-cf44-4c5e-8f6b-f36a9ee9a78b/disk --force-share --output=json" returned: 0 in 0.784s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:53:51 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 18:53:51 user nova-compute[75216]: DEBUG nova.virt.disk.api [None req-7692a0ee-5f44-457a-8dcb-b0a79aec8331 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] Cannot resize image /opt/stack/data/nova/instances/ded8f476-cf44-4c5e-8f6b-f36a9ee9a78b/disk to a smaller size. {{(pid=75216) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 18:53:51 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-7692a0ee-5f44-457a-8dcb-b0a79aec8331 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] [instance: ded8f476-cf44-4c5e-8f6b-f36a9ee9a78b] Created local disks {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 18:53:51 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-7692a0ee-5f44-457a-8dcb-b0a79aec8331 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] [instance: ded8f476-cf44-4c5e-8f6b-f36a9ee9a78b] Ensure instance console log exists: /opt/stack/data/nova/instances/ded8f476-cf44-4c5e-8f6b-f36a9ee9a78b/console.log {{(pid=75216) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 18:53:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-7692a0ee-5f44-457a-8dcb-b0a79aec8331 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:53:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-7692a0ee-5f44-457a-8dcb-b0a79aec8331 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:53:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-7692a0ee-5f44-457a-8dcb-b0a79aec8331 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:53:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-7692a0ee-5f44-457a-8dcb-b0a79aec8331 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] Acquiring lock "refresh_cache-ded8f476-cf44-4c5e-8f6b-f36a9ee9a78b" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 18:53:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85624c58-6c72-4490-8a3e-547953295ade/disk.rescue --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:53:51 user nova-compute[75216]: DEBUG nova.network.neutron [req-9323a43a-97aa-4292-ad46-f36f6c5ea973 req-ca45e57f-3103-45c0-9b98-f4efbe08a300 service nova] [instance: ded8f476-cf44-4c5e-8f6b-f36a9ee9a78b] Instance cache missing network info. {{(pid=75216) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 18:53:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-619aa454-647c-4a07-ab23-447aa33cf4d8 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9b24ed58ad40c754c777e9542268c55a0d7b7833.part --force-share --output=json" returned: 0 in 0.204s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:53:51 user nova-compute[75216]: DEBUG nova.virt.images [None req-619aa454-647c-4a07-ab23-447aa33cf4d8 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] 7241b779-6846-4ff3-b5e7-6a596d4ba25f was qcow2, converting to raw {{(pid=75216) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 13 18:53:51 user nova-compute[75216]: DEBUG nova.privsep.utils [None req-619aa454-647c-4a07-ab23-447aa33cf4d8 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75216) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 13 18:53:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-619aa454-647c-4a07-ab23-447aa33cf4d8 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9b24ed58ad40c754c777e9542268c55a0d7b7833.part /opt/stack/data/nova/instances/_base/9b24ed58ad40c754c777e9542268c55a0d7b7833.converted {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:53:51 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-40e625e0-9112-4deb-8e2e-695e767786db tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] [instance: 91ea8a19-a365-484c-80c7-baf90e7dd1aa] Starting finish_migration {{(pid=75216) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Nov 13 18:53:51 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-40e625e0-9112-4deb-8e2e-695e767786db tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] [instance: 91ea8a19-a365-484c-80c7-baf90e7dd1aa] Instance directory exists: not creating {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 13 18:53:51 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-40e625e0-9112-4deb-8e2e-695e767786db tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] [instance: 91ea8a19-a365-484c-80c7-baf90e7dd1aa] Creating image(s)
Nov 13 18:53:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-40e625e0-9112-4deb-8e2e-695e767786db tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:53:51 user nova-compute[75216]: DEBUG nova.network.neutron [None req-619aa454-647c-4a07-ab23-447aa33cf4d8 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] [instance: 3f08c061-312d-42d3-a811-e98ace4e7a63] Successfully created port: 225eb5bf-3c60-42f6-9bf7-e045ccda1213 {{(pid=75216) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 18:53:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85624c58-6c72-4490-8a3e-547953295ade/disk.rescue --force-share --output=json" returned: 0 in 0.208s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:53:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85624c58-6c72-4490-8a3e-547953295ade/disk.rescue --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:53:52 user nova-compute[75216]: DEBUG nova.network.neutron [req-9323a43a-97aa-4292-ad46-f36f6c5ea973 req-ca45e57f-3103-45c0-9b98-f4efbe08a300 service nova] [instance: ded8f476-cf44-4c5e-8f6b-f36a9ee9a78b] Updating instance_info_cache with network_info: [] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 18:53:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-40e625e0-9112-4deb-8e2e-695e767786db tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json" returned: 0 in 0.182s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:53:52 user nova-compute[75216]: DEBUG nova.virt.disk.api [None req-40e625e0-9112-4deb-8e2e-695e767786db tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Checking if we can resize image /opt/stack/data/nova/instances/91ea8a19-a365-484c-80c7-baf90e7dd1aa/disk. size=21474836480 {{(pid=75216) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 18:53:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-40e625e0-9112-4deb-8e2e-695e767786db tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91ea8a19-a365-484c-80c7-baf90e7dd1aa/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:53:52 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-9323a43a-97aa-4292-ad46-f36f6c5ea973 req-ca45e57f-3103-45c0-9b98-f4efbe08a300 service nova] Releasing lock "refresh_cache-ded8f476-cf44-4c5e-8f6b-f36a9ee9a78b" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 18:53:52 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-7692a0ee-5f44-457a-8dcb-b0a79aec8331 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] Acquired lock "refresh_cache-ded8f476-cf44-4c5e-8f6b-f36a9ee9a78b" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 18:53:52 user nova-compute[75216]: DEBUG nova.network.neutron [None req-7692a0ee-5f44-457a-8dcb-b0a79aec8331 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] [instance: ded8f476-cf44-4c5e-8f6b-f36a9ee9a78b] Building network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 18:53:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85624c58-6c72-4490-8a3e-547953295ade/disk.rescue --force-share --output=json" returned: 0 in 0.226s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:53:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85624c58-6c72-4490-8a3e-547953295ade/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:53:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-619aa454-647c-4a07-ab23-447aa33cf4d8 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9b24ed58ad40c754c777e9542268c55a0d7b7833.part /opt/stack/data/nova/instances/_base/9b24ed58ad40c754c777e9542268c55a0d7b7833.converted" returned: 0 in 0.388s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:53:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-619aa454-647c-4a07-ab23-447aa33cf4d8 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9b24ed58ad40c754c777e9542268c55a0d7b7833.converted --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:53:52 user nova-compute[75216]: DEBUG nova.network.neutron [None req-7692a0ee-5f44-457a-8dcb-b0a79aec8331 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] [instance: ded8f476-cf44-4c5e-8f6b-f36a9ee9a78b] Instance cache missing network info. {{(pid=75216) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 18:53:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-40e625e0-9112-4deb-8e2e-695e767786db tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91ea8a19-a365-484c-80c7-baf90e7dd1aa/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:53:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-40e625e0-9112-4deb-8e2e-695e767786db tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/91ea8a19-a365-484c-80c7-baf90e7dd1aa/disk 21474836480 {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:53:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85624c58-6c72-4490-8a3e-547953295ade/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:53:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85624c58-6c72-4490-8a3e-547953295ade/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:53:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-619aa454-647c-4a07-ab23-447aa33cf4d8 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9b24ed58ad40c754c777e9542268c55a0d7b7833.converted --force-share --output=json" returned: 0 in 0.274s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:53:52 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-619aa454-647c-4a07-ab23-447aa33cf4d8 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Lock "9b24ed58ad40c754c777e9542268c55a0d7b7833" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.541s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:53:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85624c58-6c72-4490-8a3e-547953295ade/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:53:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-619aa454-647c-4a07-ab23-447aa33cf4d8 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9b24ed58ad40c754c777e9542268c55a0d7b7833 --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:53:52 user nova-compute[75216]: DEBUG nova.network.neutron [None req-7692a0ee-5f44-457a-8dcb-b0a79aec8331 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] [instance: ded8f476-cf44-4c5e-8f6b-f36a9ee9a78b] Updating instance_info_cache with network_info: [{"id": "88b781a1-8dbb-455d-b138-79f2568d050a", "address": "fa:16:3e:8e:ed:49", "network": {"id": "bf647e60-7de3-41d4-abe5-a8ddf56be0f2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2101256065-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a847a509c4d34004a89158b45ec469fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88b781a1-8d", "ovs_interfaceid": "88b781a1-8dbb-455d-b138-79f2568d050a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 18:53:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c9d9c1b-6df5-41ff-a696-871e70d04e07/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:53:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-40e625e0-9112-4deb-8e2e-695e767786db tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/91ea8a19-a365-484c-80c7-baf90e7dd1aa/disk 21474836480" returned: 0 in 0.442s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:53:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-619aa454-647c-4a07-ab23-447aa33cf4d8 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9b24ed58ad40c754c777e9542268c55a0d7b7833 --force-share --output=json" returned: 0 in 0.182s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:53:52 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-619aa454-647c-4a07-ab23-447aa33cf4d8 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Acquiring lock "9b24ed58ad40c754c777e9542268c55a0d7b7833" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:53:52 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-619aa454-647c-4a07-ab23-447aa33cf4d8 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Lock "9b24ed58ad40c754c777e9542268c55a0d7b7833" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:53:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-619aa454-647c-4a07-ab23-447aa33cf4d8 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9b24ed58ad40c754c777e9542268c55a0d7b7833 --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:53:52 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-40e625e0-9112-4deb-8e2e-695e767786db tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] [instance: 91ea8a19-a365-484c-80c7-baf90e7dd1aa] Did not create local disks {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 13 18:53:52 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-40e625e0-9112-4deb-8e2e-695e767786db tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] [instance: 91ea8a19-a365-484c-80c7-baf90e7dd1aa] Ensure instance console log exists: /opt/stack/data/nova/instances/91ea8a19-a365-484c-80c7-baf90e7dd1aa/console.log {{(pid=75216) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 18:53:52 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-40e625e0-9112-4deb-8e2e-695e767786db tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:53:52 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-40e625e0-9112-4deb-8e2e-695e767786db tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:53:52 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-40e625e0-9112-4deb-8e2e-695e767786db tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:53:52 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-40e625e0-9112-4deb-8e2e-695e767786db tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] [instance: 91ea8a19-a365-484c-80c7-baf90e7dd1aa] Start _get_guest_xml network_info=[{"id": "2cfb645f-7bee-4657-b0d8-afcaa0298ac9", "address": "fa:16:3e:3e:1d:91", "network": {"id": "a9670fc3-8a8e-4a2b-a39f-d41042d3443d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1394481632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1394481632-network", "vif_mac": "fa:16:3e:3e:1d:91"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0194e3c88e2b49c5ba9b9844f6048ea9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cfb645f-7b", "ovs_interfaceid": "2cfb645f-7bee-4657-b0d8-afcaa0298ac9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T18:41:06Z,direct_url=<?>,disk_format='qcow2',id=77bcb5ba-8510-41ec-a88d-96097bb431de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c465b7c26ec44582b6d1b7169536ecc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T18:41:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'guest_format': None, 'boot_index': 0, 'image_id': '77bcb5ba-8510-41ec-a88d-96097bb431de'}], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JvBCenjA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '91ea8a19-a365-484c-80c7-baf90e7dd1aa', 'attached_at': '2023-11-13T18:53:51.000000', 'detached_at': '', 'volume_id': '82de1607-b976-408c-b503-062b8569f72d', 'serial': '82de1607-b976-408c-b503-062b8569f72d'}, 'attachment_id': '5348013a-2c44-4846-ba01-a90b05b8ba4e', 'guest_format': None, 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'boot_index': None, 'volume_type': None} {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 18:53:52 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-40e625e0-9112-4deb-8e2e-695e767786db tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 18:53:52 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-40e625e0-9112-4deb-8e2e-695e767786db tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 18:53:52 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-7692a0ee-5f44-457a-8dcb-b0a79aec8331 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] Releasing lock "refresh_cache-ded8f476-cf44-4c5e-8f6b-f36a9ee9a78b" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 18:53:52 user nova-compute[75216]: DEBUG nova.compute.manager [None req-7692a0ee-5f44-457a-8dcb-b0a79aec8331 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] [instance: ded8f476-cf44-4c5e-8f6b-f36a9ee9a78b] Instance network_info: |[{"id": "88b781a1-8dbb-455d-b138-79f2568d050a", "address": "fa:16:3e:8e:ed:49", "network": {"id": "bf647e60-7de3-41d4-abe5-a8ddf56be0f2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2101256065-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a847a509c4d34004a89158b45ec469fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88b781a1-8d", "ovs_interfaceid": "88b781a1-8dbb-455d-b138-79f2568d050a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 18:53:52 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-7692a0ee-5f44-457a-8dcb-b0a79aec8331 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] [instance: ded8f476-cf44-4c5e-8f6b-f36a9ee9a78b] Start _get_guest_xml network_info=[{"id": "88b781a1-8dbb-455d-b138-79f2568d050a", "address": "fa:16:3e:8e:ed:49", "network": {"id": "bf647e60-7de3-41d4-abe5-a8ddf56be0f2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2101256065-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a847a509c4d34004a89158b45ec469fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88b781a1-8d", "ovs_interfaceid": "88b781a1-8dbb-455d-b138-79f2568d050a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T18:41:06Z,direct_url=<?>,disk_format='qcow2',id=77bcb5ba-8510-41ec-a88d-96097bb431de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c465b7c26ec44582b6d1b7169536ecc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T18:41:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'guest_format': None, 'boot_index': 0, 'image_id': '77bcb5ba-8510-41ec-a88d-96097bb431de'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 18:53:52 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-40e625e0-9112-4deb-8e2e-695e767786db tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 18:53:52 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-40e625e0-9112-4deb-8e2e-695e767786db tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] CPU controller missing on host. {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 18:53:52 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-40e625e0-9112-4deb-8e2e-695e767786db tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 18:53:52 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-40e625e0-9112-4deb-8e2e-695e767786db tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] CPU controller found on host. {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 18:53:52 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-40e625e0-9112-4deb-8e2e-695e767786db tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75216) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 18:53:52 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-40e625e0-9112-4deb-8e2e-695e767786db tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T18:40:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T18:41:06Z,direct_url=<?>,disk_format='qcow2',id=77bcb5ba-8510-41ec-a88d-96097bb431de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c465b7c26ec44582b6d1b7169536ecc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T18:41:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 18:53:52 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-40e625e0-9112-4deb-8e2e-695e767786db tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Flavor limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 18:53:52 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-40e625e0-9112-4deb-8e2e-695e767786db tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Image limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 18:53:52 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-40e625e0-9112-4deb-8e2e-695e767786db tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Flavor pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 18:53:52 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-40e625e0-9112-4deb-8e2e-695e767786db tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Image pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 18:53:52 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-40e625e0-9112-4deb-8e2e-695e767786db tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 18:53:52 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-40e625e0-9112-4deb-8e2e-695e767786db tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 18:53:52 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-40e625e0-9112-4deb-8e2e-695e767786db tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 18:53:52 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-40e625e0-9112-4deb-8e2e-695e767786db tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Got 1 possible topologies {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 18:53:52 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-40e625e0-9112-4deb-8e2e-695e767786db tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 18:53:52 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-40e625e0-9112-4deb-8e2e-695e767786db tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 18:53:52 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-40e625e0-9112-4deb-8e2e-695e767786db tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] [instance: 91ea8a19-a365-484c-80c7-baf90e7dd1aa] Calling os-brick to attach iSCSI Volume {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 18:53:52 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-40e625e0-9112-4deb-8e2e-695e767786db tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3a8669e40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JvBCenjA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 18:53:52 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-40e625e0-9112-4deb-8e2e-695e767786db tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 18:53:52 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-40e625e0-9112-4deb-8e2e-695e767786db tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 18:53:52 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-40e625e0-9112-4deb-8e2e-695e767786db tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 18:53:52 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-40e625e0-9112-4deb-8e2e-695e767786db tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 18:53:52 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-40e625e0-9112-4deb-8e2e-695e767786db tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 18:53:52 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-40e625e0-9112-4deb-8e2e-695e767786db tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 18:53:52 user nova-compute[75216]: INFO os_brick.initiator.connectors.iscsi [None req-40e625e0-9112-4deb-8e2e-695e767786db tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 18:53:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d -p 172.16.0.220:3260 {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:53:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c9d9c1b-6df5-41ff-a696-871e70d04e07/disk --force-share --output=json" returned: 0 in 0.277s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:53:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c9d9c1b-6df5-41ff-a696-871e70d04e07/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:53:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:53:52 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[b773dbe0-0914-4a04-b387-f64bdfcd049c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:53:52 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-40e625e0-9112-4deb-8e2e-695e767786db tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 18:53:52 user nova-compute[75216]:  {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:53:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-619aa454-647c-4a07-ab23-447aa33cf4d8 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9b24ed58ad40c754c777e9542268c55a0d7b7833 --force-share --output=json" returned: 0 in 0.207s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:53:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-619aa454-647c-4a07-ab23-447aa33cf4d8 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9b24ed58ad40c754c777e9542268c55a0d7b7833,backing_fmt=raw /opt/stack/data/nova/instances/3f08c061-312d-42d3-a811-e98ace4e7a63/disk 1073741824 {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:53:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d -p 172.16.0.220:3260 --interface default --op new {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:53:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:53:53 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[83c5820e-065d-41d9-910b-cd01cb3f6172]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d] added\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:53:53 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-40e625e0-9112-4deb-8e2e-695e767786db tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d] added
Nov 13 18:53:53 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:53:53 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-7692a0ee-5f44-457a-8dcb-b0a79aec8331 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 18:53:53 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-7692a0ee-5f44-457a-8dcb-b0a79aec8331 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 18:53:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:53:53 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-7692a0ee-5f44-457a-8dcb-b0a79aec8331 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 18:53:53 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-7692a0ee-5f44-457a-8dcb-b0a79aec8331 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] CPU controller missing on host. {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 18:53:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-619aa454-647c-4a07-ab23-447aa33cf4d8 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9b24ed58ad40c754c777e9542268c55a0d7b7833,backing_fmt=raw /opt/stack/data/nova/instances/3f08c061-312d-42d3-a811-e98ace4e7a63/disk 1073741824" returned: 0 in 0.146s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:53:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.093s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:53:53 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6f05007-37e3-41e2-93fc-670795f8ced1]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:53:53 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-619aa454-647c-4a07-ab23-447aa33cf4d8 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Lock "9b24ed58ad40c754c777e9542268c55a0d7b7833" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.357s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:53:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-619aa454-647c-4a07-ab23-447aa33cf4d8 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9b24ed58ad40c754c777e9542268c55a0d7b7833 --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:53:53 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-40e625e0-9112-4deb-8e2e-695e767786db tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:53:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:53:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c9d9c1b-6df5-41ff-a696-871e70d04e07/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:53:53 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-7692a0ee-5f44-457a-8dcb-b0a79aec8331 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 18:53:53 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-7692a0ee-5f44-457a-8dcb-b0a79aec8331 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] CPU controller found on host. {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 18:53:53 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-7692a0ee-5f44-457a-8dcb-b0a79aec8331 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75216) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 18:53:53 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-7692a0ee-5f44-457a-8dcb-b0a79aec8331 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T18:40:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T18:41:06Z,direct_url=<?>,disk_format='qcow2',id=77bcb5ba-8510-41ec-a88d-96097bb431de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c465b7c26ec44582b6d1b7169536ecc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T18:41:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 18:53:53 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-7692a0ee-5f44-457a-8dcb-b0a79aec8331 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] Flavor limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 18:53:53 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-7692a0ee-5f44-457a-8dcb-b0a79aec8331 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] Image limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 18:53:53 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-7692a0ee-5f44-457a-8dcb-b0a79aec8331 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] Flavor pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 18:53:53 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-7692a0ee-5f44-457a-8dcb-b0a79aec8331 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] Image pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 18:53:53 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-7692a0ee-5f44-457a-8dcb-b0a79aec8331 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 18:53:53 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-7692a0ee-5f44-457a-8dcb-b0a79aec8331 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 18:53:53 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-7692a0ee-5f44-457a-8dcb-b0a79aec8331 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 18:53:53 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-7692a0ee-5f44-457a-8dcb-b0a79aec8331 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] Got 1 possible topologies {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 18:53:53 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-7692a0ee-5f44-457a-8dcb-b0a79aec8331 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 18:53:53 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-7692a0ee-5f44-457a-8dcb-b0a79aec8331 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 18:53:53 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-7692a0ee-5f44-457a-8dcb-b0a79aec8331 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T18:53:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1858659004',display_name='tempest-ServersNegativeTestJSON-server-1858659004',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1858659004',id=22,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a847a509c4d34004a89158b45ec469fb',ramdisk_id='',reservation_id='r-bfvor1bi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-950650335',owner_user_name='tempest-ServersNegativeTestJSON-950650335-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T18:53:50Z,user_data=None,user_id='14638ac21d6f4b0e9fa526934c8eb7ea',uuid=ded8f476-cf44-4c5e-8f6b-f36a9ee9a78b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "88b781a1-8dbb-455d-b138-79f2568d050a", "address": "fa:16:3e:8e:ed:49", "network": {"id": "bf647e60-7de3-41d4-abe5-a8ddf56be0f2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2101256065-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a847a509c4d34004a89158b45ec469fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88b781a1-8d", "ovs_interfaceid": "88b781a1-8dbb-455d-b138-79f2568d050a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75216) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 18:53:53 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-7692a0ee-5f44-457a-8dcb-b0a79aec8331 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] Converting VIF {"id": "88b781a1-8dbb-455d-b138-79f2568d050a", "address": "fa:16:3e:8e:ed:49", "network": {"id": "bf647e60-7de3-41d4-abe5-a8ddf56be0f2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2101256065-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a847a509c4d34004a89158b45ec469fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88b781a1-8d", "ovs_interfaceid": "88b781a1-8dbb-455d-b138-79f2568d050a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 18:53:53 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-7692a0ee-5f44-457a-8dcb-b0a79aec8331 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:ed:49,bridge_name='br-int',has_traffic_filtering=True,id=88b781a1-8dbb-455d-b138-79f2568d050a,network=Network(bf647e60-7de3-41d4-abe5-a8ddf56be0f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88b781a1-8d') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 18:53:53 user nova-compute[75216]: DEBUG nova.objects.instance [None req-7692a0ee-5f44-457a-8dcb-b0a79aec8331 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] Lazy-loading 'pci_devices' on Instance uuid ded8f476-cf44-4c5e-8f6b-f36a9ee9a78b {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 18:53:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:53:53 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[76bd49ce-5dcc-40e7-978e-8a1f97fd3392]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:53:53 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-40e625e0-9112-4deb-8e2e-695e767786db tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:53:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JvBCenjA {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:53:53 user nova-compute[75216]: DEBUG nova.network.neutron [None req-619aa454-647c-4a07-ab23-447aa33cf4d8 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] [instance: 3f08c061-312d-42d3-a811-e98ace4e7a63] Successfully updated port: 225eb5bf-3c60-42f6-9bf7-e045ccda1213 {{(pid=75216) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 18:53:53 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-7692a0ee-5f44-457a-8dcb-b0a79aec8331 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] [instance: ded8f476-cf44-4c5e-8f6b-f36a9ee9a78b] End _get_guest_xml xml=<domain type="kvm">
Nov 13 18:53:53 user nova-compute[75216]:   <uuid>ded8f476-cf44-4c5e-8f6b-f36a9ee9a78b</uuid>
Nov 13 18:53:53 user nova-compute[75216]:   <name>instance-00000016</name>
Nov 13 18:53:53 user nova-compute[75216]:   <memory>524288</memory>
Nov 13 18:53:53 user nova-compute[75216]:   <vcpu>1</vcpu>
Nov 13 18:53:53 user nova-compute[75216]:   <metadata>
Nov 13 18:53:53 user nova-compute[75216]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 18:53:53 user nova-compute[75216]:       <nova:package version="0.0.0"/>
Nov 13 18:53:53 user nova-compute[75216]:       <nova:name>tempest-ServersNegativeTestJSON-server-1858659004</nova:name>
Nov 13 18:53:53 user nova-compute[75216]:       <nova:creationTime>2023-11-13 18:53:53</nova:creationTime>
Nov 13 18:53:53 user nova-compute[75216]:       <nova:flavor name="m1.tiny">
Nov 13 18:53:53 user nova-compute[75216]:         <nova:memory>512</nova:memory>
Nov 13 18:53:53 user nova-compute[75216]:         <nova:disk>1</nova:disk>
Nov 13 18:53:53 user nova-compute[75216]:         <nova:swap>0</nova:swap>
Nov 13 18:53:53 user nova-compute[75216]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 18:53:53 user nova-compute[75216]:         <nova:vcpus>1</nova:vcpus>
Nov 13 18:53:53 user nova-compute[75216]:       </nova:flavor>
Nov 13 18:53:53 user nova-compute[75216]:       <nova:owner>
Nov 13 18:53:53 user nova-compute[75216]:         <nova:user uuid="14638ac21d6f4b0e9fa526934c8eb7ea">tempest-ServersNegativeTestJSON-950650335-project-member</nova:user>
Nov 13 18:53:53 user nova-compute[75216]:         <nova:project uuid="a847a509c4d34004a89158b45ec469fb">tempest-ServersNegativeTestJSON-950650335</nova:project>
Nov 13 18:53:53 user nova-compute[75216]:       </nova:owner>
Nov 13 18:53:53 user nova-compute[75216]:       <nova:root type="image" uuid="77bcb5ba-8510-41ec-a88d-96097bb431de"/>
Nov 13 18:53:53 user nova-compute[75216]:       <nova:ports>
Nov 13 18:53:53 user nova-compute[75216]:         <nova:port uuid="88b781a1-8dbb-455d-b138-79f2568d050a">
Nov 13 18:53:53 user nova-compute[75216]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 13 18:53:53 user nova-compute[75216]:         </nova:port>
Nov 13 18:53:53 user nova-compute[75216]:       </nova:ports>
Nov 13 18:53:53 user nova-compute[75216]:     </nova:instance>
Nov 13 18:53:53 user nova-compute[75216]:   </metadata>
Nov 13 18:53:53 user nova-compute[75216]:   <sysinfo type="smbios">
Nov 13 18:53:53 user nova-compute[75216]:     <system>
Nov 13 18:53:53 user nova-compute[75216]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 18:53:53 user nova-compute[75216]:       <entry name="product">OpenStack Nova</entry>
Nov 13 18:53:53 user nova-compute[75216]:       <entry name="version">0.0.0</entry>
Nov 13 18:53:53 user nova-compute[75216]:       <entry name="serial">ded8f476-cf44-4c5e-8f6b-f36a9ee9a78b</entry>
Nov 13 18:53:53 user nova-compute[75216]:       <entry name="uuid">ded8f476-cf44-4c5e-8f6b-f36a9ee9a78b</entry>
Nov 13 18:53:53 user nova-compute[75216]:       <entry name="family">Virtual Machine</entry>
Nov 13 18:53:53 user nova-compute[75216]:     </system>
Nov 13 18:53:53 user nova-compute[75216]:   </sysinfo>
Nov 13 18:53:53 user nova-compute[75216]:   <os>
Nov 13 18:53:53 user nova-compute[75216]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 18:53:53 user nova-compute[75216]:     <boot dev="hd"/>
Nov 13 18:53:53 user nova-compute[75216]:     <smbios mode="sysinfo"/>
Nov 13 18:53:53 user nova-compute[75216]:   </os>
Nov 13 18:53:53 user nova-compute[75216]:   <features>
Nov 13 18:53:53 user nova-compute[75216]:     <acpi/>
Nov 13 18:53:53 user nova-compute[75216]:     <apic/>
Nov 13 18:53:53 user nova-compute[75216]:     <vmcoreinfo/>
Nov 13 18:53:53 user nova-compute[75216]:   </features>
Nov 13 18:53:53 user nova-compute[75216]:   <clock offset="utc">
Nov 13 18:53:53 user nova-compute[75216]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 18:53:53 user nova-compute[75216]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 18:53:53 user nova-compute[75216]:     <timer name="hpet" present="no"/>
Nov 13 18:53:53 user nova-compute[75216]:   </clock>
Nov 13 18:53:53 user nova-compute[75216]:   <cpu mode="custom" match="exact">
Nov 13 18:53:53 user nova-compute[75216]:     <model>Nehalem</model>
Nov 13 18:53:53 user nova-compute[75216]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 18:53:53 user nova-compute[75216]:   </cpu>
Nov 13 18:53:53 user nova-compute[75216]:   <devices>
Nov 13 18:53:53 user nova-compute[75216]:     <disk type="file" device="disk">
Nov 13 18:53:53 user nova-compute[75216]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 18:53:53 user nova-compute[75216]:       <source file="/opt/stack/data/nova/instances/ded8f476-cf44-4c5e-8f6b-f36a9ee9a78b/disk"/>
Nov 13 18:53:53 user nova-compute[75216]:       <target dev="vda" bus="virtio"/>
Nov 13 18:53:53 user nova-compute[75216]:     </disk>
Nov 13 18:53:53 user nova-compute[75216]:     <interface type="ethernet">
Nov 13 18:53:53 user nova-compute[75216]:       <mac address="fa:16:3e:8e:ed:49"/>
Nov 13 18:53:53 user nova-compute[75216]:       <model type="virtio"/>
Nov 13 18:53:53 user nova-compute[75216]:       <mtu size="1442"/>
Nov 13 18:53:53 user nova-compute[75216]:       <target dev="tap88b781a1-8d"/>
Nov 13 18:53:53 user nova-compute[75216]:     </interface>
Nov 13 18:53:53 user nova-compute[75216]:     <serial type="pty">
Nov 13 18:53:53 user nova-compute[75216]:       <log file="/opt/stack/data/nova/instances/ded8f476-cf44-4c5e-8f6b-f36a9ee9a78b/console.log" append="off"/>
Nov 13 18:53:53 user nova-compute[75216]:     </serial>
Nov 13 18:53:53 user nova-compute[75216]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 18:53:53 user nova-compute[75216]:     <video>
Nov 13 18:53:53 user nova-compute[75216]:       <model type="virtio"/>
Nov 13 18:53:53 user nova-compute[75216]:     </video>
Nov 13 18:53:53 user nova-compute[75216]:     <rng model="virtio">
Nov 13 18:53:53 user nova-compute[75216]:       <backend model="random">/dev/urandom</backend>
Nov 13 18:53:53 user nova-compute[75216]:     </rng>
Nov 13 18:53:53 user nova-compute[75216]:     <controller type="usb" index="0" model="none"/>
Nov 13 18:53:53 user nova-compute[75216]:     <memballoon model="virtio">
Nov 13 18:53:53 user nova-compute[75216]:       <stats period="10"/>
Nov 13 18:53:53 user nova-compute[75216]:     </memballoon>
Nov 13 18:53:53 user nova-compute[75216]:   </devices>
Nov 13 18:53:53 user nova-compute[75216]: </domain>
Nov 13 18:53:53 user nova-compute[75216]:  {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 18:53:53 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-7692a0ee-5f44-457a-8dcb-b0a79aec8331 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T18:53:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1858659004',display_name='tempest-ServersNegativeTestJSON-server-1858659004',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1858659004',id=22,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a847a509c4d34004a89158b45ec469fb',ramdisk_id='',reservation_id='r-bfvor1bi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-950650335',owner_user_name='tempest-ServersNegativeTestJSON-950650335-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T18:53:50Z,user_data=None,user_id='14638ac21d6f4b0e9fa526934c8eb7ea',uuid=ded8f476-cf44-4c5e-8f6b-f36a9ee9a78b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "88b781a1-8dbb-455d-b138-79f2568d050a", "address": "fa:16:3e:8e:ed:49", "network": {"id": "bf647e60-7de3-41d4-abe5-a8ddf56be0f2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2101256065-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a847a509c4d34004a89158b45ec469fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88b781a1-8d", "ovs_interfaceid": "88b781a1-8dbb-455d-b138-79f2568d050a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 18:53:53 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-7692a0ee-5f44-457a-8dcb-b0a79aec8331 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] Converting VIF {"id": "88b781a1-8dbb-455d-b138-79f2568d050a", "address": "fa:16:3e:8e:ed:49", "network": {"id": "bf647e60-7de3-41d4-abe5-a8ddf56be0f2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2101256065-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a847a509c4d34004a89158b45ec469fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88b781a1-8d", "ovs_interfaceid": "88b781a1-8dbb-455d-b138-79f2568d050a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 18:53:53 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-7692a0ee-5f44-457a-8dcb-b0a79aec8331 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:ed:49,bridge_name='br-int',has_traffic_filtering=True,id=88b781a1-8dbb-455d-b138-79f2568d050a,network=Network(bf647e60-7de3-41d4-abe5-a8ddf56be0f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88b781a1-8d') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 18:53:53 user nova-compute[75216]: DEBUG os_vif [None req-7692a0ee-5f44-457a-8dcb-b0a79aec8331 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:ed:49,bridge_name='br-int',has_traffic_filtering=True,id=88b781a1-8dbb-455d-b138-79f2568d050a,network=Network(bf647e60-7de3-41d4-abe5-a8ddf56be0f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88b781a1-8d') {{(pid=75216) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 18:53:53 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:53:53 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:53:53 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 18:53:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JvBCenjA" returned: 0 in 0.023s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:53:53 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[544ba7f9-26aa-459e-9ccd-534f54e57373]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:53:53 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-40e625e0-9112-4deb-8e2e-695e767786db tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JvBCenjA'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:53:53 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:53:53 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5131077e-3b6c-5e49-ab47-1c2f1058f1c6', '_type': 'linux-noop'}}, row=False) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:53:53 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:53:53 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-619aa454-647c-4a07-ab23-447aa33cf4d8 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Acquiring lock "refresh_cache-3f08c061-312d-42d3-a811-e98ace4e7a63" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 18:53:53 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-619aa454-647c-4a07-ab23-447aa33cf4d8 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Acquired lock "refresh_cache-3f08c061-312d-42d3-a811-e98ace4e7a63" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 18:53:53 user nova-compute[75216]: DEBUG nova.network.neutron [None req-619aa454-647c-4a07-ab23-447aa33cf4d8 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] [instance: 3f08c061-312d-42d3-a811-e98ace4e7a63] Building network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 18:53:53 user nova-compute[75216]: DEBUG nova.compute.manager [req-43a38153-0d7f-4e86-8fcc-3553bae953e5 req-fc894994-e970-4b3d-9340-82abf3054942 service nova] [instance: 3f08c061-312d-42d3-a811-e98ace4e7a63] Received event network-changed-225eb5bf-3c60-42f6-9bf7-e045ccda1213 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:53:53 user nova-compute[75216]: DEBUG nova.compute.manager [req-43a38153-0d7f-4e86-8fcc-3553bae953e5 req-fc894994-e970-4b3d-9340-82abf3054942 service nova] [instance: 3f08c061-312d-42d3-a811-e98ace4e7a63] Refreshing instance network info cache due to event network-changed-225eb5bf-3c60-42f6-9bf7-e045ccda1213. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 18:53:53 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-43a38153-0d7f-4e86-8fcc-3553bae953e5 req-fc894994-e970-4b3d-9340-82abf3054942 service nova] Acquiring lock "refresh_cache-3f08c061-312d-42d3-a811-e98ace4e7a63" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 18:53:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-619aa454-647c-4a07-ab23-447aa33cf4d8 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9b24ed58ad40c754c777e9542268c55a0d7b7833 --force-share --output=json" returned: 0 in 0.532s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:53:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:53:53 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:53:53 user nova-compute[75216]: DEBUG nova.virt.disk.api [None req-619aa454-647c-4a07-ab23-447aa33cf4d8 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3f08c061-312d-42d3-a811-e98ace4e7a63/disk. size=1073741824 {{(pid=75216) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 18:53:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-619aa454-647c-4a07-ab23-447aa33cf4d8 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f08c061-312d-42d3-a811-e98ace4e7a63/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:53:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.031s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:53:53 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[98dc7168-5876-4df8-bd78-60f8eae80622]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:53:53 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-40e625e0-9112-4deb-8e2e-695e767786db tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:53:53 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:53:53 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap88b781a1-8d, may_exist=True, interface_attrs={}) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:53:53 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap88b781a1-8d, col_values=(('qos', UUID('3dd453f8-57e9-4aec-9f28-5b69ebe5b59f')),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:53:53 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap88b781a1-8d, col_values=(('external_ids', {'iface-id': '88b781a1-8dbb-455d-b138-79f2568d050a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8e:ed:49', 'vm-uuid': 'ded8f476-cf44-4c5e-8f6b-f36a9ee9a78b'}),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:53:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:53:53 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:53:53 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 18:53:53 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 18:53:53 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Hypervisor/Node resource view: name=user free_ram=7953MB free_disk=25.502948760986328GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75216) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 18:53:53 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:53:53 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:53:53 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:53:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.022s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:53:53 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[05b4f09e-320a-451b-ac77-1b0b091f9c6f]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:53:53 user nova-compute[75216]: INFO os_vif [None req-7692a0ee-5f44-457a-8dcb-b0a79aec8331 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:ed:49,bridge_name='br-int',has_traffic_filtering=True,id=88b781a1-8dbb-455d-b138-79f2568d050a,network=Network(bf647e60-7de3-41d4-abe5-a8ddf56be0f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88b781a1-8d')
Nov 13 18:53:53 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-40e625e0-9112-4deb-8e2e-695e767786db tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 13 18:53:53 user nova-compute[75216]:  {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 18:53:53 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-40e625e0-9112-4deb-8e2e-695e767786db tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 13 18:53:53 user nova-compute[75216]:  {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 18:53:53 user nova-compute[75216]: WARNING os_brick.initiator.connectors.iscsi [None req-40e625e0-9112-4deb-8e2e-695e767786db tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 13 18:53:53 user nova-compute[75216]: 
Nov 13 18:53:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d -p 172.16.0.220:3260 --login {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:53:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:53:53 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[98057189-348e-42c2-823e-b3b3abe33205]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:53:53 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-40e625e0-9112-4deb-8e2e-695e767786db tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d, portal: 172.16.0.220,3260]
Nov 13 18:53:53 user nova-compute[75216]: Login to [iface: default, target: iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d, portal: 172.16.0.220,3260] successful.
Nov 13 18:53:53 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:53:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:53:53 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-7692a0ee-5f44-457a-8dcb-b0a79aec8331 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 18:53:53 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-7692a0ee-5f44-457a-8dcb-b0a79aec8331 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] No VIF found with MAC fa:16:3e:8e:ed:49, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 18:53:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:53:53 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eadce23-a9d2-4bc0-8566-506bff85cf4b]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:53:53 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-40e625e0-9112-4deb-8e2e-695e767786db tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:53:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:53:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-619aa454-647c-4a07-ab23-447aa33cf4d8 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f08c061-312d-42d3-a811-e98ace4e7a63/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:53:53 user nova-compute[75216]: DEBUG nova.virt.disk.api [None req-619aa454-647c-4a07-ab23-447aa33cf4d8 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Cannot resize image /opt/stack/data/nova/instances/3f08c061-312d-42d3-a811-e98ace4e7a63/disk to a smaller size. {{(pid=75216) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 18:53:53 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-619aa454-647c-4a07-ab23-447aa33cf4d8 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] [instance: 3f08c061-312d-42d3-a811-e98ace4e7a63] Created local disks {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 18:53:53 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-619aa454-647c-4a07-ab23-447aa33cf4d8 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] [instance: 3f08c061-312d-42d3-a811-e98ace4e7a63] Ensure instance console log exists: /opt/stack/data/nova/instances/3f08c061-312d-42d3-a811-e98ace4e7a63/console.log {{(pid=75216) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 18:53:53 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-619aa454-647c-4a07-ab23-447aa33cf4d8 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:53:53 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-619aa454-647c-4a07-ab23-447aa33cf4d8 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:53:53 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-619aa454-647c-4a07-ab23-447aa33cf4d8 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:53:53 user nova-compute[75216]: DEBUG nova.network.neutron [None req-619aa454-647c-4a07-ab23-447aa33cf4d8 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] [instance: 3f08c061-312d-42d3-a811-e98ace4e7a63] Instance cache missing network info. {{(pid=75216) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 18:53:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:53:53 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e6d5dfc-f722-4953-8513-742046b2e9f6]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d (non-flash)\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:53:53 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-40e625e0-9112-4deb-8e2e-695e767786db tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d (non-flash)
Nov 13 18:53:53 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 18:53:53 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-40e625e0-9112-4deb-8e2e-695e767786db tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d (non-flash)
Nov 13 18:53:53 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 18:53:53 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-40e625e0-9112-4deb-8e2e-695e767786db tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.937s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 18:53:53 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-40e625e0-9112-4deb-8e2e-695e767786db tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Connected to 172.16.0.220:3260 {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 18:53:53 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-40e625e0-9112-4deb-8e2e-695e767786db tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] HCTL ('33', '-', '-', 0) found on session 28 with lun 0 {{(pid=75216) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 18:53:53 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-40e625e0-9112-4deb-8e2e-695e767786db tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75216) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 18:53:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:53:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:53:53 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[721a52e7-c175-48d0-b3a4-edd314347263]: (4, ('- - 0', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:53:53 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-40e625e0-9112-4deb-8e2e-695e767786db tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Searching for a device in session 28 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75216) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 18:53:53 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-40e625e0-9112-4deb-8e2e-695e767786db tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JvBCenjA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 18:53:53 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Applying migration context for instance 91ea8a19-a365-484c-80c7-baf90e7dd1aa as it has an incoming, in-progress migration 0ae048ac-88ae-4635-acf7-90c85c69f04d. Migration status is post-migrating {{(pid=75216) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 13 18:53:53 user nova-compute[75216]: INFO nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: 91ea8a19-a365-484c-80c7-baf90e7dd1aa] Updating resource usage from migration 0ae048ac-88ae-4635-acf7-90c85c69f04d
Nov 13 18:53:53 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance a1a3e849-6570-4820-97c8-75468b5bea4f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 18:53:53 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance d589d57e-de50-482a-843f-e8246b3d7528 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 18:53:53 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance 85624c58-6c72-4490-8a3e-547953295ade actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 18:53:53 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance 7c9d9c1b-6df5-41ff-a696-871e70d04e07 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 18:53:53 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance 14d378b0-79ba-4161-a795-6288939c6fef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 18:53:53 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 18:53:53 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance d9a1edfb-c2ac-4e67-abac-c915ea22a15c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 18:53:53 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Migration 0ae048ac-88ae-4635-acf7-90c85c69f04d is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 13 18:53:53 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance 91ea8a19-a365-484c-80c7-baf90e7dd1aa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 18:53:53 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance ded8f476-cf44-4c5e-8f6b-f36a9ee9a78b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 18:53:53 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance 3f08c061-312d-42d3-a811-e98ace4e7a63 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 18:53:53 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 18:53:53 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=30GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 18:53:54 user nova-compute[75216]: DEBUG nova.network.neutron [None req-619aa454-647c-4a07-ab23-447aa33cf4d8 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] [instance: 3f08c061-312d-42d3-a811-e98ace4e7a63] Updating instance_info_cache with network_info: [{"id": "225eb5bf-3c60-42f6-9bf7-e045ccda1213", "address": "fa:16:3e:3a:7e:d6", "network": {"id": "fea11c73-0074-4971-8b36-0aced430c730", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1420832282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84d0223a97ff4ecab9bf4273e3e465a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap225eb5bf-3c", "ovs_interfaceid": "225eb5bf-3c60-42f6-9bf7-e045ccda1213", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 18:53:54 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-619aa454-647c-4a07-ab23-447aa33cf4d8 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Releasing lock "refresh_cache-3f08c061-312d-42d3-a811-e98ace4e7a63" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 18:53:54 user nova-compute[75216]: DEBUG nova.compute.manager [None req-619aa454-647c-4a07-ab23-447aa33cf4d8 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] [instance: 3f08c061-312d-42d3-a811-e98ace4e7a63] Instance network_info: |[{"id": "225eb5bf-3c60-42f6-9bf7-e045ccda1213", "address": "fa:16:3e:3a:7e:d6", "network": {"id": "fea11c73-0074-4971-8b36-0aced430c730", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1420832282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84d0223a97ff4ecab9bf4273e3e465a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap225eb5bf-3c", "ovs_interfaceid": "225eb5bf-3c60-42f6-9bf7-e045ccda1213", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 18:53:54 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-43a38153-0d7f-4e86-8fcc-3553bae953e5 req-fc894994-e970-4b3d-9340-82abf3054942 service nova] Acquired lock "refresh_cache-3f08c061-312d-42d3-a811-e98ace4e7a63" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 18:53:54 user nova-compute[75216]: DEBUG nova.network.neutron [req-43a38153-0d7f-4e86-8fcc-3553bae953e5 req-fc894994-e970-4b3d-9340-82abf3054942 service nova] [instance: 3f08c061-312d-42d3-a811-e98ace4e7a63] Refreshing network info cache for port 225eb5bf-3c60-42f6-9bf7-e045ccda1213 {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 18:53:54 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-619aa454-647c-4a07-ab23-447aa33cf4d8 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] [instance: 3f08c061-312d-42d3-a811-e98ace4e7a63] Start _get_guest_xml network_info=[{"id": "225eb5bf-3c60-42f6-9bf7-e045ccda1213", "address": "fa:16:3e:3a:7e:d6", "network": {"id": "fea11c73-0074-4971-8b36-0aced430c730", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1420832282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84d0223a97ff4ecab9bf4273e3e465a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap225eb5bf-3c", "ovs_interfaceid": "225eb5bf-3c60-42f6-9bf7-e045ccda1213", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T18:53:46Z,direct_url=<?>,disk_format='qcow2',id=7241b779-6846-4ff3-b5e7-6a596d4ba25f,min_disk=0,min_ram=0,name='tempest-scenario-img--116869966',owner='84d0223a97ff4ecab9bf4273e3e465a9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T18:53:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'guest_format': None, 'boot_index': 0, 'image_id': '7241b779-6846-4ff3-b5e7-6a596d4ba25f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 18:53:54 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-619aa454-647c-4a07-ab23-447aa33cf4d8 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 18:53:54 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-619aa454-647c-4a07-ab23-447aa33cf4d8 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 18:53:54 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-619aa454-647c-4a07-ab23-447aa33cf4d8 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 18:53:54 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-619aa454-647c-4a07-ab23-447aa33cf4d8 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] CPU controller missing on host. {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 18:53:54 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-619aa454-647c-4a07-ab23-447aa33cf4d8 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 18:53:54 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-619aa454-647c-4a07-ab23-447aa33cf4d8 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] CPU controller found on host. {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 18:53:54 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-619aa454-647c-4a07-ab23-447aa33cf4d8 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75216) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 18:53:54 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-619aa454-647c-4a07-ab23-447aa33cf4d8 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T18:40:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T18:53:46Z,direct_url=<?>,disk_format='qcow2',id=7241b779-6846-4ff3-b5e7-6a596d4ba25f,min_disk=0,min_ram=0,name='tempest-scenario-img--116869966',owner='84d0223a97ff4ecab9bf4273e3e465a9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T18:53:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 18:53:54 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-619aa454-647c-4a07-ab23-447aa33cf4d8 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Flavor limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 18:53:54 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-619aa454-647c-4a07-ab23-447aa33cf4d8 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Image limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 18:53:54 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-619aa454-647c-4a07-ab23-447aa33cf4d8 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Flavor pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 18:53:54 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-619aa454-647c-4a07-ab23-447aa33cf4d8 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Image pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 18:53:54 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-619aa454-647c-4a07-ab23-447aa33cf4d8 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 18:53:54 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-619aa454-647c-4a07-ab23-447aa33cf4d8 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 18:53:54 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-619aa454-647c-4a07-ab23-447aa33cf4d8 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 18:53:54 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-619aa454-647c-4a07-ab23-447aa33cf4d8 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Got 1 possible topologies {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 18:53:54 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-619aa454-647c-4a07-ab23-447aa33cf4d8 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 18:53:54 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-619aa454-647c-4a07-ab23-447aa33cf4d8 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 18:53:54 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-619aa454-647c-4a07-ab23-447aa33cf4d8 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T18:53:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-843350509',display_name='tempest-TestMinimumBasicScenario-server-843350509',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-843350509',id=23,image_ref='7241b779-6846-4ff3-b5e7-6a596d4ba25f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLKIy5fn8nRCtUmn7K07KfB7RDBd9iwjzb5CXbq3if8xzRwbw+ZQ3REwhjsmBnemynqFCxzkc9s/yAIlOuzrQk4lJ2VBH8ecat/W+YoxobHKrItT4FKogt+fiSesp1UMUQ==',key_name='tempest-TestMinimumBasicScenario-170307334',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='84d0223a97ff4ecab9bf4273e3e465a9',ramdisk_id='',reservation_id='r-ynp0tyo0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7241b779-6846-4ff3-b5e7-6a596d4ba25f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1197015828',owner_user_name='tempest-TestMinimumBasicScenario-1197015828-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T18:53:51Z,user_data=None,user_id='83cc10163cd04fffb40b36e6c0cdd484',uuid=3f08c061-312d-42d3-a811-e98ace4e7a63,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "225eb5bf-3c60-42f6-9bf7-e045ccda1213", "address": "fa:16:3e:3a:7e:d6", "network": {"id": "fea11c73-0074-4971-8b36-0aced430c730", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1420832282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84d0223a97ff4ecab9bf4273e3e465a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap225eb5bf-3c", "ovs_interfaceid": "225eb5bf-3c60-42f6-9bf7-e045ccda1213", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75216) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 18:53:54 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-619aa454-647c-4a07-ab23-447aa33cf4d8 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Converting VIF {"id": "225eb5bf-3c60-42f6-9bf7-e045ccda1213", "address": "fa:16:3e:3a:7e:d6", "network": {"id": "fea11c73-0074-4971-8b36-0aced430c730", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1420832282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84d0223a97ff4ecab9bf4273e3e465a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap225eb5bf-3c", "ovs_interfaceid": "225eb5bf-3c60-42f6-9bf7-e045ccda1213", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 18:53:54 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-619aa454-647c-4a07-ab23-447aa33cf4d8 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:7e:d6,bridge_name='br-int',has_traffic_filtering=True,id=225eb5bf-3c60-42f6-9bf7-e045ccda1213,network=Network(fea11c73-0074-4971-8b36-0aced430c730),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap225eb5bf-3c') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 18:53:54 user nova-compute[75216]: DEBUG nova.objects.instance [None req-619aa454-647c-4a07-ab23-447aa33cf4d8 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Lazy-loading 'pci_devices' on Instance uuid 3f08c061-312d-42d3-a811-e98ace4e7a63 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 18:53:54 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-619aa454-647c-4a07-ab23-447aa33cf4d8 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] [instance: 3f08c061-312d-42d3-a811-e98ace4e7a63] End _get_guest_xml xml=<domain type="kvm">
Nov 13 18:53:54 user nova-compute[75216]:   <uuid>3f08c061-312d-42d3-a811-e98ace4e7a63</uuid>
Nov 13 18:53:54 user nova-compute[75216]:   <name>instance-00000017</name>
Nov 13 18:53:54 user nova-compute[75216]:   <memory>524288</memory>
Nov 13 18:53:54 user nova-compute[75216]:   <vcpu>1</vcpu>
Nov 13 18:53:54 user nova-compute[75216]:   <metadata>
Nov 13 18:53:54 user nova-compute[75216]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 18:53:54 user nova-compute[75216]:       <nova:package version="0.0.0"/>
Nov 13 18:53:54 user nova-compute[75216]:       <nova:name>tempest-TestMinimumBasicScenario-server-843350509</nova:name>
Nov 13 18:53:54 user nova-compute[75216]:       <nova:creationTime>2023-11-13 18:53:54</nova:creationTime>
Nov 13 18:53:54 user nova-compute[75216]:       <nova:flavor name="m1.tiny">
Nov 13 18:53:54 user nova-compute[75216]:         <nova:memory>512</nova:memory>
Nov 13 18:53:54 user nova-compute[75216]:         <nova:disk>1</nova:disk>
Nov 13 18:53:54 user nova-compute[75216]:         <nova:swap>0</nova:swap>
Nov 13 18:53:54 user nova-compute[75216]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 18:53:54 user nova-compute[75216]:         <nova:vcpus>1</nova:vcpus>
Nov 13 18:53:54 user nova-compute[75216]:       </nova:flavor>
Nov 13 18:53:54 user nova-compute[75216]:       <nova:owner>
Nov 13 18:53:54 user nova-compute[75216]:         <nova:user uuid="83cc10163cd04fffb40b36e6c0cdd484">tempest-TestMinimumBasicScenario-1197015828-project-member</nova:user>
Nov 13 18:53:54 user nova-compute[75216]:         <nova:project uuid="84d0223a97ff4ecab9bf4273e3e465a9">tempest-TestMinimumBasicScenario-1197015828</nova:project>
Nov 13 18:53:54 user nova-compute[75216]:       </nova:owner>
Nov 13 18:53:54 user nova-compute[75216]:       <nova:root type="image" uuid="7241b779-6846-4ff3-b5e7-6a596d4ba25f"/>
Nov 13 18:53:54 user nova-compute[75216]:       <nova:ports>
Nov 13 18:53:54 user nova-compute[75216]:         <nova:port uuid="225eb5bf-3c60-42f6-9bf7-e045ccda1213">
Nov 13 18:53:54 user nova-compute[75216]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 13 18:53:54 user nova-compute[75216]:         </nova:port>
Nov 13 18:53:54 user nova-compute[75216]:       </nova:ports>
Nov 13 18:53:54 user nova-compute[75216]:     </nova:instance>
Nov 13 18:53:54 user nova-compute[75216]:   </metadata>
Nov 13 18:53:54 user nova-compute[75216]:   <sysinfo type="smbios">
Nov 13 18:53:54 user nova-compute[75216]:     <system>
Nov 13 18:53:54 user nova-compute[75216]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 18:53:54 user nova-compute[75216]:       <entry name="product">OpenStack Nova</entry>
Nov 13 18:53:54 user nova-compute[75216]:       <entry name="version">0.0.0</entry>
Nov 13 18:53:54 user nova-compute[75216]:       <entry name="serial">3f08c061-312d-42d3-a811-e98ace4e7a63</entry>
Nov 13 18:53:54 user nova-compute[75216]:       <entry name="uuid">3f08c061-312d-42d3-a811-e98ace4e7a63</entry>
Nov 13 18:53:54 user nova-compute[75216]:       <entry name="family">Virtual Machine</entry>
Nov 13 18:53:54 user nova-compute[75216]:     </system>
Nov 13 18:53:54 user nova-compute[75216]:   </sysinfo>
Nov 13 18:53:54 user nova-compute[75216]:   <os>
Nov 13 18:53:54 user nova-compute[75216]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 18:53:54 user nova-compute[75216]:     <boot dev="hd"/>
Nov 13 18:53:54 user nova-compute[75216]:     <smbios mode="sysinfo"/>
Nov 13 18:53:54 user nova-compute[75216]:   </os>
Nov 13 18:53:54 user nova-compute[75216]:   <features>
Nov 13 18:53:54 user nova-compute[75216]:     <acpi/>
Nov 13 18:53:54 user nova-compute[75216]:     <apic/>
Nov 13 18:53:54 user nova-compute[75216]:     <vmcoreinfo/>
Nov 13 18:53:54 user nova-compute[75216]:   </features>
Nov 13 18:53:54 user nova-compute[75216]:   <clock offset="utc">
Nov 13 18:53:54 user nova-compute[75216]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 18:53:54 user nova-compute[75216]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 18:53:54 user nova-compute[75216]:     <timer name="hpet" present="no"/>
Nov 13 18:53:54 user nova-compute[75216]:   </clock>
Nov 13 18:53:54 user nova-compute[75216]:   <cpu mode="custom" match="exact">
Nov 13 18:53:54 user nova-compute[75216]:     <model>Nehalem</model>
Nov 13 18:53:54 user nova-compute[75216]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 18:53:54 user nova-compute[75216]:   </cpu>
Nov 13 18:53:54 user nova-compute[75216]:   <devices>
Nov 13 18:53:54 user nova-compute[75216]:     <disk type="file" device="disk">
Nov 13 18:53:54 user nova-compute[75216]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 18:53:54 user nova-compute[75216]:       <source file="/opt/stack/data/nova/instances/3f08c061-312d-42d3-a811-e98ace4e7a63/disk"/>
Nov 13 18:53:54 user nova-compute[75216]:       <target dev="vda" bus="virtio"/>
Nov 13 18:53:54 user nova-compute[75216]:     </disk>
Nov 13 18:53:54 user nova-compute[75216]:     <interface type="ethernet">
Nov 13 18:53:54 user nova-compute[75216]:       <mac address="fa:16:3e:3a:7e:d6"/>
Nov 13 18:53:54 user nova-compute[75216]:       <model type="virtio"/>
Nov 13 18:53:54 user nova-compute[75216]:       <mtu size="1442"/>
Nov 13 18:53:54 user nova-compute[75216]:       <target dev="tap225eb5bf-3c"/>
Nov 13 18:53:54 user nova-compute[75216]:     </interface>
Nov 13 18:53:54 user nova-compute[75216]:     <serial type="pty">
Nov 13 18:53:54 user nova-compute[75216]:       <log file="/opt/stack/data/nova/instances/3f08c061-312d-42d3-a811-e98ace4e7a63/console.log" append="off"/>
Nov 13 18:53:54 user nova-compute[75216]:     </serial>
Nov 13 18:53:54 user nova-compute[75216]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 18:53:54 user nova-compute[75216]:     <video>
Nov 13 18:53:54 user nova-compute[75216]:       <model type="virtio"/>
Nov 13 18:53:54 user nova-compute[75216]:     </video>
Nov 13 18:53:54 user nova-compute[75216]:     <rng model="virtio">
Nov 13 18:53:54 user nova-compute[75216]:       <backend model="random">/dev/urandom</backend>
Nov 13 18:53:54 user nova-compute[75216]:     </rng>
Nov 13 18:53:54 user nova-compute[75216]:     <controller type="usb" index="0" model="none"/>
Nov 13 18:53:54 user nova-compute[75216]:     <memballoon model="virtio">
Nov 13 18:53:54 user nova-compute[75216]:       <stats period="10"/>
Nov 13 18:53:54 user nova-compute[75216]:     </memballoon>
Nov 13 18:53:54 user nova-compute[75216]:   </devices>
Nov 13 18:53:54 user nova-compute[75216]: </domain>
Nov 13 18:53:54 user nova-compute[75216]:  {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 18:53:54 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-619aa454-647c-4a07-ab23-447aa33cf4d8 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T18:53:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-843350509',display_name='tempest-TestMinimumBasicScenario-server-843350509',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-843350509',id=23,image_ref='7241b779-6846-4ff3-b5e7-6a596d4ba25f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLKIy5fn8nRCtUmn7K07KfB7RDBd9iwjzb5CXbq3if8xzRwbw+ZQ3REwhjsmBnemynqFCxzkc9s/yAIlOuzrQk4lJ2VBH8ecat/W+YoxobHKrItT4FKogt+fiSesp1UMUQ==',key_name='tempest-TestMinimumBasicScenario-170307334',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='84d0223a97ff4ecab9bf4273e3e465a9',ramdisk_id='',reservation_id='r-ynp0tyo0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7241b779-6846-4ff3-b5e7-6a596d4ba25f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1197015828',owner_user_name='tempest-TestMinimumBasicScenario-1197015828-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T18:53:51Z,user_data=None,user_id='83cc10163cd04fffb40b36e6c0cdd484',uuid=3f08c061-312d-42d3-a811-e98ace4e7a63,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "225eb5bf-3c60-42f6-9bf7-e045ccda1213", "address": "fa:16:3e:3a:7e:d6", "network": {"id": "fea11c73-0074-4971-8b36-0aced430c730", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1420832282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84d0223a97ff4ecab9bf4273e3e465a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap225eb5bf-3c", "ovs_interfaceid": "225eb5bf-3c60-42f6-9bf7-e045ccda1213", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 18:53:54 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-619aa454-647c-4a07-ab23-447aa33cf4d8 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Converting VIF {"id": "225eb5bf-3c60-42f6-9bf7-e045ccda1213", "address": "fa:16:3e:3a:7e:d6", "network": {"id": "fea11c73-0074-4971-8b36-0aced430c730", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1420832282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84d0223a97ff4ecab9bf4273e3e465a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap225eb5bf-3c", "ovs_interfaceid": "225eb5bf-3c60-42f6-9bf7-e045ccda1213", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 18:53:54 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-619aa454-647c-4a07-ab23-447aa33cf4d8 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:7e:d6,bridge_name='br-int',has_traffic_filtering=True,id=225eb5bf-3c60-42f6-9bf7-e045ccda1213,network=Network(fea11c73-0074-4971-8b36-0aced430c730),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap225eb5bf-3c') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 18:53:54 user nova-compute[75216]: DEBUG os_vif [None req-619aa454-647c-4a07-ab23-447aa33cf4d8 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:7e:d6,bridge_name='br-int',has_traffic_filtering=True,id=225eb5bf-3c60-42f6-9bf7-e045ccda1213,network=Network(fea11c73-0074-4971-8b36-0aced430c730),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap225eb5bf-3c') {{(pid=75216) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 18:53:54 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:53:54 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:53:54 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 18:53:54 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:53:54 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1e9ed527-f8d5-5a2e-9112-af59f64f5b6b', '_type': 'linux-noop'}}, row=False) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:53:54 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:53:54 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:53:54 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:53:54 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:53:54 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap225eb5bf-3c, may_exist=True, interface_attrs={}) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:53:54 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap225eb5bf-3c, col_values=(('qos', UUID('16f44f98-d0c3-40c0-97e2-2ebf76d1a3e5')),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:53:54 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap225eb5bf-3c, col_values=(('external_ids', {'iface-id': '225eb5bf-3c60-42f6-9bf7-e045ccda1213', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3a:7e:d6', 'vm-uuid': '3f08c061-312d-42d3-a811-e98ace4e7a63'}),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:53:54 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:53:54 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:53:54 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:53:54 user nova-compute[75216]: INFO os_vif [None req-619aa454-647c-4a07-ab23-447aa33cf4d8 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:7e:d6,bridge_name='br-int',has_traffic_filtering=True,id=225eb5bf-3c60-42f6-9bf7-e045ccda1213,network=Network(fea11c73-0074-4971-8b36-0aced430c730),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap225eb5bf-3c')
Nov 13 18:53:54 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 18:53:54 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 18:53:54 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-619aa454-647c-4a07-ab23-447aa33cf4d8 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 18:53:54 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-619aa454-647c-4a07-ab23-447aa33cf4d8 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] No VIF found with MAC fa:16:3e:3a:7e:d6, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 18:53:54 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Compute_service record updated for user:user {{(pid=75216) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 18:53:54 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.644s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:53:54 user nova-compute[75216]: DEBUG nova.network.neutron [req-43a38153-0d7f-4e86-8fcc-3553bae953e5 req-fc894994-e970-4b3d-9340-82abf3054942 service nova] [instance: 3f08c061-312d-42d3-a811-e98ace4e7a63] Updated VIF entry in instance network info cache for port 225eb5bf-3c60-42f6-9bf7-e045ccda1213. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 18:53:54 user nova-compute[75216]: DEBUG nova.network.neutron [req-43a38153-0d7f-4e86-8fcc-3553bae953e5 req-fc894994-e970-4b3d-9340-82abf3054942 service nova] [instance: 3f08c061-312d-42d3-a811-e98ace4e7a63] Updating instance_info_cache with network_info: [{"id": "225eb5bf-3c60-42f6-9bf7-e045ccda1213", "address": "fa:16:3e:3a:7e:d6", "network": {"id": "fea11c73-0074-4971-8b36-0aced430c730", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1420832282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84d0223a97ff4ecab9bf4273e3e465a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap225eb5bf-3c", "ovs_interfaceid": "225eb5bf-3c60-42f6-9bf7-e045ccda1213", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 18:53:54 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-43a38153-0d7f-4e86-8fcc-3553bae953e5 req-fc894994-e970-4b3d-9340-82abf3054942 service nova] Releasing lock "refresh_cache-3f08c061-312d-42d3-a811-e98ace4e7a63" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 18:53:54 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-40e625e0-9112-4deb-8e2e-695e767786db tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.976s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 18:53:54 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-40e625e0-9112-4deb-8e2e-695e767786db tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] <== connect_volume: return (1978ms) {'type': 'block', 'scsi_wwn': '26539373964636136', 'path': '/dev/sdb'} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 18:53:54 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-40e625e0-9112-4deb-8e2e-695e767786db tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] [instance: 91ea8a19-a365-484c-80c7-baf90e7dd1aa] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26539373964636136', 'path': '/dev/sdb'} {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 18:53:54 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-40e625e0-9112-4deb-8e2e-695e767786db tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T18:49:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2138583247',display_name='tempest-ServerActionsTestOtherB-server-2138583247',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2138583247',id=18,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAl4rrs8AsTXVVWOe2ej9Q0PBsZfl4SiBx6Z+7YBp2Q8nhbMLqhEEYWYCrwvKHOa1CVoqmRod9jN0d8asOX7OMqzQqSN/edxVDFYygCGcMd2W6HT1YDz1w3rZ0s5A43lWg==',key_name='tempest-keypair-1520178236',keypairs=<?>,launch_index=0,launched_at=2023-11-13T18:49:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='0194e3c88e2b49c5ba9b9844f6048ea9',ramdisk_id='',reservation_id='r-z6obctyl',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1164011898',owner_user_name='tempest-ServerActionsTestOtherB-1164011898-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T18:53:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0543920a35a54c83bcc159b7a2b08a80',uuid=91ea8a19-a365-484c-80c7-baf90e7dd1aa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2cfb645f-7bee-4657-b0d8-afcaa0298ac9", "address": "fa:16:3e:3e:1d:91", "network": {"id": "a9670fc3-8a8e-4a2b-a39f-d41042d3443d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1394481632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1394481632-network", "vif_mac": "fa:16:3e:3e:1d:91"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0194e3c88e2b49c5ba9b9844f6048ea9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cfb645f-7b", "ovs_interfaceid": "2cfb645f-7bee-4657-b0d8-afcaa0298ac9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75216) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 18:53:54 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-40e625e0-9112-4deb-8e2e-695e767786db tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Converting VIF {"id": "2cfb645f-7bee-4657-b0d8-afcaa0298ac9", "address": "fa:16:3e:3e:1d:91", "network": {"id": "a9670fc3-8a8e-4a2b-a39f-d41042d3443d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1394481632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1394481632-network", "vif_mac": "fa:16:3e:3e:1d:91"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0194e3c88e2b49c5ba9b9844f6048ea9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cfb645f-7b", "ovs_interfaceid": "2cfb645f-7bee-4657-b0d8-afcaa0298ac9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 18:53:54 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-40e625e0-9112-4deb-8e2e-695e767786db tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:1d:91,bridge_name='br-int',has_traffic_filtering=True,id=2cfb645f-7bee-4657-b0d8-afcaa0298ac9,network=Network(a9670fc3-8a8e-4a2b-a39f-d41042d3443d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cfb645f-7b') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 18:53:54 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-40e625e0-9112-4deb-8e2e-695e767786db tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] [instance: 91ea8a19-a365-484c-80c7-baf90e7dd1aa] End _get_guest_xml xml=<domain type="kvm">
Nov 13 18:53:54 user nova-compute[75216]:   <uuid>91ea8a19-a365-484c-80c7-baf90e7dd1aa</uuid>
Nov 13 18:53:54 user nova-compute[75216]:   <name>instance-00000012</name>
Nov 13 18:53:54 user nova-compute[75216]:   <memory>2097152</memory>
Nov 13 18:53:54 user nova-compute[75216]:   <vcpu>1</vcpu>
Nov 13 18:53:54 user nova-compute[75216]:   <metadata>
Nov 13 18:53:54 user nova-compute[75216]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 18:53:54 user nova-compute[75216]:       <nova:package version="0.0.0"/>
Nov 13 18:53:54 user nova-compute[75216]:       <nova:name>tempest-ServerActionsTestOtherB-server-2138583247</nova:name>
Nov 13 18:53:54 user nova-compute[75216]:       <nova:creationTime>2023-11-13 18:53:52</nova:creationTime>
Nov 13 18:53:54 user nova-compute[75216]:       <nova:flavor name="m1.small">
Nov 13 18:53:54 user nova-compute[75216]:         <nova:memory>2048</nova:memory>
Nov 13 18:53:54 user nova-compute[75216]:         <nova:disk>20</nova:disk>
Nov 13 18:53:54 user nova-compute[75216]:         <nova:swap>0</nova:swap>
Nov 13 18:53:54 user nova-compute[75216]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 18:53:54 user nova-compute[75216]:         <nova:vcpus>1</nova:vcpus>
Nov 13 18:53:54 user nova-compute[75216]:       </nova:flavor>
Nov 13 18:53:54 user nova-compute[75216]:       <nova:owner>
Nov 13 18:53:54 user nova-compute[75216]:         <nova:user uuid="0543920a35a54c83bcc159b7a2b08a80">tempest-ServerActionsTestOtherB-1164011898-project-member</nova:user>
Nov 13 18:53:54 user nova-compute[75216]:         <nova:project uuid="0194e3c88e2b49c5ba9b9844f6048ea9">tempest-ServerActionsTestOtherB-1164011898</nova:project>
Nov 13 18:53:54 user nova-compute[75216]:       </nova:owner>
Nov 13 18:53:54 user nova-compute[75216]:       <nova:root type="image" uuid="77bcb5ba-8510-41ec-a88d-96097bb431de"/>
Nov 13 18:53:54 user nova-compute[75216]:       <nova:ports>
Nov 13 18:53:54 user nova-compute[75216]:         <nova:port uuid="2cfb645f-7bee-4657-b0d8-afcaa0298ac9">
Nov 13 18:53:54 user nova-compute[75216]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 13 18:53:54 user nova-compute[75216]:         </nova:port>
Nov 13 18:53:54 user nova-compute[75216]:       </nova:ports>
Nov 13 18:53:54 user nova-compute[75216]:     </nova:instance>
Nov 13 18:53:54 user nova-compute[75216]:   </metadata>
Nov 13 18:53:54 user nova-compute[75216]:   <sysinfo type="smbios">
Nov 13 18:53:54 user nova-compute[75216]:     <system>
Nov 13 18:53:54 user nova-compute[75216]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 18:53:54 user nova-compute[75216]:       <entry name="product">OpenStack Nova</entry>
Nov 13 18:53:54 user nova-compute[75216]:       <entry name="version">0.0.0</entry>
Nov 13 18:53:54 user nova-compute[75216]:       <entry name="serial">91ea8a19-a365-484c-80c7-baf90e7dd1aa</entry>
Nov 13 18:53:54 user nova-compute[75216]:       <entry name="uuid">91ea8a19-a365-484c-80c7-baf90e7dd1aa</entry>
Nov 13 18:53:54 user nova-compute[75216]:       <entry name="family">Virtual Machine</entry>
Nov 13 18:53:54 user nova-compute[75216]:     </system>
Nov 13 18:53:54 user nova-compute[75216]:   </sysinfo>
Nov 13 18:53:54 user nova-compute[75216]:   <os>
Nov 13 18:53:54 user nova-compute[75216]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 18:53:54 user nova-compute[75216]:     <boot dev="hd"/>
Nov 13 18:53:54 user nova-compute[75216]:     <smbios mode="sysinfo"/>
Nov 13 18:53:54 user nova-compute[75216]:   </os>
Nov 13 18:53:54 user nova-compute[75216]:   <features>
Nov 13 18:53:54 user nova-compute[75216]:     <acpi/>
Nov 13 18:53:54 user nova-compute[75216]:     <apic/>
Nov 13 18:53:54 user nova-compute[75216]:     <vmcoreinfo/>
Nov 13 18:53:54 user nova-compute[75216]:   </features>
Nov 13 18:53:54 user nova-compute[75216]:   <clock offset="utc">
Nov 13 18:53:54 user nova-compute[75216]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 18:53:54 user nova-compute[75216]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 18:53:54 user nova-compute[75216]:     <timer name="hpet" present="no"/>
Nov 13 18:53:54 user nova-compute[75216]:   </clock>
Nov 13 18:53:54 user nova-compute[75216]:   <cpu mode="custom" match="exact">
Nov 13 18:53:54 user nova-compute[75216]:     <model>Nehalem</model>
Nov 13 18:53:54 user nova-compute[75216]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 18:53:54 user nova-compute[75216]:   </cpu>
Nov 13 18:53:54 user nova-compute[75216]:   <devices>
Nov 13 18:53:54 user nova-compute[75216]:     <disk type="file" device="disk">
Nov 13 18:53:54 user nova-compute[75216]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 18:53:54 user nova-compute[75216]:       <source file="/opt/stack/data/nova/instances/91ea8a19-a365-484c-80c7-baf90e7dd1aa/disk"/>
Nov 13 18:53:54 user nova-compute[75216]:       <target dev="vda" bus="virtio"/>
Nov 13 18:53:54 user nova-compute[75216]:     </disk>
Nov 13 18:53:54 user nova-compute[75216]:     <disk type="block" device="disk">
Nov 13 18:53:54 user nova-compute[75216]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 18:53:54 user nova-compute[75216]:       <source dev="/dev/sdb"/>
Nov 13 18:53:54 user nova-compute[75216]:       <target dev="vdb" bus="virtio"/>
Nov 13 18:53:54 user nova-compute[75216]:       <serial>82de1607-b976-408c-b503-062b8569f72d</serial>
Nov 13 18:53:54 user nova-compute[75216]:     </disk>
Nov 13 18:53:54 user nova-compute[75216]:     <interface type="ethernet">
Nov 13 18:53:54 user nova-compute[75216]:       <mac address="fa:16:3e:3e:1d:91"/>
Nov 13 18:53:54 user nova-compute[75216]:       <model type="virtio"/>
Nov 13 18:53:54 user nova-compute[75216]:       <mtu size="1442"/>
Nov 13 18:53:54 user nova-compute[75216]:       <target dev="tap2cfb645f-7b"/>
Nov 13 18:53:54 user nova-compute[75216]:     </interface>
Nov 13 18:53:54 user nova-compute[75216]:     <serial type="pty">
Nov 13 18:53:54 user nova-compute[75216]:       <log file="/opt/stack/data/nova/instances/91ea8a19-a365-484c-80c7-baf90e7dd1aa/console.log" append="off"/>
Nov 13 18:53:54 user nova-compute[75216]:     </serial>
Nov 13 18:53:54 user nova-compute[75216]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 18:53:54 user nova-compute[75216]:     <video>
Nov 13 18:53:54 user nova-compute[75216]:       <model type="virtio"/>
Nov 13 18:53:54 user nova-compute[75216]:     </video>
Nov 13 18:53:54 user nova-compute[75216]:     <rng model="virtio">
Nov 13 18:53:54 user nova-compute[75216]:       <backend model="random">/dev/urandom</backend>
Nov 13 18:53:54 user nova-compute[75216]:     </rng>
Nov 13 18:53:54 user nova-compute[75216]:     <controller type="usb" index="0" model="none"/>
Nov 13 18:53:54 user nova-compute[75216]:     <memballoon model="virtio">
Nov 13 18:53:54 user nova-compute[75216]:       <stats period="10"/>
Nov 13 18:53:54 user nova-compute[75216]:     </memballoon>
Nov 13 18:53:54 user nova-compute[75216]:   </devices>
Nov 13 18:53:54 user nova-compute[75216]: </domain>
Nov 13 18:53:54 user nova-compute[75216]:  {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 18:53:54 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-40e625e0-9112-4deb-8e2e-695e767786db tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T18:49:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2138583247',display_name='tempest-ServerActionsTestOtherB-server-2138583247',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2138583247',id=18,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAl4rrs8AsTXVVWOe2ej9Q0PBsZfl4SiBx6Z+7YBp2Q8nhbMLqhEEYWYCrwvKHOa1CVoqmRod9jN0d8asOX7OMqzQqSN/edxVDFYygCGcMd2W6HT1YDz1w3rZ0s5A43lWg==',key_name='tempest-keypair-1520178236',keypairs=<?>,launch_index=0,launched_at=2023-11-13T18:49:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='0194e3c88e2b49c5ba9b9844f6048ea9',ramdisk_id='',reservation_id='r-z6obctyl',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1164011898',owner_user_name='tempest-ServerActionsTestOtherB-1164011898-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T18:53:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0543920a35a54c83bcc159b7a2b08a80',uuid=91ea8a19-a365-484c-80c7-baf90e7dd1aa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2cfb645f-7bee-4657-b0d8-afcaa0298ac9", "address": "fa:16:3e:3e:1d:91", "network": {"id": "a9670fc3-8a8e-4a2b-a39f-d41042d3443d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1394481632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1394481632-network", "vif_mac": "fa:16:3e:3e:1d:91"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0194e3c88e2b49c5ba9b9844f6048ea9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cfb645f-7b", "ovs_interfaceid": "2cfb645f-7bee-4657-b0d8-afcaa0298ac9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 18:53:54 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-40e625e0-9112-4deb-8e2e-695e767786db tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Converting VIF {"id": "2cfb645f-7bee-4657-b0d8-afcaa0298ac9", "address": "fa:16:3e:3e:1d:91", "network": {"id": "a9670fc3-8a8e-4a2b-a39f-d41042d3443d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1394481632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1394481632-network", "vif_mac": "fa:16:3e:3e:1d:91"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0194e3c88e2b49c5ba9b9844f6048ea9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cfb645f-7b", "ovs_interfaceid": "2cfb645f-7bee-4657-b0d8-afcaa0298ac9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 18:53:54 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-40e625e0-9112-4deb-8e2e-695e767786db tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:1d:91,bridge_name='br-int',has_traffic_filtering=True,id=2cfb645f-7bee-4657-b0d8-afcaa0298ac9,network=Network(a9670fc3-8a8e-4a2b-a39f-d41042d3443d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cfb645f-7b') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 18:53:54 user nova-compute[75216]: DEBUG os_vif [None req-40e625e0-9112-4deb-8e2e-695e767786db tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:1d:91,bridge_name='br-int',has_traffic_filtering=True,id=2cfb645f-7bee-4657-b0d8-afcaa0298ac9,network=Network(a9670fc3-8a8e-4a2b-a39f-d41042d3443d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cfb645f-7b') {{(pid=75216) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 18:53:54 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:53:54 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:53:54 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 18:53:54 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:53:54 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a4a5ac32-dbb0-5d2e-8045-b9124a42aeca', '_type': 'linux-noop'}}, row=False) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:53:54 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:53:54 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:53:54 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:53:54 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:53:54 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2cfb645f-7b, may_exist=True, interface_attrs={}) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:53:54 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2cfb645f-7b, col_values=(('qos', UUID('6aca2b2b-1f45-47bb-ba6a-2c56221b7523')),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:53:54 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2cfb645f-7b, col_values=(('external_ids', {'iface-id': '2cfb645f-7bee-4657-b0d8-afcaa0298ac9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3e:1d:91', 'vm-uuid': '91ea8a19-a365-484c-80c7-baf90e7dd1aa'}),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:53:54 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:53:54 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:53:55 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:53:55 user nova-compute[75216]: INFO os_vif [None req-40e625e0-9112-4deb-8e2e-695e767786db tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:1d:91,bridge_name='br-int',has_traffic_filtering=True,id=2cfb645f-7bee-4657-b0d8-afcaa0298ac9,network=Network(a9670fc3-8a8e-4a2b-a39f-d41042d3443d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cfb645f-7b')
Nov 13 18:53:55 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-40e625e0-9112-4deb-8e2e-695e767786db tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 18:53:55 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-40e625e0-9112-4deb-8e2e-695e767786db tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 18:53:55 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-40e625e0-9112-4deb-8e2e-695e767786db tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] No VIF found with MAC fa:16:3e:3e:1d:91, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 18:53:56 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:53:56 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Starting heal instance info cache {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 18:53:56 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "refresh_cache-85624c58-6c72-4490-8a3e-547953295ade" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 18:53:56 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquired lock "refresh_cache-85624c58-6c72-4490-8a3e-547953295ade" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 18:53:56 user nova-compute[75216]: DEBUG nova.network.neutron [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: 85624c58-6c72-4490-8a3e-547953295ade] Forcefully refreshing network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 18:53:56 user nova-compute[75216]: DEBUG nova.network.neutron [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: 85624c58-6c72-4490-8a3e-547953295ade] Updating instance_info_cache with network_info: [{"id": "51ccc958-5ce8-4e1d-8d28-f10c5ac288bd", "address": "fa:16:3e:f4:a4:79", "network": {"id": "6d182db1-03b5-4d1b-86cf-b9367921b7b0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1877006951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2efafc26c47c4050bd367c47469999fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51ccc958-5c", "ovs_interfaceid": "51ccc958-5ce8-4e1d-8d28-f10c5ac288bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 18:53:56 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Releasing lock "refresh_cache-85624c58-6c72-4490-8a3e-547953295ade" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 18:53:56 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: 85624c58-6c72-4490-8a3e-547953295ade] Updated the network info_cache for instance {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 18:53:56 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:53:56 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:53:56 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:53:56 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:53:56 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:53:57 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:53:57 user nova-compute[75216]: DEBUG nova.compute.manager [req-a9336281-09fd-4203-bab5-9717969c4121 req-10dc6e95-8772-4b74-a654-98e33968fc8b service nova] [instance: ded8f476-cf44-4c5e-8f6b-f36a9ee9a78b] Received event network-vif-plugged-88b781a1-8dbb-455d-b138-79f2568d050a {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:53:57 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-a9336281-09fd-4203-bab5-9717969c4121 req-10dc6e95-8772-4b74-a654-98e33968fc8b service nova] Acquiring lock "ded8f476-cf44-4c5e-8f6b-f36a9ee9a78b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:53:57 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-a9336281-09fd-4203-bab5-9717969c4121 req-10dc6e95-8772-4b74-a654-98e33968fc8b service nova] Lock "ded8f476-cf44-4c5e-8f6b-f36a9ee9a78b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:53:57 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-a9336281-09fd-4203-bab5-9717969c4121 req-10dc6e95-8772-4b74-a654-98e33968fc8b service nova] Lock "ded8f476-cf44-4c5e-8f6b-f36a9ee9a78b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:53:57 user nova-compute[75216]: DEBUG nova.compute.manager [req-a9336281-09fd-4203-bab5-9717969c4121 req-10dc6e95-8772-4b74-a654-98e33968fc8b service nova] [instance: ded8f476-cf44-4c5e-8f6b-f36a9ee9a78b] No waiting events found dispatching network-vif-plugged-88b781a1-8dbb-455d-b138-79f2568d050a {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:53:57 user nova-compute[75216]: WARNING nova.compute.manager [req-a9336281-09fd-4203-bab5-9717969c4121 req-10dc6e95-8772-4b74-a654-98e33968fc8b service nova] [instance: ded8f476-cf44-4c5e-8f6b-f36a9ee9a78b] Received unexpected event network-vif-plugged-88b781a1-8dbb-455d-b138-79f2568d050a for instance with vm_state building and task_state spawning.
Nov 13 18:53:57 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:53:57 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:53:57 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:53:57 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:53:57 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:53:57 user nova-compute[75216]: DEBUG nova.compute.manager [req-5b2d1646-bf43-4e6c-afef-9b154e675db0 req-32c0fc2e-b0a3-4d9d-9e72-388649038a3f service nova] [instance: 3f08c061-312d-42d3-a811-e98ace4e7a63] Received event network-vif-plugged-225eb5bf-3c60-42f6-9bf7-e045ccda1213 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:53:57 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-5b2d1646-bf43-4e6c-afef-9b154e675db0 req-32c0fc2e-b0a3-4d9d-9e72-388649038a3f service nova] Acquiring lock "3f08c061-312d-42d3-a811-e98ace4e7a63-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:53:57 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-5b2d1646-bf43-4e6c-afef-9b154e675db0 req-32c0fc2e-b0a3-4d9d-9e72-388649038a3f service nova] Lock "3f08c061-312d-42d3-a811-e98ace4e7a63-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:53:57 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-5b2d1646-bf43-4e6c-afef-9b154e675db0 req-32c0fc2e-b0a3-4d9d-9e72-388649038a3f service nova] Lock "3f08c061-312d-42d3-a811-e98ace4e7a63-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:53:57 user nova-compute[75216]: DEBUG nova.compute.manager [req-5b2d1646-bf43-4e6c-afef-9b154e675db0 req-32c0fc2e-b0a3-4d9d-9e72-388649038a3f service nova] [instance: 3f08c061-312d-42d3-a811-e98ace4e7a63] No waiting events found dispatching network-vif-plugged-225eb5bf-3c60-42f6-9bf7-e045ccda1213 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:53:57 user nova-compute[75216]: WARNING nova.compute.manager [req-5b2d1646-bf43-4e6c-afef-9b154e675db0 req-32c0fc2e-b0a3-4d9d-9e72-388649038a3f service nova] [instance: 3f08c061-312d-42d3-a811-e98ace4e7a63] Received unexpected event network-vif-plugged-225eb5bf-3c60-42f6-9bf7-e045ccda1213 for instance with vm_state building and task_state spawning.
Nov 13 18:53:57 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:53:57 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:53:57 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:53:57 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:53:57 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:53:57 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:53:58 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:53:58 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:53:58 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:53:58 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:53:58 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:53:59 user nova-compute[75216]: DEBUG nova.compute.manager [req-ac5bdbdc-d9b2-48a5-818d-edb5527fe79a req-0a314fa2-da8a-4af8-ab2c-b2e681e66f14 service nova] [instance: ded8f476-cf44-4c5e-8f6b-f36a9ee9a78b] Received event network-vif-plugged-88b781a1-8dbb-455d-b138-79f2568d050a {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:53:59 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-ac5bdbdc-d9b2-48a5-818d-edb5527fe79a req-0a314fa2-da8a-4af8-ab2c-b2e681e66f14 service nova] Acquiring lock "ded8f476-cf44-4c5e-8f6b-f36a9ee9a78b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:53:59 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-ac5bdbdc-d9b2-48a5-818d-edb5527fe79a req-0a314fa2-da8a-4af8-ab2c-b2e681e66f14 service nova] Lock "ded8f476-cf44-4c5e-8f6b-f36a9ee9a78b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:53:59 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-ac5bdbdc-d9b2-48a5-818d-edb5527fe79a req-0a314fa2-da8a-4af8-ab2c-b2e681e66f14 service nova] Lock "ded8f476-cf44-4c5e-8f6b-f36a9ee9a78b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:53:59 user nova-compute[75216]: DEBUG nova.compute.manager [req-ac5bdbdc-d9b2-48a5-818d-edb5527fe79a req-0a314fa2-da8a-4af8-ab2c-b2e681e66f14 service nova] [instance: ded8f476-cf44-4c5e-8f6b-f36a9ee9a78b] No waiting events found dispatching network-vif-plugged-88b781a1-8dbb-455d-b138-79f2568d050a {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:53:59 user nova-compute[75216]: WARNING nova.compute.manager [req-ac5bdbdc-d9b2-48a5-818d-edb5527fe79a req-0a314fa2-da8a-4af8-ab2c-b2e681e66f14 service nova] [instance: ded8f476-cf44-4c5e-8f6b-f36a9ee9a78b] Received unexpected event network-vif-plugged-88b781a1-8dbb-455d-b138-79f2568d050a for instance with vm_state building and task_state spawning.
Nov 13 18:53:59 user nova-compute[75216]: DEBUG nova.compute.manager [req-ac5bdbdc-d9b2-48a5-818d-edb5527fe79a req-0a314fa2-da8a-4af8-ab2c-b2e681e66f14 service nova] [instance: 91ea8a19-a365-484c-80c7-baf90e7dd1aa] Received event network-vif-plugged-2cfb645f-7bee-4657-b0d8-afcaa0298ac9 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:53:59 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-ac5bdbdc-d9b2-48a5-818d-edb5527fe79a req-0a314fa2-da8a-4af8-ab2c-b2e681e66f14 service nova] Acquiring lock "91ea8a19-a365-484c-80c7-baf90e7dd1aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:53:59 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-ac5bdbdc-d9b2-48a5-818d-edb5527fe79a req-0a314fa2-da8a-4af8-ab2c-b2e681e66f14 service nova] Lock "91ea8a19-a365-484c-80c7-baf90e7dd1aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:53:59 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-ac5bdbdc-d9b2-48a5-818d-edb5527fe79a req-0a314fa2-da8a-4af8-ab2c-b2e681e66f14 service nova] Lock "91ea8a19-a365-484c-80c7-baf90e7dd1aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:53:59 user nova-compute[75216]: DEBUG nova.compute.manager [req-ac5bdbdc-d9b2-48a5-818d-edb5527fe79a req-0a314fa2-da8a-4af8-ab2c-b2e681e66f14 service nova] [instance: 91ea8a19-a365-484c-80c7-baf90e7dd1aa] No waiting events found dispatching network-vif-plugged-2cfb645f-7bee-4657-b0d8-afcaa0298ac9 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:53:59 user nova-compute[75216]: WARNING nova.compute.manager [req-ac5bdbdc-d9b2-48a5-818d-edb5527fe79a req-0a314fa2-da8a-4af8-ab2c-b2e681e66f14 service nova] [instance: 91ea8a19-a365-484c-80c7-baf90e7dd1aa] Received unexpected event network-vif-plugged-2cfb645f-7bee-4657-b0d8-afcaa0298ac9 for instance with vm_state active and task_state resize_finish.
Nov 13 18:53:59 user nova-compute[75216]: DEBUG nova.compute.manager [req-ac5bdbdc-d9b2-48a5-818d-edb5527fe79a req-0a314fa2-da8a-4af8-ab2c-b2e681e66f14 service nova] [instance: 91ea8a19-a365-484c-80c7-baf90e7dd1aa] Received event network-vif-plugged-2cfb645f-7bee-4657-b0d8-afcaa0298ac9 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:53:59 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-ac5bdbdc-d9b2-48a5-818d-edb5527fe79a req-0a314fa2-da8a-4af8-ab2c-b2e681e66f14 service nova] Acquiring lock "91ea8a19-a365-484c-80c7-baf90e7dd1aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:53:59 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-ac5bdbdc-d9b2-48a5-818d-edb5527fe79a req-0a314fa2-da8a-4af8-ab2c-b2e681e66f14 service nova] Lock "91ea8a19-a365-484c-80c7-baf90e7dd1aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:53:59 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-ac5bdbdc-d9b2-48a5-818d-edb5527fe79a req-0a314fa2-da8a-4af8-ab2c-b2e681e66f14 service nova] Lock "91ea8a19-a365-484c-80c7-baf90e7dd1aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:53:59 user nova-compute[75216]: DEBUG nova.compute.manager [req-ac5bdbdc-d9b2-48a5-818d-edb5527fe79a req-0a314fa2-da8a-4af8-ab2c-b2e681e66f14 service nova] [instance: 91ea8a19-a365-484c-80c7-baf90e7dd1aa] No waiting events found dispatching network-vif-plugged-2cfb645f-7bee-4657-b0d8-afcaa0298ac9 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:53:59 user nova-compute[75216]: WARNING nova.compute.manager [req-ac5bdbdc-d9b2-48a5-818d-edb5527fe79a req-0a314fa2-da8a-4af8-ab2c-b2e681e66f14 service nova] [instance: 91ea8a19-a365-484c-80c7-baf90e7dd1aa] Received unexpected event network-vif-plugged-2cfb645f-7bee-4657-b0d8-afcaa0298ac9 for instance with vm_state active and task_state resize_finish.
Nov 13 18:53:59 user nova-compute[75216]: DEBUG nova.compute.manager [req-43e4a3a3-2a63-434e-8b79-d49c64634165 req-a1dbf7a3-2535-49be-9889-7098c0a78e42 service nova] [instance: 3f08c061-312d-42d3-a811-e98ace4e7a63] Received event network-vif-plugged-225eb5bf-3c60-42f6-9bf7-e045ccda1213 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:53:59 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-43e4a3a3-2a63-434e-8b79-d49c64634165 req-a1dbf7a3-2535-49be-9889-7098c0a78e42 service nova] Acquiring lock "3f08c061-312d-42d3-a811-e98ace4e7a63-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:53:59 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-43e4a3a3-2a63-434e-8b79-d49c64634165 req-a1dbf7a3-2535-49be-9889-7098c0a78e42 service nova] Lock "3f08c061-312d-42d3-a811-e98ace4e7a63-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:53:59 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-43e4a3a3-2a63-434e-8b79-d49c64634165 req-a1dbf7a3-2535-49be-9889-7098c0a78e42 service nova] Lock "3f08c061-312d-42d3-a811-e98ace4e7a63-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:53:59 user nova-compute[75216]: DEBUG nova.compute.manager [req-43e4a3a3-2a63-434e-8b79-d49c64634165 req-a1dbf7a3-2535-49be-9889-7098c0a78e42 service nova] [instance: 3f08c061-312d-42d3-a811-e98ace4e7a63] No waiting events found dispatching network-vif-plugged-225eb5bf-3c60-42f6-9bf7-e045ccda1213 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:53:59 user nova-compute[75216]: WARNING nova.compute.manager [req-43e4a3a3-2a63-434e-8b79-d49c64634165 req-a1dbf7a3-2535-49be-9889-7098c0a78e42 service nova] [instance: 3f08c061-312d-42d3-a811-e98ace4e7a63] Received unexpected event network-vif-plugged-225eb5bf-3c60-42f6-9bf7-e045ccda1213 for instance with vm_state building and task_state spawning.
Nov 13 18:53:59 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:54:00 user nova-compute[75216]: DEBUG nova.compute.manager [None req-7692a0ee-5f44-457a-8dcb-b0a79aec8331 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] [instance: ded8f476-cf44-4c5e-8f6b-f36a9ee9a78b] Instance event wait completed in 0 seconds for  {{(pid=75216) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 18:54:00 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-7692a0ee-5f44-457a-8dcb-b0a79aec8331 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] [instance: ded8f476-cf44-4c5e-8f6b-f36a9ee9a78b] Guest created on hypervisor {{(pid=75216) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 18:54:00 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: ded8f476-cf44-4c5e-8f6b-f36a9ee9a78b] Instance spawned successfully.
Nov 13 18:54:00 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-7692a0ee-5f44-457a-8dcb-b0a79aec8331 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] [instance: ded8f476-cf44-4c5e-8f6b-f36a9ee9a78b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 18:54:00 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-7692a0ee-5f44-457a-8dcb-b0a79aec8331 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] [instance: ded8f476-cf44-4c5e-8f6b-f36a9ee9a78b] Found default for hw_cdrom_bus of ide {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 18:54:00 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-7692a0ee-5f44-457a-8dcb-b0a79aec8331 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] [instance: ded8f476-cf44-4c5e-8f6b-f36a9ee9a78b] Found default for hw_disk_bus of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 18:54:00 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-7692a0ee-5f44-457a-8dcb-b0a79aec8331 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] [instance: ded8f476-cf44-4c5e-8f6b-f36a9ee9a78b] Found default for hw_input_bus of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 18:54:00 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-7692a0ee-5f44-457a-8dcb-b0a79aec8331 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] [instance: ded8f476-cf44-4c5e-8f6b-f36a9ee9a78b] Found default for hw_pointer_model of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 18:54:00 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-7692a0ee-5f44-457a-8dcb-b0a79aec8331 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] [instance: ded8f476-cf44-4c5e-8f6b-f36a9ee9a78b] Found default for hw_video_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 18:54:00 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-7692a0ee-5f44-457a-8dcb-b0a79aec8331 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] [instance: ded8f476-cf44-4c5e-8f6b-f36a9ee9a78b] Found default for hw_vif_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 18:54:00 user nova-compute[75216]: DEBUG nova.compute.manager [None req-40e625e0-9112-4deb-8e2e-695e767786db tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] [instance: 91ea8a19-a365-484c-80c7-baf90e7dd1aa] Instance event wait completed in 0 seconds for  {{(pid=75216) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 18:54:00 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 91ea8a19-a365-484c-80c7-baf90e7dd1aa] Instance running successfully.
Nov 13 18:54:00 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-40e625e0-9112-4deb-8e2e-695e767786db tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] [instance: 91ea8a19-a365-484c-80c7-baf90e7dd1aa] Failed to set time: agent not configured {{(pid=75216) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 13 18:54:00 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-40e625e0-9112-4deb-8e2e-695e767786db tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] [instance: 91ea8a19-a365-484c-80c7-baf90e7dd1aa] finish_migration finished successfully. {{(pid=75216) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Nov 13 18:54:00 user nova-compute[75216]: INFO nova.compute.manager [None req-7692a0ee-5f44-457a-8dcb-b0a79aec8331 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] [instance: ded8f476-cf44-4c5e-8f6b-f36a9ee9a78b] Took 10.32 seconds to spawn the instance on the hypervisor.
Nov 13 18:54:00 user nova-compute[75216]: DEBUG nova.compute.manager [None req-7692a0ee-5f44-457a-8dcb-b0a79aec8331 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] [instance: ded8f476-cf44-4c5e-8f6b-f36a9ee9a78b] Checking state {{(pid=75216) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 18:54:00 user nova-compute[75216]: DEBUG nova.compute.manager [None req-619aa454-647c-4a07-ab23-447aa33cf4d8 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] [instance: 3f08c061-312d-42d3-a811-e98ace4e7a63] Instance event wait completed in 0 seconds for  {{(pid=75216) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 18:54:00 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-619aa454-647c-4a07-ab23-447aa33cf4d8 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] [instance: 3f08c061-312d-42d3-a811-e98ace4e7a63] Guest created on hypervisor {{(pid=75216) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 18:54:00 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 3f08c061-312d-42d3-a811-e98ace4e7a63] Instance spawned successfully.
Nov 13 18:54:00 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-619aa454-647c-4a07-ab23-447aa33cf4d8 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] [instance: 3f08c061-312d-42d3-a811-e98ace4e7a63] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 18:54:00 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-619aa454-647c-4a07-ab23-447aa33cf4d8 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] [instance: 3f08c061-312d-42d3-a811-e98ace4e7a63] Found default for hw_cdrom_bus of ide {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 18:54:00 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-619aa454-647c-4a07-ab23-447aa33cf4d8 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] [instance: 3f08c061-312d-42d3-a811-e98ace4e7a63] Found default for hw_disk_bus of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 18:54:00 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-619aa454-647c-4a07-ab23-447aa33cf4d8 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] [instance: 3f08c061-312d-42d3-a811-e98ace4e7a63] Found default for hw_input_bus of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 18:54:00 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-619aa454-647c-4a07-ab23-447aa33cf4d8 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] [instance: 3f08c061-312d-42d3-a811-e98ace4e7a63] Found default for hw_pointer_model of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 18:54:00 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-619aa454-647c-4a07-ab23-447aa33cf4d8 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] [instance: 3f08c061-312d-42d3-a811-e98ace4e7a63] Found default for hw_video_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 18:54:00 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-619aa454-647c-4a07-ab23-447aa33cf4d8 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] [instance: 3f08c061-312d-42d3-a811-e98ace4e7a63] Found default for hw_vif_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 18:54:00 user nova-compute[75216]: INFO nova.compute.manager [None req-619aa454-647c-4a07-ab23-447aa33cf4d8 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] [instance: 3f08c061-312d-42d3-a811-e98ace4e7a63] Took 9.60 seconds to spawn the instance on the hypervisor.
Nov 13 18:54:00 user nova-compute[75216]: DEBUG nova.compute.manager [None req-619aa454-647c-4a07-ab23-447aa33cf4d8 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] [instance: 3f08c061-312d-42d3-a811-e98ace4e7a63] Checking state {{(pid=75216) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 18:54:00 user nova-compute[75216]: INFO nova.compute.manager [None req-7692a0ee-5f44-457a-8dcb-b0a79aec8331 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] [instance: ded8f476-cf44-4c5e-8f6b-f36a9ee9a78b] Took 11.55 seconds to build instance.
Nov 13 18:54:00 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-7692a0ee-5f44-457a-8dcb-b0a79aec8331 tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] Lock "ded8f476-cf44-4c5e-8f6b-f36a9ee9a78b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.700s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:54:00 user nova-compute[75216]: INFO nova.compute.manager [None req-619aa454-647c-4a07-ab23-447aa33cf4d8 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] [instance: 3f08c061-312d-42d3-a811-e98ace4e7a63] Took 11.28 seconds to build instance.
Nov 13 18:54:00 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-619aa454-647c-4a07-ab23-447aa33cf4d8 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Lock "3f08c061-312d-42d3-a811-e98ace4e7a63" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.400s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:54:03 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:54:04 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:54:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:54:09 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:54:12 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-7bb76d17-f0a1-4161-b2b6-7cca7655b41b tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Acquiring lock "7c9d9c1b-6df5-41ff-a696-871e70d04e07" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:54:12 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-7bb76d17-f0a1-4161-b2b6-7cca7655b41b tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Lock "7c9d9c1b-6df5-41ff-a696-871e70d04e07" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:54:12 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-7bb76d17-f0a1-4161-b2b6-7cca7655b41b tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Acquiring lock "7c9d9c1b-6df5-41ff-a696-871e70d04e07-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:54:12 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-7bb76d17-f0a1-4161-b2b6-7cca7655b41b tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Lock "7c9d9c1b-6df5-41ff-a696-871e70d04e07-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:54:12 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-7bb76d17-f0a1-4161-b2b6-7cca7655b41b tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Lock "7c9d9c1b-6df5-41ff-a696-871e70d04e07-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:54:12 user nova-compute[75216]: INFO nova.compute.manager [None req-7bb76d17-f0a1-4161-b2b6-7cca7655b41b tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: 7c9d9c1b-6df5-41ff-a696-871e70d04e07] Terminating instance
Nov 13 18:54:12 user nova-compute[75216]: DEBUG nova.compute.manager [None req-7bb76d17-f0a1-4161-b2b6-7cca7655b41b tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: 7c9d9c1b-6df5-41ff-a696-871e70d04e07] Start destroying the instance on the hypervisor. {{(pid=75216) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 18:54:12 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:54:12 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:54:12 user nova-compute[75216]: DEBUG nova.compute.manager [req-164513cc-af58-4256-ae28-7896734e4959 req-293c6c49-4381-4a71-9bbe-f0f30c1f2adc service nova] [instance: 7c9d9c1b-6df5-41ff-a696-871e70d04e07] Received event network-vif-unplugged-c7fc6ea1-71ae-4068-b4a4-e3432a82cfad {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:54:12 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-164513cc-af58-4256-ae28-7896734e4959 req-293c6c49-4381-4a71-9bbe-f0f30c1f2adc service nova] Acquiring lock "7c9d9c1b-6df5-41ff-a696-871e70d04e07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:54:12 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-164513cc-af58-4256-ae28-7896734e4959 req-293c6c49-4381-4a71-9bbe-f0f30c1f2adc service nova] Lock "7c9d9c1b-6df5-41ff-a696-871e70d04e07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:54:12 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-164513cc-af58-4256-ae28-7896734e4959 req-293c6c49-4381-4a71-9bbe-f0f30c1f2adc service nova] Lock "7c9d9c1b-6df5-41ff-a696-871e70d04e07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:54:12 user nova-compute[75216]: DEBUG nova.compute.manager [req-164513cc-af58-4256-ae28-7896734e4959 req-293c6c49-4381-4a71-9bbe-f0f30c1f2adc service nova] [instance: 7c9d9c1b-6df5-41ff-a696-871e70d04e07] No waiting events found dispatching network-vif-unplugged-c7fc6ea1-71ae-4068-b4a4-e3432a82cfad {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:54:12 user nova-compute[75216]: DEBUG nova.compute.manager [req-164513cc-af58-4256-ae28-7896734e4959 req-293c6c49-4381-4a71-9bbe-f0f30c1f2adc service nova] [instance: 7c9d9c1b-6df5-41ff-a696-871e70d04e07] Received event network-vif-unplugged-c7fc6ea1-71ae-4068-b4a4-e3432a82cfad for instance with task_state deleting. {{(pid=75216) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 18:54:13 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:54:13 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:54:13 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:54:13 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:54:13 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:54:13 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 7c9d9c1b-6df5-41ff-a696-871e70d04e07] Instance destroyed successfully.
Nov 13 18:54:13 user nova-compute[75216]: DEBUG nova.objects.instance [None req-7bb76d17-f0a1-4161-b2b6-7cca7655b41b tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Lazy-loading 'resources' on Instance uuid 7c9d9c1b-6df5-41ff-a696-871e70d04e07 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 18:54:13 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:54:13 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-7bb76d17-f0a1-4161-b2b6-7cca7655b41b tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-13T18:48:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1402749069',display_name='tempest-ServerActionsTestOtherA-server-704140763',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1402749069',id=15,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB3Ae+ECFlA3sYuvUiY4zZUqwlHO9GOkN+S3EitsaTvPnKHRwjJAlSh4xDkptEhbxWjHAYqFkukQp4RTJQ+f+V7vYOIcvfMMYXH7rnQu72lMH/fbmDohZCVr2iSodUm4lA==',key_name='tempest-keypair-773824062',keypairs=<?>,launch_index=0,launched_at=2023-11-13T18:50:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b9b7e11038e54e368acd22d06e54a351',ramdisk_id='',reservation_id='r-2lvnqzq7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-537419316',owner_user_name='tempest-ServerActionsTestOtherA-537419316-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T18:50:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='23f029ff09464d699e5bd6dbf44a905d',uuid=7c9d9c1b-6df5-41ff-a696-871e70d04e07,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c7fc6ea1-71ae-4068-b4a4-e3432a82cfad", "address": "fa:16:3e:57:f0:d2", "network": {"id": "d7a691f0-4495-40ad-a349-91b5dc9c635a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-961583097-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9b7e11038e54e368acd22d06e54a351", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7fc6ea1-71", "ovs_interfaceid": "c7fc6ea1-71ae-4068-b4a4-e3432a82cfad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 18:54:13 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-7bb76d17-f0a1-4161-b2b6-7cca7655b41b tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Converting VIF {"id": "c7fc6ea1-71ae-4068-b4a4-e3432a82cfad", "address": "fa:16:3e:57:f0:d2", "network": {"id": "d7a691f0-4495-40ad-a349-91b5dc9c635a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-961583097-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9b7e11038e54e368acd22d06e54a351", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7fc6ea1-71", "ovs_interfaceid": "c7fc6ea1-71ae-4068-b4a4-e3432a82cfad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 18:54:13 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-7bb76d17-f0a1-4161-b2b6-7cca7655b41b tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:57:f0:d2,bridge_name='br-int',has_traffic_filtering=True,id=c7fc6ea1-71ae-4068-b4a4-e3432a82cfad,network=Network(d7a691f0-4495-40ad-a349-91b5dc9c635a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7fc6ea1-71') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 18:54:13 user nova-compute[75216]: DEBUG os_vif [None req-7bb76d17-f0a1-4161-b2b6-7cca7655b41b tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:57:f0:d2,bridge_name='br-int',has_traffic_filtering=True,id=c7fc6ea1-71ae-4068-b4a4-e3432a82cfad,network=Network(d7a691f0-4495-40ad-a349-91b5dc9c635a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7fc6ea1-71') {{(pid=75216) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 18:54:13 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:54:13 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc7fc6ea1-71, bridge=br-int, if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:54:13 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:54:13 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:54:13 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:54:13 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1c79d41a-4805-4654-9766-b99dd39a1b6c) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:54:13 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:54:13 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:54:13 user nova-compute[75216]: INFO os_vif [None req-7bb76d17-f0a1-4161-b2b6-7cca7655b41b tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:57:f0:d2,bridge_name='br-int',has_traffic_filtering=True,id=c7fc6ea1-71ae-4068-b4a4-e3432a82cfad,network=Network(d7a691f0-4495-40ad-a349-91b5dc9c635a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7fc6ea1-71')
Nov 13 18:54:13 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-7bb76d17-f0a1-4161-b2b6-7cca7655b41b tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: 7c9d9c1b-6df5-41ff-a696-871e70d04e07] Deleting instance files /opt/stack/data/nova/instances/7c9d9c1b-6df5-41ff-a696-871e70d04e07_del
Nov 13 18:54:13 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-7bb76d17-f0a1-4161-b2b6-7cca7655b41b tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: 7c9d9c1b-6df5-41ff-a696-871e70d04e07] Deletion of /opt/stack/data/nova/instances/7c9d9c1b-6df5-41ff-a696-871e70d04e07_del complete
Nov 13 18:54:13 user nova-compute[75216]: INFO nova.compute.manager [None req-7bb76d17-f0a1-4161-b2b6-7cca7655b41b tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: 7c9d9c1b-6df5-41ff-a696-871e70d04e07] Took 0.99 seconds to destroy the instance on the hypervisor.
Nov 13 18:54:13 user nova-compute[75216]: DEBUG oslo.service.loopingcall [None req-7bb76d17-f0a1-4161-b2b6-7cca7655b41b tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75216) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 18:54:13 user nova-compute[75216]: DEBUG nova.compute.manager [-] [instance: 7c9d9c1b-6df5-41ff-a696-871e70d04e07] Deallocating network for instance {{(pid=75216) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 18:54:13 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: 7c9d9c1b-6df5-41ff-a696-871e70d04e07] deallocate_for_instance() {{(pid=75216) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 18:54:13 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:54:13 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:54:13 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:54:13 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:54:14 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: 7c9d9c1b-6df5-41ff-a696-871e70d04e07] Updating instance_info_cache with network_info: [] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 18:54:14 user nova-compute[75216]: INFO nova.compute.manager [-] [instance: 7c9d9c1b-6df5-41ff-a696-871e70d04e07] Took 1.28 seconds to deallocate network for instance.
Nov 13 18:54:14 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-7bb76d17-f0a1-4161-b2b6-7cca7655b41b tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:54:14 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-7bb76d17-f0a1-4161-b2b6-7cca7655b41b tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:54:14 user nova-compute[75216]: DEBUG nova.compute.manager [req-c78213bf-406e-4058-b5e6-5ed6037ad43e req-49c3d124-2b75-41ab-980b-f97e86dfe923 service nova] [instance: 7c9d9c1b-6df5-41ff-a696-871e70d04e07] Received event network-vif-plugged-c7fc6ea1-71ae-4068-b4a4-e3432a82cfad {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:54:14 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-c78213bf-406e-4058-b5e6-5ed6037ad43e req-49c3d124-2b75-41ab-980b-f97e86dfe923 service nova] Acquiring lock "7c9d9c1b-6df5-41ff-a696-871e70d04e07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:54:14 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-c78213bf-406e-4058-b5e6-5ed6037ad43e req-49c3d124-2b75-41ab-980b-f97e86dfe923 service nova] Lock "7c9d9c1b-6df5-41ff-a696-871e70d04e07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:54:14 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-c78213bf-406e-4058-b5e6-5ed6037ad43e req-49c3d124-2b75-41ab-980b-f97e86dfe923 service nova] Lock "7c9d9c1b-6df5-41ff-a696-871e70d04e07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:54:14 user nova-compute[75216]: DEBUG nova.compute.manager [req-c78213bf-406e-4058-b5e6-5ed6037ad43e req-49c3d124-2b75-41ab-980b-f97e86dfe923 service nova] [instance: 7c9d9c1b-6df5-41ff-a696-871e70d04e07] No waiting events found dispatching network-vif-plugged-c7fc6ea1-71ae-4068-b4a4-e3432a82cfad {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:54:14 user nova-compute[75216]: WARNING nova.compute.manager [req-c78213bf-406e-4058-b5e6-5ed6037ad43e req-49c3d124-2b75-41ab-980b-f97e86dfe923 service nova] [instance: 7c9d9c1b-6df5-41ff-a696-871e70d04e07] Received unexpected event network-vif-plugged-c7fc6ea1-71ae-4068-b4a4-e3432a82cfad for instance with vm_state deleted and task_state None.
Nov 13 18:54:14 user nova-compute[75216]: DEBUG nova.compute.manager [req-c78213bf-406e-4058-b5e6-5ed6037ad43e req-49c3d124-2b75-41ab-980b-f97e86dfe923 service nova] [instance: 7c9d9c1b-6df5-41ff-a696-871e70d04e07] Received event network-vif-plugged-c7fc6ea1-71ae-4068-b4a4-e3432a82cfad {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:54:14 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-c78213bf-406e-4058-b5e6-5ed6037ad43e req-49c3d124-2b75-41ab-980b-f97e86dfe923 service nova] Acquiring lock "7c9d9c1b-6df5-41ff-a696-871e70d04e07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:54:14 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-c78213bf-406e-4058-b5e6-5ed6037ad43e req-49c3d124-2b75-41ab-980b-f97e86dfe923 service nova] Lock "7c9d9c1b-6df5-41ff-a696-871e70d04e07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:54:14 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-c78213bf-406e-4058-b5e6-5ed6037ad43e req-49c3d124-2b75-41ab-980b-f97e86dfe923 service nova] Lock "7c9d9c1b-6df5-41ff-a696-871e70d04e07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:54:14 user nova-compute[75216]: DEBUG nova.compute.manager [req-c78213bf-406e-4058-b5e6-5ed6037ad43e req-49c3d124-2b75-41ab-980b-f97e86dfe923 service nova] [instance: 7c9d9c1b-6df5-41ff-a696-871e70d04e07] No waiting events found dispatching network-vif-plugged-c7fc6ea1-71ae-4068-b4a4-e3432a82cfad {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:54:14 user nova-compute[75216]: WARNING nova.compute.manager [req-c78213bf-406e-4058-b5e6-5ed6037ad43e req-49c3d124-2b75-41ab-980b-f97e86dfe923 service nova] [instance: 7c9d9c1b-6df5-41ff-a696-871e70d04e07] Received unexpected event network-vif-plugged-c7fc6ea1-71ae-4068-b4a4-e3432a82cfad for instance with vm_state deleted and task_state None.
Nov 13 18:54:14 user nova-compute[75216]: DEBUG nova.compute.manager [req-c78213bf-406e-4058-b5e6-5ed6037ad43e req-49c3d124-2b75-41ab-980b-f97e86dfe923 service nova] [instance: 7c9d9c1b-6df5-41ff-a696-871e70d04e07] Received event network-vif-plugged-c7fc6ea1-71ae-4068-b4a4-e3432a82cfad {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:54:14 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-c78213bf-406e-4058-b5e6-5ed6037ad43e req-49c3d124-2b75-41ab-980b-f97e86dfe923 service nova] Acquiring lock "7c9d9c1b-6df5-41ff-a696-871e70d04e07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:54:14 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-c78213bf-406e-4058-b5e6-5ed6037ad43e req-49c3d124-2b75-41ab-980b-f97e86dfe923 service nova] Lock "7c9d9c1b-6df5-41ff-a696-871e70d04e07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:54:14 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-c78213bf-406e-4058-b5e6-5ed6037ad43e req-49c3d124-2b75-41ab-980b-f97e86dfe923 service nova] Lock "7c9d9c1b-6df5-41ff-a696-871e70d04e07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:54:14 user nova-compute[75216]: DEBUG nova.compute.manager [req-c78213bf-406e-4058-b5e6-5ed6037ad43e req-49c3d124-2b75-41ab-980b-f97e86dfe923 service nova] [instance: 7c9d9c1b-6df5-41ff-a696-871e70d04e07] No waiting events found dispatching network-vif-plugged-c7fc6ea1-71ae-4068-b4a4-e3432a82cfad {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:54:14 user nova-compute[75216]: WARNING nova.compute.manager [req-c78213bf-406e-4058-b5e6-5ed6037ad43e req-49c3d124-2b75-41ab-980b-f97e86dfe923 service nova] [instance: 7c9d9c1b-6df5-41ff-a696-871e70d04e07] Received unexpected event network-vif-plugged-c7fc6ea1-71ae-4068-b4a4-e3432a82cfad for instance with vm_state deleted and task_state None.
Nov 13 18:54:14 user nova-compute[75216]: DEBUG nova.compute.manager [req-c78213bf-406e-4058-b5e6-5ed6037ad43e req-49c3d124-2b75-41ab-980b-f97e86dfe923 service nova] [instance: 7c9d9c1b-6df5-41ff-a696-871e70d04e07] Received event network-vif-unplugged-c7fc6ea1-71ae-4068-b4a4-e3432a82cfad {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:54:14 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-c78213bf-406e-4058-b5e6-5ed6037ad43e req-49c3d124-2b75-41ab-980b-f97e86dfe923 service nova] Acquiring lock "7c9d9c1b-6df5-41ff-a696-871e70d04e07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:54:14 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-c78213bf-406e-4058-b5e6-5ed6037ad43e req-49c3d124-2b75-41ab-980b-f97e86dfe923 service nova] Lock "7c9d9c1b-6df5-41ff-a696-871e70d04e07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:54:14 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-c78213bf-406e-4058-b5e6-5ed6037ad43e req-49c3d124-2b75-41ab-980b-f97e86dfe923 service nova] Lock "7c9d9c1b-6df5-41ff-a696-871e70d04e07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:54:14 user nova-compute[75216]: DEBUG nova.compute.manager [req-c78213bf-406e-4058-b5e6-5ed6037ad43e req-49c3d124-2b75-41ab-980b-f97e86dfe923 service nova] [instance: 7c9d9c1b-6df5-41ff-a696-871e70d04e07] No waiting events found dispatching network-vif-unplugged-c7fc6ea1-71ae-4068-b4a4-e3432a82cfad {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:54:14 user nova-compute[75216]: WARNING nova.compute.manager [req-c78213bf-406e-4058-b5e6-5ed6037ad43e req-49c3d124-2b75-41ab-980b-f97e86dfe923 service nova] [instance: 7c9d9c1b-6df5-41ff-a696-871e70d04e07] Received unexpected event network-vif-unplugged-c7fc6ea1-71ae-4068-b4a4-e3432a82cfad for instance with vm_state deleted and task_state None.
Nov 13 18:54:14 user nova-compute[75216]: DEBUG nova.compute.manager [req-c78213bf-406e-4058-b5e6-5ed6037ad43e req-49c3d124-2b75-41ab-980b-f97e86dfe923 service nova] [instance: 7c9d9c1b-6df5-41ff-a696-871e70d04e07] Received event network-vif-plugged-c7fc6ea1-71ae-4068-b4a4-e3432a82cfad {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:54:14 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-c78213bf-406e-4058-b5e6-5ed6037ad43e req-49c3d124-2b75-41ab-980b-f97e86dfe923 service nova] Acquiring lock "7c9d9c1b-6df5-41ff-a696-871e70d04e07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:54:14 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-c78213bf-406e-4058-b5e6-5ed6037ad43e req-49c3d124-2b75-41ab-980b-f97e86dfe923 service nova] Lock "7c9d9c1b-6df5-41ff-a696-871e70d04e07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:54:14 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-c78213bf-406e-4058-b5e6-5ed6037ad43e req-49c3d124-2b75-41ab-980b-f97e86dfe923 service nova] Lock "7c9d9c1b-6df5-41ff-a696-871e70d04e07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:54:14 user nova-compute[75216]: DEBUG nova.compute.manager [req-c78213bf-406e-4058-b5e6-5ed6037ad43e req-49c3d124-2b75-41ab-980b-f97e86dfe923 service nova] [instance: 7c9d9c1b-6df5-41ff-a696-871e70d04e07] No waiting events found dispatching network-vif-plugged-c7fc6ea1-71ae-4068-b4a4-e3432a82cfad {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:54:14 user nova-compute[75216]: WARNING nova.compute.manager [req-c78213bf-406e-4058-b5e6-5ed6037ad43e req-49c3d124-2b75-41ab-980b-f97e86dfe923 service nova] [instance: 7c9d9c1b-6df5-41ff-a696-871e70d04e07] Received unexpected event network-vif-plugged-c7fc6ea1-71ae-4068-b4a4-e3432a82cfad for instance with vm_state deleted and task_state None.
Nov 13 18:54:14 user nova-compute[75216]: DEBUG nova.compute.manager [req-c78213bf-406e-4058-b5e6-5ed6037ad43e req-49c3d124-2b75-41ab-980b-f97e86dfe923 service nova] [instance: 7c9d9c1b-6df5-41ff-a696-871e70d04e07] Received event network-vif-deleted-c7fc6ea1-71ae-4068-b4a4-e3432a82cfad {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:54:15 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-7bb76d17-f0a1-4161-b2b6-7cca7655b41b tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 18:54:15 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-7bb76d17-f0a1-4161-b2b6-7cca7655b41b tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 18:54:15 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-7bb76d17-f0a1-4161-b2b6-7cca7655b41b tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.362s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:54:15 user nova-compute[75216]: INFO nova.scheduler.client.report [None req-7bb76d17-f0a1-4161-b2b6-7cca7655b41b tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Deleted allocations for instance 7c9d9c1b-6df5-41ff-a696-871e70d04e07
Nov 13 18:54:15 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-7bb76d17-f0a1-4161-b2b6-7cca7655b41b tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Lock "7c9d9c1b-6df5-41ff-a696-871e70d04e07" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.839s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:54:18 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:54:18 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:54:19 user nova-compute[75216]: DEBUG nova.compute.manager [None req-0239bb7a-8f36-41d5-8806-86d3c4bc161b tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1] Checking state {{(pid=75216) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 18:54:19 user nova-compute[75216]: INFO nova.compute.manager [None req-0239bb7a-8f36-41d5-8806-86d3c4bc161b tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1] instance snapshotting
Nov 13 18:54:19 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-0239bb7a-8f36-41d5-8806-86d3c4bc161b tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1] Beginning live snapshot process
Nov 13 18:54:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-0239bb7a-8f36-41d5-8806-86d3c4bc161b tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1/disk --force-share --output=json -f qcow2 {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:54:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-0239bb7a-8f36-41d5-8806-86d3c4bc161b tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1/disk --force-share --output=json -f qcow2" returned: 0 in 0.209s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:54:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-0239bb7a-8f36-41d5-8806-86d3c4bc161b tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1/disk --force-share --output=json -f qcow2 {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:54:20 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-0239bb7a-8f36-41d5-8806-86d3c4bc161b tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1/disk --force-share --output=json -f qcow2" returned: 0 in 0.200s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:54:20 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-0239bb7a-8f36-41d5-8806-86d3c4bc161b tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:54:20 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-0239bb7a-8f36-41d5-8806-86d3c4bc161b tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json" returned: 0 in 0.201s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:54:20 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-0239bb7a-8f36-41d5-8806-86d3c4bc161b tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpnaoadfte/01b63c161aae4b9c95c728ade3cb5ed3.delta 1073741824 {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:54:20 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-0239bb7a-8f36-41d5-8806-86d3c4bc161b tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpnaoadfte/01b63c161aae4b9c95c728ade3cb5ed3.delta 1073741824" returned: 0 in 0.061s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:54:20 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-0239bb7a-8f36-41d5-8806-86d3c4bc161b tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 13 18:54:21 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-0239bb7a-8f36-41d5-8806-86d3c4bc161b tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75216) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 13 18:54:21 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-0239bb7a-8f36-41d5-8806-86d3c4bc161b tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75216) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 13 18:54:21 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-0239bb7a-8f36-41d5-8806-86d3c4bc161b tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 13 18:54:21 user nova-compute[75216]: DEBUG nova.privsep.utils [None req-0239bb7a-8f36-41d5-8806-86d3c4bc161b tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75216) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 13 18:54:21 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-0239bb7a-8f36-41d5-8806-86d3c4bc161b tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpnaoadfte/01b63c161aae4b9c95c728ade3cb5ed3.delta /opt/stack/data/nova/instances/snapshots/tmpnaoadfte/01b63c161aae4b9c95c728ade3cb5ed3 {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:54:22 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-0239bb7a-8f36-41d5-8806-86d3c4bc161b tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpnaoadfte/01b63c161aae4b9c95c728ade3cb5ed3.delta /opt/stack/data/nova/instances/snapshots/tmpnaoadfte/01b63c161aae4b9c95c728ade3cb5ed3" returned: 0 in 0.645s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:54:22 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-0239bb7a-8f36-41d5-8806-86d3c4bc161b tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1] Snapshot extracted, beginning image upload
Nov 13 18:54:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:54:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:54:25 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-0239bb7a-8f36-41d5-8806-86d3c4bc161b tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1] Snapshot image upload complete
Nov 13 18:54:25 user nova-compute[75216]: INFO nova.compute.manager [None req-0239bb7a-8f36-41d5-8806-86d3c4bc161b tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1] Took 5.65 seconds to snapshot the instance on the hypervisor.
Nov 13 18:54:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:54:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:54:33 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:54:33 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:54:38 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:54:43 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:54:46 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:54:48 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:54:48 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:54:48 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75216) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 18:54:48 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 18:54:48 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 18:54:48 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:54:48 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:54:48 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:54:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:54:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:54:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:54:48 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Auditing locally available compute resources for user (node: user) {{(pid=75216) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 18:54:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a3e849-6570-4820-97c8-75468b5bea4f/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:54:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a3e849-6570-4820-97c8-75468b5bea4f/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:54:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a3e849-6570-4820-97c8-75468b5bea4f/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:54:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a3e849-6570-4820-97c8-75468b5bea4f/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:54:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9a1edfb-c2ac-4e67-abac-c915ea22a15c/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:54:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9a1edfb-c2ac-4e67-abac-c915ea22a15c/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:54:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9a1edfb-c2ac-4e67-abac-c915ea22a15c/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:54:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9a1edfb-c2ac-4e67-abac-c915ea22a15c/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:54:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14d378b0-79ba-4161-a795-6288939c6fef/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:54:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14d378b0-79ba-4161-a795-6288939c6fef/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:54:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14d378b0-79ba-4161-a795-6288939c6fef/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:54:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14d378b0-79ba-4161-a795-6288939c6fef/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:54:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ded8f476-cf44-4c5e-8f6b-f36a9ee9a78b/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:54:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ded8f476-cf44-4c5e-8f6b-f36a9ee9a78b/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:54:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ded8f476-cf44-4c5e-8f6b-f36a9ee9a78b/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:54:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ded8f476-cf44-4c5e-8f6b-f36a9ee9a78b/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:54:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d589d57e-de50-482a-843f-e8246b3d7528/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:54:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d589d57e-de50-482a-843f-e8246b3d7528/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:54:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d589d57e-de50-482a-843f-e8246b3d7528/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:54:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d589d57e-de50-482a-843f-e8246b3d7528/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:54:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:54:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:54:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:54:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:54:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91ea8a19-a365-484c-80c7-baf90e7dd1aa/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:54:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91ea8a19-a365-484c-80c7-baf90e7dd1aa/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:54:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91ea8a19-a365-484c-80c7-baf90e7dd1aa/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:54:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91ea8a19-a365-484c-80c7-baf90e7dd1aa/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:54:51 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 18:54:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85624c58-6c72-4490-8a3e-547953295ade/disk.rescue --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:54:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85624c58-6c72-4490-8a3e-547953295ade/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:54:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85624c58-6c72-4490-8a3e-547953295ade/disk.rescue --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:54:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85624c58-6c72-4490-8a3e-547953295ade/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:54:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85624c58-6c72-4490-8a3e-547953295ade/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:54:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85624c58-6c72-4490-8a3e-547953295ade/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:54:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85624c58-6c72-4490-8a3e-547953295ade/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:54:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85624c58-6c72-4490-8a3e-547953295ade/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:54:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f08c061-312d-42d3-a811-e98ace4e7a63/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:54:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f08c061-312d-42d3-a811-e98ace4e7a63/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:54:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f08c061-312d-42d3-a811-e98ace4e7a63/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:54:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f08c061-312d-42d3-a811-e98ace4e7a63/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:54:52 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 18:54:52 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 18:54:52 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Hypervisor/Node resource view: name=user free_ram=7700MB free_disk=25.370136260986328GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75216) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 18:54:52 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:54:52 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:54:52 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Applying migration context for instance 91ea8a19-a365-484c-80c7-baf90e7dd1aa as it has an incoming, in-progress migration 0ae048ac-88ae-4635-acf7-90c85c69f04d. Migration status is finished {{(pid=75216) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 13 18:54:52 user nova-compute[75216]: INFO nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: 91ea8a19-a365-484c-80c7-baf90e7dd1aa] Updating resource usage from migration 0ae048ac-88ae-4635-acf7-90c85c69f04d
Nov 13 18:54:52 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance a1a3e849-6570-4820-97c8-75468b5bea4f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 18:54:52 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance d589d57e-de50-482a-843f-e8246b3d7528 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 18:54:52 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance 85624c58-6c72-4490-8a3e-547953295ade actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 18:54:52 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance 14d378b0-79ba-4161-a795-6288939c6fef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 18:54:52 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 18:54:52 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance d9a1edfb-c2ac-4e67-abac-c915ea22a15c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 18:54:52 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Migration 0ae048ac-88ae-4635-acf7-90c85c69f04d is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 13 18:54:52 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance 91ea8a19-a365-484c-80c7-baf90e7dd1aa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 18:54:52 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance ded8f476-cf44-4c5e-8f6b-f36a9ee9a78b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 18:54:52 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance 3f08c061-312d-42d3-a811-e98ace4e7a63 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 18:54:52 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 18:54:52 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=29GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 18:54:53 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 18:54:53 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 18:54:53 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Compute_service record updated for user:user {{(pid=75216) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 18:54:53 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.549s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:54:53 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:54:55 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:54:55 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:54:55 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Starting heal instance info cache {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 18:54:55 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "refresh_cache-91ea8a19-a365-484c-80c7-baf90e7dd1aa" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 18:54:55 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquired lock "refresh_cache-91ea8a19-a365-484c-80c7-baf90e7dd1aa" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 18:54:55 user nova-compute[75216]: DEBUG nova.network.neutron [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: 91ea8a19-a365-484c-80c7-baf90e7dd1aa] Forcefully refreshing network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 18:54:55 user nova-compute[75216]: DEBUG nova.network.neutron [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: 91ea8a19-a365-484c-80c7-baf90e7dd1aa] Updating instance_info_cache with network_info: [{"id": "2cfb645f-7bee-4657-b0d8-afcaa0298ac9", "address": "fa:16:3e:3e:1d:91", "network": {"id": "a9670fc3-8a8e-4a2b-a39f-d41042d3443d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1394481632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0194e3c88e2b49c5ba9b9844f6048ea9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cfb645f-7b", "ovs_interfaceid": "2cfb645f-7bee-4657-b0d8-afcaa0298ac9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 18:54:56 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Releasing lock "refresh_cache-91ea8a19-a365-484c-80c7-baf90e7dd1aa" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 18:54:56 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: 91ea8a19-a365-484c-80c7-baf90e7dd1aa] Updated the network info_cache for instance {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 18:54:56 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:54:56 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:54:56 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:54:56 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:54:56 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:54:56 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75216) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 18:54:58 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:55:03 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:55:03 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:55:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:55:11 user nova-compute[75216]: DEBUG nova.compute.manager [req-3f87b0e0-982c-46b5-bfc4-5e0e4030da22 req-09ee5a15-756b-4be6-917e-297000c65a12 service nova] [instance: d9a1edfb-c2ac-4e67-abac-c915ea22a15c] Received event network-changed-eb2895a9-124a-4504-b197-bb2022f3f55f {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:55:11 user nova-compute[75216]: DEBUG nova.compute.manager [req-3f87b0e0-982c-46b5-bfc4-5e0e4030da22 req-09ee5a15-756b-4be6-917e-297000c65a12 service nova] [instance: d9a1edfb-c2ac-4e67-abac-c915ea22a15c] Refreshing instance network info cache due to event network-changed-eb2895a9-124a-4504-b197-bb2022f3f55f. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 18:55:11 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-3f87b0e0-982c-46b5-bfc4-5e0e4030da22 req-09ee5a15-756b-4be6-917e-297000c65a12 service nova] Acquiring lock "refresh_cache-d9a1edfb-c2ac-4e67-abac-c915ea22a15c" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 18:55:11 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-3f87b0e0-982c-46b5-bfc4-5e0e4030da22 req-09ee5a15-756b-4be6-917e-297000c65a12 service nova] Acquired lock "refresh_cache-d9a1edfb-c2ac-4e67-abac-c915ea22a15c" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 18:55:11 user nova-compute[75216]: DEBUG nova.network.neutron [req-3f87b0e0-982c-46b5-bfc4-5e0e4030da22 req-09ee5a15-756b-4be6-917e-297000c65a12 service nova] [instance: d9a1edfb-c2ac-4e67-abac-c915ea22a15c] Refreshing network info cache for port eb2895a9-124a-4504-b197-bb2022f3f55f {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 18:55:11 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-af90c77b-f3a5-4fab-87d3-1fb6474c1bbe tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Acquiring lock "d9a1edfb-c2ac-4e67-abac-c915ea22a15c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:55:11 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-af90c77b-f3a5-4fab-87d3-1fb6474c1bbe tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Lock "d9a1edfb-c2ac-4e67-abac-c915ea22a15c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:55:11 user nova-compute[75216]: DEBUG nova.objects.instance [None req-af90c77b-f3a5-4fab-87d3-1fb6474c1bbe tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Lazy-loading 'flavor' on Instance uuid d9a1edfb-c2ac-4e67-abac-c915ea22a15c {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 18:55:11 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-af90c77b-f3a5-4fab-87d3-1fb6474c1bbe tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Lock "d9a1edfb-c2ac-4e67-abac-c915ea22a15c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:55:11 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-af90c77b-f3a5-4fab-87d3-1fb6474c1bbe tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Acquiring lock "d9a1edfb-c2ac-4e67-abac-c915ea22a15c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:55:11 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-af90c77b-f3a5-4fab-87d3-1fb6474c1bbe tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Lock "d9a1edfb-c2ac-4e67-abac-c915ea22a15c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:55:11 user nova-compute[75216]: INFO nova.compute.manager [None req-af90c77b-f3a5-4fab-87d3-1fb6474c1bbe tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] [instance: d9a1edfb-c2ac-4e67-abac-c915ea22a15c] Attaching volume 4ee38de6-1fa4-460d-9bb4-49720104365b to /dev/vdb
Nov 13 18:55:11 user nova-compute[75216]: DEBUG nova.network.neutron [req-3f87b0e0-982c-46b5-bfc4-5e0e4030da22 req-09ee5a15-756b-4be6-917e-297000c65a12 service nova] [instance: d9a1edfb-c2ac-4e67-abac-c915ea22a15c] Updated VIF entry in instance network info cache for port eb2895a9-124a-4504-b197-bb2022f3f55f. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 18:55:11 user nova-compute[75216]: DEBUG nova.network.neutron [req-3f87b0e0-982c-46b5-bfc4-5e0e4030da22 req-09ee5a15-756b-4be6-917e-297000c65a12 service nova] [instance: d9a1edfb-c2ac-4e67-abac-c915ea22a15c] Updating instance_info_cache with network_info: [{"id": "eb2895a9-124a-4504-b197-bb2022f3f55f", "address": "fa:16:3e:8d:84:60", "network": {"id": "6d182db1-03b5-4d1b-86cf-b9367921b7b0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1877006951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2efafc26c47c4050bd367c47469999fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb2895a9-12", "ovs_interfaceid": "eb2895a9-124a-4504-b197-bb2022f3f55f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 18:55:11 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-3f87b0e0-982c-46b5-bfc4-5e0e4030da22 req-09ee5a15-756b-4be6-917e-297000c65a12 service nova] Releasing lock "refresh_cache-d9a1edfb-c2ac-4e67-abac-c915ea22a15c" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 18:55:11 user nova-compute[75216]: DEBUG os_brick.utils [None req-af90c77b-f3a5-4fab-87d3-1fb6474c1bbe tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 18:55:11 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:55:11 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:55:11 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[a386537c-6716-48db-8cd0-13a541317cc6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aea6fcfe14b9\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:55:11 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:55:11 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:55:11 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[3913be5a-66d4-4ded-ab30-9fcfb0b87b41]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:55:11 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:55:11 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:55:11 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[753fddc4-1134-40d4-8752-64b820ead34a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:55:11 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[430ce5e8-e9d1-48c3-a80a-4ac8b0af6c0b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:55:11 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-af90c77b-f3a5-4fab-87d3-1fb6474c1bbe tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Running cmd (subprocess): nvme version {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:55:11 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-af90c77b-f3a5-4fab-87d3-1fb6474c1bbe tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] 'nvme version' failed. Not Retrying. {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 18:55:11 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.nvmeof [None req-af90c77b-f3a5-4fab-87d3-1fb6474c1bbe tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] nvme not present on system {{(pid=75216) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 18:55:11 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:55:11 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 18:55:11 user nova-compute[75216]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 18:55:11 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f3e5c0d-42f2-459c-a06d-e77f6abecbcf]: (4, '') {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:55:11 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-af90c77b-f3a5-4fab-87d3-1fb6474c1bbe tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75216) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 18:55:11 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-af90c77b-f3a5-4fab-87d3-1fb6474c1bbe tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 18:55:11 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-af90c77b-f3a5-4fab-87d3-1fb6474c1bbe tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] LIGHTOS: no hostnqn found. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 18:55:11 user nova-compute[75216]: DEBUG os_brick.utils [None req-af90c77b-f3a5-4fab-87d3-1fb6474c1bbe tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aea6fcfe14b9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 18:55:11 user nova-compute[75216]: DEBUG nova.virt.block_device [None req-af90c77b-f3a5-4fab-87d3-1fb6474c1bbe tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] [instance: d9a1edfb-c2ac-4e67-abac-c915ea22a15c] Updating existing volume attachment record: e2bfe6d3-7ab2-4933-a5c4-3450404f597a {{(pid=75216) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 18:55:13 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:55:13 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:55:15 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af90c77b-f3a5-4fab-87d3-1fb6474c1bbe tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] [instance: d9a1edfb-c2ac-4e67-abac-c915ea22a15c] Calling os-brick to attach iSCSI Volume {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 18:55:15 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-af90c77b-f3a5-4fab-87d3-1fb6474c1bbe tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3a8669e40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4ee38de6-1fa4-460d-9bb4-49720104365b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'beykmGQP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 18:55:15 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-af90c77b-f3a5-4fab-87d3-1fb6474c1bbe tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 18:55:15 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-af90c77b-f3a5-4fab-87d3-1fb6474c1bbe tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 18:55:15 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-af90c77b-f3a5-4fab-87d3-1fb6474c1bbe tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 18:55:15 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-af90c77b-f3a5-4fab-87d3-1fb6474c1bbe tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 18:55:15 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-af90c77b-f3a5-4fab-87d3-1fb6474c1bbe tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4ee38de6-1fa4-460d-9bb4-49720104365b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 18:55:15 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-af90c77b-f3a5-4fab-87d3-1fb6474c1bbe tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4ee38de6-1fa4-460d-9bb4-49720104365b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 18:55:15 user nova-compute[75216]: INFO os_brick.initiator.connectors.iscsi [None req-af90c77b-f3a5-4fab-87d3-1fb6474c1bbe tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 18:55:15 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ee38de6-1fa4-460d-9bb4-49720104365b -p 172.16.0.220:3260 {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:55:15 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ee38de6-1fa4-460d-9bb4-49720104365b -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:55:15 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[db0d8948-ab05-4a7d-a50c-3c68d022fcda]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:55:15 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-af90c77b-f3a5-4fab-87d3-1fb6474c1bbe tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 18:55:15 user nova-compute[75216]:  {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:55:15 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ee38de6-1fa4-460d-9bb4-49720104365b -p 172.16.0.220:3260 --interface default --op new {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:55:15 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ee38de6-1fa4-460d-9bb4-49720104365b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:55:15 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd96eb3f-26f2-4491-9237-b93a4fec396e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4ee38de6-1fa4-460d-9bb4-49720104365b] added\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:55:15 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-af90c77b-f3a5-4fab-87d3-1fb6474c1bbe tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4ee38de6-1fa4-460d-9bb4-49720104365b] added
Nov 13 18:55:15 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:55:15 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ee38de6-1fa4-460d-9bb4-49720104365b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:55:15 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ee38de6-1fa4-460d-9bb4-49720104365b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:55:15 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[268aaaef-f957-482a-9f15-6ad075025782]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:55:15 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-af90c77b-f3a5-4fab-87d3-1fb6474c1bbe tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:55:15 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ee38de6-1fa4-460d-9bb4-49720104365b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:55:15 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ee38de6-1fa4-460d-9bb4-49720104365b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:55:15 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[784e219c-1700-4cf3-985e-4f66a8815777]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:55:15 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-af90c77b-f3a5-4fab-87d3-1fb6474c1bbe tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:55:15 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ee38de6-1fa4-460d-9bb4-49720104365b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v beykmGQP {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:55:15 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ee38de6-1fa4-460d-9bb4-49720104365b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v beykmGQP" returned: 0 in 0.020s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:55:15 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[55e2e730-c20c-47fc-b696-e75326ae4d57]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:55:15 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-af90c77b-f3a5-4fab-87d3-1fb6474c1bbe tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'beykmGQP'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:55:15 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ee38de6-1fa4-460d-9bb4-49720104365b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:55:15 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ee38de6-1fa4-460d-9bb4-49720104365b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:55:15 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[d032f29f-d5c3-4c10-80c0-b4236645f47d]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:55:15 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-af90c77b-f3a5-4fab-87d3-1fb6474c1bbe tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:55:15 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:55:15 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:55:15 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[325828eb-eda1-419b-b146-20de559512a2]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d (non-flash)\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:55:15 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-af90c77b-f3a5-4fab-87d3-1fb6474c1bbe tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d (non-flash)
Nov 13 18:55:15 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 18:55:15 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-af90c77b-f3a5-4fab-87d3-1fb6474c1bbe tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d (non-flash)
Nov 13 18:55:15 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 18:55:15 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ee38de6-1fa4-460d-9bb4-49720104365b -p 172.16.0.220:3260 --login {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:55:15 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ee38de6-1fa4-460d-9bb4-49720104365b -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:55:15 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbc58449-a5e6-4387-a8e0-33904ab31f0e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4ee38de6-1fa4-460d-9bb4-49720104365b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4ee38de6-1fa4-460d-9bb4-49720104365b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:55:15 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-af90c77b-f3a5-4fab-87d3-1fb6474c1bbe tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4ee38de6-1fa4-460d-9bb4-49720104365b, portal: 172.16.0.220,3260]
Nov 13 18:55:15 user nova-compute[75216]: Login to [iface: default, target: iqn.2010-10.org.openstack:4ee38de6-1fa4-460d-9bb4-49720104365b, portal: 172.16.0.220,3260] successful.
Nov 13 18:55:15 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:55:15 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ee38de6-1fa4-460d-9bb4-49720104365b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:55:15 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ee38de6-1fa4-460d-9bb4-49720104365b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:55:15 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[58dd1e67-509c-4479-9d40-249f8403f4fe]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:55:15 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-af90c77b-f3a5-4fab-87d3-1fb6474c1bbe tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:55:15 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:55:15 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:55:15 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[396580bf-61bb-484b-a613-6549dd480030]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ee38de6-1fa4-460d-9bb4-49720104365b (non-flash)\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:55:15 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-af90c77b-f3a5-4fab-87d3-1fb6474c1bbe tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d (non-flash)
Nov 13 18:55:15 user nova-compute[75216]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ee38de6-1fa4-460d-9bb4-49720104365b (non-flash)
Nov 13 18:55:15 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 18:55:15 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-af90c77b-f3a5-4fab-87d3-1fb6474c1bbe tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d (non-flash)
Nov 13 18:55:15 user nova-compute[75216]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ee38de6-1fa4-460d-9bb4-49720104365b (non-flash)
Nov 13 18:55:15 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 18:55:15 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-af90c77b-f3a5-4fab-87d3-1fb6474c1bbe tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4ee38de6-1fa4-460d-9bb4-49720104365b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.282s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 18:55:15 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-af90c77b-f3a5-4fab-87d3-1fb6474c1bbe tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Connected to 172.16.0.220:3260 {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 18:55:15 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-af90c77b-f3a5-4fab-87d3-1fb6474c1bbe tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] HCTL ('34', '-', '-', 0) found on session 29 with lun 0 {{(pid=75216) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 18:55:15 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-af90c77b-f3a5-4fab-87d3-1fb6474c1bbe tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75216) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 18:55:15 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:55:15 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:55:15 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c76fa43-b9ad-473e-8192-3f43eb7ab705]: (4, ('- - 0', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:55:15 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-af90c77b-f3a5-4fab-87d3-1fb6474c1bbe tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Searching for a device in session 29 and hctl ['34', '*', '*', 0] yield: None {{(pid=75216) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 18:55:16 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-af90c77b-f3a5-4fab-87d3-1fb6474c1bbe tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Searching for a device in session 29 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75216) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 18:55:16 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-af90c77b-f3a5-4fab-87d3-1fb6474c1bbe tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:4ee38de6-1fa4-460d-9bb4-49720104365b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'beykmGQP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 18:55:16 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-af90c77b-f3a5-4fab-87d3-1fb6474c1bbe tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.316s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 18:55:16 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-af90c77b-f3a5-4fab-87d3-1fb6474c1bbe tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] <== connect_volume: return (1318ms) {'type': 'block', 'scsi_wwn': '23938393137666132', 'path': '/dev/sdc'} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 18:55:16 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af90c77b-f3a5-4fab-87d3-1fb6474c1bbe tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] [instance: d9a1edfb-c2ac-4e67-abac-c915ea22a15c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23938393137666132', 'path': '/dev/sdc'} {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 18:55:16 user nova-compute[75216]: DEBUG nova.objects.instance [None req-af90c77b-f3a5-4fab-87d3-1fb6474c1bbe tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Lazy-loading 'flavor' on Instance uuid d9a1edfb-c2ac-4e67-abac-c915ea22a15c {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 18:55:16 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-af90c77b-f3a5-4fab-87d3-1fb6474c1bbe tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] attach device xml: <disk type="block" device="disk">
Nov 13 18:55:16 user nova-compute[75216]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 18:55:16 user nova-compute[75216]:   <source dev="/dev/sdc"/>
Nov 13 18:55:16 user nova-compute[75216]:   <target dev="vdb" bus="virtio"/>
Nov 13 18:55:16 user nova-compute[75216]:   <serial>4ee38de6-1fa4-460d-9bb4-49720104365b</serial>
Nov 13 18:55:16 user nova-compute[75216]: </disk>
Nov 13 18:55:16 user nova-compute[75216]:  {{(pid=75216) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 13 18:55:17 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-af90c77b-f3a5-4fab-87d3-1fb6474c1bbe tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 18:55:17 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-af90c77b-f3a5-4fab-87d3-1fb6474c1bbe tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 18:55:17 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-af90c77b-f3a5-4fab-87d3-1fb6474c1bbe tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] No VIF found with MAC fa:16:3e:8d:84:60, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 18:55:17 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-af90c77b-f3a5-4fab-87d3-1fb6474c1bbe tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Lock "d9a1edfb-c2ac-4e67-abac-c915ea22a15c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 5.995s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:55:18 user nova-compute[75216]: INFO nova.compute.manager [None req-516e6183-b369-4c6d-a22d-da00da364eec tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] [instance: d9a1edfb-c2ac-4e67-abac-c915ea22a15c] Rescuing
Nov 13 18:55:18 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-516e6183-b369-4c6d-a22d-da00da364eec tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Acquiring lock "refresh_cache-d9a1edfb-c2ac-4e67-abac-c915ea22a15c" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 18:55:18 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-516e6183-b369-4c6d-a22d-da00da364eec tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Acquired lock "refresh_cache-d9a1edfb-c2ac-4e67-abac-c915ea22a15c" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 18:55:18 user nova-compute[75216]: DEBUG nova.network.neutron [None req-516e6183-b369-4c6d-a22d-da00da364eec tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] [instance: d9a1edfb-c2ac-4e67-abac-c915ea22a15c] Building network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 18:55:18 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:55:18 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:55:18 user nova-compute[75216]: DEBUG nova.network.neutron [None req-516e6183-b369-4c6d-a22d-da00da364eec tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] [instance: d9a1edfb-c2ac-4e67-abac-c915ea22a15c] Updating instance_info_cache with network_info: [{"id": "eb2895a9-124a-4504-b197-bb2022f3f55f", "address": "fa:16:3e:8d:84:60", "network": {"id": "6d182db1-03b5-4d1b-86cf-b9367921b7b0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1877006951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2efafc26c47c4050bd367c47469999fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb2895a9-12", "ovs_interfaceid": "eb2895a9-124a-4504-b197-bb2022f3f55f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 18:55:18 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-516e6183-b369-4c6d-a22d-da00da364eec tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Releasing lock "refresh_cache-d9a1edfb-c2ac-4e67-abac-c915ea22a15c" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 18:55:18 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:55:18 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:55:18 user nova-compute[75216]: DEBUG nova.compute.manager [req-12117a00-2882-4ee8-b34a-1a3d87ebc32a req-e10bc5e0-e522-40f1-9deb-0cc859a79d01 service nova] [instance: d9a1edfb-c2ac-4e67-abac-c915ea22a15c] Received event network-vif-unplugged-eb2895a9-124a-4504-b197-bb2022f3f55f {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:55:18 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-12117a00-2882-4ee8-b34a-1a3d87ebc32a req-e10bc5e0-e522-40f1-9deb-0cc859a79d01 service nova] Acquiring lock "d9a1edfb-c2ac-4e67-abac-c915ea22a15c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:55:18 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-12117a00-2882-4ee8-b34a-1a3d87ebc32a req-e10bc5e0-e522-40f1-9deb-0cc859a79d01 service nova] Lock "d9a1edfb-c2ac-4e67-abac-c915ea22a15c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:55:18 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-12117a00-2882-4ee8-b34a-1a3d87ebc32a req-e10bc5e0-e522-40f1-9deb-0cc859a79d01 service nova] Lock "d9a1edfb-c2ac-4e67-abac-c915ea22a15c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:55:18 user nova-compute[75216]: DEBUG nova.compute.manager [req-12117a00-2882-4ee8-b34a-1a3d87ebc32a req-e10bc5e0-e522-40f1-9deb-0cc859a79d01 service nova] [instance: d9a1edfb-c2ac-4e67-abac-c915ea22a15c] No waiting events found dispatching network-vif-unplugged-eb2895a9-124a-4504-b197-bb2022f3f55f {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:55:18 user nova-compute[75216]: WARNING nova.compute.manager [req-12117a00-2882-4ee8-b34a-1a3d87ebc32a req-e10bc5e0-e522-40f1-9deb-0cc859a79d01 service nova] [instance: d9a1edfb-c2ac-4e67-abac-c915ea22a15c] Received unexpected event network-vif-unplugged-eb2895a9-124a-4504-b197-bb2022f3f55f for instance with vm_state active and task_state rescuing.
Nov 13 18:55:18 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:55:18 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:55:19 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: d9a1edfb-c2ac-4e67-abac-c915ea22a15c] Instance destroyed successfully.
Nov 13 18:55:19 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-516e6183-b369-4c6d-a22d-da00da364eec tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] [instance: d9a1edfb-c2ac-4e67-abac-c915ea22a15c] Attempting rescue
Nov 13 18:55:19 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-516e6183-b369-4c6d-a22d-da00da364eec tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75216) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 13 18:55:19 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-516e6183-b369-4c6d-a22d-da00da364eec tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] [instance: d9a1edfb-c2ac-4e67-abac-c915ea22a15c] Instance directory exists: not creating {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 13 18:55:19 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-516e6183-b369-4c6d-a22d-da00da364eec tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] [instance: d9a1edfb-c2ac-4e67-abac-c915ea22a15c] Creating image(s)
Nov 13 18:55:19 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-516e6183-b369-4c6d-a22d-da00da364eec tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Acquiring lock "/opt/stack/data/nova/instances/d9a1edfb-c2ac-4e67-abac-c915ea22a15c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:55:19 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-516e6183-b369-4c6d-a22d-da00da364eec tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Lock "/opt/stack/data/nova/instances/d9a1edfb-c2ac-4e67-abac-c915ea22a15c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:55:19 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-516e6183-b369-4c6d-a22d-da00da364eec tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Lock "/opt/stack/data/nova/instances/d9a1edfb-c2ac-4e67-abac-c915ea22a15c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:55:19 user nova-compute[75216]: DEBUG nova.objects.instance [None req-516e6183-b369-4c6d-a22d-da00da364eec tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Lazy-loading 'trusted_certs' on Instance uuid d9a1edfb-c2ac-4e67-abac-c915ea22a15c {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 18:55:19 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-516e6183-b369-4c6d-a22d-da00da364eec tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Acquiring lock "88c50a45bec9d6b0427462b3242b9b8e5f49c2b6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:55:19 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-516e6183-b369-4c6d-a22d-da00da364eec tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Lock "88c50a45bec9d6b0427462b3242b9b8e5f49c2b6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:55:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-516e6183-b369-4c6d-a22d-da00da364eec tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:55:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-516e6183-b369-4c6d-a22d-da00da364eec tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json" returned: 0 in 0.179s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:55:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-516e6183-b369-4c6d-a22d-da00da364eec tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6,backing_fmt=raw /opt/stack/data/nova/instances/d9a1edfb-c2ac-4e67-abac-c915ea22a15c/disk.rescue {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:55:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-516e6183-b369-4c6d-a22d-da00da364eec tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6,backing_fmt=raw /opt/stack/data/nova/instances/d9a1edfb-c2ac-4e67-abac-c915ea22a15c/disk.rescue" returned: 0 in 0.049s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:55:19 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-516e6183-b369-4c6d-a22d-da00da364eec tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Lock "88c50a45bec9d6b0427462b3242b9b8e5f49c2b6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.235s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:55:19 user nova-compute[75216]: DEBUG nova.objects.instance [None req-516e6183-b369-4c6d-a22d-da00da364eec tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Lazy-loading 'migration_context' on Instance uuid d9a1edfb-c2ac-4e67-abac-c915ea22a15c {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 18:55:19 user nova-compute[75216]: DEBUG nova.objects.base [None req-516e6183-b369-4c6d-a22d-da00da364eec tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Object Instance<d9a1edfb-c2ac-4e67-abac-c915ea22a15c> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75216) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 18:55:19 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-516e6183-b369-4c6d-a22d-da00da364eec tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] [instance: d9a1edfb-c2ac-4e67-abac-c915ea22a15c] Created local disks {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 18:55:19 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-516e6183-b369-4c6d-a22d-da00da364eec tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] [instance: d9a1edfb-c2ac-4e67-abac-c915ea22a15c] Start _get_guest_xml network_info=[{"id": "eb2895a9-124a-4504-b197-bb2022f3f55f", "address": "fa:16:3e:8d:84:60", "network": {"id": "6d182db1-03b5-4d1b-86cf-b9367921b7b0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1877006951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1877006951-network", "vif_mac": "fa:16:3e:8d:84:60"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2efafc26c47c4050bd367c47469999fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb2895a9-12", "ovs_interfaceid": "eb2895a9-124a-4504-b197-bb2022f3f55f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T18:41:06Z,direct_url=<?>,disk_format='qcow2',id=77bcb5ba-8510-41ec-a88d-96097bb431de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c465b7c26ec44582b6d1b7169536ecc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T18:41:07Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '77bcb5ba-8510-41ec-a88d-96097bb431de', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 18:55:19 user nova-compute[75216]: DEBUG nova.objects.instance [None req-516e6183-b369-4c6d-a22d-da00da364eec tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Lazy-loading 'resources' on Instance uuid d9a1edfb-c2ac-4e67-abac-c915ea22a15c {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 18:55:19 user nova-compute[75216]: DEBUG nova.objects.base [None req-516e6183-b369-4c6d-a22d-da00da364eec tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Object Instance<d9a1edfb-c2ac-4e67-abac-c915ea22a15c> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75216) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 18:55:19 user nova-compute[75216]: DEBUG nova.objects.instance [None req-516e6183-b369-4c6d-a22d-da00da364eec tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Lazy-loading 'numa_topology' on Instance uuid d9a1edfb-c2ac-4e67-abac-c915ea22a15c {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 18:55:19 user nova-compute[75216]: DEBUG nova.objects.base [None req-516e6183-b369-4c6d-a22d-da00da364eec tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Object Instance<d9a1edfb-c2ac-4e67-abac-c915ea22a15c> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75216) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 18:55:19 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-516e6183-b369-4c6d-a22d-da00da364eec tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 18:55:19 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-516e6183-b369-4c6d-a22d-da00da364eec tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 18:55:19 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-516e6183-b369-4c6d-a22d-da00da364eec tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 18:55:19 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-516e6183-b369-4c6d-a22d-da00da364eec tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] CPU controller missing on host. {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 18:55:19 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-516e6183-b369-4c6d-a22d-da00da364eec tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 18:55:19 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-516e6183-b369-4c6d-a22d-da00da364eec tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] CPU controller found on host. {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 18:55:19 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-516e6183-b369-4c6d-a22d-da00da364eec tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75216) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 18:55:19 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-516e6183-b369-4c6d-a22d-da00da364eec tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T18:40:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T18:41:06Z,direct_url=<?>,disk_format='qcow2',id=77bcb5ba-8510-41ec-a88d-96097bb431de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c465b7c26ec44582b6d1b7169536ecc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T18:41:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 18:55:19 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-516e6183-b369-4c6d-a22d-da00da364eec tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Flavor limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 18:55:19 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-516e6183-b369-4c6d-a22d-da00da364eec tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Image limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 18:55:19 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-516e6183-b369-4c6d-a22d-da00da364eec tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Flavor pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 18:55:19 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-516e6183-b369-4c6d-a22d-da00da364eec tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Image pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 18:55:19 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-516e6183-b369-4c6d-a22d-da00da364eec tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 18:55:19 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-516e6183-b369-4c6d-a22d-da00da364eec tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 18:55:19 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-516e6183-b369-4c6d-a22d-da00da364eec tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 18:55:19 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-516e6183-b369-4c6d-a22d-da00da364eec tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Got 1 possible topologies {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 18:55:19 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-516e6183-b369-4c6d-a22d-da00da364eec tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 18:55:19 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-516e6183-b369-4c6d-a22d-da00da364eec tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 18:55:19 user nova-compute[75216]: DEBUG nova.objects.instance [None req-516e6183-b369-4c6d-a22d-da00da364eec tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Lazy-loading 'vcpu_model' on Instance uuid d9a1edfb-c2ac-4e67-abac-c915ea22a15c {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 18:55:19 user nova-compute[75216]: DEBUG nova.objects.base [None req-516e6183-b369-4c6d-a22d-da00da364eec tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Object Instance<d9a1edfb-c2ac-4e67-abac-c915ea22a15c> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75216) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 18:55:19 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-516e6183-b369-4c6d-a22d-da00da364eec tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T18:53:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-592596084',display_name='tempest-ServerRescueNegativeTestJSON-server-592596084',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-592596084',id=21,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK+2PkxKKa7trQ91oahynfsb+ED4eBrX/gngy0uUVn/I9HNQHRE/MYLJgkcv2KjmmoqwoAll/FQqq9eo5uxBEri6NDF/QBB2CwxMJWgUT8869feJBRIceiVszXyooPeT3Q==',key_name='tempest-keypair-1092347516',keypairs=<?>,launch_index=0,launched_at=2023-11-13T18:53:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2efafc26c47c4050bd367c47469999fb',ramdisk_id='',reservation_id='r-5rr602jn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-165310019',owner_user_name='tempest-ServerRescueNegativeTestJSON-165310019-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T18:53:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3587565f5b56450e95f2bd572d7e4f88',uuid=d9a1edfb-c2ac-4e67-abac-c915ea22a15c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eb2895a9-124a-4504-b197-bb2022f3f55f", "address": "fa:16:3e:8d:84:60", "network": {"id": "6d182db1-03b5-4d1b-86cf-b9367921b7b0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1877006951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1877006951-network", "vif_mac": "fa:16:3e:8d:84:60"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2efafc26c47c4050bd367c47469999fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb2895a9-12", "ovs_interfaceid": "eb2895a9-124a-4504-b197-bb2022f3f55f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75216) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 18:55:19 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-516e6183-b369-4c6d-a22d-da00da364eec tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Converting VIF {"id": "eb2895a9-124a-4504-b197-bb2022f3f55f", "address": "fa:16:3e:8d:84:60", "network": {"id": "6d182db1-03b5-4d1b-86cf-b9367921b7b0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1877006951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1877006951-network", "vif_mac": "fa:16:3e:8d:84:60"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2efafc26c47c4050bd367c47469999fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb2895a9-12", "ovs_interfaceid": "eb2895a9-124a-4504-b197-bb2022f3f55f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 18:55:19 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-516e6183-b369-4c6d-a22d-da00da364eec tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8d:84:60,bridge_name='br-int',has_traffic_filtering=True,id=eb2895a9-124a-4504-b197-bb2022f3f55f,network=Network(6d182db1-03b5-4d1b-86cf-b9367921b7b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb2895a9-12') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 18:55:19 user nova-compute[75216]: DEBUG nova.objects.instance [None req-516e6183-b369-4c6d-a22d-da00da364eec tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Lazy-loading 'pci_devices' on Instance uuid d9a1edfb-c2ac-4e67-abac-c915ea22a15c {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 18:55:19 user nova-compute[75216]: DEBUG nova.objects.base [None req-516e6183-b369-4c6d-a22d-da00da364eec tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Object Instance<d9a1edfb-c2ac-4e67-abac-c915ea22a15c> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75216) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 18:55:19 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-516e6183-b369-4c6d-a22d-da00da364eec tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] [instance: d9a1edfb-c2ac-4e67-abac-c915ea22a15c] End _get_guest_xml xml=<domain type="kvm">
Nov 13 18:55:19 user nova-compute[75216]:   <uuid>d9a1edfb-c2ac-4e67-abac-c915ea22a15c</uuid>
Nov 13 18:55:19 user nova-compute[75216]:   <name>instance-00000015</name>
Nov 13 18:55:19 user nova-compute[75216]:   <memory>524288</memory>
Nov 13 18:55:19 user nova-compute[75216]:   <vcpu>1</vcpu>
Nov 13 18:55:19 user nova-compute[75216]:   <metadata>
Nov 13 18:55:19 user nova-compute[75216]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 18:55:19 user nova-compute[75216]:       <nova:package version="0.0.0"/>
Nov 13 18:55:19 user nova-compute[75216]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-592596084</nova:name>
Nov 13 18:55:19 user nova-compute[75216]:       <nova:creationTime>2023-11-13 18:55:19</nova:creationTime>
Nov 13 18:55:19 user nova-compute[75216]:       <nova:flavor name="m1.tiny">
Nov 13 18:55:19 user nova-compute[75216]:         <nova:memory>512</nova:memory>
Nov 13 18:55:19 user nova-compute[75216]:         <nova:disk>1</nova:disk>
Nov 13 18:55:19 user nova-compute[75216]:         <nova:swap>0</nova:swap>
Nov 13 18:55:19 user nova-compute[75216]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 18:55:19 user nova-compute[75216]:         <nova:vcpus>1</nova:vcpus>
Nov 13 18:55:19 user nova-compute[75216]:       </nova:flavor>
Nov 13 18:55:19 user nova-compute[75216]:       <nova:owner>
Nov 13 18:55:19 user nova-compute[75216]:         <nova:user uuid="3587565f5b56450e95f2bd572d7e4f88">tempest-ServerRescueNegativeTestJSON-165310019-project-member</nova:user>
Nov 13 18:55:19 user nova-compute[75216]:         <nova:project uuid="2efafc26c47c4050bd367c47469999fb">tempest-ServerRescueNegativeTestJSON-165310019</nova:project>
Nov 13 18:55:19 user nova-compute[75216]:       </nova:owner>
Nov 13 18:55:19 user nova-compute[75216]:       <nova:root type="image" uuid="77bcb5ba-8510-41ec-a88d-96097bb431de"/>
Nov 13 18:55:19 user nova-compute[75216]:       <nova:ports>
Nov 13 18:55:19 user nova-compute[75216]:         <nova:port uuid="eb2895a9-124a-4504-b197-bb2022f3f55f">
Nov 13 18:55:19 user nova-compute[75216]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 13 18:55:19 user nova-compute[75216]:         </nova:port>
Nov 13 18:55:19 user nova-compute[75216]:       </nova:ports>
Nov 13 18:55:19 user nova-compute[75216]:     </nova:instance>
Nov 13 18:55:19 user nova-compute[75216]:   </metadata>
Nov 13 18:55:19 user nova-compute[75216]:   <sysinfo type="smbios">
Nov 13 18:55:19 user nova-compute[75216]:     <system>
Nov 13 18:55:19 user nova-compute[75216]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 18:55:19 user nova-compute[75216]:       <entry name="product">OpenStack Nova</entry>
Nov 13 18:55:19 user nova-compute[75216]:       <entry name="version">0.0.0</entry>
Nov 13 18:55:19 user nova-compute[75216]:       <entry name="serial">d9a1edfb-c2ac-4e67-abac-c915ea22a15c</entry>
Nov 13 18:55:19 user nova-compute[75216]:       <entry name="uuid">d9a1edfb-c2ac-4e67-abac-c915ea22a15c</entry>
Nov 13 18:55:19 user nova-compute[75216]:       <entry name="family">Virtual Machine</entry>
Nov 13 18:55:19 user nova-compute[75216]:     </system>
Nov 13 18:55:19 user nova-compute[75216]:   </sysinfo>
Nov 13 18:55:19 user nova-compute[75216]:   <os>
Nov 13 18:55:19 user nova-compute[75216]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 18:55:19 user nova-compute[75216]:     <smbios mode="sysinfo"/>
Nov 13 18:55:19 user nova-compute[75216]:   </os>
Nov 13 18:55:19 user nova-compute[75216]:   <features>
Nov 13 18:55:19 user nova-compute[75216]:     <acpi/>
Nov 13 18:55:19 user nova-compute[75216]:     <apic/>
Nov 13 18:55:19 user nova-compute[75216]:     <vmcoreinfo/>
Nov 13 18:55:19 user nova-compute[75216]:   </features>
Nov 13 18:55:19 user nova-compute[75216]:   <clock offset="utc">
Nov 13 18:55:19 user nova-compute[75216]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 18:55:19 user nova-compute[75216]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 18:55:19 user nova-compute[75216]:     <timer name="hpet" present="no"/>
Nov 13 18:55:19 user nova-compute[75216]:   </clock>
Nov 13 18:55:19 user nova-compute[75216]:   <cpu mode="custom" match="exact">
Nov 13 18:55:19 user nova-compute[75216]:     <model>Nehalem</model>
Nov 13 18:55:19 user nova-compute[75216]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 18:55:19 user nova-compute[75216]:   </cpu>
Nov 13 18:55:19 user nova-compute[75216]:   <devices>
Nov 13 18:55:19 user nova-compute[75216]:     <disk type="file" device="disk">
Nov 13 18:55:19 user nova-compute[75216]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 18:55:19 user nova-compute[75216]:       <source file="/opt/stack/data/nova/instances/d9a1edfb-c2ac-4e67-abac-c915ea22a15c/disk.rescue"/>
Nov 13 18:55:19 user nova-compute[75216]:       <target dev="vda" bus="virtio"/>
Nov 13 18:55:19 user nova-compute[75216]:     </disk>
Nov 13 18:55:19 user nova-compute[75216]:     <disk type="file" device="disk">
Nov 13 18:55:19 user nova-compute[75216]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 18:55:19 user nova-compute[75216]:       <source file="/opt/stack/data/nova/instances/d9a1edfb-c2ac-4e67-abac-c915ea22a15c/disk"/>
Nov 13 18:55:19 user nova-compute[75216]:       <target dev="vdb" bus="virtio"/>
Nov 13 18:55:19 user nova-compute[75216]:     </disk>
Nov 13 18:55:19 user nova-compute[75216]:     <interface type="ethernet">
Nov 13 18:55:19 user nova-compute[75216]:       <mac address="fa:16:3e:8d:84:60"/>
Nov 13 18:55:19 user nova-compute[75216]:       <model type="virtio"/>
Nov 13 18:55:19 user nova-compute[75216]:       <mtu size="1442"/>
Nov 13 18:55:19 user nova-compute[75216]:       <target dev="tapeb2895a9-12"/>
Nov 13 18:55:19 user nova-compute[75216]:     </interface>
Nov 13 18:55:19 user nova-compute[75216]:     <serial type="pty">
Nov 13 18:55:19 user nova-compute[75216]:       <log file="/opt/stack/data/nova/instances/d9a1edfb-c2ac-4e67-abac-c915ea22a15c/console.log" append="off"/>
Nov 13 18:55:19 user nova-compute[75216]:     </serial>
Nov 13 18:55:19 user nova-compute[75216]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 18:55:19 user nova-compute[75216]:     <video>
Nov 13 18:55:19 user nova-compute[75216]:       <model type="virtio"/>
Nov 13 18:55:19 user nova-compute[75216]:     </video>
Nov 13 18:55:19 user nova-compute[75216]:     <rng model="virtio">
Nov 13 18:55:19 user nova-compute[75216]:       <backend model="random">/dev/urandom</backend>
Nov 13 18:55:19 user nova-compute[75216]:     </rng>
Nov 13 18:55:19 user nova-compute[75216]:     <controller type="usb" index="0" model="none"/>
Nov 13 18:55:19 user nova-compute[75216]:     <memballoon model="virtio">
Nov 13 18:55:19 user nova-compute[75216]:       <stats period="10"/>
Nov 13 18:55:19 user nova-compute[75216]:     </memballoon>
Nov 13 18:55:19 user nova-compute[75216]:   </devices>
Nov 13 18:55:19 user nova-compute[75216]: </domain>
Nov 13 18:55:19 user nova-compute[75216]:  {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 18:55:19 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: d9a1edfb-c2ac-4e67-abac-c915ea22a15c] Instance destroyed successfully.
Nov 13 18:55:19 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-516e6183-b369-4c6d-a22d-da00da364eec tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 18:55:19 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-516e6183-b369-4c6d-a22d-da00da364eec tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 18:55:19 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-516e6183-b369-4c6d-a22d-da00da364eec tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] No VIF found with MAC fa:16:3e:8d:84:60, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 18:55:20 user nova-compute[75216]: DEBUG nova.compute.manager [req-52c1361a-5bf4-428b-b6d0-ec826f0a2ee2 req-2187c94c-88ef-40d0-a323-80461b34b1b4 service nova] [instance: d9a1edfb-c2ac-4e67-abac-c915ea22a15c] Received event network-vif-plugged-eb2895a9-124a-4504-b197-bb2022f3f55f {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:55:20 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-52c1361a-5bf4-428b-b6d0-ec826f0a2ee2 req-2187c94c-88ef-40d0-a323-80461b34b1b4 service nova] Acquiring lock "d9a1edfb-c2ac-4e67-abac-c915ea22a15c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:55:20 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-52c1361a-5bf4-428b-b6d0-ec826f0a2ee2 req-2187c94c-88ef-40d0-a323-80461b34b1b4 service nova] Lock "d9a1edfb-c2ac-4e67-abac-c915ea22a15c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:55:20 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-52c1361a-5bf4-428b-b6d0-ec826f0a2ee2 req-2187c94c-88ef-40d0-a323-80461b34b1b4 service nova] Lock "d9a1edfb-c2ac-4e67-abac-c915ea22a15c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:55:20 user nova-compute[75216]: DEBUG nova.compute.manager [req-52c1361a-5bf4-428b-b6d0-ec826f0a2ee2 req-2187c94c-88ef-40d0-a323-80461b34b1b4 service nova] [instance: d9a1edfb-c2ac-4e67-abac-c915ea22a15c] No waiting events found dispatching network-vif-plugged-eb2895a9-124a-4504-b197-bb2022f3f55f {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:55:20 user nova-compute[75216]: WARNING nova.compute.manager [req-52c1361a-5bf4-428b-b6d0-ec826f0a2ee2 req-2187c94c-88ef-40d0-a323-80461b34b1b4 service nova] [instance: d9a1edfb-c2ac-4e67-abac-c915ea22a15c] Received unexpected event network-vif-plugged-eb2895a9-124a-4504-b197-bb2022f3f55f for instance with vm_state active and task_state rescuing.
Nov 13 18:55:21 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:55:21 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:55:21 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:55:21 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:55:21 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:55:21 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:55:21 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:55:22 user nova-compute[75216]: DEBUG nova.compute.manager [req-4762b460-d4e2-4ab8-a4da-1d7496317c81 req-d8ad9c37-d479-4d94-9500-0e2c81bff2e5 service nova] [instance: d9a1edfb-c2ac-4e67-abac-c915ea22a15c] Received event network-vif-plugged-eb2895a9-124a-4504-b197-bb2022f3f55f {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:55:22 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-4762b460-d4e2-4ab8-a4da-1d7496317c81 req-d8ad9c37-d479-4d94-9500-0e2c81bff2e5 service nova] Acquiring lock "d9a1edfb-c2ac-4e67-abac-c915ea22a15c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:55:22 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-4762b460-d4e2-4ab8-a4da-1d7496317c81 req-d8ad9c37-d479-4d94-9500-0e2c81bff2e5 service nova] Lock "d9a1edfb-c2ac-4e67-abac-c915ea22a15c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:55:22 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-4762b460-d4e2-4ab8-a4da-1d7496317c81 req-d8ad9c37-d479-4d94-9500-0e2c81bff2e5 service nova] Lock "d9a1edfb-c2ac-4e67-abac-c915ea22a15c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:55:22 user nova-compute[75216]: DEBUG nova.compute.manager [req-4762b460-d4e2-4ab8-a4da-1d7496317c81 req-d8ad9c37-d479-4d94-9500-0e2c81bff2e5 service nova] [instance: d9a1edfb-c2ac-4e67-abac-c915ea22a15c] No waiting events found dispatching network-vif-plugged-eb2895a9-124a-4504-b197-bb2022f3f55f {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:55:22 user nova-compute[75216]: WARNING nova.compute.manager [req-4762b460-d4e2-4ab8-a4da-1d7496317c81 req-d8ad9c37-d479-4d94-9500-0e2c81bff2e5 service nova] [instance: d9a1edfb-c2ac-4e67-abac-c915ea22a15c] Received unexpected event network-vif-plugged-eb2895a9-124a-4504-b197-bb2022f3f55f for instance with vm_state active and task_state rescuing.
Nov 13 18:55:22 user nova-compute[75216]: DEBUG nova.compute.manager [req-4762b460-d4e2-4ab8-a4da-1d7496317c81 req-d8ad9c37-d479-4d94-9500-0e2c81bff2e5 service nova] [instance: d9a1edfb-c2ac-4e67-abac-c915ea22a15c] Received event network-vif-plugged-eb2895a9-124a-4504-b197-bb2022f3f55f {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:55:22 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-4762b460-d4e2-4ab8-a4da-1d7496317c81 req-d8ad9c37-d479-4d94-9500-0e2c81bff2e5 service nova] Acquiring lock "d9a1edfb-c2ac-4e67-abac-c915ea22a15c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:55:22 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-4762b460-d4e2-4ab8-a4da-1d7496317c81 req-d8ad9c37-d479-4d94-9500-0e2c81bff2e5 service nova] Lock "d9a1edfb-c2ac-4e67-abac-c915ea22a15c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:55:22 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-4762b460-d4e2-4ab8-a4da-1d7496317c81 req-d8ad9c37-d479-4d94-9500-0e2c81bff2e5 service nova] Lock "d9a1edfb-c2ac-4e67-abac-c915ea22a15c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:55:22 user nova-compute[75216]: DEBUG nova.compute.manager [req-4762b460-d4e2-4ab8-a4da-1d7496317c81 req-d8ad9c37-d479-4d94-9500-0e2c81bff2e5 service nova] [instance: d9a1edfb-c2ac-4e67-abac-c915ea22a15c] No waiting events found dispatching network-vif-plugged-eb2895a9-124a-4504-b197-bb2022f3f55f {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:55:22 user nova-compute[75216]: WARNING nova.compute.manager [req-4762b460-d4e2-4ab8-a4da-1d7496317c81 req-d8ad9c37-d479-4d94-9500-0e2c81bff2e5 service nova] [instance: d9a1edfb-c2ac-4e67-abac-c915ea22a15c] Received unexpected event network-vif-plugged-eb2895a9-124a-4504-b197-bb2022f3f55f for instance with vm_state active and task_state rescuing.
Nov 13 18:55:23 user nova-compute[75216]: DEBUG nova.compute.manager [None req-516e6183-b369-4c6d-a22d-da00da364eec tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] [instance: d9a1edfb-c2ac-4e67-abac-c915ea22a15c] Checking state {{(pid=75216) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 18:55:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:55:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:55:27 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-7fd27229-42ed-457f-a18d-fd21c387d34d tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Acquiring lock "1e5f1164-a15e-40cf-b7bc-5aeb404a1216" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:55:27 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-7fd27229-42ed-457f-a18d-fd21c387d34d tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Lock "1e5f1164-a15e-40cf-b7bc-5aeb404a1216" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:55:27 user nova-compute[75216]: DEBUG nova.compute.manager [None req-7fd27229-42ed-457f-a18d-fd21c387d34d tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: 1e5f1164-a15e-40cf-b7bc-5aeb404a1216] Starting instance... {{(pid=75216) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 18:55:27 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-7fd27229-42ed-457f-a18d-fd21c387d34d tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:55:27 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-7fd27229-42ed-457f-a18d-fd21c387d34d tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:55:27 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-7fd27229-42ed-457f-a18d-fd21c387d34d tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75216) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 18:55:27 user nova-compute[75216]: INFO nova.compute.claims [None req-7fd27229-42ed-457f-a18d-fd21c387d34d tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: 1e5f1164-a15e-40cf-b7bc-5aeb404a1216] Claim successful on node user
Nov 13 18:55:28 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-7fd27229-42ed-457f-a18d-fd21c387d34d tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 18:55:28 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-7fd27229-42ed-457f-a18d-fd21c387d34d tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 18:55:28 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-7fd27229-42ed-457f-a18d-fd21c387d34d tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.434s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:55:28 user nova-compute[75216]: DEBUG nova.compute.manager [None req-7fd27229-42ed-457f-a18d-fd21c387d34d tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: 1e5f1164-a15e-40cf-b7bc-5aeb404a1216] Start building networks asynchronously for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 18:55:28 user nova-compute[75216]: DEBUG nova.compute.manager [None req-7fd27229-42ed-457f-a18d-fd21c387d34d tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: 1e5f1164-a15e-40cf-b7bc-5aeb404a1216] Allocating IP information in the background. {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 18:55:28 user nova-compute[75216]: DEBUG nova.network.neutron [None req-7fd27229-42ed-457f-a18d-fd21c387d34d tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: 1e5f1164-a15e-40cf-b7bc-5aeb404a1216] allocate_for_instance() {{(pid=75216) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 18:55:28 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-7fd27229-42ed-457f-a18d-fd21c387d34d tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: 1e5f1164-a15e-40cf-b7bc-5aeb404a1216] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 18:55:28 user nova-compute[75216]: DEBUG nova.compute.manager [None req-7fd27229-42ed-457f-a18d-fd21c387d34d tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: 1e5f1164-a15e-40cf-b7bc-5aeb404a1216] Start building block device mappings for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 18:55:28 user nova-compute[75216]: DEBUG nova.policy [None req-7fd27229-42ed-457f-a18d-fd21c387d34d tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b381ea98871846b1bfb29a202a058208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '903397a6c0474cfd8bd1a4fb338528aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75216) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 18:55:28 user nova-compute[75216]: INFO nova.virt.block_device [None req-7fd27229-42ed-457f-a18d-fd21c387d34d tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: 1e5f1164-a15e-40cf-b7bc-5aeb404a1216] Booting with blank volume at /dev/vda
Nov 13 18:55:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:55:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:55:28 user nova-compute[75216]: DEBUG nova.network.neutron [None req-7fd27229-42ed-457f-a18d-fd21c387d34d tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: 1e5f1164-a15e-40cf-b7bc-5aeb404a1216] Successfully created port: 96dfdc95-6a8e-43f3-8d7c-5b4f78a8f134 {{(pid=75216) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 18:55:29 user nova-compute[75216]: DEBUG nova.network.neutron [None req-7fd27229-42ed-457f-a18d-fd21c387d34d tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: 1e5f1164-a15e-40cf-b7bc-5aeb404a1216] Successfully updated port: 96dfdc95-6a8e-43f3-8d7c-5b4f78a8f134 {{(pid=75216) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 18:55:29 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-7fd27229-42ed-457f-a18d-fd21c387d34d tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Acquiring lock "refresh_cache-1e5f1164-a15e-40cf-b7bc-5aeb404a1216" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 18:55:29 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-7fd27229-42ed-457f-a18d-fd21c387d34d tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Acquired lock "refresh_cache-1e5f1164-a15e-40cf-b7bc-5aeb404a1216" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 18:55:29 user nova-compute[75216]: DEBUG nova.network.neutron [None req-7fd27229-42ed-457f-a18d-fd21c387d34d tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: 1e5f1164-a15e-40cf-b7bc-5aeb404a1216] Building network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 18:55:29 user nova-compute[75216]: DEBUG nova.compute.manager [req-d9174828-c0bc-4d47-9387-aeb1003983af req-39958096-1525-482a-a07f-8329a53a51cd service nova] [instance: 1e5f1164-a15e-40cf-b7bc-5aeb404a1216] Received event network-changed-96dfdc95-6a8e-43f3-8d7c-5b4f78a8f134 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:55:29 user nova-compute[75216]: DEBUG nova.compute.manager [req-d9174828-c0bc-4d47-9387-aeb1003983af req-39958096-1525-482a-a07f-8329a53a51cd service nova] [instance: 1e5f1164-a15e-40cf-b7bc-5aeb404a1216] Refreshing instance network info cache due to event network-changed-96dfdc95-6a8e-43f3-8d7c-5b4f78a8f134. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 18:55:29 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-d9174828-c0bc-4d47-9387-aeb1003983af req-39958096-1525-482a-a07f-8329a53a51cd service nova] Acquiring lock "refresh_cache-1e5f1164-a15e-40cf-b7bc-5aeb404a1216" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 18:55:29 user nova-compute[75216]: DEBUG nova.network.neutron [None req-7fd27229-42ed-457f-a18d-fd21c387d34d tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: 1e5f1164-a15e-40cf-b7bc-5aeb404a1216] Instance cache missing network info. {{(pid=75216) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 18:55:29 user nova-compute[75216]: DEBUG nova.network.neutron [None req-7fd27229-42ed-457f-a18d-fd21c387d34d tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: 1e5f1164-a15e-40cf-b7bc-5aeb404a1216] Updating instance_info_cache with network_info: [{"id": "96dfdc95-6a8e-43f3-8d7c-5b4f78a8f134", "address": "fa:16:3e:19:0b:3a", "network": {"id": "f8b821ef-8fae-42b9-9055-a9ea7be955ab", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-50594548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "903397a6c0474cfd8bd1a4fb338528aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96dfdc95-6a", "ovs_interfaceid": "96dfdc95-6a8e-43f3-8d7c-5b4f78a8f134", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 18:55:29 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-7fd27229-42ed-457f-a18d-fd21c387d34d tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Releasing lock "refresh_cache-1e5f1164-a15e-40cf-b7bc-5aeb404a1216" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 18:55:29 user nova-compute[75216]: DEBUG nova.compute.manager [None req-7fd27229-42ed-457f-a18d-fd21c387d34d tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: 1e5f1164-a15e-40cf-b7bc-5aeb404a1216] Instance network_info: |[{"id": "96dfdc95-6a8e-43f3-8d7c-5b4f78a8f134", "address": "fa:16:3e:19:0b:3a", "network": {"id": "f8b821ef-8fae-42b9-9055-a9ea7be955ab", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-50594548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "903397a6c0474cfd8bd1a4fb338528aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96dfdc95-6a", "ovs_interfaceid": "96dfdc95-6a8e-43f3-8d7c-5b4f78a8f134", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 18:55:29 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-d9174828-c0bc-4d47-9387-aeb1003983af req-39958096-1525-482a-a07f-8329a53a51cd service nova] Acquired lock "refresh_cache-1e5f1164-a15e-40cf-b7bc-5aeb404a1216" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 18:55:29 user nova-compute[75216]: DEBUG nova.network.neutron [req-d9174828-c0bc-4d47-9387-aeb1003983af req-39958096-1525-482a-a07f-8329a53a51cd service nova] [instance: 1e5f1164-a15e-40cf-b7bc-5aeb404a1216] Refreshing network info cache for port 96dfdc95-6a8e-43f3-8d7c-5b4f78a8f134 {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 18:55:30 user nova-compute[75216]: DEBUG nova.network.neutron [req-d9174828-c0bc-4d47-9387-aeb1003983af req-39958096-1525-482a-a07f-8329a53a51cd service nova] [instance: 1e5f1164-a15e-40cf-b7bc-5aeb404a1216] Updated VIF entry in instance network info cache for port 96dfdc95-6a8e-43f3-8d7c-5b4f78a8f134. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 18:55:30 user nova-compute[75216]: DEBUG nova.network.neutron [req-d9174828-c0bc-4d47-9387-aeb1003983af req-39958096-1525-482a-a07f-8329a53a51cd service nova] [instance: 1e5f1164-a15e-40cf-b7bc-5aeb404a1216] Updating instance_info_cache with network_info: [{"id": "96dfdc95-6a8e-43f3-8d7c-5b4f78a8f134", "address": "fa:16:3e:19:0b:3a", "network": {"id": "f8b821ef-8fae-42b9-9055-a9ea7be955ab", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-50594548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "903397a6c0474cfd8bd1a4fb338528aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96dfdc95-6a", "ovs_interfaceid": "96dfdc95-6a8e-43f3-8d7c-5b4f78a8f134", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 18:55:30 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-d9174828-c0bc-4d47-9387-aeb1003983af req-39958096-1525-482a-a07f-8329a53a51cd service nova] Releasing lock "refresh_cache-1e5f1164-a15e-40cf-b7bc-5aeb404a1216" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 18:55:31 user nova-compute[75216]: DEBUG nova.network.neutron [None req-5644284d-5f6c-4b74-b632-ab09f913e009 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] [instance: 91ea8a19-a365-484c-80c7-baf90e7dd1aa] Port 2cfb645f-7bee-4657-b0d8-afcaa0298ac9 binding to destination host user is already ACTIVE {{(pid=75216) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 13 18:55:31 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-5644284d-5f6c-4b74-b632-ab09f913e009 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Acquiring lock "refresh_cache-91ea8a19-a365-484c-80c7-baf90e7dd1aa" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 18:55:31 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-5644284d-5f6c-4b74-b632-ab09f913e009 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Acquired lock "refresh_cache-91ea8a19-a365-484c-80c7-baf90e7dd1aa" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 18:55:31 user nova-compute[75216]: DEBUG nova.network.neutron [None req-5644284d-5f6c-4b74-b632-ab09f913e009 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] [instance: 91ea8a19-a365-484c-80c7-baf90e7dd1aa] Building network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 18:55:31 user nova-compute[75216]: DEBUG nova.network.neutron [None req-5644284d-5f6c-4b74-b632-ab09f913e009 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] [instance: 91ea8a19-a365-484c-80c7-baf90e7dd1aa] Updating instance_info_cache with network_info: [{"id": "2cfb645f-7bee-4657-b0d8-afcaa0298ac9", "address": "fa:16:3e:3e:1d:91", "network": {"id": "a9670fc3-8a8e-4a2b-a39f-d41042d3443d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1394481632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0194e3c88e2b49c5ba9b9844f6048ea9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cfb645f-7b", "ovs_interfaceid": "2cfb645f-7bee-4657-b0d8-afcaa0298ac9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 18:55:32 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-5644284d-5f6c-4b74-b632-ab09f913e009 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Releasing lock "refresh_cache-91ea8a19-a365-484c-80c7-baf90e7dd1aa" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 18:55:32 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-5644284d-5f6c-4b74-b632-ab09f913e009 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] [instance: 91ea8a19-a365-484c-80c7-baf90e7dd1aa] Creating tmpfile /opt/stack/data/nova/instances/91ea8a19-a365-484c-80c7-baf90e7dd1aa/tmpov76ncf9 to verify with other compute node that the instance is on the same shared storage. {{(pid=75216) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9628}}
Nov 13 18:55:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:55:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:55:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:55:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:55:32 user nova-compute[75216]: DEBUG nova.compute.manager [req-03bc230a-b547-4512-a103-4f7fe1cd2c9f req-7588d1c2-87de-4623-af6d-1d9cddcda2a1 service nova] [instance: 91ea8a19-a365-484c-80c7-baf90e7dd1aa] Received event network-vif-unplugged-2cfb645f-7bee-4657-b0d8-afcaa0298ac9 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:55:32 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-03bc230a-b547-4512-a103-4f7fe1cd2c9f req-7588d1c2-87de-4623-af6d-1d9cddcda2a1 service nova] Acquiring lock "91ea8a19-a365-484c-80c7-baf90e7dd1aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:55:32 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-03bc230a-b547-4512-a103-4f7fe1cd2c9f req-7588d1c2-87de-4623-af6d-1d9cddcda2a1 service nova] Lock "91ea8a19-a365-484c-80c7-baf90e7dd1aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:55:32 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-03bc230a-b547-4512-a103-4f7fe1cd2c9f req-7588d1c2-87de-4623-af6d-1d9cddcda2a1 service nova] Lock "91ea8a19-a365-484c-80c7-baf90e7dd1aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:55:32 user nova-compute[75216]: DEBUG nova.compute.manager [req-03bc230a-b547-4512-a103-4f7fe1cd2c9f req-7588d1c2-87de-4623-af6d-1d9cddcda2a1 service nova] [instance: 91ea8a19-a365-484c-80c7-baf90e7dd1aa] No waiting events found dispatching network-vif-unplugged-2cfb645f-7bee-4657-b0d8-afcaa0298ac9 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:55:32 user nova-compute[75216]: WARNING nova.compute.manager [req-03bc230a-b547-4512-a103-4f7fe1cd2c9f req-7588d1c2-87de-4623-af6d-1d9cddcda2a1 service nova] [instance: 91ea8a19-a365-484c-80c7-baf90e7dd1aa] Received unexpected event network-vif-unplugged-2cfb645f-7bee-4657-b0d8-afcaa0298ac9 for instance with vm_state resized and task_state resize_reverting.
Nov 13 18:55:32 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 91ea8a19-a365-484c-80c7-baf90e7dd1aa] Instance destroyed successfully.
Nov 13 18:55:32 user nova-compute[75216]: DEBUG nova.objects.instance [None req-5644284d-5f6c-4b74-b632-ab09f913e009 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Lazy-loading 'resources' on Instance uuid 91ea8a19-a365-484c-80c7-baf90e7dd1aa {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 18:55:32 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-5644284d-5f6c-4b74-b632-ab09f913e009 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T18:49:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2138583247',display_name='tempest-ServerActionsTestOtherB-server-2138583247',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2138583247',id=18,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAl4rrs8AsTXVVWOe2ej9Q0PBsZfl4SiBx6Z+7YBp2Q8nhbMLqhEEYWYCrwvKHOa1CVoqmRod9jN0d8asOX7OMqzQqSN/edxVDFYygCGcMd2W6HT1YDz1w3rZ0s5A43lWg==',key_name='tempest-keypair-1520178236',keypairs=<?>,launch_index=0,launched_at=2023-11-13T18:54:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0194e3c88e2b49c5ba9b9844f6048ea9',ramdisk_id='',reservation_id='r-z6obctyl',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1164011898',owner_user_name='tempest-ServerActionsTestOtherB-1164011898-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T18:54:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0543920a35a54c83bcc159b7a2b08a80',uuid=91ea8a19-a365-484c-80c7-baf90e7dd1aa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "2cfb645f-7bee-4657-b0d8-afcaa0298ac9", "address": "fa:16:3e:3e:1d:91", "network": {"id": "a9670fc3-8a8e-4a2b-a39f-d41042d3443d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1394481632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0194e3c88e2b49c5ba9b9844f6048ea9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cfb645f-7b", "ovs_interfaceid": "2cfb645f-7bee-4657-b0d8-afcaa0298ac9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 18:55:32 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-5644284d-5f6c-4b74-b632-ab09f913e009 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Converting VIF {"id": "2cfb645f-7bee-4657-b0d8-afcaa0298ac9", "address": "fa:16:3e:3e:1d:91", "network": {"id": "a9670fc3-8a8e-4a2b-a39f-d41042d3443d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1394481632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0194e3c88e2b49c5ba9b9844f6048ea9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cfb645f-7b", "ovs_interfaceid": "2cfb645f-7bee-4657-b0d8-afcaa0298ac9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 18:55:32 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-5644284d-5f6c-4b74-b632-ab09f913e009 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3e:1d:91,bridge_name='br-int',has_traffic_filtering=True,id=2cfb645f-7bee-4657-b0d8-afcaa0298ac9,network=Network(a9670fc3-8a8e-4a2b-a39f-d41042d3443d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cfb645f-7b') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 18:55:32 user nova-compute[75216]: DEBUG os_vif [None req-5644284d-5f6c-4b74-b632-ab09f913e009 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3e:1d:91,bridge_name='br-int',has_traffic_filtering=True,id=2cfb645f-7bee-4657-b0d8-afcaa0298ac9,network=Network(a9670fc3-8a8e-4a2b-a39f-d41042d3443d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cfb645f-7b') {{(pid=75216) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 18:55:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:55:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2cfb645f-7b, bridge=br-int, if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:55:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:55:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:55:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:55:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6aca2b2b-1f45-47bb-ba6a-2c56221b7523) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:55:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:55:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:55:32 user nova-compute[75216]: INFO os_vif [None req-5644284d-5f6c-4b74-b632-ab09f913e009 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3e:1d:91,bridge_name='br-int',has_traffic_filtering=True,id=2cfb645f-7bee-4657-b0d8-afcaa0298ac9,network=Network(a9670fc3-8a8e-4a2b-a39f-d41042d3443d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cfb645f-7b')
Nov 13 18:55:32 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5644284d-5f6c-4b74-b632-ab09f913e009 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] [instance: 91ea8a19-a365-484c-80c7-baf90e7dd1aa] calling os-brick to detach iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 18:55:32 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-5644284d-5f6c-4b74-b632-ab09f913e009 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3a8669e40>, {'target_iqn': 'iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JvBCenjA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 18:55:32 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-5644284d-5f6c-4b74-b632-ab09f913e009 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 18:55:32 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-5644284d-5f6c-4b74-b632-ab09f913e009 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 18:55:32 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-5644284d-5f6c-4b74-b632-ab09f913e009 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 18:55:32 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:55:32 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:55:32 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdfac428-8dcd-48d6-8422-54dc43c43a18]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4ee38de6-1fa4-460d-9bb4-49720104365b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:55:32 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-5644284d-5f6c-4b74-b632-ab09f913e009 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 18:55:32 user nova-compute[75216]: No targets found.
Nov 13 18:55:32 user nova-compute[75216]: iSNS:
Nov 13 18:55:32 user nova-compute[75216]: No targets found.
Nov 13 18:55:32 user nova-compute[75216]: STATIC:
Nov 13 18:55:32 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d
Nov 13 18:55:32 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 18:55:32 user nova-compute[75216]:                 Iface Name: default
Nov 13 18:55:32 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:4ee38de6-1fa4-460d-9bb4-49720104365b
Nov 13 18:55:32 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 18:55:32 user nova-compute[75216]:                 Iface Name: default
Nov 13 18:55:32 user nova-compute[75216]: FIRMWARE:
Nov 13 18:55:32 user nova-compute[75216]: No targets found.
Nov 13 18:55:32 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 18:55:32 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-5644284d-5f6c-4b74-b632-ab09f913e009 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 18:55:32 user nova-compute[75216]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 18:55:32 user nova-compute[75216]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75216) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 18:55:32 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-5644284d-5f6c-4b74-b632-ab09f913e009 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d', 0)] {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 18:55:32 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:55:32 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:55:32 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba8bf020-a229-42ca-b792-e92e8addbad4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4ee38de6-1fa4-460d-9bb4-49720104365b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:55:32 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:55:32 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:55:32 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3bd0a80-6233-4c93-9454-e0b8c3e50261]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ee38de6-1fa4-460d-9bb4-49720104365b (non-flash)\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:55:32 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-5644284d-5f6c-4b74-b632-ab09f913e009 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d (non-flash)
Nov 13 18:55:32 user nova-compute[75216]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ee38de6-1fa4-460d-9bb4-49720104365b (non-flash)
Nov 13 18:55:32 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 18:55:32 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-5644284d-5f6c-4b74-b632-ab09f913e009 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d (non-flash)
Nov 13 18:55:32 user nova-compute[75216]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ee38de6-1fa4-460d-9bb4-49720104365b (non-flash)
Nov 13 18:55:32 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 18:55:32 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-5644284d-5f6c-4b74-b632-ab09f913e009 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe3a8153010>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d'): ({'sdb'}, set())}) {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 18:55:32 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-5644284d-5f6c-4b74-b632-ab09f913e009 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Removing single pathed devices sdb {{(pid=75216) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 18:55:32 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:55:32 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:55:32 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3d829d3-7a26-4dca-80cd-6479aef1dbc3]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:55:32 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:55:32 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.016s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:55:32 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[266140ef-e8c8-4757-aeb2-f61da12d7119]: (4, ('ok\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:55:32 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-5644284d-5f6c-4b74-b632-ab09f913e009 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Flushing IO for device /dev/sdb {{(pid=75216) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 18:55:32 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:55:32 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:55:32 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[409b5851-de7a-40a2-982a-dda5045af24f]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:55:32 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-5644284d-5f6c-4b74-b632-ab09f913e009 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75216) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 18:55:32 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:55:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.058s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:55:33 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbfff3eb-b71a-4433-ac3e-f3e4cdffa519]: (4, ('1', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:55:33 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-5644284d-5f6c-4b74-b632-ab09f913e009 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 18:55:33 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-5644284d-5f6c-4b74-b632-ab09f913e009 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] SCSI volumes sdb have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 18:55:33 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-5644284d-5f6c-4b74-b632-ab09f913e009 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d')] {{(pid=75216) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 18:55:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:55:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:55:33 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[72eec69b-345d-405b-acd0-7523e51685b0]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:55:33 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-5644284d-5f6c-4b74-b632-ab09f913e009 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:55:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d -p 172.16.0.220:3260 --logout {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:55:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d -p 172.16.0.220:3260 --logout" returned: 0 in 0.041s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:55:33 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[daa4019c-2480-4872-a239-2c29fb1a3516]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:55:33 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-5644284d-5f6c-4b74-b632-ab09f913e009 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d, portal: 172.16.0.220,3260]
Nov 13 18:55:33 user nova-compute[75216]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d, portal: 172.16.0.220,3260] successful.
Nov 13 18:55:33 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:55:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d -p 172.16.0.220:3260 --op delete {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:55:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:55:33 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[24cc6b9e-1602-480d-9f7e-ac5e188e34c6]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:55:33 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-5644284d-5f6c-4b74-b632-ab09f913e009 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:55:33 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-5644284d-5f6c-4b74-b632-ab09f913e009 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.271s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 18:55:33 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-5644284d-5f6c-4b74-b632-ab09f913e009 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] <== disconnect_volume: return (272ms) None {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 18:55:33 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5644284d-5f6c-4b74-b632-ab09f913e009 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] [instance: 91ea8a19-a365-484c-80c7-baf90e7dd1aa] Disconnected iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 18:55:33 user nova-compute[75216]: DEBUG os_brick.utils [None req-7fd27229-42ed-457f-a18d-fd21c387d34d tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 18:55:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:55:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:55:33 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[7891660e-755c-47c4-9a19-7c3de83bb3ea]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aea6fcfe14b9\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:55:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:55:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:55:33 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[58b651a5-0318-4cd4-a42a-5b06653f2d87]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:55:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:55:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:55:33 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[94f05b46-3b76-47bc-a36f-658fc7e986c8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:55:33 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[310be4ff-912a-4466-8083-2df0680604ea]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:55:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-7fd27229-42ed-457f-a18d-fd21c387d34d tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Running cmd (subprocess): nvme version {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:55:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-7fd27229-42ed-457f-a18d-fd21c387d34d tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] 'nvme version' failed. Not Retrying. {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 18:55:33 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7fd27229-42ed-457f-a18d-fd21c387d34d tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] nvme not present on system {{(pid=75216) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 18:55:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:55:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 18:55:33 user nova-compute[75216]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 18:55:33 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[1108180d-99eb-4007-9af5-0cb6e83190e3]: (4, '') {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:55:33 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-7fd27229-42ed-457f-a18d-fd21c387d34d tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75216) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 18:55:33 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-7fd27229-42ed-457f-a18d-fd21c387d34d tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 18:55:33 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-7fd27229-42ed-457f-a18d-fd21c387d34d tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] LIGHTOS: no hostnqn found. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 18:55:33 user nova-compute[75216]: DEBUG os_brick.utils [None req-7fd27229-42ed-457f-a18d-fd21c387d34d tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aea6fcfe14b9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 18:55:33 user nova-compute[75216]: DEBUG nova.virt.block_device [None req-7fd27229-42ed-457f-a18d-fd21c387d34d tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: 1e5f1164-a15e-40cf-b7bc-5aeb404a1216] Updating existing volume attachment record: f1079bcf-5407-4e87-beca-c3c05ab56334 {{(pid=75216) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 18:55:33 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-5644284d-5f6c-4b74-b632-ab09f913e009 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:55:33 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-5644284d-5f6c-4b74-b632-ab09f913e009 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:55:33 user nova-compute[75216]: DEBUG nova.objects.instance [None req-5644284d-5f6c-4b74-b632-ab09f913e009 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Lazy-loading 'migration_context' on Instance uuid 91ea8a19-a365-484c-80c7-baf90e7dd1aa {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 18:55:33 user nova-compute[75216]: DEBUG nova.objects.base [None req-5644284d-5f6c-4b74-b632-ab09f913e009 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Object Instance<91ea8a19-a365-484c-80c7-baf90e7dd1aa> lazy-loaded attributes: resources,migration_context {{(pid=75216) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 18:55:34 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-5644284d-5f6c-4b74-b632-ab09f913e009 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 18:55:34 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-5644284d-5f6c-4b74-b632-ab09f913e009 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 18:55:34 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-5644284d-5f6c-4b74-b632-ab09f913e009 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.425s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:55:34 user nova-compute[75216]: INFO nova.compute.manager [None req-5644284d-5f6c-4b74-b632-ab09f913e009 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] [instance: 91ea8a19-a365-484c-80c7-baf90e7dd1aa] Swapping old allocation on dict_keys(['d927e00d-5a8b-43f7-ac04-6437958fac1f']) held by migration 0ae048ac-88ae-4635-acf7-90c85c69f04d for instance
Nov 13 18:55:34 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-5644284d-5f6c-4b74-b632-ab09f913e009 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Overwriting current allocation {'allocations': {'d927e00d-5a8b-43f7-ac04-6437958fac1f': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 29}}, 'project_id': '0194e3c88e2b49c5ba9b9844f6048ea9', 'user_id': '0543920a35a54c83bcc159b7a2b08a80', 'consumer_generation': 1} on consumer 91ea8a19-a365-484c-80c7-baf90e7dd1aa {{(pid=75216) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Nov 13 18:55:34 user nova-compute[75216]: DEBUG nova.compute.manager [req-42fcf7db-3aec-4021-b720-d43fa5b16be8 req-c931620d-6eb1-401e-b9da-6c4ecb66cffe service nova] [instance: 91ea8a19-a365-484c-80c7-baf90e7dd1aa] Received event network-vif-plugged-2cfb645f-7bee-4657-b0d8-afcaa0298ac9 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:55:34 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-42fcf7db-3aec-4021-b720-d43fa5b16be8 req-c931620d-6eb1-401e-b9da-6c4ecb66cffe service nova] Acquiring lock "91ea8a19-a365-484c-80c7-baf90e7dd1aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:55:34 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-42fcf7db-3aec-4021-b720-d43fa5b16be8 req-c931620d-6eb1-401e-b9da-6c4ecb66cffe service nova] Lock "91ea8a19-a365-484c-80c7-baf90e7dd1aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:55:34 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-42fcf7db-3aec-4021-b720-d43fa5b16be8 req-c931620d-6eb1-401e-b9da-6c4ecb66cffe service nova] Lock "91ea8a19-a365-484c-80c7-baf90e7dd1aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:55:34 user nova-compute[75216]: DEBUG nova.compute.manager [req-42fcf7db-3aec-4021-b720-d43fa5b16be8 req-c931620d-6eb1-401e-b9da-6c4ecb66cffe service nova] [instance: 91ea8a19-a365-484c-80c7-baf90e7dd1aa] No waiting events found dispatching network-vif-plugged-2cfb645f-7bee-4657-b0d8-afcaa0298ac9 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:55:34 user nova-compute[75216]: WARNING nova.compute.manager [req-42fcf7db-3aec-4021-b720-d43fa5b16be8 req-c931620d-6eb1-401e-b9da-6c4ecb66cffe service nova] [instance: 91ea8a19-a365-484c-80c7-baf90e7dd1aa] Received unexpected event network-vif-plugged-2cfb645f-7bee-4657-b0d8-afcaa0298ac9 for instance with vm_state resized and task_state resize_reverting.
Nov 13 18:55:34 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-5644284d-5f6c-4b74-b632-ab09f913e009 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Acquiring lock "refresh_cache-91ea8a19-a365-484c-80c7-baf90e7dd1aa" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 18:55:34 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-5644284d-5f6c-4b74-b632-ab09f913e009 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Acquired lock "refresh_cache-91ea8a19-a365-484c-80c7-baf90e7dd1aa" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 18:55:34 user nova-compute[75216]: DEBUG nova.network.neutron [None req-5644284d-5f6c-4b74-b632-ab09f913e009 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] [instance: 91ea8a19-a365-484c-80c7-baf90e7dd1aa] Building network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 18:55:35 user nova-compute[75216]: DEBUG nova.network.neutron [None req-5644284d-5f6c-4b74-b632-ab09f913e009 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] [instance: 91ea8a19-a365-484c-80c7-baf90e7dd1aa] Updating instance_info_cache with network_info: [{"id": "2cfb645f-7bee-4657-b0d8-afcaa0298ac9", "address": "fa:16:3e:3e:1d:91", "network": {"id": "a9670fc3-8a8e-4a2b-a39f-d41042d3443d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1394481632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0194e3c88e2b49c5ba9b9844f6048ea9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cfb645f-7b", "ovs_interfaceid": "2cfb645f-7bee-4657-b0d8-afcaa0298ac9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 18:55:35 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-5644284d-5f6c-4b74-b632-ab09f913e009 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Releasing lock "refresh_cache-91ea8a19-a365-484c-80c7-baf90e7dd1aa" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 18:55:35 user nova-compute[75216]: DEBUG os_brick.utils [None req-5644284d-5f6c-4b74-b632-ab09f913e009 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 18:55:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:55:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:55:35 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eaae4c3-7203-47b0-aa0d-e79c14ce30f2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aea6fcfe14b9\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:55:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:55:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:55:35 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b2481ba-125f-48ab-a134-53a654d90498]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:55:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:55:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:55:35 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[fae92b25-b457-4e86-9979-4591eea3f772]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:55:35 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ffd2b55-9068-4da0-bfde-e06b5c442391]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:55:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-5644284d-5f6c-4b74-b632-ab09f913e009 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Running cmd (subprocess): nvme version {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:55:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-5644284d-5f6c-4b74-b632-ab09f913e009 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] 'nvme version' failed. Not Retrying. {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 18:55:35 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5644284d-5f6c-4b74-b632-ab09f913e009 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] nvme not present on system {{(pid=75216) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 18:55:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:55:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 18:55:35 user nova-compute[75216]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 18:55:35 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d9ebd0f-2254-42a0-a3d7-cc702de92354]: (4, '') {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:55:35 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-5644284d-5f6c-4b74-b632-ab09f913e009 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75216) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 18:55:35 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-5644284d-5f6c-4b74-b632-ab09f913e009 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 18:55:35 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-5644284d-5f6c-4b74-b632-ab09f913e009 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] LIGHTOS: no hostnqn found. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 18:55:35 user nova-compute[75216]: DEBUG os_brick.utils [None req-5644284d-5f6c-4b74-b632-ab09f913e009 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aea6fcfe14b9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 18:55:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:55:38 user nova-compute[75216]: DEBUG nova.compute.manager [None req-7fd27229-42ed-457f-a18d-fd21c387d34d tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: 1e5f1164-a15e-40cf-b7bc-5aeb404a1216] Start spawning the instance on the hypervisor. {{(pid=75216) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 18:55:38 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-7fd27229-42ed-457f-a18d-fd21c387d34d tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: 1e5f1164-a15e-40cf-b7bc-5aeb404a1216] Creating instance directory {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 18:55:38 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-7fd27229-42ed-457f-a18d-fd21c387d34d tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: 1e5f1164-a15e-40cf-b7bc-5aeb404a1216] Creating image(s)
Nov 13 18:55:38 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-7fd27229-42ed-457f-a18d-fd21c387d34d tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: 1e5f1164-a15e-40cf-b7bc-5aeb404a1216] Did not create local disks {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 13 18:55:38 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-7fd27229-42ed-457f-a18d-fd21c387d34d tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: 1e5f1164-a15e-40cf-b7bc-5aeb404a1216] Ensure instance console log exists: /opt/stack/data/nova/instances/1e5f1164-a15e-40cf-b7bc-5aeb404a1216/console.log {{(pid=75216) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 18:55:38 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-7fd27229-42ed-457f-a18d-fd21c387d34d tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:55:38 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-7fd27229-42ed-457f-a18d-fd21c387d34d tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:55:38 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-7fd27229-42ed-457f-a18d-fd21c387d34d tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:55:38 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-7fd27229-42ed-457f-a18d-fd21c387d34d tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: 1e5f1164-a15e-40cf-b7bc-5aeb404a1216] Start _get_guest_xml network_info=[{"id": "96dfdc95-6a8e-43f3-8d7c-5b4f78a8f134", "address": "fa:16:3e:19:0b:3a", "network": {"id": "f8b821ef-8fae-42b9-9055-a9ea7be955ab", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-50594548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "903397a6c0474cfd8bd1a4fb338528aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96dfdc95-6a", "ovs_interfaceid": "96dfdc95-6a8e-43f3-8d7c-5b4f78a8f134", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T18:41:06Z,direct_url=<?>,disk_format='qcow2',id=77bcb5ba-8510-41ec-a88d-96097bb431de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c465b7c26ec44582b6d1b7169536ecc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T18:41:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RAbjhwID', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '1e5f1164-a15e-40cf-b7bc-5aeb404a1216', 'attached_at': '', 'detached_at': '', 'volume_id': '7e02966c-e269-45a8-8773-1dba3abaf1a1', 'serial': '7e02966c-e269-45a8-8773-1dba3abaf1a1'}, 'attachment_id': 'f1079bcf-5407-4e87-beca-c3c05ab56334', 'guest_format': None, 'mount_device': '/dev/vda', 'delete_on_termination': False, 'boot_index': 0, 'volume_type': None} {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 18:55:38 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-7fd27229-42ed-457f-a18d-fd21c387d34d tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 18:55:38 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-7fd27229-42ed-457f-a18d-fd21c387d34d tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 18:55:38 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-7fd27229-42ed-457f-a18d-fd21c387d34d tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 18:55:38 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-7fd27229-42ed-457f-a18d-fd21c387d34d tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] CPU controller missing on host. {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 18:55:38 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-7fd27229-42ed-457f-a18d-fd21c387d34d tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 18:55:38 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-7fd27229-42ed-457f-a18d-fd21c387d34d tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] CPU controller found on host. {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 18:55:38 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-7fd27229-42ed-457f-a18d-fd21c387d34d tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75216) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 18:55:38 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-7fd27229-42ed-457f-a18d-fd21c387d34d tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T18:40:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T18:41:06Z,direct_url=<?>,disk_format='qcow2',id=77bcb5ba-8510-41ec-a88d-96097bb431de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c465b7c26ec44582b6d1b7169536ecc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T18:41:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 18:55:38 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-7fd27229-42ed-457f-a18d-fd21c387d34d tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Flavor limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 18:55:38 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-7fd27229-42ed-457f-a18d-fd21c387d34d tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Image limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 18:55:38 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-7fd27229-42ed-457f-a18d-fd21c387d34d tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Flavor pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 18:55:38 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-7fd27229-42ed-457f-a18d-fd21c387d34d tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Image pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 18:55:38 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-7fd27229-42ed-457f-a18d-fd21c387d34d tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 18:55:38 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-7fd27229-42ed-457f-a18d-fd21c387d34d tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 18:55:38 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-7fd27229-42ed-457f-a18d-fd21c387d34d tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 18:55:38 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-7fd27229-42ed-457f-a18d-fd21c387d34d tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Got 1 possible topologies {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 18:55:38 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-7fd27229-42ed-457f-a18d-fd21c387d34d tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 18:55:38 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-7fd27229-42ed-457f-a18d-fd21c387d34d tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 18:55:38 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7fd27229-42ed-457f-a18d-fd21c387d34d tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: 1e5f1164-a15e-40cf-b7bc-5aeb404a1216] Calling os-brick to attach iSCSI Volume {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 18:55:38 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fd27229-42ed-457f-a18d-fd21c387d34d tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3a8669e40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RAbjhwID', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 18:55:38 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-7fd27229-42ed-457f-a18d-fd21c387d34d tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 18:55:38 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-7fd27229-42ed-457f-a18d-fd21c387d34d tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 18:55:38 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-7fd27229-42ed-457f-a18d-fd21c387d34d tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 18:55:38 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-7fd27229-42ed-457f-a18d-fd21c387d34d tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 18:55:38 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-7fd27229-42ed-457f-a18d-fd21c387d34d tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 18:55:38 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-7fd27229-42ed-457f-a18d-fd21c387d34d tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 18:55:38 user nova-compute[75216]: INFO os_brick.initiator.connectors.iscsi [None req-7fd27229-42ed-457f-a18d-fd21c387d34d tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 18:55:38 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1 -p 172.16.0.220:3260 {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:55:38 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:55:38 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[3afa831f-fcdc-485d-8215-1fac261fe921]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:55:38 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fd27229-42ed-457f-a18d-fd21c387d34d tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 18:55:38 user nova-compute[75216]:  {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:55:38 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1 -p 172.16.0.220:3260 --interface default --op new {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:55:38 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:55:38 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[81006e75-71ed-46f2-9f67-dc6b970695c4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1] added\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:55:38 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fd27229-42ed-457f-a18d-fd21c387d34d tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1] added
Nov 13 18:55:38 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:55:38 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:55:38 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:55:38 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[84d1a4df-22bb-496b-9c72-09ce085dad72]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:55:38 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fd27229-42ed-457f-a18d-fd21c387d34d tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:55:38 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:55:38 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:55:38 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[20e9b01f-bbfe-4139-aa7f-c4563dedb651]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:55:38 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fd27229-42ed-457f-a18d-fd21c387d34d tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:55:38 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RAbjhwID {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:55:38 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RAbjhwID" returned: 0 in 0.017s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:55:38 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[30f7722f-e3a1-4019-a660-67a203c93c88]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:55:38 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fd27229-42ed-457f-a18d-fd21c387d34d tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RAbjhwID'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:55:38 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:55:38 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:55:38 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cc5e661-df81-40da-8767-8ecc78dfa7f3]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:55:38 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fd27229-42ed-457f-a18d-fd21c387d34d tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:55:38 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:55:38 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:55:38 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[febe669f-be9e-4ad5-a7b1-77134a95a826]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ee38de6-1fa4-460d-9bb4-49720104365b (non-flash)\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:55:38 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fd27229-42ed-457f-a18d-fd21c387d34d tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ee38de6-1fa4-460d-9bb4-49720104365b (non-flash)
Nov 13 18:55:38 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 18:55:38 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fd27229-42ed-457f-a18d-fd21c387d34d tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ee38de6-1fa4-460d-9bb4-49720104365b (non-flash)
Nov 13 18:55:38 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 18:55:38 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1 -p 172.16.0.220:3260 --login {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:55:38 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:55:38 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[77aa6420-2f34-41f7-b9c9-1f6256e81ec6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:55:38 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fd27229-42ed-457f-a18d-fd21c387d34d tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1, portal: 172.16.0.220,3260]
Nov 13 18:55:38 user nova-compute[75216]: Login to [iface: default, target: iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1, portal: 172.16.0.220,3260] successful.
Nov 13 18:55:38 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:55:38 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:55:38 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:55:38 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[c99c95e7-8bae-4ba9-b206-423754b035b3]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:55:38 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fd27229-42ed-457f-a18d-fd21c387d34d tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:55:38 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:55:38 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:55:38 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[0601cb91-2ffe-4a73-bfa5-ccdc6586b2a6]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ee38de6-1fa4-460d-9bb4-49720104365b (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1 (non-flash)\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:55:38 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fd27229-42ed-457f-a18d-fd21c387d34d tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ee38de6-1fa4-460d-9bb4-49720104365b (non-flash)
Nov 13 18:55:38 user nova-compute[75216]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1 (non-flash)
Nov 13 18:55:38 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 18:55:38 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fd27229-42ed-457f-a18d-fd21c387d34d tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ee38de6-1fa4-460d-9bb4-49720104365b (non-flash)
Nov 13 18:55:38 user nova-compute[75216]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1 (non-flash)
Nov 13 18:55:38 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 18:55:38 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-7fd27229-42ed-457f-a18d-fd21c387d34d tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.255s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 18:55:38 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fd27229-42ed-457f-a18d-fd21c387d34d tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Connected to 172.16.0.220:3260 {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 18:55:38 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-7fd27229-42ed-457f-a18d-fd21c387d34d tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] HCTL ('33', '-', '-', 0) found on session 30 with lun 0 {{(pid=75216) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 18:55:38 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-7fd27229-42ed-457f-a18d-fd21c387d34d tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75216) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 18:55:38 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:55:38 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:55:38 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[03a81c89-ded5-4cca-a9c0-178e891478f8]: (4, ('- - 0', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:55:38 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-7fd27229-42ed-457f-a18d-fd21c387d34d tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Searching for a device in session 30 and hctl ['33', '*', '*', 0] yield: None {{(pid=75216) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 18:55:38 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:55:38 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75216) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 13 18:55:38 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:55:38 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-ccfba556-dd77-4eef-9e1e-4512891ff3fb tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] Acquiring lock "ded8f476-cf44-4c5e-8f6b-f36a9ee9a78b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:55:38 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-ccfba556-dd77-4eef-9e1e-4512891ff3fb tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] Lock "ded8f476-cf44-4c5e-8f6b-f36a9ee9a78b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:55:38 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-ccfba556-dd77-4eef-9e1e-4512891ff3fb tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] Acquiring lock "ded8f476-cf44-4c5e-8f6b-f36a9ee9a78b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:55:38 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-ccfba556-dd77-4eef-9e1e-4512891ff3fb tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] Lock "ded8f476-cf44-4c5e-8f6b-f36a9ee9a78b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:55:38 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-ccfba556-dd77-4eef-9e1e-4512891ff3fb tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] Lock "ded8f476-cf44-4c5e-8f6b-f36a9ee9a78b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:55:38 user nova-compute[75216]: INFO nova.compute.manager [None req-ccfba556-dd77-4eef-9e1e-4512891ff3fb tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] [instance: ded8f476-cf44-4c5e-8f6b-f36a9ee9a78b] Terminating instance
Nov 13 18:55:38 user nova-compute[75216]: DEBUG nova.compute.manager [None req-ccfba556-dd77-4eef-9e1e-4512891ff3fb tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] [instance: ded8f476-cf44-4c5e-8f6b-f36a9ee9a78b] Start destroying the instance on the hypervisor. {{(pid=75216) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 18:55:39 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:55:39 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:55:39 user nova-compute[75216]: DEBUG nova.compute.manager [req-bf057a7d-2b45-4753-8bfd-a67b611d010c req-c21f8380-f422-4b59-8d24-373e762819c1 service nova] [instance: ded8f476-cf44-4c5e-8f6b-f36a9ee9a78b] Received event network-vif-unplugged-88b781a1-8dbb-455d-b138-79f2568d050a {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:55:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-bf057a7d-2b45-4753-8bfd-a67b611d010c req-c21f8380-f422-4b59-8d24-373e762819c1 service nova] Acquiring lock "ded8f476-cf44-4c5e-8f6b-f36a9ee9a78b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:55:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-bf057a7d-2b45-4753-8bfd-a67b611d010c req-c21f8380-f422-4b59-8d24-373e762819c1 service nova] Lock "ded8f476-cf44-4c5e-8f6b-f36a9ee9a78b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:55:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-bf057a7d-2b45-4753-8bfd-a67b611d010c req-c21f8380-f422-4b59-8d24-373e762819c1 service nova] Lock "ded8f476-cf44-4c5e-8f6b-f36a9ee9a78b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:55:39 user nova-compute[75216]: DEBUG nova.compute.manager [req-bf057a7d-2b45-4753-8bfd-a67b611d010c req-c21f8380-f422-4b59-8d24-373e762819c1 service nova] [instance: ded8f476-cf44-4c5e-8f6b-f36a9ee9a78b] No waiting events found dispatching network-vif-unplugged-88b781a1-8dbb-455d-b138-79f2568d050a {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:55:39 user nova-compute[75216]: DEBUG nova.compute.manager [req-bf057a7d-2b45-4753-8bfd-a67b611d010c req-c21f8380-f422-4b59-8d24-373e762819c1 service nova] [instance: ded8f476-cf44-4c5e-8f6b-f36a9ee9a78b] Received event network-vif-unplugged-88b781a1-8dbb-455d-b138-79f2568d050a for instance with task_state deleting. {{(pid=75216) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 18:55:39 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-5644284d-5f6c-4b74-b632-ab09f913e009 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] [instance: 91ea8a19-a365-484c-80c7-baf90e7dd1aa] Starting finish_revert_migration {{(pid=75216) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Nov 13 18:55:39 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-5644284d-5f6c-4b74-b632-ab09f913e009 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] [instance: 91ea8a19-a365-484c-80c7-baf90e7dd1aa] Start _get_guest_xml network_info=[{"id": "2cfb645f-7bee-4657-b0d8-afcaa0298ac9", "address": "fa:16:3e:3e:1d:91", "network": {"id": "a9670fc3-8a8e-4a2b-a39f-d41042d3443d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1394481632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0194e3c88e2b49c5ba9b9844f6048ea9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cfb645f-7b", "ovs_interfaceid": "2cfb645f-7bee-4657-b0d8-afcaa0298ac9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=77bcb5ba-8510-41ec-a88d-96097bb431de,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'guest_format': None, 'boot_index': 0, 'image_id': '77bcb5ba-8510-41ec-a88d-96097bb431de'}], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JvBCenjA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '91ea8a19-a365-484c-80c7-baf90e7dd1aa', 'attached_at': '2023-11-13T18:55:39.000000', 'detached_at': '', 'volume_id': '82de1607-b976-408c-b503-062b8569f72d', 'serial': '82de1607-b976-408c-b503-062b8569f72d'}, 'attachment_id': 'b5449880-8ff6-42e3-ad0d-38bc6f60ec82', 'guest_format': None, 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'boot_index': None, 'volume_type': None} {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 18:55:39 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-5644284d-5f6c-4b74-b632-ab09f913e009 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 18:55:39 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-5644284d-5f6c-4b74-b632-ab09f913e009 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 18:55:39 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-5644284d-5f6c-4b74-b632-ab09f913e009 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 18:55:39 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-5644284d-5f6c-4b74-b632-ab09f913e009 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] CPU controller missing on host. {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 18:55:39 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-5644284d-5f6c-4b74-b632-ab09f913e009 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 18:55:39 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-5644284d-5f6c-4b74-b632-ab09f913e009 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] CPU controller found on host. {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 18:55:39 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-5644284d-5f6c-4b74-b632-ab09f913e009 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75216) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 18:55:39 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-5644284d-5f6c-4b74-b632-ab09f913e009 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T18:40:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=77bcb5ba-8510-41ec-a88d-96097bb431de,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 18:55:39 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-5644284d-5f6c-4b74-b632-ab09f913e009 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Flavor limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 18:55:39 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-5644284d-5f6c-4b74-b632-ab09f913e009 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Image limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 18:55:39 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-5644284d-5f6c-4b74-b632-ab09f913e009 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Flavor pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 18:55:39 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-5644284d-5f6c-4b74-b632-ab09f913e009 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Image pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 18:55:39 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-5644284d-5f6c-4b74-b632-ab09f913e009 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 18:55:39 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-5644284d-5f6c-4b74-b632-ab09f913e009 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 18:55:39 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-5644284d-5f6c-4b74-b632-ab09f913e009 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 18:55:39 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-5644284d-5f6c-4b74-b632-ab09f913e009 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Got 1 possible topologies {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 18:55:39 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-5644284d-5f6c-4b74-b632-ab09f913e009 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 18:55:39 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-5644284d-5f6c-4b74-b632-ab09f913e009 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 18:55:39 user nova-compute[75216]: DEBUG nova.objects.instance [None req-5644284d-5f6c-4b74-b632-ab09f913e009 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Lazy-loading 'vcpu_model' on Instance uuid 91ea8a19-a365-484c-80c7-baf90e7dd1aa {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 18:55:39 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-7fd27229-42ed-457f-a18d-fd21c387d34d tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Searching for a device in session 30 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75216) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 18:55:39 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fd27229-42ed-457f-a18d-fd21c387d34d tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RAbjhwID', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 18:55:39 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-7fd27229-42ed-457f-a18d-fd21c387d34d tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.287s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 18:55:39 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fd27229-42ed-457f-a18d-fd21c387d34d tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] <== connect_volume: return (1289ms) {'type': 'block', 'scsi_wwn': '26163306334623137', 'path': '/dev/sdb'} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 18:55:39 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7fd27229-42ed-457f-a18d-fd21c387d34d tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: 1e5f1164-a15e-40cf-b7bc-5aeb404a1216] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26163306334623137', 'path': '/dev/sdb'} {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 18:55:39 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:55:39 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5644284d-5f6c-4b74-b632-ab09f913e009 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] [instance: 91ea8a19-a365-484c-80c7-baf90e7dd1aa] Calling os-brick to attach iSCSI Volume {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 18:55:39 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-5644284d-5f6c-4b74-b632-ab09f913e009 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3a8669e40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JvBCenjA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 18:55:39 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-5644284d-5f6c-4b74-b632-ab09f913e009 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 18:55:39 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-5644284d-5f6c-4b74-b632-ab09f913e009 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 18:55:39 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-5644284d-5f6c-4b74-b632-ab09f913e009 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 18:55:39 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-5644284d-5f6c-4b74-b632-ab09f913e009 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 18:55:39 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-5644284d-5f6c-4b74-b632-ab09f913e009 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 18:55:39 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-5644284d-5f6c-4b74-b632-ab09f913e009 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 18:55:39 user nova-compute[75216]: INFO os_brick.initiator.connectors.iscsi [None req-5644284d-5f6c-4b74-b632-ab09f913e009 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 18:55:39 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:55:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d -p 172.16.0.220:3260 {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:55:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:55:39 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d871e72-41c9-4e36-9d8a-7a533fcc5562]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:55:39 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-5644284d-5f6c-4b74-b632-ab09f913e009 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 18:55:39 user nova-compute[75216]:  {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:55:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d -p 172.16.0.220:3260 --interface default --op new {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:55:39 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-7fd27229-42ed-457f-a18d-fd21c387d34d tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T18:55:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1805019771',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1805019771',id=24,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='903397a6c0474cfd8bd1a4fb338528aa',ramdisk_id='',reservation_id='r-0t4799bp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-197527955',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T18:55:28Z,user_data=None,user_id='b381ea98871846b1bfb29a202a058208',uuid=1e5f1164-a15e-40cf-b7bc-5aeb404a1216,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "96dfdc95-6a8e-43f3-8d7c-5b4f78a8f134", "address": "fa:16:3e:19:0b:3a", "network": {"id": "f8b821ef-8fae-42b9-9055-a9ea7be955ab", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-50594548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "903397a6c0474cfd8bd1a4fb338528aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96dfdc95-6a", "ovs_interfaceid": "96dfdc95-6a8e-43f3-8d7c-5b4f78a8f134", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75216) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 18:55:39 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-7fd27229-42ed-457f-a18d-fd21c387d34d tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Converting VIF {"id": "96dfdc95-6a8e-43f3-8d7c-5b4f78a8f134", "address": "fa:16:3e:19:0b:3a", "network": {"id": "f8b821ef-8fae-42b9-9055-a9ea7be955ab", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-50594548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "903397a6c0474cfd8bd1a4fb338528aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96dfdc95-6a", "ovs_interfaceid": "96dfdc95-6a8e-43f3-8d7c-5b4f78a8f134", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 18:55:39 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-7fd27229-42ed-457f-a18d-fd21c387d34d tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:0b:3a,bridge_name='br-int',has_traffic_filtering=True,id=96dfdc95-6a8e-43f3-8d7c-5b4f78a8f134,network=Network(f8b821ef-8fae-42b9-9055-a9ea7be955ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96dfdc95-6a') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 18:55:39 user nova-compute[75216]: DEBUG nova.objects.instance [None req-7fd27229-42ed-457f-a18d-fd21c387d34d tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Lazy-loading 'pci_devices' on Instance uuid 1e5f1164-a15e-40cf-b7bc-5aeb404a1216 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 18:55:39 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-7fd27229-42ed-457f-a18d-fd21c387d34d tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: 1e5f1164-a15e-40cf-b7bc-5aeb404a1216] End _get_guest_xml xml=<domain type="kvm">
Nov 13 18:55:39 user nova-compute[75216]:   <uuid>1e5f1164-a15e-40cf-b7bc-5aeb404a1216</uuid>
Nov 13 18:55:39 user nova-compute[75216]:   <name>instance-00000018</name>
Nov 13 18:55:39 user nova-compute[75216]:   <memory>524288</memory>
Nov 13 18:55:39 user nova-compute[75216]:   <vcpu>1</vcpu>
Nov 13 18:55:39 user nova-compute[75216]:   <metadata>
Nov 13 18:55:39 user nova-compute[75216]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 18:55:39 user nova-compute[75216]:       <nova:package version="0.0.0"/>
Nov 13 18:55:39 user nova-compute[75216]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1805019771</nova:name>
Nov 13 18:55:39 user nova-compute[75216]:       <nova:creationTime>2023-11-13 18:55:38</nova:creationTime>
Nov 13 18:55:39 user nova-compute[75216]:       <nova:flavor name="m1.tiny">
Nov 13 18:55:39 user nova-compute[75216]:         <nova:memory>512</nova:memory>
Nov 13 18:55:39 user nova-compute[75216]:         <nova:disk>1</nova:disk>
Nov 13 18:55:39 user nova-compute[75216]:         <nova:swap>0</nova:swap>
Nov 13 18:55:39 user nova-compute[75216]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 18:55:39 user nova-compute[75216]:         <nova:vcpus>1</nova:vcpus>
Nov 13 18:55:39 user nova-compute[75216]:       </nova:flavor>
Nov 13 18:55:39 user nova-compute[75216]:       <nova:owner>
Nov 13 18:55:39 user nova-compute[75216]:         <nova:user uuid="b381ea98871846b1bfb29a202a058208">tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member</nova:user>
Nov 13 18:55:39 user nova-compute[75216]:         <nova:project uuid="903397a6c0474cfd8bd1a4fb338528aa">tempest-ServerBootFromVolumeStableRescueTest-197527955</nova:project>
Nov 13 18:55:39 user nova-compute[75216]:       </nova:owner>
Nov 13 18:55:39 user nova-compute[75216]:       <nova:root type="image" uuid="77bcb5ba-8510-41ec-a88d-96097bb431de"/>
Nov 13 18:55:39 user nova-compute[75216]:       <nova:ports>
Nov 13 18:55:39 user nova-compute[75216]:         <nova:port uuid="96dfdc95-6a8e-43f3-8d7c-5b4f78a8f134">
Nov 13 18:55:39 user nova-compute[75216]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 13 18:55:39 user nova-compute[75216]:         </nova:port>
Nov 13 18:55:39 user nova-compute[75216]:       </nova:ports>
Nov 13 18:55:39 user nova-compute[75216]:     </nova:instance>
Nov 13 18:55:39 user nova-compute[75216]:   </metadata>
Nov 13 18:55:39 user nova-compute[75216]:   <sysinfo type="smbios">
Nov 13 18:55:39 user nova-compute[75216]:     <system>
Nov 13 18:55:39 user nova-compute[75216]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 18:55:39 user nova-compute[75216]:       <entry name="product">OpenStack Nova</entry>
Nov 13 18:55:39 user nova-compute[75216]:       <entry name="version">0.0.0</entry>
Nov 13 18:55:39 user nova-compute[75216]:       <entry name="serial">1e5f1164-a15e-40cf-b7bc-5aeb404a1216</entry>
Nov 13 18:55:39 user nova-compute[75216]:       <entry name="uuid">1e5f1164-a15e-40cf-b7bc-5aeb404a1216</entry>
Nov 13 18:55:39 user nova-compute[75216]:       <entry name="family">Virtual Machine</entry>
Nov 13 18:55:39 user nova-compute[75216]:     </system>
Nov 13 18:55:39 user nova-compute[75216]:   </sysinfo>
Nov 13 18:55:39 user nova-compute[75216]:   <os>
Nov 13 18:55:39 user nova-compute[75216]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 18:55:39 user nova-compute[75216]:     <boot dev="hd"/>
Nov 13 18:55:39 user nova-compute[75216]:     <smbios mode="sysinfo"/>
Nov 13 18:55:39 user nova-compute[75216]:   </os>
Nov 13 18:55:39 user nova-compute[75216]:   <features>
Nov 13 18:55:39 user nova-compute[75216]:     <acpi/>
Nov 13 18:55:39 user nova-compute[75216]:     <apic/>
Nov 13 18:55:39 user nova-compute[75216]:     <vmcoreinfo/>
Nov 13 18:55:39 user nova-compute[75216]:   </features>
Nov 13 18:55:39 user nova-compute[75216]:   <clock offset="utc">
Nov 13 18:55:39 user nova-compute[75216]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 18:55:39 user nova-compute[75216]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 18:55:39 user nova-compute[75216]:     <timer name="hpet" present="no"/>
Nov 13 18:55:39 user nova-compute[75216]:   </clock>
Nov 13 18:55:39 user nova-compute[75216]:   <cpu mode="custom" match="exact">
Nov 13 18:55:39 user nova-compute[75216]:     <model>Nehalem</model>
Nov 13 18:55:39 user nova-compute[75216]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 18:55:39 user nova-compute[75216]:   </cpu>
Nov 13 18:55:39 user nova-compute[75216]:   <devices>
Nov 13 18:55:39 user nova-compute[75216]:     <disk type="block" device="disk">
Nov 13 18:55:39 user nova-compute[75216]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 18:55:39 user nova-compute[75216]:       <source dev="/dev/sdb"/>
Nov 13 18:55:39 user nova-compute[75216]:       <target dev="vda" bus="virtio"/>
Nov 13 18:55:39 user nova-compute[75216]:       <serial>7e02966c-e269-45a8-8773-1dba3abaf1a1</serial>
Nov 13 18:55:39 user nova-compute[75216]:     </disk>
Nov 13 18:55:39 user nova-compute[75216]:     <interface type="ethernet">
Nov 13 18:55:39 user nova-compute[75216]:       <mac address="fa:16:3e:19:0b:3a"/>
Nov 13 18:55:39 user nova-compute[75216]:       <model type="virtio"/>
Nov 13 18:55:39 user nova-compute[75216]:       <mtu size="1442"/>
Nov 13 18:55:39 user nova-compute[75216]:       <target dev="tap96dfdc95-6a"/>
Nov 13 18:55:39 user nova-compute[75216]:     </interface>
Nov 13 18:55:39 user nova-compute[75216]:     <serial type="pty">
Nov 13 18:55:39 user nova-compute[75216]:       <log file="/opt/stack/data/nova/instances/1e5f1164-a15e-40cf-b7bc-5aeb404a1216/console.log" append="off"/>
Nov 13 18:55:39 user nova-compute[75216]:     </serial>
Nov 13 18:55:39 user nova-compute[75216]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 18:55:39 user nova-compute[75216]:     <video>
Nov 13 18:55:39 user nova-compute[75216]:       <model type="virtio"/>
Nov 13 18:55:39 user nova-compute[75216]:     </video>
Nov 13 18:55:39 user nova-compute[75216]:     <rng model="virtio">
Nov 13 18:55:39 user nova-compute[75216]:       <backend model="random">/dev/urandom</backend>
Nov 13 18:55:39 user nova-compute[75216]:     </rng>
Nov 13 18:55:39 user nova-compute[75216]:     <controller type="usb" index="0" model="none"/>
Nov 13 18:55:39 user nova-compute[75216]:     <memballoon model="virtio">
Nov 13 18:55:39 user nova-compute[75216]:       <stats period="10"/>
Nov 13 18:55:39 user nova-compute[75216]:     </memballoon>
Nov 13 18:55:39 user nova-compute[75216]:   </devices>
Nov 13 18:55:39 user nova-compute[75216]: </domain>
Nov 13 18:55:39 user nova-compute[75216]:  {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 18:55:39 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-7fd27229-42ed-457f-a18d-fd21c387d34d tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T18:55:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1805019771',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1805019771',id=24,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='903397a6c0474cfd8bd1a4fb338528aa',ramdisk_id='',reservation_id='r-0t4799bp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-197527955',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T18:55:28Z,user_data=None,user_id='b381ea98871846b1bfb29a202a058208',uuid=1e5f1164-a15e-40cf-b7bc-5aeb404a1216,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "96dfdc95-6a8e-43f3-8d7c-5b4f78a8f134", "address": "fa:16:3e:19:0b:3a", "network": {"id": "f8b821ef-8fae-42b9-9055-a9ea7be955ab", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-50594548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "903397a6c0474cfd8bd1a4fb338528aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96dfdc95-6a", "ovs_interfaceid": "96dfdc95-6a8e-43f3-8d7c-5b4f78a8f134", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 18:55:39 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-7fd27229-42ed-457f-a18d-fd21c387d34d tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Converting VIF {"id": "96dfdc95-6a8e-43f3-8d7c-5b4f78a8f134", "address": "fa:16:3e:19:0b:3a", "network": {"id": "f8b821ef-8fae-42b9-9055-a9ea7be955ab", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-50594548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "903397a6c0474cfd8bd1a4fb338528aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96dfdc95-6a", "ovs_interfaceid": "96dfdc95-6a8e-43f3-8d7c-5b4f78a8f134", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 18:55:39 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-7fd27229-42ed-457f-a18d-fd21c387d34d tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:0b:3a,bridge_name='br-int',has_traffic_filtering=True,id=96dfdc95-6a8e-43f3-8d7c-5b4f78a8f134,network=Network(f8b821ef-8fae-42b9-9055-a9ea7be955ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96dfdc95-6a') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 18:55:39 user nova-compute[75216]: DEBUG os_vif [None req-7fd27229-42ed-457f-a18d-fd21c387d34d tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:0b:3a,bridge_name='br-int',has_traffic_filtering=True,id=96dfdc95-6a8e-43f3-8d7c-5b4f78a8f134,network=Network(f8b821ef-8fae-42b9-9055-a9ea7be955ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96dfdc95-6a') {{(pid=75216) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 18:55:39 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:55:39 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:55:39 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 18:55:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:55:39 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[6edab693-4367-4405-8a06-2cc78bca3abb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d] added\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:55:39 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-5644284d-5f6c-4b74-b632-ab09f913e009 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d] added
Nov 13 18:55:39 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:55:39 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:55:39 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '273083ad-067d-5140-8d9b-f713ca7a337f', '_type': 'linux-noop'}}, row=False) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:55:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:55:39 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:55:39 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:55:39 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:55:39 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:55:39 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap96dfdc95-6a, may_exist=True, interface_attrs={}) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:55:39 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap96dfdc95-6a, col_values=(('qos', UUID('56f4cd45-4e17-4ba9-a580-27d2ea9e3b86')),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:55:39 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap96dfdc95-6a, col_values=(('external_ids', {'iface-id': '96dfdc95-6a8e-43f3-8d7c-5b4f78a8f134', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:19:0b:3a', 'vm-uuid': '1e5f1164-a15e-40cf-b7bc-5aeb404a1216'}),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:55:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:55:39 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4b23636-2ff5-4875-9294-7d449aa7e729]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:55:39 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-5644284d-5f6c-4b74-b632-ab09f913e009 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:55:39 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:55:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:55:39 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:55:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:55:39 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[f18742d9-e079-4bd7-b706-f924cfefca6e]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:55:39 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-5644284d-5f6c-4b74-b632-ab09f913e009 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:55:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JvBCenjA {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:55:39 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:55:39 user nova-compute[75216]: INFO os_vif [None req-7fd27229-42ed-457f-a18d-fd21c387d34d tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:0b:3a,bridge_name='br-int',has_traffic_filtering=True,id=96dfdc95-6a8e-43f3-8d7c-5b4f78a8f134,network=Network(f8b821ef-8fae-42b9-9055-a9ea7be955ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96dfdc95-6a')
Nov 13 18:55:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JvBCenjA" returned: 0 in 0.020s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:55:39 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee5cf9e1-d687-4126-a615-d54aab8faf98]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:55:39 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-5644284d-5f6c-4b74-b632-ab09f913e009 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JvBCenjA'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:55:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:55:39 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: ded8f476-cf44-4c5e-8f6b-f36a9ee9a78b] Instance destroyed successfully.
Nov 13 18:55:39 user nova-compute[75216]: DEBUG nova.objects.instance [None req-ccfba556-dd77-4eef-9e1e-4512891ff3fb tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] Lazy-loading 'resources' on Instance uuid ded8f476-cf44-4c5e-8f6b-f36a9ee9a78b {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 18:55:39 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-ccfba556-dd77-4eef-9e1e-4512891ff3fb tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T18:53:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1858659004',display_name='tempest-ServersNegativeTestJSON-server-1858659004',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1858659004',id=22,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-13T18:54:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a847a509c4d34004a89158b45ec469fb',ramdisk_id='',reservation_id='r-bfvor1bi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-950650335',owner_user_name='tempest-ServersNegativeTestJSON-950650335-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T18:54:01Z,user_data=None,user_id='14638ac21d6f4b0e9fa526934c8eb7ea',uuid=ded8f476-cf44-4c5e-8f6b-f36a9ee9a78b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "88b781a1-8dbb-455d-b138-79f2568d050a", "address": "fa:16:3e:8e:ed:49", "network": {"id": "bf647e60-7de3-41d4-abe5-a8ddf56be0f2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2101256065-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a847a509c4d34004a89158b45ec469fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88b781a1-8d", "ovs_interfaceid": "88b781a1-8dbb-455d-b138-79f2568d050a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 18:55:39 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-ccfba556-dd77-4eef-9e1e-4512891ff3fb tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] Converting VIF {"id": "88b781a1-8dbb-455d-b138-79f2568d050a", "address": "fa:16:3e:8e:ed:49", "network": {"id": "bf647e60-7de3-41d4-abe5-a8ddf56be0f2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2101256065-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a847a509c4d34004a89158b45ec469fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88b781a1-8d", "ovs_interfaceid": "88b781a1-8dbb-455d-b138-79f2568d050a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 18:55:39 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-ccfba556-dd77-4eef-9e1e-4512891ff3fb tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:ed:49,bridge_name='br-int',has_traffic_filtering=True,id=88b781a1-8dbb-455d-b138-79f2568d050a,network=Network(bf647e60-7de3-41d4-abe5-a8ddf56be0f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88b781a1-8d') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 18:55:39 user nova-compute[75216]: DEBUG os_vif [None req-ccfba556-dd77-4eef-9e1e-4512891ff3fb tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:ed:49,bridge_name='br-int',has_traffic_filtering=True,id=88b781a1-8dbb-455d-b138-79f2568d050a,network=Network(bf647e60-7de3-41d4-abe5-a8ddf56be0f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88b781a1-8d') {{(pid=75216) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 18:55:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:55:39 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c7760a1-a620-4a85-baf9-c56e2e31e6d3]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:55:39 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-5644284d-5f6c-4b74-b632-ab09f913e009 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:55:39 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:55:39 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap88b781a1-8d, bridge=br-int, if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:55:39 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:55:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:55:39 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:55:39 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:55:39 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:55:39 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3dd453f8-57e9-4aec-9f28-5b69ebe5b59f) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:55:39 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:55:39 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:55:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:55:39 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea3f250d-fc17-4141-bd15-2f6f4f76ff42]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ee38de6-1fa4-460d-9bb4-49720104365b (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1 (non-flash)\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:55:39 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:55:39 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-5644284d-5f6c-4b74-b632-ab09f913e009 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ee38de6-1fa4-460d-9bb4-49720104365b (non-flash)
Nov 13 18:55:39 user nova-compute[75216]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1 (non-flash)
Nov 13 18:55:39 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 18:55:39 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-5644284d-5f6c-4b74-b632-ab09f913e009 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ee38de6-1fa4-460d-9bb4-49720104365b (non-flash)
Nov 13 18:55:39 user nova-compute[75216]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1 (non-flash)
Nov 13 18:55:39 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 18:55:39 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-7fd27229-42ed-457f-a18d-fd21c387d34d tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 18:55:39 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-7fd27229-42ed-457f-a18d-fd21c387d34d tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] No VIF found with MAC fa:16:3e:19:0b:3a, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 18:55:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d -p 172.16.0.220:3260 --login {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:55:39 user nova-compute[75216]: INFO os_vif [None req-ccfba556-dd77-4eef-9e1e-4512891ff3fb tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:ed:49,bridge_name='br-int',has_traffic_filtering=True,id=88b781a1-8dbb-455d-b138-79f2568d050a,network=Network(bf647e60-7de3-41d4-abe5-a8ddf56be0f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88b781a1-8d')
Nov 13 18:55:39 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-ccfba556-dd77-4eef-9e1e-4512891ff3fb tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] [instance: ded8f476-cf44-4c5e-8f6b-f36a9ee9a78b] Deleting instance files /opt/stack/data/nova/instances/ded8f476-cf44-4c5e-8f6b-f36a9ee9a78b_del
Nov 13 18:55:39 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-ccfba556-dd77-4eef-9e1e-4512891ff3fb tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] [instance: ded8f476-cf44-4c5e-8f6b-f36a9ee9a78b] Deletion of /opt/stack/data/nova/instances/ded8f476-cf44-4c5e-8f6b-f36a9ee9a78b_del complete
Nov 13 18:55:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:55:39 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[09415c68-bef2-4a34-ba8f-5fb5be6439ad]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:55:39 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-5644284d-5f6c-4b74-b632-ab09f913e009 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d, portal: 172.16.0.220,3260]
Nov 13 18:55:39 user nova-compute[75216]: Login to [iface: default, target: iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d, portal: 172.16.0.220,3260] successful.
Nov 13 18:55:39 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:55:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:55:39 user nova-compute[75216]: INFO nova.compute.manager [None req-ccfba556-dd77-4eef-9e1e-4512891ff3fb tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] [instance: ded8f476-cf44-4c5e-8f6b-f36a9ee9a78b] Took 0.68 seconds to destroy the instance on the hypervisor.
Nov 13 18:55:39 user nova-compute[75216]: DEBUG oslo.service.loopingcall [None req-ccfba556-dd77-4eef-9e1e-4512891ff3fb tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75216) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 18:55:39 user nova-compute[75216]: DEBUG nova.compute.manager [-] [instance: ded8f476-cf44-4c5e-8f6b-f36a9ee9a78b] Deallocating network for instance {{(pid=75216) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 18:55:39 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: ded8f476-cf44-4c5e-8f6b-f36a9ee9a78b] deallocate_for_instance() {{(pid=75216) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 18:55:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:55:39 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7f4202f-4613-476d-a3cd-f225ce76f95e]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:55:39 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-5644284d-5f6c-4b74-b632-ab09f913e009 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:55:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:55:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:55:39 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[7163346f-b61f-4024-9c18-e0dae035457e]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ee38de6-1fa4-460d-9bb4-49720104365b (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d (non-flash)\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:55:39 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-5644284d-5f6c-4b74-b632-ab09f913e009 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ee38de6-1fa4-460d-9bb4-49720104365b (non-flash)
Nov 13 18:55:39 user nova-compute[75216]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1 (non-flash)
Nov 13 18:55:39 user nova-compute[75216]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d (non-flash)
Nov 13 18:55:39 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 18:55:39 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-5644284d-5f6c-4b74-b632-ab09f913e009 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ee38de6-1fa4-460d-9bb4-49720104365b (non-flash)
Nov 13 18:55:39 user nova-compute[75216]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1 (non-flash)
Nov 13 18:55:39 user nova-compute[75216]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d (non-flash)
Nov 13 18:55:39 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 18:55:39 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-5644284d-5f6c-4b74-b632-ab09f913e009 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.309s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 18:55:39 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-5644284d-5f6c-4b74-b632-ab09f913e009 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Connected to 172.16.0.220:3260 {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 18:55:39 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-5644284d-5f6c-4b74-b632-ab09f913e009 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] HCTL ('35', '-', '-', 0) found on session 31 with lun 0 {{(pid=75216) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 18:55:39 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-5644284d-5f6c-4b74-b632-ab09f913e009 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75216) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 18:55:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:55:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:55:39 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee57f89b-6df1-41ca-9387-bc1b3026f5a7]: (4, ('- - 0', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:55:39 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-5644284d-5f6c-4b74-b632-ab09f913e009 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Searching for a device in session 31 and hctl ['35', '*', '*', 0] yield: None {{(pid=75216) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 18:55:40 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: ded8f476-cf44-4c5e-8f6b-f36a9ee9a78b] Updating instance_info_cache with network_info: [] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 18:55:40 user nova-compute[75216]: INFO nova.compute.manager [-] [instance: ded8f476-cf44-4c5e-8f6b-f36a9ee9a78b] Took 0.50 seconds to deallocate network for instance.
Nov 13 18:55:40 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-ccfba556-dd77-4eef-9e1e-4512891ff3fb tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:55:40 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-ccfba556-dd77-4eef-9e1e-4512891ff3fb tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:55:40 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-ccfba556-dd77-4eef-9e1e-4512891ff3fb tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 18:55:40 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-ccfba556-dd77-4eef-9e1e-4512891ff3fb tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 18:55:40 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-ccfba556-dd77-4eef-9e1e-4512891ff3fb tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.372s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:55:40 user nova-compute[75216]: INFO nova.scheduler.client.report [None req-ccfba556-dd77-4eef-9e1e-4512891ff3fb tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] Deleted allocations for instance ded8f476-cf44-4c5e-8f6b-f36a9ee9a78b
Nov 13 18:55:40 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-ccfba556-dd77-4eef-9e1e-4512891ff3fb tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] Lock "ded8f476-cf44-4c5e-8f6b-f36a9ee9a78b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.729s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:55:40 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-5644284d-5f6c-4b74-b632-ab09f913e009 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Searching for a device in session 31 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75216) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 18:55:40 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-5644284d-5f6c-4b74-b632-ab09f913e009 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JvBCenjA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 18:55:40 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-5644284d-5f6c-4b74-b632-ab09f913e009 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.339s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 18:55:40 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-5644284d-5f6c-4b74-b632-ab09f913e009 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] <== connect_volume: return (1341ms) {'type': 'block', 'scsi_wwn': '26539373964636136', 'path': '/dev/sdd'} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 18:55:40 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5644284d-5f6c-4b74-b632-ab09f913e009 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] [instance: 91ea8a19-a365-484c-80c7-baf90e7dd1aa] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26539373964636136', 'path': '/dev/sdd'} {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 18:55:40 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-5644284d-5f6c-4b74-b632-ab09f913e009 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T18:49:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2138583247',display_name='tempest-ServerActionsTestOtherB-server-2138583247',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2138583247',id=18,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAl4rrs8AsTXVVWOe2ej9Q0PBsZfl4SiBx6Z+7YBp2Q8nhbMLqhEEYWYCrwvKHOa1CVoqmRod9jN0d8asOX7OMqzQqSN/edxVDFYygCGcMd2W6HT1YDz1w3rZ0s5A43lWg==',key_name='tempest-keypair-1520178236',keypairs=<?>,launch_index=0,launched_at=2023-11-13T18:54:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='0194e3c88e2b49c5ba9b9844f6048ea9',ramdisk_id='',reservation_id='r-z6obctyl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1164011898',owner_user_name='tempest-ServerActionsTestOtherB-1164011898-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T18:55:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0543920a35a54c83bcc159b7a2b08a80',uuid=91ea8a19-a365-484c-80c7-baf90e7dd1aa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "2cfb645f-7bee-4657-b0d8-afcaa0298ac9", "address": "fa:16:3e:3e:1d:91", "network": {"id": "a9670fc3-8a8e-4a2b-a39f-d41042d3443d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1394481632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0194e3c88e2b49c5ba9b9844f6048ea9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cfb645f-7b", "ovs_interfaceid": "2cfb645f-7bee-4657-b0d8-afcaa0298ac9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75216) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 18:55:40 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-5644284d-5f6c-4b74-b632-ab09f913e009 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Converting VIF {"id": "2cfb645f-7bee-4657-b0d8-afcaa0298ac9", "address": "fa:16:3e:3e:1d:91", "network": {"id": "a9670fc3-8a8e-4a2b-a39f-d41042d3443d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1394481632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0194e3c88e2b49c5ba9b9844f6048ea9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cfb645f-7b", "ovs_interfaceid": "2cfb645f-7bee-4657-b0d8-afcaa0298ac9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 18:55:40 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-5644284d-5f6c-4b74-b632-ab09f913e009 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:1d:91,bridge_name='br-int',has_traffic_filtering=True,id=2cfb645f-7bee-4657-b0d8-afcaa0298ac9,network=Network(a9670fc3-8a8e-4a2b-a39f-d41042d3443d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cfb645f-7b') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 18:55:40 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-5644284d-5f6c-4b74-b632-ab09f913e009 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] [instance: 91ea8a19-a365-484c-80c7-baf90e7dd1aa] End _get_guest_xml xml=<domain type="kvm">
Nov 13 18:55:40 user nova-compute[75216]:   <uuid>91ea8a19-a365-484c-80c7-baf90e7dd1aa</uuid>
Nov 13 18:55:40 user nova-compute[75216]:   <name>instance-00000012</name>
Nov 13 18:55:40 user nova-compute[75216]:   <memory>524288</memory>
Nov 13 18:55:40 user nova-compute[75216]:   <vcpu>1</vcpu>
Nov 13 18:55:40 user nova-compute[75216]:   <metadata>
Nov 13 18:55:40 user nova-compute[75216]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 18:55:40 user nova-compute[75216]:       <nova:package version="0.0.0"/>
Nov 13 18:55:40 user nova-compute[75216]:       <nova:name>tempest-ServerActionsTestOtherB-server-2138583247</nova:name>
Nov 13 18:55:40 user nova-compute[75216]:       <nova:creationTime>2023-11-13 18:55:39</nova:creationTime>
Nov 13 18:55:40 user nova-compute[75216]:       <nova:flavor name="m1.tiny">
Nov 13 18:55:40 user nova-compute[75216]:         <nova:memory>512</nova:memory>
Nov 13 18:55:40 user nova-compute[75216]:         <nova:disk>1</nova:disk>
Nov 13 18:55:40 user nova-compute[75216]:         <nova:swap>0</nova:swap>
Nov 13 18:55:40 user nova-compute[75216]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 18:55:40 user nova-compute[75216]:         <nova:vcpus>1</nova:vcpus>
Nov 13 18:55:40 user nova-compute[75216]:       </nova:flavor>
Nov 13 18:55:40 user nova-compute[75216]:       <nova:owner>
Nov 13 18:55:40 user nova-compute[75216]:         <nova:user uuid="0543920a35a54c83bcc159b7a2b08a80">tempest-ServerActionsTestOtherB-1164011898-project-member</nova:user>
Nov 13 18:55:40 user nova-compute[75216]:         <nova:project uuid="0194e3c88e2b49c5ba9b9844f6048ea9">tempest-ServerActionsTestOtherB-1164011898</nova:project>
Nov 13 18:55:40 user nova-compute[75216]:       </nova:owner>
Nov 13 18:55:40 user nova-compute[75216]:       <nova:root type="image" uuid="77bcb5ba-8510-41ec-a88d-96097bb431de"/>
Nov 13 18:55:40 user nova-compute[75216]:       <nova:ports>
Nov 13 18:55:40 user nova-compute[75216]:         <nova:port uuid="2cfb645f-7bee-4657-b0d8-afcaa0298ac9">
Nov 13 18:55:40 user nova-compute[75216]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 13 18:55:40 user nova-compute[75216]:         </nova:port>
Nov 13 18:55:40 user nova-compute[75216]:       </nova:ports>
Nov 13 18:55:40 user nova-compute[75216]:     </nova:instance>
Nov 13 18:55:40 user nova-compute[75216]:   </metadata>
Nov 13 18:55:40 user nova-compute[75216]:   <sysinfo type="smbios">
Nov 13 18:55:40 user nova-compute[75216]:     <system>
Nov 13 18:55:40 user nova-compute[75216]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 18:55:40 user nova-compute[75216]:       <entry name="product">OpenStack Nova</entry>
Nov 13 18:55:40 user nova-compute[75216]:       <entry name="version">0.0.0</entry>
Nov 13 18:55:40 user nova-compute[75216]:       <entry name="serial">91ea8a19-a365-484c-80c7-baf90e7dd1aa</entry>
Nov 13 18:55:40 user nova-compute[75216]:       <entry name="uuid">91ea8a19-a365-484c-80c7-baf90e7dd1aa</entry>
Nov 13 18:55:40 user nova-compute[75216]:       <entry name="family">Virtual Machine</entry>
Nov 13 18:55:40 user nova-compute[75216]:     </system>
Nov 13 18:55:40 user nova-compute[75216]:   </sysinfo>
Nov 13 18:55:40 user nova-compute[75216]:   <os>
Nov 13 18:55:40 user nova-compute[75216]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 18:55:40 user nova-compute[75216]:     <boot dev="hd"/>
Nov 13 18:55:40 user nova-compute[75216]:     <smbios mode="sysinfo"/>
Nov 13 18:55:40 user nova-compute[75216]:   </os>
Nov 13 18:55:40 user nova-compute[75216]:   <features>
Nov 13 18:55:40 user nova-compute[75216]:     <acpi/>
Nov 13 18:55:40 user nova-compute[75216]:     <apic/>
Nov 13 18:55:40 user nova-compute[75216]:     <vmcoreinfo/>
Nov 13 18:55:40 user nova-compute[75216]:   </features>
Nov 13 18:55:40 user nova-compute[75216]:   <clock offset="utc">
Nov 13 18:55:40 user nova-compute[75216]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 18:55:40 user nova-compute[75216]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 18:55:40 user nova-compute[75216]:     <timer name="hpet" present="no"/>
Nov 13 18:55:40 user nova-compute[75216]:   </clock>
Nov 13 18:55:40 user nova-compute[75216]:   <cpu mode="custom" match="exact">
Nov 13 18:55:40 user nova-compute[75216]:     <model>Nehalem</model>
Nov 13 18:55:40 user nova-compute[75216]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 18:55:40 user nova-compute[75216]:   </cpu>
Nov 13 18:55:40 user nova-compute[75216]:   <devices>
Nov 13 18:55:40 user nova-compute[75216]:     <disk type="file" device="disk">
Nov 13 18:55:40 user nova-compute[75216]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 18:55:40 user nova-compute[75216]:       <source file="/opt/stack/data/nova/instances/91ea8a19-a365-484c-80c7-baf90e7dd1aa/disk"/>
Nov 13 18:55:40 user nova-compute[75216]:       <target dev="vda" bus="virtio"/>
Nov 13 18:55:40 user nova-compute[75216]:     </disk>
Nov 13 18:55:40 user nova-compute[75216]:     <disk type="block" device="disk">
Nov 13 18:55:40 user nova-compute[75216]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 18:55:40 user nova-compute[75216]:       <source dev="/dev/sdd"/>
Nov 13 18:55:40 user nova-compute[75216]:       <target dev="vdb" bus="virtio"/>
Nov 13 18:55:40 user nova-compute[75216]:       <serial>82de1607-b976-408c-b503-062b8569f72d</serial>
Nov 13 18:55:40 user nova-compute[75216]:     </disk>
Nov 13 18:55:40 user nova-compute[75216]:     <interface type="ethernet">
Nov 13 18:55:40 user nova-compute[75216]:       <mac address="fa:16:3e:3e:1d:91"/>
Nov 13 18:55:40 user nova-compute[75216]:       <model type="virtio"/>
Nov 13 18:55:40 user nova-compute[75216]:       <mtu size="1442"/>
Nov 13 18:55:40 user nova-compute[75216]:       <target dev="tap2cfb645f-7b"/>
Nov 13 18:55:40 user nova-compute[75216]:     </interface>
Nov 13 18:55:40 user nova-compute[75216]:     <serial type="pty">
Nov 13 18:55:40 user nova-compute[75216]:       <log file="/opt/stack/data/nova/instances/91ea8a19-a365-484c-80c7-baf90e7dd1aa/console.log" append="off"/>
Nov 13 18:55:40 user nova-compute[75216]:     </serial>
Nov 13 18:55:40 user nova-compute[75216]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 18:55:40 user nova-compute[75216]:     <video>
Nov 13 18:55:40 user nova-compute[75216]:       <model type="virtio"/>
Nov 13 18:55:40 user nova-compute[75216]:     </video>
Nov 13 18:55:40 user nova-compute[75216]:     <rng model="virtio">
Nov 13 18:55:40 user nova-compute[75216]:       <backend model="random">/dev/urandom</backend>
Nov 13 18:55:40 user nova-compute[75216]:     </rng>
Nov 13 18:55:40 user nova-compute[75216]:     <controller type="usb" index="0" model="none"/>
Nov 13 18:55:40 user nova-compute[75216]:     <memballoon model="virtio">
Nov 13 18:55:40 user nova-compute[75216]:       <stats period="10"/>
Nov 13 18:55:40 user nova-compute[75216]:     </memballoon>
Nov 13 18:55:40 user nova-compute[75216]:   </devices>
Nov 13 18:55:40 user nova-compute[75216]: </domain>
Nov 13 18:55:40 user nova-compute[75216]:  {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 18:55:40 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-5644284d-5f6c-4b74-b632-ab09f913e009 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T18:49:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2138583247',display_name='tempest-ServerActionsTestOtherB-server-2138583247',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2138583247',id=18,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAl4rrs8AsTXVVWOe2ej9Q0PBsZfl4SiBx6Z+7YBp2Q8nhbMLqhEEYWYCrwvKHOa1CVoqmRod9jN0d8asOX7OMqzQqSN/edxVDFYygCGcMd2W6HT1YDz1w3rZ0s5A43lWg==',key_name='tempest-keypair-1520178236',keypairs=<?>,launch_index=0,launched_at=2023-11-13T18:54:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='0194e3c88e2b49c5ba9b9844f6048ea9',ramdisk_id='',reservation_id='r-z6obctyl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1164011898',owner_user_name='tempest-ServerActionsTestOtherB-1164011898-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T18:55:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0543920a35a54c83bcc159b7a2b08a80',uuid=91ea8a19-a365-484c-80c7-baf90e7dd1aa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "2cfb645f-7bee-4657-b0d8-afcaa0298ac9", "address": "fa:16:3e:3e:1d:91", "network": {"id": "a9670fc3-8a8e-4a2b-a39f-d41042d3443d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1394481632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0194e3c88e2b49c5ba9b9844f6048ea9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cfb645f-7b", "ovs_interfaceid": "2cfb645f-7bee-4657-b0d8-afcaa0298ac9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 18:55:40 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-5644284d-5f6c-4b74-b632-ab09f913e009 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Converting VIF {"id": "2cfb645f-7bee-4657-b0d8-afcaa0298ac9", "address": "fa:16:3e:3e:1d:91", "network": {"id": "a9670fc3-8a8e-4a2b-a39f-d41042d3443d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1394481632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0194e3c88e2b49c5ba9b9844f6048ea9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cfb645f-7b", "ovs_interfaceid": "2cfb645f-7bee-4657-b0d8-afcaa0298ac9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 18:55:40 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-5644284d-5f6c-4b74-b632-ab09f913e009 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:1d:91,bridge_name='br-int',has_traffic_filtering=True,id=2cfb645f-7bee-4657-b0d8-afcaa0298ac9,network=Network(a9670fc3-8a8e-4a2b-a39f-d41042d3443d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cfb645f-7b') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 18:55:40 user nova-compute[75216]: DEBUG os_vif [None req-5644284d-5f6c-4b74-b632-ab09f913e009 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:1d:91,bridge_name='br-int',has_traffic_filtering=True,id=2cfb645f-7bee-4657-b0d8-afcaa0298ac9,network=Network(a9670fc3-8a8e-4a2b-a39f-d41042d3443d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cfb645f-7b') {{(pid=75216) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 18:55:40 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:55:40 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:55:40 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 18:55:40 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:55:40 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a4a5ac32-dbb0-5d2e-8045-b9124a42aeca', '_type': 'linux-noop'}}, row=False) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:55:40 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:55:40 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:55:40 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:55:40 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:55:40 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2cfb645f-7b, may_exist=True, interface_attrs={}) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:55:40 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2cfb645f-7b, col_values=(('qos', UUID('ebd02f98-c0ed-41c9-be1d-60a7f6ca1d63')),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:55:40 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2cfb645f-7b, col_values=(('external_ids', {'iface-id': '2cfb645f-7bee-4657-b0d8-afcaa0298ac9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3e:1d:91', 'vm-uuid': '91ea8a19-a365-484c-80c7-baf90e7dd1aa'}),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:55:40 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:55:40 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:55:40 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:55:40 user nova-compute[75216]: INFO os_vif [None req-5644284d-5f6c-4b74-b632-ab09f913e009 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:1d:91,bridge_name='br-int',has_traffic_filtering=True,id=2cfb645f-7bee-4657-b0d8-afcaa0298ac9,network=Network(a9670fc3-8a8e-4a2b-a39f-d41042d3443d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cfb645f-7b')
Nov 13 18:55:40 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:55:40 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:55:40 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:55:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:55:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:55:41 user nova-compute[75216]: DEBUG nova.compute.manager [req-6a4df584-522f-46f0-a677-5e18a8a91b55 req-65ac43ff-f9e9-418a-9d91-08099e282015 service nova] [instance: 1e5f1164-a15e-40cf-b7bc-5aeb404a1216] Received event network-vif-plugged-96dfdc95-6a8e-43f3-8d7c-5b4f78a8f134 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:55:41 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-6a4df584-522f-46f0-a677-5e18a8a91b55 req-65ac43ff-f9e9-418a-9d91-08099e282015 service nova] Acquiring lock "1e5f1164-a15e-40cf-b7bc-5aeb404a1216-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:55:41 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-6a4df584-522f-46f0-a677-5e18a8a91b55 req-65ac43ff-f9e9-418a-9d91-08099e282015 service nova] Lock "1e5f1164-a15e-40cf-b7bc-5aeb404a1216-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:55:41 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-6a4df584-522f-46f0-a677-5e18a8a91b55 req-65ac43ff-f9e9-418a-9d91-08099e282015 service nova] Lock "1e5f1164-a15e-40cf-b7bc-5aeb404a1216-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:55:41 user nova-compute[75216]: DEBUG nova.compute.manager [req-6a4df584-522f-46f0-a677-5e18a8a91b55 req-65ac43ff-f9e9-418a-9d91-08099e282015 service nova] [instance: 1e5f1164-a15e-40cf-b7bc-5aeb404a1216] No waiting events found dispatching network-vif-plugged-96dfdc95-6a8e-43f3-8d7c-5b4f78a8f134 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:55:41 user nova-compute[75216]: WARNING nova.compute.manager [req-6a4df584-522f-46f0-a677-5e18a8a91b55 req-65ac43ff-f9e9-418a-9d91-08099e282015 service nova] [instance: 1e5f1164-a15e-40cf-b7bc-5aeb404a1216] Received unexpected event network-vif-plugged-96dfdc95-6a8e-43f3-8d7c-5b4f78a8f134 for instance with vm_state building and task_state spawning.
Nov 13 18:55:41 user nova-compute[75216]: DEBUG nova.compute.manager [req-7d3f3645-47bb-439f-9a1a-aeac4bc24840 req-2306f226-94f4-41f7-a9b9-f6fd21131b7e service nova] [instance: ded8f476-cf44-4c5e-8f6b-f36a9ee9a78b] Received event network-vif-plugged-88b781a1-8dbb-455d-b138-79f2568d050a {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:55:41 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-7d3f3645-47bb-439f-9a1a-aeac4bc24840 req-2306f226-94f4-41f7-a9b9-f6fd21131b7e service nova] Acquiring lock "ded8f476-cf44-4c5e-8f6b-f36a9ee9a78b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:55:41 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-7d3f3645-47bb-439f-9a1a-aeac4bc24840 req-2306f226-94f4-41f7-a9b9-f6fd21131b7e service nova] Lock "ded8f476-cf44-4c5e-8f6b-f36a9ee9a78b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:55:41 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-7d3f3645-47bb-439f-9a1a-aeac4bc24840 req-2306f226-94f4-41f7-a9b9-f6fd21131b7e service nova] Lock "ded8f476-cf44-4c5e-8f6b-f36a9ee9a78b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:55:41 user nova-compute[75216]: DEBUG nova.compute.manager [req-7d3f3645-47bb-439f-9a1a-aeac4bc24840 req-2306f226-94f4-41f7-a9b9-f6fd21131b7e service nova] [instance: ded8f476-cf44-4c5e-8f6b-f36a9ee9a78b] No waiting events found dispatching network-vif-plugged-88b781a1-8dbb-455d-b138-79f2568d050a {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:55:41 user nova-compute[75216]: WARNING nova.compute.manager [req-7d3f3645-47bb-439f-9a1a-aeac4bc24840 req-2306f226-94f4-41f7-a9b9-f6fd21131b7e service nova] [instance: ded8f476-cf44-4c5e-8f6b-f36a9ee9a78b] Received unexpected event network-vif-plugged-88b781a1-8dbb-455d-b138-79f2568d050a for instance with vm_state deleted and task_state None.
Nov 13 18:55:41 user nova-compute[75216]: DEBUG nova.compute.manager [req-7d3f3645-47bb-439f-9a1a-aeac4bc24840 req-2306f226-94f4-41f7-a9b9-f6fd21131b7e service nova] [instance: ded8f476-cf44-4c5e-8f6b-f36a9ee9a78b] Received event network-vif-deleted-88b781a1-8dbb-455d-b138-79f2568d050a {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:55:41 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-07400e27-b49b-4e28-9b1a-26c9567bd9fe tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Acquiring lock "3f08c061-312d-42d3-a811-e98ace4e7a63" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:55:41 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-07400e27-b49b-4e28-9b1a-26c9567bd9fe tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Lock "3f08c061-312d-42d3-a811-e98ace4e7a63" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:55:41 user nova-compute[75216]: DEBUG nova.objects.instance [None req-07400e27-b49b-4e28-9b1a-26c9567bd9fe tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Lazy-loading 'flavor' on Instance uuid 3f08c061-312d-42d3-a811-e98ace4e7a63 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 18:55:41 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-07400e27-b49b-4e28-9b1a-26c9567bd9fe tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Lock "3f08c061-312d-42d3-a811-e98ace4e7a63" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:55:42 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-07400e27-b49b-4e28-9b1a-26c9567bd9fe tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Acquiring lock "3f08c061-312d-42d3-a811-e98ace4e7a63" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:55:42 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-07400e27-b49b-4e28-9b1a-26c9567bd9fe tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Lock "3f08c061-312d-42d3-a811-e98ace4e7a63" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:55:42 user nova-compute[75216]: INFO nova.compute.manager [None req-07400e27-b49b-4e28-9b1a-26c9567bd9fe tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] [instance: 3f08c061-312d-42d3-a811-e98ace4e7a63] Attaching volume 671f1985-7823-411f-b273-6a6930de84e1 to /dev/vdb
Nov 13 18:55:42 user nova-compute[75216]: DEBUG os_brick.utils [None req-07400e27-b49b-4e28-9b1a-26c9567bd9fe tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 18:55:42 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:55:42 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:55:42 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[74a28f75-14c8-444a-8547-a974622d1ac4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aea6fcfe14b9\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:55:42 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:55:42 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:55:42 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0e01372-3537-4327-b663-deeff47fc53a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:55:42 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:55:42 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:55:42 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[7311c642-d0c4-48b1-91b1-e61a65c3c5d7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:55:42 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[db83aeca-f000-4e5a-bfb7-bf7c6e01015c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:55:42 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-07400e27-b49b-4e28-9b1a-26c9567bd9fe tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Running cmd (subprocess): nvme version {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:55:42 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-07400e27-b49b-4e28-9b1a-26c9567bd9fe tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] 'nvme version' failed. Not Retrying. {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 18:55:42 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.nvmeof [None req-07400e27-b49b-4e28-9b1a-26c9567bd9fe tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] nvme not present on system {{(pid=75216) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 18:55:42 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:55:42 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 18:55:42 user nova-compute[75216]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 18:55:42 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a6eea6f-99ed-41f2-affc-aa2bb1cf97cc]: (4, '') {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:55:42 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-07400e27-b49b-4e28-9b1a-26c9567bd9fe tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75216) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 18:55:42 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-07400e27-b49b-4e28-9b1a-26c9567bd9fe tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 18:55:42 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-07400e27-b49b-4e28-9b1a-26c9567bd9fe tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] LIGHTOS: no hostnqn found. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 18:55:42 user nova-compute[75216]: DEBUG os_brick.utils [None req-07400e27-b49b-4e28-9b1a-26c9567bd9fe tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] <== get_connector_properties: return (110ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aea6fcfe14b9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 18:55:42 user nova-compute[75216]: DEBUG nova.virt.block_device [None req-07400e27-b49b-4e28-9b1a-26c9567bd9fe tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] [instance: 3f08c061-312d-42d3-a811-e98ace4e7a63] Updating existing volume attachment record: 593555e6-a46d-4f3e-9fdc-7483a18e67a9 {{(pid=75216) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 18:55:42 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:55:42 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:55:42 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:55:43 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:55:43 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:55:43 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:55:43 user nova-compute[75216]: DEBUG nova.compute.manager [req-c712b291-6b51-44fd-bdc4-13d215010d3e req-666640ac-071d-4c9f-8ffe-14200e1ffa15 service nova] [instance: 1e5f1164-a15e-40cf-b7bc-5aeb404a1216] Received event network-vif-plugged-96dfdc95-6a8e-43f3-8d7c-5b4f78a8f134 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:55:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-c712b291-6b51-44fd-bdc4-13d215010d3e req-666640ac-071d-4c9f-8ffe-14200e1ffa15 service nova] Acquiring lock "1e5f1164-a15e-40cf-b7bc-5aeb404a1216-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:55:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-c712b291-6b51-44fd-bdc4-13d215010d3e req-666640ac-071d-4c9f-8ffe-14200e1ffa15 service nova] Lock "1e5f1164-a15e-40cf-b7bc-5aeb404a1216-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:55:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-c712b291-6b51-44fd-bdc4-13d215010d3e req-666640ac-071d-4c9f-8ffe-14200e1ffa15 service nova] Lock "1e5f1164-a15e-40cf-b7bc-5aeb404a1216-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:55:43 user nova-compute[75216]: DEBUG nova.compute.manager [req-c712b291-6b51-44fd-bdc4-13d215010d3e req-666640ac-071d-4c9f-8ffe-14200e1ffa15 service nova] [instance: 1e5f1164-a15e-40cf-b7bc-5aeb404a1216] No waiting events found dispatching network-vif-plugged-96dfdc95-6a8e-43f3-8d7c-5b4f78a8f134 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:55:43 user nova-compute[75216]: WARNING nova.compute.manager [req-c712b291-6b51-44fd-bdc4-13d215010d3e req-666640ac-071d-4c9f-8ffe-14200e1ffa15 service nova] [instance: 1e5f1164-a15e-40cf-b7bc-5aeb404a1216] Received unexpected event network-vif-plugged-96dfdc95-6a8e-43f3-8d7c-5b4f78a8f134 for instance with vm_state building and task_state spawning.
Nov 13 18:55:43 user nova-compute[75216]: DEBUG nova.compute.manager [req-fc03fd6c-8843-4fc5-a644-613227c7cf1f req-77eb8650-bfbe-43e7-bc78-bfc75b453cdf service nova] [instance: 91ea8a19-a365-484c-80c7-baf90e7dd1aa] Received event network-vif-plugged-2cfb645f-7bee-4657-b0d8-afcaa0298ac9 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:55:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-fc03fd6c-8843-4fc5-a644-613227c7cf1f req-77eb8650-bfbe-43e7-bc78-bfc75b453cdf service nova] Acquiring lock "91ea8a19-a365-484c-80c7-baf90e7dd1aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:55:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-fc03fd6c-8843-4fc5-a644-613227c7cf1f req-77eb8650-bfbe-43e7-bc78-bfc75b453cdf service nova] Lock "91ea8a19-a365-484c-80c7-baf90e7dd1aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:55:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-fc03fd6c-8843-4fc5-a644-613227c7cf1f req-77eb8650-bfbe-43e7-bc78-bfc75b453cdf service nova] Lock "91ea8a19-a365-484c-80c7-baf90e7dd1aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:55:43 user nova-compute[75216]: DEBUG nova.compute.manager [req-fc03fd6c-8843-4fc5-a644-613227c7cf1f req-77eb8650-bfbe-43e7-bc78-bfc75b453cdf service nova] [instance: 91ea8a19-a365-484c-80c7-baf90e7dd1aa] No waiting events found dispatching network-vif-plugged-2cfb645f-7bee-4657-b0d8-afcaa0298ac9 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:55:43 user nova-compute[75216]: WARNING nova.compute.manager [req-fc03fd6c-8843-4fc5-a644-613227c7cf1f req-77eb8650-bfbe-43e7-bc78-bfc75b453cdf service nova] [instance: 91ea8a19-a365-484c-80c7-baf90e7dd1aa] Received unexpected event network-vif-plugged-2cfb645f-7bee-4657-b0d8-afcaa0298ac9 for instance with vm_state resized and task_state resize_reverting.
Nov 13 18:55:43 user nova-compute[75216]: DEBUG nova.compute.manager [req-fc03fd6c-8843-4fc5-a644-613227c7cf1f req-77eb8650-bfbe-43e7-bc78-bfc75b453cdf service nova] [instance: 91ea8a19-a365-484c-80c7-baf90e7dd1aa] Received event network-vif-plugged-2cfb645f-7bee-4657-b0d8-afcaa0298ac9 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:55:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-fc03fd6c-8843-4fc5-a644-613227c7cf1f req-77eb8650-bfbe-43e7-bc78-bfc75b453cdf service nova] Acquiring lock "91ea8a19-a365-484c-80c7-baf90e7dd1aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:55:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-fc03fd6c-8843-4fc5-a644-613227c7cf1f req-77eb8650-bfbe-43e7-bc78-bfc75b453cdf service nova] Lock "91ea8a19-a365-484c-80c7-baf90e7dd1aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:55:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-fc03fd6c-8843-4fc5-a644-613227c7cf1f req-77eb8650-bfbe-43e7-bc78-bfc75b453cdf service nova] Lock "91ea8a19-a365-484c-80c7-baf90e7dd1aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:55:43 user nova-compute[75216]: DEBUG nova.compute.manager [req-fc03fd6c-8843-4fc5-a644-613227c7cf1f req-77eb8650-bfbe-43e7-bc78-bfc75b453cdf service nova] [instance: 91ea8a19-a365-484c-80c7-baf90e7dd1aa] No waiting events found dispatching network-vif-plugged-2cfb645f-7bee-4657-b0d8-afcaa0298ac9 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:55:43 user nova-compute[75216]: WARNING nova.compute.manager [req-fc03fd6c-8843-4fc5-a644-613227c7cf1f req-77eb8650-bfbe-43e7-bc78-bfc75b453cdf service nova] [instance: 91ea8a19-a365-484c-80c7-baf90e7dd1aa] Received unexpected event network-vif-plugged-2cfb645f-7bee-4657-b0d8-afcaa0298ac9 for instance with vm_state resized and task_state resize_reverting.
Nov 13 18:55:43 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:55:44 user nova-compute[75216]: DEBUG nova.compute.manager [None req-7fd27229-42ed-457f-a18d-fd21c387d34d tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: 1e5f1164-a15e-40cf-b7bc-5aeb404a1216] Instance event wait completed in 0 seconds for  {{(pid=75216) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 18:55:44 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-7fd27229-42ed-457f-a18d-fd21c387d34d tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: 1e5f1164-a15e-40cf-b7bc-5aeb404a1216] Guest created on hypervisor {{(pid=75216) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 18:55:44 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 1e5f1164-a15e-40cf-b7bc-5aeb404a1216] Instance spawned successfully.
Nov 13 18:55:44 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-7fd27229-42ed-457f-a18d-fd21c387d34d tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: 1e5f1164-a15e-40cf-b7bc-5aeb404a1216] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 18:55:44 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-7fd27229-42ed-457f-a18d-fd21c387d34d tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: 1e5f1164-a15e-40cf-b7bc-5aeb404a1216] Found default for hw_cdrom_bus of ide {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 18:55:44 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-7fd27229-42ed-457f-a18d-fd21c387d34d tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: 1e5f1164-a15e-40cf-b7bc-5aeb404a1216] Found default for hw_disk_bus of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 18:55:44 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-7fd27229-42ed-457f-a18d-fd21c387d34d tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: 1e5f1164-a15e-40cf-b7bc-5aeb404a1216] Found default for hw_input_bus of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 18:55:44 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-7fd27229-42ed-457f-a18d-fd21c387d34d tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: 1e5f1164-a15e-40cf-b7bc-5aeb404a1216] Found default for hw_pointer_model of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 18:55:44 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-7fd27229-42ed-457f-a18d-fd21c387d34d tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: 1e5f1164-a15e-40cf-b7bc-5aeb404a1216] Found default for hw_video_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 18:55:44 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-7fd27229-42ed-457f-a18d-fd21c387d34d tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: 1e5f1164-a15e-40cf-b7bc-5aeb404a1216] Found default for hw_vif_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 18:55:44 user nova-compute[75216]: INFO nova.compute.manager [None req-7fd27229-42ed-457f-a18d-fd21c387d34d tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: 1e5f1164-a15e-40cf-b7bc-5aeb404a1216] Took 6.16 seconds to spawn the instance on the hypervisor.
Nov 13 18:55:44 user nova-compute[75216]: DEBUG nova.compute.manager [None req-7fd27229-42ed-457f-a18d-fd21c387d34d tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: 1e5f1164-a15e-40cf-b7bc-5aeb404a1216] Checking state {{(pid=75216) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 18:55:44 user nova-compute[75216]: INFO nova.compute.manager [None req-7fd27229-42ed-457f-a18d-fd21c387d34d tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: 1e5f1164-a15e-40cf-b7bc-5aeb404a1216] Took 16.64 seconds to build instance.
Nov 13 18:55:44 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-7fd27229-42ed-457f-a18d-fd21c387d34d tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Lock "1e5f1164-a15e-40cf-b7bc-5aeb404a1216" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.737s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:55:44 user nova-compute[75216]: DEBUG nova.compute.manager [None req-5644284d-5f6c-4b74-b632-ab09f913e009 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] [instance: 91ea8a19-a365-484c-80c7-baf90e7dd1aa] Instance event wait completed in 0 seconds for  {{(pid=75216) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 18:55:44 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 91ea8a19-a365-484c-80c7-baf90e7dd1aa] Instance running successfully.
Nov 13 18:55:44 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-5644284d-5f6c-4b74-b632-ab09f913e009 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] [instance: 91ea8a19-a365-484c-80c7-baf90e7dd1aa] finish_revert_migration finished successfully. {{(pid=75216) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Nov 13 18:55:44 user nova-compute[75216]: INFO nova.compute.manager [None req-5644284d-5f6c-4b74-b632-ab09f913e009 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] [instance: 91ea8a19-a365-484c-80c7-baf90e7dd1aa] Updating instance to original state: 'active'
Nov 13 18:55:45 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:55:46 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-07400e27-b49b-4e28-9b1a-26c9567bd9fe tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] [instance: 3f08c061-312d-42d3-a811-e98ace4e7a63] Calling os-brick to attach iSCSI Volume {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 18:55:46 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-07400e27-b49b-4e28-9b1a-26c9567bd9fe tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3a8669e40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:671f1985-7823-411f-b273-6a6930de84e1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jrOCibMl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 18:55:46 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-07400e27-b49b-4e28-9b1a-26c9567bd9fe tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 18:55:46 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-07400e27-b49b-4e28-9b1a-26c9567bd9fe tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 18:55:46 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-07400e27-b49b-4e28-9b1a-26c9567bd9fe tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 18:55:46 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-07400e27-b49b-4e28-9b1a-26c9567bd9fe tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 18:55:46 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-07400e27-b49b-4e28-9b1a-26c9567bd9fe tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:671f1985-7823-411f-b273-6a6930de84e1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 18:55:46 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-07400e27-b49b-4e28-9b1a-26c9567bd9fe tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:671f1985-7823-411f-b273-6a6930de84e1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 18:55:46 user nova-compute[75216]: INFO os_brick.initiator.connectors.iscsi [None req-07400e27-b49b-4e28-9b1a-26c9567bd9fe tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 18:55:46 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:671f1985-7823-411f-b273-6a6930de84e1 -p 172.16.0.220:3260 {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:55:46 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:671f1985-7823-411f-b273-6a6930de84e1 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:55:46 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[88e19646-4cd0-4b03-9df1-83e2db054132]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:55:46 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-07400e27-b49b-4e28-9b1a-26c9567bd9fe tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 18:55:46 user nova-compute[75216]:  {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:55:46 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:671f1985-7823-411f-b273-6a6930de84e1 -p 172.16.0.220:3260 --interface default --op new {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:55:46 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:671f1985-7823-411f-b273-6a6930de84e1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:55:46 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[381d1e1f-67dc-4e38-9fe9-8f47a78fb3e9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:671f1985-7823-411f-b273-6a6930de84e1] added\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:55:46 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-07400e27-b49b-4e28-9b1a-26c9567bd9fe tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:671f1985-7823-411f-b273-6a6930de84e1] added
Nov 13 18:55:46 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:55:46 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:671f1985-7823-411f-b273-6a6930de84e1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:55:46 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:671f1985-7823-411f-b273-6a6930de84e1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:55:46 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[42fcf574-debb-47bd-9ba3-47cd4647c735]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:55:46 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-07400e27-b49b-4e28-9b1a-26c9567bd9fe tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:55:46 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:671f1985-7823-411f-b273-6a6930de84e1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:55:46 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:671f1985-7823-411f-b273-6a6930de84e1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:55:46 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[52e6f747-0fd9-4eef-a2bf-15c85a6e0a82]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:55:46 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-07400e27-b49b-4e28-9b1a-26c9567bd9fe tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:55:46 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:671f1985-7823-411f-b273-6a6930de84e1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jrOCibMl {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:55:46 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:671f1985-7823-411f-b273-6a6930de84e1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jrOCibMl" returned: 0 in 0.021s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:55:46 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ee7eb83-e2f3-4766-b3f3-d3bf77bf027c]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:55:46 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-07400e27-b49b-4e28-9b1a-26c9567bd9fe tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jrOCibMl'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:55:46 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:671f1985-7823-411f-b273-6a6930de84e1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:55:46 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:671f1985-7823-411f-b273-6a6930de84e1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:55:46 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d8c5199-d1f7-43a3-8bf3-2d553e06af34]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:55:46 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-07400e27-b49b-4e28-9b1a-26c9567bd9fe tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:55:46 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:55:46 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:55:46 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[78cf1dc5-cfce-494b-9124-0d3bd67d31a8]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ee38de6-1fa4-460d-9bb4-49720104365b (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d (non-flash)\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:55:46 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-07400e27-b49b-4e28-9b1a-26c9567bd9fe tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ee38de6-1fa4-460d-9bb4-49720104365b (non-flash)
Nov 13 18:55:46 user nova-compute[75216]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1 (non-flash)
Nov 13 18:55:46 user nova-compute[75216]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d (non-flash)
Nov 13 18:55:46 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 18:55:46 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-07400e27-b49b-4e28-9b1a-26c9567bd9fe tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ee38de6-1fa4-460d-9bb4-49720104365b (non-flash)
Nov 13 18:55:46 user nova-compute[75216]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1 (non-flash)
Nov 13 18:55:46 user nova-compute[75216]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d (non-flash)
Nov 13 18:55:46 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 18:55:46 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:671f1985-7823-411f-b273-6a6930de84e1 -p 172.16.0.220:3260 --login {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:55:46 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:671f1985-7823-411f-b273-6a6930de84e1 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:55:46 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[224e07e0-8539-477b-8ec8-11692a7b9abf]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:671f1985-7823-411f-b273-6a6930de84e1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:671f1985-7823-411f-b273-6a6930de84e1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:55:46 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-07400e27-b49b-4e28-9b1a-26c9567bd9fe tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:671f1985-7823-411f-b273-6a6930de84e1, portal: 172.16.0.220,3260]
Nov 13 18:55:46 user nova-compute[75216]: Login to [iface: default, target: iqn.2010-10.org.openstack:671f1985-7823-411f-b273-6a6930de84e1, portal: 172.16.0.220,3260] successful.
Nov 13 18:55:46 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:55:46 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:671f1985-7823-411f-b273-6a6930de84e1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:55:46 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:671f1985-7823-411f-b273-6a6930de84e1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:55:46 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[241101e2-92b7-40e4-b23e-60047dd9a85a]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:55:46 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-07400e27-b49b-4e28-9b1a-26c9567bd9fe tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:55:46 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:55:46 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:55:46 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[0633c52b-9904-4e48-ac3b-a477066bf54e]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ee38de6-1fa4-460d-9bb4-49720104365b (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:671f1985-7823-411f-b273-6a6930de84e1 (non-flash)\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:55:46 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-07400e27-b49b-4e28-9b1a-26c9567bd9fe tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ee38de6-1fa4-460d-9bb4-49720104365b (non-flash)
Nov 13 18:55:46 user nova-compute[75216]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1 (non-flash)
Nov 13 18:55:46 user nova-compute[75216]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d (non-flash)
Nov 13 18:55:46 user nova-compute[75216]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:671f1985-7823-411f-b273-6a6930de84e1 (non-flash)
Nov 13 18:55:46 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 18:55:46 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-07400e27-b49b-4e28-9b1a-26c9567bd9fe tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ee38de6-1fa4-460d-9bb4-49720104365b (non-flash)
Nov 13 18:55:46 user nova-compute[75216]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1 (non-flash)
Nov 13 18:55:46 user nova-compute[75216]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d (non-flash)
Nov 13 18:55:46 user nova-compute[75216]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:671f1985-7823-411f-b273-6a6930de84e1 (non-flash)
Nov 13 18:55:46 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 18:55:46 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-07400e27-b49b-4e28-9b1a-26c9567bd9fe tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:671f1985-7823-411f-b273-6a6930de84e1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.284s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 18:55:46 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-07400e27-b49b-4e28-9b1a-26c9567bd9fe tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Connected to 172.16.0.220:3260 {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 18:55:46 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-07400e27-b49b-4e28-9b1a-26c9567bd9fe tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] HCTL ('36', '-', '-', 0) found on session 32 with lun 0 {{(pid=75216) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 18:55:46 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-07400e27-b49b-4e28-9b1a-26c9567bd9fe tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75216) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 18:55:46 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:55:46 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.020s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:55:46 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[53d2f07f-2b2f-4633-9e56-b1ca9d80abb4]: (4, ('- - 0', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:55:46 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-07400e27-b49b-4e28-9b1a-26c9567bd9fe tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Searching for a device in session 32 and hctl ['36', '*', '*', 0] yield: None {{(pid=75216) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 18:55:47 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:55:47 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-07400e27-b49b-4e28-9b1a-26c9567bd9fe tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Searching for a device in session 32 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75216) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 18:55:47 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-07400e27-b49b-4e28-9b1a-26c9567bd9fe tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:671f1985-7823-411f-b273-6a6930de84e1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jrOCibMl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 18:55:47 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-07400e27-b49b-4e28-9b1a-26c9567bd9fe tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.317s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 18:55:47 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-07400e27-b49b-4e28-9b1a-26c9567bd9fe tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] <== connect_volume: return (1318ms) {'type': 'block', 'scsi_wwn': '23062363832333665', 'path': '/dev/sde'} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 18:55:47 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-07400e27-b49b-4e28-9b1a-26c9567bd9fe tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] [instance: 3f08c061-312d-42d3-a811-e98ace4e7a63] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23062363832333665', 'path': '/dev/sde'} {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 18:55:47 user nova-compute[75216]: DEBUG nova.objects.instance [None req-07400e27-b49b-4e28-9b1a-26c9567bd9fe tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Lazy-loading 'flavor' on Instance uuid 3f08c061-312d-42d3-a811-e98ace4e7a63 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 18:55:47 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-07400e27-b49b-4e28-9b1a-26c9567bd9fe tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] attach device xml: <disk type="block" device="disk">
Nov 13 18:55:47 user nova-compute[75216]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 18:55:47 user nova-compute[75216]:   <source dev="/dev/sde"/>
Nov 13 18:55:47 user nova-compute[75216]:   <target dev="vdb" bus="virtio"/>
Nov 13 18:55:47 user nova-compute[75216]:   <serial>671f1985-7823-411f-b273-6a6930de84e1</serial>
Nov 13 18:55:47 user nova-compute[75216]: </disk>
Nov 13 18:55:47 user nova-compute[75216]:  {{(pid=75216) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 13 18:55:48 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-07400e27-b49b-4e28-9b1a-26c9567bd9fe tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 18:55:48 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-07400e27-b49b-4e28-9b1a-26c9567bd9fe tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 18:55:48 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-07400e27-b49b-4e28-9b1a-26c9567bd9fe tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] No VIF found with MAC fa:16:3e:3a:7e:d6, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 18:55:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-07400e27-b49b-4e28-9b1a-26c9567bd9fe tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Lock "3f08c061-312d-42d3-a811-e98ace4e7a63" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.280s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:55:48 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:55:48 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:55:49 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:55:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:55:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:55:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:55:49 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Auditing locally available compute resources for user (node: user) {{(pid=75216) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 18:55:49 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 18:55:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a3e849-6570-4820-97c8-75468b5bea4f/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:55:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a3e849-6570-4820-97c8-75468b5bea4f/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:55:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a3e849-6570-4820-97c8-75468b5bea4f/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:55:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a3e849-6570-4820-97c8-75468b5bea4f/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:55:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9a1edfb-c2ac-4e67-abac-c915ea22a15c/disk.rescue --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:55:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9a1edfb-c2ac-4e67-abac-c915ea22a15c/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:55:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9a1edfb-c2ac-4e67-abac-c915ea22a15c/disk.rescue --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:55:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9a1edfb-c2ac-4e67-abac-c915ea22a15c/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:55:50 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] skipping disk /opt/stack/data/nova/instances/d9a1edfb-c2ac-4e67-abac-c915ea22a15c/disk (vdb) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 18:55:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14d378b0-79ba-4161-a795-6288939c6fef/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:55:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14d378b0-79ba-4161-a795-6288939c6fef/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:55:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14d378b0-79ba-4161-a795-6288939c6fef/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:55:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14d378b0-79ba-4161-a795-6288939c6fef/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:55:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91ea8a19-a365-484c-80c7-baf90e7dd1aa/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:55:50 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:55:50 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:55:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91ea8a19-a365-484c-80c7-baf90e7dd1aa/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:55:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91ea8a19-a365-484c-80c7-baf90e7dd1aa/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:55:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91ea8a19-a365-484c-80c7-baf90e7dd1aa/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:55:51 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 18:55:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d589d57e-de50-482a-843f-e8246b3d7528/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:55:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d589d57e-de50-482a-843f-e8246b3d7528/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:55:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d589d57e-de50-482a-843f-e8246b3d7528/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:55:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d589d57e-de50-482a-843f-e8246b3d7528/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:55:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:55:51 user nova-compute[75216]: DEBUG nova.compute.manager [req-f1084cd6-a00d-4052-8215-d9549c26898c req-6b541b42-7923-41de-90f7-c29b6ecec3be service nova] [instance: 3f08c061-312d-42d3-a811-e98ace4e7a63] Received event network-changed-225eb5bf-3c60-42f6-9bf7-e045ccda1213 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:55:51 user nova-compute[75216]: DEBUG nova.compute.manager [req-f1084cd6-a00d-4052-8215-d9549c26898c req-6b541b42-7923-41de-90f7-c29b6ecec3be service nova] [instance: 3f08c061-312d-42d3-a811-e98ace4e7a63] Refreshing instance network info cache due to event network-changed-225eb5bf-3c60-42f6-9bf7-e045ccda1213. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 18:55:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-f1084cd6-a00d-4052-8215-d9549c26898c req-6b541b42-7923-41de-90f7-c29b6ecec3be service nova] Acquiring lock "refresh_cache-3f08c061-312d-42d3-a811-e98ace4e7a63" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 18:55:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-f1084cd6-a00d-4052-8215-d9549c26898c req-6b541b42-7923-41de-90f7-c29b6ecec3be service nova] Acquired lock "refresh_cache-3f08c061-312d-42d3-a811-e98ace4e7a63" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 18:55:51 user nova-compute[75216]: DEBUG nova.network.neutron [req-f1084cd6-a00d-4052-8215-d9549c26898c req-6b541b42-7923-41de-90f7-c29b6ecec3be service nova] [instance: 3f08c061-312d-42d3-a811-e98ace4e7a63] Refreshing network info cache for port 225eb5bf-3c60-42f6-9bf7-e045ccda1213 {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 18:55:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:55:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:55:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:55:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85624c58-6c72-4490-8a3e-547953295ade/disk.rescue --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:55:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85624c58-6c72-4490-8a3e-547953295ade/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:55:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85624c58-6c72-4490-8a3e-547953295ade/disk.rescue --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:55:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85624c58-6c72-4490-8a3e-547953295ade/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:55:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85624c58-6c72-4490-8a3e-547953295ade/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:55:52 user nova-compute[75216]: DEBUG nova.network.neutron [req-f1084cd6-a00d-4052-8215-d9549c26898c req-6b541b42-7923-41de-90f7-c29b6ecec3be service nova] [instance: 3f08c061-312d-42d3-a811-e98ace4e7a63] Updated VIF entry in instance network info cache for port 225eb5bf-3c60-42f6-9bf7-e045ccda1213. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 18:55:52 user nova-compute[75216]: DEBUG nova.network.neutron [req-f1084cd6-a00d-4052-8215-d9549c26898c req-6b541b42-7923-41de-90f7-c29b6ecec3be service nova] [instance: 3f08c061-312d-42d3-a811-e98ace4e7a63] Updating instance_info_cache with network_info: [{"id": "225eb5bf-3c60-42f6-9bf7-e045ccda1213", "address": "fa:16:3e:3a:7e:d6", "network": {"id": "fea11c73-0074-4971-8b36-0aced430c730", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1420832282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84d0223a97ff4ecab9bf4273e3e465a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap225eb5bf-3c", "ovs_interfaceid": "225eb5bf-3c60-42f6-9bf7-e045ccda1213", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 18:55:52 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-f1084cd6-a00d-4052-8215-d9549c26898c req-6b541b42-7923-41de-90f7-c29b6ecec3be service nova] Releasing lock "refresh_cache-3f08c061-312d-42d3-a811-e98ace4e7a63" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 18:55:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85624c58-6c72-4490-8a3e-547953295ade/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:55:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85624c58-6c72-4490-8a3e-547953295ade/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:55:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85624c58-6c72-4490-8a3e-547953295ade/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:55:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f08c061-312d-42d3-a811-e98ace4e7a63/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:55:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f08c061-312d-42d3-a811-e98ace4e7a63/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:55:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f08c061-312d-42d3-a811-e98ace4e7a63/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:55:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f08c061-312d-42d3-a811-e98ace4e7a63/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:55:52 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 18:55:53 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 18:55:53 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 18:55:53 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Hypervisor/Node resource view: name=user free_ram=8024MB free_disk=25.421756744384766GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75216) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 18:55:53 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:55:53 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:55:53 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:55:53 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance a1a3e849-6570-4820-97c8-75468b5bea4f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 18:55:53 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance d589d57e-de50-482a-843f-e8246b3d7528 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 18:55:53 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance 85624c58-6c72-4490-8a3e-547953295ade actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 18:55:53 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance 14d378b0-79ba-4161-a795-6288939c6fef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 18:55:53 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 18:55:53 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance d9a1edfb-c2ac-4e67-abac-c915ea22a15c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 18:55:53 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance 91ea8a19-a365-484c-80c7-baf90e7dd1aa actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 18:55:53 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance 3f08c061-312d-42d3-a811-e98ace4e7a63 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 18:55:53 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance 1e5f1164-a15e-40cf-b7bc-5aeb404a1216 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 18:55:53 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 18:55:53 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 18:55:53 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Refreshing inventories for resource provider d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 13 18:55:53 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Updating ProviderTree inventory for provider d927e00d-5a8b-43f7-ac04-6437958fac1f from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 13 18:55:53 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Updating inventory in ProviderTree for provider d927e00d-5a8b-43f7-ac04-6437958fac1f with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 13 18:55:53 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Refreshing aggregate associations for resource provider d927e00d-5a8b-43f7-ac04-6437958fac1f, aggregates: None {{(pid=75216) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 13 18:55:53 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Refreshing trait associations for resource provider d927e00d-5a8b-43f7-ac04-6437958fac1f, traits: COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_MMX {{(pid=75216) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 13 18:55:53 user nova-compute[75216]: DEBUG nova.compute.manager [req-00dea760-f0b1-4915-bdf2-6173bf03843a req-bb0d9a25-4531-48db-a210-ac98c7c7d122 service nova] [instance: 3f08c061-312d-42d3-a811-e98ace4e7a63] Received event network-changed-225eb5bf-3c60-42f6-9bf7-e045ccda1213 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:55:53 user nova-compute[75216]: DEBUG nova.compute.manager [req-00dea760-f0b1-4915-bdf2-6173bf03843a req-bb0d9a25-4531-48db-a210-ac98c7c7d122 service nova] [instance: 3f08c061-312d-42d3-a811-e98ace4e7a63] Refreshing instance network info cache due to event network-changed-225eb5bf-3c60-42f6-9bf7-e045ccda1213. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 18:55:53 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-00dea760-f0b1-4915-bdf2-6173bf03843a req-bb0d9a25-4531-48db-a210-ac98c7c7d122 service nova] Acquiring lock "refresh_cache-3f08c061-312d-42d3-a811-e98ace4e7a63" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 18:55:53 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-00dea760-f0b1-4915-bdf2-6173bf03843a req-bb0d9a25-4531-48db-a210-ac98c7c7d122 service nova] Acquired lock "refresh_cache-3f08c061-312d-42d3-a811-e98ace4e7a63" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 18:55:53 user nova-compute[75216]: DEBUG nova.network.neutron [req-00dea760-f0b1-4915-bdf2-6173bf03843a req-bb0d9a25-4531-48db-a210-ac98c7c7d122 service nova] [instance: 3f08c061-312d-42d3-a811-e98ace4e7a63] Refreshing network info cache for port 225eb5bf-3c60-42f6-9bf7-e045ccda1213 {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 18:55:54 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 18:55:54 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 18:55:54 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Compute_service record updated for user:user {{(pid=75216) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 18:55:54 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.642s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:55:54 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:55:54 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Cleaning up deleted instances {{(pid=75216) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 13 18:55:54 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] There are 0 instances to clean {{(pid=75216) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 13 18:55:54 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:55:54 user nova-compute[75216]: DEBUG nova.network.neutron [req-00dea760-f0b1-4915-bdf2-6173bf03843a req-bb0d9a25-4531-48db-a210-ac98c7c7d122 service nova] [instance: 3f08c061-312d-42d3-a811-e98ace4e7a63] Updated VIF entry in instance network info cache for port 225eb5bf-3c60-42f6-9bf7-e045ccda1213. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 18:55:54 user nova-compute[75216]: DEBUG nova.network.neutron [req-00dea760-f0b1-4915-bdf2-6173bf03843a req-bb0d9a25-4531-48db-a210-ac98c7c7d122 service nova] [instance: 3f08c061-312d-42d3-a811-e98ace4e7a63] Updating instance_info_cache with network_info: [{"id": "225eb5bf-3c60-42f6-9bf7-e045ccda1213", "address": "fa:16:3e:3a:7e:d6", "network": {"id": "fea11c73-0074-4971-8b36-0aced430c730", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1420832282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84d0223a97ff4ecab9bf4273e3e465a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap225eb5bf-3c", "ovs_interfaceid": "225eb5bf-3c60-42f6-9bf7-e045ccda1213", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 18:55:54 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-00dea760-f0b1-4915-bdf2-6173bf03843a req-bb0d9a25-4531-48db-a210-ac98c7c7d122 service nova] Releasing lock "refresh_cache-3f08c061-312d-42d3-a811-e98ace4e7a63" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 18:55:55 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:55:55 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Starting heal instance info cache {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 18:55:55 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Didn't find any instances for network info cache update. {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 13 18:55:55 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:55:55 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:55:55 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:55:55 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:55:55 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:55:55 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75216) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 18:55:55 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:55:55 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-b0510105-c3d6-4272-8b69-fffc48421911 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Acquiring lock "3f08c061-312d-42d3-a811-e98ace4e7a63" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:55:55 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-b0510105-c3d6-4272-8b69-fffc48421911 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Lock "3f08c061-312d-42d3-a811-e98ace4e7a63" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:55:55 user nova-compute[75216]: INFO nova.compute.manager [None req-b0510105-c3d6-4272-8b69-fffc48421911 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] [instance: 3f08c061-312d-42d3-a811-e98ace4e7a63] Rebooting instance
Nov 13 18:55:56 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-b0510105-c3d6-4272-8b69-fffc48421911 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Acquiring lock "refresh_cache-3f08c061-312d-42d3-a811-e98ace4e7a63" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 18:55:56 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-b0510105-c3d6-4272-8b69-fffc48421911 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Acquired lock "refresh_cache-3f08c061-312d-42d3-a811-e98ace4e7a63" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 18:55:56 user nova-compute[75216]: DEBUG nova.network.neutron [None req-b0510105-c3d6-4272-8b69-fffc48421911 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] [instance: 3f08c061-312d-42d3-a811-e98ace4e7a63] Building network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 18:55:56 user nova-compute[75216]: DEBUG nova.network.neutron [None req-b0510105-c3d6-4272-8b69-fffc48421911 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] [instance: 3f08c061-312d-42d3-a811-e98ace4e7a63] Updating instance_info_cache with network_info: [{"id": "225eb5bf-3c60-42f6-9bf7-e045ccda1213", "address": "fa:16:3e:3a:7e:d6", "network": {"id": "fea11c73-0074-4971-8b36-0aced430c730", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1420832282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84d0223a97ff4ecab9bf4273e3e465a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap225eb5bf-3c", "ovs_interfaceid": "225eb5bf-3c60-42f6-9bf7-e045ccda1213", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 18:55:56 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-b0510105-c3d6-4272-8b69-fffc48421911 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Releasing lock "refresh_cache-3f08c061-312d-42d3-a811-e98ace4e7a63" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 18:55:56 user nova-compute[75216]: DEBUG nova.compute.manager [None req-b0510105-c3d6-4272-8b69-fffc48421911 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] [instance: 3f08c061-312d-42d3-a811-e98ace4e7a63] Checking state {{(pid=75216) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 18:55:56 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:55:56 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:55:56 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:55:56 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:55:56 user nova-compute[75216]: DEBUG nova.compute.manager [req-dcb6c890-e673-4e95-8b0b-8190808f94f6 req-92baf017-2f8f-4ece-b07e-c2fd2762059a service nova] [instance: 3f08c061-312d-42d3-a811-e98ace4e7a63] Received event network-vif-unplugged-225eb5bf-3c60-42f6-9bf7-e045ccda1213 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:55:56 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-dcb6c890-e673-4e95-8b0b-8190808f94f6 req-92baf017-2f8f-4ece-b07e-c2fd2762059a service nova] Acquiring lock "3f08c061-312d-42d3-a811-e98ace4e7a63-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:55:56 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-dcb6c890-e673-4e95-8b0b-8190808f94f6 req-92baf017-2f8f-4ece-b07e-c2fd2762059a service nova] Lock "3f08c061-312d-42d3-a811-e98ace4e7a63-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:55:56 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-dcb6c890-e673-4e95-8b0b-8190808f94f6 req-92baf017-2f8f-4ece-b07e-c2fd2762059a service nova] Lock "3f08c061-312d-42d3-a811-e98ace4e7a63-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:55:56 user nova-compute[75216]: DEBUG nova.compute.manager [req-dcb6c890-e673-4e95-8b0b-8190808f94f6 req-92baf017-2f8f-4ece-b07e-c2fd2762059a service nova] [instance: 3f08c061-312d-42d3-a811-e98ace4e7a63] No waiting events found dispatching network-vif-unplugged-225eb5bf-3c60-42f6-9bf7-e045ccda1213 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:55:56 user nova-compute[75216]: WARNING nova.compute.manager [req-dcb6c890-e673-4e95-8b0b-8190808f94f6 req-92baf017-2f8f-4ece-b07e-c2fd2762059a service nova] [instance: 3f08c061-312d-42d3-a811-e98ace4e7a63] Received unexpected event network-vif-unplugged-225eb5bf-3c60-42f6-9bf7-e045ccda1213 for instance with vm_state active and task_state reboot_started_hard.
Nov 13 18:55:57 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 3f08c061-312d-42d3-a811-e98ace4e7a63] Instance destroyed successfully.
Nov 13 18:55:57 user nova-compute[75216]: DEBUG nova.objects.instance [None req-b0510105-c3d6-4272-8b69-fffc48421911 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Lazy-loading 'resources' on Instance uuid 3f08c061-312d-42d3-a811-e98ace4e7a63 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 18:55:57 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-b0510105-c3d6-4272-8b69-fffc48421911 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T18:53:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-843350509',display_name='tempest-TestMinimumBasicScenario-server-843350509',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-843350509',id=23,image_ref='7241b779-6846-4ff3-b5e7-6a596d4ba25f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLKIy5fn8nRCtUmn7K07KfB7RDBd9iwjzb5CXbq3if8xzRwbw+ZQ3REwhjsmBnemynqFCxzkc9s/yAIlOuzrQk4lJ2VBH8ecat/W+YoxobHKrItT4FKogt+fiSesp1UMUQ==',key_name='tempest-TestMinimumBasicScenario-170307334',keypairs=<?>,launch_index=0,launched_at=2023-11-13T18:54:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='84d0223a97ff4ecab9bf4273e3e465a9',ramdisk_id='',reservation_id='r-ynp0tyo0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7241b779-6846-4ff3-b5e7-6a596d4ba25f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1197015828',owner_user_name='tempest-TestMinimumBasicScenario-1197015828-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T18:55:57Z,user_data=None,user_id='83cc10163cd04fffb40b36e6c0cdd484',uuid=3f08c061-312d-42d3-a811-e98ace4e7a63,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "225eb5bf-3c60-42f6-9bf7-e045ccda1213", "address": "fa:16:3e:3a:7e:d6", "network": {"id": "fea11c73-0074-4971-8b36-0aced430c730", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1420832282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84d0223a97ff4ecab9bf4273e3e465a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap225eb5bf-3c", "ovs_interfaceid": "225eb5bf-3c60-42f6-9bf7-e045ccda1213", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 18:55:57 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-b0510105-c3d6-4272-8b69-fffc48421911 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Converting VIF {"id": "225eb5bf-3c60-42f6-9bf7-e045ccda1213", "address": "fa:16:3e:3a:7e:d6", "network": {"id": "fea11c73-0074-4971-8b36-0aced430c730", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1420832282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84d0223a97ff4ecab9bf4273e3e465a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap225eb5bf-3c", "ovs_interfaceid": "225eb5bf-3c60-42f6-9bf7-e045ccda1213", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 18:55:57 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-b0510105-c3d6-4272-8b69-fffc48421911 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3a:7e:d6,bridge_name='br-int',has_traffic_filtering=True,id=225eb5bf-3c60-42f6-9bf7-e045ccda1213,network=Network(fea11c73-0074-4971-8b36-0aced430c730),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap225eb5bf-3c') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 18:55:57 user nova-compute[75216]: DEBUG os_vif [None req-b0510105-c3d6-4272-8b69-fffc48421911 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3a:7e:d6,bridge_name='br-int',has_traffic_filtering=True,id=225eb5bf-3c60-42f6-9bf7-e045ccda1213,network=Network(fea11c73-0074-4971-8b36-0aced430c730),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap225eb5bf-3c') {{(pid=75216) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 18:55:57 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:55:57 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap225eb5bf-3c, bridge=br-int, if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:55:57 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:55:57 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:55:57 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:55:57 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=16f44f98-d0c3-40c0-97e2-2ebf76d1a3e5) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:55:57 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:55:57 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:55:57 user nova-compute[75216]: INFO os_vif [None req-b0510105-c3d6-4272-8b69-fffc48421911 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3a:7e:d6,bridge_name='br-int',has_traffic_filtering=True,id=225eb5bf-3c60-42f6-9bf7-e045ccda1213,network=Network(fea11c73-0074-4971-8b36-0aced430c730),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap225eb5bf-3c')
Nov 13 18:55:57 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0510105-c3d6-4272-8b69-fffc48421911 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] [instance: 3f08c061-312d-42d3-a811-e98ace4e7a63] calling os-brick to detach iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 18:55:57 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0510105-c3d6-4272-8b69-fffc48421911 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3a8669e40>, {'target_iqn': 'iqn.2010-10.org.openstack:671f1985-7823-411f-b273-6a6930de84e1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jrOCibMl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 18:55:57 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-b0510105-c3d6-4272-8b69-fffc48421911 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 18:55:57 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-b0510105-c3d6-4272-8b69-fffc48421911 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 18:55:57 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-b0510105-c3d6-4272-8b69-fffc48421911 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 18:55:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:55:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:55:57 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[418d5b19-b0fb-467a-81d7-b5c1d099837c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:671f1985-7823-411f-b273-6a6930de84e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4ee38de6-1fa4-460d-9bb4-49720104365b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:55:57 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0510105-c3d6-4272-8b69-fffc48421911 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 18:55:57 user nova-compute[75216]: No targets found.
Nov 13 18:55:57 user nova-compute[75216]: iSNS:
Nov 13 18:55:57 user nova-compute[75216]: No targets found.
Nov 13 18:55:57 user nova-compute[75216]: STATIC:
Nov 13 18:55:57 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:671f1985-7823-411f-b273-6a6930de84e1
Nov 13 18:55:57 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 18:55:57 user nova-compute[75216]:                 Iface Name: default
Nov 13 18:55:57 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d
Nov 13 18:55:57 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 18:55:57 user nova-compute[75216]:                 Iface Name: default
Nov 13 18:55:57 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1
Nov 13 18:55:57 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 18:55:57 user nova-compute[75216]:                 Iface Name: default
Nov 13 18:55:57 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:4ee38de6-1fa4-460d-9bb4-49720104365b
Nov 13 18:55:57 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 18:55:57 user nova-compute[75216]:                 Iface Name: default
Nov 13 18:55:57 user nova-compute[75216]: FIRMWARE:
Nov 13 18:55:57 user nova-compute[75216]: No targets found.
Nov 13 18:55:57 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 18:55:57 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0510105-c3d6-4272-8b69-fffc48421911 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 18:55:57 user nova-compute[75216]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 18:55:57 user nova-compute[75216]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75216) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 18:55:57 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0510105-c3d6-4272-8b69-fffc48421911 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:671f1985-7823-411f-b273-6a6930de84e1', 0)] {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 18:55:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:55:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:55:57 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[b092e5f3-524a-4d90-8872-c3be31141458]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4ee38de6-1fa4-460d-9bb4-49720104365b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:671f1985-7823-411f-b273-6a6930de84e1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:55:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:55:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:55:57 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[4668888d-cbdf-42b3-b714-2a804047ed7c]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ee38de6-1fa4-460d-9bb4-49720104365b (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:671f1985-7823-411f-b273-6a6930de84e1 (non-flash)\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:55:57 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0510105-c3d6-4272-8b69-fffc48421911 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ee38de6-1fa4-460d-9bb4-49720104365b (non-flash)
Nov 13 18:55:57 user nova-compute[75216]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1 (non-flash)
Nov 13 18:55:57 user nova-compute[75216]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d (non-flash)
Nov 13 18:55:57 user nova-compute[75216]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:671f1985-7823-411f-b273-6a6930de84e1 (non-flash)
Nov 13 18:55:57 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 18:55:57 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0510105-c3d6-4272-8b69-fffc48421911 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ee38de6-1fa4-460d-9bb4-49720104365b (non-flash)
Nov 13 18:55:57 user nova-compute[75216]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1 (non-flash)
Nov 13 18:55:57 user nova-compute[75216]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d (non-flash)
Nov 13 18:55:57 user nova-compute[75216]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:671f1985-7823-411f-b273-6a6930de84e1 (non-flash)
Nov 13 18:55:57 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 18:55:57 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0510105-c3d6-4272-8b69-fffc48421911 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe3c8206170>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:671f1985-7823-411f-b273-6a6930de84e1'): ({'sde'}, set())}) {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 18:55:57 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-b0510105-c3d6-4272-8b69-fffc48421911 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Removing single pathed devices sde {{(pid=75216) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 18:55:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:55:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:55:57 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[789cb926-fe64-4b66-a47e-0803f6d5485a]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:55:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:55:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:55:57 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1ed8aa6-57c0-438e-85cf-f7a7c5ad1279]: (4, ('ok\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:55:57 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-b0510105-c3d6-4272-8b69-fffc48421911 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Flushing IO for device /dev/sde {{(pid=75216) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 18:55:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:55:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:55:57 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc398f5a-d28f-4247-bea2-5102031e0fa8]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:55:57 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-b0510105-c3d6-4272-8b69-fffc48421911 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75216) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 18:55:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:55:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.048s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:55:57 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb0104da-6ae8-43cc-9d05-0844b6194be8]: (4, ('1', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:55:57 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-b0510105-c3d6-4272-8b69-fffc48421911 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 18:55:57 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-b0510105-c3d6-4272-8b69-fffc48421911 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] SCSI volumes sde have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 18:55:57 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0510105-c3d6-4272-8b69-fffc48421911 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:671f1985-7823-411f-b273-6a6930de84e1')] {{(pid=75216) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 18:55:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:671f1985-7823-411f-b273-6a6930de84e1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:55:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:671f1985-7823-411f-b273-6a6930de84e1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:55:57 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa3c1048-d67d-496a-81f3-2a42259baa1e]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:55:57 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0510105-c3d6-4272-8b69-fffc48421911 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:55:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:671f1985-7823-411f-b273-6a6930de84e1 -p 172.16.0.220:3260 --logout {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:55:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:671f1985-7823-411f-b273-6a6930de84e1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:55:57 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[82d2d084-4c35-40de-95ce-61f3cbf7d11d]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:671f1985-7823-411f-b273-6a6930de84e1, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:671f1985-7823-411f-b273-6a6930de84e1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:55:57 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0510105-c3d6-4272-8b69-fffc48421911 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:671f1985-7823-411f-b273-6a6930de84e1, portal: 172.16.0.220,3260]
Nov 13 18:55:57 user nova-compute[75216]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:671f1985-7823-411f-b273-6a6930de84e1, portal: 172.16.0.220,3260] successful.
Nov 13 18:55:57 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:55:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:671f1985-7823-411f-b273-6a6930de84e1 -p 172.16.0.220:3260 --op delete {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:55:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:671f1985-7823-411f-b273-6a6930de84e1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:55:57 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[59700886-22b1-44fb-81f5-6a0903303c6b]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:55:57 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0510105-c3d6-4272-8b69-fffc48421911 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:55:57 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-b0510105-c3d6-4272-8b69-fffc48421911 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.307s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 18:55:57 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0510105-c3d6-4272-8b69-fffc48421911 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] <== disconnect_volume: return (309ms) None {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 18:55:57 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0510105-c3d6-4272-8b69-fffc48421911 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] [instance: 3f08c061-312d-42d3-a811-e98ace4e7a63] Disconnected iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 18:55:57 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-b0510105-c3d6-4272-8b69-fffc48421911 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] [instance: 3f08c061-312d-42d3-a811-e98ace4e7a63] Start _get_guest_xml network_info=[{"id": "225eb5bf-3c60-42f6-9bf7-e045ccda1213", "address": "fa:16:3e:3a:7e:d6", "network": {"id": "fea11c73-0074-4971-8b36-0aced430c730", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1420832282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84d0223a97ff4ecab9bf4273e3e465a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap225eb5bf-3c", "ovs_interfaceid": "225eb5bf-3c60-42f6-9bf7-e045ccda1213", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=7241b779-6846-4ff3-b5e7-6a596d4ba25f,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'guest_format': None, 'boot_index': 0, 'image_id': '7241b779-6846-4ff3-b5e7-6a596d4ba25f'}], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:671f1985-7823-411f-b273-6a6930de84e1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jrOCibMl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': '3f08c061-312d-42d3-a811-e98ace4e7a63', 'attached_at': '', 'detached_at': '', 'volume_id': '671f1985-7823-411f-b273-6a6930de84e1', 'serial': '671f1985-7823-411f-b273-6a6930de84e1'}, 'attachment_id': '593555e6-a46d-4f3e-9fdc-7483a18e67a9', 'guest_format': None, 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'boot_index': None, 'volume_type': None} {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 18:55:57 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-b0510105-c3d6-4272-8b69-fffc48421911 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 18:55:57 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-b0510105-c3d6-4272-8b69-fffc48421911 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 18:55:57 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-b0510105-c3d6-4272-8b69-fffc48421911 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 18:55:57 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-b0510105-c3d6-4272-8b69-fffc48421911 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] CPU controller missing on host. {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 18:55:57 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-b0510105-c3d6-4272-8b69-fffc48421911 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 18:55:57 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-b0510105-c3d6-4272-8b69-fffc48421911 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] CPU controller found on host. {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 18:55:57 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-b0510105-c3d6-4272-8b69-fffc48421911 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75216) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 18:55:57 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-b0510105-c3d6-4272-8b69-fffc48421911 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T18:40:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=7241b779-6846-4ff3-b5e7-6a596d4ba25f,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 18:55:57 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-b0510105-c3d6-4272-8b69-fffc48421911 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Flavor limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 18:55:57 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-b0510105-c3d6-4272-8b69-fffc48421911 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Image limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 18:55:57 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-b0510105-c3d6-4272-8b69-fffc48421911 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Flavor pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 18:55:57 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-b0510105-c3d6-4272-8b69-fffc48421911 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Image pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 18:55:57 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-b0510105-c3d6-4272-8b69-fffc48421911 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 18:55:57 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-b0510105-c3d6-4272-8b69-fffc48421911 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 18:55:57 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-b0510105-c3d6-4272-8b69-fffc48421911 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 18:55:57 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-b0510105-c3d6-4272-8b69-fffc48421911 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Got 1 possible topologies {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 18:55:57 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-b0510105-c3d6-4272-8b69-fffc48421911 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 18:55:57 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-b0510105-c3d6-4272-8b69-fffc48421911 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 18:55:57 user nova-compute[75216]: DEBUG nova.objects.instance [None req-b0510105-c3d6-4272-8b69-fffc48421911 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Lazy-loading 'vcpu_model' on Instance uuid 3f08c061-312d-42d3-a811-e98ace4e7a63 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 18:55:57 user nova-compute[75216]: DEBUG nova.objects.base [None req-b0510105-c3d6-4272-8b69-fffc48421911 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Object Instance<3f08c061-312d-42d3-a811-e98ace4e7a63> lazy-loaded attributes: resources,vcpu_model {{(pid=75216) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 18:55:57 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0510105-c3d6-4272-8b69-fffc48421911 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] [instance: 3f08c061-312d-42d3-a811-e98ace4e7a63] Calling os-brick to attach iSCSI Volume {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 18:55:57 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0510105-c3d6-4272-8b69-fffc48421911 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3a8669e40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:671f1985-7823-411f-b273-6a6930de84e1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jrOCibMl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 18:55:57 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-b0510105-c3d6-4272-8b69-fffc48421911 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 18:55:57 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-b0510105-c3d6-4272-8b69-fffc48421911 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 18:55:57 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-b0510105-c3d6-4272-8b69-fffc48421911 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 18:55:57 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-b0510105-c3d6-4272-8b69-fffc48421911 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 18:55:57 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-b0510105-c3d6-4272-8b69-fffc48421911 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:671f1985-7823-411f-b273-6a6930de84e1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 18:55:57 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-b0510105-c3d6-4272-8b69-fffc48421911 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:671f1985-7823-411f-b273-6a6930de84e1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 18:55:57 user nova-compute[75216]: INFO os_brick.initiator.connectors.iscsi [None req-b0510105-c3d6-4272-8b69-fffc48421911 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 18:55:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:671f1985-7823-411f-b273-6a6930de84e1 -p 172.16.0.220:3260 {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:55:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:671f1985-7823-411f-b273-6a6930de84e1 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:55:57 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[98ef8029-85c3-42fc-8bfd-ac501f233253]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:55:57 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0510105-c3d6-4272-8b69-fffc48421911 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 18:55:57 user nova-compute[75216]:  {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:55:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:671f1985-7823-411f-b273-6a6930de84e1 -p 172.16.0.220:3260 --interface default --op new {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:55:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:671f1985-7823-411f-b273-6a6930de84e1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:55:57 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b239ae3-0451-4d61-9465-460c96eb39cd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:671f1985-7823-411f-b273-6a6930de84e1] added\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:55:57 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0510105-c3d6-4272-8b69-fffc48421911 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:671f1985-7823-411f-b273-6a6930de84e1] added
Nov 13 18:55:57 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:55:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:671f1985-7823-411f-b273-6a6930de84e1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:55:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:671f1985-7823-411f-b273-6a6930de84e1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:55:57 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[e598aeb2-b384-4cec-88e7-295a6a25fd7e]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:55:57 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0510105-c3d6-4272-8b69-fffc48421911 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:55:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:671f1985-7823-411f-b273-6a6930de84e1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:55:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:671f1985-7823-411f-b273-6a6930de84e1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:55:57 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a1eead1-a064-4a1e-9deb-81dde1356a77]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:55:57 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0510105-c3d6-4272-8b69-fffc48421911 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:55:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:671f1985-7823-411f-b273-6a6930de84e1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jrOCibMl {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:55:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:671f1985-7823-411f-b273-6a6930de84e1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jrOCibMl" returned: 0 in 0.017s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:55:57 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[be0e35b2-e57b-4610-90c4-5705b011bbd3]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:55:57 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0510105-c3d6-4272-8b69-fffc48421911 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jrOCibMl'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:55:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:671f1985-7823-411f-b273-6a6930de84e1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:55:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:671f1985-7823-411f-b273-6a6930de84e1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:55:57 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[fffe7059-07a8-4345-8e74-f84004302006]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:55:57 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0510105-c3d6-4272-8b69-fffc48421911 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:55:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:55:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:55:57 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aa72351-37e7-4504-964f-320ef09aebf0]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ee38de6-1fa4-460d-9bb4-49720104365b (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d (non-flash)\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:55:57 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0510105-c3d6-4272-8b69-fffc48421911 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ee38de6-1fa4-460d-9bb4-49720104365b (non-flash)
Nov 13 18:55:57 user nova-compute[75216]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1 (non-flash)
Nov 13 18:55:57 user nova-compute[75216]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d (non-flash)
Nov 13 18:55:57 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 18:55:57 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0510105-c3d6-4272-8b69-fffc48421911 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ee38de6-1fa4-460d-9bb4-49720104365b (non-flash)
Nov 13 18:55:57 user nova-compute[75216]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1 (non-flash)
Nov 13 18:55:57 user nova-compute[75216]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d (non-flash)
Nov 13 18:55:57 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 18:55:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:671f1985-7823-411f-b273-6a6930de84e1 -p 172.16.0.220:3260 --login {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:55:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:671f1985-7823-411f-b273-6a6930de84e1 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:55:58 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff0271e1-7047-46f9-9d41-672149a025de]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:671f1985-7823-411f-b273-6a6930de84e1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:671f1985-7823-411f-b273-6a6930de84e1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:55:58 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0510105-c3d6-4272-8b69-fffc48421911 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:671f1985-7823-411f-b273-6a6930de84e1, portal: 172.16.0.220,3260]
Nov 13 18:55:58 user nova-compute[75216]: Login to [iface: default, target: iqn.2010-10.org.openstack:671f1985-7823-411f-b273-6a6930de84e1, portal: 172.16.0.220,3260] successful.
Nov 13 18:55:58 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:55:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:671f1985-7823-411f-b273-6a6930de84e1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:55:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:671f1985-7823-411f-b273-6a6930de84e1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:55:58 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[b18bc751-e1d9-4a60-a5f8-7c84a62509a1]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:55:58 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0510105-c3d6-4272-8b69-fffc48421911 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:55:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:55:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:55:58 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[e623451b-a915-432c-96a6-6af9bb530a8d]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ee38de6-1fa4-460d-9bb4-49720104365b (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:671f1985-7823-411f-b273-6a6930de84e1 (non-flash)\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:55:58 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0510105-c3d6-4272-8b69-fffc48421911 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ee38de6-1fa4-460d-9bb4-49720104365b (non-flash)
Nov 13 18:55:58 user nova-compute[75216]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1 (non-flash)
Nov 13 18:55:58 user nova-compute[75216]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d (non-flash)
Nov 13 18:55:58 user nova-compute[75216]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:671f1985-7823-411f-b273-6a6930de84e1 (non-flash)
Nov 13 18:55:58 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 18:55:58 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0510105-c3d6-4272-8b69-fffc48421911 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ee38de6-1fa4-460d-9bb4-49720104365b (non-flash)
Nov 13 18:55:58 user nova-compute[75216]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1 (non-flash)
Nov 13 18:55:58 user nova-compute[75216]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d (non-flash)
Nov 13 18:55:58 user nova-compute[75216]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:671f1985-7823-411f-b273-6a6930de84e1 (non-flash)
Nov 13 18:55:58 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 18:55:58 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-b0510105-c3d6-4272-8b69-fffc48421911 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:671f1985-7823-411f-b273-6a6930de84e1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.277s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 18:55:58 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0510105-c3d6-4272-8b69-fffc48421911 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Connected to 172.16.0.220:3260 {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 18:55:58 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-b0510105-c3d6-4272-8b69-fffc48421911 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] HCTL ('36', '-', '-', 0) found on session 33 with lun 0 {{(pid=75216) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 18:55:58 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-b0510105-c3d6-4272-8b69-fffc48421911 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75216) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 18:55:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:55:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:55:58 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[ada1bcbf-5df0-45cd-b085-67a90cb3b320]: (4, ('- - 0', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:55:58 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-b0510105-c3d6-4272-8b69-fffc48421911 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Searching for a device in session 33 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75216) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 18:55:58 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0510105-c3d6-4272-8b69-fffc48421911 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:671f1985-7823-411f-b273-6a6930de84e1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jrOCibMl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 18:55:58 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:55:58 user nova-compute[75216]: DEBUG nova.compute.manager [req-e12f497a-93af-48b1-bed4-6a5492934e90 req-1ac89472-537b-4bea-a0d0-85cce1efa4fe service nova] [instance: 3f08c061-312d-42d3-a811-e98ace4e7a63] Received event network-vif-plugged-225eb5bf-3c60-42f6-9bf7-e045ccda1213 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:55:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-e12f497a-93af-48b1-bed4-6a5492934e90 req-1ac89472-537b-4bea-a0d0-85cce1efa4fe service nova] Acquiring lock "3f08c061-312d-42d3-a811-e98ace4e7a63-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:55:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-e12f497a-93af-48b1-bed4-6a5492934e90 req-1ac89472-537b-4bea-a0d0-85cce1efa4fe service nova] Lock "3f08c061-312d-42d3-a811-e98ace4e7a63-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:55:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-e12f497a-93af-48b1-bed4-6a5492934e90 req-1ac89472-537b-4bea-a0d0-85cce1efa4fe service nova] Lock "3f08c061-312d-42d3-a811-e98ace4e7a63-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:55:58 user nova-compute[75216]: DEBUG nova.compute.manager [req-e12f497a-93af-48b1-bed4-6a5492934e90 req-1ac89472-537b-4bea-a0d0-85cce1efa4fe service nova] [instance: 3f08c061-312d-42d3-a811-e98ace4e7a63] No waiting events found dispatching network-vif-plugged-225eb5bf-3c60-42f6-9bf7-e045ccda1213 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:55:58 user nova-compute[75216]: WARNING nova.compute.manager [req-e12f497a-93af-48b1-bed4-6a5492934e90 req-1ac89472-537b-4bea-a0d0-85cce1efa4fe service nova] [instance: 3f08c061-312d-42d3-a811-e98ace4e7a63] Received unexpected event network-vif-plugged-225eb5bf-3c60-42f6-9bf7-e045ccda1213 for instance with vm_state active and task_state reboot_started_hard.
Nov 13 18:55:59 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-b0510105-c3d6-4272-8b69-fffc48421911 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.307s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 18:55:59 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0510105-c3d6-4272-8b69-fffc48421911 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] <== connect_volume: return (1308ms) {'type': 'block', 'scsi_wwn': '23062363832333665', 'path': '/dev/sde'} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 18:55:59 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0510105-c3d6-4272-8b69-fffc48421911 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] [instance: 3f08c061-312d-42d3-a811-e98ace4e7a63] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23062363832333665', 'path': '/dev/sde'} {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 18:55:59 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-b0510105-c3d6-4272-8b69-fffc48421911 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T18:53:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-843350509',display_name='tempest-TestMinimumBasicScenario-server-843350509',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-843350509',id=23,image_ref='7241b779-6846-4ff3-b5e7-6a596d4ba25f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLKIy5fn8nRCtUmn7K07KfB7RDBd9iwjzb5CXbq3if8xzRwbw+ZQ3REwhjsmBnemynqFCxzkc9s/yAIlOuzrQk4lJ2VBH8ecat/W+YoxobHKrItT4FKogt+fiSesp1UMUQ==',key_name='tempest-TestMinimumBasicScenario-170307334',keypairs=<?>,launch_index=0,launched_at=2023-11-13T18:54:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='84d0223a97ff4ecab9bf4273e3e465a9',ramdisk_id='',reservation_id='r-ynp0tyo0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7241b779-6846-4ff3-b5e7-6a596d4ba25f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1197015828',owner_user_name='tempest-TestMinimumBasicScenario-1197015828-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T18:55:57Z,user_data=None,user_id='83cc10163cd04fffb40b36e6c0cdd484',uuid=3f08c061-312d-42d3-a811-e98ace4e7a63,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "225eb5bf-3c60-42f6-9bf7-e045ccda1213", "address": "fa:16:3e:3a:7e:d6", "network": {"id": "fea11c73-0074-4971-8b36-0aced430c730", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1420832282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84d0223a97ff4ecab9bf4273e3e465a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap225eb5bf-3c", "ovs_interfaceid": "225eb5bf-3c60-42f6-9bf7-e045ccda1213", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75216) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 18:55:59 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-b0510105-c3d6-4272-8b69-fffc48421911 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Converting VIF {"id": "225eb5bf-3c60-42f6-9bf7-e045ccda1213", "address": "fa:16:3e:3a:7e:d6", "network": {"id": "fea11c73-0074-4971-8b36-0aced430c730", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1420832282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84d0223a97ff4ecab9bf4273e3e465a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap225eb5bf-3c", "ovs_interfaceid": "225eb5bf-3c60-42f6-9bf7-e045ccda1213", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 18:55:59 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-b0510105-c3d6-4272-8b69-fffc48421911 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3a:7e:d6,bridge_name='br-int',has_traffic_filtering=True,id=225eb5bf-3c60-42f6-9bf7-e045ccda1213,network=Network(fea11c73-0074-4971-8b36-0aced430c730),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap225eb5bf-3c') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 18:55:59 user nova-compute[75216]: DEBUG nova.objects.instance [None req-b0510105-c3d6-4272-8b69-fffc48421911 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Lazy-loading 'pci_devices' on Instance uuid 3f08c061-312d-42d3-a811-e98ace4e7a63 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 18:55:59 user nova-compute[75216]: DEBUG nova.objects.base [None req-b0510105-c3d6-4272-8b69-fffc48421911 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Object Instance<3f08c061-312d-42d3-a811-e98ace4e7a63> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=75216) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 18:55:59 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-b0510105-c3d6-4272-8b69-fffc48421911 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] [instance: 3f08c061-312d-42d3-a811-e98ace4e7a63] End _get_guest_xml xml=<domain type="kvm">
Nov 13 18:55:59 user nova-compute[75216]:   <uuid>3f08c061-312d-42d3-a811-e98ace4e7a63</uuid>
Nov 13 18:55:59 user nova-compute[75216]:   <name>instance-00000017</name>
Nov 13 18:55:59 user nova-compute[75216]:   <memory>524288</memory>
Nov 13 18:55:59 user nova-compute[75216]:   <vcpu>1</vcpu>
Nov 13 18:55:59 user nova-compute[75216]:   <metadata>
Nov 13 18:55:59 user nova-compute[75216]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 18:55:59 user nova-compute[75216]:       <nova:package version="0.0.0"/>
Nov 13 18:55:59 user nova-compute[75216]:       <nova:name>tempest-TestMinimumBasicScenario-server-843350509</nova:name>
Nov 13 18:55:59 user nova-compute[75216]:       <nova:creationTime>2023-11-13 18:55:57</nova:creationTime>
Nov 13 18:55:59 user nova-compute[75216]:       <nova:flavor name="m1.tiny">
Nov 13 18:55:59 user nova-compute[75216]:         <nova:memory>512</nova:memory>
Nov 13 18:55:59 user nova-compute[75216]:         <nova:disk>1</nova:disk>
Nov 13 18:55:59 user nova-compute[75216]:         <nova:swap>0</nova:swap>
Nov 13 18:55:59 user nova-compute[75216]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 18:55:59 user nova-compute[75216]:         <nova:vcpus>1</nova:vcpus>
Nov 13 18:55:59 user nova-compute[75216]:       </nova:flavor>
Nov 13 18:55:59 user nova-compute[75216]:       <nova:owner>
Nov 13 18:55:59 user nova-compute[75216]:         <nova:user uuid="83cc10163cd04fffb40b36e6c0cdd484">tempest-TestMinimumBasicScenario-1197015828-project-member</nova:user>
Nov 13 18:55:59 user nova-compute[75216]:         <nova:project uuid="84d0223a97ff4ecab9bf4273e3e465a9">tempest-TestMinimumBasicScenario-1197015828</nova:project>
Nov 13 18:55:59 user nova-compute[75216]:       </nova:owner>
Nov 13 18:55:59 user nova-compute[75216]:       <nova:root type="image" uuid="7241b779-6846-4ff3-b5e7-6a596d4ba25f"/>
Nov 13 18:55:59 user nova-compute[75216]:       <nova:ports>
Nov 13 18:55:59 user nova-compute[75216]:         <nova:port uuid="225eb5bf-3c60-42f6-9bf7-e045ccda1213">
Nov 13 18:55:59 user nova-compute[75216]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 13 18:55:59 user nova-compute[75216]:         </nova:port>
Nov 13 18:55:59 user nova-compute[75216]:       </nova:ports>
Nov 13 18:55:59 user nova-compute[75216]:     </nova:instance>
Nov 13 18:55:59 user nova-compute[75216]:   </metadata>
Nov 13 18:55:59 user nova-compute[75216]:   <sysinfo type="smbios">
Nov 13 18:55:59 user nova-compute[75216]:     <system>
Nov 13 18:55:59 user nova-compute[75216]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 18:55:59 user nova-compute[75216]:       <entry name="product">OpenStack Nova</entry>
Nov 13 18:55:59 user nova-compute[75216]:       <entry name="version">0.0.0</entry>
Nov 13 18:55:59 user nova-compute[75216]:       <entry name="serial">3f08c061-312d-42d3-a811-e98ace4e7a63</entry>
Nov 13 18:55:59 user nova-compute[75216]:       <entry name="uuid">3f08c061-312d-42d3-a811-e98ace4e7a63</entry>
Nov 13 18:55:59 user nova-compute[75216]:       <entry name="family">Virtual Machine</entry>
Nov 13 18:55:59 user nova-compute[75216]:     </system>
Nov 13 18:55:59 user nova-compute[75216]:   </sysinfo>
Nov 13 18:55:59 user nova-compute[75216]:   <os>
Nov 13 18:55:59 user nova-compute[75216]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 18:55:59 user nova-compute[75216]:     <boot dev="hd"/>
Nov 13 18:55:59 user nova-compute[75216]:     <smbios mode="sysinfo"/>
Nov 13 18:55:59 user nova-compute[75216]:   </os>
Nov 13 18:55:59 user nova-compute[75216]:   <features>
Nov 13 18:55:59 user nova-compute[75216]:     <acpi/>
Nov 13 18:55:59 user nova-compute[75216]:     <apic/>
Nov 13 18:55:59 user nova-compute[75216]:     <vmcoreinfo/>
Nov 13 18:55:59 user nova-compute[75216]:   </features>
Nov 13 18:55:59 user nova-compute[75216]:   <clock offset="utc">
Nov 13 18:55:59 user nova-compute[75216]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 18:55:59 user nova-compute[75216]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 18:55:59 user nova-compute[75216]:     <timer name="hpet" present="no"/>
Nov 13 18:55:59 user nova-compute[75216]:   </clock>
Nov 13 18:55:59 user nova-compute[75216]:   <cpu mode="custom" match="exact">
Nov 13 18:55:59 user nova-compute[75216]:     <model>Nehalem</model>
Nov 13 18:55:59 user nova-compute[75216]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 18:55:59 user nova-compute[75216]:   </cpu>
Nov 13 18:55:59 user nova-compute[75216]:   <devices>
Nov 13 18:55:59 user nova-compute[75216]:     <disk type="file" device="disk">
Nov 13 18:55:59 user nova-compute[75216]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 18:55:59 user nova-compute[75216]:       <source file="/opt/stack/data/nova/instances/3f08c061-312d-42d3-a811-e98ace4e7a63/disk"/>
Nov 13 18:55:59 user nova-compute[75216]:       <target dev="vda" bus="virtio"/>
Nov 13 18:55:59 user nova-compute[75216]:     </disk>
Nov 13 18:55:59 user nova-compute[75216]:     <disk type="block" device="disk">
Nov 13 18:55:59 user nova-compute[75216]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 18:55:59 user nova-compute[75216]:       <source dev="/dev/sde"/>
Nov 13 18:55:59 user nova-compute[75216]:       <target dev="vdb" bus="virtio"/>
Nov 13 18:55:59 user nova-compute[75216]:       <serial>671f1985-7823-411f-b273-6a6930de84e1</serial>
Nov 13 18:55:59 user nova-compute[75216]:     </disk>
Nov 13 18:55:59 user nova-compute[75216]:     <interface type="ethernet">
Nov 13 18:55:59 user nova-compute[75216]:       <mac address="fa:16:3e:3a:7e:d6"/>
Nov 13 18:55:59 user nova-compute[75216]:       <model type="virtio"/>
Nov 13 18:55:59 user nova-compute[75216]:       <mtu size="1442"/>
Nov 13 18:55:59 user nova-compute[75216]:       <target dev="tap225eb5bf-3c"/>
Nov 13 18:55:59 user nova-compute[75216]:     </interface>
Nov 13 18:55:59 user nova-compute[75216]:     <serial type="pty">
Nov 13 18:55:59 user nova-compute[75216]:       <log file="/opt/stack/data/nova/instances/3f08c061-312d-42d3-a811-e98ace4e7a63/console.log" append="off"/>
Nov 13 18:55:59 user nova-compute[75216]:     </serial>
Nov 13 18:55:59 user nova-compute[75216]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 18:55:59 user nova-compute[75216]:     <video>
Nov 13 18:55:59 user nova-compute[75216]:       <model type="virtio"/>
Nov 13 18:55:59 user nova-compute[75216]:     </video>
Nov 13 18:55:59 user nova-compute[75216]:     <rng model="virtio">
Nov 13 18:55:59 user nova-compute[75216]:       <backend model="random">/dev/urandom</backend>
Nov 13 18:55:59 user nova-compute[75216]:     </rng>
Nov 13 18:55:59 user nova-compute[75216]:     <controller type="usb" index="0" model="none"/>
Nov 13 18:55:59 user nova-compute[75216]:     <memballoon model="virtio">
Nov 13 18:55:59 user nova-compute[75216]:       <stats period="10"/>
Nov 13 18:55:59 user nova-compute[75216]:     </memballoon>
Nov 13 18:55:59 user nova-compute[75216]:   </devices>
Nov 13 18:55:59 user nova-compute[75216]: </domain>
Nov 13 18:55:59 user nova-compute[75216]:  {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 18:55:59 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-b0510105-c3d6-4272-8b69-fffc48421911 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f08c061-312d-42d3-a811-e98ace4e7a63/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:55:59 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-b0510105-c3d6-4272-8b69-fffc48421911 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f08c061-312d-42d3-a811-e98ace4e7a63/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:55:59 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-b0510105-c3d6-4272-8b69-fffc48421911 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f08c061-312d-42d3-a811-e98ace4e7a63/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:55:59 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-b0510105-c3d6-4272-8b69-fffc48421911 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f08c061-312d-42d3-a811-e98ace4e7a63/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:55:59 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-b0510105-c3d6-4272-8b69-fffc48421911 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 18:55:59 user nova-compute[75216]: DEBUG nova.objects.instance [None req-b0510105-c3d6-4272-8b69-fffc48421911 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Lazy-loading 'trusted_certs' on Instance uuid 3f08c061-312d-42d3-a811-e98ace4e7a63 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 18:55:59 user nova-compute[75216]: DEBUG nova.objects.base [None req-b0510105-c3d6-4272-8b69-fffc48421911 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Object Instance<3f08c061-312d-42d3-a811-e98ace4e7a63> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=75216) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 18:55:59 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-b0510105-c3d6-4272-8b69-fffc48421911 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9b24ed58ad40c754c777e9542268c55a0d7b7833 --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:55:59 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-b0510105-c3d6-4272-8b69-fffc48421911 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9b24ed58ad40c754c777e9542268c55a0d7b7833 --force-share --output=json" returned: 0 in 0.174s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:55:59 user nova-compute[75216]: DEBUG nova.virt.disk.api [None req-b0510105-c3d6-4272-8b69-fffc48421911 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3f08c061-312d-42d3-a811-e98ace4e7a63/disk. size=1073741824 {{(pid=75216) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 18:55:59 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-b0510105-c3d6-4272-8b69-fffc48421911 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f08c061-312d-42d3-a811-e98ace4e7a63/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:55:59 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-b0510105-c3d6-4272-8b69-fffc48421911 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f08c061-312d-42d3-a811-e98ace4e7a63/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:55:59 user nova-compute[75216]: DEBUG nova.virt.disk.api [None req-b0510105-c3d6-4272-8b69-fffc48421911 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Cannot resize image /opt/stack/data/nova/instances/3f08c061-312d-42d3-a811-e98ace4e7a63/disk to a smaller size. {{(pid=75216) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 18:55:59 user nova-compute[75216]: DEBUG nova.objects.instance [None req-b0510105-c3d6-4272-8b69-fffc48421911 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Lazy-loading 'migration_context' on Instance uuid 3f08c061-312d-42d3-a811-e98ace4e7a63 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 18:55:59 user nova-compute[75216]: DEBUG nova.objects.base [None req-b0510105-c3d6-4272-8b69-fffc48421911 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Object Instance<3f08c061-312d-42d3-a811-e98ace4e7a63> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75216) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 18:55:59 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-b0510105-c3d6-4272-8b69-fffc48421911 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T18:53:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-843350509',display_name='tempest-TestMinimumBasicScenario-server-843350509',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-843350509',id=23,image_ref='7241b779-6846-4ff3-b5e7-6a596d4ba25f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLKIy5fn8nRCtUmn7K07KfB7RDBd9iwjzb5CXbq3if8xzRwbw+ZQ3REwhjsmBnemynqFCxzkc9s/yAIlOuzrQk4lJ2VBH8ecat/W+YoxobHKrItT4FKogt+fiSesp1UMUQ==',key_name='tempest-TestMinimumBasicScenario-170307334',keypairs=<?>,launch_index=0,launched_at=2023-11-13T18:54:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='84d0223a97ff4ecab9bf4273e3e465a9',ramdisk_id='',reservation_id='r-ynp0tyo0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7241b779-6846-4ff3-b5e7-6a596d4ba25f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1197015828',owner_user_name='tempest-TestMinimumBasicScenario-1197015828-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T18:55:57Z,user_data=None,user_id='83cc10163cd04fffb40b36e6c0cdd484',uuid=3f08c061-312d-42d3-a811-e98ace4e7a63,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "225eb5bf-3c60-42f6-9bf7-e045ccda1213", "address": "fa:16:3e:3a:7e:d6", "network": {"id": "fea11c73-0074-4971-8b36-0aced430c730", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1420832282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84d0223a97ff4ecab9bf4273e3e465a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap225eb5bf-3c", "ovs_interfaceid": "225eb5bf-3c60-42f6-9bf7-e045ccda1213", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 18:55:59 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-b0510105-c3d6-4272-8b69-fffc48421911 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Converting VIF {"id": "225eb5bf-3c60-42f6-9bf7-e045ccda1213", "address": "fa:16:3e:3a:7e:d6", "network": {"id": "fea11c73-0074-4971-8b36-0aced430c730", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1420832282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84d0223a97ff4ecab9bf4273e3e465a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap225eb5bf-3c", "ovs_interfaceid": "225eb5bf-3c60-42f6-9bf7-e045ccda1213", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 18:55:59 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-b0510105-c3d6-4272-8b69-fffc48421911 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3a:7e:d6,bridge_name='br-int',has_traffic_filtering=True,id=225eb5bf-3c60-42f6-9bf7-e045ccda1213,network=Network(fea11c73-0074-4971-8b36-0aced430c730),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap225eb5bf-3c') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 18:55:59 user nova-compute[75216]: DEBUG os_vif [None req-b0510105-c3d6-4272-8b69-fffc48421911 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3a:7e:d6,bridge_name='br-int',has_traffic_filtering=True,id=225eb5bf-3c60-42f6-9bf7-e045ccda1213,network=Network(fea11c73-0074-4971-8b36-0aced430c730),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap225eb5bf-3c') {{(pid=75216) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 18:55:59 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:55:59 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:55:59 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 18:55:59 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:55:59 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1e9ed527-f8d5-5a2e-9112-af59f64f5b6b', '_type': 'linux-noop'}}, row=False) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:55:59 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:55:59 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:55:59 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:55:59 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap225eb5bf-3c, may_exist=True, interface_attrs={}) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:55:59 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap225eb5bf-3c, col_values=(('qos', UUID('677df35e-bdaa-4c3d-9cfd-ec372812aff7')),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:55:59 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap225eb5bf-3c, col_values=(('external_ids', {'iface-id': '225eb5bf-3c60-42f6-9bf7-e045ccda1213', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3a:7e:d6', 'vm-uuid': '3f08c061-312d-42d3-a811-e98ace4e7a63'}),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:55:59 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:55:59 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:55:59 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:55:59 user nova-compute[75216]: INFO os_vif [None req-b0510105-c3d6-4272-8b69-fffc48421911 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3a:7e:d6,bridge_name='br-int',has_traffic_filtering=True,id=225eb5bf-3c60-42f6-9bf7-e045ccda1213,network=Network(fea11c73-0074-4971-8b36-0aced430c730),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap225eb5bf-3c')
Nov 13 18:56:01 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:56:01 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:56:01 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:56:01 user nova-compute[75216]: DEBUG nova.compute.manager [req-01859b48-d50f-4580-9c8d-1b1beb46c189 req-79db8a46-6b3c-49e3-8288-303eaa276b0a service nova] [instance: 3f08c061-312d-42d3-a811-e98ace4e7a63] Received event network-vif-plugged-225eb5bf-3c60-42f6-9bf7-e045ccda1213 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:56:01 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-01859b48-d50f-4580-9c8d-1b1beb46c189 req-79db8a46-6b3c-49e3-8288-303eaa276b0a service nova] Acquiring lock "3f08c061-312d-42d3-a811-e98ace4e7a63-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:56:01 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-01859b48-d50f-4580-9c8d-1b1beb46c189 req-79db8a46-6b3c-49e3-8288-303eaa276b0a service nova] Lock "3f08c061-312d-42d3-a811-e98ace4e7a63-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:56:01 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-01859b48-d50f-4580-9c8d-1b1beb46c189 req-79db8a46-6b3c-49e3-8288-303eaa276b0a service nova] Lock "3f08c061-312d-42d3-a811-e98ace4e7a63-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:56:01 user nova-compute[75216]: DEBUG nova.compute.manager [req-01859b48-d50f-4580-9c8d-1b1beb46c189 req-79db8a46-6b3c-49e3-8288-303eaa276b0a service nova] [instance: 3f08c061-312d-42d3-a811-e98ace4e7a63] No waiting events found dispatching network-vif-plugged-225eb5bf-3c60-42f6-9bf7-e045ccda1213 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:56:01 user nova-compute[75216]: WARNING nova.compute.manager [req-01859b48-d50f-4580-9c8d-1b1beb46c189 req-79db8a46-6b3c-49e3-8288-303eaa276b0a service nova] [instance: 3f08c061-312d-42d3-a811-e98ace4e7a63] Received unexpected event network-vif-plugged-225eb5bf-3c60-42f6-9bf7-e045ccda1213 for instance with vm_state active and task_state reboot_started_hard.
Nov 13 18:56:01 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:56:01 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:56:01 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:56:01 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:56:03 user nova-compute[75216]: DEBUG nova.compute.manager [None req-b0510105-c3d6-4272-8b69-fffc48421911 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] [instance: 3f08c061-312d-42d3-a811-e98ace4e7a63] Instance event wait completed in 0 seconds for  {{(pid=75216) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 18:56:03 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 3f08c061-312d-42d3-a811-e98ace4e7a63] Instance rebooted successfully.
Nov 13 18:56:03 user nova-compute[75216]: DEBUG nova.compute.manager [None req-b0510105-c3d6-4272-8b69-fffc48421911 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] [instance: 3f08c061-312d-42d3-a811-e98ace4e7a63] Checking state {{(pid=75216) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 18:56:03 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-b0510105-c3d6-4272-8b69-fffc48421911 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Lock "3f08c061-312d-42d3-a811-e98ace4e7a63" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.520s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:56:03 user nova-compute[75216]: DEBUG nova.compute.manager [req-9570ce04-45e7-4c4a-8e1f-e255485f4a99 req-dfed2153-531b-4baf-9c8b-95761966c5e7 service nova] [instance: 3f08c061-312d-42d3-a811-e98ace4e7a63] Received event network-vif-plugged-225eb5bf-3c60-42f6-9bf7-e045ccda1213 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:56:03 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-9570ce04-45e7-4c4a-8e1f-e255485f4a99 req-dfed2153-531b-4baf-9c8b-95761966c5e7 service nova] Acquiring lock "3f08c061-312d-42d3-a811-e98ace4e7a63-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:56:03 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-9570ce04-45e7-4c4a-8e1f-e255485f4a99 req-dfed2153-531b-4baf-9c8b-95761966c5e7 service nova] Lock "3f08c061-312d-42d3-a811-e98ace4e7a63-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:56:03 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-9570ce04-45e7-4c4a-8e1f-e255485f4a99 req-dfed2153-531b-4baf-9c8b-95761966c5e7 service nova] Lock "3f08c061-312d-42d3-a811-e98ace4e7a63-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:56:03 user nova-compute[75216]: DEBUG nova.compute.manager [req-9570ce04-45e7-4c4a-8e1f-e255485f4a99 req-dfed2153-531b-4baf-9c8b-95761966c5e7 service nova] [instance: 3f08c061-312d-42d3-a811-e98ace4e7a63] No waiting events found dispatching network-vif-plugged-225eb5bf-3c60-42f6-9bf7-e045ccda1213 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:56:03 user nova-compute[75216]: WARNING nova.compute.manager [req-9570ce04-45e7-4c4a-8e1f-e255485f4a99 req-dfed2153-531b-4baf-9c8b-95761966c5e7 service nova] [instance: 3f08c061-312d-42d3-a811-e98ace4e7a63] Received unexpected event network-vif-plugged-225eb5bf-3c60-42f6-9bf7-e045ccda1213 for instance with vm_state active and task_state None.
Nov 13 18:56:03 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:56:04 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:56:07 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-61cce829-94bb-4bfc-97c1-d68581cef8d3 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Acquiring lock "2f074d68-d0a7-4204-a79d-be619ee42d0c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:56:07 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-61cce829-94bb-4bfc-97c1-d68581cef8d3 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Lock "2f074d68-d0a7-4204-a79d-be619ee42d0c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:56:07 user nova-compute[75216]: DEBUG nova.compute.manager [None req-61cce829-94bb-4bfc-97c1-d68581cef8d3 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: 2f074d68-d0a7-4204-a79d-be619ee42d0c] Starting instance... {{(pid=75216) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 18:56:07 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-61cce829-94bb-4bfc-97c1-d68581cef8d3 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:56:07 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-61cce829-94bb-4bfc-97c1-d68581cef8d3 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:56:07 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-61cce829-94bb-4bfc-97c1-d68581cef8d3 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75216) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 18:56:07 user nova-compute[75216]: INFO nova.compute.claims [None req-61cce829-94bb-4bfc-97c1-d68581cef8d3 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: 2f074d68-d0a7-4204-a79d-be619ee42d0c] Claim successful on node user
Nov 13 18:56:07 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-61cce829-94bb-4bfc-97c1-d68581cef8d3 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 18:56:07 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-61cce829-94bb-4bfc-97c1-d68581cef8d3 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 18:56:07 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-61cce829-94bb-4bfc-97c1-d68581cef8d3 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.441s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:56:07 user nova-compute[75216]: DEBUG nova.compute.manager [None req-61cce829-94bb-4bfc-97c1-d68581cef8d3 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: 2f074d68-d0a7-4204-a79d-be619ee42d0c] Start building networks asynchronously for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 18:56:08 user nova-compute[75216]: DEBUG nova.compute.manager [None req-61cce829-94bb-4bfc-97c1-d68581cef8d3 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: 2f074d68-d0a7-4204-a79d-be619ee42d0c] Allocating IP information in the background. {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 18:56:08 user nova-compute[75216]: DEBUG nova.network.neutron [None req-61cce829-94bb-4bfc-97c1-d68581cef8d3 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: 2f074d68-d0a7-4204-a79d-be619ee42d0c] allocate_for_instance() {{(pid=75216) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 18:56:08 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-61cce829-94bb-4bfc-97c1-d68581cef8d3 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: 2f074d68-d0a7-4204-a79d-be619ee42d0c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 18:56:08 user nova-compute[75216]: DEBUG nova.compute.manager [None req-61cce829-94bb-4bfc-97c1-d68581cef8d3 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: 2f074d68-d0a7-4204-a79d-be619ee42d0c] Start building block device mappings for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 18:56:08 user nova-compute[75216]: INFO nova.virt.block_device [None req-61cce829-94bb-4bfc-97c1-d68581cef8d3 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: 2f074d68-d0a7-4204-a79d-be619ee42d0c] Booting with volume 8a7c3d74-e183-497b-b6c7-85be2b2f171e at /dev/vda
Nov 13 18:56:08 user nova-compute[75216]: DEBUG nova.policy [None req-61cce829-94bb-4bfc-97c1-d68581cef8d3 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '23f029ff09464d699e5bd6dbf44a905d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b7e11038e54e368acd22d06e54a351', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75216) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 18:56:08 user nova-compute[75216]: DEBUG os_brick.utils [None req-61cce829-94bb-4bfc-97c1-d68581cef8d3 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 18:56:08 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:56:08 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:56:08 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[de343bfc-1cb6-45ec-ad9f-7831d319b2f3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aea6fcfe14b9\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:56:08 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:56:08 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:56:08 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6196d58-ef07-442c-944c-6dc22579e0e6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:56:08 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:56:08 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:56:08 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[51c2c3c0-0b27-4356-acff-2021a853dfab]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:56:08 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab6427a4-ace1-418b-82a2-dc1d6f9ebe73]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:56:08 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-61cce829-94bb-4bfc-97c1-d68581cef8d3 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Running cmd (subprocess): nvme version {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:56:08 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-61cce829-94bb-4bfc-97c1-d68581cef8d3 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] 'nvme version' failed. Not Retrying. {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 18:56:08 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.nvmeof [None req-61cce829-94bb-4bfc-97c1-d68581cef8d3 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] nvme not present on system {{(pid=75216) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 18:56:08 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:56:08 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 18:56:08 user nova-compute[75216]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 18:56:08 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[0938aea5-ccaf-4642-87d9-a719730808a2]: (4, '') {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:56:08 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-61cce829-94bb-4bfc-97c1-d68581cef8d3 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75216) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 18:56:08 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-61cce829-94bb-4bfc-97c1-d68581cef8d3 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 18:56:08 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-61cce829-94bb-4bfc-97c1-d68581cef8d3 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] LIGHTOS: no hostnqn found. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 18:56:08 user nova-compute[75216]: DEBUG os_brick.utils [None req-61cce829-94bb-4bfc-97c1-d68581cef8d3 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aea6fcfe14b9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 18:56:08 user nova-compute[75216]: DEBUG nova.virt.block_device [None req-61cce829-94bb-4bfc-97c1-d68581cef8d3 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: 2f074d68-d0a7-4204-a79d-be619ee42d0c] Updating existing volume attachment record: ed60084b-245b-4ced-a5af-8cdfb6e429a7 {{(pid=75216) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 18:56:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:56:08 user nova-compute[75216]: DEBUG nova.network.neutron [None req-61cce829-94bb-4bfc-97c1-d68581cef8d3 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: 2f074d68-d0a7-4204-a79d-be619ee42d0c] Successfully created port: 3d9260c2-c8da-47b8-884c-8c66259c7c2b {{(pid=75216) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 18:56:09 user nova-compute[75216]: DEBUG nova.network.neutron [None req-61cce829-94bb-4bfc-97c1-d68581cef8d3 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: 2f074d68-d0a7-4204-a79d-be619ee42d0c] Successfully updated port: 3d9260c2-c8da-47b8-884c-8c66259c7c2b {{(pid=75216) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 18:56:09 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-61cce829-94bb-4bfc-97c1-d68581cef8d3 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Acquiring lock "refresh_cache-2f074d68-d0a7-4204-a79d-be619ee42d0c" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 18:56:09 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-61cce829-94bb-4bfc-97c1-d68581cef8d3 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Acquired lock "refresh_cache-2f074d68-d0a7-4204-a79d-be619ee42d0c" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 18:56:09 user nova-compute[75216]: DEBUG nova.network.neutron [None req-61cce829-94bb-4bfc-97c1-d68581cef8d3 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: 2f074d68-d0a7-4204-a79d-be619ee42d0c] Building network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 18:56:09 user nova-compute[75216]: DEBUG nova.compute.manager [req-2dd6ad6f-408b-4019-a725-f070ecdfb875 req-d4c73425-0d2e-44b3-9ab3-ba90e4bd87bd service nova] [instance: 2f074d68-d0a7-4204-a79d-be619ee42d0c] Received event network-changed-3d9260c2-c8da-47b8-884c-8c66259c7c2b {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:56:09 user nova-compute[75216]: DEBUG nova.compute.manager [req-2dd6ad6f-408b-4019-a725-f070ecdfb875 req-d4c73425-0d2e-44b3-9ab3-ba90e4bd87bd service nova] [instance: 2f074d68-d0a7-4204-a79d-be619ee42d0c] Refreshing instance network info cache due to event network-changed-3d9260c2-c8da-47b8-884c-8c66259c7c2b. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 18:56:09 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-2dd6ad6f-408b-4019-a725-f070ecdfb875 req-d4c73425-0d2e-44b3-9ab3-ba90e4bd87bd service nova] Acquiring lock "refresh_cache-2f074d68-d0a7-4204-a79d-be619ee42d0c" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 18:56:09 user nova-compute[75216]: DEBUG nova.network.neutron [None req-61cce829-94bb-4bfc-97c1-d68581cef8d3 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: 2f074d68-d0a7-4204-a79d-be619ee42d0c] Instance cache missing network info. {{(pid=75216) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 18:56:09 user nova-compute[75216]: DEBUG nova.network.neutron [None req-61cce829-94bb-4bfc-97c1-d68581cef8d3 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: 2f074d68-d0a7-4204-a79d-be619ee42d0c] Updating instance_info_cache with network_info: [{"id": "3d9260c2-c8da-47b8-884c-8c66259c7c2b", "address": "fa:16:3e:12:97:81", "network": {"id": "d7a691f0-4495-40ad-a349-91b5dc9c635a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-961583097-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9b7e11038e54e368acd22d06e54a351", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d9260c2-c8", "ovs_interfaceid": "3d9260c2-c8da-47b8-884c-8c66259c7c2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 18:56:09 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-61cce829-94bb-4bfc-97c1-d68581cef8d3 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Releasing lock "refresh_cache-2f074d68-d0a7-4204-a79d-be619ee42d0c" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 18:56:09 user nova-compute[75216]: DEBUG nova.compute.manager [None req-61cce829-94bb-4bfc-97c1-d68581cef8d3 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: 2f074d68-d0a7-4204-a79d-be619ee42d0c] Instance network_info: |[{"id": "3d9260c2-c8da-47b8-884c-8c66259c7c2b", "address": "fa:16:3e:12:97:81", "network": {"id": "d7a691f0-4495-40ad-a349-91b5dc9c635a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-961583097-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9b7e11038e54e368acd22d06e54a351", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d9260c2-c8", "ovs_interfaceid": "3d9260c2-c8da-47b8-884c-8c66259c7c2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 18:56:09 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-2dd6ad6f-408b-4019-a725-f070ecdfb875 req-d4c73425-0d2e-44b3-9ab3-ba90e4bd87bd service nova] Acquired lock "refresh_cache-2f074d68-d0a7-4204-a79d-be619ee42d0c" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 18:56:09 user nova-compute[75216]: DEBUG nova.network.neutron [req-2dd6ad6f-408b-4019-a725-f070ecdfb875 req-d4c73425-0d2e-44b3-9ab3-ba90e4bd87bd service nova] [instance: 2f074d68-d0a7-4204-a79d-be619ee42d0c] Refreshing network info cache for port 3d9260c2-c8da-47b8-884c-8c66259c7c2b {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 18:56:09 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:56:10 user nova-compute[75216]: DEBUG nova.network.neutron [req-2dd6ad6f-408b-4019-a725-f070ecdfb875 req-d4c73425-0d2e-44b3-9ab3-ba90e4bd87bd service nova] [instance: 2f074d68-d0a7-4204-a79d-be619ee42d0c] Updated VIF entry in instance network info cache for port 3d9260c2-c8da-47b8-884c-8c66259c7c2b. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 18:56:10 user nova-compute[75216]: DEBUG nova.network.neutron [req-2dd6ad6f-408b-4019-a725-f070ecdfb875 req-d4c73425-0d2e-44b3-9ab3-ba90e4bd87bd service nova] [instance: 2f074d68-d0a7-4204-a79d-be619ee42d0c] Updating instance_info_cache with network_info: [{"id": "3d9260c2-c8da-47b8-884c-8c66259c7c2b", "address": "fa:16:3e:12:97:81", "network": {"id": "d7a691f0-4495-40ad-a349-91b5dc9c635a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-961583097-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9b7e11038e54e368acd22d06e54a351", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d9260c2-c8", "ovs_interfaceid": "3d9260c2-c8da-47b8-884c-8c66259c7c2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 18:56:10 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-2dd6ad6f-408b-4019-a725-f070ecdfb875 req-d4c73425-0d2e-44b3-9ab3-ba90e4bd87bd service nova] Releasing lock "refresh_cache-2f074d68-d0a7-4204-a79d-be619ee42d0c" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 18:56:12 user nova-compute[75216]: DEBUG nova.compute.manager [None req-61cce829-94bb-4bfc-97c1-d68581cef8d3 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: 2f074d68-d0a7-4204-a79d-be619ee42d0c] Start spawning the instance on the hypervisor. {{(pid=75216) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 18:56:12 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-61cce829-94bb-4bfc-97c1-d68581cef8d3 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: 2f074d68-d0a7-4204-a79d-be619ee42d0c] Creating instance directory {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 18:56:12 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-61cce829-94bb-4bfc-97c1-d68581cef8d3 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: 2f074d68-d0a7-4204-a79d-be619ee42d0c] Creating image(s)
Nov 13 18:56:12 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-61cce829-94bb-4bfc-97c1-d68581cef8d3 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: 2f074d68-d0a7-4204-a79d-be619ee42d0c] Did not create local disks {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 13 18:56:12 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-61cce829-94bb-4bfc-97c1-d68581cef8d3 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: 2f074d68-d0a7-4204-a79d-be619ee42d0c] Ensure instance console log exists: /opt/stack/data/nova/instances/2f074d68-d0a7-4204-a79d-be619ee42d0c/console.log {{(pid=75216) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 18:56:12 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-61cce829-94bb-4bfc-97c1-d68581cef8d3 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:56:12 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-61cce829-94bb-4bfc-97c1-d68581cef8d3 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:56:12 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-61cce829-94bb-4bfc-97c1-d68581cef8d3 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:56:12 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-61cce829-94bb-4bfc-97c1-d68581cef8d3 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: 2f074d68-d0a7-4204-a79d-be619ee42d0c] Start _get_guest_xml network_info=[{"id": "3d9260c2-c8da-47b8-884c-8c66259c7c2b", "address": "fa:16:3e:12:97:81", "network": {"id": "d7a691f0-4495-40ad-a349-91b5dc9c635a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-961583097-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9b7e11038e54e368acd22d06e54a351", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d9260c2-c8", "ovs_interfaceid": "3d9260c2-c8da-47b8-884c-8c66259c7c2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8a7c3d74-e183-497b-b6c7-85be2b2f171e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'umwcQxTI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '2f074d68-d0a7-4204-a79d-be619ee42d0c', 'attached_at': '', 'detached_at': '', 'volume_id': '8a7c3d74-e183-497b-b6c7-85be2b2f171e', 'serial': '8a7c3d74-e183-497b-b6c7-85be2b2f171e'}, 'attachment_id': 'ed60084b-245b-4ced-a5af-8cdfb6e429a7', 'guest_format': None, 'mount_device': '/dev/vda', 'delete_on_termination': True, 'boot_index': 0, 'volume_type': None} {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 18:56:12 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-61cce829-94bb-4bfc-97c1-d68581cef8d3 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 18:56:12 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-61cce829-94bb-4bfc-97c1-d68581cef8d3 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 18:56:12 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-61cce829-94bb-4bfc-97c1-d68581cef8d3 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 18:56:12 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-61cce829-94bb-4bfc-97c1-d68581cef8d3 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] CPU controller missing on host. {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 18:56:12 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-61cce829-94bb-4bfc-97c1-d68581cef8d3 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 18:56:12 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-61cce829-94bb-4bfc-97c1-d68581cef8d3 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] CPU controller found on host. {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 18:56:12 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-61cce829-94bb-4bfc-97c1-d68581cef8d3 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75216) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 18:56:12 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-61cce829-94bb-4bfc-97c1-d68581cef8d3 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T18:40:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 18:56:12 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-61cce829-94bb-4bfc-97c1-d68581cef8d3 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Flavor limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 18:56:12 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-61cce829-94bb-4bfc-97c1-d68581cef8d3 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Image limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 18:56:12 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-61cce829-94bb-4bfc-97c1-d68581cef8d3 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Flavor pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 18:56:12 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-61cce829-94bb-4bfc-97c1-d68581cef8d3 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Image pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 18:56:12 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-61cce829-94bb-4bfc-97c1-d68581cef8d3 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 18:56:12 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-61cce829-94bb-4bfc-97c1-d68581cef8d3 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 18:56:12 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-61cce829-94bb-4bfc-97c1-d68581cef8d3 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 18:56:12 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-61cce829-94bb-4bfc-97c1-d68581cef8d3 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Got 1 possible topologies {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 18:56:12 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-61cce829-94bb-4bfc-97c1-d68581cef8d3 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 18:56:12 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-61cce829-94bb-4bfc-97c1-d68581cef8d3 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 18:56:12 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61cce829-94bb-4bfc-97c1-d68581cef8d3 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: 2f074d68-d0a7-4204-a79d-be619ee42d0c] Calling os-brick to attach iSCSI Volume {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 18:56:12 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-61cce829-94bb-4bfc-97c1-d68581cef8d3 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3a8669e40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8a7c3d74-e183-497b-b6c7-85be2b2f171e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'umwcQxTI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 18:56:12 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-61cce829-94bb-4bfc-97c1-d68581cef8d3 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 18:56:12 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-61cce829-94bb-4bfc-97c1-d68581cef8d3 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 18:56:12 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-61cce829-94bb-4bfc-97c1-d68581cef8d3 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 18:56:12 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-61cce829-94bb-4bfc-97c1-d68581cef8d3 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 18:56:12 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-61cce829-94bb-4bfc-97c1-d68581cef8d3 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8a7c3d74-e183-497b-b6c7-85be2b2f171e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 18:56:12 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-61cce829-94bb-4bfc-97c1-d68581cef8d3 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8a7c3d74-e183-497b-b6c7-85be2b2f171e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 18:56:12 user nova-compute[75216]: INFO os_brick.initiator.connectors.iscsi [None req-61cce829-94bb-4bfc-97c1-d68581cef8d3 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 18:56:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a7c3d74-e183-497b-b6c7-85be2b2f171e -p 172.16.0.220:3260 {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:56:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a7c3d74-e183-497b-b6c7-85be2b2f171e -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:56:12 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[f93e36e5-83f4-4606-8429-a08e1927c74e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:56:12 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-61cce829-94bb-4bfc-97c1-d68581cef8d3 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 18:56:12 user nova-compute[75216]:  {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:56:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a7c3d74-e183-497b-b6c7-85be2b2f171e -p 172.16.0.220:3260 --interface default --op new {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:56:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a7c3d74-e183-497b-b6c7-85be2b2f171e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:56:12 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[6abcfc49-7cd5-4887-b4bb-523fc21dd8cc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8a7c3d74-e183-497b-b6c7-85be2b2f171e] added\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:56:12 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-61cce829-94bb-4bfc-97c1-d68581cef8d3 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8a7c3d74-e183-497b-b6c7-85be2b2f171e] added
Nov 13 18:56:12 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:56:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a7c3d74-e183-497b-b6c7-85be2b2f171e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:56:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a7c3d74-e183-497b-b6c7-85be2b2f171e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:56:12 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eb4d59a-6015-4d5d-bc4f-93dce9ee0ffe]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:56:12 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-61cce829-94bb-4bfc-97c1-d68581cef8d3 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:56:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a7c3d74-e183-497b-b6c7-85be2b2f171e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:56:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a7c3d74-e183-497b-b6c7-85be2b2f171e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:56:12 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[64b4c4f0-f8fd-43cb-b8ff-c9e00a700e9c]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:56:12 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-61cce829-94bb-4bfc-97c1-d68581cef8d3 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:56:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a7c3d74-e183-497b-b6c7-85be2b2f171e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v umwcQxTI {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:56:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a7c3d74-e183-497b-b6c7-85be2b2f171e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v umwcQxTI" returned: 0 in 0.017s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:56:12 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[92b0b95b-a7f6-4324-b682-4df78247bccc]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:56:12 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-61cce829-94bb-4bfc-97c1-d68581cef8d3 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'umwcQxTI'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:56:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a7c3d74-e183-497b-b6c7-85be2b2f171e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:56:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a7c3d74-e183-497b-b6c7-85be2b2f171e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:56:12 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2bd3daf-82a0-4a63-a1bd-be4537b5c798]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:56:12 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-61cce829-94bb-4bfc-97c1-d68581cef8d3 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:56:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:56:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:56:12 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[612e27e9-736d-43f5-920f-32f6475674ef]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ee38de6-1fa4-460d-9bb4-49720104365b (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:671f1985-7823-411f-b273-6a6930de84e1 (non-flash)\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:56:12 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-61cce829-94bb-4bfc-97c1-d68581cef8d3 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ee38de6-1fa4-460d-9bb4-49720104365b (non-flash)
Nov 13 18:56:12 user nova-compute[75216]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1 (non-flash)
Nov 13 18:56:12 user nova-compute[75216]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d (non-flash)
Nov 13 18:56:12 user nova-compute[75216]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:671f1985-7823-411f-b273-6a6930de84e1 (non-flash)
Nov 13 18:56:12 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 18:56:12 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-61cce829-94bb-4bfc-97c1-d68581cef8d3 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ee38de6-1fa4-460d-9bb4-49720104365b (non-flash)
Nov 13 18:56:12 user nova-compute[75216]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1 (non-flash)
Nov 13 18:56:12 user nova-compute[75216]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d (non-flash)
Nov 13 18:56:12 user nova-compute[75216]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:671f1985-7823-411f-b273-6a6930de84e1 (non-flash)
Nov 13 18:56:12 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 18:56:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a7c3d74-e183-497b-b6c7-85be2b2f171e -p 172.16.0.220:3260 --login {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:56:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a7c3d74-e183-497b-b6c7-85be2b2f171e -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:56:12 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5118bb4-af7b-41cf-8513-81a53c122e20]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8a7c3d74-e183-497b-b6c7-85be2b2f171e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8a7c3d74-e183-497b-b6c7-85be2b2f171e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:56:12 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-61cce829-94bb-4bfc-97c1-d68581cef8d3 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8a7c3d74-e183-497b-b6c7-85be2b2f171e, portal: 172.16.0.220,3260]
Nov 13 18:56:12 user nova-compute[75216]: Login to [iface: default, target: iqn.2010-10.org.openstack:8a7c3d74-e183-497b-b6c7-85be2b2f171e, portal: 172.16.0.220,3260] successful.
Nov 13 18:56:12 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:56:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a7c3d74-e183-497b-b6c7-85be2b2f171e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:56:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a7c3d74-e183-497b-b6c7-85be2b2f171e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:56:12 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a1b865d-7639-4e26-8589-45e269552c80]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:56:12 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-61cce829-94bb-4bfc-97c1-d68581cef8d3 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:56:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:56:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:56:12 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[4836bdfb-bcb3-4f47-b00c-627de7d3ca47]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ee38de6-1fa4-460d-9bb4-49720104365b (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:671f1985-7823-411f-b273-6a6930de84e1 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a7c3d74-e183-497b-b6c7-85be2b2f171e (non-flash)\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:56:12 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-61cce829-94bb-4bfc-97c1-d68581cef8d3 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ee38de6-1fa4-460d-9bb4-49720104365b (non-flash)
Nov 13 18:56:12 user nova-compute[75216]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1 (non-flash)
Nov 13 18:56:12 user nova-compute[75216]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d (non-flash)
Nov 13 18:56:12 user nova-compute[75216]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:671f1985-7823-411f-b273-6a6930de84e1 (non-flash)
Nov 13 18:56:12 user nova-compute[75216]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a7c3d74-e183-497b-b6c7-85be2b2f171e (non-flash)
Nov 13 18:56:12 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 18:56:12 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-61cce829-94bb-4bfc-97c1-d68581cef8d3 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ee38de6-1fa4-460d-9bb4-49720104365b (non-flash)
Nov 13 18:56:12 user nova-compute[75216]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1 (non-flash)
Nov 13 18:56:12 user nova-compute[75216]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d (non-flash)
Nov 13 18:56:12 user nova-compute[75216]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:671f1985-7823-411f-b273-6a6930de84e1 (non-flash)
Nov 13 18:56:12 user nova-compute[75216]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a7c3d74-e183-497b-b6c7-85be2b2f171e (non-flash)
Nov 13 18:56:12 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 18:56:12 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-61cce829-94bb-4bfc-97c1-d68581cef8d3 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8a7c3d74-e183-497b-b6c7-85be2b2f171e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.279s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 18:56:12 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-61cce829-94bb-4bfc-97c1-d68581cef8d3 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Connected to 172.16.0.220:3260 {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 18:56:12 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-61cce829-94bb-4bfc-97c1-d68581cef8d3 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] HCTL ('37', '-', '-', 0) found on session 34 with lun 0 {{(pid=75216) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 18:56:12 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-61cce829-94bb-4bfc-97c1-d68581cef8d3 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75216) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 18:56:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:56:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:56:12 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce67f71f-6f3c-431a-a7a0-aed2627c6169]: (4, ('- - 0', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:56:12 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-61cce829-94bb-4bfc-97c1-d68581cef8d3 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Searching for a device in session 34 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75216) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 18:56:12 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-61cce829-94bb-4bfc-97c1-d68581cef8d3 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:8a7c3d74-e183-497b-b6c7-85be2b2f171e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'umwcQxTI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 18:56:13 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:56:13 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-61cce829-94bb-4bfc-97c1-d68581cef8d3 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.312s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 18:56:13 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-61cce829-94bb-4bfc-97c1-d68581cef8d3 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] <== connect_volume: return (1314ms) {'type': 'block', 'scsi_wwn': '23261366139346465', 'path': '/dev/sdf'} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 18:56:13 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61cce829-94bb-4bfc-97c1-d68581cef8d3 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: 2f074d68-d0a7-4204-a79d-be619ee42d0c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23261366139346465', 'path': '/dev/sdf'} {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 18:56:13 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-61cce829-94bb-4bfc-97c1-d68581cef8d3 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T18:56:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1279111656',display_name='tempest-ServerActionsTestOtherA-server-1279111656',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1279111656',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKz099Lx1XxYKMwpEh9A7Hze8Yy5EijTt+h0RSW+LWAAdums7McTLzxWcs+4M2TWx6M56tfd+yHdLdlnr7vz5lvq3aL+fZolVlZV3LeOornnUO38Y1O0XVUZqifXtvNPtQ==',key_name='tempest-keypair-1574128026',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b9b7e11038e54e368acd22d06e54a351',ramdisk_id='',reservation_id='r-59nswt1o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-537419316',owner_user_name='tempest-ServerActionsTestOtherA-537419316-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T18:56:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='23f029ff09464d699e5bd6dbf44a905d',uuid=2f074d68-d0a7-4204-a79d-be619ee42d0c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3d9260c2-c8da-47b8-884c-8c66259c7c2b", "address": "fa:16:3e:12:97:81", "network": {"id": "d7a691f0-4495-40ad-a349-91b5dc9c635a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-961583097-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9b7e11038e54e368acd22d06e54a351", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d9260c2-c8", "ovs_interfaceid": "3d9260c2-c8da-47b8-884c-8c66259c7c2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75216) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 18:56:13 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-61cce829-94bb-4bfc-97c1-d68581cef8d3 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Converting VIF {"id": "3d9260c2-c8da-47b8-884c-8c66259c7c2b", "address": "fa:16:3e:12:97:81", "network": {"id": "d7a691f0-4495-40ad-a349-91b5dc9c635a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-961583097-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9b7e11038e54e368acd22d06e54a351", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d9260c2-c8", "ovs_interfaceid": "3d9260c2-c8da-47b8-884c-8c66259c7c2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 18:56:13 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-61cce829-94bb-4bfc-97c1-d68581cef8d3 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:97:81,bridge_name='br-int',has_traffic_filtering=True,id=3d9260c2-c8da-47b8-884c-8c66259c7c2b,network=Network(d7a691f0-4495-40ad-a349-91b5dc9c635a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d9260c2-c8') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 18:56:13 user nova-compute[75216]: DEBUG nova.objects.instance [None req-61cce829-94bb-4bfc-97c1-d68581cef8d3 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Lazy-loading 'pci_devices' on Instance uuid 2f074d68-d0a7-4204-a79d-be619ee42d0c {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 18:56:13 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-61cce829-94bb-4bfc-97c1-d68581cef8d3 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: 2f074d68-d0a7-4204-a79d-be619ee42d0c] End _get_guest_xml xml=<domain type="kvm">
Nov 13 18:56:13 user nova-compute[75216]:   <uuid>2f074d68-d0a7-4204-a79d-be619ee42d0c</uuid>
Nov 13 18:56:13 user nova-compute[75216]:   <name>instance-00000019</name>
Nov 13 18:56:13 user nova-compute[75216]:   <memory>524288</memory>
Nov 13 18:56:13 user nova-compute[75216]:   <vcpu>1</vcpu>
Nov 13 18:56:13 user nova-compute[75216]:   <metadata>
Nov 13 18:56:13 user nova-compute[75216]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 18:56:13 user nova-compute[75216]:       <nova:package version="0.0.0"/>
Nov 13 18:56:13 user nova-compute[75216]:       <nova:name>tempest-ServerActionsTestOtherA-server-1279111656</nova:name>
Nov 13 18:56:13 user nova-compute[75216]:       <nova:creationTime>2023-11-13 18:56:12</nova:creationTime>
Nov 13 18:56:13 user nova-compute[75216]:       <nova:flavor name="m1.tiny">
Nov 13 18:56:13 user nova-compute[75216]:         <nova:memory>512</nova:memory>
Nov 13 18:56:13 user nova-compute[75216]:         <nova:disk>1</nova:disk>
Nov 13 18:56:13 user nova-compute[75216]:         <nova:swap>0</nova:swap>
Nov 13 18:56:13 user nova-compute[75216]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 18:56:13 user nova-compute[75216]:         <nova:vcpus>1</nova:vcpus>
Nov 13 18:56:13 user nova-compute[75216]:       </nova:flavor>
Nov 13 18:56:13 user nova-compute[75216]:       <nova:owner>
Nov 13 18:56:13 user nova-compute[75216]:         <nova:user uuid="23f029ff09464d699e5bd6dbf44a905d">tempest-ServerActionsTestOtherA-537419316-project-member</nova:user>
Nov 13 18:56:13 user nova-compute[75216]:         <nova:project uuid="b9b7e11038e54e368acd22d06e54a351">tempest-ServerActionsTestOtherA-537419316</nova:project>
Nov 13 18:56:13 user nova-compute[75216]:       </nova:owner>
Nov 13 18:56:13 user nova-compute[75216]:       <nova:ports>
Nov 13 18:56:13 user nova-compute[75216]:         <nova:port uuid="3d9260c2-c8da-47b8-884c-8c66259c7c2b">
Nov 13 18:56:13 user nova-compute[75216]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 13 18:56:13 user nova-compute[75216]:         </nova:port>
Nov 13 18:56:13 user nova-compute[75216]:       </nova:ports>
Nov 13 18:56:13 user nova-compute[75216]:     </nova:instance>
Nov 13 18:56:13 user nova-compute[75216]:   </metadata>
Nov 13 18:56:13 user nova-compute[75216]:   <sysinfo type="smbios">
Nov 13 18:56:13 user nova-compute[75216]:     <system>
Nov 13 18:56:13 user nova-compute[75216]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 18:56:13 user nova-compute[75216]:       <entry name="product">OpenStack Nova</entry>
Nov 13 18:56:13 user nova-compute[75216]:       <entry name="version">0.0.0</entry>
Nov 13 18:56:13 user nova-compute[75216]:       <entry name="serial">2f074d68-d0a7-4204-a79d-be619ee42d0c</entry>
Nov 13 18:56:13 user nova-compute[75216]:       <entry name="uuid">2f074d68-d0a7-4204-a79d-be619ee42d0c</entry>
Nov 13 18:56:13 user nova-compute[75216]:       <entry name="family">Virtual Machine</entry>
Nov 13 18:56:13 user nova-compute[75216]:     </system>
Nov 13 18:56:13 user nova-compute[75216]:   </sysinfo>
Nov 13 18:56:13 user nova-compute[75216]:   <os>
Nov 13 18:56:13 user nova-compute[75216]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 18:56:13 user nova-compute[75216]:     <boot dev="hd"/>
Nov 13 18:56:13 user nova-compute[75216]:     <smbios mode="sysinfo"/>
Nov 13 18:56:13 user nova-compute[75216]:   </os>
Nov 13 18:56:13 user nova-compute[75216]:   <features>
Nov 13 18:56:13 user nova-compute[75216]:     <acpi/>
Nov 13 18:56:13 user nova-compute[75216]:     <apic/>
Nov 13 18:56:13 user nova-compute[75216]:     <vmcoreinfo/>
Nov 13 18:56:13 user nova-compute[75216]:   </features>
Nov 13 18:56:13 user nova-compute[75216]:   <clock offset="utc">
Nov 13 18:56:13 user nova-compute[75216]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 18:56:13 user nova-compute[75216]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 18:56:13 user nova-compute[75216]:     <timer name="hpet" present="no"/>
Nov 13 18:56:13 user nova-compute[75216]:   </clock>
Nov 13 18:56:13 user nova-compute[75216]:   <cpu mode="custom" match="exact">
Nov 13 18:56:13 user nova-compute[75216]:     <model>Nehalem</model>
Nov 13 18:56:13 user nova-compute[75216]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 18:56:13 user nova-compute[75216]:   </cpu>
Nov 13 18:56:13 user nova-compute[75216]:   <devices>
Nov 13 18:56:13 user nova-compute[75216]:     <disk type="block" device="disk">
Nov 13 18:56:13 user nova-compute[75216]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 18:56:13 user nova-compute[75216]:       <source dev="/dev/sdf"/>
Nov 13 18:56:13 user nova-compute[75216]:       <target dev="vda" bus="virtio"/>
Nov 13 18:56:13 user nova-compute[75216]:       <serial>8a7c3d74-e183-497b-b6c7-85be2b2f171e</serial>
Nov 13 18:56:13 user nova-compute[75216]:     </disk>
Nov 13 18:56:13 user nova-compute[75216]:     <interface type="ethernet">
Nov 13 18:56:13 user nova-compute[75216]:       <mac address="fa:16:3e:12:97:81"/>
Nov 13 18:56:13 user nova-compute[75216]:       <model type="virtio"/>
Nov 13 18:56:13 user nova-compute[75216]:       <mtu size="1442"/>
Nov 13 18:56:13 user nova-compute[75216]:       <target dev="tap3d9260c2-c8"/>
Nov 13 18:56:13 user nova-compute[75216]:     </interface>
Nov 13 18:56:13 user nova-compute[75216]:     <serial type="pty">
Nov 13 18:56:13 user nova-compute[75216]:       <log file="/opt/stack/data/nova/instances/2f074d68-d0a7-4204-a79d-be619ee42d0c/console.log" append="off"/>
Nov 13 18:56:13 user nova-compute[75216]:     </serial>
Nov 13 18:56:13 user nova-compute[75216]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 18:56:13 user nova-compute[75216]:     <video>
Nov 13 18:56:13 user nova-compute[75216]:       <model type="virtio"/>
Nov 13 18:56:13 user nova-compute[75216]:     </video>
Nov 13 18:56:13 user nova-compute[75216]:     <rng model="virtio">
Nov 13 18:56:13 user nova-compute[75216]:       <backend model="random">/dev/urandom</backend>
Nov 13 18:56:13 user nova-compute[75216]:     </rng>
Nov 13 18:56:13 user nova-compute[75216]:     <controller type="usb" index="0" model="none"/>
Nov 13 18:56:13 user nova-compute[75216]:     <memballoon model="virtio">
Nov 13 18:56:13 user nova-compute[75216]:       <stats period="10"/>
Nov 13 18:56:13 user nova-compute[75216]:     </memballoon>
Nov 13 18:56:13 user nova-compute[75216]:   </devices>
Nov 13 18:56:13 user nova-compute[75216]: </domain>
Nov 13 18:56:13 user nova-compute[75216]:  {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 18:56:13 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-61cce829-94bb-4bfc-97c1-d68581cef8d3 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T18:56:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1279111656',display_name='tempest-ServerActionsTestOtherA-server-1279111656',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1279111656',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKz099Lx1XxYKMwpEh9A7Hze8Yy5EijTt+h0RSW+LWAAdums7McTLzxWcs+4M2TWx6M56tfd+yHdLdlnr7vz5lvq3aL+fZolVlZV3LeOornnUO38Y1O0XVUZqifXtvNPtQ==',key_name='tempest-keypair-1574128026',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b9b7e11038e54e368acd22d06e54a351',ramdisk_id='',reservation_id='r-59nswt1o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-537419316',owner_user_name='tempest-ServerActionsTestOtherA-537419316-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T18:56:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='23f029ff09464d699e5bd6dbf44a905d',uuid=2f074d68-d0a7-4204-a79d-be619ee42d0c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3d9260c2-c8da-47b8-884c-8c66259c7c2b", "address": "fa:16:3e:12:97:81", "network": {"id": "d7a691f0-4495-40ad-a349-91b5dc9c635a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-961583097-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9b7e11038e54e368acd22d06e54a351", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d9260c2-c8", "ovs_interfaceid": "3d9260c2-c8da-47b8-884c-8c66259c7c2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 18:56:13 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-61cce829-94bb-4bfc-97c1-d68581cef8d3 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Converting VIF {"id": "3d9260c2-c8da-47b8-884c-8c66259c7c2b", "address": "fa:16:3e:12:97:81", "network": {"id": "d7a691f0-4495-40ad-a349-91b5dc9c635a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-961583097-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9b7e11038e54e368acd22d06e54a351", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d9260c2-c8", "ovs_interfaceid": "3d9260c2-c8da-47b8-884c-8c66259c7c2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 18:56:13 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-61cce829-94bb-4bfc-97c1-d68581cef8d3 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:97:81,bridge_name='br-int',has_traffic_filtering=True,id=3d9260c2-c8da-47b8-884c-8c66259c7c2b,network=Network(d7a691f0-4495-40ad-a349-91b5dc9c635a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d9260c2-c8') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 18:56:13 user nova-compute[75216]: DEBUG os_vif [None req-61cce829-94bb-4bfc-97c1-d68581cef8d3 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:97:81,bridge_name='br-int',has_traffic_filtering=True,id=3d9260c2-c8da-47b8-884c-8c66259c7c2b,network=Network(d7a691f0-4495-40ad-a349-91b5dc9c635a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d9260c2-c8') {{(pid=75216) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 18:56:13 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:56:13 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:56:13 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 18:56:13 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:56:13 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6ee13622-13a5-5558-98f4-bf4b64d9558b', '_type': 'linux-noop'}}, row=False) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:56:13 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:56:13 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:56:13 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:56:13 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3d9260c2-c8, may_exist=True, interface_attrs={}) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:56:13 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3d9260c2-c8, col_values=(('qos', UUID('97d82290-3fa4-4b93-9843-46f56d780bab')),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:56:13 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3d9260c2-c8, col_values=(('external_ids', {'iface-id': '3d9260c2-c8da-47b8-884c-8c66259c7c2b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:12:97:81', 'vm-uuid': '2f074d68-d0a7-4204-a79d-be619ee42d0c'}),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:56:13 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:56:13 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:56:13 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:56:13 user nova-compute[75216]: INFO os_vif [None req-61cce829-94bb-4bfc-97c1-d68581cef8d3 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:97:81,bridge_name='br-int',has_traffic_filtering=True,id=3d9260c2-c8da-47b8-884c-8c66259c7c2b,network=Network(d7a691f0-4495-40ad-a349-91b5dc9c635a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d9260c2-c8')
Nov 13 18:56:14 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-61cce829-94bb-4bfc-97c1-d68581cef8d3 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 18:56:14 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-61cce829-94bb-4bfc-97c1-d68581cef8d3 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] No VIF found with MAC fa:16:3e:12:97:81, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 18:56:15 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:56:15 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:56:15 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:56:15 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:56:15 user nova-compute[75216]: DEBUG nova.compute.manager [req-26b9d361-4958-445f-9557-0d2a2ea75cdc req-322d46ec-4d84-4bc5-a602-75d1f13654cb service nova] [instance: 2f074d68-d0a7-4204-a79d-be619ee42d0c] Received event network-vif-plugged-3d9260c2-c8da-47b8-884c-8c66259c7c2b {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:56:15 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-26b9d361-4958-445f-9557-0d2a2ea75cdc req-322d46ec-4d84-4bc5-a602-75d1f13654cb service nova] Acquiring lock "2f074d68-d0a7-4204-a79d-be619ee42d0c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:56:15 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-26b9d361-4958-445f-9557-0d2a2ea75cdc req-322d46ec-4d84-4bc5-a602-75d1f13654cb service nova] Lock "2f074d68-d0a7-4204-a79d-be619ee42d0c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:56:15 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-26b9d361-4958-445f-9557-0d2a2ea75cdc req-322d46ec-4d84-4bc5-a602-75d1f13654cb service nova] Lock "2f074d68-d0a7-4204-a79d-be619ee42d0c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:56:15 user nova-compute[75216]: DEBUG nova.compute.manager [req-26b9d361-4958-445f-9557-0d2a2ea75cdc req-322d46ec-4d84-4bc5-a602-75d1f13654cb service nova] [instance: 2f074d68-d0a7-4204-a79d-be619ee42d0c] No waiting events found dispatching network-vif-plugged-3d9260c2-c8da-47b8-884c-8c66259c7c2b {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:56:15 user nova-compute[75216]: WARNING nova.compute.manager [req-26b9d361-4958-445f-9557-0d2a2ea75cdc req-322d46ec-4d84-4bc5-a602-75d1f13654cb service nova] [instance: 2f074d68-d0a7-4204-a79d-be619ee42d0c] Received unexpected event network-vif-plugged-3d9260c2-c8da-47b8-884c-8c66259c7c2b for instance with vm_state building and task_state spawning.
Nov 13 18:56:15 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:56:15 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:56:17 user nova-compute[75216]: DEBUG nova.compute.manager [None req-61cce829-94bb-4bfc-97c1-d68581cef8d3 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: 2f074d68-d0a7-4204-a79d-be619ee42d0c] Instance event wait completed in 0 seconds for  {{(pid=75216) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 18:56:17 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-61cce829-94bb-4bfc-97c1-d68581cef8d3 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: 2f074d68-d0a7-4204-a79d-be619ee42d0c] Guest created on hypervisor {{(pid=75216) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 18:56:17 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 2f074d68-d0a7-4204-a79d-be619ee42d0c] Instance spawned successfully.
Nov 13 18:56:17 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-61cce829-94bb-4bfc-97c1-d68581cef8d3 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: 2f074d68-d0a7-4204-a79d-be619ee42d0c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 18:56:17 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-61cce829-94bb-4bfc-97c1-d68581cef8d3 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: 2f074d68-d0a7-4204-a79d-be619ee42d0c] Found default for hw_cdrom_bus of ide {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 18:56:17 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-61cce829-94bb-4bfc-97c1-d68581cef8d3 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: 2f074d68-d0a7-4204-a79d-be619ee42d0c] Found default for hw_disk_bus of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 18:56:17 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-61cce829-94bb-4bfc-97c1-d68581cef8d3 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: 2f074d68-d0a7-4204-a79d-be619ee42d0c] Found default for hw_input_bus of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 18:56:17 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-61cce829-94bb-4bfc-97c1-d68581cef8d3 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: 2f074d68-d0a7-4204-a79d-be619ee42d0c] Found default for hw_pointer_model of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 18:56:17 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-61cce829-94bb-4bfc-97c1-d68581cef8d3 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: 2f074d68-d0a7-4204-a79d-be619ee42d0c] Found default for hw_video_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 18:56:17 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-61cce829-94bb-4bfc-97c1-d68581cef8d3 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: 2f074d68-d0a7-4204-a79d-be619ee42d0c] Found default for hw_vif_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 18:56:17 user nova-compute[75216]: INFO nova.compute.manager [None req-61cce829-94bb-4bfc-97c1-d68581cef8d3 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: 2f074d68-d0a7-4204-a79d-be619ee42d0c] Took 4.90 seconds to spawn the instance on the hypervisor.
Nov 13 18:56:17 user nova-compute[75216]: DEBUG nova.compute.manager [None req-61cce829-94bb-4bfc-97c1-d68581cef8d3 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: 2f074d68-d0a7-4204-a79d-be619ee42d0c] Checking state {{(pid=75216) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 18:56:17 user nova-compute[75216]: DEBUG nova.compute.manager [req-50362cca-f373-47f3-93a9-3546e6d33f58 req-e18b754a-b444-442d-a9df-e94c77e84527 service nova] [instance: 2f074d68-d0a7-4204-a79d-be619ee42d0c] Received event network-vif-plugged-3d9260c2-c8da-47b8-884c-8c66259c7c2b {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:56:17 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-50362cca-f373-47f3-93a9-3546e6d33f58 req-e18b754a-b444-442d-a9df-e94c77e84527 service nova] Acquiring lock "2f074d68-d0a7-4204-a79d-be619ee42d0c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:56:17 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-50362cca-f373-47f3-93a9-3546e6d33f58 req-e18b754a-b444-442d-a9df-e94c77e84527 service nova] Lock "2f074d68-d0a7-4204-a79d-be619ee42d0c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:56:17 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-50362cca-f373-47f3-93a9-3546e6d33f58 req-e18b754a-b444-442d-a9df-e94c77e84527 service nova] Lock "2f074d68-d0a7-4204-a79d-be619ee42d0c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:56:17 user nova-compute[75216]: DEBUG nova.compute.manager [req-50362cca-f373-47f3-93a9-3546e6d33f58 req-e18b754a-b444-442d-a9df-e94c77e84527 service nova] [instance: 2f074d68-d0a7-4204-a79d-be619ee42d0c] No waiting events found dispatching network-vif-plugged-3d9260c2-c8da-47b8-884c-8c66259c7c2b {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:56:17 user nova-compute[75216]: WARNING nova.compute.manager [req-50362cca-f373-47f3-93a9-3546e6d33f58 req-e18b754a-b444-442d-a9df-e94c77e84527 service nova] [instance: 2f074d68-d0a7-4204-a79d-be619ee42d0c] Received unexpected event network-vif-plugged-3d9260c2-c8da-47b8-884c-8c66259c7c2b for instance with vm_state building and task_state spawning.
Nov 13 18:56:17 user nova-compute[75216]: INFO nova.compute.manager [None req-61cce829-94bb-4bfc-97c1-d68581cef8d3 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: 2f074d68-d0a7-4204-a79d-be619ee42d0c] Took 9.98 seconds to build instance.
Nov 13 18:56:17 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-61cce829-94bb-4bfc-97c1-d68581cef8d3 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Lock "2f074d68-d0a7-4204-a79d-be619ee42d0c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.068s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:56:18 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:56:18 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:56:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:56:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:56:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:56:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:56:33 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:56:33 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:56:38 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:56:38 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:56:43 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:56:43 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:56:48 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:56:48 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:56:48 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:56:49 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:56:51 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:56:51 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:56:51 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75216) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 18:56:51 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:56:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:56:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:56:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:56:51 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Auditing locally available compute resources for user (node: user) {{(pid=75216) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 18:56:51 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 18:56:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a3e849-6570-4820-97c8-75468b5bea4f/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:56:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a3e849-6570-4820-97c8-75468b5bea4f/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:56:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a3e849-6570-4820-97c8-75468b5bea4f/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:56:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a3e849-6570-4820-97c8-75468b5bea4f/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:56:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9a1edfb-c2ac-4e67-abac-c915ea22a15c/disk.rescue --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:56:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9a1edfb-c2ac-4e67-abac-c915ea22a15c/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:56:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9a1edfb-c2ac-4e67-abac-c915ea22a15c/disk.rescue --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:56:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9a1edfb-c2ac-4e67-abac-c915ea22a15c/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:56:52 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] skipping disk /opt/stack/data/nova/instances/d9a1edfb-c2ac-4e67-abac-c915ea22a15c/disk (vdb) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 18:56:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14d378b0-79ba-4161-a795-6288939c6fef/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:56:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14d378b0-79ba-4161-a795-6288939c6fef/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:56:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14d378b0-79ba-4161-a795-6288939c6fef/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:56:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14d378b0-79ba-4161-a795-6288939c6fef/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:56:52 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 18:56:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91ea8a19-a365-484c-80c7-baf90e7dd1aa/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:56:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91ea8a19-a365-484c-80c7-baf90e7dd1aa/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:56:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91ea8a19-a365-484c-80c7-baf90e7dd1aa/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:56:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91ea8a19-a365-484c-80c7-baf90e7dd1aa/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:56:53 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 18:56:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d589d57e-de50-482a-843f-e8246b3d7528/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:56:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d589d57e-de50-482a-843f-e8246b3d7528/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:56:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d589d57e-de50-482a-843f-e8246b3d7528/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:56:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d589d57e-de50-482a-843f-e8246b3d7528/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:56:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:56:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:56:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:56:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:56:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85624c58-6c72-4490-8a3e-547953295ade/disk.rescue --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:56:53 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:56:54 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85624c58-6c72-4490-8a3e-547953295ade/disk.rescue --force-share --output=json" returned: 0 in 0.169s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:56:54 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85624c58-6c72-4490-8a3e-547953295ade/disk.rescue --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:56:54 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85624c58-6c72-4490-8a3e-547953295ade/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:56:54 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85624c58-6c72-4490-8a3e-547953295ade/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:56:54 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85624c58-6c72-4490-8a3e-547953295ade/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:56:54 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85624c58-6c72-4490-8a3e-547953295ade/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:56:54 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85624c58-6c72-4490-8a3e-547953295ade/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:56:54 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f08c061-312d-42d3-a811-e98ace4e7a63/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:56:54 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f08c061-312d-42d3-a811-e98ace4e7a63/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:56:54 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f08c061-312d-42d3-a811-e98ace4e7a63/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:56:54 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f08c061-312d-42d3-a811-e98ace4e7a63/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:56:54 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 18:56:55 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 18:56:55 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 18:56:55 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Hypervisor/Node resource view: name=user free_ram=7772MB free_disk=25.410396575927734GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75216) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 18:56:55 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:56:55 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:56:55 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance a1a3e849-6570-4820-97c8-75468b5bea4f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 18:56:55 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance d589d57e-de50-482a-843f-e8246b3d7528 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 18:56:55 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance 85624c58-6c72-4490-8a3e-547953295ade actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 18:56:55 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance 14d378b0-79ba-4161-a795-6288939c6fef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 18:56:55 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 18:56:55 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance d9a1edfb-c2ac-4e67-abac-c915ea22a15c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 18:56:55 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance 91ea8a19-a365-484c-80c7-baf90e7dd1aa actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 18:56:55 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance 3f08c061-312d-42d3-a811-e98ace4e7a63 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 18:56:55 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance 1e5f1164-a15e-40cf-b7bc-5aeb404a1216 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 18:56:55 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance 2f074d68-d0a7-4204-a79d-be619ee42d0c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 18:56:55 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 18:56:55 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 18:56:55 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 18:56:55 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 18:56:55 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Compute_service record updated for user:user {{(pid=75216) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 18:56:55 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.498s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:56:56 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:56:56 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Starting heal instance info cache {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 18:56:56 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Rebuilding the list of instances to heal {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 13 18:56:56 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "refresh_cache-a1a3e849-6570-4820-97c8-75468b5bea4f" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 18:56:56 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquired lock "refresh_cache-a1a3e849-6570-4820-97c8-75468b5bea4f" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 18:56:56 user nova-compute[75216]: DEBUG nova.network.neutron [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: a1a3e849-6570-4820-97c8-75468b5bea4f] Forcefully refreshing network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 18:56:56 user nova-compute[75216]: DEBUG nova.objects.instance [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lazy-loading 'info_cache' on Instance uuid a1a3e849-6570-4820-97c8-75468b5bea4f {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 18:56:57 user nova-compute[75216]: DEBUG nova.network.neutron [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: a1a3e849-6570-4820-97c8-75468b5bea4f] Updating instance_info_cache with network_info: [{"id": "3544d3e3-8dfa-4043-b225-77f690cd3760", "address": "fa:16:3e:9e:b9:f7", "network": {"id": "d7a691f0-4495-40ad-a349-91b5dc9c635a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-961583097-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9b7e11038e54e368acd22d06e54a351", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3544d3e3-8d", "ovs_interfaceid": "3544d3e3-8dfa-4043-b225-77f690cd3760", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 18:56:57 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Releasing lock "refresh_cache-a1a3e849-6570-4820-97c8-75468b5bea4f" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 18:56:57 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: a1a3e849-6570-4820-97c8-75468b5bea4f] Updated the network info_cache for instance {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 18:56:57 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:56:57 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:56:57 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:56:57 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:56:58 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:57:03 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:57:03 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:57:03 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75216) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 18:57:03 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 18:57:03 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 18:57:03 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:57:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:57:09 user nova-compute[75216]: INFO nova.compute.manager [None req-7c7d47f3-3e26-4e52-8ae4-7d540f67e13d tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] [instance: d9a1edfb-c2ac-4e67-abac-c915ea22a15c] Unrescuing
Nov 13 18:57:09 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-7c7d47f3-3e26-4e52-8ae4-7d540f67e13d tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Acquiring lock "refresh_cache-d9a1edfb-c2ac-4e67-abac-c915ea22a15c" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 18:57:09 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-7c7d47f3-3e26-4e52-8ae4-7d540f67e13d tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Acquired lock "refresh_cache-d9a1edfb-c2ac-4e67-abac-c915ea22a15c" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 18:57:09 user nova-compute[75216]: DEBUG nova.network.neutron [None req-7c7d47f3-3e26-4e52-8ae4-7d540f67e13d tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] [instance: d9a1edfb-c2ac-4e67-abac-c915ea22a15c] Building network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 18:57:09 user nova-compute[75216]: DEBUG nova.network.neutron [None req-7c7d47f3-3e26-4e52-8ae4-7d540f67e13d tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] [instance: d9a1edfb-c2ac-4e67-abac-c915ea22a15c] Updating instance_info_cache with network_info: [{"id": "eb2895a9-124a-4504-b197-bb2022f3f55f", "address": "fa:16:3e:8d:84:60", "network": {"id": "6d182db1-03b5-4d1b-86cf-b9367921b7b0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1877006951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2efafc26c47c4050bd367c47469999fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb2895a9-12", "ovs_interfaceid": "eb2895a9-124a-4504-b197-bb2022f3f55f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 18:57:09 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-7c7d47f3-3e26-4e52-8ae4-7d540f67e13d tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Releasing lock "refresh_cache-d9a1edfb-c2ac-4e67-abac-c915ea22a15c" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 18:57:09 user nova-compute[75216]: DEBUG nova.objects.instance [None req-7c7d47f3-3e26-4e52-8ae4-7d540f67e13d tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Lazy-loading 'flavor' on Instance uuid d9a1edfb-c2ac-4e67-abac-c915ea22a15c {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 18:57:09 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:57:09 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:57:10 user nova-compute[75216]: DEBUG nova.compute.manager [req-2eaf859a-06f0-478b-89d0-af812f3fce08 req-998dc976-9603-4de2-af82-f8c0fa3fc5a6 service nova] [instance: d9a1edfb-c2ac-4e67-abac-c915ea22a15c] Received event network-vif-unplugged-eb2895a9-124a-4504-b197-bb2022f3f55f {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:57:10 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-2eaf859a-06f0-478b-89d0-af812f3fce08 req-998dc976-9603-4de2-af82-f8c0fa3fc5a6 service nova] Acquiring lock "d9a1edfb-c2ac-4e67-abac-c915ea22a15c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:57:10 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-2eaf859a-06f0-478b-89d0-af812f3fce08 req-998dc976-9603-4de2-af82-f8c0fa3fc5a6 service nova] Lock "d9a1edfb-c2ac-4e67-abac-c915ea22a15c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:57:10 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-2eaf859a-06f0-478b-89d0-af812f3fce08 req-998dc976-9603-4de2-af82-f8c0fa3fc5a6 service nova] Lock "d9a1edfb-c2ac-4e67-abac-c915ea22a15c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:57:10 user nova-compute[75216]: DEBUG nova.compute.manager [req-2eaf859a-06f0-478b-89d0-af812f3fce08 req-998dc976-9603-4de2-af82-f8c0fa3fc5a6 service nova] [instance: d9a1edfb-c2ac-4e67-abac-c915ea22a15c] No waiting events found dispatching network-vif-unplugged-eb2895a9-124a-4504-b197-bb2022f3f55f {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:57:10 user nova-compute[75216]: WARNING nova.compute.manager [req-2eaf859a-06f0-478b-89d0-af812f3fce08 req-998dc976-9603-4de2-af82-f8c0fa3fc5a6 service nova] [instance: d9a1edfb-c2ac-4e67-abac-c915ea22a15c] Received unexpected event network-vif-unplugged-eb2895a9-124a-4504-b197-bb2022f3f55f for instance with vm_state rescued and task_state unrescuing.
Nov 13 18:57:10 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:57:10 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:57:10 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:57:10 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: d9a1edfb-c2ac-4e67-abac-c915ea22a15c] Instance destroyed successfully.
Nov 13 18:57:11 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:57:11 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:57:11 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:57:11 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:57:12 user nova-compute[75216]: DEBUG nova.compute.manager [req-b05f2970-ed53-4a50-a482-1e7fa7cb3167 req-8ca2be93-6a70-4dcc-88ca-ce4232ec48cd service nova] [instance: d9a1edfb-c2ac-4e67-abac-c915ea22a15c] Received event network-vif-plugged-eb2895a9-124a-4504-b197-bb2022f3f55f {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:57:12 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-b05f2970-ed53-4a50-a482-1e7fa7cb3167 req-8ca2be93-6a70-4dcc-88ca-ce4232ec48cd service nova] Acquiring lock "d9a1edfb-c2ac-4e67-abac-c915ea22a15c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:57:12 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-b05f2970-ed53-4a50-a482-1e7fa7cb3167 req-8ca2be93-6a70-4dcc-88ca-ce4232ec48cd service nova] Lock "d9a1edfb-c2ac-4e67-abac-c915ea22a15c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:57:12 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-b05f2970-ed53-4a50-a482-1e7fa7cb3167 req-8ca2be93-6a70-4dcc-88ca-ce4232ec48cd service nova] Lock "d9a1edfb-c2ac-4e67-abac-c915ea22a15c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:57:12 user nova-compute[75216]: DEBUG nova.compute.manager [req-b05f2970-ed53-4a50-a482-1e7fa7cb3167 req-8ca2be93-6a70-4dcc-88ca-ce4232ec48cd service nova] [instance: d9a1edfb-c2ac-4e67-abac-c915ea22a15c] No waiting events found dispatching network-vif-plugged-eb2895a9-124a-4504-b197-bb2022f3f55f {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:57:12 user nova-compute[75216]: WARNING nova.compute.manager [req-b05f2970-ed53-4a50-a482-1e7fa7cb3167 req-8ca2be93-6a70-4dcc-88ca-ce4232ec48cd service nova] [instance: d9a1edfb-c2ac-4e67-abac-c915ea22a15c] Received unexpected event network-vif-plugged-eb2895a9-124a-4504-b197-bb2022f3f55f for instance with vm_state rescued and task_state unrescuing.
Nov 13 18:57:12 user nova-compute[75216]: DEBUG nova.compute.manager [req-b05f2970-ed53-4a50-a482-1e7fa7cb3167 req-8ca2be93-6a70-4dcc-88ca-ce4232ec48cd service nova] [instance: d9a1edfb-c2ac-4e67-abac-c915ea22a15c] Received event network-vif-plugged-eb2895a9-124a-4504-b197-bb2022f3f55f {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:57:12 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-b05f2970-ed53-4a50-a482-1e7fa7cb3167 req-8ca2be93-6a70-4dcc-88ca-ce4232ec48cd service nova] Acquiring lock "d9a1edfb-c2ac-4e67-abac-c915ea22a15c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:57:12 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-b05f2970-ed53-4a50-a482-1e7fa7cb3167 req-8ca2be93-6a70-4dcc-88ca-ce4232ec48cd service nova] Lock "d9a1edfb-c2ac-4e67-abac-c915ea22a15c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:57:12 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-b05f2970-ed53-4a50-a482-1e7fa7cb3167 req-8ca2be93-6a70-4dcc-88ca-ce4232ec48cd service nova] Lock "d9a1edfb-c2ac-4e67-abac-c915ea22a15c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:57:12 user nova-compute[75216]: DEBUG nova.compute.manager [req-b05f2970-ed53-4a50-a482-1e7fa7cb3167 req-8ca2be93-6a70-4dcc-88ca-ce4232ec48cd service nova] [instance: d9a1edfb-c2ac-4e67-abac-c915ea22a15c] No waiting events found dispatching network-vif-plugged-eb2895a9-124a-4504-b197-bb2022f3f55f {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:57:12 user nova-compute[75216]: WARNING nova.compute.manager [req-b05f2970-ed53-4a50-a482-1e7fa7cb3167 req-8ca2be93-6a70-4dcc-88ca-ce4232ec48cd service nova] [instance: d9a1edfb-c2ac-4e67-abac-c915ea22a15c] Received unexpected event network-vif-plugged-eb2895a9-124a-4504-b197-bb2022f3f55f for instance with vm_state rescued and task_state unrescuing.
Nov 13 18:57:12 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:57:12 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:57:13 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:57:13 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:57:14 user nova-compute[75216]: DEBUG nova.compute.manager [None req-7c7d47f3-3e26-4e52-8ae4-7d540f67e13d tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] [instance: d9a1edfb-c2ac-4e67-abac-c915ea22a15c] Checking state {{(pid=75216) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 18:57:14 user nova-compute[75216]: DEBUG nova.compute.manager [req-c71620d3-da39-4336-b62b-a524a0c6b328 req-a5df1f0f-38dd-42d6-bc7c-adf6df60c96d service nova] [instance: d9a1edfb-c2ac-4e67-abac-c915ea22a15c] Received event network-vif-plugged-eb2895a9-124a-4504-b197-bb2022f3f55f {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:57:14 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-c71620d3-da39-4336-b62b-a524a0c6b328 req-a5df1f0f-38dd-42d6-bc7c-adf6df60c96d service nova] Acquiring lock "d9a1edfb-c2ac-4e67-abac-c915ea22a15c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:57:14 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-c71620d3-da39-4336-b62b-a524a0c6b328 req-a5df1f0f-38dd-42d6-bc7c-adf6df60c96d service nova] Lock "d9a1edfb-c2ac-4e67-abac-c915ea22a15c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:57:14 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-c71620d3-da39-4336-b62b-a524a0c6b328 req-a5df1f0f-38dd-42d6-bc7c-adf6df60c96d service nova] Lock "d9a1edfb-c2ac-4e67-abac-c915ea22a15c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:57:14 user nova-compute[75216]: DEBUG nova.compute.manager [req-c71620d3-da39-4336-b62b-a524a0c6b328 req-a5df1f0f-38dd-42d6-bc7c-adf6df60c96d service nova] [instance: d9a1edfb-c2ac-4e67-abac-c915ea22a15c] No waiting events found dispatching network-vif-plugged-eb2895a9-124a-4504-b197-bb2022f3f55f {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:57:14 user nova-compute[75216]: WARNING nova.compute.manager [req-c71620d3-da39-4336-b62b-a524a0c6b328 req-a5df1f0f-38dd-42d6-bc7c-adf6df60c96d service nova] [instance: d9a1edfb-c2ac-4e67-abac-c915ea22a15c] Received unexpected event network-vif-plugged-eb2895a9-124a-4504-b197-bb2022f3f55f for instance with vm_state active and task_state None.
Nov 13 18:57:18 user nova-compute[75216]: INFO nova.compute.manager [None req-2bb6dfd3-0e89-4391-8e50-2454ddd5d280 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: 1e5f1164-a15e-40cf-b7bc-5aeb404a1216] Rescuing
Nov 13 18:57:18 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-2bb6dfd3-0e89-4391-8e50-2454ddd5d280 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Acquiring lock "refresh_cache-1e5f1164-a15e-40cf-b7bc-5aeb404a1216" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 18:57:18 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-2bb6dfd3-0e89-4391-8e50-2454ddd5d280 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Acquired lock "refresh_cache-1e5f1164-a15e-40cf-b7bc-5aeb404a1216" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 18:57:18 user nova-compute[75216]: DEBUG nova.network.neutron [None req-2bb6dfd3-0e89-4391-8e50-2454ddd5d280 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: 1e5f1164-a15e-40cf-b7bc-5aeb404a1216] Building network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 18:57:18 user nova-compute[75216]: DEBUG nova.network.neutron [None req-2bb6dfd3-0e89-4391-8e50-2454ddd5d280 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: 1e5f1164-a15e-40cf-b7bc-5aeb404a1216] Updating instance_info_cache with network_info: [{"id": "96dfdc95-6a8e-43f3-8d7c-5b4f78a8f134", "address": "fa:16:3e:19:0b:3a", "network": {"id": "f8b821ef-8fae-42b9-9055-a9ea7be955ab", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-50594548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "903397a6c0474cfd8bd1a4fb338528aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96dfdc95-6a", "ovs_interfaceid": "96dfdc95-6a8e-43f3-8d7c-5b4f78a8f134", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 18:57:18 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-2bb6dfd3-0e89-4391-8e50-2454ddd5d280 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Releasing lock "refresh_cache-1e5f1164-a15e-40cf-b7bc-5aeb404a1216" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 18:57:18 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:57:19 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:57:19 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:57:19 user nova-compute[75216]: DEBUG nova.compute.manager [req-ec0b5731-565f-4372-ba1c-e6bc3fbbad54 req-e264c9da-46c6-477b-ba5d-63d0e6e9006b service nova] [instance: 1e5f1164-a15e-40cf-b7bc-5aeb404a1216] Received event network-vif-unplugged-96dfdc95-6a8e-43f3-8d7c-5b4f78a8f134 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:57:19 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-ec0b5731-565f-4372-ba1c-e6bc3fbbad54 req-e264c9da-46c6-477b-ba5d-63d0e6e9006b service nova] Acquiring lock "1e5f1164-a15e-40cf-b7bc-5aeb404a1216-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:57:19 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-ec0b5731-565f-4372-ba1c-e6bc3fbbad54 req-e264c9da-46c6-477b-ba5d-63d0e6e9006b service nova] Lock "1e5f1164-a15e-40cf-b7bc-5aeb404a1216-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:57:19 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-ec0b5731-565f-4372-ba1c-e6bc3fbbad54 req-e264c9da-46c6-477b-ba5d-63d0e6e9006b service nova] Lock "1e5f1164-a15e-40cf-b7bc-5aeb404a1216-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:57:19 user nova-compute[75216]: DEBUG nova.compute.manager [req-ec0b5731-565f-4372-ba1c-e6bc3fbbad54 req-e264c9da-46c6-477b-ba5d-63d0e6e9006b service nova] [instance: 1e5f1164-a15e-40cf-b7bc-5aeb404a1216] No waiting events found dispatching network-vif-unplugged-96dfdc95-6a8e-43f3-8d7c-5b4f78a8f134 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:57:19 user nova-compute[75216]: WARNING nova.compute.manager [req-ec0b5731-565f-4372-ba1c-e6bc3fbbad54 req-e264c9da-46c6-477b-ba5d-63d0e6e9006b service nova] [instance: 1e5f1164-a15e-40cf-b7bc-5aeb404a1216] Received unexpected event network-vif-unplugged-96dfdc95-6a8e-43f3-8d7c-5b4f78a8f134 for instance with vm_state active and task_state rescuing.
Nov 13 18:57:19 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:57:19 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:57:19 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 1e5f1164-a15e-40cf-b7bc-5aeb404a1216] Instance destroyed successfully.
Nov 13 18:57:19 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-2bb6dfd3-0e89-4391-8e50-2454ddd5d280 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: 1e5f1164-a15e-40cf-b7bc-5aeb404a1216] Attempting a stable device rescue
Nov 13 18:57:19 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-2bb6dfd3-0e89-4391-8e50-2454ddd5d280 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75216) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 13 18:57:19 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-2bb6dfd3-0e89-4391-8e50-2454ddd5d280 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: 1e5f1164-a15e-40cf-b7bc-5aeb404a1216] Instance directory exists: not creating {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 13 18:57:19 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-2bb6dfd3-0e89-4391-8e50-2454ddd5d280 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: 1e5f1164-a15e-40cf-b7bc-5aeb404a1216] Creating image(s)
Nov 13 18:57:19 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-2bb6dfd3-0e89-4391-8e50-2454ddd5d280 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Acquiring lock "/opt/stack/data/nova/instances/1e5f1164-a15e-40cf-b7bc-5aeb404a1216/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:57:19 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-2bb6dfd3-0e89-4391-8e50-2454ddd5d280 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Lock "/opt/stack/data/nova/instances/1e5f1164-a15e-40cf-b7bc-5aeb404a1216/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:57:19 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-2bb6dfd3-0e89-4391-8e50-2454ddd5d280 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Lock "/opt/stack/data/nova/instances/1e5f1164-a15e-40cf-b7bc-5aeb404a1216/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:57:19 user nova-compute[75216]: DEBUG nova.objects.instance [None req-2bb6dfd3-0e89-4391-8e50-2454ddd5d280 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Lazy-loading 'trusted_certs' on Instance uuid 1e5f1164-a15e-40cf-b7bc-5aeb404a1216 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 18:57:19 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-2bb6dfd3-0e89-4391-8e50-2454ddd5d280 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Acquiring lock "a8743d5a88207b520489f05b745c820c739d74ca" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:57:19 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-2bb6dfd3-0e89-4391-8e50-2454ddd5d280 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Lock "a8743d5a88207b520489f05b745c820c739d74ca" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:57:20 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-2bb6dfd3-0e89-4391-8e50-2454ddd5d280 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8743d5a88207b520489f05b745c820c739d74ca.part --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:57:21 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-2bb6dfd3-0e89-4391-8e50-2454ddd5d280 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8743d5a88207b520489f05b745c820c739d74ca.part --force-share --output=json" returned: 0 in 0.175s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:57:21 user nova-compute[75216]: DEBUG nova.virt.images [None req-2bb6dfd3-0e89-4391-8e50-2454ddd5d280 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] fefddf3a-31dc-45fa-a827-444a58ab58bf was qcow2, converting to raw {{(pid=75216) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 13 18:57:21 user nova-compute[75216]: DEBUG nova.privsep.utils [None req-2bb6dfd3-0e89-4391-8e50-2454ddd5d280 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75216) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 13 18:57:21 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-2bb6dfd3-0e89-4391-8e50-2454ddd5d280 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a8743d5a88207b520489f05b745c820c739d74ca.part /opt/stack/data/nova/instances/_base/a8743d5a88207b520489f05b745c820c739d74ca.converted {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:57:21 user nova-compute[75216]: DEBUG nova.compute.manager [req-15d34c7a-47de-41ee-9fbb-67033951b0c8 req-dcafa911-fd82-493e-b9a9-ac1f1b35d1b5 service nova] [instance: 1e5f1164-a15e-40cf-b7bc-5aeb404a1216] Received event network-vif-plugged-96dfdc95-6a8e-43f3-8d7c-5b4f78a8f134 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:57:21 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-15d34c7a-47de-41ee-9fbb-67033951b0c8 req-dcafa911-fd82-493e-b9a9-ac1f1b35d1b5 service nova] Acquiring lock "1e5f1164-a15e-40cf-b7bc-5aeb404a1216-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:57:21 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-15d34c7a-47de-41ee-9fbb-67033951b0c8 req-dcafa911-fd82-493e-b9a9-ac1f1b35d1b5 service nova] Lock "1e5f1164-a15e-40cf-b7bc-5aeb404a1216-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:57:21 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-15d34c7a-47de-41ee-9fbb-67033951b0c8 req-dcafa911-fd82-493e-b9a9-ac1f1b35d1b5 service nova] Lock "1e5f1164-a15e-40cf-b7bc-5aeb404a1216-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:57:21 user nova-compute[75216]: DEBUG nova.compute.manager [req-15d34c7a-47de-41ee-9fbb-67033951b0c8 req-dcafa911-fd82-493e-b9a9-ac1f1b35d1b5 service nova] [instance: 1e5f1164-a15e-40cf-b7bc-5aeb404a1216] No waiting events found dispatching network-vif-plugged-96dfdc95-6a8e-43f3-8d7c-5b4f78a8f134 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:57:21 user nova-compute[75216]: WARNING nova.compute.manager [req-15d34c7a-47de-41ee-9fbb-67033951b0c8 req-dcafa911-fd82-493e-b9a9-ac1f1b35d1b5 service nova] [instance: 1e5f1164-a15e-40cf-b7bc-5aeb404a1216] Received unexpected event network-vif-plugged-96dfdc95-6a8e-43f3-8d7c-5b4f78a8f134 for instance with vm_state active and task_state rescuing.
Nov 13 18:57:21 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-2bb6dfd3-0e89-4391-8e50-2454ddd5d280 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a8743d5a88207b520489f05b745c820c739d74ca.part /opt/stack/data/nova/instances/_base/a8743d5a88207b520489f05b745c820c739d74ca.converted" returned: 0 in 0.584s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:57:21 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-2bb6dfd3-0e89-4391-8e50-2454ddd5d280 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8743d5a88207b520489f05b745c820c739d74ca.converted --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:57:21 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-2bb6dfd3-0e89-4391-8e50-2454ddd5d280 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8743d5a88207b520489f05b745c820c739d74ca.converted --force-share --output=json" returned: 0 in 0.170s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:57:21 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-2bb6dfd3-0e89-4391-8e50-2454ddd5d280 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Lock "a8743d5a88207b520489f05b745c820c739d74ca" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.965s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:57:21 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-2bb6dfd3-0e89-4391-8e50-2454ddd5d280 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Acquiring lock "a8743d5a88207b520489f05b745c820c739d74ca" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:57:21 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-2bb6dfd3-0e89-4391-8e50-2454ddd5d280 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Lock "a8743d5a88207b520489f05b745c820c739d74ca" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:57:21 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-2bb6dfd3-0e89-4391-8e50-2454ddd5d280 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8743d5a88207b520489f05b745c820c739d74ca --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:57:22 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-2bb6dfd3-0e89-4391-8e50-2454ddd5d280 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8743d5a88207b520489f05b745c820c739d74ca --force-share --output=json" returned: 0 in 0.164s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:57:22 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-2bb6dfd3-0e89-4391-8e50-2454ddd5d280 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a8743d5a88207b520489f05b745c820c739d74ca,backing_fmt=raw /opt/stack/data/nova/instances/1e5f1164-a15e-40cf-b7bc-5aeb404a1216/disk.rescue {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:57:22 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-2bb6dfd3-0e89-4391-8e50-2454ddd5d280 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a8743d5a88207b520489f05b745c820c739d74ca,backing_fmt=raw /opt/stack/data/nova/instances/1e5f1164-a15e-40cf-b7bc-5aeb404a1216/disk.rescue" returned: 0 in 0.051s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:57:22 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-2bb6dfd3-0e89-4391-8e50-2454ddd5d280 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Lock "a8743d5a88207b520489f05b745c820c739d74ca" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.223s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:57:22 user nova-compute[75216]: DEBUG nova.objects.instance [None req-2bb6dfd3-0e89-4391-8e50-2454ddd5d280 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Lazy-loading 'migration_context' on Instance uuid 1e5f1164-a15e-40cf-b7bc-5aeb404a1216 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 18:57:22 user nova-compute[75216]: DEBUG nova.objects.base [None req-2bb6dfd3-0e89-4391-8e50-2454ddd5d280 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Object Instance<1e5f1164-a15e-40cf-b7bc-5aeb404a1216> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75216) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 18:57:22 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-2bb6dfd3-0e89-4391-8e50-2454ddd5d280 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: 1e5f1164-a15e-40cf-b7bc-5aeb404a1216] Created local disks {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 18:57:22 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-2bb6dfd3-0e89-4391-8e50-2454ddd5d280 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: 1e5f1164-a15e-40cf-b7bc-5aeb404a1216] Start _get_guest_xml network_info=[{"id": "96dfdc95-6a8e-43f3-8d7c-5b4f78a8f134", "address": "fa:16:3e:19:0b:3a", "network": {"id": "f8b821ef-8fae-42b9-9055-a9ea7be955ab", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-50594548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-50594548-network", "vif_mac": "fa:16:3e:19:0b:3a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "903397a6c0474cfd8bd1a4fb338528aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96dfdc95-6a", "ovs_interfaceid": "96dfdc95-6a8e-43f3-8d7c-5b4f78a8f134", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T18:41:06Z,direct_url=<?>,disk_format='qcow2',id=77bcb5ba-8510-41ec-a88d-96097bb431de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c465b7c26ec44582b6d1b7169536ecc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T18:41:07Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'fefddf3a-31dc-45fa-a827-444a58ab58bf', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RAbjhwID', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '1e5f1164-a15e-40cf-b7bc-5aeb404a1216', 'attached_at': '', 'detached_at': '', 'volume_id': '7e02966c-e269-45a8-8773-1dba3abaf1a1', 'serial': '7e02966c-e269-45a8-8773-1dba3abaf1a1'}, 'attachment_id': 'f1079bcf-5407-4e87-beca-c3c05ab56334', 'guest_format': None, 'mount_device': '/dev/vda', 'delete_on_termination': False, 'boot_index': 0, 'volume_type': None} {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 18:57:22 user nova-compute[75216]: DEBUG nova.objects.instance [None req-2bb6dfd3-0e89-4391-8e50-2454ddd5d280 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Lazy-loading 'resources' on Instance uuid 1e5f1164-a15e-40cf-b7bc-5aeb404a1216 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 18:57:22 user nova-compute[75216]: DEBUG nova.objects.base [None req-2bb6dfd3-0e89-4391-8e50-2454ddd5d280 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Object Instance<1e5f1164-a15e-40cf-b7bc-5aeb404a1216> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75216) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 18:57:22 user nova-compute[75216]: DEBUG nova.objects.instance [None req-2bb6dfd3-0e89-4391-8e50-2454ddd5d280 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Lazy-loading 'numa_topology' on Instance uuid 1e5f1164-a15e-40cf-b7bc-5aeb404a1216 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 18:57:22 user nova-compute[75216]: DEBUG nova.objects.base [None req-2bb6dfd3-0e89-4391-8e50-2454ddd5d280 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Object Instance<1e5f1164-a15e-40cf-b7bc-5aeb404a1216> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75216) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 18:57:22 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-2bb6dfd3-0e89-4391-8e50-2454ddd5d280 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 18:57:22 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-2bb6dfd3-0e89-4391-8e50-2454ddd5d280 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 18:57:22 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-2bb6dfd3-0e89-4391-8e50-2454ddd5d280 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 18:57:22 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-2bb6dfd3-0e89-4391-8e50-2454ddd5d280 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] CPU controller missing on host. {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 18:57:22 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-2bb6dfd3-0e89-4391-8e50-2454ddd5d280 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 18:57:22 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-2bb6dfd3-0e89-4391-8e50-2454ddd5d280 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] CPU controller found on host. {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 18:57:22 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-2bb6dfd3-0e89-4391-8e50-2454ddd5d280 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75216) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 18:57:22 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-2bb6dfd3-0e89-4391-8e50-2454ddd5d280 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T18:40:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T18:41:06Z,direct_url=<?>,disk_format='qcow2',id=77bcb5ba-8510-41ec-a88d-96097bb431de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c465b7c26ec44582b6d1b7169536ecc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T18:41:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 18:57:22 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-2bb6dfd3-0e89-4391-8e50-2454ddd5d280 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Flavor limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 18:57:22 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-2bb6dfd3-0e89-4391-8e50-2454ddd5d280 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Image limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 18:57:22 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-2bb6dfd3-0e89-4391-8e50-2454ddd5d280 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Flavor pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 18:57:22 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-2bb6dfd3-0e89-4391-8e50-2454ddd5d280 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Image pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 18:57:22 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-2bb6dfd3-0e89-4391-8e50-2454ddd5d280 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 18:57:22 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-2bb6dfd3-0e89-4391-8e50-2454ddd5d280 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 18:57:22 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-2bb6dfd3-0e89-4391-8e50-2454ddd5d280 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 18:57:22 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-2bb6dfd3-0e89-4391-8e50-2454ddd5d280 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Got 1 possible topologies {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 18:57:22 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-2bb6dfd3-0e89-4391-8e50-2454ddd5d280 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 18:57:22 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-2bb6dfd3-0e89-4391-8e50-2454ddd5d280 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 18:57:22 user nova-compute[75216]: DEBUG nova.objects.instance [None req-2bb6dfd3-0e89-4391-8e50-2454ddd5d280 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Lazy-loading 'vcpu_model' on Instance uuid 1e5f1164-a15e-40cf-b7bc-5aeb404a1216 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 18:57:22 user nova-compute[75216]: DEBUG nova.objects.base [None req-2bb6dfd3-0e89-4391-8e50-2454ddd5d280 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Object Instance<1e5f1164-a15e-40cf-b7bc-5aeb404a1216> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75216) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 18:57:22 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2bb6dfd3-0e89-4391-8e50-2454ddd5d280 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: 1e5f1164-a15e-40cf-b7bc-5aeb404a1216] Calling os-brick to attach iSCSI Volume {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 18:57:22 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bb6dfd3-0e89-4391-8e50-2454ddd5d280 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3a8669e40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RAbjhwID', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 18:57:22 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-2bb6dfd3-0e89-4391-8e50-2454ddd5d280 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 18:57:22 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-2bb6dfd3-0e89-4391-8e50-2454ddd5d280 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 18:57:22 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-2bb6dfd3-0e89-4391-8e50-2454ddd5d280 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 18:57:22 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-2bb6dfd3-0e89-4391-8e50-2454ddd5d280 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 18:57:22 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-2bb6dfd3-0e89-4391-8e50-2454ddd5d280 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 18:57:22 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-2bb6dfd3-0e89-4391-8e50-2454ddd5d280 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 18:57:22 user nova-compute[75216]: INFO os_brick.initiator.connectors.iscsi [None req-2bb6dfd3-0e89-4391-8e50-2454ddd5d280 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 18:57:22 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1 -p 172.16.0.220:3260 {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:57:22 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1 -p 172.16.0.220:3260" returned: 0 in 0.019s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:57:22 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[9277aea8-6997-45b0-a71d-2e3b66b388ca]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = RAbjhwID\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:57:22 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bb6dfd3-0e89-4391-8e50-2454ddd5d280 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 13 18:57:22 user nova-compute[75216]: node.name = iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1
Nov 13 18:57:22 user nova-compute[75216]: node.tpgt = -1
Nov 13 18:57:22 user nova-compute[75216]: node.startup = automatic
Nov 13 18:57:22 user nova-compute[75216]: node.leading_login = No
Nov 13 18:57:22 user nova-compute[75216]: iface.iscsi_ifacename = default
Nov 13 18:57:22 user nova-compute[75216]: iface.net_ifacename = <empty>
Nov 13 18:57:22 user nova-compute[75216]: iface.ipaddress = <empty>
Nov 13 18:57:22 user nova-compute[75216]: iface.prefix_len = 0
Nov 13 18:57:22 user nova-compute[75216]: iface.hwaddress = <empty>
Nov 13 18:57:22 user nova-compute[75216]: iface.transport_name = tcp
Nov 13 18:57:22 user nova-compute[75216]: iface.initiatorname = <empty>
Nov 13 18:57:22 user nova-compute[75216]: iface.state = <empty>
Nov 13 18:57:22 user nova-compute[75216]: iface.vlan_id = 0
Nov 13 18:57:22 user nova-compute[75216]: iface.vlan_priority = 0
Nov 13 18:57:22 user nova-compute[75216]: iface.vlan_state = <empty>
Nov 13 18:57:22 user nova-compute[75216]: iface.iface_num = 0
Nov 13 18:57:22 user nova-compute[75216]: iface.mtu = 0
Nov 13 18:57:22 user nova-compute[75216]: iface.port = 0
Nov 13 18:57:22 user nova-compute[75216]: iface.bootproto = <empty>
Nov 13 18:57:22 user nova-compute[75216]: iface.subnet_mask = <empty>
Nov 13 18:57:22 user nova-compute[75216]: iface.gateway = <empty>
Nov 13 18:57:22 user nova-compute[75216]: iface.dhcp_alt_client_id_state = <empty>
Nov 13 18:57:22 user nova-compute[75216]: iface.dhcp_alt_client_id = <empty>
Nov 13 18:57:22 user nova-compute[75216]: iface.dhcp_dns = <empty>
Nov 13 18:57:22 user nova-compute[75216]: iface.dhcp_learn_iqn = <empty>
Nov 13 18:57:22 user nova-compute[75216]: iface.dhcp_req_vendor_id_state = <empty>
Nov 13 18:57:22 user nova-compute[75216]: iface.dhcp_vendor_id_state = <empty>
Nov 13 18:57:22 user nova-compute[75216]: iface.dhcp_vendor_id = <empty>
Nov 13 18:57:22 user nova-compute[75216]: iface.dhcp_slp_da = <empty>
Nov 13 18:57:22 user nova-compute[75216]: iface.fragmentation = <empty>
Nov 13 18:57:22 user nova-compute[75216]: iface.gratuitous_arp = <empty>
Nov 13 18:57:22 user nova-compute[75216]: iface.incoming_forwarding = <empty>
Nov 13 18:57:22 user nova-compute[75216]: iface.tos_state = <empty>
Nov 13 18:57:22 user nova-compute[75216]: iface.tos = 0
Nov 13 18:57:22 user nova-compute[75216]: iface.ttl = 0
Nov 13 18:57:22 user nova-compute[75216]: iface.delayed_ack = <empty>
Nov 13 18:57:22 user nova-compute[75216]: iface.tcp_nagle = <empty>
Nov 13 18:57:22 user nova-compute[75216]: iface.tcp_wsf_state = <empty>
Nov 13 18:57:22 user nova-compute[75216]: iface.tcp_wsf = 0
Nov 13 18:57:22 user nova-compute[75216]: iface.tcp_timer_scale = 0
Nov 13 18:57:22 user nova-compute[75216]: iface.tcp_timestamp = <empty>
Nov 13 18:57:22 user nova-compute[75216]: iface.redirect = <empty>
Nov 13 18:57:22 user nova-compute[75216]: iface.def_task_mgmt_timeout = 0
Nov 13 18:57:22 user nova-compute[75216]: iface.header_digest = <empty>
Nov 13 18:57:22 user nova-compute[75216]: iface.data_digest = <empty>
Nov 13 18:57:22 user nova-compute[75216]: iface.immediate_data = <empty>
Nov 13 18:57:22 user nova-compute[75216]: iface.initial_r2t = <empty>
Nov 13 18:57:22 user nova-compute[75216]: iface.data_seq_inorder = <empty>
Nov 13 18:57:22 user nova-compute[75216]: iface.data_pdu_inorder = <empty>
Nov 13 18:57:22 user nova-compute[75216]: iface.erl = 0
Nov 13 18:57:22 user nova-compute[75216]: iface.max_receive_data_len = 0
Nov 13 18:57:22 user nova-compute[75216]: iface.first_burst_len = 0
Nov 13 18:57:22 user nova-compute[75216]: iface.max_outstanding_r2t = 0
Nov 13 18:57:22 user nova-compute[75216]: iface.max_burst_len = 0
Nov 13 18:57:22 user nova-compute[75216]: iface.chap_auth = <empty>
Nov 13 18:57:22 user nova-compute[75216]: iface.bidi_chap = <empty>
Nov 13 18:57:22 user nova-compute[75216]: iface.strict_login_compliance = <empty>
Nov 13 18:57:22 user nova-compute[75216]: iface.discovery_auth = <empty>
Nov 13 18:57:22 user nova-compute[75216]: iface.discovery_logout = <empty>
Nov 13 18:57:22 user nova-compute[75216]: node.discovery_address = <empty>
Nov 13 18:57:22 user nova-compute[75216]: node.discovery_port = 0
Nov 13 18:57:22 user nova-compute[75216]: node.discovery_type = static
Nov 13 18:57:22 user nova-compute[75216]: node.session.initial_cmdsn = 0
Nov 13 18:57:22 user nova-compute[75216]: node.session.initial_login_retry_max = 8
Nov 13 18:57:22 user nova-compute[75216]: node.session.xmit_thread_priority = -20
Nov 13 18:57:22 user nova-compute[75216]: node.session.cmds_max = 128
Nov 13 18:57:22 user nova-compute[75216]: node.session.queue_depth = 32
Nov 13 18:57:22 user nova-compute[75216]: node.session.nr_sessions = 1
Nov 13 18:57:22 user nova-compute[75216]: node.session.auth.authmethod = CHAP
Nov 13 18:57:22 user nova-compute[75216]: node.session.auth.username = RAbjhwID
Nov 13 18:57:22 user nova-compute[75216]: node.session.auth.password = ***
Nov 13 18:57:22 user nova-compute[75216]: node.session.auth.username_in = <empty>
Nov 13 18:57:22 user nova-compute[75216]: node.session.auth.password_in = <empty>
Nov 13 18:57:22 user nova-compute[75216]: node.session.auth.chap_algs = MD5
Nov 13 18:57:22 user nova-compute[75216]: node.session.timeo.replacement_timeout = 120
Nov 13 18:57:22 user nova-compute[75216]: node.session.err_timeo.abort_timeout = 15
Nov 13 18:57:22 user nova-compute[75216]: node.session.err_timeo.lu_reset_timeout = 30
Nov 13 18:57:22 user nova-compute[75216]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 13 18:57:22 user nova-compute[75216]: node.session.err_timeo.host_reset_timeout = 60
Nov 13 18:57:22 user nova-compute[75216]: node.session.iscsi.FastAbort = Yes
Nov 13 18:57:22 user nova-compute[75216]: node.session.iscsi.InitialR2T = No
Nov 13 18:57:22 user nova-compute[75216]: node.session.iscsi.ImmediateData = Yes
Nov 13 18:57:22 user nova-compute[75216]: node.session.iscsi.FirstBurstLength = 262144
Nov 13 18:57:22 user nova-compute[75216]: node.session.iscsi.MaxBurstLength = 16776192
Nov 13 18:57:22 user nova-compute[75216]: node.session.iscsi.DefaultTime2Retain = 0
Nov 13 18:57:22 user nova-compute[75216]: node.session.iscsi.DefaultTime2Wait = 2
Nov 13 18:57:22 user nova-compute[75216]: node.session.iscsi.MaxConnections = 1
Nov 13 18:57:22 user nova-compute[75216]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 13 18:57:22 user nova-compute[75216]: node.session.iscsi.ERL = 0
Nov 13 18:57:22 user nova-compute[75216]: node.session.scan = manual
Nov 13 18:57:22 user nova-compute[75216]: node.session.reopen_max = 0
Nov 13 18:57:22 user nova-compute[75216]: node.conn[0].address = 172.16.0.220
Nov 13 18:57:22 user nova-compute[75216]: node.conn[0].port = 3260
Nov 13 18:57:22 user nova-compute[75216]: node.conn[0].startup = manual
Nov 13 18:57:22 user nova-compute[75216]: node.conn[0].tcp.window_size = 524288
Nov 13 18:57:22 user nova-compute[75216]: node.conn[0].tcp.type_of_service = 0
Nov 13 18:57:22 user nova-compute[75216]: node.conn[0].timeo.logout_timeout = 15
Nov 13 18:57:22 user nova-compute[75216]: node.conn[0].timeo.login_timeout = 15
Nov 13 18:57:22 user nova-compute[75216]: node.conn[0].timeo.auth_timeout = 45
Nov 13 18:57:22 user nova-compute[75216]: node.conn[0].timeo.noop_out_interval = 5
Nov 13 18:57:22 user nova-compute[75216]: node.conn[0].timeo.noop_out_timeout = 5
Nov 13 18:57:22 user nova-compute[75216]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 13 18:57:22 user nova-compute[75216]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 13 18:57:22 user nova-compute[75216]: node.conn[0].iscsi.HeaderDigest = None
Nov 13 18:57:22 user nova-compute[75216]: node.conn[0].iscsi.DataDigest = None
Nov 13 18:57:22 user nova-compute[75216]: node.conn[0].iscsi.IFMarker = No
Nov 13 18:57:22 user nova-compute[75216]: node.conn[0].iscsi.OFMarker = No
Nov 13 18:57:22 user nova-compute[75216]: # END RECORD
Nov 13 18:57:22 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:57:22 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:57:22 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:57:22 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ef4f0e0-c554-4fd2-a4f1-fcaa787a3c4b]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:57:22 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bb6dfd3-0e89-4391-8e50-2454ddd5d280 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:57:22 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:57:22 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:57:22 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[90f83c98-aff6-4490-a39a-f0451ddcf32f]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:57:22 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bb6dfd3-0e89-4391-8e50-2454ddd5d280 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:57:22 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RAbjhwID {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:57:22 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RAbjhwID" returned: 0 in 0.017s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:57:22 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7bb0971-bfed-4233-98d0-aa0c6a5285de]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:57:22 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bb6dfd3-0e89-4391-8e50-2454ddd5d280 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RAbjhwID'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:57:22 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:57:22 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:57:22 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[127554d0-97cd-46df-9ec1-ce4d3c0c8a07]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:57:22 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bb6dfd3-0e89-4391-8e50-2454ddd5d280 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:57:22 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:57:22 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:57:22 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d9e26f7-2326-4849-b39f-078cf4227575]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ee38de6-1fa4-460d-9bb4-49720104365b (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:671f1985-7823-411f-b273-6a6930de84e1 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a7c3d74-e183-497b-b6c7-85be2b2f171e (non-flash)\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:57:22 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bb6dfd3-0e89-4391-8e50-2454ddd5d280 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ee38de6-1fa4-460d-9bb4-49720104365b (non-flash)
Nov 13 18:57:22 user nova-compute[75216]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1 (non-flash)
Nov 13 18:57:22 user nova-compute[75216]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d (non-flash)
Nov 13 18:57:22 user nova-compute[75216]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:671f1985-7823-411f-b273-6a6930de84e1 (non-flash)
Nov 13 18:57:22 user nova-compute[75216]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a7c3d74-e183-497b-b6c7-85be2b2f171e (non-flash)
Nov 13 18:57:22 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 18:57:22 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bb6dfd3-0e89-4391-8e50-2454ddd5d280 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ee38de6-1fa4-460d-9bb4-49720104365b (non-flash)
Nov 13 18:57:22 user nova-compute[75216]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1 (non-flash)
Nov 13 18:57:22 user nova-compute[75216]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d (non-flash)
Nov 13 18:57:22 user nova-compute[75216]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:671f1985-7823-411f-b273-6a6930de84e1 (non-flash)
Nov 13 18:57:22 user nova-compute[75216]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a7c3d74-e183-497b-b6c7-85be2b2f171e (non-flash)
Nov 13 18:57:22 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 18:57:22 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-2bb6dfd3-0e89-4391-8e50-2454ddd5d280 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.140s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 18:57:22 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bb6dfd3-0e89-4391-8e50-2454ddd5d280 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Connected to 172.16.0.220:3260 {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 18:57:22 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-2bb6dfd3-0e89-4391-8e50-2454ddd5d280 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] HCTL ('33', '0', '0', 0) found on session 30 with lun 0 {{(pid=75216) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 18:57:22 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-2bb6dfd3-0e89-4391-8e50-2454ddd5d280 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=75216) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 18:57:22 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:57:22 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.013s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:57:22 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcaac272-1fd0-495d-94a8-0032d932bcb6]: (4, ('0 0 0', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:57:22 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-2bb6dfd3-0e89-4391-8e50-2454ddd5d280 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Searching for a device in session 30 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=75216) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 18:57:22 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bb6dfd3-0e89-4391-8e50-2454ddd5d280 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RAbjhwID', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 18:57:22 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-2bb6dfd3-0e89-4391-8e50-2454ddd5d280 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.162s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 18:57:22 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bb6dfd3-0e89-4391-8e50-2454ddd5d280 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] <== connect_volume: return (163ms) {'type': 'block', 'scsi_wwn': '26163306334623137', 'path': '/dev/sdb'} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 18:57:22 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2bb6dfd3-0e89-4391-8e50-2454ddd5d280 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: 1e5f1164-a15e-40cf-b7bc-5aeb404a1216] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26163306334623137', 'path': '/dev/sdb'} {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 18:57:22 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-2bb6dfd3-0e89-4391-8e50-2454ddd5d280 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T18:55:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1805019771',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1805019771',id=24,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-13T18:55:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='903397a6c0474cfd8bd1a4fb338528aa',ramdisk_id='',reservation_id='r-0t4799bp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-197527955',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T18:55:44Z,user_data=None,user_id='b381ea98871846b1bfb29a202a058208',uuid=1e5f1164-a15e-40cf-b7bc-5aeb404a1216,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "96dfdc95-6a8e-43f3-8d7c-5b4f78a8f134", "address": "fa:16:3e:19:0b:3a", "network": {"id": "f8b821ef-8fae-42b9-9055-a9ea7be955ab", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-50594548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-50594548-network", "vif_mac": "fa:16:3e:19:0b:3a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "903397a6c0474cfd8bd1a4fb338528aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96dfdc95-6a", "ovs_interfaceid": "96dfdc95-6a8e-43f3-8d7c-5b4f78a8f134", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75216) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 18:57:22 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-2bb6dfd3-0e89-4391-8e50-2454ddd5d280 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Converting VIF {"id": "96dfdc95-6a8e-43f3-8d7c-5b4f78a8f134", "address": "fa:16:3e:19:0b:3a", "network": {"id": "f8b821ef-8fae-42b9-9055-a9ea7be955ab", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-50594548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-50594548-network", "vif_mac": "fa:16:3e:19:0b:3a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "903397a6c0474cfd8bd1a4fb338528aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96dfdc95-6a", "ovs_interfaceid": "96dfdc95-6a8e-43f3-8d7c-5b4f78a8f134", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 18:57:22 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-2bb6dfd3-0e89-4391-8e50-2454ddd5d280 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:19:0b:3a,bridge_name='br-int',has_traffic_filtering=True,id=96dfdc95-6a8e-43f3-8d7c-5b4f78a8f134,network=Network(f8b821ef-8fae-42b9-9055-a9ea7be955ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96dfdc95-6a') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 18:57:22 user nova-compute[75216]: DEBUG nova.objects.instance [None req-2bb6dfd3-0e89-4391-8e50-2454ddd5d280 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Lazy-loading 'pci_devices' on Instance uuid 1e5f1164-a15e-40cf-b7bc-5aeb404a1216 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 18:57:22 user nova-compute[75216]: DEBUG nova.objects.base [None req-2bb6dfd3-0e89-4391-8e50-2454ddd5d280 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Object Instance<1e5f1164-a15e-40cf-b7bc-5aeb404a1216> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75216) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 18:57:22 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-2bb6dfd3-0e89-4391-8e50-2454ddd5d280 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: 1e5f1164-a15e-40cf-b7bc-5aeb404a1216] End _get_guest_xml xml=<domain type="kvm">
Nov 13 18:57:22 user nova-compute[75216]:   <uuid>1e5f1164-a15e-40cf-b7bc-5aeb404a1216</uuid>
Nov 13 18:57:22 user nova-compute[75216]:   <name>instance-00000018</name>
Nov 13 18:57:22 user nova-compute[75216]:   <memory>524288</memory>
Nov 13 18:57:22 user nova-compute[75216]:   <vcpu>1</vcpu>
Nov 13 18:57:22 user nova-compute[75216]:   <metadata>
Nov 13 18:57:22 user nova-compute[75216]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 18:57:22 user nova-compute[75216]:       <nova:package version="0.0.0"/>
Nov 13 18:57:22 user nova-compute[75216]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1805019771</nova:name>
Nov 13 18:57:22 user nova-compute[75216]:       <nova:creationTime>2023-11-13 18:57:22</nova:creationTime>
Nov 13 18:57:22 user nova-compute[75216]:       <nova:flavor name="m1.tiny">
Nov 13 18:57:22 user nova-compute[75216]:         <nova:memory>512</nova:memory>
Nov 13 18:57:22 user nova-compute[75216]:         <nova:disk>1</nova:disk>
Nov 13 18:57:22 user nova-compute[75216]:         <nova:swap>0</nova:swap>
Nov 13 18:57:22 user nova-compute[75216]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 18:57:22 user nova-compute[75216]:         <nova:vcpus>1</nova:vcpus>
Nov 13 18:57:22 user nova-compute[75216]:       </nova:flavor>
Nov 13 18:57:22 user nova-compute[75216]:       <nova:owner>
Nov 13 18:57:22 user nova-compute[75216]:         <nova:user uuid="b381ea98871846b1bfb29a202a058208">tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member</nova:user>
Nov 13 18:57:22 user nova-compute[75216]:         <nova:project uuid="903397a6c0474cfd8bd1a4fb338528aa">tempest-ServerBootFromVolumeStableRescueTest-197527955</nova:project>
Nov 13 18:57:22 user nova-compute[75216]:       </nova:owner>
Nov 13 18:57:22 user nova-compute[75216]:       <nova:root type="image" uuid="77bcb5ba-8510-41ec-a88d-96097bb431de"/>
Nov 13 18:57:22 user nova-compute[75216]:       <nova:ports>
Nov 13 18:57:22 user nova-compute[75216]:         <nova:port uuid="96dfdc95-6a8e-43f3-8d7c-5b4f78a8f134">
Nov 13 18:57:22 user nova-compute[75216]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 13 18:57:22 user nova-compute[75216]:         </nova:port>
Nov 13 18:57:22 user nova-compute[75216]:       </nova:ports>
Nov 13 18:57:22 user nova-compute[75216]:     </nova:instance>
Nov 13 18:57:22 user nova-compute[75216]:   </metadata>
Nov 13 18:57:22 user nova-compute[75216]:   <sysinfo type="smbios">
Nov 13 18:57:22 user nova-compute[75216]:     <system>
Nov 13 18:57:22 user nova-compute[75216]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 18:57:22 user nova-compute[75216]:       <entry name="product">OpenStack Nova</entry>
Nov 13 18:57:22 user nova-compute[75216]:       <entry name="version">0.0.0</entry>
Nov 13 18:57:22 user nova-compute[75216]:       <entry name="serial">1e5f1164-a15e-40cf-b7bc-5aeb404a1216</entry>
Nov 13 18:57:22 user nova-compute[75216]:       <entry name="uuid">1e5f1164-a15e-40cf-b7bc-5aeb404a1216</entry>
Nov 13 18:57:22 user nova-compute[75216]:       <entry name="family">Virtual Machine</entry>
Nov 13 18:57:22 user nova-compute[75216]:     </system>
Nov 13 18:57:22 user nova-compute[75216]:   </sysinfo>
Nov 13 18:57:22 user nova-compute[75216]:   <os>
Nov 13 18:57:22 user nova-compute[75216]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 18:57:22 user nova-compute[75216]:     <smbios mode="sysinfo"/>
Nov 13 18:57:22 user nova-compute[75216]:   </os>
Nov 13 18:57:22 user nova-compute[75216]:   <features>
Nov 13 18:57:22 user nova-compute[75216]:     <acpi/>
Nov 13 18:57:22 user nova-compute[75216]:     <apic/>
Nov 13 18:57:22 user nova-compute[75216]:     <vmcoreinfo/>
Nov 13 18:57:22 user nova-compute[75216]:   </features>
Nov 13 18:57:22 user nova-compute[75216]:   <clock offset="utc">
Nov 13 18:57:22 user nova-compute[75216]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 18:57:22 user nova-compute[75216]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 18:57:22 user nova-compute[75216]:     <timer name="hpet" present="no"/>
Nov 13 18:57:22 user nova-compute[75216]:   </clock>
Nov 13 18:57:22 user nova-compute[75216]:   <cpu mode="custom" match="exact">
Nov 13 18:57:22 user nova-compute[75216]:     <model>Nehalem</model>
Nov 13 18:57:22 user nova-compute[75216]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 18:57:22 user nova-compute[75216]:   </cpu>
Nov 13 18:57:22 user nova-compute[75216]:   <devices>
Nov 13 18:57:22 user nova-compute[75216]:     <disk type="block" device="disk">
Nov 13 18:57:22 user nova-compute[75216]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 18:57:22 user nova-compute[75216]:       <source dev="/dev/sdb"/>
Nov 13 18:57:22 user nova-compute[75216]:       <target dev="vda" bus="virtio"/>
Nov 13 18:57:22 user nova-compute[75216]:       <serial>7e02966c-e269-45a8-8773-1dba3abaf1a1</serial>
Nov 13 18:57:22 user nova-compute[75216]:     </disk>
Nov 13 18:57:22 user nova-compute[75216]:     <disk type="file" device="disk">
Nov 13 18:57:22 user nova-compute[75216]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 18:57:22 user nova-compute[75216]:       <source file="/opt/stack/data/nova/instances/1e5f1164-a15e-40cf-b7bc-5aeb404a1216/disk.rescue"/>
Nov 13 18:57:22 user nova-compute[75216]:       <target dev="vdb" bus="virtio"/>
Nov 13 18:57:22 user nova-compute[75216]:       <boot order="1"/>
Nov 13 18:57:22 user nova-compute[75216]:     </disk>
Nov 13 18:57:22 user nova-compute[75216]:     <interface type="ethernet">
Nov 13 18:57:22 user nova-compute[75216]:       <mac address="fa:16:3e:19:0b:3a"/>
Nov 13 18:57:22 user nova-compute[75216]:       <model type="virtio"/>
Nov 13 18:57:22 user nova-compute[75216]:       <mtu size="1442"/>
Nov 13 18:57:22 user nova-compute[75216]:       <target dev="tap96dfdc95-6a"/>
Nov 13 18:57:22 user nova-compute[75216]:     </interface>
Nov 13 18:57:22 user nova-compute[75216]:     <serial type="pty">
Nov 13 18:57:22 user nova-compute[75216]:       <log file="/opt/stack/data/nova/instances/1e5f1164-a15e-40cf-b7bc-5aeb404a1216/console.log" append="off"/>
Nov 13 18:57:22 user nova-compute[75216]:     </serial>
Nov 13 18:57:22 user nova-compute[75216]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 18:57:22 user nova-compute[75216]:     <video>
Nov 13 18:57:22 user nova-compute[75216]:       <model type="virtio"/>
Nov 13 18:57:22 user nova-compute[75216]:     </video>
Nov 13 18:57:22 user nova-compute[75216]:     <rng model="virtio">
Nov 13 18:57:22 user nova-compute[75216]:       <backend model="random">/dev/urandom</backend>
Nov 13 18:57:22 user nova-compute[75216]:     </rng>
Nov 13 18:57:22 user nova-compute[75216]:     <controller type="usb" index="0" model="none"/>
Nov 13 18:57:22 user nova-compute[75216]:     <memballoon model="virtio">
Nov 13 18:57:22 user nova-compute[75216]:       <stats period="10"/>
Nov 13 18:57:22 user nova-compute[75216]:     </memballoon>
Nov 13 18:57:22 user nova-compute[75216]:   </devices>
Nov 13 18:57:22 user nova-compute[75216]: </domain>
Nov 13 18:57:22 user nova-compute[75216]:  {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 18:57:22 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 1e5f1164-a15e-40cf-b7bc-5aeb404a1216] Instance destroyed successfully.
Nov 13 18:57:22 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-2bb6dfd3-0e89-4391-8e50-2454ddd5d280 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 18:57:22 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-2bb6dfd3-0e89-4391-8e50-2454ddd5d280 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 18:57:22 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-2bb6dfd3-0e89-4391-8e50-2454ddd5d280 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] No VIF found with MAC fa:16:3e:19:0b:3a, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 18:57:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:57:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:57:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:57:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:57:23 user nova-compute[75216]: DEBUG nova.compute.manager [req-e3c2c41a-2440-4983-84dc-4dba671f4465 req-d9175cf3-50c6-4554-a1d6-3ef737e2ca2d service nova] [instance: 1e5f1164-a15e-40cf-b7bc-5aeb404a1216] Received event network-vif-plugged-96dfdc95-6a8e-43f3-8d7c-5b4f78a8f134 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:57:23 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-e3c2c41a-2440-4983-84dc-4dba671f4465 req-d9175cf3-50c6-4554-a1d6-3ef737e2ca2d service nova] Acquiring lock "1e5f1164-a15e-40cf-b7bc-5aeb404a1216-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:57:23 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-e3c2c41a-2440-4983-84dc-4dba671f4465 req-d9175cf3-50c6-4554-a1d6-3ef737e2ca2d service nova] Lock "1e5f1164-a15e-40cf-b7bc-5aeb404a1216-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:57:23 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-e3c2c41a-2440-4983-84dc-4dba671f4465 req-d9175cf3-50c6-4554-a1d6-3ef737e2ca2d service nova] Lock "1e5f1164-a15e-40cf-b7bc-5aeb404a1216-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:57:23 user nova-compute[75216]: DEBUG nova.compute.manager [req-e3c2c41a-2440-4983-84dc-4dba671f4465 req-d9175cf3-50c6-4554-a1d6-3ef737e2ca2d service nova] [instance: 1e5f1164-a15e-40cf-b7bc-5aeb404a1216] No waiting events found dispatching network-vif-plugged-96dfdc95-6a8e-43f3-8d7c-5b4f78a8f134 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:57:23 user nova-compute[75216]: WARNING nova.compute.manager [req-e3c2c41a-2440-4983-84dc-4dba671f4465 req-d9175cf3-50c6-4554-a1d6-3ef737e2ca2d service nova] [instance: 1e5f1164-a15e-40cf-b7bc-5aeb404a1216] Received unexpected event network-vif-plugged-96dfdc95-6a8e-43f3-8d7c-5b4f78a8f134 for instance with vm_state active and task_state rescuing.
Nov 13 18:57:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:57:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:57:25 user nova-compute[75216]: DEBUG nova.compute.manager [req-4f8d0264-5612-4882-8964-98afd3078b62 req-7e32b6b5-50b9-4858-ad53-8e275e45f70a service nova] [instance: 1e5f1164-a15e-40cf-b7bc-5aeb404a1216] Received event network-vif-plugged-96dfdc95-6a8e-43f3-8d7c-5b4f78a8f134 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:57:25 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-4f8d0264-5612-4882-8964-98afd3078b62 req-7e32b6b5-50b9-4858-ad53-8e275e45f70a service nova] Acquiring lock "1e5f1164-a15e-40cf-b7bc-5aeb404a1216-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:57:25 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-4f8d0264-5612-4882-8964-98afd3078b62 req-7e32b6b5-50b9-4858-ad53-8e275e45f70a service nova] Lock "1e5f1164-a15e-40cf-b7bc-5aeb404a1216-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:57:25 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-4f8d0264-5612-4882-8964-98afd3078b62 req-7e32b6b5-50b9-4858-ad53-8e275e45f70a service nova] Lock "1e5f1164-a15e-40cf-b7bc-5aeb404a1216-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:57:25 user nova-compute[75216]: DEBUG nova.compute.manager [req-4f8d0264-5612-4882-8964-98afd3078b62 req-7e32b6b5-50b9-4858-ad53-8e275e45f70a service nova] [instance: 1e5f1164-a15e-40cf-b7bc-5aeb404a1216] No waiting events found dispatching network-vif-plugged-96dfdc95-6a8e-43f3-8d7c-5b4f78a8f134 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:57:25 user nova-compute[75216]: WARNING nova.compute.manager [req-4f8d0264-5612-4882-8964-98afd3078b62 req-7e32b6b5-50b9-4858-ad53-8e275e45f70a service nova] [instance: 1e5f1164-a15e-40cf-b7bc-5aeb404a1216] Received unexpected event network-vif-plugged-96dfdc95-6a8e-43f3-8d7c-5b4f78a8f134 for instance with vm_state active and task_state rescuing.
Nov 13 18:57:25 user nova-compute[75216]: DEBUG nova.compute.manager [None req-2bb6dfd3-0e89-4391-8e50-2454ddd5d280 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: 1e5f1164-a15e-40cf-b7bc-5aeb404a1216] Checking state {{(pid=75216) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 18:57:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:57:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:57:33 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:57:33 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:57:38 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:57:38 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:57:43 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:57:43 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:57:47 user nova-compute[75216]: DEBUG nova.compute.manager [req-b78057c7-e891-428c-8b3e-b44556860d9f req-4f8f08da-0c0a-4ea5-8106-ad492378f0c9 service nova] [instance: 3f08c061-312d-42d3-a811-e98ace4e7a63] Received event network-changed-225eb5bf-3c60-42f6-9bf7-e045ccda1213 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:57:47 user nova-compute[75216]: DEBUG nova.compute.manager [req-b78057c7-e891-428c-8b3e-b44556860d9f req-4f8f08da-0c0a-4ea5-8106-ad492378f0c9 service nova] [instance: 3f08c061-312d-42d3-a811-e98ace4e7a63] Refreshing instance network info cache due to event network-changed-225eb5bf-3c60-42f6-9bf7-e045ccda1213. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 18:57:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-b78057c7-e891-428c-8b3e-b44556860d9f req-4f8f08da-0c0a-4ea5-8106-ad492378f0c9 service nova] Acquiring lock "refresh_cache-3f08c061-312d-42d3-a811-e98ace4e7a63" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 18:57:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-b78057c7-e891-428c-8b3e-b44556860d9f req-4f8f08da-0c0a-4ea5-8106-ad492378f0c9 service nova] Acquired lock "refresh_cache-3f08c061-312d-42d3-a811-e98ace4e7a63" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 18:57:47 user nova-compute[75216]: DEBUG nova.network.neutron [req-b78057c7-e891-428c-8b3e-b44556860d9f req-4f8f08da-0c0a-4ea5-8106-ad492378f0c9 service nova] [instance: 3f08c061-312d-42d3-a811-e98ace4e7a63] Refreshing network info cache for port 225eb5bf-3c60-42f6-9bf7-e045ccda1213 {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 18:57:48 user nova-compute[75216]: DEBUG nova.network.neutron [req-b78057c7-e891-428c-8b3e-b44556860d9f req-4f8f08da-0c0a-4ea5-8106-ad492378f0c9 service nova] [instance: 3f08c061-312d-42d3-a811-e98ace4e7a63] Updated VIF entry in instance network info cache for port 225eb5bf-3c60-42f6-9bf7-e045ccda1213. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 18:57:48 user nova-compute[75216]: DEBUG nova.network.neutron [req-b78057c7-e891-428c-8b3e-b44556860d9f req-4f8f08da-0c0a-4ea5-8106-ad492378f0c9 service nova] [instance: 3f08c061-312d-42d3-a811-e98ace4e7a63] Updating instance_info_cache with network_info: [{"id": "225eb5bf-3c60-42f6-9bf7-e045ccda1213", "address": "fa:16:3e:3a:7e:d6", "network": {"id": "fea11c73-0074-4971-8b36-0aced430c730", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1420832282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84d0223a97ff4ecab9bf4273e3e465a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap225eb5bf-3c", "ovs_interfaceid": "225eb5bf-3c60-42f6-9bf7-e045ccda1213", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 18:57:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-b78057c7-e891-428c-8b3e-b44556860d9f req-4f8f08da-0c0a-4ea5-8106-ad492378f0c9 service nova] Releasing lock "refresh_cache-3f08c061-312d-42d3-a811-e98ace4e7a63" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 18:57:48 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:57:48 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:57:48 user nova-compute[75216]: DEBUG nova.compute.manager [req-b5383029-7f69-4661-9589-41fc194ebf0a req-1f926fa8-8bdd-4b93-a9b0-31b40be1dc31 service nova] [instance: 3f08c061-312d-42d3-a811-e98ace4e7a63] Received event network-changed-225eb5bf-3c60-42f6-9bf7-e045ccda1213 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:57:48 user nova-compute[75216]: DEBUG nova.compute.manager [req-b5383029-7f69-4661-9589-41fc194ebf0a req-1f926fa8-8bdd-4b93-a9b0-31b40be1dc31 service nova] [instance: 3f08c061-312d-42d3-a811-e98ace4e7a63] Refreshing instance network info cache due to event network-changed-225eb5bf-3c60-42f6-9bf7-e045ccda1213. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 18:57:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-b5383029-7f69-4661-9589-41fc194ebf0a req-1f926fa8-8bdd-4b93-a9b0-31b40be1dc31 service nova] Acquiring lock "refresh_cache-3f08c061-312d-42d3-a811-e98ace4e7a63" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 18:57:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-b5383029-7f69-4661-9589-41fc194ebf0a req-1f926fa8-8bdd-4b93-a9b0-31b40be1dc31 service nova] Acquired lock "refresh_cache-3f08c061-312d-42d3-a811-e98ace4e7a63" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 18:57:48 user nova-compute[75216]: DEBUG nova.network.neutron [req-b5383029-7f69-4661-9589-41fc194ebf0a req-1f926fa8-8bdd-4b93-a9b0-31b40be1dc31 service nova] [instance: 3f08c061-312d-42d3-a811-e98ace4e7a63] Refreshing network info cache for port 225eb5bf-3c60-42f6-9bf7-e045ccda1213 {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 18:57:48 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:57:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-6fdacc15-119d-48c2-95ce-e79e81dc8c57 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Acquiring lock "3f08c061-312d-42d3-a811-e98ace4e7a63" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:57:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-6fdacc15-119d-48c2-95ce-e79e81dc8c57 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Lock "3f08c061-312d-42d3-a811-e98ace4e7a63" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:57:49 user nova-compute[75216]: INFO nova.compute.manager [None req-6fdacc15-119d-48c2-95ce-e79e81dc8c57 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] [instance: 3f08c061-312d-42d3-a811-e98ace4e7a63] Detaching volume 671f1985-7823-411f-b273-6a6930de84e1
Nov 13 18:57:49 user nova-compute[75216]: INFO nova.virt.block_device [None req-6fdacc15-119d-48c2-95ce-e79e81dc8c57 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] [instance: 3f08c061-312d-42d3-a811-e98ace4e7a63] Attempting to driver detach volume 671f1985-7823-411f-b273-6a6930de84e1 from mountpoint /dev/vdb
Nov 13 18:57:49 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-6fdacc15-119d-48c2-95ce-e79e81dc8c57 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Attempting to detach device vdb from instance 3f08c061-312d-42d3-a811-e98ace4e7a63 from the persistent domain config. {{(pid=75216) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 13 18:57:49 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-6fdacc15-119d-48c2-95ce-e79e81dc8c57 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 18:57:49 user nova-compute[75216]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 18:57:49 user nova-compute[75216]:   <source dev="/dev/sde"/>
Nov 13 18:57:49 user nova-compute[75216]:   <target dev="vdb" bus="virtio"/>
Nov 13 18:57:49 user nova-compute[75216]:   <serial>671f1985-7823-411f-b273-6a6930de84e1</serial>
Nov 13 18:57:49 user nova-compute[75216]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 13 18:57:49 user nova-compute[75216]: </disk>
Nov 13 18:57:49 user nova-compute[75216]:  {{(pid=75216) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 18:57:49 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-6fdacc15-119d-48c2-95ce-e79e81dc8c57 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Successfully detached device vdb from instance 3f08c061-312d-42d3-a811-e98ace4e7a63 from the persistent domain config.
Nov 13 18:57:49 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-6fdacc15-119d-48c2-95ce-e79e81dc8c57 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3f08c061-312d-42d3-a811-e98ace4e7a63 from the live domain config. {{(pid=75216) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 13 18:57:49 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-6fdacc15-119d-48c2-95ce-e79e81dc8c57 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 18:57:49 user nova-compute[75216]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 18:57:49 user nova-compute[75216]:   <source dev="/dev/sde"/>
Nov 13 18:57:49 user nova-compute[75216]:   <target dev="vdb" bus="virtio"/>
Nov 13 18:57:49 user nova-compute[75216]:   <serial>671f1985-7823-411f-b273-6a6930de84e1</serial>
Nov 13 18:57:49 user nova-compute[75216]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 13 18:57:49 user nova-compute[75216]: </disk>
Nov 13 18:57:49 user nova-compute[75216]:  {{(pid=75216) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 18:57:49 user nova-compute[75216]: DEBUG nova.network.neutron [req-b5383029-7f69-4661-9589-41fc194ebf0a req-1f926fa8-8bdd-4b93-a9b0-31b40be1dc31 service nova] [instance: 3f08c061-312d-42d3-a811-e98ace4e7a63] Updated VIF entry in instance network info cache for port 225eb5bf-3c60-42f6-9bf7-e045ccda1213. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 18:57:49 user nova-compute[75216]: DEBUG nova.network.neutron [req-b5383029-7f69-4661-9589-41fc194ebf0a req-1f926fa8-8bdd-4b93-a9b0-31b40be1dc31 service nova] [instance: 3f08c061-312d-42d3-a811-e98ace4e7a63] Updating instance_info_cache with network_info: [{"id": "225eb5bf-3c60-42f6-9bf7-e045ccda1213", "address": "fa:16:3e:3a:7e:d6", "network": {"id": "fea11c73-0074-4971-8b36-0aced430c730", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1420832282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84d0223a97ff4ecab9bf4273e3e465a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap225eb5bf-3c", "ovs_interfaceid": "225eb5bf-3c60-42f6-9bf7-e045ccda1213", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 18:57:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-b5383029-7f69-4661-9589-41fc194ebf0a req-1f926fa8-8bdd-4b93-a9b0-31b40be1dc31 service nova] Releasing lock "refresh_cache-3f08c061-312d-42d3-a811-e98ace4e7a63" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 18:57:49 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:57:49 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:57:49 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-6fdacc15-119d-48c2-95ce-e79e81dc8c57 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3f08c061-312d-42d3-a811-e98ace4e7a63 {{(pid=75216) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 13 18:57:52 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:57:52 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:57:52 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:57:52 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:57:52 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:57:52 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:57:52 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Auditing locally available compute resources for user (node: user) {{(pid=75216) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 18:57:52 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 18:57:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e5f1164-a15e-40cf-b7bc-5aeb404a1216/disk.rescue --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:57:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e5f1164-a15e-40cf-b7bc-5aeb404a1216/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:57:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e5f1164-a15e-40cf-b7bc-5aeb404a1216/disk.rescue --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:57:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e5f1164-a15e-40cf-b7bc-5aeb404a1216/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:57:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a3e849-6570-4820-97c8-75468b5bea4f/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:57:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a3e849-6570-4820-97c8-75468b5bea4f/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:57:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a3e849-6570-4820-97c8-75468b5bea4f/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:57:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a3e849-6570-4820-97c8-75468b5bea4f/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:57:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9a1edfb-c2ac-4e67-abac-c915ea22a15c/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:57:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9a1edfb-c2ac-4e67-abac-c915ea22a15c/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:57:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9a1edfb-c2ac-4e67-abac-c915ea22a15c/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:57:53 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:57:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9a1edfb-c2ac-4e67-abac-c915ea22a15c/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:57:53 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 18:57:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14d378b0-79ba-4161-a795-6288939c6fef/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:57:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14d378b0-79ba-4161-a795-6288939c6fef/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:57:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14d378b0-79ba-4161-a795-6288939c6fef/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:57:53 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:57:54 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14d378b0-79ba-4161-a795-6288939c6fef/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:57:54 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 18:57:54 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91ea8a19-a365-484c-80c7-baf90e7dd1aa/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:57:54 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91ea8a19-a365-484c-80c7-baf90e7dd1aa/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:57:54 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91ea8a19-a365-484c-80c7-baf90e7dd1aa/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:57:54 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91ea8a19-a365-484c-80c7-baf90e7dd1aa/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:57:54 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 18:57:54 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d589d57e-de50-482a-843f-e8246b3d7528/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:57:54 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d589d57e-de50-482a-843f-e8246b3d7528/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:57:54 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d589d57e-de50-482a-843f-e8246b3d7528/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:57:54 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d589d57e-de50-482a-843f-e8246b3d7528/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:57:54 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:57:55 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:57:55 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:57:55 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:57:55 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85624c58-6c72-4490-8a3e-547953295ade/disk.rescue --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:57:55 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85624c58-6c72-4490-8a3e-547953295ade/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:57:55 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85624c58-6c72-4490-8a3e-547953295ade/disk.rescue --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:57:55 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85624c58-6c72-4490-8a3e-547953295ade/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:57:55 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85624c58-6c72-4490-8a3e-547953295ade/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:57:55 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85624c58-6c72-4490-8a3e-547953295ade/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:57:55 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85624c58-6c72-4490-8a3e-547953295ade/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:57:55 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85624c58-6c72-4490-8a3e-547953295ade/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:57:55 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f08c061-312d-42d3-a811-e98ace4e7a63/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:57:56 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f08c061-312d-42d3-a811-e98ace4e7a63/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:57:56 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f08c061-312d-42d3-a811-e98ace4e7a63/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:57:56 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f08c061-312d-42d3-a811-e98ace4e7a63/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:57:56 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 18:57:56 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 18:57:56 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Hypervisor/Node resource view: name=user free_ram=7681MB free_disk=25.312755584716797GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75216) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 18:57:56 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:57:56 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:57:56 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance a1a3e849-6570-4820-97c8-75468b5bea4f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 18:57:56 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance d589d57e-de50-482a-843f-e8246b3d7528 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 18:57:56 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance 85624c58-6c72-4490-8a3e-547953295ade actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 18:57:56 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance 14d378b0-79ba-4161-a795-6288939c6fef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 18:57:56 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 18:57:56 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance d9a1edfb-c2ac-4e67-abac-c915ea22a15c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 18:57:56 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance 91ea8a19-a365-484c-80c7-baf90e7dd1aa actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 18:57:56 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance 3f08c061-312d-42d3-a811-e98ace4e7a63 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 18:57:56 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance 1e5f1164-a15e-40cf-b7bc-5aeb404a1216 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 18:57:56 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance 2f074d68-d0a7-4204-a79d-be619ee42d0c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 18:57:56 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 18:57:56 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 18:57:57 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 18:57:57 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 18:57:57 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Compute_service record updated for user:user {{(pid=75216) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 18:57:57 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.451s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:57:58 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:57:58 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Starting heal instance info cache {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 18:57:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "refresh_cache-d589d57e-de50-482a-843f-e8246b3d7528" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 18:57:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquired lock "refresh_cache-d589d57e-de50-482a-843f-e8246b3d7528" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 18:57:58 user nova-compute[75216]: DEBUG nova.network.neutron [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: d589d57e-de50-482a-843f-e8246b3d7528] Forcefully refreshing network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 18:57:58 user nova-compute[75216]: DEBUG nova.compute.manager [req-d37f7e17-0c92-4ba9-b639-1a1304f1e1bc req-3e79f2ef-d350-4921-8de1-64ff5fb536cc service nova] [instance: a1a3e849-6570-4820-97c8-75468b5bea4f] Received event network-changed-3544d3e3-8dfa-4043-b225-77f690cd3760 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:57:58 user nova-compute[75216]: DEBUG nova.compute.manager [req-d37f7e17-0c92-4ba9-b639-1a1304f1e1bc req-3e79f2ef-d350-4921-8de1-64ff5fb536cc service nova] [instance: a1a3e849-6570-4820-97c8-75468b5bea4f] Refreshing instance network info cache due to event network-changed-3544d3e3-8dfa-4043-b225-77f690cd3760. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 18:57:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-d37f7e17-0c92-4ba9-b639-1a1304f1e1bc req-3e79f2ef-d350-4921-8de1-64ff5fb536cc service nova] Acquiring lock "refresh_cache-a1a3e849-6570-4820-97c8-75468b5bea4f" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 18:57:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-d37f7e17-0c92-4ba9-b639-1a1304f1e1bc req-3e79f2ef-d350-4921-8de1-64ff5fb536cc service nova] Acquired lock "refresh_cache-a1a3e849-6570-4820-97c8-75468b5bea4f" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 18:57:58 user nova-compute[75216]: DEBUG nova.network.neutron [req-d37f7e17-0c92-4ba9-b639-1a1304f1e1bc req-3e79f2ef-d350-4921-8de1-64ff5fb536cc service nova] [instance: a1a3e849-6570-4820-97c8-75468b5bea4f] Refreshing network info cache for port 3544d3e3-8dfa-4043-b225-77f690cd3760 {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 18:57:58 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:57:58 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:57:59 user nova-compute[75216]: DEBUG nova.network.neutron [req-d37f7e17-0c92-4ba9-b639-1a1304f1e1bc req-3e79f2ef-d350-4921-8de1-64ff5fb536cc service nova] [instance: a1a3e849-6570-4820-97c8-75468b5bea4f] Updated VIF entry in instance network info cache for port 3544d3e3-8dfa-4043-b225-77f690cd3760. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 18:57:59 user nova-compute[75216]: DEBUG nova.network.neutron [req-d37f7e17-0c92-4ba9-b639-1a1304f1e1bc req-3e79f2ef-d350-4921-8de1-64ff5fb536cc service nova] [instance: a1a3e849-6570-4820-97c8-75468b5bea4f] Updating instance_info_cache with network_info: [{"id": "3544d3e3-8dfa-4043-b225-77f690cd3760", "address": "fa:16:3e:9e:b9:f7", "network": {"id": "d7a691f0-4495-40ad-a349-91b5dc9c635a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-961583097-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9b7e11038e54e368acd22d06e54a351", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3544d3e3-8d", "ovs_interfaceid": "3544d3e3-8dfa-4043-b225-77f690cd3760", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 18:57:59 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-d37f7e17-0c92-4ba9-b639-1a1304f1e1bc req-3e79f2ef-d350-4921-8de1-64ff5fb536cc service nova] Releasing lock "refresh_cache-a1a3e849-6570-4820-97c8-75468b5bea4f" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 18:57:59 user nova-compute[75216]: DEBUG nova.network.neutron [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: d589d57e-de50-482a-843f-e8246b3d7528] Updating instance_info_cache with network_info: [{"id": "87426a6f-0164-4df3-aad0-becbbbfe8310", "address": "fa:16:3e:64:4d:81", "network": {"id": "6d182db1-03b5-4d1b-86cf-b9367921b7b0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1877006951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2efafc26c47c4050bd367c47469999fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87426a6f-01", "ovs_interfaceid": "87426a6f-0164-4df3-aad0-becbbbfe8310", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 18:57:59 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Releasing lock "refresh_cache-d589d57e-de50-482a-843f-e8246b3d7528" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 18:57:59 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: d589d57e-de50-482a-843f-e8246b3d7528] Updated the network info_cache for instance {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 18:57:59 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:57:59 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:57:59 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:57:59 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75216) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 18:58:00 user nova-compute[75216]: DEBUG nova.compute.manager [None req-d4a14813-c1ab-45f8-96a0-42c9fc7db27a tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: 2f074d68-d0a7-4204-a79d-be619ee42d0c] Stashing vm_state: active {{(pid=75216) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 13 18:58:00 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-d4a14813-c1ab-45f8-96a0-42c9fc7db27a tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:58:00 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-d4a14813-c1ab-45f8-96a0-42c9fc7db27a tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:58:00 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-d4a14813-c1ab-45f8-96a0-42c9fc7db27a tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75216) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 18:58:00 user nova-compute[75216]: INFO nova.compute.claims [None req-d4a14813-c1ab-45f8-96a0-42c9fc7db27a tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: 2f074d68-d0a7-4204-a79d-be619ee42d0c] Claim successful on node user
Nov 13 18:58:00 user nova-compute[75216]: INFO nova.compute.resource_tracker [None req-d4a14813-c1ab-45f8-96a0-42c9fc7db27a tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: 2f074d68-d0a7-4204-a79d-be619ee42d0c] Updating resource usage from migration cb47afd3-5c76-48c9-aaa1-4aaeb4bc442a
Nov 13 18:58:00 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-d4a14813-c1ab-45f8-96a0-42c9fc7db27a tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 18:58:00 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-d4a14813-c1ab-45f8-96a0-42c9fc7db27a tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 18:58:00 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-d4a14813-c1ab-45f8-96a0-42c9fc7db27a tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.407s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:58:00 user nova-compute[75216]: INFO nova.compute.manager [None req-d4a14813-c1ab-45f8-96a0-42c9fc7db27a tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: 2f074d68-d0a7-4204-a79d-be619ee42d0c] Migrating
Nov 13 18:58:00 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-d4a14813-c1ab-45f8-96a0-42c9fc7db27a tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Acquiring lock "refresh_cache-2f074d68-d0a7-4204-a79d-be619ee42d0c" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 18:58:00 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-d4a14813-c1ab-45f8-96a0-42c9fc7db27a tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Acquired lock "refresh_cache-2f074d68-d0a7-4204-a79d-be619ee42d0c" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 18:58:00 user nova-compute[75216]: DEBUG nova.network.neutron [None req-d4a14813-c1ab-45f8-96a0-42c9fc7db27a tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: 2f074d68-d0a7-4204-a79d-be619ee42d0c] Building network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 18:58:00 user nova-compute[75216]: DEBUG nova.compute.manager [req-af2447fa-c821-48dd-8f5f-fe972fd35b16 req-aef1b5e0-fedc-488f-a52b-f7ac769ef56e service nova] [instance: 2f074d68-d0a7-4204-a79d-be619ee42d0c] Received event network-changed-3d9260c2-c8da-47b8-884c-8c66259c7c2b {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:58:00 user nova-compute[75216]: DEBUG nova.compute.manager [req-af2447fa-c821-48dd-8f5f-fe972fd35b16 req-aef1b5e0-fedc-488f-a52b-f7ac769ef56e service nova] [instance: 2f074d68-d0a7-4204-a79d-be619ee42d0c] Refreshing instance network info cache due to event network-changed-3d9260c2-c8da-47b8-884c-8c66259c7c2b. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 18:58:00 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-af2447fa-c821-48dd-8f5f-fe972fd35b16 req-aef1b5e0-fedc-488f-a52b-f7ac769ef56e service nova] Acquiring lock "refresh_cache-2f074d68-d0a7-4204-a79d-be619ee42d0c" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 18:58:01 user nova-compute[75216]: DEBUG nova.network.neutron [None req-d4a14813-c1ab-45f8-96a0-42c9fc7db27a tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: 2f074d68-d0a7-4204-a79d-be619ee42d0c] Updating instance_info_cache with network_info: [{"id": "3d9260c2-c8da-47b8-884c-8c66259c7c2b", "address": "fa:16:3e:12:97:81", "network": {"id": "d7a691f0-4495-40ad-a349-91b5dc9c635a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-961583097-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9b7e11038e54e368acd22d06e54a351", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d9260c2-c8", "ovs_interfaceid": "3d9260c2-c8da-47b8-884c-8c66259c7c2b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 18:58:01 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-d4a14813-c1ab-45f8-96a0-42c9fc7db27a tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Releasing lock "refresh_cache-2f074d68-d0a7-4204-a79d-be619ee42d0c" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 18:58:01 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-af2447fa-c821-48dd-8f5f-fe972fd35b16 req-aef1b5e0-fedc-488f-a52b-f7ac769ef56e service nova] Acquired lock "refresh_cache-2f074d68-d0a7-4204-a79d-be619ee42d0c" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 18:58:01 user nova-compute[75216]: DEBUG nova.network.neutron [req-af2447fa-c821-48dd-8f5f-fe972fd35b16 req-aef1b5e0-fedc-488f-a52b-f7ac769ef56e service nova] [instance: 2f074d68-d0a7-4204-a79d-be619ee42d0c] Refreshing network info cache for port 3d9260c2-c8da-47b8-884c-8c66259c7c2b {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 18:58:01 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-d4a14813-c1ab-45f8-96a0-42c9fc7db27a tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: 2f074d68-d0a7-4204-a79d-be619ee42d0c] Starting migrate_disk_and_power_off {{(pid=75216) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Nov 13 18:58:01 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:58:01 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:58:01 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:58:01 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:58:01 user nova-compute[75216]: DEBUG nova.network.neutron [req-af2447fa-c821-48dd-8f5f-fe972fd35b16 req-aef1b5e0-fedc-488f-a52b-f7ac769ef56e service nova] [instance: 2f074d68-d0a7-4204-a79d-be619ee42d0c] Updated VIF entry in instance network info cache for port 3d9260c2-c8da-47b8-884c-8c66259c7c2b. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 18:58:01 user nova-compute[75216]: DEBUG nova.network.neutron [req-af2447fa-c821-48dd-8f5f-fe972fd35b16 req-aef1b5e0-fedc-488f-a52b-f7ac769ef56e service nova] [instance: 2f074d68-d0a7-4204-a79d-be619ee42d0c] Updating instance_info_cache with network_info: [{"id": "3d9260c2-c8da-47b8-884c-8c66259c7c2b", "address": "fa:16:3e:12:97:81", "network": {"id": "d7a691f0-4495-40ad-a349-91b5dc9c635a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-961583097-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9b7e11038e54e368acd22d06e54a351", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d9260c2-c8", "ovs_interfaceid": "3d9260c2-c8da-47b8-884c-8c66259c7c2b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 18:58:01 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-af2447fa-c821-48dd-8f5f-fe972fd35b16 req-aef1b5e0-fedc-488f-a52b-f7ac769ef56e service nova] Releasing lock "refresh_cache-2f074d68-d0a7-4204-a79d-be619ee42d0c" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 18:58:02 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:58:02 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 2f074d68-d0a7-4204-a79d-be619ee42d0c] Instance destroyed successfully.
Nov 13 18:58:02 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-d4a14813-c1ab-45f8-96a0-42c9fc7db27a tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T18:56:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1279111656',display_name='tempest-ServerActionsTestOtherA-server-1279111656',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1279111656',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKz099Lx1XxYKMwpEh9A7Hze8Yy5EijTt+h0RSW+LWAAdums7McTLzxWcs+4M2TWx6M56tfd+yHdLdlnr7vz5lvq3aL+fZolVlZV3LeOornnUO38Y1O0XVUZqifXtvNPtQ==',key_name='tempest-keypair-1574128026',keypairs=<?>,launch_index=0,launched_at=2023-11-13T18:56:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b9b7e11038e54e368acd22d06e54a351',ramdisk_id='',reservation_id='r-59nswt1o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-537419316',owner_user_name='tempest-ServerActionsTestOtherA-537419316-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T18:58:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='23f029ff09464d699e5bd6dbf44a905d',uuid=2f074d68-d0a7-4204-a79d-be619ee42d0c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3d9260c2-c8da-47b8-884c-8c66259c7c2b", "address": "fa:16:3e:12:97:81", "network": {"id": "d7a691f0-4495-40ad-a349-91b5dc9c635a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-961583097-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-961583097-network", "vif_mac": "fa:16:3e:12:97:81"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9b7e11038e54e368acd22d06e54a351", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d9260c2-c8", "ovs_interfaceid": "3d9260c2-c8da-47b8-884c-8c66259c7c2b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 18:58:02 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-d4a14813-c1ab-45f8-96a0-42c9fc7db27a tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Converting VIF {"id": "3d9260c2-c8da-47b8-884c-8c66259c7c2b", "address": "fa:16:3e:12:97:81", "network": {"id": "d7a691f0-4495-40ad-a349-91b5dc9c635a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-961583097-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-961583097-network", "vif_mac": "fa:16:3e:12:97:81"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9b7e11038e54e368acd22d06e54a351", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d9260c2-c8", "ovs_interfaceid": "3d9260c2-c8da-47b8-884c-8c66259c7c2b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 18:58:02 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-d4a14813-c1ab-45f8-96a0-42c9fc7db27a tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:12:97:81,bridge_name='br-int',has_traffic_filtering=True,id=3d9260c2-c8da-47b8-884c-8c66259c7c2b,network=Network(d7a691f0-4495-40ad-a349-91b5dc9c635a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d9260c2-c8') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 18:58:02 user nova-compute[75216]: DEBUG os_vif [None req-d4a14813-c1ab-45f8-96a0-42c9fc7db27a tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:12:97:81,bridge_name='br-int',has_traffic_filtering=True,id=3d9260c2-c8da-47b8-884c-8c66259c7c2b,network=Network(d7a691f0-4495-40ad-a349-91b5dc9c635a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d9260c2-c8') {{(pid=75216) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 18:58:02 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:58:02 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3d9260c2-c8, bridge=br-int, if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:58:02 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:58:02 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:58:02 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:58:02 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=97d82290-3fa4-4b93-9843-46f56d780bab) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:58:02 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:58:02 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:58:02 user nova-compute[75216]: INFO os_vif [None req-d4a14813-c1ab-45f8-96a0-42c9fc7db27a tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:12:97:81,bridge_name='br-int',has_traffic_filtering=True,id=3d9260c2-c8da-47b8-884c-8c66259c7c2b,network=Network(d7a691f0-4495-40ad-a349-91b5dc9c635a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d9260c2-c8')
Nov 13 18:58:02 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d4a14813-c1ab-45f8-96a0-42c9fc7db27a tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: 2f074d68-d0a7-4204-a79d-be619ee42d0c] calling os-brick to detach iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 18:58:02 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4a14813-c1ab-45f8-96a0-42c9fc7db27a tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3a8669e40>, {'target_iqn': 'iqn.2010-10.org.openstack:8a7c3d74-e183-497b-b6c7-85be2b2f171e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'umwcQxTI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 18:58:02 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-d4a14813-c1ab-45f8-96a0-42c9fc7db27a tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 18:58:02 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-d4a14813-c1ab-45f8-96a0-42c9fc7db27a tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 18:58:02 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-d4a14813-c1ab-45f8-96a0-42c9fc7db27a tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 18:58:02 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:58:02 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:58:02 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1c635b8-16c5-4d3f-8e2f-227246c5bfc7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:671f1985-7823-411f-b273-6a6930de84e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8a7c3d74-e183-497b-b6c7-85be2b2f171e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4ee38de6-1fa4-460d-9bb4-49720104365b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:58:02 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4a14813-c1ab-45f8-96a0-42c9fc7db27a tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 18:58:02 user nova-compute[75216]: No targets found.
Nov 13 18:58:02 user nova-compute[75216]: iSNS:
Nov 13 18:58:02 user nova-compute[75216]: No targets found.
Nov 13 18:58:02 user nova-compute[75216]: STATIC:
Nov 13 18:58:02 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:671f1985-7823-411f-b273-6a6930de84e1
Nov 13 18:58:02 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 18:58:02 user nova-compute[75216]:                 Iface Name: default
Nov 13 18:58:02 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:8a7c3d74-e183-497b-b6c7-85be2b2f171e
Nov 13 18:58:02 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 18:58:02 user nova-compute[75216]:                 Iface Name: default
Nov 13 18:58:02 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d
Nov 13 18:58:02 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 18:58:02 user nova-compute[75216]:                 Iface Name: default
Nov 13 18:58:02 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1
Nov 13 18:58:02 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 18:58:02 user nova-compute[75216]:                 Iface Name: default
Nov 13 18:58:02 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:4ee38de6-1fa4-460d-9bb4-49720104365b
Nov 13 18:58:02 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 18:58:02 user nova-compute[75216]:                 Iface Name: default
Nov 13 18:58:02 user nova-compute[75216]: FIRMWARE:
Nov 13 18:58:02 user nova-compute[75216]: No targets found.
Nov 13 18:58:02 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 18:58:02 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4a14813-c1ab-45f8-96a0-42c9fc7db27a tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 18:58:02 user nova-compute[75216]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 18:58:02 user nova-compute[75216]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75216) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 18:58:02 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4a14813-c1ab-45f8-96a0-42c9fc7db27a tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8a7c3d74-e183-497b-b6c7-85be2b2f171e', 0)] {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 18:58:02 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:58:02 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:58:02 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[b00c4cc8-48c7-4e92-ae7c-8b17f19cfba8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4ee38de6-1fa4-460d-9bb4-49720104365b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:671f1985-7823-411f-b273-6a6930de84e1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8a7c3d74-e183-497b-b6c7-85be2b2f171e\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:58:02 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:58:02 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:58:02 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c6198a5-dc32-405e-bef0-9f51ffb29633]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ee38de6-1fa4-460d-9bb4-49720104365b (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:671f1985-7823-411f-b273-6a6930de84e1 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a7c3d74-e183-497b-b6c7-85be2b2f171e (non-flash)\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:58:02 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4a14813-c1ab-45f8-96a0-42c9fc7db27a tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ee38de6-1fa4-460d-9bb4-49720104365b (non-flash)
Nov 13 18:58:02 user nova-compute[75216]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1 (non-flash)
Nov 13 18:58:02 user nova-compute[75216]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d (non-flash)
Nov 13 18:58:02 user nova-compute[75216]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:671f1985-7823-411f-b273-6a6930de84e1 (non-flash)
Nov 13 18:58:02 user nova-compute[75216]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a7c3d74-e183-497b-b6c7-85be2b2f171e (non-flash)
Nov 13 18:58:02 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 18:58:02 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4a14813-c1ab-45f8-96a0-42c9fc7db27a tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ee38de6-1fa4-460d-9bb4-49720104365b (non-flash)
Nov 13 18:58:02 user nova-compute[75216]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1 (non-flash)
Nov 13 18:58:02 user nova-compute[75216]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d (non-flash)
Nov 13 18:58:02 user nova-compute[75216]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:671f1985-7823-411f-b273-6a6930de84e1 (non-flash)
Nov 13 18:58:02 user nova-compute[75216]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a7c3d74-e183-497b-b6c7-85be2b2f171e (non-flash)
Nov 13 18:58:02 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 18:58:02 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4a14813-c1ab-45f8-96a0-42c9fc7db27a tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe3a826f490>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8a7c3d74-e183-497b-b6c7-85be2b2f171e'): ({'sdf'}, set())}) {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 18:58:02 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-d4a14813-c1ab-45f8-96a0-42c9fc7db27a tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Removing single pathed devices sdf {{(pid=75216) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 18:58:02 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:58:02 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:58:02 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[299b0dca-6d36-49ba-a9f5-a0245e4d4a30]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:58:02 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:58:02 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.017s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:58:02 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[40897fda-dc76-4e66-873a-3d673470ab02]: (4, ('ok\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:58:02 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-d4a14813-c1ab-45f8-96a0-42c9fc7db27a tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Flushing IO for device /dev/sdf {{(pid=75216) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 18:58:02 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:58:02 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:58:02 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef28c72b-79f4-42d6-aa59-9eeff47e1f24]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:58:02 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-d4a14813-c1ab-45f8-96a0-42c9fc7db27a tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75216) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 18:58:02 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:58:02 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.053s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:58:02 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6799251-bdc1-452e-9c74-f13753678d2b]: (4, ('1', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:58:02 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-d4a14813-c1ab-45f8-96a0-42c9fc7db27a tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 18:58:02 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-d4a14813-c1ab-45f8-96a0-42c9fc7db27a tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] SCSI volumes sdf have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 18:58:02 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4a14813-c1ab-45f8-96a0-42c9fc7db27a tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8a7c3d74-e183-497b-b6c7-85be2b2f171e')] {{(pid=75216) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 18:58:02 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a7c3d74-e183-497b-b6c7-85be2b2f171e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:58:02 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a7c3d74-e183-497b-b6c7-85be2b2f171e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:58:02 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d807f61-eaf2-4ad0-8a2b-7d9e41525a13]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:58:02 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4a14813-c1ab-45f8-96a0-42c9fc7db27a tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:58:02 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a7c3d74-e183-497b-b6c7-85be2b2f171e -p 172.16.0.220:3260 --logout {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:58:02 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a7c3d74-e183-497b-b6c7-85be2b2f171e -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:58:02 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[896bdf60-2e06-498d-ae1c-06685fe2cd91]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:8a7c3d74-e183-497b-b6c7-85be2b2f171e, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:8a7c3d74-e183-497b-b6c7-85be2b2f171e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:58:02 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4a14813-c1ab-45f8-96a0-42c9fc7db27a tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:8a7c3d74-e183-497b-b6c7-85be2b2f171e, portal: 172.16.0.220,3260]
Nov 13 18:58:02 user nova-compute[75216]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:8a7c3d74-e183-497b-b6c7-85be2b2f171e, portal: 172.16.0.220,3260] successful.
Nov 13 18:58:02 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:58:02 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a7c3d74-e183-497b-b6c7-85be2b2f171e -p 172.16.0.220:3260 --op delete {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:58:02 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a7c3d74-e183-497b-b6c7-85be2b2f171e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:58:02 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc314a84-ef2b-4ac0-bdbb-dee7fd0b9bb8]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:58:02 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4a14813-c1ab-45f8-96a0-42c9fc7db27a tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:58:02 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-d4a14813-c1ab-45f8-96a0-42c9fc7db27a tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.331s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 18:58:02 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4a14813-c1ab-45f8-96a0-42c9fc7db27a tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] <== disconnect_volume: return (333ms) None {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 18:58:02 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d4a14813-c1ab-45f8-96a0-42c9fc7db27a tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: 2f074d68-d0a7-4204-a79d-be619ee42d0c] Disconnected iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 18:58:02 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-d4a14813-c1ab-45f8-96a0-42c9fc7db27a tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 18:58:02 user nova-compute[75216]: DEBUG nova.compute.manager [req-76f4a5b9-e6a6-4366-bfe7-4a443bda7555 req-3290f868-c3df-43d9-aad9-a0e25c7caf73 service nova] [instance: 2f074d68-d0a7-4204-a79d-be619ee42d0c] Received event network-vif-unplugged-3d9260c2-c8da-47b8-884c-8c66259c7c2b {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:58:02 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-76f4a5b9-e6a6-4366-bfe7-4a443bda7555 req-3290f868-c3df-43d9-aad9-a0e25c7caf73 service nova] Acquiring lock "2f074d68-d0a7-4204-a79d-be619ee42d0c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:58:02 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-76f4a5b9-e6a6-4366-bfe7-4a443bda7555 req-3290f868-c3df-43d9-aad9-a0e25c7caf73 service nova] Lock "2f074d68-d0a7-4204-a79d-be619ee42d0c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:58:02 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-76f4a5b9-e6a6-4366-bfe7-4a443bda7555 req-3290f868-c3df-43d9-aad9-a0e25c7caf73 service nova] Lock "2f074d68-d0a7-4204-a79d-be619ee42d0c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:58:02 user nova-compute[75216]: DEBUG nova.compute.manager [req-76f4a5b9-e6a6-4366-bfe7-4a443bda7555 req-3290f868-c3df-43d9-aad9-a0e25c7caf73 service nova] [instance: 2f074d68-d0a7-4204-a79d-be619ee42d0c] No waiting events found dispatching network-vif-unplugged-3d9260c2-c8da-47b8-884c-8c66259c7c2b {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:58:02 user nova-compute[75216]: WARNING nova.compute.manager [req-76f4a5b9-e6a6-4366-bfe7-4a443bda7555 req-3290f868-c3df-43d9-aad9-a0e25c7caf73 service nova] [instance: 2f074d68-d0a7-4204-a79d-be619ee42d0c] Received unexpected event network-vif-unplugged-3d9260c2-c8da-47b8-884c-8c66259c7c2b for instance with vm_state active and task_state resize_migrating.
Nov 13 18:58:02 user nova-compute[75216]: DEBUG nova.compute.manager [req-76f4a5b9-e6a6-4366-bfe7-4a443bda7555 req-3290f868-c3df-43d9-aad9-a0e25c7caf73 service nova] [instance: 2f074d68-d0a7-4204-a79d-be619ee42d0c] Received event network-vif-plugged-3d9260c2-c8da-47b8-884c-8c66259c7c2b {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:58:02 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-76f4a5b9-e6a6-4366-bfe7-4a443bda7555 req-3290f868-c3df-43d9-aad9-a0e25c7caf73 service nova] Acquiring lock "2f074d68-d0a7-4204-a79d-be619ee42d0c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:58:02 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-76f4a5b9-e6a6-4366-bfe7-4a443bda7555 req-3290f868-c3df-43d9-aad9-a0e25c7caf73 service nova] Lock "2f074d68-d0a7-4204-a79d-be619ee42d0c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:58:02 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-76f4a5b9-e6a6-4366-bfe7-4a443bda7555 req-3290f868-c3df-43d9-aad9-a0e25c7caf73 service nova] Lock "2f074d68-d0a7-4204-a79d-be619ee42d0c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:58:02 user nova-compute[75216]: DEBUG nova.compute.manager [req-76f4a5b9-e6a6-4366-bfe7-4a443bda7555 req-3290f868-c3df-43d9-aad9-a0e25c7caf73 service nova] [instance: 2f074d68-d0a7-4204-a79d-be619ee42d0c] No waiting events found dispatching network-vif-plugged-3d9260c2-c8da-47b8-884c-8c66259c7c2b {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:58:02 user nova-compute[75216]: WARNING nova.compute.manager [req-76f4a5b9-e6a6-4366-bfe7-4a443bda7555 req-3290f868-c3df-43d9-aad9-a0e25c7caf73 service nova] [instance: 2f074d68-d0a7-4204-a79d-be619ee42d0c] Received unexpected event network-vif-plugged-3d9260c2-c8da-47b8-884c-8c66259c7c2b for instance with vm_state active and task_state resize_migrating.
Nov 13 18:58:03 user nova-compute[75216]: DEBUG nova.network.neutron [None req-d4a14813-c1ab-45f8-96a0-42c9fc7db27a tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: 2f074d68-d0a7-4204-a79d-be619ee42d0c] Port 3d9260c2-c8da-47b8-884c-8c66259c7c2b binding to destination host user is already ACTIVE {{(pid=75216) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 13 18:58:03 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-d4a14813-c1ab-45f8-96a0-42c9fc7db27a tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Acquiring lock "2f074d68-d0a7-4204-a79d-be619ee42d0c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:58:03 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-d4a14813-c1ab-45f8-96a0-42c9fc7db27a tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Lock "2f074d68-d0a7-4204-a79d-be619ee42d0c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:58:03 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-d4a14813-c1ab-45f8-96a0-42c9fc7db27a tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Lock "2f074d68-d0a7-4204-a79d-be619ee42d0c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:58:03 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-d4a14813-c1ab-45f8-96a0-42c9fc7db27a tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Acquiring lock "refresh_cache-2f074d68-d0a7-4204-a79d-be619ee42d0c" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 18:58:03 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-d4a14813-c1ab-45f8-96a0-42c9fc7db27a tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Acquired lock "refresh_cache-2f074d68-d0a7-4204-a79d-be619ee42d0c" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 18:58:03 user nova-compute[75216]: DEBUG nova.network.neutron [None req-d4a14813-c1ab-45f8-96a0-42c9fc7db27a tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: 2f074d68-d0a7-4204-a79d-be619ee42d0c] Building network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 18:58:03 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:58:03 user nova-compute[75216]: DEBUG nova.network.neutron [None req-d4a14813-c1ab-45f8-96a0-42c9fc7db27a tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: 2f074d68-d0a7-4204-a79d-be619ee42d0c] Updating instance_info_cache with network_info: [{"id": "3d9260c2-c8da-47b8-884c-8c66259c7c2b", "address": "fa:16:3e:12:97:81", "network": {"id": "d7a691f0-4495-40ad-a349-91b5dc9c635a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-961583097-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9b7e11038e54e368acd22d06e54a351", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d9260c2-c8", "ovs_interfaceid": "3d9260c2-c8da-47b8-884c-8c66259c7c2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 18:58:03 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-d4a14813-c1ab-45f8-96a0-42c9fc7db27a tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Releasing lock "refresh_cache-2f074d68-d0a7-4204-a79d-be619ee42d0c" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 18:58:04 user nova-compute[75216]: DEBUG os_brick.utils [None req-d4a14813-c1ab-45f8-96a0-42c9fc7db27a tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 18:58:04 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:58:04 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:58:04 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a975a3d-3a93-4c27-a0ff-912cb876db85]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aea6fcfe14b9\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:58:04 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:58:04 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:58:04 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[099a1b38-dbab-4b00-96c9-4737d96ac310]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:58:04 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:58:04 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:58:04 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[f817b6d0-a206-4858-a689-e3b186976431]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:58:04 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[c098d952-0246-4196-98d4-80b34f5543ea]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:58:04 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-d4a14813-c1ab-45f8-96a0-42c9fc7db27a tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Running cmd (subprocess): nvme version {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:58:04 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-d4a14813-c1ab-45f8-96a0-42c9fc7db27a tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] 'nvme version' failed. Not Retrying. {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 18:58:04 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d4a14813-c1ab-45f8-96a0-42c9fc7db27a tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] nvme not present on system {{(pid=75216) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 18:58:04 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:58:04 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 18:58:04 user nova-compute[75216]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 18:58:04 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bbc01c2-38b3-43c2-b569-2edbefb33150]: (4, '') {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:58:04 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-d4a14813-c1ab-45f8-96a0-42c9fc7db27a tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75216) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 18:58:04 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-d4a14813-c1ab-45f8-96a0-42c9fc7db27a tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 18:58:04 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-d4a14813-c1ab-45f8-96a0-42c9fc7db27a tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] LIGHTOS: no hostnqn found. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 18:58:04 user nova-compute[75216]: DEBUG os_brick.utils [None req-d4a14813-c1ab-45f8-96a0-42c9fc7db27a tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aea6fcfe14b9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 18:58:07 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:58:08 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-d4a14813-c1ab-45f8-96a0-42c9fc7db27a tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: 2f074d68-d0a7-4204-a79d-be619ee42d0c] Starting finish_migration {{(pid=75216) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Nov 13 18:58:08 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-d4a14813-c1ab-45f8-96a0-42c9fc7db27a tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: 2f074d68-d0a7-4204-a79d-be619ee42d0c] Instance directory exists: not creating {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 13 18:58:08 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-d4a14813-c1ab-45f8-96a0-42c9fc7db27a tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: 2f074d68-d0a7-4204-a79d-be619ee42d0c] Creating image(s)
Nov 13 18:58:08 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-d4a14813-c1ab-45f8-96a0-42c9fc7db27a tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: 2f074d68-d0a7-4204-a79d-be619ee42d0c] Did not create local disks {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 13 18:58:08 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-d4a14813-c1ab-45f8-96a0-42c9fc7db27a tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: 2f074d68-d0a7-4204-a79d-be619ee42d0c] Ensure instance console log exists: /opt/stack/data/nova/instances/2f074d68-d0a7-4204-a79d-be619ee42d0c/console.log {{(pid=75216) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 18:58:08 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-d4a14813-c1ab-45f8-96a0-42c9fc7db27a tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:58:08 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-d4a14813-c1ab-45f8-96a0-42c9fc7db27a tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:58:08 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-d4a14813-c1ab-45f8-96a0-42c9fc7db27a tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:58:08 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-d4a14813-c1ab-45f8-96a0-42c9fc7db27a tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: 2f074d68-d0a7-4204-a79d-be619ee42d0c] Start _get_guest_xml network_info=[{"id": "3d9260c2-c8da-47b8-884c-8c66259c7c2b", "address": "fa:16:3e:12:97:81", "network": {"id": "d7a691f0-4495-40ad-a349-91b5dc9c635a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-961583097-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-961583097-network", "vif_mac": "fa:16:3e:12:97:81"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9b7e11038e54e368acd22d06e54a351", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d9260c2-c8", "ovs_interfaceid": "3d9260c2-c8da-47b8-884c-8c66259c7c2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8a7c3d74-e183-497b-b6c7-85be2b2f171e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'umwcQxTI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '2f074d68-d0a7-4204-a79d-be619ee42d0c', 'attached_at': '2023-11-13T18:58:08.000000', 'detached_at': '', 'volume_id': '8a7c3d74-e183-497b-b6c7-85be2b2f171e', 'serial': '8a7c3d74-e183-497b-b6c7-85be2b2f171e'}, 'attachment_id': 'c0de03df-bbb7-4969-aa88-ce67c6bd3992', 'guest_format': None, 'mount_device': '/dev/vda', 'delete_on_termination': True, 'boot_index': 0, 'volume_type': None} {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 18:58:08 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-d4a14813-c1ab-45f8-96a0-42c9fc7db27a tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 18:58:08 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-d4a14813-c1ab-45f8-96a0-42c9fc7db27a tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 18:58:08 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-d4a14813-c1ab-45f8-96a0-42c9fc7db27a tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 18:58:08 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-d4a14813-c1ab-45f8-96a0-42c9fc7db27a tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] CPU controller missing on host. {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 18:58:08 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-d4a14813-c1ab-45f8-96a0-42c9fc7db27a tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 18:58:08 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-d4a14813-c1ab-45f8-96a0-42c9fc7db27a tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] CPU controller found on host. {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 18:58:08 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-d4a14813-c1ab-45f8-96a0-42c9fc7db27a tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75216) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 18:58:08 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-d4a14813-c1ab-45f8-96a0-42c9fc7db27a tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T18:40:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 18:58:08 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-d4a14813-c1ab-45f8-96a0-42c9fc7db27a tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Flavor limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 18:58:08 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-d4a14813-c1ab-45f8-96a0-42c9fc7db27a tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Image limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 18:58:08 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-d4a14813-c1ab-45f8-96a0-42c9fc7db27a tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Flavor pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 18:58:08 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-d4a14813-c1ab-45f8-96a0-42c9fc7db27a tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Image pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 18:58:08 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-d4a14813-c1ab-45f8-96a0-42c9fc7db27a tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 18:58:08 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-d4a14813-c1ab-45f8-96a0-42c9fc7db27a tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 18:58:08 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-d4a14813-c1ab-45f8-96a0-42c9fc7db27a tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 18:58:08 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-d4a14813-c1ab-45f8-96a0-42c9fc7db27a tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Got 1 possible topologies {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 18:58:08 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-d4a14813-c1ab-45f8-96a0-42c9fc7db27a tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 18:58:08 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-d4a14813-c1ab-45f8-96a0-42c9fc7db27a tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 18:58:08 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d4a14813-c1ab-45f8-96a0-42c9fc7db27a tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: 2f074d68-d0a7-4204-a79d-be619ee42d0c] Calling os-brick to attach iSCSI Volume {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 18:58:08 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4a14813-c1ab-45f8-96a0-42c9fc7db27a tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3a8669e40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8a7c3d74-e183-497b-b6c7-85be2b2f171e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'umwcQxTI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 18:58:08 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-d4a14813-c1ab-45f8-96a0-42c9fc7db27a tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 18:58:08 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-d4a14813-c1ab-45f8-96a0-42c9fc7db27a tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 18:58:08 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-d4a14813-c1ab-45f8-96a0-42c9fc7db27a tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 18:58:08 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-d4a14813-c1ab-45f8-96a0-42c9fc7db27a tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 18:58:08 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-d4a14813-c1ab-45f8-96a0-42c9fc7db27a tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8a7c3d74-e183-497b-b6c7-85be2b2f171e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 18:58:08 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-d4a14813-c1ab-45f8-96a0-42c9fc7db27a tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8a7c3d74-e183-497b-b6c7-85be2b2f171e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 18:58:08 user nova-compute[75216]: INFO os_brick.initiator.connectors.iscsi [None req-d4a14813-c1ab-45f8-96a0-42c9fc7db27a tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 18:58:08 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a7c3d74-e183-497b-b6c7-85be2b2f171e -p 172.16.0.220:3260 {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:58:08 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a7c3d74-e183-497b-b6c7-85be2b2f171e -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:58:08 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f9931bb-7eaf-4d10-ab93-330c9129444a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:58:08 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4a14813-c1ab-45f8-96a0-42c9fc7db27a tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 18:58:08 user nova-compute[75216]:  {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:58:08 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a7c3d74-e183-497b-b6c7-85be2b2f171e -p 172.16.0.220:3260 --interface default --op new {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:58:08 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a7c3d74-e183-497b-b6c7-85be2b2f171e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:58:08 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[a03d8fa9-bfc1-4d6f-840f-567e6717e391]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8a7c3d74-e183-497b-b6c7-85be2b2f171e] added\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:58:08 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4a14813-c1ab-45f8-96a0-42c9fc7db27a tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8a7c3d74-e183-497b-b6c7-85be2b2f171e] added
Nov 13 18:58:08 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:58:08 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a7c3d74-e183-497b-b6c7-85be2b2f171e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:58:08 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a7c3d74-e183-497b-b6c7-85be2b2f171e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:58:08 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[a345da71-9478-4764-a370-74f1b6e1e975]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:58:08 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4a14813-c1ab-45f8-96a0-42c9fc7db27a tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:58:08 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a7c3d74-e183-497b-b6c7-85be2b2f171e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:58:08 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a7c3d74-e183-497b-b6c7-85be2b2f171e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:58:08 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf4c03ac-d783-4ad4-af05-4e01c31ededf]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:58:08 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4a14813-c1ab-45f8-96a0-42c9fc7db27a tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:58:08 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a7c3d74-e183-497b-b6c7-85be2b2f171e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v umwcQxTI {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:58:08 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a7c3d74-e183-497b-b6c7-85be2b2f171e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v umwcQxTI" returned: 0 in 0.016s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:58:08 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[44b885f8-afc5-4ddd-8d2b-a9f27f1db734]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:58:08 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4a14813-c1ab-45f8-96a0-42c9fc7db27a tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'umwcQxTI'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:58:08 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a7c3d74-e183-497b-b6c7-85be2b2f171e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:58:08 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a7c3d74-e183-497b-b6c7-85be2b2f171e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:58:08 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd4b8dd9-c916-4edb-9337-ed9a1e16b39a]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:58:08 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4a14813-c1ab-45f8-96a0-42c9fc7db27a tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:58:08 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:58:08 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:58:08 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6ef0dc3-bf13-4b20-add2-d2eb52654b89]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ee38de6-1fa4-460d-9bb4-49720104365b (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:671f1985-7823-411f-b273-6a6930de84e1 (non-flash)\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:58:08 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4a14813-c1ab-45f8-96a0-42c9fc7db27a tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ee38de6-1fa4-460d-9bb4-49720104365b (non-flash)
Nov 13 18:58:08 user nova-compute[75216]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1 (non-flash)
Nov 13 18:58:08 user nova-compute[75216]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d (non-flash)
Nov 13 18:58:08 user nova-compute[75216]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:671f1985-7823-411f-b273-6a6930de84e1 (non-flash)
Nov 13 18:58:08 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 18:58:08 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4a14813-c1ab-45f8-96a0-42c9fc7db27a tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ee38de6-1fa4-460d-9bb4-49720104365b (non-flash)
Nov 13 18:58:08 user nova-compute[75216]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1 (non-flash)
Nov 13 18:58:08 user nova-compute[75216]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d (non-flash)
Nov 13 18:58:08 user nova-compute[75216]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:671f1985-7823-411f-b273-6a6930de84e1 (non-flash)
Nov 13 18:58:08 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 18:58:08 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a7c3d74-e183-497b-b6c7-85be2b2f171e -p 172.16.0.220:3260 --login {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:58:08 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a7c3d74-e183-497b-b6c7-85be2b2f171e -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:58:08 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e57dabb-ac16-4e51-b429-ef70591d08d5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8a7c3d74-e183-497b-b6c7-85be2b2f171e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8a7c3d74-e183-497b-b6c7-85be2b2f171e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:58:08 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4a14813-c1ab-45f8-96a0-42c9fc7db27a tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8a7c3d74-e183-497b-b6c7-85be2b2f171e, portal: 172.16.0.220,3260]
Nov 13 18:58:08 user nova-compute[75216]: Login to [iface: default, target: iqn.2010-10.org.openstack:8a7c3d74-e183-497b-b6c7-85be2b2f171e, portal: 172.16.0.220,3260] successful.
Nov 13 18:58:08 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:58:08 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a7c3d74-e183-497b-b6c7-85be2b2f171e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:58:08 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a7c3d74-e183-497b-b6c7-85be2b2f171e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:58:08 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6aa08f5-95d9-49b2-9c82-882003c969c3]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:58:08 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4a14813-c1ab-45f8-96a0-42c9fc7db27a tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:58:08 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:58:08 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:58:08 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5fd6f9f-3bc2-45f4-bea2-984bf9900176]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ee38de6-1fa4-460d-9bb4-49720104365b (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:671f1985-7823-411f-b273-6a6930de84e1 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a7c3d74-e183-497b-b6c7-85be2b2f171e (non-flash)\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:58:08 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4a14813-c1ab-45f8-96a0-42c9fc7db27a tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ee38de6-1fa4-460d-9bb4-49720104365b (non-flash)
Nov 13 18:58:08 user nova-compute[75216]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1 (non-flash)
Nov 13 18:58:08 user nova-compute[75216]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d (non-flash)
Nov 13 18:58:08 user nova-compute[75216]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:671f1985-7823-411f-b273-6a6930de84e1 (non-flash)
Nov 13 18:58:08 user nova-compute[75216]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a7c3d74-e183-497b-b6c7-85be2b2f171e (non-flash)
Nov 13 18:58:08 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 18:58:08 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4a14813-c1ab-45f8-96a0-42c9fc7db27a tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ee38de6-1fa4-460d-9bb4-49720104365b (non-flash)
Nov 13 18:58:08 user nova-compute[75216]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1 (non-flash)
Nov 13 18:58:08 user nova-compute[75216]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d (non-flash)
Nov 13 18:58:08 user nova-compute[75216]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:671f1985-7823-411f-b273-6a6930de84e1 (non-flash)
Nov 13 18:58:08 user nova-compute[75216]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a7c3d74-e183-497b-b6c7-85be2b2f171e (non-flash)
Nov 13 18:58:08 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 18:58:08 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-d4a14813-c1ab-45f8-96a0-42c9fc7db27a tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8a7c3d74-e183-497b-b6c7-85be2b2f171e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.272s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 18:58:08 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4a14813-c1ab-45f8-96a0-42c9fc7db27a tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Connected to 172.16.0.220:3260 {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 18:58:08 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-d4a14813-c1ab-45f8-96a0-42c9fc7db27a tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] HCTL ('37', '-', '-', 0) found on session 35 with lun 0 {{(pid=75216) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 18:58:08 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-d4a14813-c1ab-45f8-96a0-42c9fc7db27a tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75216) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 18:58:08 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:58:08 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:58:08 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1200630-56c0-44a4-bc80-af00ec723ef2]: (4, ('- - 0', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:58:08 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-d4a14813-c1ab-45f8-96a0-42c9fc7db27a tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Searching for a device in session 35 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75216) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 18:58:08 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4a14813-c1ab-45f8-96a0-42c9fc7db27a tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:8a7c3d74-e183-497b-b6c7-85be2b2f171e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'umwcQxTI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 18:58:09 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-6fdacc15-119d-48c2-95ce-e79e81dc8c57 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 3f08c061-312d-42d3-a811-e98ace4e7a63 is timed out.
Nov 13 18:58:09 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-6fdacc15-119d-48c2-95ce-e79e81dc8c57 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Successfully detached device vdb from instance 3f08c061-312d-42d3-a811-e98ace4e7a63 from the live domain config.
Nov 13 18:58:09 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6fdacc15-119d-48c2-95ce-e79e81dc8c57 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] [instance: 3f08c061-312d-42d3-a811-e98ace4e7a63] calling os-brick to detach iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 18:58:09 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fdacc15-119d-48c2-95ce-e79e81dc8c57 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3a8669e40>, {'target_iqn': 'iqn.2010-10.org.openstack:671f1985-7823-411f-b273-6a6930de84e1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jrOCibMl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 18:58:09 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-6fdacc15-119d-48c2-95ce-e79e81dc8c57 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 18:58:09 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-6fdacc15-119d-48c2-95ce-e79e81dc8c57 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 18:58:09 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-d4a14813-c1ab-45f8-96a0-42c9fc7db27a tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.379s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 18:58:09 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4a14813-c1ab-45f8-96a0-42c9fc7db27a tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] <== connect_volume: return (1380ms) {'type': 'block', 'scsi_wwn': '23261366139346465', 'path': '/dev/sdf'} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 18:58:09 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d4a14813-c1ab-45f8-96a0-42c9fc7db27a tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: 2f074d68-d0a7-4204-a79d-be619ee42d0c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23261366139346465', 'path': '/dev/sdf'} {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 18:58:09 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-6fdacc15-119d-48c2-95ce-e79e81dc8c57 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.357s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 18:58:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:58:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:58:09 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[997d8e67-f3ab-4e47-b9ef-d6060f9bd573]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:671f1985-7823-411f-b273-6a6930de84e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8a7c3d74-e183-497b-b6c7-85be2b2f171e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4ee38de6-1fa4-460d-9bb4-49720104365b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:58:09 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fdacc15-119d-48c2-95ce-e79e81dc8c57 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 18:58:09 user nova-compute[75216]: No targets found.
Nov 13 18:58:09 user nova-compute[75216]: iSNS:
Nov 13 18:58:09 user nova-compute[75216]: No targets found.
Nov 13 18:58:09 user nova-compute[75216]: STATIC:
Nov 13 18:58:09 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:671f1985-7823-411f-b273-6a6930de84e1
Nov 13 18:58:09 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 18:58:09 user nova-compute[75216]:                 Iface Name: default
Nov 13 18:58:09 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:8a7c3d74-e183-497b-b6c7-85be2b2f171e
Nov 13 18:58:09 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 18:58:09 user nova-compute[75216]:                 Iface Name: default
Nov 13 18:58:09 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d
Nov 13 18:58:09 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 18:58:09 user nova-compute[75216]:                 Iface Name: default
Nov 13 18:58:09 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1
Nov 13 18:58:09 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 18:58:09 user nova-compute[75216]:                 Iface Name: default
Nov 13 18:58:09 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:4ee38de6-1fa4-460d-9bb4-49720104365b
Nov 13 18:58:09 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 18:58:09 user nova-compute[75216]:                 Iface Name: default
Nov 13 18:58:09 user nova-compute[75216]: FIRMWARE:
Nov 13 18:58:09 user nova-compute[75216]: No targets found.
Nov 13 18:58:09 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 18:58:09 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fdacc15-119d-48c2-95ce-e79e81dc8c57 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 18:58:09 user nova-compute[75216]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 18:58:09 user nova-compute[75216]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75216) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 18:58:09 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fdacc15-119d-48c2-95ce-e79e81dc8c57 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:671f1985-7823-411f-b273-6a6930de84e1', 0)] {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 18:58:09 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-d4a14813-c1ab-45f8-96a0-42c9fc7db27a tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T18:56:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1279111656',display_name='tempest-ServerActionsTestOtherA-server-1279111656',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1279111656',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKz099Lx1XxYKMwpEh9A7Hze8Yy5EijTt+h0RSW+LWAAdums7McTLzxWcs+4M2TWx6M56tfd+yHdLdlnr7vz5lvq3aL+fZolVlZV3LeOornnUO38Y1O0XVUZqifXtvNPtQ==',key_name='tempest-keypair-1574128026',keypairs=<?>,launch_index=0,launched_at=2023-11-13T18:56:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b9b7e11038e54e368acd22d06e54a351',ramdisk_id='',reservation_id='r-59nswt1o',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-537419316',owner_user_name='tempest-ServerActionsTestOtherA-537419316-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T18:58:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='23f029ff09464d699e5bd6dbf44a905d',uuid=2f074d68-d0a7-4204-a79d-be619ee42d0c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3d9260c2-c8da-47b8-884c-8c66259c7c2b", "address": "fa:16:3e:12:97:81", "network": {"id": "d7a691f0-4495-40ad-a349-91b5dc9c635a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-961583097-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-961583097-network", "vif_mac": "fa:16:3e:12:97:81"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9b7e11038e54e368acd22d06e54a351", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d9260c2-c8", "ovs_interfaceid": "3d9260c2-c8da-47b8-884c-8c66259c7c2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75216) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 18:58:09 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-d4a14813-c1ab-45f8-96a0-42c9fc7db27a tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Converting VIF {"id": "3d9260c2-c8da-47b8-884c-8c66259c7c2b", "address": "fa:16:3e:12:97:81", "network": {"id": "d7a691f0-4495-40ad-a349-91b5dc9c635a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-961583097-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-961583097-network", "vif_mac": "fa:16:3e:12:97:81"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9b7e11038e54e368acd22d06e54a351", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d9260c2-c8", "ovs_interfaceid": "3d9260c2-c8da-47b8-884c-8c66259c7c2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 18:58:09 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-d4a14813-c1ab-45f8-96a0-42c9fc7db27a tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:97:81,bridge_name='br-int',has_traffic_filtering=True,id=3d9260c2-c8da-47b8-884c-8c66259c7c2b,network=Network(d7a691f0-4495-40ad-a349-91b5dc9c635a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d9260c2-c8') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 18:58:09 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-d4a14813-c1ab-45f8-96a0-42c9fc7db27a tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: 2f074d68-d0a7-4204-a79d-be619ee42d0c] End _get_guest_xml xml=<domain type="kvm">
Nov 13 18:58:09 user nova-compute[75216]:   <uuid>2f074d68-d0a7-4204-a79d-be619ee42d0c</uuid>
Nov 13 18:58:09 user nova-compute[75216]:   <name>instance-00000019</name>
Nov 13 18:58:09 user nova-compute[75216]:   <memory>2097152</memory>
Nov 13 18:58:09 user nova-compute[75216]:   <vcpu>1</vcpu>
Nov 13 18:58:09 user nova-compute[75216]:   <metadata>
Nov 13 18:58:09 user nova-compute[75216]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 18:58:09 user nova-compute[75216]:       <nova:package version="0.0.0"/>
Nov 13 18:58:09 user nova-compute[75216]:       <nova:name>tempest-ServerActionsTestOtherA-server-1279111656</nova:name>
Nov 13 18:58:09 user nova-compute[75216]:       <nova:creationTime>2023-11-13 18:58:08</nova:creationTime>
Nov 13 18:58:09 user nova-compute[75216]:       <nova:flavor name="m1.small">
Nov 13 18:58:09 user nova-compute[75216]:         <nova:memory>2048</nova:memory>
Nov 13 18:58:09 user nova-compute[75216]:         <nova:disk>20</nova:disk>
Nov 13 18:58:09 user nova-compute[75216]:         <nova:swap>0</nova:swap>
Nov 13 18:58:09 user nova-compute[75216]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 18:58:09 user nova-compute[75216]:         <nova:vcpus>1</nova:vcpus>
Nov 13 18:58:09 user nova-compute[75216]:       </nova:flavor>
Nov 13 18:58:09 user nova-compute[75216]:       <nova:owner>
Nov 13 18:58:09 user nova-compute[75216]:         <nova:user uuid="23f029ff09464d699e5bd6dbf44a905d">tempest-ServerActionsTestOtherA-537419316-project-member</nova:user>
Nov 13 18:58:09 user nova-compute[75216]:         <nova:project uuid="b9b7e11038e54e368acd22d06e54a351">tempest-ServerActionsTestOtherA-537419316</nova:project>
Nov 13 18:58:09 user nova-compute[75216]:       </nova:owner>
Nov 13 18:58:09 user nova-compute[75216]:       <nova:ports>
Nov 13 18:58:09 user nova-compute[75216]:         <nova:port uuid="3d9260c2-c8da-47b8-884c-8c66259c7c2b">
Nov 13 18:58:09 user nova-compute[75216]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 13 18:58:09 user nova-compute[75216]:         </nova:port>
Nov 13 18:58:09 user nova-compute[75216]:       </nova:ports>
Nov 13 18:58:09 user nova-compute[75216]:     </nova:instance>
Nov 13 18:58:09 user nova-compute[75216]:   </metadata>
Nov 13 18:58:09 user nova-compute[75216]:   <sysinfo type="smbios">
Nov 13 18:58:09 user nova-compute[75216]:     <system>
Nov 13 18:58:09 user nova-compute[75216]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 18:58:09 user nova-compute[75216]:       <entry name="product">OpenStack Nova</entry>
Nov 13 18:58:09 user nova-compute[75216]:       <entry name="version">0.0.0</entry>
Nov 13 18:58:09 user nova-compute[75216]:       <entry name="serial">2f074d68-d0a7-4204-a79d-be619ee42d0c</entry>
Nov 13 18:58:09 user nova-compute[75216]:       <entry name="uuid">2f074d68-d0a7-4204-a79d-be619ee42d0c</entry>
Nov 13 18:58:09 user nova-compute[75216]:       <entry name="family">Virtual Machine</entry>
Nov 13 18:58:09 user nova-compute[75216]:     </system>
Nov 13 18:58:09 user nova-compute[75216]:   </sysinfo>
Nov 13 18:58:09 user nova-compute[75216]:   <os>
Nov 13 18:58:09 user nova-compute[75216]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 18:58:09 user nova-compute[75216]:     <boot dev="hd"/>
Nov 13 18:58:09 user nova-compute[75216]:     <smbios mode="sysinfo"/>
Nov 13 18:58:09 user nova-compute[75216]:   </os>
Nov 13 18:58:09 user nova-compute[75216]:   <features>
Nov 13 18:58:09 user nova-compute[75216]:     <acpi/>
Nov 13 18:58:09 user nova-compute[75216]:     <apic/>
Nov 13 18:58:09 user nova-compute[75216]:     <vmcoreinfo/>
Nov 13 18:58:09 user nova-compute[75216]:   </features>
Nov 13 18:58:09 user nova-compute[75216]:   <clock offset="utc">
Nov 13 18:58:09 user nova-compute[75216]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 18:58:09 user nova-compute[75216]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 18:58:09 user nova-compute[75216]:     <timer name="hpet" present="no"/>
Nov 13 18:58:09 user nova-compute[75216]:   </clock>
Nov 13 18:58:09 user nova-compute[75216]:   <cpu mode="custom" match="exact">
Nov 13 18:58:09 user nova-compute[75216]:     <model>Nehalem</model>
Nov 13 18:58:09 user nova-compute[75216]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 18:58:09 user nova-compute[75216]:   </cpu>
Nov 13 18:58:09 user nova-compute[75216]:   <devices>
Nov 13 18:58:09 user nova-compute[75216]:     <disk type="block" device="disk">
Nov 13 18:58:09 user nova-compute[75216]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 18:58:09 user nova-compute[75216]:       <source dev="/dev/sdf"/>
Nov 13 18:58:09 user nova-compute[75216]:       <target dev="vda" bus="virtio"/>
Nov 13 18:58:09 user nova-compute[75216]:       <serial>8a7c3d74-e183-497b-b6c7-85be2b2f171e</serial>
Nov 13 18:58:09 user nova-compute[75216]:     </disk>
Nov 13 18:58:09 user nova-compute[75216]:     <interface type="ethernet">
Nov 13 18:58:09 user nova-compute[75216]:       <mac address="fa:16:3e:12:97:81"/>
Nov 13 18:58:09 user nova-compute[75216]:       <model type="virtio"/>
Nov 13 18:58:09 user nova-compute[75216]:       <mtu size="1442"/>
Nov 13 18:58:09 user nova-compute[75216]:       <target dev="tap3d9260c2-c8"/>
Nov 13 18:58:09 user nova-compute[75216]:     </interface>
Nov 13 18:58:09 user nova-compute[75216]:     <serial type="pty">
Nov 13 18:58:09 user nova-compute[75216]:       <log file="/opt/stack/data/nova/instances/2f074d68-d0a7-4204-a79d-be619ee42d0c/console.log" append="off"/>
Nov 13 18:58:09 user nova-compute[75216]:     </serial>
Nov 13 18:58:09 user nova-compute[75216]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 18:58:09 user nova-compute[75216]:     <video>
Nov 13 18:58:09 user nova-compute[75216]:       <model type="virtio"/>
Nov 13 18:58:09 user nova-compute[75216]:     </video>
Nov 13 18:58:09 user nova-compute[75216]:     <rng model="virtio">
Nov 13 18:58:09 user nova-compute[75216]:       <backend model="random">/dev/urandom</backend>
Nov 13 18:58:09 user nova-compute[75216]:     </rng>
Nov 13 18:58:09 user nova-compute[75216]:     <controller type="usb" index="0" model="none"/>
Nov 13 18:58:09 user nova-compute[75216]:     <memballoon model="virtio">
Nov 13 18:58:09 user nova-compute[75216]:       <stats period="10"/>
Nov 13 18:58:09 user nova-compute[75216]:     </memballoon>
Nov 13 18:58:09 user nova-compute[75216]:   </devices>
Nov 13 18:58:09 user nova-compute[75216]: </domain>
Nov 13 18:58:09 user nova-compute[75216]:  {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 18:58:10 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-d4a14813-c1ab-45f8-96a0-42c9fc7db27a tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T18:56:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1279111656',display_name='tempest-ServerActionsTestOtherA-server-1279111656',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1279111656',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKz099Lx1XxYKMwpEh9A7Hze8Yy5EijTt+h0RSW+LWAAdums7McTLzxWcs+4M2TWx6M56tfd+yHdLdlnr7vz5lvq3aL+fZolVlZV3LeOornnUO38Y1O0XVUZqifXtvNPtQ==',key_name='tempest-keypair-1574128026',keypairs=<?>,launch_index=0,launched_at=2023-11-13T18:56:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b9b7e11038e54e368acd22d06e54a351',ramdisk_id='',reservation_id='r-59nswt1o',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-537419316',owner_user_name='tempest-ServerActionsTestOtherA-537419316-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T18:58:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='23f029ff09464d699e5bd6dbf44a905d',uuid=2f074d68-d0a7-4204-a79d-be619ee42d0c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3d9260c2-c8da-47b8-884c-8c66259c7c2b", "address": "fa:16:3e:12:97:81", "network": {"id": "d7a691f0-4495-40ad-a349-91b5dc9c635a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-961583097-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-961583097-network", "vif_mac": "fa:16:3e:12:97:81"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9b7e11038e54e368acd22d06e54a351", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d9260c2-c8", "ovs_interfaceid": "3d9260c2-c8da-47b8-884c-8c66259c7c2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 18:58:10 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-d4a14813-c1ab-45f8-96a0-42c9fc7db27a tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Converting VIF {"id": "3d9260c2-c8da-47b8-884c-8c66259c7c2b", "address": "fa:16:3e:12:97:81", "network": {"id": "d7a691f0-4495-40ad-a349-91b5dc9c635a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-961583097-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-961583097-network", "vif_mac": "fa:16:3e:12:97:81"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9b7e11038e54e368acd22d06e54a351", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d9260c2-c8", "ovs_interfaceid": "3d9260c2-c8da-47b8-884c-8c66259c7c2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 18:58:10 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-d4a14813-c1ab-45f8-96a0-42c9fc7db27a tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:97:81,bridge_name='br-int',has_traffic_filtering=True,id=3d9260c2-c8da-47b8-884c-8c66259c7c2b,network=Network(d7a691f0-4495-40ad-a349-91b5dc9c635a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d9260c2-c8') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 18:58:10 user nova-compute[75216]: DEBUG os_vif [None req-d4a14813-c1ab-45f8-96a0-42c9fc7db27a tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:97:81,bridge_name='br-int',has_traffic_filtering=True,id=3d9260c2-c8da-47b8-884c-8c66259c7c2b,network=Network(d7a691f0-4495-40ad-a349-91b5dc9c635a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d9260c2-c8') {{(pid=75216) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 18:58:10 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:58:10 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:58:10 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:58:10 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 18:58:10 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:58:10 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6ee13622-13a5-5558-98f4-bf4b64d9558b', '_type': 'linux-noop'}}, row=False) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:58:10 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:58:10 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:58:10 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:58:10 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b870740-d5b3-4d7d-a3d6-41222b9bea7b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4ee38de6-1fa4-460d-9bb4-49720104365b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:671f1985-7823-411f-b273-6a6930de84e1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8a7c3d74-e183-497b-b6c7-85be2b2f171e\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:58:10 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:58:10 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3d9260c2-c8, may_exist=True, interface_attrs={}) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:58:10 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3d9260c2-c8, col_values=(('qos', UUID('0e74f6e1-05ec-4ee7-8ade-f38e33cd6390')),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:58:10 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3d9260c2-c8, col_values=(('external_ids', {'iface-id': '3d9260c2-c8da-47b8-884c-8c66259c7c2b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:12:97:81', 'vm-uuid': '2f074d68-d0a7-4204-a79d-be619ee42d0c'}),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:58:10 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:58:10 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:58:10 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:58:10 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:58:10 user nova-compute[75216]: INFO os_vif [None req-d4a14813-c1ab-45f8-96a0-42c9fc7db27a tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:97:81,bridge_name='br-int',has_traffic_filtering=True,id=3d9260c2-c8da-47b8-884c-8c66259c7c2b,network=Network(d7a691f0-4495-40ad-a349-91b5dc9c635a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d9260c2-c8')
Nov 13 18:58:10 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:58:10 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[a49a526c-9769-4257-973c-6d133b121d0e]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ee38de6-1fa4-460d-9bb4-49720104365b (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:671f1985-7823-411f-b273-6a6930de84e1 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a7c3d74-e183-497b-b6c7-85be2b2f171e (non-flash)\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:58:10 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fdacc15-119d-48c2-95ce-e79e81dc8c57 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ee38de6-1fa4-460d-9bb4-49720104365b (non-flash)
Nov 13 18:58:10 user nova-compute[75216]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1 (non-flash)
Nov 13 18:58:10 user nova-compute[75216]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d (non-flash)
Nov 13 18:58:10 user nova-compute[75216]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:671f1985-7823-411f-b273-6a6930de84e1 (non-flash)
Nov 13 18:58:10 user nova-compute[75216]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a7c3d74-e183-497b-b6c7-85be2b2f171e (non-flash)
Nov 13 18:58:10 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 18:58:10 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fdacc15-119d-48c2-95ce-e79e81dc8c57 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ee38de6-1fa4-460d-9bb4-49720104365b (non-flash)
Nov 13 18:58:10 user nova-compute[75216]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1 (non-flash)
Nov 13 18:58:10 user nova-compute[75216]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d (non-flash)
Nov 13 18:58:10 user nova-compute[75216]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:671f1985-7823-411f-b273-6a6930de84e1 (non-flash)
Nov 13 18:58:10 user nova-compute[75216]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a7c3d74-e183-497b-b6c7-85be2b2f171e (non-flash)
Nov 13 18:58:10 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 18:58:10 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fdacc15-119d-48c2-95ce-e79e81dc8c57 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe3a86d1870>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:671f1985-7823-411f-b273-6a6930de84e1'): ({'sde'}, set())}) {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 18:58:10 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-6fdacc15-119d-48c2-95ce-e79e81dc8c57 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Removing single pathed devices sde {{(pid=75216) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 18:58:10 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:58:10 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:58:10 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[674686b5-86a0-49be-9f64-fc001318d077]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:58:10 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:58:10 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-d4a14813-c1ab-45f8-96a0-42c9fc7db27a tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 18:58:10 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-d4a14813-c1ab-45f8-96a0-42c9fc7db27a tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] No VIF found with MAC fa:16:3e:12:97:81, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 18:58:10 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:58:10 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[d393a7da-6bbe-4c8e-ab06-247edcc41632]: (4, ('ok\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:58:10 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-6fdacc15-119d-48c2-95ce-e79e81dc8c57 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Flushing IO for device /dev/sde {{(pid=75216) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 18:58:10 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:58:10 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:58:10 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e1e88a9-86ce-4d71-8929-c552f6be72e3]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:58:10 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-6fdacc15-119d-48c2-95ce-e79e81dc8c57 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75216) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 18:58:10 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:58:10 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.044s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:58:10 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[aac20070-9dda-494c-856b-af4834f16d1b]: (4, ('1', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:58:10 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-6fdacc15-119d-48c2-95ce-e79e81dc8c57 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 18:58:10 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-6fdacc15-119d-48c2-95ce-e79e81dc8c57 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] SCSI volumes sde have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 18:58:10 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fdacc15-119d-48c2-95ce-e79e81dc8c57 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:671f1985-7823-411f-b273-6a6930de84e1')] {{(pid=75216) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 18:58:10 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:671f1985-7823-411f-b273-6a6930de84e1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:58:10 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:671f1985-7823-411f-b273-6a6930de84e1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:58:10 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[e30a9441-69a6-4c1e-88e2-2efb57023dec]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:58:10 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fdacc15-119d-48c2-95ce-e79e81dc8c57 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:58:10 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:671f1985-7823-411f-b273-6a6930de84e1 -p 172.16.0.220:3260 --logout {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:58:10 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:671f1985-7823-411f-b273-6a6930de84e1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:58:10 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[24debfcf-8f91-4cb1-a005-95fb2ac84363]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:671f1985-7823-411f-b273-6a6930de84e1, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:671f1985-7823-411f-b273-6a6930de84e1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:58:10 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fdacc15-119d-48c2-95ce-e79e81dc8c57 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:671f1985-7823-411f-b273-6a6930de84e1, portal: 172.16.0.220,3260]
Nov 13 18:58:10 user nova-compute[75216]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:671f1985-7823-411f-b273-6a6930de84e1, portal: 172.16.0.220,3260] successful.
Nov 13 18:58:10 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:58:10 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:671f1985-7823-411f-b273-6a6930de84e1 -p 172.16.0.220:3260 --op delete {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:58:10 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:671f1985-7823-411f-b273-6a6930de84e1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:58:10 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fb70308-f57a-4eb7-8112-7e76a46c77cf]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:58:10 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fdacc15-119d-48c2-95ce-e79e81dc8c57 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:58:10 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-6fdacc15-119d-48c2-95ce-e79e81dc8c57 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.323s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 18:58:10 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fdacc15-119d-48c2-95ce-e79e81dc8c57 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] <== disconnect_volume: return (679ms) None {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 18:58:10 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6fdacc15-119d-48c2-95ce-e79e81dc8c57 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] [instance: 3f08c061-312d-42d3-a811-e98ace4e7a63] Disconnected iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 18:58:10 user nova-compute[75216]: DEBUG nova.objects.instance [None req-6fdacc15-119d-48c2-95ce-e79e81dc8c57 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Lazy-loading 'flavor' on Instance uuid 3f08c061-312d-42d3-a811-e98ace4e7a63 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 18:58:11 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-6fdacc15-119d-48c2-95ce-e79e81dc8c57 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Lock "3f08c061-312d-42d3-a811-e98ace4e7a63" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.981s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:58:11 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:58:11 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:58:11 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:58:11 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:58:11 user nova-compute[75216]: DEBUG nova.compute.manager [req-f3600105-cc07-4c83-8e7f-108f70b79ab0 req-7e7a8954-d670-4c38-900c-3863a68db63e service nova] [instance: 2f074d68-d0a7-4204-a79d-be619ee42d0c] Received event network-vif-plugged-3d9260c2-c8da-47b8-884c-8c66259c7c2b {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:58:11 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-f3600105-cc07-4c83-8e7f-108f70b79ab0 req-7e7a8954-d670-4c38-900c-3863a68db63e service nova] Acquiring lock "2f074d68-d0a7-4204-a79d-be619ee42d0c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:58:11 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-f3600105-cc07-4c83-8e7f-108f70b79ab0 req-7e7a8954-d670-4c38-900c-3863a68db63e service nova] Lock "2f074d68-d0a7-4204-a79d-be619ee42d0c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:58:11 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-f3600105-cc07-4c83-8e7f-108f70b79ab0 req-7e7a8954-d670-4c38-900c-3863a68db63e service nova] Lock "2f074d68-d0a7-4204-a79d-be619ee42d0c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:58:11 user nova-compute[75216]: DEBUG nova.compute.manager [req-f3600105-cc07-4c83-8e7f-108f70b79ab0 req-7e7a8954-d670-4c38-900c-3863a68db63e service nova] [instance: 2f074d68-d0a7-4204-a79d-be619ee42d0c] No waiting events found dispatching network-vif-plugged-3d9260c2-c8da-47b8-884c-8c66259c7c2b {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:58:11 user nova-compute[75216]: WARNING nova.compute.manager [req-f3600105-cc07-4c83-8e7f-108f70b79ab0 req-7e7a8954-d670-4c38-900c-3863a68db63e service nova] [instance: 2f074d68-d0a7-4204-a79d-be619ee42d0c] Received unexpected event network-vif-plugged-3d9260c2-c8da-47b8-884c-8c66259c7c2b for instance with vm_state active and task_state resize_finish.
Nov 13 18:58:11 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:58:11 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:58:13 user nova-compute[75216]: DEBUG nova.compute.manager [None req-d4a14813-c1ab-45f8-96a0-42c9fc7db27a tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: 2f074d68-d0a7-4204-a79d-be619ee42d0c] Instance event wait completed in 0 seconds for  {{(pid=75216) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 18:58:13 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 2f074d68-d0a7-4204-a79d-be619ee42d0c] Instance running successfully.
Nov 13 18:58:13 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-d4a14813-c1ab-45f8-96a0-42c9fc7db27a tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: 2f074d68-d0a7-4204-a79d-be619ee42d0c] Failed to set time: agent not configured {{(pid=75216) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 13 18:58:13 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-d4a14813-c1ab-45f8-96a0-42c9fc7db27a tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: 2f074d68-d0a7-4204-a79d-be619ee42d0c] finish_migration finished successfully. {{(pid=75216) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Nov 13 18:58:13 user nova-compute[75216]: DEBUG nova.compute.manager [req-0102efae-ff05-4957-9abf-b2d3cf1f640c req-c4c4f637-0914-44c1-b7c8-a8315fb3b024 service nova] [instance: 2f074d68-d0a7-4204-a79d-be619ee42d0c] Received event network-vif-plugged-3d9260c2-c8da-47b8-884c-8c66259c7c2b {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:58:13 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-0102efae-ff05-4957-9abf-b2d3cf1f640c req-c4c4f637-0914-44c1-b7c8-a8315fb3b024 service nova] Acquiring lock "2f074d68-d0a7-4204-a79d-be619ee42d0c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:58:13 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-0102efae-ff05-4957-9abf-b2d3cf1f640c req-c4c4f637-0914-44c1-b7c8-a8315fb3b024 service nova] Lock "2f074d68-d0a7-4204-a79d-be619ee42d0c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:58:13 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-0102efae-ff05-4957-9abf-b2d3cf1f640c req-c4c4f637-0914-44c1-b7c8-a8315fb3b024 service nova] Lock "2f074d68-d0a7-4204-a79d-be619ee42d0c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:58:13 user nova-compute[75216]: DEBUG nova.compute.manager [req-0102efae-ff05-4957-9abf-b2d3cf1f640c req-c4c4f637-0914-44c1-b7c8-a8315fb3b024 service nova] [instance: 2f074d68-d0a7-4204-a79d-be619ee42d0c] No waiting events found dispatching network-vif-plugged-3d9260c2-c8da-47b8-884c-8c66259c7c2b {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:58:13 user nova-compute[75216]: WARNING nova.compute.manager [req-0102efae-ff05-4957-9abf-b2d3cf1f640c req-c4c4f637-0914-44c1-b7c8-a8315fb3b024 service nova] [instance: 2f074d68-d0a7-4204-a79d-be619ee42d0c] Received unexpected event network-vif-plugged-3d9260c2-c8da-47b8-884c-8c66259c7c2b for instance with vm_state active and task_state resize_finish.
Nov 13 18:58:13 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:58:15 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:58:20 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:58:22 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-7c3d96da-ae65-453d-a97a-1962d3091897 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Acquiring lock "91ea8a19-a365-484c-80c7-baf90e7dd1aa" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:58:22 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-7c3d96da-ae65-453d-a97a-1962d3091897 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Lock "91ea8a19-a365-484c-80c7-baf90e7dd1aa" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:58:22 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-7c3d96da-ae65-453d-a97a-1962d3091897 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Acquiring lock "91ea8a19-a365-484c-80c7-baf90e7dd1aa-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:58:22 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-7c3d96da-ae65-453d-a97a-1962d3091897 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Lock "91ea8a19-a365-484c-80c7-baf90e7dd1aa-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:58:22 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-7c3d96da-ae65-453d-a97a-1962d3091897 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Lock "91ea8a19-a365-484c-80c7-baf90e7dd1aa-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:58:22 user nova-compute[75216]: INFO nova.compute.manager [None req-7c3d96da-ae65-453d-a97a-1962d3091897 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] [instance: 91ea8a19-a365-484c-80c7-baf90e7dd1aa] Terminating instance
Nov 13 18:58:22 user nova-compute[75216]: DEBUG nova.compute.manager [None req-7c3d96da-ae65-453d-a97a-1962d3091897 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] [instance: 91ea8a19-a365-484c-80c7-baf90e7dd1aa] Start destroying the instance on the hypervisor. {{(pid=75216) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 18:58:22 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:58:22 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:58:22 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:58:22 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:58:22 user nova-compute[75216]: DEBUG nova.compute.manager [req-3995db84-bebd-44c9-8c9b-a6b5a71c19cc req-98c39955-74f9-4a42-9385-fc705ab1a04b service nova] [instance: 91ea8a19-a365-484c-80c7-baf90e7dd1aa] Received event network-vif-unplugged-2cfb645f-7bee-4657-b0d8-afcaa0298ac9 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:58:22 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-3995db84-bebd-44c9-8c9b-a6b5a71c19cc req-98c39955-74f9-4a42-9385-fc705ab1a04b service nova] Acquiring lock "91ea8a19-a365-484c-80c7-baf90e7dd1aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:58:22 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-3995db84-bebd-44c9-8c9b-a6b5a71c19cc req-98c39955-74f9-4a42-9385-fc705ab1a04b service nova] Lock "91ea8a19-a365-484c-80c7-baf90e7dd1aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:58:22 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-3995db84-bebd-44c9-8c9b-a6b5a71c19cc req-98c39955-74f9-4a42-9385-fc705ab1a04b service nova] Lock "91ea8a19-a365-484c-80c7-baf90e7dd1aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:58:22 user nova-compute[75216]: DEBUG nova.compute.manager [req-3995db84-bebd-44c9-8c9b-a6b5a71c19cc req-98c39955-74f9-4a42-9385-fc705ab1a04b service nova] [instance: 91ea8a19-a365-484c-80c7-baf90e7dd1aa] No waiting events found dispatching network-vif-unplugged-2cfb645f-7bee-4657-b0d8-afcaa0298ac9 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:58:22 user nova-compute[75216]: DEBUG nova.compute.manager [req-3995db84-bebd-44c9-8c9b-a6b5a71c19cc req-98c39955-74f9-4a42-9385-fc705ab1a04b service nova] [instance: 91ea8a19-a365-484c-80c7-baf90e7dd1aa] Received event network-vif-unplugged-2cfb645f-7bee-4657-b0d8-afcaa0298ac9 for instance with task_state deleting. {{(pid=75216) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 18:58:23 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 91ea8a19-a365-484c-80c7-baf90e7dd1aa] Instance destroyed successfully.
Nov 13 18:58:23 user nova-compute[75216]: DEBUG nova.objects.instance [None req-7c3d96da-ae65-453d-a97a-1962d3091897 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Lazy-loading 'resources' on Instance uuid 91ea8a19-a365-484c-80c7-baf90e7dd1aa {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 18:58:23 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-7c3d96da-ae65-453d-a97a-1962d3091897 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T18:49:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2138583247',display_name='tempest-ServerActionsTestOtherB-server-2138583247',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2138583247',id=18,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAl4rrs8AsTXVVWOe2ej9Q0PBsZfl4SiBx6Z+7YBp2Q8nhbMLqhEEYWYCrwvKHOa1CVoqmRod9jN0d8asOX7OMqzQqSN/edxVDFYygCGcMd2W6HT1YDz1w3rZ0s5A43lWg==',key_name='tempest-keypair-1520178236',keypairs=<?>,launch_index=0,launched_at=2023-11-13T18:55:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0194e3c88e2b49c5ba9b9844f6048ea9',ramdisk_id='',reservation_id='r-z6obctyl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-1164011898',owner_user_name='tempest-ServerActionsTestOtherB-1164011898-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T18:55:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0543920a35a54c83bcc159b7a2b08a80',uuid=91ea8a19-a365-484c-80c7-baf90e7dd1aa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2cfb645f-7bee-4657-b0d8-afcaa0298ac9", "address": "fa:16:3e:3e:1d:91", "network": {"id": "a9670fc3-8a8e-4a2b-a39f-d41042d3443d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1394481632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0194e3c88e2b49c5ba9b9844f6048ea9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cfb645f-7b", "ovs_interfaceid": "2cfb645f-7bee-4657-b0d8-afcaa0298ac9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 18:58:23 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-7c3d96da-ae65-453d-a97a-1962d3091897 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Converting VIF {"id": "2cfb645f-7bee-4657-b0d8-afcaa0298ac9", "address": "fa:16:3e:3e:1d:91", "network": {"id": "a9670fc3-8a8e-4a2b-a39f-d41042d3443d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1394481632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0194e3c88e2b49c5ba9b9844f6048ea9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cfb645f-7b", "ovs_interfaceid": "2cfb645f-7bee-4657-b0d8-afcaa0298ac9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 18:58:23 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-7c3d96da-ae65-453d-a97a-1962d3091897 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:1d:91,bridge_name='br-int',has_traffic_filtering=True,id=2cfb645f-7bee-4657-b0d8-afcaa0298ac9,network=Network(a9670fc3-8a8e-4a2b-a39f-d41042d3443d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cfb645f-7b') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 18:58:23 user nova-compute[75216]: DEBUG os_vif [None req-7c3d96da-ae65-453d-a97a-1962d3091897 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:1d:91,bridge_name='br-int',has_traffic_filtering=True,id=2cfb645f-7bee-4657-b0d8-afcaa0298ac9,network=Network(a9670fc3-8a8e-4a2b-a39f-d41042d3443d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cfb645f-7b') {{(pid=75216) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 18:58:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:58:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2cfb645f-7b, bridge=br-int, if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:58:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:58:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:58:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:58:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ebd02f98-c0ed-41c9-be1d-60a7f6ca1d63) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:58:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:58:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:58:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:58:23 user nova-compute[75216]: INFO os_vif [None req-7c3d96da-ae65-453d-a97a-1962d3091897 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:1d:91,bridge_name='br-int',has_traffic_filtering=True,id=2cfb645f-7bee-4657-b0d8-afcaa0298ac9,network=Network(a9670fc3-8a8e-4a2b-a39f-d41042d3443d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cfb645f-7b')
Nov 13 18:58:23 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7c3d96da-ae65-453d-a97a-1962d3091897 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] [instance: 91ea8a19-a365-484c-80c7-baf90e7dd1aa] calling os-brick to detach iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 18:58:23 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c3d96da-ae65-453d-a97a-1962d3091897 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3a8669e40>, {'target_iqn': 'iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JvBCenjA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 18:58:23 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-7c3d96da-ae65-453d-a97a-1962d3091897 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 18:58:23 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-7c3d96da-ae65-453d-a97a-1962d3091897 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 18:58:23 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-7c3d96da-ae65-453d-a97a-1962d3091897 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 18:58:23 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:58:23 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:58:23 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd952d29-ac75-4cc5-a7f8-3e1e9e155281]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8a7c3d74-e183-497b-b6c7-85be2b2f171e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4ee38de6-1fa4-460d-9bb4-49720104365b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:58:23 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c3d96da-ae65-453d-a97a-1962d3091897 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 18:58:23 user nova-compute[75216]: No targets found.
Nov 13 18:58:23 user nova-compute[75216]: iSNS:
Nov 13 18:58:23 user nova-compute[75216]: No targets found.
Nov 13 18:58:23 user nova-compute[75216]: STATIC:
Nov 13 18:58:23 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:8a7c3d74-e183-497b-b6c7-85be2b2f171e
Nov 13 18:58:23 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 18:58:23 user nova-compute[75216]:                 Iface Name: default
Nov 13 18:58:23 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d
Nov 13 18:58:23 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 18:58:23 user nova-compute[75216]:                 Iface Name: default
Nov 13 18:58:23 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1
Nov 13 18:58:23 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 18:58:23 user nova-compute[75216]:                 Iface Name: default
Nov 13 18:58:23 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:4ee38de6-1fa4-460d-9bb4-49720104365b
Nov 13 18:58:23 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 18:58:23 user nova-compute[75216]:                 Iface Name: default
Nov 13 18:58:23 user nova-compute[75216]: FIRMWARE:
Nov 13 18:58:23 user nova-compute[75216]: No targets found.
Nov 13 18:58:23 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 18:58:23 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c3d96da-ae65-453d-a97a-1962d3091897 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 18:58:23 user nova-compute[75216]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 18:58:23 user nova-compute[75216]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75216) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 18:58:23 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c3d96da-ae65-453d-a97a-1962d3091897 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d', 0)] {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 18:58:23 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:58:23 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:58:23 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f9e05f4-d957-40a0-baef-d856b36e2c57]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4ee38de6-1fa4-460d-9bb4-49720104365b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8a7c3d74-e183-497b-b6c7-85be2b2f171e\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:58:23 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:58:23 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:58:23 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[f30331fb-4358-476f-9516-3708d3825165]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ee38de6-1fa4-460d-9bb4-49720104365b (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a7c3d74-e183-497b-b6c7-85be2b2f171e (non-flash)\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:58:23 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c3d96da-ae65-453d-a97a-1962d3091897 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ee38de6-1fa4-460d-9bb4-49720104365b (non-flash)
Nov 13 18:58:23 user nova-compute[75216]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1 (non-flash)
Nov 13 18:58:23 user nova-compute[75216]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d (non-flash)
Nov 13 18:58:23 user nova-compute[75216]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a7c3d74-e183-497b-b6c7-85be2b2f171e (non-flash)
Nov 13 18:58:23 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 18:58:23 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c3d96da-ae65-453d-a97a-1962d3091897 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ee38de6-1fa4-460d-9bb4-49720104365b (non-flash)
Nov 13 18:58:23 user nova-compute[75216]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1 (non-flash)
Nov 13 18:58:23 user nova-compute[75216]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d (non-flash)
Nov 13 18:58:23 user nova-compute[75216]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a7c3d74-e183-497b-b6c7-85be2b2f171e (non-flash)
Nov 13 18:58:23 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 18:58:23 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c3d96da-ae65-453d-a97a-1962d3091897 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe3c03c3130>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d'): ({'sdd'}, set())}) {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 18:58:23 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-7c3d96da-ae65-453d-a97a-1962d3091897 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Removing single pathed devices sdd {{(pid=75216) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 18:58:23 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:58:23 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:58:23 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cab560d-3e8a-49f3-992e-b9fb94780183]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:58:23 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:58:23 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:58:23 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[001dd387-1c72-4c45-9340-c7c5b07d99bd]: (4, ('ok\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:58:23 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-7c3d96da-ae65-453d-a97a-1962d3091897 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Flushing IO for device /dev/sdd {{(pid=75216) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 18:58:23 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:58:23 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:58:23 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6c4cd3d-f4f5-4554-908e-0553a65a66a3]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:58:23 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-7c3d96da-ae65-453d-a97a-1962d3091897 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75216) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 18:58:23 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:58:23 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.041s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:58:23 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[32e3e2f1-59b8-4a09-8288-55ace47a7928]: (4, ('1', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:58:23 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-7c3d96da-ae65-453d-a97a-1962d3091897 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 18:58:23 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-7c3d96da-ae65-453d-a97a-1962d3091897 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] SCSI volumes sdd have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 18:58:23 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c3d96da-ae65-453d-a97a-1962d3091897 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d')] {{(pid=75216) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 18:58:23 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:58:23 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:58:23 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[e94cdb76-4357-462b-8005-388bcfc4551b]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:58:23 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c3d96da-ae65-453d-a97a-1962d3091897 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:58:23 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d -p 172.16.0.220:3260 --logout {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:58:23 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:58:23 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[36f7adfc-9f11-4462-b95a-db2793985f00]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:58:23 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c3d96da-ae65-453d-a97a-1962d3091897 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d, portal: 172.16.0.220,3260]
Nov 13 18:58:23 user nova-compute[75216]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d, portal: 172.16.0.220,3260] successful.
Nov 13 18:58:23 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:58:23 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d -p 172.16.0.220:3260 --op delete {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:58:23 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82de1607-b976-408c-b503-062b8569f72d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:58:23 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bc440ee-ed14-47c6-aae7-434022334e8a]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:58:23 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c3d96da-ae65-453d-a97a-1962d3091897 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:58:23 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-7c3d96da-ae65-453d-a97a-1962d3091897 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.302s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 18:58:23 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c3d96da-ae65-453d-a97a-1962d3091897 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] <== disconnect_volume: return (303ms) None {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 18:58:23 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7c3d96da-ae65-453d-a97a-1962d3091897 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] [instance: 91ea8a19-a365-484c-80c7-baf90e7dd1aa] Disconnected iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 18:58:23 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-7c3d96da-ae65-453d-a97a-1962d3091897 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] [instance: 91ea8a19-a365-484c-80c7-baf90e7dd1aa] Deleting instance files /opt/stack/data/nova/instances/91ea8a19-a365-484c-80c7-baf90e7dd1aa_del
Nov 13 18:58:23 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-7c3d96da-ae65-453d-a97a-1962d3091897 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] [instance: 91ea8a19-a365-484c-80c7-baf90e7dd1aa] Deletion of /opt/stack/data/nova/instances/91ea8a19-a365-484c-80c7-baf90e7dd1aa_del complete
Nov 13 18:58:23 user nova-compute[75216]: INFO nova.compute.manager [None req-7c3d96da-ae65-453d-a97a-1962d3091897 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] [instance: 91ea8a19-a365-484c-80c7-baf90e7dd1aa] Took 1.21 seconds to destroy the instance on the hypervisor.
Nov 13 18:58:23 user nova-compute[75216]: DEBUG oslo.service.loopingcall [None req-7c3d96da-ae65-453d-a97a-1962d3091897 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75216) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 18:58:23 user nova-compute[75216]: DEBUG nova.compute.manager [-] [instance: 91ea8a19-a365-484c-80c7-baf90e7dd1aa] Deallocating network for instance {{(pid=75216) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 18:58:23 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: 91ea8a19-a365-484c-80c7-baf90e7dd1aa] deallocate_for_instance() {{(pid=75216) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 18:58:24 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: 91ea8a19-a365-484c-80c7-baf90e7dd1aa] Updating instance_info_cache with network_info: [] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 18:58:24 user nova-compute[75216]: INFO nova.compute.manager [-] [instance: 91ea8a19-a365-484c-80c7-baf90e7dd1aa] Took 0.78 seconds to deallocate network for instance.
Nov 13 18:58:24 user nova-compute[75216]: DEBUG nova.compute.manager [req-a6bcedf1-200b-455b-b25b-d60df0964463 req-b5687740-d8aa-4530-98fb-e625a1028488 service nova] [instance: 91ea8a19-a365-484c-80c7-baf90e7dd1aa] Received event network-vif-plugged-2cfb645f-7bee-4657-b0d8-afcaa0298ac9 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:58:24 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-a6bcedf1-200b-455b-b25b-d60df0964463 req-b5687740-d8aa-4530-98fb-e625a1028488 service nova] Acquiring lock "91ea8a19-a365-484c-80c7-baf90e7dd1aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:58:24 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-a6bcedf1-200b-455b-b25b-d60df0964463 req-b5687740-d8aa-4530-98fb-e625a1028488 service nova] Lock "91ea8a19-a365-484c-80c7-baf90e7dd1aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:58:24 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-a6bcedf1-200b-455b-b25b-d60df0964463 req-b5687740-d8aa-4530-98fb-e625a1028488 service nova] Lock "91ea8a19-a365-484c-80c7-baf90e7dd1aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:58:24 user nova-compute[75216]: DEBUG nova.compute.manager [req-a6bcedf1-200b-455b-b25b-d60df0964463 req-b5687740-d8aa-4530-98fb-e625a1028488 service nova] [instance: 91ea8a19-a365-484c-80c7-baf90e7dd1aa] No waiting events found dispatching network-vif-plugged-2cfb645f-7bee-4657-b0d8-afcaa0298ac9 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:58:24 user nova-compute[75216]: WARNING nova.compute.manager [req-a6bcedf1-200b-455b-b25b-d60df0964463 req-b5687740-d8aa-4530-98fb-e625a1028488 service nova] [instance: 91ea8a19-a365-484c-80c7-baf90e7dd1aa] Received unexpected event network-vif-plugged-2cfb645f-7bee-4657-b0d8-afcaa0298ac9 for instance with vm_state active and task_state deleting.
Nov 13 18:58:24 user nova-compute[75216]: DEBUG nova.compute.manager [req-a6bcedf1-200b-455b-b25b-d60df0964463 req-b5687740-d8aa-4530-98fb-e625a1028488 service nova] [instance: 91ea8a19-a365-484c-80c7-baf90e7dd1aa] Received event network-vif-deleted-2cfb645f-7bee-4657-b0d8-afcaa0298ac9 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:58:25 user nova-compute[75216]: INFO nova.compute.manager [None req-7c3d96da-ae65-453d-a97a-1962d3091897 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] [instance: 91ea8a19-a365-484c-80c7-baf90e7dd1aa] Took 0.74 seconds to detach 1 volumes for instance.
Nov 13 18:58:25 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-7c3d96da-ae65-453d-a97a-1962d3091897 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:58:25 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-7c3d96da-ae65-453d-a97a-1962d3091897 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:58:25 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-7c3d96da-ae65-453d-a97a-1962d3091897 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 18:58:25 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-7c3d96da-ae65-453d-a97a-1962d3091897 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 18:58:25 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-7c3d96da-ae65-453d-a97a-1962d3091897 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.311s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:58:25 user nova-compute[75216]: INFO nova.scheduler.client.report [None req-7c3d96da-ae65-453d-a97a-1962d3091897 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Deleted allocations for instance 91ea8a19-a365-484c-80c7-baf90e7dd1aa
Nov 13 18:58:25 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-7c3d96da-ae65-453d-a97a-1962d3091897 tempest-ServerActionsTestOtherB-1164011898 tempest-ServerActionsTestOtherB-1164011898-project-member] Lock "91ea8a19-a365-484c-80c7-baf90e7dd1aa" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.223s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:58:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:58:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:58:33 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:58:33 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:58:38 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:58:38 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:58:40 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-4bfe6cca-30cc-4dfd-bd34-8fd89fa3ba25 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Acquiring lock "3f08c061-312d-42d3-a811-e98ace4e7a63" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:58:40 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-4bfe6cca-30cc-4dfd-bd34-8fd89fa3ba25 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Lock "3f08c061-312d-42d3-a811-e98ace4e7a63" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:58:40 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-4bfe6cca-30cc-4dfd-bd34-8fd89fa3ba25 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Acquiring lock "3f08c061-312d-42d3-a811-e98ace4e7a63-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:58:40 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-4bfe6cca-30cc-4dfd-bd34-8fd89fa3ba25 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Lock "3f08c061-312d-42d3-a811-e98ace4e7a63-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:58:40 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-4bfe6cca-30cc-4dfd-bd34-8fd89fa3ba25 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Lock "3f08c061-312d-42d3-a811-e98ace4e7a63-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:58:40 user nova-compute[75216]: INFO nova.compute.manager [None req-4bfe6cca-30cc-4dfd-bd34-8fd89fa3ba25 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] [instance: 3f08c061-312d-42d3-a811-e98ace4e7a63] Terminating instance
Nov 13 18:58:40 user nova-compute[75216]: DEBUG nova.compute.manager [None req-4bfe6cca-30cc-4dfd-bd34-8fd89fa3ba25 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] [instance: 3f08c061-312d-42d3-a811-e98ace4e7a63] Start destroying the instance on the hypervisor. {{(pid=75216) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 18:58:40 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:58:40 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:58:40 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:58:40 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:58:40 user nova-compute[75216]: DEBUG nova.compute.manager [req-5e63ce42-8b59-4327-a160-09863b6c5a7b req-d8ce7688-064c-4d6d-9527-9c5752a7d1ec service nova] [instance: 3f08c061-312d-42d3-a811-e98ace4e7a63] Received event network-vif-unplugged-225eb5bf-3c60-42f6-9bf7-e045ccda1213 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:58:40 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-5e63ce42-8b59-4327-a160-09863b6c5a7b req-d8ce7688-064c-4d6d-9527-9c5752a7d1ec service nova] Acquiring lock "3f08c061-312d-42d3-a811-e98ace4e7a63-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:58:40 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-5e63ce42-8b59-4327-a160-09863b6c5a7b req-d8ce7688-064c-4d6d-9527-9c5752a7d1ec service nova] Lock "3f08c061-312d-42d3-a811-e98ace4e7a63-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:58:40 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-5e63ce42-8b59-4327-a160-09863b6c5a7b req-d8ce7688-064c-4d6d-9527-9c5752a7d1ec service nova] Lock "3f08c061-312d-42d3-a811-e98ace4e7a63-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:58:40 user nova-compute[75216]: DEBUG nova.compute.manager [req-5e63ce42-8b59-4327-a160-09863b6c5a7b req-d8ce7688-064c-4d6d-9527-9c5752a7d1ec service nova] [instance: 3f08c061-312d-42d3-a811-e98ace4e7a63] No waiting events found dispatching network-vif-unplugged-225eb5bf-3c60-42f6-9bf7-e045ccda1213 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:58:40 user nova-compute[75216]: DEBUG nova.compute.manager [req-5e63ce42-8b59-4327-a160-09863b6c5a7b req-d8ce7688-064c-4d6d-9527-9c5752a7d1ec service nova] [instance: 3f08c061-312d-42d3-a811-e98ace4e7a63] Received event network-vif-unplugged-225eb5bf-3c60-42f6-9bf7-e045ccda1213 for instance with task_state deleting. {{(pid=75216) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 18:58:41 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 3f08c061-312d-42d3-a811-e98ace4e7a63] Instance destroyed successfully.
Nov 13 18:58:41 user nova-compute[75216]: DEBUG nova.objects.instance [None req-4bfe6cca-30cc-4dfd-bd34-8fd89fa3ba25 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Lazy-loading 'resources' on Instance uuid 3f08c061-312d-42d3-a811-e98ace4e7a63 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 18:58:41 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-4bfe6cca-30cc-4dfd-bd34-8fd89fa3ba25 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T18:53:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-843350509',display_name='tempest-TestMinimumBasicScenario-server-843350509',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-843350509',id=23,image_ref='7241b779-6846-4ff3-b5e7-6a596d4ba25f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLKIy5fn8nRCtUmn7K07KfB7RDBd9iwjzb5CXbq3if8xzRwbw+ZQ3REwhjsmBnemynqFCxzkc9s/yAIlOuzrQk4lJ2VBH8ecat/W+YoxobHKrItT4FKogt+fiSesp1UMUQ==',key_name='tempest-TestMinimumBasicScenario-170307334',keypairs=<?>,launch_index=0,launched_at=2023-11-13T18:54:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='84d0223a97ff4ecab9bf4273e3e465a9',ramdisk_id='',reservation_id='r-ynp0tyo0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7241b779-6846-4ff3-b5e7-6a596d4ba25f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1197015828',owner_user_name='tempest-TestMinimumBasicScenario-1197015828-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T18:56:03Z,user_data=None,user_id='83cc10163cd04fffb40b36e6c0cdd484',uuid=3f08c061-312d-42d3-a811-e98ace4e7a63,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "225eb5bf-3c60-42f6-9bf7-e045ccda1213", "address": "fa:16:3e:3a:7e:d6", "network": {"id": "fea11c73-0074-4971-8b36-0aced430c730", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1420832282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84d0223a97ff4ecab9bf4273e3e465a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap225eb5bf-3c", "ovs_interfaceid": "225eb5bf-3c60-42f6-9bf7-e045ccda1213", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 18:58:41 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-4bfe6cca-30cc-4dfd-bd34-8fd89fa3ba25 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Converting VIF {"id": "225eb5bf-3c60-42f6-9bf7-e045ccda1213", "address": "fa:16:3e:3a:7e:d6", "network": {"id": "fea11c73-0074-4971-8b36-0aced430c730", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1420832282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84d0223a97ff4ecab9bf4273e3e465a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap225eb5bf-3c", "ovs_interfaceid": "225eb5bf-3c60-42f6-9bf7-e045ccda1213", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 18:58:41 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-4bfe6cca-30cc-4dfd-bd34-8fd89fa3ba25 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3a:7e:d6,bridge_name='br-int',has_traffic_filtering=True,id=225eb5bf-3c60-42f6-9bf7-e045ccda1213,network=Network(fea11c73-0074-4971-8b36-0aced430c730),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap225eb5bf-3c') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 18:58:41 user nova-compute[75216]: DEBUG os_vif [None req-4bfe6cca-30cc-4dfd-bd34-8fd89fa3ba25 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3a:7e:d6,bridge_name='br-int',has_traffic_filtering=True,id=225eb5bf-3c60-42f6-9bf7-e045ccda1213,network=Network(fea11c73-0074-4971-8b36-0aced430c730),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap225eb5bf-3c') {{(pid=75216) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 18:58:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:58:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap225eb5bf-3c, bridge=br-int, if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:58:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:58:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:58:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:58:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=677df35e-bdaa-4c3d-9cfd-ec372812aff7) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:58:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:58:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:58:41 user nova-compute[75216]: INFO os_vif [None req-4bfe6cca-30cc-4dfd-bd34-8fd89fa3ba25 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3a:7e:d6,bridge_name='br-int',has_traffic_filtering=True,id=225eb5bf-3c60-42f6-9bf7-e045ccda1213,network=Network(fea11c73-0074-4971-8b36-0aced430c730),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap225eb5bf-3c')
Nov 13 18:58:41 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-4bfe6cca-30cc-4dfd-bd34-8fd89fa3ba25 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] [instance: 3f08c061-312d-42d3-a811-e98ace4e7a63] Deleting instance files /opt/stack/data/nova/instances/3f08c061-312d-42d3-a811-e98ace4e7a63_del
Nov 13 18:58:41 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-4bfe6cca-30cc-4dfd-bd34-8fd89fa3ba25 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] [instance: 3f08c061-312d-42d3-a811-e98ace4e7a63] Deletion of /opt/stack/data/nova/instances/3f08c061-312d-42d3-a811-e98ace4e7a63_del complete
Nov 13 18:58:41 user nova-compute[75216]: INFO nova.compute.manager [None req-4bfe6cca-30cc-4dfd-bd34-8fd89fa3ba25 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] [instance: 3f08c061-312d-42d3-a811-e98ace4e7a63] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 13 18:58:41 user nova-compute[75216]: DEBUG oslo.service.loopingcall [None req-4bfe6cca-30cc-4dfd-bd34-8fd89fa3ba25 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75216) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 18:58:41 user nova-compute[75216]: DEBUG nova.compute.manager [-] [instance: 3f08c061-312d-42d3-a811-e98ace4e7a63] Deallocating network for instance {{(pid=75216) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 18:58:41 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: 3f08c061-312d-42d3-a811-e98ace4e7a63] deallocate_for_instance() {{(pid=75216) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 18:58:41 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: 3f08c061-312d-42d3-a811-e98ace4e7a63] Updating instance_info_cache with network_info: [] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 18:58:41 user nova-compute[75216]: INFO nova.compute.manager [-] [instance: 3f08c061-312d-42d3-a811-e98ace4e7a63] Took 0.36 seconds to deallocate network for instance.
Nov 13 18:58:41 user nova-compute[75216]: DEBUG nova.compute.manager [req-ca9e460e-42bd-41a0-ab61-7b07cbc3f06e req-a4bd8339-af41-4d7f-ba17-290adb5bf7a0 service nova] [instance: 3f08c061-312d-42d3-a811-e98ace4e7a63] Received event network-vif-deleted-225eb5bf-3c60-42f6-9bf7-e045ccda1213 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:58:41 user nova-compute[75216]: INFO nova.compute.manager [req-ca9e460e-42bd-41a0-ab61-7b07cbc3f06e req-a4bd8339-af41-4d7f-ba17-290adb5bf7a0 service nova] [instance: 3f08c061-312d-42d3-a811-e98ace4e7a63] Neutron deleted interface 225eb5bf-3c60-42f6-9bf7-e045ccda1213; detaching it from the instance and deleting it from the info cache
Nov 13 18:58:41 user nova-compute[75216]: DEBUG nova.network.neutron [req-ca9e460e-42bd-41a0-ab61-7b07cbc3f06e req-a4bd8339-af41-4d7f-ba17-290adb5bf7a0 service nova] [instance: 3f08c061-312d-42d3-a811-e98ace4e7a63] Updating instance_info_cache with network_info: [] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 18:58:41 user nova-compute[75216]: DEBUG nova.compute.manager [req-ca9e460e-42bd-41a0-ab61-7b07cbc3f06e req-a4bd8339-af41-4d7f-ba17-290adb5bf7a0 service nova] [instance: 3f08c061-312d-42d3-a811-e98ace4e7a63] Detach interface failed, port_id=225eb5bf-3c60-42f6-9bf7-e045ccda1213, reason: Instance 3f08c061-312d-42d3-a811-e98ace4e7a63 could not be found. {{(pid=75216) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 13 18:58:41 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-4bfe6cca-30cc-4dfd-bd34-8fd89fa3ba25 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:58:41 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-4bfe6cca-30cc-4dfd-bd34-8fd89fa3ba25 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:58:42 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-4bfe6cca-30cc-4dfd-bd34-8fd89fa3ba25 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 18:58:42 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-4bfe6cca-30cc-4dfd-bd34-8fd89fa3ba25 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 18:58:42 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-4bfe6cca-30cc-4dfd-bd34-8fd89fa3ba25 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.293s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:58:42 user nova-compute[75216]: INFO nova.scheduler.client.report [None req-4bfe6cca-30cc-4dfd-bd34-8fd89fa3ba25 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Deleted allocations for instance 3f08c061-312d-42d3-a811-e98ace4e7a63
Nov 13 18:58:42 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-4bfe6cca-30cc-4dfd-bd34-8fd89fa3ba25 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Lock "3f08c061-312d-42d3-a811-e98ace4e7a63" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.713s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:58:42 user nova-compute[75216]: DEBUG nova.compute.manager [req-fa07a9ce-a6d3-4ace-a479-f592472e61e1 req-c07c3d69-22a1-47c6-ad46-d099c2ebe8c8 service nova] [instance: 3f08c061-312d-42d3-a811-e98ace4e7a63] Received event network-vif-plugged-225eb5bf-3c60-42f6-9bf7-e045ccda1213 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:58:42 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-fa07a9ce-a6d3-4ace-a479-f592472e61e1 req-c07c3d69-22a1-47c6-ad46-d099c2ebe8c8 service nova] Acquiring lock "3f08c061-312d-42d3-a811-e98ace4e7a63-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:58:42 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-fa07a9ce-a6d3-4ace-a479-f592472e61e1 req-c07c3d69-22a1-47c6-ad46-d099c2ebe8c8 service nova] Lock "3f08c061-312d-42d3-a811-e98ace4e7a63-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:58:42 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-fa07a9ce-a6d3-4ace-a479-f592472e61e1 req-c07c3d69-22a1-47c6-ad46-d099c2ebe8c8 service nova] Lock "3f08c061-312d-42d3-a811-e98ace4e7a63-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:58:42 user nova-compute[75216]: DEBUG nova.compute.manager [req-fa07a9ce-a6d3-4ace-a479-f592472e61e1 req-c07c3d69-22a1-47c6-ad46-d099c2ebe8c8 service nova] [instance: 3f08c061-312d-42d3-a811-e98ace4e7a63] No waiting events found dispatching network-vif-plugged-225eb5bf-3c60-42f6-9bf7-e045ccda1213 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:58:42 user nova-compute[75216]: WARNING nova.compute.manager [req-fa07a9ce-a6d3-4ace-a479-f592472e61e1 req-c07c3d69-22a1-47c6-ad46-d099c2ebe8c8 service nova] [instance: 3f08c061-312d-42d3-a811-e98ace4e7a63] Received unexpected event network-vif-plugged-225eb5bf-3c60-42f6-9bf7-e045ccda1213 for instance with vm_state deleted and task_state None.
Nov 13 18:58:43 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:58:46 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:58:49 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:58:50 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:58:51 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:58:51 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:58:51 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75216) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 18:58:51 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 18:58:51 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 18:58:51 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:58:52 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:58:52 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:58:54 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:58:54 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:58:54 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:58:54 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:58:54 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Auditing locally available compute resources for user (node: user) {{(pid=75216) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 18:58:54 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 18:58:54 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e5f1164-a15e-40cf-b7bc-5aeb404a1216/disk.rescue --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:58:54 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e5f1164-a15e-40cf-b7bc-5aeb404a1216/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:58:54 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e5f1164-a15e-40cf-b7bc-5aeb404a1216/disk.rescue --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:58:54 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e5f1164-a15e-40cf-b7bc-5aeb404a1216/disk.rescue --force-share --output=json" returned: 0 in 0.168s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:58:54 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a3e849-6570-4820-97c8-75468b5bea4f/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:58:55 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a3e849-6570-4820-97c8-75468b5bea4f/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:58:55 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a3e849-6570-4820-97c8-75468b5bea4f/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:58:55 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a3e849-6570-4820-97c8-75468b5bea4f/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:58:55 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9a1edfb-c2ac-4e67-abac-c915ea22a15c/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:58:55 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9a1edfb-c2ac-4e67-abac-c915ea22a15c/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:58:55 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9a1edfb-c2ac-4e67-abac-c915ea22a15c/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:58:55 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9a1edfb-c2ac-4e67-abac-c915ea22a15c/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:58:55 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 18:58:55 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14d378b0-79ba-4161-a795-6288939c6fef/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:58:55 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14d378b0-79ba-4161-a795-6288939c6fef/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:58:55 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14d378b0-79ba-4161-a795-6288939c6fef/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:58:56 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14d378b0-79ba-4161-a795-6288939c6fef/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:58:56 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 18:58:56 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d589d57e-de50-482a-843f-e8246b3d7528/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:58:56 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d589d57e-de50-482a-843f-e8246b3d7528/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:58:56 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d589d57e-de50-482a-843f-e8246b3d7528/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:58:56 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:58:56 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d589d57e-de50-482a-843f-e8246b3d7528/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:58:56 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:58:56 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:58:56 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:58:56 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:58:56 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85624c58-6c72-4490-8a3e-547953295ade/disk.rescue --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:58:56 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85624c58-6c72-4490-8a3e-547953295ade/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:58:56 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85624c58-6c72-4490-8a3e-547953295ade/disk.rescue --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:58:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85624c58-6c72-4490-8a3e-547953295ade/disk.rescue --force-share --output=json" returned: 0 in 0.162s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:58:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85624c58-6c72-4490-8a3e-547953295ade/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:58:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85624c58-6c72-4490-8a3e-547953295ade/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:58:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85624c58-6c72-4490-8a3e-547953295ade/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:58:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85624c58-6c72-4490-8a3e-547953295ade/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:58:57 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 18:58:57 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 18:58:57 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Hypervisor/Node resource view: name=user free_ram=7942MB free_disk=25.36623764038086GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75216) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 18:58:57 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:58:57 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:58:58 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Applying migration context for instance 2f074d68-d0a7-4204-a79d-be619ee42d0c as it has an incoming, in-progress migration cb47afd3-5c76-48c9-aaa1-4aaeb4bc442a. Migration status is finished {{(pid=75216) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 13 18:58:58 user nova-compute[75216]: INFO nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: 2f074d68-d0a7-4204-a79d-be619ee42d0c] Updating resource usage from migration cb47afd3-5c76-48c9-aaa1-4aaeb4bc442a
Nov 13 18:58:58 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance a1a3e849-6570-4820-97c8-75468b5bea4f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 18:58:58 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance d589d57e-de50-482a-843f-e8246b3d7528 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 18:58:58 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance 85624c58-6c72-4490-8a3e-547953295ade actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 18:58:58 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance 14d378b0-79ba-4161-a795-6288939c6fef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 18:58:58 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 18:58:58 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance d9a1edfb-c2ac-4e67-abac-c915ea22a15c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 18:58:58 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance 1e5f1164-a15e-40cf-b7bc-5aeb404a1216 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 18:58:58 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Migration cb47afd3-5c76-48c9-aaa1-4aaeb4bc442a is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 13 18:58:58 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance 2f074d68-d0a7-4204-a79d-be619ee42d0c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 18:58:58 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 18:58:58 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 18:58:58 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 18:58:58 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 18:58:58 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Compute_service record updated for user:user {{(pid=75216) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 18:58:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.463s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:58:59 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:58:59 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:58:59 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Starting heal instance info cache {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 18:58:59 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "refresh_cache-85624c58-6c72-4490-8a3e-547953295ade" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 18:58:59 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquired lock "refresh_cache-85624c58-6c72-4490-8a3e-547953295ade" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 18:58:59 user nova-compute[75216]: DEBUG nova.network.neutron [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: 85624c58-6c72-4490-8a3e-547953295ade] Forcefully refreshing network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 18:58:59 user nova-compute[75216]: DEBUG nova.network.neutron [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: 85624c58-6c72-4490-8a3e-547953295ade] Updating instance_info_cache with network_info: [{"id": "51ccc958-5ce8-4e1d-8d28-f10c5ac288bd", "address": "fa:16:3e:f4:a4:79", "network": {"id": "6d182db1-03b5-4d1b-86cf-b9367921b7b0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1877006951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2efafc26c47c4050bd367c47469999fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51ccc958-5c", "ovs_interfaceid": "51ccc958-5ce8-4e1d-8d28-f10c5ac288bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 18:58:59 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Releasing lock "refresh_cache-85624c58-6c72-4490-8a3e-547953295ade" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 18:58:59 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: 85624c58-6c72-4490-8a3e-547953295ade] Updated the network info_cache for instance {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 18:58:59 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:58:59 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:58:59 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:58:59 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75216) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 18:59:01 user nova-compute[75216]: DEBUG nova.compute.manager [req-4ea1f291-dd41-4dd9-920e-55ef5f4e2748 req-75303cdc-10ce-4810-a1b8-2f15dab2b764 service nova] [instance: d9a1edfb-c2ac-4e67-abac-c915ea22a15c] Received event network-changed-eb2895a9-124a-4504-b197-bb2022f3f55f {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:59:01 user nova-compute[75216]: DEBUG nova.compute.manager [req-4ea1f291-dd41-4dd9-920e-55ef5f4e2748 req-75303cdc-10ce-4810-a1b8-2f15dab2b764 service nova] [instance: d9a1edfb-c2ac-4e67-abac-c915ea22a15c] Refreshing instance network info cache due to event network-changed-eb2895a9-124a-4504-b197-bb2022f3f55f. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 18:59:01 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-4ea1f291-dd41-4dd9-920e-55ef5f4e2748 req-75303cdc-10ce-4810-a1b8-2f15dab2b764 service nova] Acquiring lock "refresh_cache-d9a1edfb-c2ac-4e67-abac-c915ea22a15c" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 18:59:01 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-4ea1f291-dd41-4dd9-920e-55ef5f4e2748 req-75303cdc-10ce-4810-a1b8-2f15dab2b764 service nova] Acquired lock "refresh_cache-d9a1edfb-c2ac-4e67-abac-c915ea22a15c" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 18:59:01 user nova-compute[75216]: DEBUG nova.network.neutron [req-4ea1f291-dd41-4dd9-920e-55ef5f4e2748 req-75303cdc-10ce-4810-a1b8-2f15dab2b764 service nova] [instance: d9a1edfb-c2ac-4e67-abac-c915ea22a15c] Refreshing network info cache for port eb2895a9-124a-4504-b197-bb2022f3f55f {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 18:59:01 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:59:01 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:59:01 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=75216) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 18:59:01 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 18:59:01 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 18:59:01 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:59:01 user nova-compute[75216]: DEBUG nova.network.neutron [req-4ea1f291-dd41-4dd9-920e-55ef5f4e2748 req-75303cdc-10ce-4810-a1b8-2f15dab2b764 service nova] [instance: d9a1edfb-c2ac-4e67-abac-c915ea22a15c] Updated VIF entry in instance network info cache for port eb2895a9-124a-4504-b197-bb2022f3f55f. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 18:59:01 user nova-compute[75216]: DEBUG nova.network.neutron [req-4ea1f291-dd41-4dd9-920e-55ef5f4e2748 req-75303cdc-10ce-4810-a1b8-2f15dab2b764 service nova] [instance: d9a1edfb-c2ac-4e67-abac-c915ea22a15c] Updating instance_info_cache with network_info: [{"id": "eb2895a9-124a-4504-b197-bb2022f3f55f", "address": "fa:16:3e:8d:84:60", "network": {"id": "6d182db1-03b5-4d1b-86cf-b9367921b7b0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1877006951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2efafc26c47c4050bd367c47469999fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb2895a9-12", "ovs_interfaceid": "eb2895a9-124a-4504-b197-bb2022f3f55f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 18:59:01 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-4ea1f291-dd41-4dd9-920e-55ef5f4e2748 req-75303cdc-10ce-4810-a1b8-2f15dab2b764 service nova] Releasing lock "refresh_cache-d9a1edfb-c2ac-4e67-abac-c915ea22a15c" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 18:59:01 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-626ba7cf-68c7-4d8f-981b-9d7091206b59 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Acquiring lock "d9a1edfb-c2ac-4e67-abac-c915ea22a15c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:59:01 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-626ba7cf-68c7-4d8f-981b-9d7091206b59 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Lock "d9a1edfb-c2ac-4e67-abac-c915ea22a15c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:59:01 user nova-compute[75216]: INFO nova.compute.manager [None req-626ba7cf-68c7-4d8f-981b-9d7091206b59 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] [instance: d9a1edfb-c2ac-4e67-abac-c915ea22a15c] Detaching volume 4ee38de6-1fa4-460d-9bb4-49720104365b
Nov 13 18:59:01 user nova-compute[75216]: INFO nova.virt.block_device [None req-626ba7cf-68c7-4d8f-981b-9d7091206b59 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] [instance: d9a1edfb-c2ac-4e67-abac-c915ea22a15c] Attempting to driver detach volume 4ee38de6-1fa4-460d-9bb4-49720104365b from mountpoint /dev/vdb
Nov 13 18:59:01 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-626ba7cf-68c7-4d8f-981b-9d7091206b59 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Attempting to detach device vdb from instance d9a1edfb-c2ac-4e67-abac-c915ea22a15c from the persistent domain config. {{(pid=75216) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 13 18:59:01 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-626ba7cf-68c7-4d8f-981b-9d7091206b59 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 18:59:01 user nova-compute[75216]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 18:59:01 user nova-compute[75216]:   <source dev="/dev/sdc"/>
Nov 13 18:59:01 user nova-compute[75216]:   <target dev="vdb" bus="virtio"/>
Nov 13 18:59:01 user nova-compute[75216]:   <serial>4ee38de6-1fa4-460d-9bb4-49720104365b</serial>
Nov 13 18:59:01 user nova-compute[75216]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 18:59:01 user nova-compute[75216]: </disk>
Nov 13 18:59:01 user nova-compute[75216]:  {{(pid=75216) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 18:59:01 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-626ba7cf-68c7-4d8f-981b-9d7091206b59 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Successfully detached device vdb from instance d9a1edfb-c2ac-4e67-abac-c915ea22a15c from the persistent domain config.
Nov 13 18:59:01 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-626ba7cf-68c7-4d8f-981b-9d7091206b59 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d9a1edfb-c2ac-4e67-abac-c915ea22a15c from the live domain config. {{(pid=75216) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 13 18:59:01 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-626ba7cf-68c7-4d8f-981b-9d7091206b59 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 18:59:01 user nova-compute[75216]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 18:59:01 user nova-compute[75216]:   <source dev="/dev/sdc"/>
Nov 13 18:59:01 user nova-compute[75216]:   <target dev="vdb" bus="virtio"/>
Nov 13 18:59:01 user nova-compute[75216]:   <serial>4ee38de6-1fa4-460d-9bb4-49720104365b</serial>
Nov 13 18:59:01 user nova-compute[75216]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 18:59:01 user nova-compute[75216]: </disk>
Nov 13 18:59:01 user nova-compute[75216]:  {{(pid=75216) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 18:59:02 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-626ba7cf-68c7-4d8f-981b-9d7091206b59 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d9a1edfb-c2ac-4e67-abac-c915ea22a15c {{(pid=75216) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 13 18:59:03 user nova-compute[75216]: DEBUG nova.compute.manager [req-4dd9516d-bc6d-42bb-be12-6ff5b65608f1 req-23e03460-9c68-4db7-b8ab-2404b212e129 service nova] [instance: d9a1edfb-c2ac-4e67-abac-c915ea22a15c] Received event network-changed-eb2895a9-124a-4504-b197-bb2022f3f55f {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:59:03 user nova-compute[75216]: DEBUG nova.compute.manager [req-4dd9516d-bc6d-42bb-be12-6ff5b65608f1 req-23e03460-9c68-4db7-b8ab-2404b212e129 service nova] [instance: d9a1edfb-c2ac-4e67-abac-c915ea22a15c] Refreshing instance network info cache due to event network-changed-eb2895a9-124a-4504-b197-bb2022f3f55f. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 18:59:03 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-4dd9516d-bc6d-42bb-be12-6ff5b65608f1 req-23e03460-9c68-4db7-b8ab-2404b212e129 service nova] Acquiring lock "refresh_cache-d9a1edfb-c2ac-4e67-abac-c915ea22a15c" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 18:59:03 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-4dd9516d-bc6d-42bb-be12-6ff5b65608f1 req-23e03460-9c68-4db7-b8ab-2404b212e129 service nova] Acquired lock "refresh_cache-d9a1edfb-c2ac-4e67-abac-c915ea22a15c" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 18:59:03 user nova-compute[75216]: DEBUG nova.network.neutron [req-4dd9516d-bc6d-42bb-be12-6ff5b65608f1 req-23e03460-9c68-4db7-b8ab-2404b212e129 service nova] [instance: d9a1edfb-c2ac-4e67-abac-c915ea22a15c] Refreshing network info cache for port eb2895a9-124a-4504-b197-bb2022f3f55f {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 18:59:03 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:59:03 user nova-compute[75216]: DEBUG nova.network.neutron [req-4dd9516d-bc6d-42bb-be12-6ff5b65608f1 req-23e03460-9c68-4db7-b8ab-2404b212e129 service nova] [instance: d9a1edfb-c2ac-4e67-abac-c915ea22a15c] Updated VIF entry in instance network info cache for port eb2895a9-124a-4504-b197-bb2022f3f55f. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 18:59:03 user nova-compute[75216]: DEBUG nova.network.neutron [req-4dd9516d-bc6d-42bb-be12-6ff5b65608f1 req-23e03460-9c68-4db7-b8ab-2404b212e129 service nova] [instance: d9a1edfb-c2ac-4e67-abac-c915ea22a15c] Updating instance_info_cache with network_info: [{"id": "eb2895a9-124a-4504-b197-bb2022f3f55f", "address": "fa:16:3e:8d:84:60", "network": {"id": "6d182db1-03b5-4d1b-86cf-b9367921b7b0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1877006951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2efafc26c47c4050bd367c47469999fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb2895a9-12", "ovs_interfaceid": "eb2895a9-124a-4504-b197-bb2022f3f55f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 18:59:03 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-4dd9516d-bc6d-42bb-be12-6ff5b65608f1 req-23e03460-9c68-4db7-b8ab-2404b212e129 service nova] Releasing lock "refresh_cache-d9a1edfb-c2ac-4e67-abac-c915ea22a15c" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 18:59:06 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:59:09 user nova-compute[75216]: INFO nova.compute.manager [None req-cd216392-91d8-49ad-b202-170a6618834e tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: 1e5f1164-a15e-40cf-b7bc-5aeb404a1216] Unrescuing
Nov 13 18:59:09 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-cd216392-91d8-49ad-b202-170a6618834e tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Acquiring lock "refresh_cache-1e5f1164-a15e-40cf-b7bc-5aeb404a1216" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 18:59:09 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-cd216392-91d8-49ad-b202-170a6618834e tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Acquired lock "refresh_cache-1e5f1164-a15e-40cf-b7bc-5aeb404a1216" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 18:59:09 user nova-compute[75216]: DEBUG nova.network.neutron [None req-cd216392-91d8-49ad-b202-170a6618834e tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: 1e5f1164-a15e-40cf-b7bc-5aeb404a1216] Building network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 18:59:09 user nova-compute[75216]: DEBUG nova.network.neutron [None req-cd216392-91d8-49ad-b202-170a6618834e tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: 1e5f1164-a15e-40cf-b7bc-5aeb404a1216] Updating instance_info_cache with network_info: [{"id": "96dfdc95-6a8e-43f3-8d7c-5b4f78a8f134", "address": "fa:16:3e:19:0b:3a", "network": {"id": "f8b821ef-8fae-42b9-9055-a9ea7be955ab", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-50594548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "903397a6c0474cfd8bd1a4fb338528aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96dfdc95-6a", "ovs_interfaceid": "96dfdc95-6a8e-43f3-8d7c-5b4f78a8f134", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 18:59:09 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-cd216392-91d8-49ad-b202-170a6618834e tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Releasing lock "refresh_cache-1e5f1164-a15e-40cf-b7bc-5aeb404a1216" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 18:59:09 user nova-compute[75216]: DEBUG nova.objects.instance [None req-cd216392-91d8-49ad-b202-170a6618834e tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Lazy-loading 'flavor' on Instance uuid 1e5f1164-a15e-40cf-b7bc-5aeb404a1216 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 18:59:09 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:59:09 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:59:09 user nova-compute[75216]: DEBUG nova.compute.manager [req-6e505d3b-bf75-4b4e-a05f-30dd5b5fe082 req-20a001ba-ee49-4508-8116-d17407d5fb2b service nova] [instance: 1e5f1164-a15e-40cf-b7bc-5aeb404a1216] Received event network-vif-unplugged-96dfdc95-6a8e-43f3-8d7c-5b4f78a8f134 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:59:09 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-6e505d3b-bf75-4b4e-a05f-30dd5b5fe082 req-20a001ba-ee49-4508-8116-d17407d5fb2b service nova] Acquiring lock "1e5f1164-a15e-40cf-b7bc-5aeb404a1216-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:59:09 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-6e505d3b-bf75-4b4e-a05f-30dd5b5fe082 req-20a001ba-ee49-4508-8116-d17407d5fb2b service nova] Lock "1e5f1164-a15e-40cf-b7bc-5aeb404a1216-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:59:09 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-6e505d3b-bf75-4b4e-a05f-30dd5b5fe082 req-20a001ba-ee49-4508-8116-d17407d5fb2b service nova] Lock "1e5f1164-a15e-40cf-b7bc-5aeb404a1216-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:59:09 user nova-compute[75216]: DEBUG nova.compute.manager [req-6e505d3b-bf75-4b4e-a05f-30dd5b5fe082 req-20a001ba-ee49-4508-8116-d17407d5fb2b service nova] [instance: 1e5f1164-a15e-40cf-b7bc-5aeb404a1216] No waiting events found dispatching network-vif-unplugged-96dfdc95-6a8e-43f3-8d7c-5b4f78a8f134 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:59:09 user nova-compute[75216]: WARNING nova.compute.manager [req-6e505d3b-bf75-4b4e-a05f-30dd5b5fe082 req-20a001ba-ee49-4508-8116-d17407d5fb2b service nova] [instance: 1e5f1164-a15e-40cf-b7bc-5aeb404a1216] Received unexpected event network-vif-unplugged-96dfdc95-6a8e-43f3-8d7c-5b4f78a8f134 for instance with vm_state rescued and task_state unrescuing.
Nov 13 18:59:09 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:59:09 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:59:10 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:59:10 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:59:10 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 1e5f1164-a15e-40cf-b7bc-5aeb404a1216] Instance destroyed successfully.
Nov 13 18:59:11 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:59:11 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:59:11 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:59:11 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:59:11 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:59:11 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:59:11 user nova-compute[75216]: DEBUG nova.compute.manager [req-2e436541-fbcf-4df8-abf3-a4fac547c3d4 req-3ae23c38-dd00-4b20-8ec0-89d633678549 service nova] [instance: 1e5f1164-a15e-40cf-b7bc-5aeb404a1216] Received event network-vif-plugged-96dfdc95-6a8e-43f3-8d7c-5b4f78a8f134 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:59:11 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-2e436541-fbcf-4df8-abf3-a4fac547c3d4 req-3ae23c38-dd00-4b20-8ec0-89d633678549 service nova] Acquiring lock "1e5f1164-a15e-40cf-b7bc-5aeb404a1216-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:59:11 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-2e436541-fbcf-4df8-abf3-a4fac547c3d4 req-3ae23c38-dd00-4b20-8ec0-89d633678549 service nova] Lock "1e5f1164-a15e-40cf-b7bc-5aeb404a1216-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:59:11 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-2e436541-fbcf-4df8-abf3-a4fac547c3d4 req-3ae23c38-dd00-4b20-8ec0-89d633678549 service nova] Lock "1e5f1164-a15e-40cf-b7bc-5aeb404a1216-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:59:11 user nova-compute[75216]: DEBUG nova.compute.manager [req-2e436541-fbcf-4df8-abf3-a4fac547c3d4 req-3ae23c38-dd00-4b20-8ec0-89d633678549 service nova] [instance: 1e5f1164-a15e-40cf-b7bc-5aeb404a1216] No waiting events found dispatching network-vif-plugged-96dfdc95-6a8e-43f3-8d7c-5b4f78a8f134 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:59:11 user nova-compute[75216]: WARNING nova.compute.manager [req-2e436541-fbcf-4df8-abf3-a4fac547c3d4 req-3ae23c38-dd00-4b20-8ec0-89d633678549 service nova] [instance: 1e5f1164-a15e-40cf-b7bc-5aeb404a1216] Received unexpected event network-vif-plugged-96dfdc95-6a8e-43f3-8d7c-5b4f78a8f134 for instance with vm_state rescued and task_state unrescuing.
Nov 13 18:59:11 user nova-compute[75216]: DEBUG nova.compute.manager [req-2e436541-fbcf-4df8-abf3-a4fac547c3d4 req-3ae23c38-dd00-4b20-8ec0-89d633678549 service nova] [instance: 1e5f1164-a15e-40cf-b7bc-5aeb404a1216] Received event network-vif-plugged-96dfdc95-6a8e-43f3-8d7c-5b4f78a8f134 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:59:11 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-2e436541-fbcf-4df8-abf3-a4fac547c3d4 req-3ae23c38-dd00-4b20-8ec0-89d633678549 service nova] Acquiring lock "1e5f1164-a15e-40cf-b7bc-5aeb404a1216-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:59:11 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-2e436541-fbcf-4df8-abf3-a4fac547c3d4 req-3ae23c38-dd00-4b20-8ec0-89d633678549 service nova] Lock "1e5f1164-a15e-40cf-b7bc-5aeb404a1216-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:59:11 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-2e436541-fbcf-4df8-abf3-a4fac547c3d4 req-3ae23c38-dd00-4b20-8ec0-89d633678549 service nova] Lock "1e5f1164-a15e-40cf-b7bc-5aeb404a1216-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:59:11 user nova-compute[75216]: DEBUG nova.compute.manager [req-2e436541-fbcf-4df8-abf3-a4fac547c3d4 req-3ae23c38-dd00-4b20-8ec0-89d633678549 service nova] [instance: 1e5f1164-a15e-40cf-b7bc-5aeb404a1216] No waiting events found dispatching network-vif-plugged-96dfdc95-6a8e-43f3-8d7c-5b4f78a8f134 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:59:11 user nova-compute[75216]: WARNING nova.compute.manager [req-2e436541-fbcf-4df8-abf3-a4fac547c3d4 req-3ae23c38-dd00-4b20-8ec0-89d633678549 service nova] [instance: 1e5f1164-a15e-40cf-b7bc-5aeb404a1216] Received unexpected event network-vif-plugged-96dfdc95-6a8e-43f3-8d7c-5b4f78a8f134 for instance with vm_state rescued and task_state unrescuing.
Nov 13 18:59:13 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:59:13 user nova-compute[75216]: DEBUG nova.compute.manager [None req-cd216392-91d8-49ad-b202-170a6618834e tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: 1e5f1164-a15e-40cf-b7bc-5aeb404a1216] Checking state {{(pid=75216) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 18:59:14 user nova-compute[75216]: DEBUG nova.compute.manager [req-0765acab-9bb9-42db-98a3-646a70324a96 req-e668f3a6-f804-4f26-ae21-f3782004c141 service nova] [instance: 1e5f1164-a15e-40cf-b7bc-5aeb404a1216] Received event network-vif-plugged-96dfdc95-6a8e-43f3-8d7c-5b4f78a8f134 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:59:14 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-0765acab-9bb9-42db-98a3-646a70324a96 req-e668f3a6-f804-4f26-ae21-f3782004c141 service nova] Acquiring lock "1e5f1164-a15e-40cf-b7bc-5aeb404a1216-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:59:14 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-0765acab-9bb9-42db-98a3-646a70324a96 req-e668f3a6-f804-4f26-ae21-f3782004c141 service nova] Lock "1e5f1164-a15e-40cf-b7bc-5aeb404a1216-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:59:14 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-0765acab-9bb9-42db-98a3-646a70324a96 req-e668f3a6-f804-4f26-ae21-f3782004c141 service nova] Lock "1e5f1164-a15e-40cf-b7bc-5aeb404a1216-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:59:14 user nova-compute[75216]: DEBUG nova.compute.manager [req-0765acab-9bb9-42db-98a3-646a70324a96 req-e668f3a6-f804-4f26-ae21-f3782004c141 service nova] [instance: 1e5f1164-a15e-40cf-b7bc-5aeb404a1216] No waiting events found dispatching network-vif-plugged-96dfdc95-6a8e-43f3-8d7c-5b4f78a8f134 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:59:14 user nova-compute[75216]: WARNING nova.compute.manager [req-0765acab-9bb9-42db-98a3-646a70324a96 req-e668f3a6-f804-4f26-ae21-f3782004c141 service nova] [instance: 1e5f1164-a15e-40cf-b7bc-5aeb404a1216] Received unexpected event network-vif-plugged-96dfdc95-6a8e-43f3-8d7c-5b4f78a8f134 for instance with vm_state active and task_state None.
Nov 13 18:59:16 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:59:17 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:59:21 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:59:22 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:59:22 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-626ba7cf-68c7-4d8f-981b-9d7091206b59 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance d9a1edfb-c2ac-4e67-abac-c915ea22a15c is timed out.
Nov 13 18:59:22 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-626ba7cf-68c7-4d8f-981b-9d7091206b59 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Successfully detached device vdb from instance d9a1edfb-c2ac-4e67-abac-c915ea22a15c from the live domain config.
Nov 13 18:59:22 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-626ba7cf-68c7-4d8f-981b-9d7091206b59 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] [instance: d9a1edfb-c2ac-4e67-abac-c915ea22a15c] calling os-brick to detach iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 18:59:22 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-626ba7cf-68c7-4d8f-981b-9d7091206b59 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3a8669e40>, {'target_iqn': 'iqn.2010-10.org.openstack:4ee38de6-1fa4-460d-9bb4-49720104365b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'beykmGQP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 18:59:22 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-626ba7cf-68c7-4d8f-981b-9d7091206b59 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 18:59:22 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-626ba7cf-68c7-4d8f-981b-9d7091206b59 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 18:59:22 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-626ba7cf-68c7-4d8f-981b-9d7091206b59 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 18:59:22 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:59:22 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:59:22 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d679d0a-1229-4046-8268-e72dd3ee2157]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8a7c3d74-e183-497b-b6c7-85be2b2f171e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4ee38de6-1fa4-460d-9bb4-49720104365b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:59:22 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-626ba7cf-68c7-4d8f-981b-9d7091206b59 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 18:59:22 user nova-compute[75216]: No targets found.
Nov 13 18:59:22 user nova-compute[75216]: iSNS:
Nov 13 18:59:22 user nova-compute[75216]: No targets found.
Nov 13 18:59:22 user nova-compute[75216]: STATIC:
Nov 13 18:59:22 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:8a7c3d74-e183-497b-b6c7-85be2b2f171e
Nov 13 18:59:22 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 18:59:22 user nova-compute[75216]:                 Iface Name: default
Nov 13 18:59:22 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1
Nov 13 18:59:22 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 18:59:22 user nova-compute[75216]:                 Iface Name: default
Nov 13 18:59:22 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:4ee38de6-1fa4-460d-9bb4-49720104365b
Nov 13 18:59:22 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 18:59:22 user nova-compute[75216]:                 Iface Name: default
Nov 13 18:59:22 user nova-compute[75216]: FIRMWARE:
Nov 13 18:59:22 user nova-compute[75216]: No targets found.
Nov 13 18:59:22 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 18:59:22 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-626ba7cf-68c7-4d8f-981b-9d7091206b59 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 18:59:22 user nova-compute[75216]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 18:59:22 user nova-compute[75216]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75216) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 18:59:22 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-626ba7cf-68c7-4d8f-981b-9d7091206b59 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4ee38de6-1fa4-460d-9bb4-49720104365b', 0)] {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 18:59:22 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:59:22 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:59:22 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[3abbb0c6-5b2f-4412-80fa-b712ac89ed17]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4ee38de6-1fa4-460d-9bb4-49720104365b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8a7c3d74-e183-497b-b6c7-85be2b2f171e\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:59:22 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:59:22 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:59:22 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4368219-7d2d-4d77-8a9a-e0d6da9ea5e7]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ee38de6-1fa4-460d-9bb4-49720104365b (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a7c3d74-e183-497b-b6c7-85be2b2f171e (non-flash)\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:59:22 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-626ba7cf-68c7-4d8f-981b-9d7091206b59 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ee38de6-1fa4-460d-9bb4-49720104365b (non-flash)
Nov 13 18:59:22 user nova-compute[75216]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1 (non-flash)
Nov 13 18:59:22 user nova-compute[75216]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a7c3d74-e183-497b-b6c7-85be2b2f171e (non-flash)
Nov 13 18:59:22 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 18:59:22 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-626ba7cf-68c7-4d8f-981b-9d7091206b59 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ee38de6-1fa4-460d-9bb4-49720104365b (non-flash)
Nov 13 18:59:22 user nova-compute[75216]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1 (non-flash)
Nov 13 18:59:22 user nova-compute[75216]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a7c3d74-e183-497b-b6c7-85be2b2f171e (non-flash)
Nov 13 18:59:22 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 18:59:22 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-626ba7cf-68c7-4d8f-981b-9d7091206b59 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe3a82b31c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4ee38de6-1fa4-460d-9bb4-49720104365b'): ({'sdc'}, set())}) {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 18:59:22 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-626ba7cf-68c7-4d8f-981b-9d7091206b59 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Removing single pathed devices sdc {{(pid=75216) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 18:59:22 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:59:22 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:59:22 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[56ee2731-60d8-4092-9be7-000332d361a7]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:59:22 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:59:22 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:59:22 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[4be952b7-2098-4a9c-8cd0-1a852b5f6f0a]: (4, ('ok\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:59:22 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-626ba7cf-68c7-4d8f-981b-9d7091206b59 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Flushing IO for device /dev/sdc {{(pid=75216) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 18:59:22 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:59:22 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:59:22 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[e36b30b5-0c89-43f3-976c-26fde35b0615]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:59:22 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-626ba7cf-68c7-4d8f-981b-9d7091206b59 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75216) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 18:59:22 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:59:22 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.045s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:59:22 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9f04893-6850-4704-9da3-d2b6f8f51ad5]: (4, ('1', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:59:22 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-626ba7cf-68c7-4d8f-981b-9d7091206b59 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 18:59:22 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-626ba7cf-68c7-4d8f-981b-9d7091206b59 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] SCSI volumes sdc have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 18:59:22 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-626ba7cf-68c7-4d8f-981b-9d7091206b59 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4ee38de6-1fa4-460d-9bb4-49720104365b')] {{(pid=75216) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 18:59:22 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ee38de6-1fa4-460d-9bb4-49720104365b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:59:22 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ee38de6-1fa4-460d-9bb4-49720104365b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:59:22 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ff72178-a3f9-4b8f-ae41-a465d70e8865]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:59:22 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-626ba7cf-68c7-4d8f-981b-9d7091206b59 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:59:22 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ee38de6-1fa4-460d-9bb4-49720104365b -p 172.16.0.220:3260 --logout {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:59:22 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ee38de6-1fa4-460d-9bb4-49720104365b -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:59:22 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b99847b-c000-4d74-8962-fd501b2fc35d]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:4ee38de6-1fa4-460d-9bb4-49720104365b, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:4ee38de6-1fa4-460d-9bb4-49720104365b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:59:22 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-626ba7cf-68c7-4d8f-981b-9d7091206b59 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:4ee38de6-1fa4-460d-9bb4-49720104365b, portal: 172.16.0.220,3260]
Nov 13 18:59:22 user nova-compute[75216]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:4ee38de6-1fa4-460d-9bb4-49720104365b, portal: 172.16.0.220,3260] successful.
Nov 13 18:59:22 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:59:22 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ee38de6-1fa4-460d-9bb4-49720104365b -p 172.16.0.220:3260 --op delete {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:59:22 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ee38de6-1fa4-460d-9bb4-49720104365b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:59:22 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[6856f8b7-0121-4d03-a899-e273213c58ff]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:59:22 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-626ba7cf-68c7-4d8f-981b-9d7091206b59 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:59:22 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-626ba7cf-68c7-4d8f-981b-9d7091206b59 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.304s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 18:59:22 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-626ba7cf-68c7-4d8f-981b-9d7091206b59 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] <== disconnect_volume: return (306ms) None {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 18:59:22 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-626ba7cf-68c7-4d8f-981b-9d7091206b59 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] [instance: d9a1edfb-c2ac-4e67-abac-c915ea22a15c] Disconnected iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 18:59:23 user nova-compute[75216]: DEBUG nova.objects.instance [None req-626ba7cf-68c7-4d8f-981b-9d7091206b59 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Lazy-loading 'flavor' on Instance uuid d9a1edfb-c2ac-4e67-abac-c915ea22a15c {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 18:59:23 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-626ba7cf-68c7-4d8f-981b-9d7091206b59 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Lock "d9a1edfb-c2ac-4e67-abac-c915ea22a15c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.701s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:59:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:59:24 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:59:26 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:59:26 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-bde5954f-9f67-48cb-895f-d67c66e6b8ec tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Acquiring lock "71134725-e6cc-4426-b2c2-5be4991c53f7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:59:26 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-bde5954f-9f67-48cb-895f-d67c66e6b8ec tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Lock "71134725-e6cc-4426-b2c2-5be4991c53f7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:59:26 user nova-compute[75216]: DEBUG nova.compute.manager [None req-bde5954f-9f67-48cb-895f-d67c66e6b8ec tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] [instance: 71134725-e6cc-4426-b2c2-5be4991c53f7] Starting instance... {{(pid=75216) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 18:59:26 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-bde5954f-9f67-48cb-895f-d67c66e6b8ec tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:59:26 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-bde5954f-9f67-48cb-895f-d67c66e6b8ec tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:59:26 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-bde5954f-9f67-48cb-895f-d67c66e6b8ec tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75216) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 18:59:26 user nova-compute[75216]: INFO nova.compute.claims [None req-bde5954f-9f67-48cb-895f-d67c66e6b8ec tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] [instance: 71134725-e6cc-4426-b2c2-5be4991c53f7] Claim successful on node user
Nov 13 18:59:27 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-bde5954f-9f67-48cb-895f-d67c66e6b8ec tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 18:59:27 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-bde5954f-9f67-48cb-895f-d67c66e6b8ec tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 18:59:27 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-bde5954f-9f67-48cb-895f-d67c66e6b8ec tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.390s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:59:27 user nova-compute[75216]: DEBUG nova.compute.manager [None req-bde5954f-9f67-48cb-895f-d67c66e6b8ec tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] [instance: 71134725-e6cc-4426-b2c2-5be4991c53f7] Start building networks asynchronously for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 18:59:27 user nova-compute[75216]: DEBUG nova.compute.manager [None req-bde5954f-9f67-48cb-895f-d67c66e6b8ec tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] [instance: 71134725-e6cc-4426-b2c2-5be4991c53f7] Allocating IP information in the background. {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 18:59:27 user nova-compute[75216]: DEBUG nova.network.neutron [None req-bde5954f-9f67-48cb-895f-d67c66e6b8ec tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] [instance: 71134725-e6cc-4426-b2c2-5be4991c53f7] allocate_for_instance() {{(pid=75216) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 18:59:27 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-bde5954f-9f67-48cb-895f-d67c66e6b8ec tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] [instance: 71134725-e6cc-4426-b2c2-5be4991c53f7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 18:59:27 user nova-compute[75216]: DEBUG nova.compute.manager [None req-bde5954f-9f67-48cb-895f-d67c66e6b8ec tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] [instance: 71134725-e6cc-4426-b2c2-5be4991c53f7] Start building block device mappings for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 18:59:27 user nova-compute[75216]: DEBUG nova.policy [None req-bde5954f-9f67-48cb-895f-d67c66e6b8ec tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7e59bd525db64698b8e3587734cde6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58d1e76a793406bbdd3821ff74abd92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75216) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 18:59:27 user nova-compute[75216]: DEBUG nova.compute.manager [None req-bde5954f-9f67-48cb-895f-d67c66e6b8ec tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] [instance: 71134725-e6cc-4426-b2c2-5be4991c53f7] Start spawning the instance on the hypervisor. {{(pid=75216) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 18:59:27 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-bde5954f-9f67-48cb-895f-d67c66e6b8ec tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] [instance: 71134725-e6cc-4426-b2c2-5be4991c53f7] Creating instance directory {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 18:59:27 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-bde5954f-9f67-48cb-895f-d67c66e6b8ec tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] [instance: 71134725-e6cc-4426-b2c2-5be4991c53f7] Creating image(s)
Nov 13 18:59:27 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-bde5954f-9f67-48cb-895f-d67c66e6b8ec tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Acquiring lock "/opt/stack/data/nova/instances/71134725-e6cc-4426-b2c2-5be4991c53f7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:59:27 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-bde5954f-9f67-48cb-895f-d67c66e6b8ec tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Lock "/opt/stack/data/nova/instances/71134725-e6cc-4426-b2c2-5be4991c53f7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:59:27 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-bde5954f-9f67-48cb-895f-d67c66e6b8ec tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Lock "/opt/stack/data/nova/instances/71134725-e6cc-4426-b2c2-5be4991c53f7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:59:27 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-bde5954f-9f67-48cb-895f-d67c66e6b8ec tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:59:27 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-bde5954f-9f67-48cb-895f-d67c66e6b8ec tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json" returned: 0 in 0.177s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:59:27 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-bde5954f-9f67-48cb-895f-d67c66e6b8ec tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Acquiring lock "88c50a45bec9d6b0427462b3242b9b8e5f49c2b6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:59:27 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-bde5954f-9f67-48cb-895f-d67c66e6b8ec tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Lock "88c50a45bec9d6b0427462b3242b9b8e5f49c2b6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:59:27 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-bde5954f-9f67-48cb-895f-d67c66e6b8ec tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:59:27 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-bde5954f-9f67-48cb-895f-d67c66e6b8ec tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json" returned: 0 in 0.175s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:59:27 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-bde5954f-9f67-48cb-895f-d67c66e6b8ec tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6,backing_fmt=raw /opt/stack/data/nova/instances/71134725-e6cc-4426-b2c2-5be4991c53f7/disk 1073741824 {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:59:27 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-bde5954f-9f67-48cb-895f-d67c66e6b8ec tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6,backing_fmt=raw /opt/stack/data/nova/instances/71134725-e6cc-4426-b2c2-5be4991c53f7/disk 1073741824" returned: 0 in 0.047s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:59:27 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-bde5954f-9f67-48cb-895f-d67c66e6b8ec tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Lock "88c50a45bec9d6b0427462b3242b9b8e5f49c2b6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.229s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:59:27 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-bde5954f-9f67-48cb-895f-d67c66e6b8ec tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:59:27 user nova-compute[75216]: DEBUG nova.network.neutron [None req-bde5954f-9f67-48cb-895f-d67c66e6b8ec tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] [instance: 71134725-e6cc-4426-b2c2-5be4991c53f7] Successfully created port: a1fda64d-c09d-45d7-b1ae-be416c60918d {{(pid=75216) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 18:59:27 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-bde5954f-9f67-48cb-895f-d67c66e6b8ec tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json" returned: 0 in 0.167s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:59:27 user nova-compute[75216]: DEBUG nova.virt.disk.api [None req-bde5954f-9f67-48cb-895f-d67c66e6b8ec tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Checking if we can resize image /opt/stack/data/nova/instances/71134725-e6cc-4426-b2c2-5be4991c53f7/disk. size=1073741824 {{(pid=75216) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 18:59:27 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-bde5954f-9f67-48cb-895f-d67c66e6b8ec tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71134725-e6cc-4426-b2c2-5be4991c53f7/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:59:28 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-bde5954f-9f67-48cb-895f-d67c66e6b8ec tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71134725-e6cc-4426-b2c2-5be4991c53f7/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:59:28 user nova-compute[75216]: DEBUG nova.virt.disk.api [None req-bde5954f-9f67-48cb-895f-d67c66e6b8ec tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Cannot resize image /opt/stack/data/nova/instances/71134725-e6cc-4426-b2c2-5be4991c53f7/disk to a smaller size. {{(pid=75216) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 18:59:28 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-bde5954f-9f67-48cb-895f-d67c66e6b8ec tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] [instance: 71134725-e6cc-4426-b2c2-5be4991c53f7] Created local disks {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 18:59:28 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-bde5954f-9f67-48cb-895f-d67c66e6b8ec tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] [instance: 71134725-e6cc-4426-b2c2-5be4991c53f7] Ensure instance console log exists: /opt/stack/data/nova/instances/71134725-e6cc-4426-b2c2-5be4991c53f7/console.log {{(pid=75216) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 18:59:28 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-bde5954f-9f67-48cb-895f-d67c66e6b8ec tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:59:28 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-bde5954f-9f67-48cb-895f-d67c66e6b8ec tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:59:28 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-bde5954f-9f67-48cb-895f-d67c66e6b8ec tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:59:28 user nova-compute[75216]: DEBUG nova.network.neutron [None req-bde5954f-9f67-48cb-895f-d67c66e6b8ec tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] [instance: 71134725-e6cc-4426-b2c2-5be4991c53f7] Successfully updated port: a1fda64d-c09d-45d7-b1ae-be416c60918d {{(pid=75216) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 18:59:28 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-bde5954f-9f67-48cb-895f-d67c66e6b8ec tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Acquiring lock "refresh_cache-71134725-e6cc-4426-b2c2-5be4991c53f7" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 18:59:28 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-bde5954f-9f67-48cb-895f-d67c66e6b8ec tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Acquired lock "refresh_cache-71134725-e6cc-4426-b2c2-5be4991c53f7" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 18:59:28 user nova-compute[75216]: DEBUG nova.network.neutron [None req-bde5954f-9f67-48cb-895f-d67c66e6b8ec tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] [instance: 71134725-e6cc-4426-b2c2-5be4991c53f7] Building network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 18:59:28 user nova-compute[75216]: DEBUG nova.compute.manager [req-ed5bd5ef-5981-4599-87bf-d93bc0a475ee req-c32df143-34ed-4f60-90ce-2f00267ed25c service nova] [instance: 71134725-e6cc-4426-b2c2-5be4991c53f7] Received event network-changed-a1fda64d-c09d-45d7-b1ae-be416c60918d {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:59:28 user nova-compute[75216]: DEBUG nova.compute.manager [req-ed5bd5ef-5981-4599-87bf-d93bc0a475ee req-c32df143-34ed-4f60-90ce-2f00267ed25c service nova] [instance: 71134725-e6cc-4426-b2c2-5be4991c53f7] Refreshing instance network info cache due to event network-changed-a1fda64d-c09d-45d7-b1ae-be416c60918d. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 18:59:28 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-ed5bd5ef-5981-4599-87bf-d93bc0a475ee req-c32df143-34ed-4f60-90ce-2f00267ed25c service nova] Acquiring lock "refresh_cache-71134725-e6cc-4426-b2c2-5be4991c53f7" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 18:59:28 user nova-compute[75216]: DEBUG nova.network.neutron [None req-bde5954f-9f67-48cb-895f-d67c66e6b8ec tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] [instance: 71134725-e6cc-4426-b2c2-5be4991c53f7] Instance cache missing network info. {{(pid=75216) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 18:59:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:59:28 user nova-compute[75216]: DEBUG nova.network.neutron [None req-bde5954f-9f67-48cb-895f-d67c66e6b8ec tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] [instance: 71134725-e6cc-4426-b2c2-5be4991c53f7] Updating instance_info_cache with network_info: [{"id": "a1fda64d-c09d-45d7-b1ae-be416c60918d", "address": "fa:16:3e:bd:0d:c9", "network": {"id": "8cbeb1cc-a067-4c8d-82d8-0dc5c2ac924c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-742672345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a58d1e76a793406bbdd3821ff74abd92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1fda64d-c0", "ovs_interfaceid": "a1fda64d-c09d-45d7-b1ae-be416c60918d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 18:59:28 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-bde5954f-9f67-48cb-895f-d67c66e6b8ec tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Releasing lock "refresh_cache-71134725-e6cc-4426-b2c2-5be4991c53f7" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 18:59:28 user nova-compute[75216]: DEBUG nova.compute.manager [None req-bde5954f-9f67-48cb-895f-d67c66e6b8ec tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] [instance: 71134725-e6cc-4426-b2c2-5be4991c53f7] Instance network_info: |[{"id": "a1fda64d-c09d-45d7-b1ae-be416c60918d", "address": "fa:16:3e:bd:0d:c9", "network": {"id": "8cbeb1cc-a067-4c8d-82d8-0dc5c2ac924c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-742672345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a58d1e76a793406bbdd3821ff74abd92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1fda64d-c0", "ovs_interfaceid": "a1fda64d-c09d-45d7-b1ae-be416c60918d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 18:59:28 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-ed5bd5ef-5981-4599-87bf-d93bc0a475ee req-c32df143-34ed-4f60-90ce-2f00267ed25c service nova] Acquired lock "refresh_cache-71134725-e6cc-4426-b2c2-5be4991c53f7" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 18:59:28 user nova-compute[75216]: DEBUG nova.network.neutron [req-ed5bd5ef-5981-4599-87bf-d93bc0a475ee req-c32df143-34ed-4f60-90ce-2f00267ed25c service nova] [instance: 71134725-e6cc-4426-b2c2-5be4991c53f7] Refreshing network info cache for port a1fda64d-c09d-45d7-b1ae-be416c60918d {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 18:59:28 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-bde5954f-9f67-48cb-895f-d67c66e6b8ec tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] [instance: 71134725-e6cc-4426-b2c2-5be4991c53f7] Start _get_guest_xml network_info=[{"id": "a1fda64d-c09d-45d7-b1ae-be416c60918d", "address": "fa:16:3e:bd:0d:c9", "network": {"id": "8cbeb1cc-a067-4c8d-82d8-0dc5c2ac924c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-742672345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a58d1e76a793406bbdd3821ff74abd92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1fda64d-c0", "ovs_interfaceid": "a1fda64d-c09d-45d7-b1ae-be416c60918d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T18:41:06Z,direct_url=<?>,disk_format='qcow2',id=77bcb5ba-8510-41ec-a88d-96097bb431de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c465b7c26ec44582b6d1b7169536ecc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T18:41:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'guest_format': None, 'boot_index': 0, 'image_id': '77bcb5ba-8510-41ec-a88d-96097bb431de'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 18:59:28 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-bde5954f-9f67-48cb-895f-d67c66e6b8ec tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 18:59:28 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-bde5954f-9f67-48cb-895f-d67c66e6b8ec tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 18:59:28 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-bde5954f-9f67-48cb-895f-d67c66e6b8ec tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 18:59:28 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-bde5954f-9f67-48cb-895f-d67c66e6b8ec tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] CPU controller missing on host. {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 18:59:28 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-bde5954f-9f67-48cb-895f-d67c66e6b8ec tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 18:59:28 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-bde5954f-9f67-48cb-895f-d67c66e6b8ec tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] CPU controller found on host. {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 18:59:28 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-bde5954f-9f67-48cb-895f-d67c66e6b8ec tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75216) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 18:59:28 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-bde5954f-9f67-48cb-895f-d67c66e6b8ec tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T18:40:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T18:41:06Z,direct_url=<?>,disk_format='qcow2',id=77bcb5ba-8510-41ec-a88d-96097bb431de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c465b7c26ec44582b6d1b7169536ecc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T18:41:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 18:59:28 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-bde5954f-9f67-48cb-895f-d67c66e6b8ec tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Flavor limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 18:59:28 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-bde5954f-9f67-48cb-895f-d67c66e6b8ec tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Image limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 18:59:28 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-bde5954f-9f67-48cb-895f-d67c66e6b8ec tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Flavor pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 18:59:28 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-bde5954f-9f67-48cb-895f-d67c66e6b8ec tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Image pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 18:59:28 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-bde5954f-9f67-48cb-895f-d67c66e6b8ec tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 18:59:28 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-bde5954f-9f67-48cb-895f-d67c66e6b8ec tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 18:59:28 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-bde5954f-9f67-48cb-895f-d67c66e6b8ec tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 18:59:28 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-bde5954f-9f67-48cb-895f-d67c66e6b8ec tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Got 1 possible topologies {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 18:59:28 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-bde5954f-9f67-48cb-895f-d67c66e6b8ec tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 18:59:28 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-bde5954f-9f67-48cb-895f-d67c66e6b8ec tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 18:59:28 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-bde5954f-9f67-48cb-895f-d67c66e6b8ec tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T18:59:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-617465978',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-617465978',id=26,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA6jERmHhwdzykQUbYQt2L5Y0wAwzhuoXtCyCIVaBHNHP63oR5trgspDL2RAZ8jteIRJfyEGc5Jooh7DEaXc2Dx/nzho69SJjdngZ26XtMGqh2TmVh3lXYk7mlLT7W85cQ==',key_name='tempest-keypair-1201518352',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a58d1e76a793406bbdd3821ff74abd92',ramdisk_id='',reservation_id='r-04yvplgw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1861834155',owner_user_name='tempest-AttachVolumeShelveTestJSON-1861834155-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T18:59:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e59bd525db64698b8e3587734cde6b8',uuid=71134725-e6cc-4426-b2c2-5be4991c53f7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a1fda64d-c09d-45d7-b1ae-be416c60918d", "address": "fa:16:3e:bd:0d:c9", "network": {"id": "8cbeb1cc-a067-4c8d-82d8-0dc5c2ac924c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-742672345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a58d1e76a793406bbdd3821ff74abd92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1fda64d-c0", "ovs_interfaceid": "a1fda64d-c09d-45d7-b1ae-be416c60918d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75216) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 18:59:28 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-bde5954f-9f67-48cb-895f-d67c66e6b8ec tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Converting VIF {"id": "a1fda64d-c09d-45d7-b1ae-be416c60918d", "address": "fa:16:3e:bd:0d:c9", "network": {"id": "8cbeb1cc-a067-4c8d-82d8-0dc5c2ac924c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-742672345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a58d1e76a793406bbdd3821ff74abd92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1fda64d-c0", "ovs_interfaceid": "a1fda64d-c09d-45d7-b1ae-be416c60918d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 18:59:28 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-bde5954f-9f67-48cb-895f-d67c66e6b8ec tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:0d:c9,bridge_name='br-int',has_traffic_filtering=True,id=a1fda64d-c09d-45d7-b1ae-be416c60918d,network=Network(8cbeb1cc-a067-4c8d-82d8-0dc5c2ac924c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1fda64d-c0') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 18:59:28 user nova-compute[75216]: DEBUG nova.objects.instance [None req-bde5954f-9f67-48cb-895f-d67c66e6b8ec tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Lazy-loading 'pci_devices' on Instance uuid 71134725-e6cc-4426-b2c2-5be4991c53f7 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 18:59:28 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-bde5954f-9f67-48cb-895f-d67c66e6b8ec tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] [instance: 71134725-e6cc-4426-b2c2-5be4991c53f7] End _get_guest_xml xml=<domain type="kvm">
Nov 13 18:59:28 user nova-compute[75216]:   <uuid>71134725-e6cc-4426-b2c2-5be4991c53f7</uuid>
Nov 13 18:59:28 user nova-compute[75216]:   <name>instance-0000001a</name>
Nov 13 18:59:28 user nova-compute[75216]:   <memory>524288</memory>
Nov 13 18:59:28 user nova-compute[75216]:   <vcpu>1</vcpu>
Nov 13 18:59:28 user nova-compute[75216]:   <metadata>
Nov 13 18:59:28 user nova-compute[75216]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 18:59:28 user nova-compute[75216]:       <nova:package version="0.0.0"/>
Nov 13 18:59:28 user nova-compute[75216]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-617465978</nova:name>
Nov 13 18:59:28 user nova-compute[75216]:       <nova:creationTime>2023-11-13 18:59:28</nova:creationTime>
Nov 13 18:59:28 user nova-compute[75216]:       <nova:flavor name="m1.tiny">
Nov 13 18:59:28 user nova-compute[75216]:         <nova:memory>512</nova:memory>
Nov 13 18:59:28 user nova-compute[75216]:         <nova:disk>1</nova:disk>
Nov 13 18:59:28 user nova-compute[75216]:         <nova:swap>0</nova:swap>
Nov 13 18:59:28 user nova-compute[75216]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 18:59:28 user nova-compute[75216]:         <nova:vcpus>1</nova:vcpus>
Nov 13 18:59:28 user nova-compute[75216]:       </nova:flavor>
Nov 13 18:59:28 user nova-compute[75216]:       <nova:owner>
Nov 13 18:59:28 user nova-compute[75216]:         <nova:user uuid="7e59bd525db64698b8e3587734cde6b8">tempest-AttachVolumeShelveTestJSON-1861834155-project-member</nova:user>
Nov 13 18:59:28 user nova-compute[75216]:         <nova:project uuid="a58d1e76a793406bbdd3821ff74abd92">tempest-AttachVolumeShelveTestJSON-1861834155</nova:project>
Nov 13 18:59:28 user nova-compute[75216]:       </nova:owner>
Nov 13 18:59:28 user nova-compute[75216]:       <nova:root type="image" uuid="77bcb5ba-8510-41ec-a88d-96097bb431de"/>
Nov 13 18:59:28 user nova-compute[75216]:       <nova:ports>
Nov 13 18:59:28 user nova-compute[75216]:         <nova:port uuid="a1fda64d-c09d-45d7-b1ae-be416c60918d">
Nov 13 18:59:28 user nova-compute[75216]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 13 18:59:28 user nova-compute[75216]:         </nova:port>
Nov 13 18:59:28 user nova-compute[75216]:       </nova:ports>
Nov 13 18:59:28 user nova-compute[75216]:     </nova:instance>
Nov 13 18:59:28 user nova-compute[75216]:   </metadata>
Nov 13 18:59:28 user nova-compute[75216]:   <sysinfo type="smbios">
Nov 13 18:59:28 user nova-compute[75216]:     <system>
Nov 13 18:59:28 user nova-compute[75216]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 18:59:28 user nova-compute[75216]:       <entry name="product">OpenStack Nova</entry>
Nov 13 18:59:28 user nova-compute[75216]:       <entry name="version">0.0.0</entry>
Nov 13 18:59:28 user nova-compute[75216]:       <entry name="serial">71134725-e6cc-4426-b2c2-5be4991c53f7</entry>
Nov 13 18:59:28 user nova-compute[75216]:       <entry name="uuid">71134725-e6cc-4426-b2c2-5be4991c53f7</entry>
Nov 13 18:59:28 user nova-compute[75216]:       <entry name="family">Virtual Machine</entry>
Nov 13 18:59:28 user nova-compute[75216]:     </system>
Nov 13 18:59:28 user nova-compute[75216]:   </sysinfo>
Nov 13 18:59:28 user nova-compute[75216]:   <os>
Nov 13 18:59:28 user nova-compute[75216]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 18:59:28 user nova-compute[75216]:     <boot dev="hd"/>
Nov 13 18:59:28 user nova-compute[75216]:     <smbios mode="sysinfo"/>
Nov 13 18:59:28 user nova-compute[75216]:   </os>
Nov 13 18:59:28 user nova-compute[75216]:   <features>
Nov 13 18:59:28 user nova-compute[75216]:     <acpi/>
Nov 13 18:59:28 user nova-compute[75216]:     <apic/>
Nov 13 18:59:28 user nova-compute[75216]:     <vmcoreinfo/>
Nov 13 18:59:28 user nova-compute[75216]:   </features>
Nov 13 18:59:28 user nova-compute[75216]:   <clock offset="utc">
Nov 13 18:59:28 user nova-compute[75216]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 18:59:28 user nova-compute[75216]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 18:59:28 user nova-compute[75216]:     <timer name="hpet" present="no"/>
Nov 13 18:59:28 user nova-compute[75216]:   </clock>
Nov 13 18:59:28 user nova-compute[75216]:   <cpu mode="custom" match="exact">
Nov 13 18:59:28 user nova-compute[75216]:     <model>Nehalem</model>
Nov 13 18:59:28 user nova-compute[75216]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 18:59:28 user nova-compute[75216]:   </cpu>
Nov 13 18:59:28 user nova-compute[75216]:   <devices>
Nov 13 18:59:28 user nova-compute[75216]:     <disk type="file" device="disk">
Nov 13 18:59:28 user nova-compute[75216]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 18:59:28 user nova-compute[75216]:       <source file="/opt/stack/data/nova/instances/71134725-e6cc-4426-b2c2-5be4991c53f7/disk"/>
Nov 13 18:59:28 user nova-compute[75216]:       <target dev="vda" bus="virtio"/>
Nov 13 18:59:28 user nova-compute[75216]:     </disk>
Nov 13 18:59:28 user nova-compute[75216]:     <interface type="ethernet">
Nov 13 18:59:28 user nova-compute[75216]:       <mac address="fa:16:3e:bd:0d:c9"/>
Nov 13 18:59:28 user nova-compute[75216]:       <model type="virtio"/>
Nov 13 18:59:28 user nova-compute[75216]:       <mtu size="1442"/>
Nov 13 18:59:28 user nova-compute[75216]:       <target dev="tapa1fda64d-c0"/>
Nov 13 18:59:28 user nova-compute[75216]:     </interface>
Nov 13 18:59:28 user nova-compute[75216]:     <serial type="pty">
Nov 13 18:59:28 user nova-compute[75216]:       <log file="/opt/stack/data/nova/instances/71134725-e6cc-4426-b2c2-5be4991c53f7/console.log" append="off"/>
Nov 13 18:59:28 user nova-compute[75216]:     </serial>
Nov 13 18:59:28 user nova-compute[75216]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 18:59:28 user nova-compute[75216]:     <video>
Nov 13 18:59:28 user nova-compute[75216]:       <model type="virtio"/>
Nov 13 18:59:28 user nova-compute[75216]:     </video>
Nov 13 18:59:28 user nova-compute[75216]:     <rng model="virtio">
Nov 13 18:59:28 user nova-compute[75216]:       <backend model="random">/dev/urandom</backend>
Nov 13 18:59:28 user nova-compute[75216]:     </rng>
Nov 13 18:59:28 user nova-compute[75216]:     <controller type="usb" index="0" model="none"/>
Nov 13 18:59:28 user nova-compute[75216]:     <memballoon model="virtio">
Nov 13 18:59:28 user nova-compute[75216]:       <stats period="10"/>
Nov 13 18:59:28 user nova-compute[75216]:     </memballoon>
Nov 13 18:59:28 user nova-compute[75216]:   </devices>
Nov 13 18:59:28 user nova-compute[75216]: </domain>
Nov 13 18:59:28 user nova-compute[75216]:  {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 18:59:28 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-bde5954f-9f67-48cb-895f-d67c66e6b8ec tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T18:59:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-617465978',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-617465978',id=26,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA6jERmHhwdzykQUbYQt2L5Y0wAwzhuoXtCyCIVaBHNHP63oR5trgspDL2RAZ8jteIRJfyEGc5Jooh7DEaXc2Dx/nzho69SJjdngZ26XtMGqh2TmVh3lXYk7mlLT7W85cQ==',key_name='tempest-keypair-1201518352',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a58d1e76a793406bbdd3821ff74abd92',ramdisk_id='',reservation_id='r-04yvplgw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1861834155',owner_user_name='tempest-AttachVolumeShelveTestJSON-1861834155-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T18:59:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e59bd525db64698b8e3587734cde6b8',uuid=71134725-e6cc-4426-b2c2-5be4991c53f7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a1fda64d-c09d-45d7-b1ae-be416c60918d", "address": "fa:16:3e:bd:0d:c9", "network": {"id": "8cbeb1cc-a067-4c8d-82d8-0dc5c2ac924c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-742672345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a58d1e76a793406bbdd3821ff74abd92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1fda64d-c0", "ovs_interfaceid": "a1fda64d-c09d-45d7-b1ae-be416c60918d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 18:59:28 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-bde5954f-9f67-48cb-895f-d67c66e6b8ec tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Converting VIF {"id": "a1fda64d-c09d-45d7-b1ae-be416c60918d", "address": "fa:16:3e:bd:0d:c9", "network": {"id": "8cbeb1cc-a067-4c8d-82d8-0dc5c2ac924c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-742672345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a58d1e76a793406bbdd3821ff74abd92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1fda64d-c0", "ovs_interfaceid": "a1fda64d-c09d-45d7-b1ae-be416c60918d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 18:59:28 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-bde5954f-9f67-48cb-895f-d67c66e6b8ec tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:0d:c9,bridge_name='br-int',has_traffic_filtering=True,id=a1fda64d-c09d-45d7-b1ae-be416c60918d,network=Network(8cbeb1cc-a067-4c8d-82d8-0dc5c2ac924c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1fda64d-c0') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 18:59:28 user nova-compute[75216]: DEBUG os_vif [None req-bde5954f-9f67-48cb-895f-d67c66e6b8ec tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:0d:c9,bridge_name='br-int',has_traffic_filtering=True,id=a1fda64d-c09d-45d7-b1ae-be416c60918d,network=Network(8cbeb1cc-a067-4c8d-82d8-0dc5c2ac924c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1fda64d-c0') {{(pid=75216) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 18:59:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:59:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:59:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 18:59:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:59:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cb900019-bb95-54cb-8c76-fc93ca535dd3', '_type': 'linux-noop'}}, row=False) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:59:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:59:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:59:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:59:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa1fda64d-c0, may_exist=True, interface_attrs={}) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:59:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa1fda64d-c0, col_values=(('qos', UUID('82864bb3-b022-45d9-9d6f-a502f9d324ca')),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:59:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa1fda64d-c0, col_values=(('external_ids', {'iface-id': 'a1fda64d-c09d-45d7-b1ae-be416c60918d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bd:0d:c9', 'vm-uuid': '71134725-e6cc-4426-b2c2-5be4991c53f7'}),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:59:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:59:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:59:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:59:28 user nova-compute[75216]: INFO os_vif [None req-bde5954f-9f67-48cb-895f-d67c66e6b8ec tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:0d:c9,bridge_name='br-int',has_traffic_filtering=True,id=a1fda64d-c09d-45d7-b1ae-be416c60918d,network=Network(8cbeb1cc-a067-4c8d-82d8-0dc5c2ac924c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1fda64d-c0')
Nov 13 18:59:28 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-bde5954f-9f67-48cb-895f-d67c66e6b8ec tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 18:59:29 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-bde5954f-9f67-48cb-895f-d67c66e6b8ec tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] No VIF found with MAC fa:16:3e:bd:0d:c9, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 18:59:29 user nova-compute[75216]: DEBUG nova.network.neutron [req-ed5bd5ef-5981-4599-87bf-d93bc0a475ee req-c32df143-34ed-4f60-90ce-2f00267ed25c service nova] [instance: 71134725-e6cc-4426-b2c2-5be4991c53f7] Updated VIF entry in instance network info cache for port a1fda64d-c09d-45d7-b1ae-be416c60918d. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 18:59:29 user nova-compute[75216]: DEBUG nova.network.neutron [req-ed5bd5ef-5981-4599-87bf-d93bc0a475ee req-c32df143-34ed-4f60-90ce-2f00267ed25c service nova] [instance: 71134725-e6cc-4426-b2c2-5be4991c53f7] Updating instance_info_cache with network_info: [{"id": "a1fda64d-c09d-45d7-b1ae-be416c60918d", "address": "fa:16:3e:bd:0d:c9", "network": {"id": "8cbeb1cc-a067-4c8d-82d8-0dc5c2ac924c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-742672345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a58d1e76a793406bbdd3821ff74abd92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1fda64d-c0", "ovs_interfaceid": "a1fda64d-c09d-45d7-b1ae-be416c60918d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 18:59:29 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-ed5bd5ef-5981-4599-87bf-d93bc0a475ee req-c32df143-34ed-4f60-90ce-2f00267ed25c service nova] Releasing lock "refresh_cache-71134725-e6cc-4426-b2c2-5be4991c53f7" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 18:59:30 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:59:30 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:59:30 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:59:30 user nova-compute[75216]: DEBUG nova.compute.manager [req-b98d77c5-39b9-4a63-bd57-0e60ea4744ab req-eda1e8fc-122d-444d-a5f1-33448a1e47ee service nova] [instance: 71134725-e6cc-4426-b2c2-5be4991c53f7] Received event network-vif-plugged-a1fda64d-c09d-45d7-b1ae-be416c60918d {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:59:30 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-b98d77c5-39b9-4a63-bd57-0e60ea4744ab req-eda1e8fc-122d-444d-a5f1-33448a1e47ee service nova] Acquiring lock "71134725-e6cc-4426-b2c2-5be4991c53f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:59:30 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-b98d77c5-39b9-4a63-bd57-0e60ea4744ab req-eda1e8fc-122d-444d-a5f1-33448a1e47ee service nova] Lock "71134725-e6cc-4426-b2c2-5be4991c53f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:59:30 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-b98d77c5-39b9-4a63-bd57-0e60ea4744ab req-eda1e8fc-122d-444d-a5f1-33448a1e47ee service nova] Lock "71134725-e6cc-4426-b2c2-5be4991c53f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:59:30 user nova-compute[75216]: DEBUG nova.compute.manager [req-b98d77c5-39b9-4a63-bd57-0e60ea4744ab req-eda1e8fc-122d-444d-a5f1-33448a1e47ee service nova] [instance: 71134725-e6cc-4426-b2c2-5be4991c53f7] No waiting events found dispatching network-vif-plugged-a1fda64d-c09d-45d7-b1ae-be416c60918d {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:59:30 user nova-compute[75216]: WARNING nova.compute.manager [req-b98d77c5-39b9-4a63-bd57-0e60ea4744ab req-eda1e8fc-122d-444d-a5f1-33448a1e47ee service nova] [instance: 71134725-e6cc-4426-b2c2-5be4991c53f7] Received unexpected event network-vif-plugged-a1fda64d-c09d-45d7-b1ae-be416c60918d for instance with vm_state building and task_state spawning.
Nov 13 18:59:30 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:59:30 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:59:30 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:59:30 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:59:32 user nova-compute[75216]: DEBUG nova.compute.manager [None req-bde5954f-9f67-48cb-895f-d67c66e6b8ec tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] [instance: 71134725-e6cc-4426-b2c2-5be4991c53f7] Instance event wait completed in 0 seconds for  {{(pid=75216) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 18:59:32 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-bde5954f-9f67-48cb-895f-d67c66e6b8ec tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] [instance: 71134725-e6cc-4426-b2c2-5be4991c53f7] Guest created on hypervisor {{(pid=75216) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 18:59:32 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 71134725-e6cc-4426-b2c2-5be4991c53f7] Instance spawned successfully.
Nov 13 18:59:32 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-bde5954f-9f67-48cb-895f-d67c66e6b8ec tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] [instance: 71134725-e6cc-4426-b2c2-5be4991c53f7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 18:59:32 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-bde5954f-9f67-48cb-895f-d67c66e6b8ec tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] [instance: 71134725-e6cc-4426-b2c2-5be4991c53f7] Found default for hw_cdrom_bus of ide {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 18:59:32 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-bde5954f-9f67-48cb-895f-d67c66e6b8ec tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] [instance: 71134725-e6cc-4426-b2c2-5be4991c53f7] Found default for hw_disk_bus of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 18:59:32 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-bde5954f-9f67-48cb-895f-d67c66e6b8ec tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] [instance: 71134725-e6cc-4426-b2c2-5be4991c53f7] Found default for hw_input_bus of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 18:59:32 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-bde5954f-9f67-48cb-895f-d67c66e6b8ec tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] [instance: 71134725-e6cc-4426-b2c2-5be4991c53f7] Found default for hw_pointer_model of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 18:59:32 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-bde5954f-9f67-48cb-895f-d67c66e6b8ec tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] [instance: 71134725-e6cc-4426-b2c2-5be4991c53f7] Found default for hw_video_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 18:59:32 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-bde5954f-9f67-48cb-895f-d67c66e6b8ec tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] [instance: 71134725-e6cc-4426-b2c2-5be4991c53f7] Found default for hw_vif_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 18:59:32 user nova-compute[75216]: DEBUG nova.compute.manager [req-ace43437-3f00-4ad9-8cb9-6eabfbef2dbc req-11aebb98-e6ee-4340-9020-c10120266497 service nova] [instance: 71134725-e6cc-4426-b2c2-5be4991c53f7] Received event network-vif-plugged-a1fda64d-c09d-45d7-b1ae-be416c60918d {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:59:32 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-ace43437-3f00-4ad9-8cb9-6eabfbef2dbc req-11aebb98-e6ee-4340-9020-c10120266497 service nova] Acquiring lock "71134725-e6cc-4426-b2c2-5be4991c53f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:59:32 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-ace43437-3f00-4ad9-8cb9-6eabfbef2dbc req-11aebb98-e6ee-4340-9020-c10120266497 service nova] Lock "71134725-e6cc-4426-b2c2-5be4991c53f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:59:32 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-ace43437-3f00-4ad9-8cb9-6eabfbef2dbc req-11aebb98-e6ee-4340-9020-c10120266497 service nova] Lock "71134725-e6cc-4426-b2c2-5be4991c53f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:59:32 user nova-compute[75216]: DEBUG nova.compute.manager [req-ace43437-3f00-4ad9-8cb9-6eabfbef2dbc req-11aebb98-e6ee-4340-9020-c10120266497 service nova] [instance: 71134725-e6cc-4426-b2c2-5be4991c53f7] No waiting events found dispatching network-vif-plugged-a1fda64d-c09d-45d7-b1ae-be416c60918d {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:59:32 user nova-compute[75216]: WARNING nova.compute.manager [req-ace43437-3f00-4ad9-8cb9-6eabfbef2dbc req-11aebb98-e6ee-4340-9020-c10120266497 service nova] [instance: 71134725-e6cc-4426-b2c2-5be4991c53f7] Received unexpected event network-vif-plugged-a1fda64d-c09d-45d7-b1ae-be416c60918d for instance with vm_state building and task_state spawning.
Nov 13 18:59:32 user nova-compute[75216]: INFO nova.compute.manager [None req-bde5954f-9f67-48cb-895f-d67c66e6b8ec tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] [instance: 71134725-e6cc-4426-b2c2-5be4991c53f7] Took 5.12 seconds to spawn the instance on the hypervisor.
Nov 13 18:59:32 user nova-compute[75216]: DEBUG nova.compute.manager [None req-bde5954f-9f67-48cb-895f-d67c66e6b8ec tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] [instance: 71134725-e6cc-4426-b2c2-5be4991c53f7] Checking state {{(pid=75216) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 18:59:32 user nova-compute[75216]: INFO nova.compute.manager [None req-bde5954f-9f67-48cb-895f-d67c66e6b8ec tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] [instance: 71134725-e6cc-4426-b2c2-5be4991c53f7] Took 5.86 seconds to build instance.
Nov 13 18:59:32 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-bde5954f-9f67-48cb-895f-d67c66e6b8ec tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Lock "71134725-e6cc-4426-b2c2-5be4991c53f7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.956s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:59:33 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:59:33 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:59:34 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-af921e50-97b8-4f5a-a083-4cb0f596a88d tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Acquiring lock "af8089f7-6dc3-4655-9369-2177dbd7bf4d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:59:34 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-af921e50-97b8-4f5a-a083-4cb0f596a88d tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Lock "af8089f7-6dc3-4655-9369-2177dbd7bf4d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:59:34 user nova-compute[75216]: DEBUG nova.compute.manager [None req-af921e50-97b8-4f5a-a083-4cb0f596a88d tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] [instance: af8089f7-6dc3-4655-9369-2177dbd7bf4d] Starting instance... {{(pid=75216) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 18:59:34 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-af921e50-97b8-4f5a-a083-4cb0f596a88d tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:59:34 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-af921e50-97b8-4f5a-a083-4cb0f596a88d tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:59:34 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-af921e50-97b8-4f5a-a083-4cb0f596a88d tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75216) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 18:59:34 user nova-compute[75216]: INFO nova.compute.claims [None req-af921e50-97b8-4f5a-a083-4cb0f596a88d tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] [instance: af8089f7-6dc3-4655-9369-2177dbd7bf4d] Claim successful on node user
Nov 13 18:59:34 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-af921e50-97b8-4f5a-a083-4cb0f596a88d tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 18:59:34 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-af921e50-97b8-4f5a-a083-4cb0f596a88d tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 18:59:34 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-af921e50-97b8-4f5a-a083-4cb0f596a88d tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.392s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:59:34 user nova-compute[75216]: DEBUG nova.compute.manager [None req-af921e50-97b8-4f5a-a083-4cb0f596a88d tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] [instance: af8089f7-6dc3-4655-9369-2177dbd7bf4d] Start building networks asynchronously for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 18:59:34 user nova-compute[75216]: DEBUG nova.compute.manager [None req-af921e50-97b8-4f5a-a083-4cb0f596a88d tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] [instance: af8089f7-6dc3-4655-9369-2177dbd7bf4d] Allocating IP information in the background. {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 18:59:34 user nova-compute[75216]: DEBUG nova.network.neutron [None req-af921e50-97b8-4f5a-a083-4cb0f596a88d tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] [instance: af8089f7-6dc3-4655-9369-2177dbd7bf4d] allocate_for_instance() {{(pid=75216) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 18:59:34 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-af921e50-97b8-4f5a-a083-4cb0f596a88d tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] [instance: af8089f7-6dc3-4655-9369-2177dbd7bf4d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 18:59:35 user nova-compute[75216]: DEBUG nova.compute.manager [None req-af921e50-97b8-4f5a-a083-4cb0f596a88d tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] [instance: af8089f7-6dc3-4655-9369-2177dbd7bf4d] Start building block device mappings for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 18:59:35 user nova-compute[75216]: DEBUG nova.policy [None req-af921e50-97b8-4f5a-a083-4cb0f596a88d tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '83cc10163cd04fffb40b36e6c0cdd484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d0223a97ff4ecab9bf4273e3e465a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75216) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 18:59:35 user nova-compute[75216]: DEBUG nova.compute.manager [None req-af921e50-97b8-4f5a-a083-4cb0f596a88d tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] [instance: af8089f7-6dc3-4655-9369-2177dbd7bf4d] Start spawning the instance on the hypervisor. {{(pid=75216) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 18:59:35 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-af921e50-97b8-4f5a-a083-4cb0f596a88d tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] [instance: af8089f7-6dc3-4655-9369-2177dbd7bf4d] Creating instance directory {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 18:59:35 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-af921e50-97b8-4f5a-a083-4cb0f596a88d tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] [instance: af8089f7-6dc3-4655-9369-2177dbd7bf4d] Creating image(s)
Nov 13 18:59:35 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-af921e50-97b8-4f5a-a083-4cb0f596a88d tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Acquiring lock "/opt/stack/data/nova/instances/af8089f7-6dc3-4655-9369-2177dbd7bf4d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:59:35 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-af921e50-97b8-4f5a-a083-4cb0f596a88d tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Lock "/opt/stack/data/nova/instances/af8089f7-6dc3-4655-9369-2177dbd7bf4d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:59:35 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-af921e50-97b8-4f5a-a083-4cb0f596a88d tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Lock "/opt/stack/data/nova/instances/af8089f7-6dc3-4655-9369-2177dbd7bf4d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:59:35 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-af921e50-97b8-4f5a-a083-4cb0f596a88d tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Acquiring lock "1a96792b5ea4f840a218df36fb3abab2368172a6" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:59:35 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-af921e50-97b8-4f5a-a083-4cb0f596a88d tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Lock "1a96792b5ea4f840a218df36fb3abab2368172a6" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:59:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-af921e50-97b8-4f5a-a083-4cb0f596a88d tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a96792b5ea4f840a218df36fb3abab2368172a6.part --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:59:35 user nova-compute[75216]: DEBUG nova.network.neutron [None req-af921e50-97b8-4f5a-a083-4cb0f596a88d tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] [instance: af8089f7-6dc3-4655-9369-2177dbd7bf4d] Successfully created port: c26beff8-370e-431e-9a8c-d31c4ec912ec {{(pid=75216) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 18:59:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-af921e50-97b8-4f5a-a083-4cb0f596a88d tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a96792b5ea4f840a218df36fb3abab2368172a6.part --force-share --output=json" returned: 0 in 0.206s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:59:35 user nova-compute[75216]: DEBUG nova.virt.images [None req-af921e50-97b8-4f5a-a083-4cb0f596a88d tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] c1c8eeb9-2ea4-4665-94c5-b399df123710 was qcow2, converting to raw {{(pid=75216) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 13 18:59:35 user nova-compute[75216]: DEBUG nova.privsep.utils [None req-af921e50-97b8-4f5a-a083-4cb0f596a88d tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75216) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 13 18:59:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-af921e50-97b8-4f5a-a083-4cb0f596a88d tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1a96792b5ea4f840a218df36fb3abab2368172a6.part /opt/stack/data/nova/instances/_base/1a96792b5ea4f840a218df36fb3abab2368172a6.converted {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:59:36 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-af921e50-97b8-4f5a-a083-4cb0f596a88d tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1a96792b5ea4f840a218df36fb3abab2368172a6.part /opt/stack/data/nova/instances/_base/1a96792b5ea4f840a218df36fb3abab2368172a6.converted" returned: 0 in 0.376s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:59:36 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-af921e50-97b8-4f5a-a083-4cb0f596a88d tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a96792b5ea4f840a218df36fb3abab2368172a6.converted --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:59:36 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-af921e50-97b8-4f5a-a083-4cb0f596a88d tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a96792b5ea4f840a218df36fb3abab2368172a6.converted --force-share --output=json" returned: 0 in 0.188s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:59:36 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-af921e50-97b8-4f5a-a083-4cb0f596a88d tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Lock "1a96792b5ea4f840a218df36fb3abab2368172a6" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.416s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:59:36 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-af921e50-97b8-4f5a-a083-4cb0f596a88d tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a96792b5ea4f840a218df36fb3abab2368172a6 --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:59:36 user nova-compute[75216]: DEBUG nova.network.neutron [None req-af921e50-97b8-4f5a-a083-4cb0f596a88d tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] [instance: af8089f7-6dc3-4655-9369-2177dbd7bf4d] Successfully updated port: c26beff8-370e-431e-9a8c-d31c4ec912ec {{(pid=75216) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 18:59:36 user nova-compute[75216]: DEBUG nova.compute.manager [req-c16b0469-25a6-47d6-a336-0cd6ddad1665 req-2b18d383-6e88-410b-8847-3507b4ca0cc5 service nova] [instance: af8089f7-6dc3-4655-9369-2177dbd7bf4d] Received event network-changed-c26beff8-370e-431e-9a8c-d31c4ec912ec {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:59:36 user nova-compute[75216]: DEBUG nova.compute.manager [req-c16b0469-25a6-47d6-a336-0cd6ddad1665 req-2b18d383-6e88-410b-8847-3507b4ca0cc5 service nova] [instance: af8089f7-6dc3-4655-9369-2177dbd7bf4d] Refreshing instance network info cache due to event network-changed-c26beff8-370e-431e-9a8c-d31c4ec912ec. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 18:59:36 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-c16b0469-25a6-47d6-a336-0cd6ddad1665 req-2b18d383-6e88-410b-8847-3507b4ca0cc5 service nova] Acquiring lock "refresh_cache-af8089f7-6dc3-4655-9369-2177dbd7bf4d" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 18:59:36 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-c16b0469-25a6-47d6-a336-0cd6ddad1665 req-2b18d383-6e88-410b-8847-3507b4ca0cc5 service nova] Acquired lock "refresh_cache-af8089f7-6dc3-4655-9369-2177dbd7bf4d" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 18:59:36 user nova-compute[75216]: DEBUG nova.network.neutron [req-c16b0469-25a6-47d6-a336-0cd6ddad1665 req-2b18d383-6e88-410b-8847-3507b4ca0cc5 service nova] [instance: af8089f7-6dc3-4655-9369-2177dbd7bf4d] Refreshing network info cache for port c26beff8-370e-431e-9a8c-d31c4ec912ec {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 18:59:36 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-af921e50-97b8-4f5a-a083-4cb0f596a88d tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Acquiring lock "refresh_cache-af8089f7-6dc3-4655-9369-2177dbd7bf4d" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 18:59:36 user nova-compute[75216]: DEBUG nova.network.neutron [req-c16b0469-25a6-47d6-a336-0cd6ddad1665 req-2b18d383-6e88-410b-8847-3507b4ca0cc5 service nova] [instance: af8089f7-6dc3-4655-9369-2177dbd7bf4d] Instance cache missing network info. {{(pid=75216) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 18:59:36 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-af921e50-97b8-4f5a-a083-4cb0f596a88d tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a96792b5ea4f840a218df36fb3abab2368172a6 --force-share --output=json" returned: 0 in 0.182s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:59:36 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-af921e50-97b8-4f5a-a083-4cb0f596a88d tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Acquiring lock "1a96792b5ea4f840a218df36fb3abab2368172a6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:59:36 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-af921e50-97b8-4f5a-a083-4cb0f596a88d tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Lock "1a96792b5ea4f840a218df36fb3abab2368172a6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:59:36 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-af921e50-97b8-4f5a-a083-4cb0f596a88d tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a96792b5ea4f840a218df36fb3abab2368172a6 --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:59:36 user nova-compute[75216]: DEBUG nova.network.neutron [req-c16b0469-25a6-47d6-a336-0cd6ddad1665 req-2b18d383-6e88-410b-8847-3507b4ca0cc5 service nova] [instance: af8089f7-6dc3-4655-9369-2177dbd7bf4d] Updating instance_info_cache with network_info: [] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 18:59:36 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-c16b0469-25a6-47d6-a336-0cd6ddad1665 req-2b18d383-6e88-410b-8847-3507b4ca0cc5 service nova] Releasing lock "refresh_cache-af8089f7-6dc3-4655-9369-2177dbd7bf4d" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 18:59:36 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-af921e50-97b8-4f5a-a083-4cb0f596a88d tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Acquired lock "refresh_cache-af8089f7-6dc3-4655-9369-2177dbd7bf4d" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 18:59:36 user nova-compute[75216]: DEBUG nova.network.neutron [None req-af921e50-97b8-4f5a-a083-4cb0f596a88d tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] [instance: af8089f7-6dc3-4655-9369-2177dbd7bf4d] Building network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 18:59:36 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-af921e50-97b8-4f5a-a083-4cb0f596a88d tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a96792b5ea4f840a218df36fb3abab2368172a6 --force-share --output=json" returned: 0 in 0.194s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:59:36 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-af921e50-97b8-4f5a-a083-4cb0f596a88d tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1a96792b5ea4f840a218df36fb3abab2368172a6,backing_fmt=raw /opt/stack/data/nova/instances/af8089f7-6dc3-4655-9369-2177dbd7bf4d/disk 1073741824 {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:59:36 user nova-compute[75216]: DEBUG nova.network.neutron [None req-af921e50-97b8-4f5a-a083-4cb0f596a88d tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] [instance: af8089f7-6dc3-4655-9369-2177dbd7bf4d] Instance cache missing network info. {{(pid=75216) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 18:59:36 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-af921e50-97b8-4f5a-a083-4cb0f596a88d tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1a96792b5ea4f840a218df36fb3abab2368172a6,backing_fmt=raw /opt/stack/data/nova/instances/af8089f7-6dc3-4655-9369-2177dbd7bf4d/disk 1073741824" returned: 0 in 0.056s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:59:36 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-af921e50-97b8-4f5a-a083-4cb0f596a88d tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Lock "1a96792b5ea4f840a218df36fb3abab2368172a6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.253s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:59:36 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-af921e50-97b8-4f5a-a083-4cb0f596a88d tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a96792b5ea4f840a218df36fb3abab2368172a6 --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:59:37 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-af921e50-97b8-4f5a-a083-4cb0f596a88d tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a96792b5ea4f840a218df36fb3abab2368172a6 --force-share --output=json" returned: 0 in 0.190s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:59:37 user nova-compute[75216]: DEBUG nova.virt.disk.api [None req-af921e50-97b8-4f5a-a083-4cb0f596a88d tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Checking if we can resize image /opt/stack/data/nova/instances/af8089f7-6dc3-4655-9369-2177dbd7bf4d/disk. size=1073741824 {{(pid=75216) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 18:59:37 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-af921e50-97b8-4f5a-a083-4cb0f596a88d tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af8089f7-6dc3-4655-9369-2177dbd7bf4d/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:59:37 user nova-compute[75216]: DEBUG nova.network.neutron [None req-af921e50-97b8-4f5a-a083-4cb0f596a88d tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] [instance: af8089f7-6dc3-4655-9369-2177dbd7bf4d] Updating instance_info_cache with network_info: [{"id": "c26beff8-370e-431e-9a8c-d31c4ec912ec", "address": "fa:16:3e:03:83:09", "network": {"id": "fea11c73-0074-4971-8b36-0aced430c730", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1420832282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84d0223a97ff4ecab9bf4273e3e465a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc26beff8-37", "ovs_interfaceid": "c26beff8-370e-431e-9a8c-d31c4ec912ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 18:59:37 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-af921e50-97b8-4f5a-a083-4cb0f596a88d tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Releasing lock "refresh_cache-af8089f7-6dc3-4655-9369-2177dbd7bf4d" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 18:59:37 user nova-compute[75216]: DEBUG nova.compute.manager [None req-af921e50-97b8-4f5a-a083-4cb0f596a88d tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] [instance: af8089f7-6dc3-4655-9369-2177dbd7bf4d] Instance network_info: |[{"id": "c26beff8-370e-431e-9a8c-d31c4ec912ec", "address": "fa:16:3e:03:83:09", "network": {"id": "fea11c73-0074-4971-8b36-0aced430c730", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1420832282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84d0223a97ff4ecab9bf4273e3e465a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc26beff8-37", "ovs_interfaceid": "c26beff8-370e-431e-9a8c-d31c4ec912ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 18:59:37 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-af921e50-97b8-4f5a-a083-4cb0f596a88d tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af8089f7-6dc3-4655-9369-2177dbd7bf4d/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:59:37 user nova-compute[75216]: DEBUG nova.virt.disk.api [None req-af921e50-97b8-4f5a-a083-4cb0f596a88d tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Cannot resize image /opt/stack/data/nova/instances/af8089f7-6dc3-4655-9369-2177dbd7bf4d/disk to a smaller size. {{(pid=75216) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 18:59:37 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-af921e50-97b8-4f5a-a083-4cb0f596a88d tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] [instance: af8089f7-6dc3-4655-9369-2177dbd7bf4d] Created local disks {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 18:59:37 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-af921e50-97b8-4f5a-a083-4cb0f596a88d tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] [instance: af8089f7-6dc3-4655-9369-2177dbd7bf4d] Ensure instance console log exists: /opt/stack/data/nova/instances/af8089f7-6dc3-4655-9369-2177dbd7bf4d/console.log {{(pid=75216) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 18:59:37 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-af921e50-97b8-4f5a-a083-4cb0f596a88d tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:59:37 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-af921e50-97b8-4f5a-a083-4cb0f596a88d tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:59:37 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-af921e50-97b8-4f5a-a083-4cb0f596a88d tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:59:37 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-af921e50-97b8-4f5a-a083-4cb0f596a88d tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] [instance: af8089f7-6dc3-4655-9369-2177dbd7bf4d] Start _get_guest_xml network_info=[{"id": "c26beff8-370e-431e-9a8c-d31c4ec912ec", "address": "fa:16:3e:03:83:09", "network": {"id": "fea11c73-0074-4971-8b36-0aced430c730", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1420832282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84d0223a97ff4ecab9bf4273e3e465a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc26beff8-37", "ovs_interfaceid": "c26beff8-370e-431e-9a8c-d31c4ec912ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T18:59:32Z,direct_url=<?>,disk_format='qcow2',id=c1c8eeb9-2ea4-4665-94c5-b399df123710,min_disk=0,min_ram=0,name='tempest-scenario-img--552743373',owner='84d0223a97ff4ecab9bf4273e3e465a9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T18:59:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'guest_format': None, 'boot_index': 0, 'image_id': 'c1c8eeb9-2ea4-4665-94c5-b399df123710'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 18:59:37 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-af921e50-97b8-4f5a-a083-4cb0f596a88d tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 18:59:37 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-af921e50-97b8-4f5a-a083-4cb0f596a88d tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 18:59:37 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-af921e50-97b8-4f5a-a083-4cb0f596a88d tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 18:59:37 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-af921e50-97b8-4f5a-a083-4cb0f596a88d tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] CPU controller missing on host. {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 18:59:37 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-af921e50-97b8-4f5a-a083-4cb0f596a88d tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 18:59:37 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-af921e50-97b8-4f5a-a083-4cb0f596a88d tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] CPU controller found on host. {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 18:59:37 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-af921e50-97b8-4f5a-a083-4cb0f596a88d tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75216) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 18:59:37 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-af921e50-97b8-4f5a-a083-4cb0f596a88d tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T18:40:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T18:59:32Z,direct_url=<?>,disk_format='qcow2',id=c1c8eeb9-2ea4-4665-94c5-b399df123710,min_disk=0,min_ram=0,name='tempest-scenario-img--552743373',owner='84d0223a97ff4ecab9bf4273e3e465a9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T18:59:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 18:59:37 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-af921e50-97b8-4f5a-a083-4cb0f596a88d tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Flavor limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 18:59:37 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-af921e50-97b8-4f5a-a083-4cb0f596a88d tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Image limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 18:59:37 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-af921e50-97b8-4f5a-a083-4cb0f596a88d tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Flavor pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 18:59:37 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-af921e50-97b8-4f5a-a083-4cb0f596a88d tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Image pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 18:59:37 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-af921e50-97b8-4f5a-a083-4cb0f596a88d tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 18:59:37 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-af921e50-97b8-4f5a-a083-4cb0f596a88d tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 18:59:37 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-af921e50-97b8-4f5a-a083-4cb0f596a88d tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 18:59:37 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-af921e50-97b8-4f5a-a083-4cb0f596a88d tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Got 1 possible topologies {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 18:59:37 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-af921e50-97b8-4f5a-a083-4cb0f596a88d tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 18:59:37 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-af921e50-97b8-4f5a-a083-4cb0f596a88d tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 18:59:37 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-af921e50-97b8-4f5a-a083-4cb0f596a88d tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T18:59:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-780279528',display_name='tempest-TestMinimumBasicScenario-server-780279528',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-780279528',id=27,image_ref='c1c8eeb9-2ea4-4665-94c5-b399df123710',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMkFC1l0t0GBOtzT2bLiJ8lAjyzCHTdr7Xj4oBWrTAaMd1//fCspfw4r2vuGqo9b1iSdtFSJATkMSuJELCx7MDHe2xx0PHl1FK/K0yjaXgUddzBQSnf3lRM5pnUKjvgUNg==',key_name='tempest-TestMinimumBasicScenario-1870399637',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='84d0223a97ff4ecab9bf4273e3e465a9',ramdisk_id='',reservation_id='r-902ox0es',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c1c8eeb9-2ea4-4665-94c5-b399df123710',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1197015828',owner_user_name='tempest-TestMinimumBasicScenario-1197015828-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T18:59:35Z,user_data=None,user_id='83cc10163cd04fffb40b36e6c0cdd484',uuid=af8089f7-6dc3-4655-9369-2177dbd7bf4d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c26beff8-370e-431e-9a8c-d31c4ec912ec", "address": "fa:16:3e:03:83:09", "network": {"id": "fea11c73-0074-4971-8b36-0aced430c730", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1420832282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84d0223a97ff4ecab9bf4273e3e465a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc26beff8-37", "ovs_interfaceid": "c26beff8-370e-431e-9a8c-d31c4ec912ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75216) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 18:59:37 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-af921e50-97b8-4f5a-a083-4cb0f596a88d tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Converting VIF {"id": "c26beff8-370e-431e-9a8c-d31c4ec912ec", "address": "fa:16:3e:03:83:09", "network": {"id": "fea11c73-0074-4971-8b36-0aced430c730", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1420832282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84d0223a97ff4ecab9bf4273e3e465a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc26beff8-37", "ovs_interfaceid": "c26beff8-370e-431e-9a8c-d31c4ec912ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 18:59:37 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-af921e50-97b8-4f5a-a083-4cb0f596a88d tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:83:09,bridge_name='br-int',has_traffic_filtering=True,id=c26beff8-370e-431e-9a8c-d31c4ec912ec,network=Network(fea11c73-0074-4971-8b36-0aced430c730),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc26beff8-37') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 18:59:37 user nova-compute[75216]: DEBUG nova.objects.instance [None req-af921e50-97b8-4f5a-a083-4cb0f596a88d tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Lazy-loading 'pci_devices' on Instance uuid af8089f7-6dc3-4655-9369-2177dbd7bf4d {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 18:59:37 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-af921e50-97b8-4f5a-a083-4cb0f596a88d tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] [instance: af8089f7-6dc3-4655-9369-2177dbd7bf4d] End _get_guest_xml xml=<domain type="kvm">
Nov 13 18:59:37 user nova-compute[75216]:   <uuid>af8089f7-6dc3-4655-9369-2177dbd7bf4d</uuid>
Nov 13 18:59:37 user nova-compute[75216]:   <name>instance-0000001b</name>
Nov 13 18:59:37 user nova-compute[75216]:   <memory>524288</memory>
Nov 13 18:59:37 user nova-compute[75216]:   <vcpu>1</vcpu>
Nov 13 18:59:37 user nova-compute[75216]:   <metadata>
Nov 13 18:59:37 user nova-compute[75216]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 18:59:37 user nova-compute[75216]:       <nova:package version="0.0.0"/>
Nov 13 18:59:37 user nova-compute[75216]:       <nova:name>tempest-TestMinimumBasicScenario-server-780279528</nova:name>
Nov 13 18:59:37 user nova-compute[75216]:       <nova:creationTime>2023-11-13 18:59:37</nova:creationTime>
Nov 13 18:59:37 user nova-compute[75216]:       <nova:flavor name="m1.tiny">
Nov 13 18:59:37 user nova-compute[75216]:         <nova:memory>512</nova:memory>
Nov 13 18:59:37 user nova-compute[75216]:         <nova:disk>1</nova:disk>
Nov 13 18:59:37 user nova-compute[75216]:         <nova:swap>0</nova:swap>
Nov 13 18:59:37 user nova-compute[75216]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 18:59:37 user nova-compute[75216]:         <nova:vcpus>1</nova:vcpus>
Nov 13 18:59:37 user nova-compute[75216]:       </nova:flavor>
Nov 13 18:59:37 user nova-compute[75216]:       <nova:owner>
Nov 13 18:59:37 user nova-compute[75216]:         <nova:user uuid="83cc10163cd04fffb40b36e6c0cdd484">tempest-TestMinimumBasicScenario-1197015828-project-member</nova:user>
Nov 13 18:59:37 user nova-compute[75216]:         <nova:project uuid="84d0223a97ff4ecab9bf4273e3e465a9">tempest-TestMinimumBasicScenario-1197015828</nova:project>
Nov 13 18:59:37 user nova-compute[75216]:       </nova:owner>
Nov 13 18:59:37 user nova-compute[75216]:       <nova:root type="image" uuid="c1c8eeb9-2ea4-4665-94c5-b399df123710"/>
Nov 13 18:59:37 user nova-compute[75216]:       <nova:ports>
Nov 13 18:59:37 user nova-compute[75216]:         <nova:port uuid="c26beff8-370e-431e-9a8c-d31c4ec912ec">
Nov 13 18:59:37 user nova-compute[75216]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 13 18:59:37 user nova-compute[75216]:         </nova:port>
Nov 13 18:59:37 user nova-compute[75216]:       </nova:ports>
Nov 13 18:59:37 user nova-compute[75216]:     </nova:instance>
Nov 13 18:59:37 user nova-compute[75216]:   </metadata>
Nov 13 18:59:37 user nova-compute[75216]:   <sysinfo type="smbios">
Nov 13 18:59:37 user nova-compute[75216]:     <system>
Nov 13 18:59:37 user nova-compute[75216]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 18:59:37 user nova-compute[75216]:       <entry name="product">OpenStack Nova</entry>
Nov 13 18:59:37 user nova-compute[75216]:       <entry name="version">0.0.0</entry>
Nov 13 18:59:37 user nova-compute[75216]:       <entry name="serial">af8089f7-6dc3-4655-9369-2177dbd7bf4d</entry>
Nov 13 18:59:37 user nova-compute[75216]:       <entry name="uuid">af8089f7-6dc3-4655-9369-2177dbd7bf4d</entry>
Nov 13 18:59:37 user nova-compute[75216]:       <entry name="family">Virtual Machine</entry>
Nov 13 18:59:37 user nova-compute[75216]:     </system>
Nov 13 18:59:37 user nova-compute[75216]:   </sysinfo>
Nov 13 18:59:37 user nova-compute[75216]:   <os>
Nov 13 18:59:37 user nova-compute[75216]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 18:59:37 user nova-compute[75216]:     <boot dev="hd"/>
Nov 13 18:59:37 user nova-compute[75216]:     <smbios mode="sysinfo"/>
Nov 13 18:59:37 user nova-compute[75216]:   </os>
Nov 13 18:59:37 user nova-compute[75216]:   <features>
Nov 13 18:59:37 user nova-compute[75216]:     <acpi/>
Nov 13 18:59:37 user nova-compute[75216]:     <apic/>
Nov 13 18:59:37 user nova-compute[75216]:     <vmcoreinfo/>
Nov 13 18:59:37 user nova-compute[75216]:   </features>
Nov 13 18:59:37 user nova-compute[75216]:   <clock offset="utc">
Nov 13 18:59:37 user nova-compute[75216]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 18:59:37 user nova-compute[75216]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 18:59:37 user nova-compute[75216]:     <timer name="hpet" present="no"/>
Nov 13 18:59:37 user nova-compute[75216]:   </clock>
Nov 13 18:59:37 user nova-compute[75216]:   <cpu mode="custom" match="exact">
Nov 13 18:59:37 user nova-compute[75216]:     <model>Nehalem</model>
Nov 13 18:59:37 user nova-compute[75216]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 18:59:37 user nova-compute[75216]:   </cpu>
Nov 13 18:59:37 user nova-compute[75216]:   <devices>
Nov 13 18:59:37 user nova-compute[75216]:     <disk type="file" device="disk">
Nov 13 18:59:37 user nova-compute[75216]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 18:59:37 user nova-compute[75216]:       <source file="/opt/stack/data/nova/instances/af8089f7-6dc3-4655-9369-2177dbd7bf4d/disk"/>
Nov 13 18:59:37 user nova-compute[75216]:       <target dev="vda" bus="virtio"/>
Nov 13 18:59:37 user nova-compute[75216]:     </disk>
Nov 13 18:59:37 user nova-compute[75216]:     <interface type="ethernet">
Nov 13 18:59:37 user nova-compute[75216]:       <mac address="fa:16:3e:03:83:09"/>
Nov 13 18:59:37 user nova-compute[75216]:       <model type="virtio"/>
Nov 13 18:59:37 user nova-compute[75216]:       <mtu size="1442"/>
Nov 13 18:59:37 user nova-compute[75216]:       <target dev="tapc26beff8-37"/>
Nov 13 18:59:37 user nova-compute[75216]:     </interface>
Nov 13 18:59:37 user nova-compute[75216]:     <serial type="pty">
Nov 13 18:59:37 user nova-compute[75216]:       <log file="/opt/stack/data/nova/instances/af8089f7-6dc3-4655-9369-2177dbd7bf4d/console.log" append="off"/>
Nov 13 18:59:37 user nova-compute[75216]:     </serial>
Nov 13 18:59:37 user nova-compute[75216]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 18:59:37 user nova-compute[75216]:     <video>
Nov 13 18:59:37 user nova-compute[75216]:       <model type="virtio"/>
Nov 13 18:59:37 user nova-compute[75216]:     </video>
Nov 13 18:59:37 user nova-compute[75216]:     <rng model="virtio">
Nov 13 18:59:37 user nova-compute[75216]:       <backend model="random">/dev/urandom</backend>
Nov 13 18:59:37 user nova-compute[75216]:     </rng>
Nov 13 18:59:37 user nova-compute[75216]:     <controller type="usb" index="0" model="none"/>
Nov 13 18:59:37 user nova-compute[75216]:     <memballoon model="virtio">
Nov 13 18:59:37 user nova-compute[75216]:       <stats period="10"/>
Nov 13 18:59:37 user nova-compute[75216]:     </memballoon>
Nov 13 18:59:37 user nova-compute[75216]:   </devices>
Nov 13 18:59:37 user nova-compute[75216]: </domain>
Nov 13 18:59:37 user nova-compute[75216]:  {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 18:59:37 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-af921e50-97b8-4f5a-a083-4cb0f596a88d tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T18:59:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-780279528',display_name='tempest-TestMinimumBasicScenario-server-780279528',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-780279528',id=27,image_ref='c1c8eeb9-2ea4-4665-94c5-b399df123710',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMkFC1l0t0GBOtzT2bLiJ8lAjyzCHTdr7Xj4oBWrTAaMd1//fCspfw4r2vuGqo9b1iSdtFSJATkMSuJELCx7MDHe2xx0PHl1FK/K0yjaXgUddzBQSnf3lRM5pnUKjvgUNg==',key_name='tempest-TestMinimumBasicScenario-1870399637',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='84d0223a97ff4ecab9bf4273e3e465a9',ramdisk_id='',reservation_id='r-902ox0es',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c1c8eeb9-2ea4-4665-94c5-b399df123710',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1197015828',owner_user_name='tempest-TestMinimumBasicScenario-1197015828-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T18:59:35Z,user_data=None,user_id='83cc10163cd04fffb40b36e6c0cdd484',uuid=af8089f7-6dc3-4655-9369-2177dbd7bf4d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c26beff8-370e-431e-9a8c-d31c4ec912ec", "address": "fa:16:3e:03:83:09", "network": {"id": "fea11c73-0074-4971-8b36-0aced430c730", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1420832282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84d0223a97ff4ecab9bf4273e3e465a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc26beff8-37", "ovs_interfaceid": "c26beff8-370e-431e-9a8c-d31c4ec912ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 18:59:37 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-af921e50-97b8-4f5a-a083-4cb0f596a88d tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Converting VIF {"id": "c26beff8-370e-431e-9a8c-d31c4ec912ec", "address": "fa:16:3e:03:83:09", "network": {"id": "fea11c73-0074-4971-8b36-0aced430c730", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1420832282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84d0223a97ff4ecab9bf4273e3e465a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc26beff8-37", "ovs_interfaceid": "c26beff8-370e-431e-9a8c-d31c4ec912ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 18:59:37 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-af921e50-97b8-4f5a-a083-4cb0f596a88d tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:83:09,bridge_name='br-int',has_traffic_filtering=True,id=c26beff8-370e-431e-9a8c-d31c4ec912ec,network=Network(fea11c73-0074-4971-8b36-0aced430c730),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc26beff8-37') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 18:59:37 user nova-compute[75216]: DEBUG os_vif [None req-af921e50-97b8-4f5a-a083-4cb0f596a88d tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:83:09,bridge_name='br-int',has_traffic_filtering=True,id=c26beff8-370e-431e-9a8c-d31c4ec912ec,network=Network(fea11c73-0074-4971-8b36-0aced430c730),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc26beff8-37') {{(pid=75216) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 18:59:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:59:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:59:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 18:59:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:59:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '58ef5874-6898-5bb1-86c2-b3c19b34add6', '_type': 'linux-noop'}}, row=False) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:59:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:59:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:59:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:59:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc26beff8-37, may_exist=True, interface_attrs={}) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:59:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc26beff8-37, col_values=(('qos', UUID('c78e97cc-7005-4b13-a276-fc179dd7dfe5')),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:59:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc26beff8-37, col_values=(('external_ids', {'iface-id': 'c26beff8-370e-431e-9a8c-d31c4ec912ec', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:03:83:09', 'vm-uuid': 'af8089f7-6dc3-4655-9369-2177dbd7bf4d'}),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:59:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:59:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:59:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:59:37 user nova-compute[75216]: INFO os_vif [None req-af921e50-97b8-4f5a-a083-4cb0f596a88d tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:83:09,bridge_name='br-int',has_traffic_filtering=True,id=c26beff8-370e-431e-9a8c-d31c4ec912ec,network=Network(fea11c73-0074-4971-8b36-0aced430c730),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc26beff8-37')
Nov 13 18:59:37 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-af921e50-97b8-4f5a-a083-4cb0f596a88d tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 18:59:37 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-af921e50-97b8-4f5a-a083-4cb0f596a88d tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] No VIF found with MAC fa:16:3e:03:83:09, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 18:59:38 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:59:38 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:59:38 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:59:38 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:59:39 user nova-compute[75216]: DEBUG nova.compute.manager [req-8c9c6acf-7bea-446f-a52c-6c128d195c99 req-d8e2dad1-d8f9-4d8c-82cf-0b63fa6f1e1d service nova] [instance: af8089f7-6dc3-4655-9369-2177dbd7bf4d] Received event network-vif-plugged-c26beff8-370e-431e-9a8c-d31c4ec912ec {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:59:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-8c9c6acf-7bea-446f-a52c-6c128d195c99 req-d8e2dad1-d8f9-4d8c-82cf-0b63fa6f1e1d service nova] Acquiring lock "af8089f7-6dc3-4655-9369-2177dbd7bf4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:59:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-8c9c6acf-7bea-446f-a52c-6c128d195c99 req-d8e2dad1-d8f9-4d8c-82cf-0b63fa6f1e1d service nova] Lock "af8089f7-6dc3-4655-9369-2177dbd7bf4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:59:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-8c9c6acf-7bea-446f-a52c-6c128d195c99 req-d8e2dad1-d8f9-4d8c-82cf-0b63fa6f1e1d service nova] Lock "af8089f7-6dc3-4655-9369-2177dbd7bf4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:59:39 user nova-compute[75216]: DEBUG nova.compute.manager [req-8c9c6acf-7bea-446f-a52c-6c128d195c99 req-d8e2dad1-d8f9-4d8c-82cf-0b63fa6f1e1d service nova] [instance: af8089f7-6dc3-4655-9369-2177dbd7bf4d] No waiting events found dispatching network-vif-plugged-c26beff8-370e-431e-9a8c-d31c4ec912ec {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:59:39 user nova-compute[75216]: WARNING nova.compute.manager [req-8c9c6acf-7bea-446f-a52c-6c128d195c99 req-d8e2dad1-d8f9-4d8c-82cf-0b63fa6f1e1d service nova] [instance: af8089f7-6dc3-4655-9369-2177dbd7bf4d] Received unexpected event network-vif-plugged-c26beff8-370e-431e-9a8c-d31c4ec912ec for instance with vm_state building and task_state spawning.
Nov 13 18:59:39 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:59:39 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:59:39 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:59:39 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:59:39 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:59:40 user nova-compute[75216]: DEBUG nova.compute.manager [None req-af921e50-97b8-4f5a-a083-4cb0f596a88d tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] [instance: af8089f7-6dc3-4655-9369-2177dbd7bf4d] Instance event wait completed in 0 seconds for  {{(pid=75216) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 18:59:40 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-af921e50-97b8-4f5a-a083-4cb0f596a88d tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] [instance: af8089f7-6dc3-4655-9369-2177dbd7bf4d] Guest created on hypervisor {{(pid=75216) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 18:59:40 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: af8089f7-6dc3-4655-9369-2177dbd7bf4d] Instance spawned successfully.
Nov 13 18:59:40 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-af921e50-97b8-4f5a-a083-4cb0f596a88d tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] [instance: af8089f7-6dc3-4655-9369-2177dbd7bf4d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 18:59:40 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-af921e50-97b8-4f5a-a083-4cb0f596a88d tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] [instance: af8089f7-6dc3-4655-9369-2177dbd7bf4d] Found default for hw_cdrom_bus of ide {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 18:59:40 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-af921e50-97b8-4f5a-a083-4cb0f596a88d tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] [instance: af8089f7-6dc3-4655-9369-2177dbd7bf4d] Found default for hw_disk_bus of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 18:59:40 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-af921e50-97b8-4f5a-a083-4cb0f596a88d tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] [instance: af8089f7-6dc3-4655-9369-2177dbd7bf4d] Found default for hw_input_bus of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 18:59:40 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-af921e50-97b8-4f5a-a083-4cb0f596a88d tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] [instance: af8089f7-6dc3-4655-9369-2177dbd7bf4d] Found default for hw_pointer_model of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 18:59:40 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-af921e50-97b8-4f5a-a083-4cb0f596a88d tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] [instance: af8089f7-6dc3-4655-9369-2177dbd7bf4d] Found default for hw_video_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 18:59:40 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-af921e50-97b8-4f5a-a083-4cb0f596a88d tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] [instance: af8089f7-6dc3-4655-9369-2177dbd7bf4d] Found default for hw_vif_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 18:59:41 user nova-compute[75216]: INFO nova.compute.manager [None req-af921e50-97b8-4f5a-a083-4cb0f596a88d tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] [instance: af8089f7-6dc3-4655-9369-2177dbd7bf4d] Took 5.88 seconds to spawn the instance on the hypervisor.
Nov 13 18:59:41 user nova-compute[75216]: DEBUG nova.compute.manager [None req-af921e50-97b8-4f5a-a083-4cb0f596a88d tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] [instance: af8089f7-6dc3-4655-9369-2177dbd7bf4d] Checking state {{(pid=75216) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 18:59:41 user nova-compute[75216]: INFO nova.compute.manager [None req-af921e50-97b8-4f5a-a083-4cb0f596a88d tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] [instance: af8089f7-6dc3-4655-9369-2177dbd7bf4d] Took 6.60 seconds to build instance.
Nov 13 18:59:41 user nova-compute[75216]: DEBUG nova.compute.manager [req-9acabd58-f8d3-4621-937a-617bb1cf5bc6 req-42076dfc-1c67-4971-9983-436f998b85c3 service nova] [instance: af8089f7-6dc3-4655-9369-2177dbd7bf4d] Received event network-vif-plugged-c26beff8-370e-431e-9a8c-d31c4ec912ec {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:59:41 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-9acabd58-f8d3-4621-937a-617bb1cf5bc6 req-42076dfc-1c67-4971-9983-436f998b85c3 service nova] Acquiring lock "af8089f7-6dc3-4655-9369-2177dbd7bf4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:59:41 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-9acabd58-f8d3-4621-937a-617bb1cf5bc6 req-42076dfc-1c67-4971-9983-436f998b85c3 service nova] Lock "af8089f7-6dc3-4655-9369-2177dbd7bf4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:59:41 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-9acabd58-f8d3-4621-937a-617bb1cf5bc6 req-42076dfc-1c67-4971-9983-436f998b85c3 service nova] Lock "af8089f7-6dc3-4655-9369-2177dbd7bf4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:59:41 user nova-compute[75216]: DEBUG nova.compute.manager [req-9acabd58-f8d3-4621-937a-617bb1cf5bc6 req-42076dfc-1c67-4971-9983-436f998b85c3 service nova] [instance: af8089f7-6dc3-4655-9369-2177dbd7bf4d] No waiting events found dispatching network-vif-plugged-c26beff8-370e-431e-9a8c-d31c4ec912ec {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:59:41 user nova-compute[75216]: WARNING nova.compute.manager [req-9acabd58-f8d3-4621-937a-617bb1cf5bc6 req-42076dfc-1c67-4971-9983-436f998b85c3 service nova] [instance: af8089f7-6dc3-4655-9369-2177dbd7bf4d] Received unexpected event network-vif-plugged-c26beff8-370e-431e-9a8c-d31c4ec912ec for instance with vm_state active and task_state None.
Nov 13 18:59:41 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-af921e50-97b8-4f5a-a083-4cb0f596a88d tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Lock "af8089f7-6dc3-4655-9369-2177dbd7bf4d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.712s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:59:42 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:59:43 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:59:47 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:59:48 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:59:50 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-18a59b2d-d43d-43b1-b5dd-c5b4e1f81b5a tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Acquiring lock "2f074d68-d0a7-4204-a79d-be619ee42d0c" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:59:50 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-18a59b2d-d43d-43b1-b5dd-c5b4e1f81b5a tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Lock "2f074d68-d0a7-4204-a79d-be619ee42d0c" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:59:50 user nova-compute[75216]: DEBUG nova.compute.manager [None req-18a59b2d-d43d-43b1-b5dd-c5b4e1f81b5a tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: 2f074d68-d0a7-4204-a79d-be619ee42d0c] Going to confirm migration 2 {{(pid=75216) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4774}}
Nov 13 18:59:50 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-18a59b2d-d43d-43b1-b5dd-c5b4e1f81b5a tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Acquiring lock "refresh_cache-2f074d68-d0a7-4204-a79d-be619ee42d0c" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 18:59:50 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-18a59b2d-d43d-43b1-b5dd-c5b4e1f81b5a tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Acquired lock "refresh_cache-2f074d68-d0a7-4204-a79d-be619ee42d0c" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 18:59:50 user nova-compute[75216]: DEBUG nova.network.neutron [None req-18a59b2d-d43d-43b1-b5dd-c5b4e1f81b5a tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: 2f074d68-d0a7-4204-a79d-be619ee42d0c] Building network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 18:59:50 user nova-compute[75216]: DEBUG nova.objects.instance [None req-18a59b2d-d43d-43b1-b5dd-c5b4e1f81b5a tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Lazy-loading 'info_cache' on Instance uuid 2f074d68-d0a7-4204-a79d-be619ee42d0c {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 18:59:50 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:59:50 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:59:50 user nova-compute[75216]: DEBUG nova.network.neutron [None req-18a59b2d-d43d-43b1-b5dd-c5b4e1f81b5a tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: 2f074d68-d0a7-4204-a79d-be619ee42d0c] Updating instance_info_cache with network_info: [{"id": "3d9260c2-c8da-47b8-884c-8c66259c7c2b", "address": "fa:16:3e:12:97:81", "network": {"id": "d7a691f0-4495-40ad-a349-91b5dc9c635a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-961583097-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9b7e11038e54e368acd22d06e54a351", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d9260c2-c8", "ovs_interfaceid": "3d9260c2-c8da-47b8-884c-8c66259c7c2b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 18:59:50 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-18a59b2d-d43d-43b1-b5dd-c5b4e1f81b5a tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Releasing lock "refresh_cache-2f074d68-d0a7-4204-a79d-be619ee42d0c" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 18:59:50 user nova-compute[75216]: DEBUG nova.objects.instance [None req-18a59b2d-d43d-43b1-b5dd-c5b4e1f81b5a tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Lazy-loading 'migration_context' on Instance uuid 2f074d68-d0a7-4204-a79d-be619ee42d0c {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 18:59:50 user nova-compute[75216]: DEBUG nova.objects.base [None req-18a59b2d-d43d-43b1-b5dd-c5b4e1f81b5a tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Object Instance<2f074d68-d0a7-4204-a79d-be619ee42d0c> lazy-loaded attributes: info_cache,migration_context {{(pid=75216) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 18:59:50 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-18a59b2d-d43d-43b1-b5dd-c5b4e1f81b5a tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:59:50 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-18a59b2d-d43d-43b1-b5dd-c5b4e1f81b5a tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:59:51 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-18a59b2d-d43d-43b1-b5dd-c5b4e1f81b5a tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 18:59:51 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-18a59b2d-d43d-43b1-b5dd-c5b4e1f81b5a tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 18:59:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-18a59b2d-d43d-43b1-b5dd-c5b4e1f81b5a tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.389s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:59:51 user nova-compute[75216]: INFO nova.scheduler.client.report [None req-18a59b2d-d43d-43b1-b5dd-c5b4e1f81b5a tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Deleted allocation for migration cb47afd3-5c76-48c9-aaa1-4aaeb4bc442a
Nov 13 18:59:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-18a59b2d-d43d-43b1-b5dd-c5b4e1f81b5a tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Lock "2f074d68-d0a7-4204-a79d-be619ee42d0c" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.314s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:59:52 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1bf3c186-f1c9-4386-ad2e-1364388061dd tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Acquiring lock "d9a1edfb-c2ac-4e67-abac-c915ea22a15c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:59:52 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1bf3c186-f1c9-4386-ad2e-1364388061dd tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Lock "d9a1edfb-c2ac-4e67-abac-c915ea22a15c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:59:52 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1bf3c186-f1c9-4386-ad2e-1364388061dd tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Acquiring lock "d9a1edfb-c2ac-4e67-abac-c915ea22a15c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:59:52 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1bf3c186-f1c9-4386-ad2e-1364388061dd tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Lock "d9a1edfb-c2ac-4e67-abac-c915ea22a15c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:59:52 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1bf3c186-f1c9-4386-ad2e-1364388061dd tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Lock "d9a1edfb-c2ac-4e67-abac-c915ea22a15c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:59:52 user nova-compute[75216]: INFO nova.compute.manager [None req-1bf3c186-f1c9-4386-ad2e-1364388061dd tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] [instance: d9a1edfb-c2ac-4e67-abac-c915ea22a15c] Terminating instance
Nov 13 18:59:52 user nova-compute[75216]: DEBUG nova.compute.manager [None req-1bf3c186-f1c9-4386-ad2e-1364388061dd tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] [instance: d9a1edfb-c2ac-4e67-abac-c915ea22a15c] Start destroying the instance on the hypervisor. {{(pid=75216) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 18:59:52 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:59:52 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:59:52 user nova-compute[75216]: DEBUG nova.compute.manager [req-2c02ad31-cbde-413a-8c29-d397591a9891 req-aea2af63-d961-40df-a431-b17999d0eacb service nova] [instance: d9a1edfb-c2ac-4e67-abac-c915ea22a15c] Received event network-vif-unplugged-eb2895a9-124a-4504-b197-bb2022f3f55f {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:59:52 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-2c02ad31-cbde-413a-8c29-d397591a9891 req-aea2af63-d961-40df-a431-b17999d0eacb service nova] Acquiring lock "d9a1edfb-c2ac-4e67-abac-c915ea22a15c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:59:52 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-2c02ad31-cbde-413a-8c29-d397591a9891 req-aea2af63-d961-40df-a431-b17999d0eacb service nova] Lock "d9a1edfb-c2ac-4e67-abac-c915ea22a15c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:59:52 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-2c02ad31-cbde-413a-8c29-d397591a9891 req-aea2af63-d961-40df-a431-b17999d0eacb service nova] Lock "d9a1edfb-c2ac-4e67-abac-c915ea22a15c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:59:52 user nova-compute[75216]: DEBUG nova.compute.manager [req-2c02ad31-cbde-413a-8c29-d397591a9891 req-aea2af63-d961-40df-a431-b17999d0eacb service nova] [instance: d9a1edfb-c2ac-4e67-abac-c915ea22a15c] No waiting events found dispatching network-vif-unplugged-eb2895a9-124a-4504-b197-bb2022f3f55f {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:59:52 user nova-compute[75216]: DEBUG nova.compute.manager [req-2c02ad31-cbde-413a-8c29-d397591a9891 req-aea2af63-d961-40df-a431-b17999d0eacb service nova] [instance: d9a1edfb-c2ac-4e67-abac-c915ea22a15c] Received event network-vif-unplugged-eb2895a9-124a-4504-b197-bb2022f3f55f for instance with task_state deleting. {{(pid=75216) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 18:59:52 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:59:52 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:59:52 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:59:52 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: d9a1edfb-c2ac-4e67-abac-c915ea22a15c] Instance destroyed successfully.
Nov 13 18:59:52 user nova-compute[75216]: DEBUG nova.objects.instance [None req-1bf3c186-f1c9-4386-ad2e-1364388061dd tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Lazy-loading 'resources' on Instance uuid d9a1edfb-c2ac-4e67-abac-c915ea22a15c {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 18:59:52 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-1bf3c186-f1c9-4386-ad2e-1364388061dd tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T18:53:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-592596084',display_name='tempest-ServerRescueNegativeTestJSON-server-592596084',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-592596084',id=21,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK+2PkxKKa7trQ91oahynfsb+ED4eBrX/gngy0uUVn/I9HNQHRE/MYLJgkcv2KjmmoqwoAll/FQqq9eo5uxBEri6NDF/QBB2CwxMJWgUT8869feJBRIceiVszXyooPeT3Q==',key_name='tempest-keypair-1092347516',keypairs=<?>,launch_index=0,launched_at=2023-11-13T18:55:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2efafc26c47c4050bd367c47469999fb',ramdisk_id='',reservation_id='r-5rr602jn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-165310019',owner_user_name='tempest-ServerRescueNegativeTestJSON-165310019-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T18:57:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3587565f5b56450e95f2bd572d7e4f88',uuid=d9a1edfb-c2ac-4e67-abac-c915ea22a15c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eb2895a9-124a-4504-b197-bb2022f3f55f", "address": "fa:16:3e:8d:84:60", "network": {"id": "6d182db1-03b5-4d1b-86cf-b9367921b7b0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1877006951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2efafc26c47c4050bd367c47469999fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb2895a9-12", "ovs_interfaceid": "eb2895a9-124a-4504-b197-bb2022f3f55f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 18:59:52 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-1bf3c186-f1c9-4386-ad2e-1364388061dd tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Converting VIF {"id": "eb2895a9-124a-4504-b197-bb2022f3f55f", "address": "fa:16:3e:8d:84:60", "network": {"id": "6d182db1-03b5-4d1b-86cf-b9367921b7b0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1877006951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2efafc26c47c4050bd367c47469999fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb2895a9-12", "ovs_interfaceid": "eb2895a9-124a-4504-b197-bb2022f3f55f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 18:59:52 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-1bf3c186-f1c9-4386-ad2e-1364388061dd tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8d:84:60,bridge_name='br-int',has_traffic_filtering=True,id=eb2895a9-124a-4504-b197-bb2022f3f55f,network=Network(6d182db1-03b5-4d1b-86cf-b9367921b7b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb2895a9-12') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 18:59:52 user nova-compute[75216]: DEBUG os_vif [None req-1bf3c186-f1c9-4386-ad2e-1364388061dd tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8d:84:60,bridge_name='br-int',has_traffic_filtering=True,id=eb2895a9-124a-4504-b197-bb2022f3f55f,network=Network(6d182db1-03b5-4d1b-86cf-b9367921b7b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb2895a9-12') {{(pid=75216) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 18:59:52 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:59:52 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapeb2895a9-12, bridge=br-int, if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:59:52 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:59:52 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:59:52 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:59:52 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=67dd2b28-2adf-4fbb-8eaa-70bc35558799) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:59:52 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:59:52 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:59:52 user nova-compute[75216]: INFO os_vif [None req-1bf3c186-f1c9-4386-ad2e-1364388061dd tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8d:84:60,bridge_name='br-int',has_traffic_filtering=True,id=eb2895a9-124a-4504-b197-bb2022f3f55f,network=Network(6d182db1-03b5-4d1b-86cf-b9367921b7b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb2895a9-12')
Nov 13 18:59:52 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-1bf3c186-f1c9-4386-ad2e-1364388061dd tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] [instance: d9a1edfb-c2ac-4e67-abac-c915ea22a15c] Deleting instance files /opt/stack/data/nova/instances/d9a1edfb-c2ac-4e67-abac-c915ea22a15c_del
Nov 13 18:59:52 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-1bf3c186-f1c9-4386-ad2e-1364388061dd tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] [instance: d9a1edfb-c2ac-4e67-abac-c915ea22a15c] Deletion of /opt/stack/data/nova/instances/d9a1edfb-c2ac-4e67-abac-c915ea22a15c_del complete
Nov 13 18:59:52 user nova-compute[75216]: INFO nova.compute.manager [None req-1bf3c186-f1c9-4386-ad2e-1364388061dd tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] [instance: d9a1edfb-c2ac-4e67-abac-c915ea22a15c] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 13 18:59:52 user nova-compute[75216]: DEBUG oslo.service.loopingcall [None req-1bf3c186-f1c9-4386-ad2e-1364388061dd tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75216) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 18:59:52 user nova-compute[75216]: DEBUG nova.compute.manager [-] [instance: d9a1edfb-c2ac-4e67-abac-c915ea22a15c] Deallocating network for instance {{(pid=75216) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 18:59:52 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: d9a1edfb-c2ac-4e67-abac-c915ea22a15c] deallocate_for_instance() {{(pid=75216) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 18:59:53 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:59:53 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:59:53 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: d9a1edfb-c2ac-4e67-abac-c915ea22a15c] Updating instance_info_cache with network_info: [] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 18:59:53 user nova-compute[75216]: INFO nova.compute.manager [-] [instance: d9a1edfb-c2ac-4e67-abac-c915ea22a15c] Took 0.59 seconds to deallocate network for instance.
Nov 13 18:59:53 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1bf3c186-f1c9-4386-ad2e-1364388061dd tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:59:53 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1bf3c186-f1c9-4386-ad2e-1364388061dd tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:59:53 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:59:53 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-1bf3c186-f1c9-4386-ad2e-1364388061dd tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 18:59:54 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-1bf3c186-f1c9-4386-ad2e-1364388061dd tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 18:59:54 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1bf3c186-f1c9-4386-ad2e-1364388061dd tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.449s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:59:54 user nova-compute[75216]: INFO nova.scheduler.client.report [None req-1bf3c186-f1c9-4386-ad2e-1364388061dd tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Deleted allocations for instance d9a1edfb-c2ac-4e67-abac-c915ea22a15c
Nov 13 18:59:54 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1bf3c186-f1c9-4386-ad2e-1364388061dd tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Lock "d9a1edfb-c2ac-4e67-abac-c915ea22a15c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.326s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:59:54 user nova-compute[75216]: DEBUG nova.compute.manager [req-5982ec82-98d4-4a81-9b5c-2386835678e5 req-997d9e8e-6dce-4f94-9fa9-a0f5ab6d72a0 service nova] [instance: d9a1edfb-c2ac-4e67-abac-c915ea22a15c] Received event network-vif-plugged-eb2895a9-124a-4504-b197-bb2022f3f55f {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:59:54 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-5982ec82-98d4-4a81-9b5c-2386835678e5 req-997d9e8e-6dce-4f94-9fa9-a0f5ab6d72a0 service nova] Acquiring lock "d9a1edfb-c2ac-4e67-abac-c915ea22a15c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:59:54 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-5982ec82-98d4-4a81-9b5c-2386835678e5 req-997d9e8e-6dce-4f94-9fa9-a0f5ab6d72a0 service nova] Lock "d9a1edfb-c2ac-4e67-abac-c915ea22a15c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:59:54 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-5982ec82-98d4-4a81-9b5c-2386835678e5 req-997d9e8e-6dce-4f94-9fa9-a0f5ab6d72a0 service nova] Lock "d9a1edfb-c2ac-4e67-abac-c915ea22a15c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:59:54 user nova-compute[75216]: DEBUG nova.compute.manager [req-5982ec82-98d4-4a81-9b5c-2386835678e5 req-997d9e8e-6dce-4f94-9fa9-a0f5ab6d72a0 service nova] [instance: d9a1edfb-c2ac-4e67-abac-c915ea22a15c] No waiting events found dispatching network-vif-plugged-eb2895a9-124a-4504-b197-bb2022f3f55f {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:59:54 user nova-compute[75216]: WARNING nova.compute.manager [req-5982ec82-98d4-4a81-9b5c-2386835678e5 req-997d9e8e-6dce-4f94-9fa9-a0f5ab6d72a0 service nova] [instance: d9a1edfb-c2ac-4e67-abac-c915ea22a15c] Received unexpected event network-vif-plugged-eb2895a9-124a-4504-b197-bb2022f3f55f for instance with vm_state deleted and task_state None.
Nov 13 18:59:54 user nova-compute[75216]: DEBUG nova.compute.manager [req-5982ec82-98d4-4a81-9b5c-2386835678e5 req-997d9e8e-6dce-4f94-9fa9-a0f5ab6d72a0 service nova] [instance: d9a1edfb-c2ac-4e67-abac-c915ea22a15c] Received event network-vif-deleted-eb2895a9-124a-4504-b197-bb2022f3f55f {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:59:55 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:59:55 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75216) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 18:59:55 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:59:55 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:59:55 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:59:55 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:59:55 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Auditing locally available compute resources for user (node: user) {{(pid=75216) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 18:59:55 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 18:59:55 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a3e849-6570-4820-97c8-75468b5bea4f/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:59:55 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a3e849-6570-4820-97c8-75468b5bea4f/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:59:55 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a3e849-6570-4820-97c8-75468b5bea4f/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:59:55 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a3e849-6570-4820-97c8-75468b5bea4f/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:59:55 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14d378b0-79ba-4161-a795-6288939c6fef/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:59:56 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14d378b0-79ba-4161-a795-6288939c6fef/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:59:56 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14d378b0-79ba-4161-a795-6288939c6fef/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:59:56 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14d378b0-79ba-4161-a795-6288939c6fef/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:59:56 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 18:59:56 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d589d57e-de50-482a-843f-e8246b3d7528/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:59:56 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d589d57e-de50-482a-843f-e8246b3d7528/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:59:56 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d589d57e-de50-482a-843f-e8246b3d7528/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:59:56 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d589d57e-de50-482a-843f-e8246b3d7528/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:59:56 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:59:56 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:59:56 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:59:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:59:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71134725-e6cc-4426-b2c2-5be4991c53f7/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:59:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71134725-e6cc-4426-b2c2-5be4991c53f7/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:59:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71134725-e6cc-4426-b2c2-5be4991c53f7/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:59:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71134725-e6cc-4426-b2c2-5be4991c53f7/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:59:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af8089f7-6dc3-4655-9369-2177dbd7bf4d/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:59:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af8089f7-6dc3-4655-9369-2177dbd7bf4d/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:59:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af8089f7-6dc3-4655-9369-2177dbd7bf4d/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:59:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af8089f7-6dc3-4655-9369-2177dbd7bf4d/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:59:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85624c58-6c72-4490-8a3e-547953295ade/disk.rescue --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:59:57 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:59:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85624c58-6c72-4490-8a3e-547953295ade/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:59:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85624c58-6c72-4490-8a3e-547953295ade/disk.rescue --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:59:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85624c58-6c72-4490-8a3e-547953295ade/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:59:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85624c58-6c72-4490-8a3e-547953295ade/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:59:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85624c58-6c72-4490-8a3e-547953295ade/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:59:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85624c58-6c72-4490-8a3e-547953295ade/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:59:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85624c58-6c72-4490-8a3e-547953295ade/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:59:58 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:59:58 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 18:59:58 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 18:59:58 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Hypervisor/Node resource view: name=user free_ram=7823MB free_disk=25.31749725341797GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75216) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 18:59:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:59:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:59:59 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance a1a3e849-6570-4820-97c8-75468b5bea4f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 18:59:59 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance d589d57e-de50-482a-843f-e8246b3d7528 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 18:59:59 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance 85624c58-6c72-4490-8a3e-547953295ade actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 18:59:59 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance 14d378b0-79ba-4161-a795-6288939c6fef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 18:59:59 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 18:59:59 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance 1e5f1164-a15e-40cf-b7bc-5aeb404a1216 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 18:59:59 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance 2f074d68-d0a7-4204-a79d-be619ee42d0c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 18:59:59 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance 71134725-e6cc-4426-b2c2-5be4991c53f7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 18:59:59 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance af8089f7-6dc3-4655-9369-2177dbd7bf4d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 18:59:59 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 18:59:59 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 18:59:59 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 18:59:59 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 18:59:59 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Compute_service record updated for user:user {{(pid=75216) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 18:59:59 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.508s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:00:00 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:00:00 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Starting heal instance info cache {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 19:00:00 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "refresh_cache-14d378b0-79ba-4161-a795-6288939c6fef" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 19:00:00 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquired lock "refresh_cache-14d378b0-79ba-4161-a795-6288939c6fef" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 19:00:00 user nova-compute[75216]: DEBUG nova.network.neutron [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: 14d378b0-79ba-4161-a795-6288939c6fef] Forcefully refreshing network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 19:00:01 user nova-compute[75216]: DEBUG nova.network.neutron [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: 14d378b0-79ba-4161-a795-6288939c6fef] Updating instance_info_cache with network_info: [{"id": "7ac04b47-1761-46fb-8193-7eb1dd278710", "address": "fa:16:3e:6e:00:d7", "network": {"id": "bf647e60-7de3-41d4-abe5-a8ddf56be0f2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2101256065-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a847a509c4d34004a89158b45ec469fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ac04b47-17", "ovs_interfaceid": "7ac04b47-1761-46fb-8193-7eb1dd278710", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:00:01 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Releasing lock "refresh_cache-14d378b0-79ba-4161-a795-6288939c6fef" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 19:00:01 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: 14d378b0-79ba-4161-a795-6288939c6fef] Updated the network info_cache for instance {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 19:00:01 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:00:01 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:00:02 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:00:03 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:00:07 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:00:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:00:12 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:00:13 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:00:17 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:00:22 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:00:27 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:00:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:00:37 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-d70fc5e1-587d-46a9-a475-f0fb03e9e94e tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] Acquiring lock "14d378b0-79ba-4161-a795-6288939c6fef" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:00:37 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-d70fc5e1-587d-46a9-a475-f0fb03e9e94e tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] Lock "14d378b0-79ba-4161-a795-6288939c6fef" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:00:37 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-d70fc5e1-587d-46a9-a475-f0fb03e9e94e tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] Acquiring lock "14d378b0-79ba-4161-a795-6288939c6fef-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:00:37 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-d70fc5e1-587d-46a9-a475-f0fb03e9e94e tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] Lock "14d378b0-79ba-4161-a795-6288939c6fef-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:00:37 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-d70fc5e1-587d-46a9-a475-f0fb03e9e94e tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] Lock "14d378b0-79ba-4161-a795-6288939c6fef-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:00:37 user nova-compute[75216]: INFO nova.compute.manager [None req-d70fc5e1-587d-46a9-a475-f0fb03e9e94e tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] [instance: 14d378b0-79ba-4161-a795-6288939c6fef] Terminating instance
Nov 13 19:00:37 user nova-compute[75216]: DEBUG nova.compute.manager [None req-d70fc5e1-587d-46a9-a475-f0fb03e9e94e tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] [instance: 14d378b0-79ba-4161-a795-6288939c6fef] Start destroying the instance on the hypervisor. {{(pid=75216) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 19:00:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:00:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:00:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:00:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:00:37 user nova-compute[75216]: DEBUG nova.compute.manager [req-dbe9e406-e7ca-4bfc-a20a-4083c4bc9a12 req-f4b9becb-cc59-4943-bfe2-0db1c966152c service nova] [instance: 14d378b0-79ba-4161-a795-6288939c6fef] Received event network-vif-unplugged-7ac04b47-1761-46fb-8193-7eb1dd278710 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:00:37 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-dbe9e406-e7ca-4bfc-a20a-4083c4bc9a12 req-f4b9becb-cc59-4943-bfe2-0db1c966152c service nova] Acquiring lock "14d378b0-79ba-4161-a795-6288939c6fef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:00:37 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-dbe9e406-e7ca-4bfc-a20a-4083c4bc9a12 req-f4b9becb-cc59-4943-bfe2-0db1c966152c service nova] Lock "14d378b0-79ba-4161-a795-6288939c6fef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:00:37 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-dbe9e406-e7ca-4bfc-a20a-4083c4bc9a12 req-f4b9becb-cc59-4943-bfe2-0db1c966152c service nova] Lock "14d378b0-79ba-4161-a795-6288939c6fef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:00:37 user nova-compute[75216]: DEBUG nova.compute.manager [req-dbe9e406-e7ca-4bfc-a20a-4083c4bc9a12 req-f4b9becb-cc59-4943-bfe2-0db1c966152c service nova] [instance: 14d378b0-79ba-4161-a795-6288939c6fef] No waiting events found dispatching network-vif-unplugged-7ac04b47-1761-46fb-8193-7eb1dd278710 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 19:00:37 user nova-compute[75216]: DEBUG nova.compute.manager [req-dbe9e406-e7ca-4bfc-a20a-4083c4bc9a12 req-f4b9becb-cc59-4943-bfe2-0db1c966152c service nova] [instance: 14d378b0-79ba-4161-a795-6288939c6fef] Received event network-vif-unplugged-7ac04b47-1761-46fb-8193-7eb1dd278710 for instance with task_state deleting. {{(pid=75216) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 19:00:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:00:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:00:37 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 14d378b0-79ba-4161-a795-6288939c6fef] Instance destroyed successfully.
Nov 13 19:00:37 user nova-compute[75216]: DEBUG nova.objects.instance [None req-d70fc5e1-587d-46a9-a475-f0fb03e9e94e tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] Lazy-loading 'resources' on Instance uuid 14d378b0-79ba-4161-a795-6288939c6fef {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:00:37 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-d70fc5e1-587d-46a9-a475-f0fb03e9e94e tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T18:51:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1612928989',display_name='tempest-ServersNegativeTestJSON-server-1612928989',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1612928989',id=19,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-13T18:52:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a847a509c4d34004a89158b45ec469fb',ramdisk_id='',reservation_id='r-hngd993m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-950650335',owner_user_name='tempest-ServersNegativeTestJSON-950650335-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T18:52:05Z,user_data=None,user_id='14638ac21d6f4b0e9fa526934c8eb7ea',uuid=14d378b0-79ba-4161-a795-6288939c6fef,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7ac04b47-1761-46fb-8193-7eb1dd278710", "address": "fa:16:3e:6e:00:d7", "network": {"id": "bf647e60-7de3-41d4-abe5-a8ddf56be0f2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2101256065-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a847a509c4d34004a89158b45ec469fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ac04b47-17", "ovs_interfaceid": "7ac04b47-1761-46fb-8193-7eb1dd278710", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 19:00:37 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-d70fc5e1-587d-46a9-a475-f0fb03e9e94e tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] Converting VIF {"id": "7ac04b47-1761-46fb-8193-7eb1dd278710", "address": "fa:16:3e:6e:00:d7", "network": {"id": "bf647e60-7de3-41d4-abe5-a8ddf56be0f2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2101256065-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a847a509c4d34004a89158b45ec469fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ac04b47-17", "ovs_interfaceid": "7ac04b47-1761-46fb-8193-7eb1dd278710", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 19:00:37 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-d70fc5e1-587d-46a9-a475-f0fb03e9e94e tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6e:00:d7,bridge_name='br-int',has_traffic_filtering=True,id=7ac04b47-1761-46fb-8193-7eb1dd278710,network=Network(bf647e60-7de3-41d4-abe5-a8ddf56be0f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ac04b47-17') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 19:00:37 user nova-compute[75216]: DEBUG os_vif [None req-d70fc5e1-587d-46a9-a475-f0fb03e9e94e tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6e:00:d7,bridge_name='br-int',has_traffic_filtering=True,id=7ac04b47-1761-46fb-8193-7eb1dd278710,network=Network(bf647e60-7de3-41d4-abe5-a8ddf56be0f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ac04b47-17') {{(pid=75216) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 19:00:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:00:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7ac04b47-17, bridge=br-int, if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:00:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:00:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:00:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:00:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9f1ef6b3-bc12-4a49-9782-69161429ab7b) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:00:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:00:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:00:37 user nova-compute[75216]: INFO os_vif [None req-d70fc5e1-587d-46a9-a475-f0fb03e9e94e tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6e:00:d7,bridge_name='br-int',has_traffic_filtering=True,id=7ac04b47-1761-46fb-8193-7eb1dd278710,network=Network(bf647e60-7de3-41d4-abe5-a8ddf56be0f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ac04b47-17')
Nov 13 19:00:37 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-d70fc5e1-587d-46a9-a475-f0fb03e9e94e tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] [instance: 14d378b0-79ba-4161-a795-6288939c6fef] Deleting instance files /opt/stack/data/nova/instances/14d378b0-79ba-4161-a795-6288939c6fef_del
Nov 13 19:00:37 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-d70fc5e1-587d-46a9-a475-f0fb03e9e94e tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] [instance: 14d378b0-79ba-4161-a795-6288939c6fef] Deletion of /opt/stack/data/nova/instances/14d378b0-79ba-4161-a795-6288939c6fef_del complete
Nov 13 19:00:38 user nova-compute[75216]: INFO nova.compute.manager [None req-d70fc5e1-587d-46a9-a475-f0fb03e9e94e tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] [instance: 14d378b0-79ba-4161-a795-6288939c6fef] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 13 19:00:38 user nova-compute[75216]: DEBUG oslo.service.loopingcall [None req-d70fc5e1-587d-46a9-a475-f0fb03e9e94e tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75216) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 19:00:38 user nova-compute[75216]: DEBUG nova.compute.manager [-] [instance: 14d378b0-79ba-4161-a795-6288939c6fef] Deallocating network for instance {{(pid=75216) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 19:00:38 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: 14d378b0-79ba-4161-a795-6288939c6fef] deallocate_for_instance() {{(pid=75216) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 19:00:38 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: 14d378b0-79ba-4161-a795-6288939c6fef] Updating instance_info_cache with network_info: [] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:00:38 user nova-compute[75216]: INFO nova.compute.manager [-] [instance: 14d378b0-79ba-4161-a795-6288939c6fef] Took 0.39 seconds to deallocate network for instance.
Nov 13 19:00:38 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-d70fc5e1-587d-46a9-a475-f0fb03e9e94e tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:00:38 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-d70fc5e1-587d-46a9-a475-f0fb03e9e94e tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:00:38 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-d70fc5e1-587d-46a9-a475-f0fb03e9e94e tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 19:00:38 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-d70fc5e1-587d-46a9-a475-f0fb03e9e94e tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 19:00:38 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-d70fc5e1-587d-46a9-a475-f0fb03e9e94e tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.269s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:00:38 user nova-compute[75216]: INFO nova.scheduler.client.report [None req-d70fc5e1-587d-46a9-a475-f0fb03e9e94e tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] Deleted allocations for instance 14d378b0-79ba-4161-a795-6288939c6fef
Nov 13 19:00:38 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-d70fc5e1-587d-46a9-a475-f0fb03e9e94e tempest-ServersNegativeTestJSON-950650335 tempest-ServersNegativeTestJSON-950650335-project-member] Lock "14d378b0-79ba-4161-a795-6288939c6fef" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.733s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:00:39 user nova-compute[75216]: DEBUG nova.compute.manager [req-b503ca1b-10e3-4d8d-8c5e-39005d478475 req-b7ec40b9-7119-4a2a-b972-2c3635d160c1 service nova] [instance: 14d378b0-79ba-4161-a795-6288939c6fef] Received event network-vif-plugged-7ac04b47-1761-46fb-8193-7eb1dd278710 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:00:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-b503ca1b-10e3-4d8d-8c5e-39005d478475 req-b7ec40b9-7119-4a2a-b972-2c3635d160c1 service nova] Acquiring lock "14d378b0-79ba-4161-a795-6288939c6fef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:00:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-b503ca1b-10e3-4d8d-8c5e-39005d478475 req-b7ec40b9-7119-4a2a-b972-2c3635d160c1 service nova] Lock "14d378b0-79ba-4161-a795-6288939c6fef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:00:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-b503ca1b-10e3-4d8d-8c5e-39005d478475 req-b7ec40b9-7119-4a2a-b972-2c3635d160c1 service nova] Lock "14d378b0-79ba-4161-a795-6288939c6fef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:00:39 user nova-compute[75216]: DEBUG nova.compute.manager [req-b503ca1b-10e3-4d8d-8c5e-39005d478475 req-b7ec40b9-7119-4a2a-b972-2c3635d160c1 service nova] [instance: 14d378b0-79ba-4161-a795-6288939c6fef] No waiting events found dispatching network-vif-plugged-7ac04b47-1761-46fb-8193-7eb1dd278710 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 19:00:39 user nova-compute[75216]: WARNING nova.compute.manager [req-b503ca1b-10e3-4d8d-8c5e-39005d478475 req-b7ec40b9-7119-4a2a-b972-2c3635d160c1 service nova] [instance: 14d378b0-79ba-4161-a795-6288939c6fef] Received unexpected event network-vif-plugged-7ac04b47-1761-46fb-8193-7eb1dd278710 for instance with vm_state deleted and task_state None.
Nov 13 19:00:39 user nova-compute[75216]: DEBUG nova.compute.manager [req-b503ca1b-10e3-4d8d-8c5e-39005d478475 req-b7ec40b9-7119-4a2a-b972-2c3635d160c1 service nova] [instance: 14d378b0-79ba-4161-a795-6288939c6fef] Received event network-vif-deleted-7ac04b47-1761-46fb-8193-7eb1dd278710 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:00:42 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:00:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-2abff3c8-cda5-4eb6-af57-084e7d17e6f2 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Acquiring lock "85624c58-6c72-4490-8a3e-547953295ade" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:00:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-2abff3c8-cda5-4eb6-af57-084e7d17e6f2 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Lock "85624c58-6c72-4490-8a3e-547953295ade" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:00:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-2abff3c8-cda5-4eb6-af57-084e7d17e6f2 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Acquiring lock "85624c58-6c72-4490-8a3e-547953295ade-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:00:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-2abff3c8-cda5-4eb6-af57-084e7d17e6f2 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Lock "85624c58-6c72-4490-8a3e-547953295ade-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:00:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-2abff3c8-cda5-4eb6-af57-084e7d17e6f2 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Lock "85624c58-6c72-4490-8a3e-547953295ade-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:00:45 user nova-compute[75216]: INFO nova.compute.manager [None req-2abff3c8-cda5-4eb6-af57-084e7d17e6f2 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] [instance: 85624c58-6c72-4490-8a3e-547953295ade] Terminating instance
Nov 13 19:00:45 user nova-compute[75216]: DEBUG nova.compute.manager [None req-2abff3c8-cda5-4eb6-af57-084e7d17e6f2 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] [instance: 85624c58-6c72-4490-8a3e-547953295ade] Start destroying the instance on the hypervisor. {{(pid=75216) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 19:00:45 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:00:45 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:00:45 user nova-compute[75216]: DEBUG nova.compute.manager [req-cc41894c-f453-494e-8634-e2858eadfbed req-a7e9f1b6-0cab-447c-9c2e-3cac1a5f53bc service nova] [instance: 85624c58-6c72-4490-8a3e-547953295ade] Received event network-vif-unplugged-51ccc958-5ce8-4e1d-8d28-f10c5ac288bd {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:00:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-cc41894c-f453-494e-8634-e2858eadfbed req-a7e9f1b6-0cab-447c-9c2e-3cac1a5f53bc service nova] Acquiring lock "85624c58-6c72-4490-8a3e-547953295ade-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:00:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-cc41894c-f453-494e-8634-e2858eadfbed req-a7e9f1b6-0cab-447c-9c2e-3cac1a5f53bc service nova] Lock "85624c58-6c72-4490-8a3e-547953295ade-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:00:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-cc41894c-f453-494e-8634-e2858eadfbed req-a7e9f1b6-0cab-447c-9c2e-3cac1a5f53bc service nova] Lock "85624c58-6c72-4490-8a3e-547953295ade-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:00:45 user nova-compute[75216]: DEBUG nova.compute.manager [req-cc41894c-f453-494e-8634-e2858eadfbed req-a7e9f1b6-0cab-447c-9c2e-3cac1a5f53bc service nova] [instance: 85624c58-6c72-4490-8a3e-547953295ade] No waiting events found dispatching network-vif-unplugged-51ccc958-5ce8-4e1d-8d28-f10c5ac288bd {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 19:00:45 user nova-compute[75216]: DEBUG nova.compute.manager [req-cc41894c-f453-494e-8634-e2858eadfbed req-a7e9f1b6-0cab-447c-9c2e-3cac1a5f53bc service nova] [instance: 85624c58-6c72-4490-8a3e-547953295ade] Received event network-vif-unplugged-51ccc958-5ce8-4e1d-8d28-f10c5ac288bd for instance with task_state deleting. {{(pid=75216) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 19:00:46 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:00:46 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:00:46 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 85624c58-6c72-4490-8a3e-547953295ade] Instance destroyed successfully.
Nov 13 19:00:46 user nova-compute[75216]: DEBUG nova.objects.instance [None req-2abff3c8-cda5-4eb6-af57-084e7d17e6f2 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Lazy-loading 'resources' on Instance uuid 85624c58-6c72-4490-8a3e-547953295ade {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:00:46 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-2abff3c8-cda5-4eb6-af57-084e7d17e6f2 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T18:44:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1814419203',display_name='tempest-ServerRescueNegativeTestJSON-server-1814419203',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1814419203',id=4,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-13T18:46:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2efafc26c47c4050bd367c47469999fb',ramdisk_id='',reservation_id='r-s9cus3mx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-165310019',owner_user_name='tempest-ServerRescueNegativeTestJSON-165310019-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T18:46:48Z,user_data=None,user_id='3587565f5b56450e95f2bd572d7e4f88',uuid=85624c58-6c72-4490-8a3e-547953295ade,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "51ccc958-5ce8-4e1d-8d28-f10c5ac288bd", "address": "fa:16:3e:f4:a4:79", "network": {"id": "6d182db1-03b5-4d1b-86cf-b9367921b7b0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1877006951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2efafc26c47c4050bd367c47469999fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51ccc958-5c", "ovs_interfaceid": "51ccc958-5ce8-4e1d-8d28-f10c5ac288bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 19:00:46 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-2abff3c8-cda5-4eb6-af57-084e7d17e6f2 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Converting VIF {"id": "51ccc958-5ce8-4e1d-8d28-f10c5ac288bd", "address": "fa:16:3e:f4:a4:79", "network": {"id": "6d182db1-03b5-4d1b-86cf-b9367921b7b0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1877006951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2efafc26c47c4050bd367c47469999fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51ccc958-5c", "ovs_interfaceid": "51ccc958-5ce8-4e1d-8d28-f10c5ac288bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 19:00:46 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-2abff3c8-cda5-4eb6-af57-084e7d17e6f2 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f4:a4:79,bridge_name='br-int',has_traffic_filtering=True,id=51ccc958-5ce8-4e1d-8d28-f10c5ac288bd,network=Network(6d182db1-03b5-4d1b-86cf-b9367921b7b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51ccc958-5c') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 19:00:46 user nova-compute[75216]: DEBUG os_vif [None req-2abff3c8-cda5-4eb6-af57-084e7d17e6f2 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f4:a4:79,bridge_name='br-int',has_traffic_filtering=True,id=51ccc958-5ce8-4e1d-8d28-f10c5ac288bd,network=Network(6d182db1-03b5-4d1b-86cf-b9367921b7b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51ccc958-5c') {{(pid=75216) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 19:00:46 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:00:46 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap51ccc958-5c, bridge=br-int, if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:00:46 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:00:46 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:00:46 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:00:46 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b6a7c5ce-23b4-482a-9c55-866a48ad9b7e) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:00:46 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:00:46 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:00:46 user nova-compute[75216]: INFO os_vif [None req-2abff3c8-cda5-4eb6-af57-084e7d17e6f2 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f4:a4:79,bridge_name='br-int',has_traffic_filtering=True,id=51ccc958-5ce8-4e1d-8d28-f10c5ac288bd,network=Network(6d182db1-03b5-4d1b-86cf-b9367921b7b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51ccc958-5c')
Nov 13 19:00:46 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-2abff3c8-cda5-4eb6-af57-084e7d17e6f2 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] [instance: 85624c58-6c72-4490-8a3e-547953295ade] Deleting instance files /opt/stack/data/nova/instances/85624c58-6c72-4490-8a3e-547953295ade_del
Nov 13 19:00:46 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-2abff3c8-cda5-4eb6-af57-084e7d17e6f2 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] [instance: 85624c58-6c72-4490-8a3e-547953295ade] Deletion of /opt/stack/data/nova/instances/85624c58-6c72-4490-8a3e-547953295ade_del complete
Nov 13 19:00:46 user nova-compute[75216]: INFO nova.compute.manager [None req-2abff3c8-cda5-4eb6-af57-084e7d17e6f2 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] [instance: 85624c58-6c72-4490-8a3e-547953295ade] Took 0.95 seconds to destroy the instance on the hypervisor.
Nov 13 19:00:46 user nova-compute[75216]: DEBUG oslo.service.loopingcall [None req-2abff3c8-cda5-4eb6-af57-084e7d17e6f2 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75216) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 19:00:46 user nova-compute[75216]: DEBUG nova.compute.manager [-] [instance: 85624c58-6c72-4490-8a3e-547953295ade] Deallocating network for instance {{(pid=75216) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 19:00:46 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: 85624c58-6c72-4490-8a3e-547953295ade] deallocate_for_instance() {{(pid=75216) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 19:00:47 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: 85624c58-6c72-4490-8a3e-547953295ade] Updating instance_info_cache with network_info: [] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:00:47 user nova-compute[75216]: INFO nova.compute.manager [-] [instance: 85624c58-6c72-4490-8a3e-547953295ade] Took 0.42 seconds to deallocate network for instance.
Nov 13 19:00:47 user nova-compute[75216]: DEBUG nova.compute.manager [req-105b7a14-0760-4355-98ef-808fc7b269ea req-ae63f351-e448-4f99-86e0-b3dbed09c538 service nova] [instance: 85624c58-6c72-4490-8a3e-547953295ade] Received event network-vif-deleted-51ccc958-5ce8-4e1d-8d28-f10c5ac288bd {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:00:47 user nova-compute[75216]: INFO nova.compute.manager [req-105b7a14-0760-4355-98ef-808fc7b269ea req-ae63f351-e448-4f99-86e0-b3dbed09c538 service nova] [instance: 85624c58-6c72-4490-8a3e-547953295ade] Neutron deleted interface 51ccc958-5ce8-4e1d-8d28-f10c5ac288bd; detaching it from the instance and deleting it from the info cache
Nov 13 19:00:47 user nova-compute[75216]: DEBUG nova.network.neutron [req-105b7a14-0760-4355-98ef-808fc7b269ea req-ae63f351-e448-4f99-86e0-b3dbed09c538 service nova] [instance: 85624c58-6c72-4490-8a3e-547953295ade] Updating instance_info_cache with network_info: [] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:00:47 user nova-compute[75216]: DEBUG nova.compute.manager [req-105b7a14-0760-4355-98ef-808fc7b269ea req-ae63f351-e448-4f99-86e0-b3dbed09c538 service nova] [instance: 85624c58-6c72-4490-8a3e-547953295ade] Detach interface failed, port_id=51ccc958-5ce8-4e1d-8d28-f10c5ac288bd, reason: Instance 85624c58-6c72-4490-8a3e-547953295ade could not be found. {{(pid=75216) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 13 19:00:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-2abff3c8-cda5-4eb6-af57-084e7d17e6f2 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:00:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-2abff3c8-cda5-4eb6-af57-084e7d17e6f2 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:00:47 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-2abff3c8-cda5-4eb6-af57-084e7d17e6f2 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 19:00:47 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-2abff3c8-cda5-4eb6-af57-084e7d17e6f2 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 19:00:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-2abff3c8-cda5-4eb6-af57-084e7d17e6f2 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.274s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:00:47 user nova-compute[75216]: INFO nova.scheduler.client.report [None req-2abff3c8-cda5-4eb6-af57-084e7d17e6f2 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Deleted allocations for instance 85624c58-6c72-4490-8a3e-547953295ade
Nov 13 19:00:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-2abff3c8-cda5-4eb6-af57-084e7d17e6f2 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Lock "85624c58-6c72-4490-8a3e-547953295ade" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.854s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:00:48 user nova-compute[75216]: DEBUG nova.compute.manager [req-86e7085b-8c96-4511-89ef-1601a17fe3c8 req-aa2ff563-3ea4-41c5-b180-3c889bdb5c1f service nova] [instance: 85624c58-6c72-4490-8a3e-547953295ade] Received event network-vif-plugged-51ccc958-5ce8-4e1d-8d28-f10c5ac288bd {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:00:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-86e7085b-8c96-4511-89ef-1601a17fe3c8 req-aa2ff563-3ea4-41c5-b180-3c889bdb5c1f service nova] Acquiring lock "85624c58-6c72-4490-8a3e-547953295ade-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:00:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-86e7085b-8c96-4511-89ef-1601a17fe3c8 req-aa2ff563-3ea4-41c5-b180-3c889bdb5c1f service nova] Lock "85624c58-6c72-4490-8a3e-547953295ade-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:00:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-86e7085b-8c96-4511-89ef-1601a17fe3c8 req-aa2ff563-3ea4-41c5-b180-3c889bdb5c1f service nova] Lock "85624c58-6c72-4490-8a3e-547953295ade-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:00:48 user nova-compute[75216]: DEBUG nova.compute.manager [req-86e7085b-8c96-4511-89ef-1601a17fe3c8 req-aa2ff563-3ea4-41c5-b180-3c889bdb5c1f service nova] [instance: 85624c58-6c72-4490-8a3e-547953295ade] No waiting events found dispatching network-vif-plugged-51ccc958-5ce8-4e1d-8d28-f10c5ac288bd {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 19:00:48 user nova-compute[75216]: WARNING nova.compute.manager [req-86e7085b-8c96-4511-89ef-1601a17fe3c8 req-aa2ff563-3ea4-41c5-b180-3c889bdb5c1f service nova] [instance: 85624c58-6c72-4490-8a3e-547953295ade] Received unexpected event network-vif-plugged-51ccc958-5ce8-4e1d-8d28-f10c5ac288bd for instance with vm_state deleted and task_state None.
Nov 13 19:00:51 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:00:52 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:00:52 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:00:52 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:00:52 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75216) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 13 19:00:52 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:00:53 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:00:53 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:00:56 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:00:56 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75216) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 19:00:56 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:00:56 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:00:56 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:00:56 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:00:56 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Auditing locally available compute resources for user (node: user) {{(pid=75216) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 19:00:56 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 19:00:56 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a3e849-6570-4820-97c8-75468b5bea4f/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:00:56 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:00:56 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a3e849-6570-4820-97c8-75468b5bea4f/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:00:56 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a3e849-6570-4820-97c8-75468b5bea4f/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:00:56 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a3e849-6570-4820-97c8-75468b5bea4f/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:00:56 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 19:00:56 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d589d57e-de50-482a-843f-e8246b3d7528/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:00:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d589d57e-de50-482a-843f-e8246b3d7528/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:00:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d589d57e-de50-482a-843f-e8246b3d7528/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:00:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d589d57e-de50-482a-843f-e8246b3d7528/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:00:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:00:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:00:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:00:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:00:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71134725-e6cc-4426-b2c2-5be4991c53f7/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:00:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71134725-e6cc-4426-b2c2-5be4991c53f7/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:00:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71134725-e6cc-4426-b2c2-5be4991c53f7/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:00:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71134725-e6cc-4426-b2c2-5be4991c53f7/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:00:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af8089f7-6dc3-4655-9369-2177dbd7bf4d/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:00:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af8089f7-6dc3-4655-9369-2177dbd7bf4d/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:00:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af8089f7-6dc3-4655-9369-2177dbd7bf4d/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:00:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af8089f7-6dc3-4655-9369-2177dbd7bf4d/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:00:58 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 19:00:58 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 19:00:58 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Hypervisor/Node resource view: name=user free_ram=8143MB free_disk=25.361534118652344GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75216) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 19:00:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:00:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:00:59 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance a1a3e849-6570-4820-97c8-75468b5bea4f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 19:00:59 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance d589d57e-de50-482a-843f-e8246b3d7528 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 19:00:59 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 19:00:59 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance 1e5f1164-a15e-40cf-b7bc-5aeb404a1216 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 19:00:59 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance 2f074d68-d0a7-4204-a79d-be619ee42d0c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 19:00:59 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance 71134725-e6cc-4426-b2c2-5be4991c53f7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 19:00:59 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance af8089f7-6dc3-4655-9369-2177dbd7bf4d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 19:00:59 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 19:00:59 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 19:00:59 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Refreshing inventories for resource provider d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 13 19:00:59 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Updating ProviderTree inventory for provider d927e00d-5a8b-43f7-ac04-6437958fac1f from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 13 19:00:59 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Updating inventory in ProviderTree for provider d927e00d-5a8b-43f7-ac04-6437958fac1f with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 13 19:00:59 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Refreshing aggregate associations for resource provider d927e00d-5a8b-43f7-ac04-6437958fac1f, aggregates: None {{(pid=75216) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 13 19:00:59 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Refreshing trait associations for resource provider d927e00d-5a8b-43f7-ac04-6437958fac1f, traits: COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_MMX {{(pid=75216) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 13 19:00:59 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 19:00:59 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 19:00:59 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Compute_service record updated for user:user {{(pid=75216) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 19:00:59 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.665s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:01:00 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:01:00 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:01:00 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Starting heal instance info cache {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 19:01:00 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "refresh_cache-f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 19:01:00 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquired lock "refresh_cache-f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 19:01:00 user nova-compute[75216]: DEBUG nova.network.neutron [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1] Forcefully refreshing network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 19:01:00 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-ac99283f-818d-402f-b988-a5e81c5bf9c0 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Acquiring lock "5c18c0ad-60e5-4ef2-97f2-b7008e89ac78" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:01:00 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-ac99283f-818d-402f-b988-a5e81c5bf9c0 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Lock "5c18c0ad-60e5-4ef2-97f2-b7008e89ac78" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:01:00 user nova-compute[75216]: DEBUG nova.compute.manager [None req-ac99283f-818d-402f-b988-a5e81c5bf9c0 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: 5c18c0ad-60e5-4ef2-97f2-b7008e89ac78] Starting instance... {{(pid=75216) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 19:01:00 user nova-compute[75216]: DEBUG nova.network.neutron [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1] Updating instance_info_cache with network_info: [{"id": "5419f8b4-31da-434a-b131-6476134a71bf", "address": "fa:16:3e:9a:08:ac", "network": {"id": "f8b821ef-8fae-42b9-9055-a9ea7be955ab", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-50594548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "903397a6c0474cfd8bd1a4fb338528aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5419f8b4-31", "ovs_interfaceid": "5419f8b4-31da-434a-b131-6476134a71bf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:01:00 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Releasing lock "refresh_cache-f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 19:01:00 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1] Updated the network info_cache for instance {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 19:01:00 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:01:00 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:01:00 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:01:01 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-ac99283f-818d-402f-b988-a5e81c5bf9c0 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:01:01 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-ac99283f-818d-402f-b988-a5e81c5bf9c0 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:01:01 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-ac99283f-818d-402f-b988-a5e81c5bf9c0 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75216) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 19:01:01 user nova-compute[75216]: INFO nova.compute.claims [None req-ac99283f-818d-402f-b988-a5e81c5bf9c0 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: 5c18c0ad-60e5-4ef2-97f2-b7008e89ac78] Claim successful on node user
Nov 13 19:01:01 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Triggering sync for uuid a1a3e849-6570-4820-97c8-75468b5bea4f {{(pid=75216) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 13 19:01:01 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Triggering sync for uuid d589d57e-de50-482a-843f-e8246b3d7528 {{(pid=75216) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 13 19:01:01 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Triggering sync for uuid f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1 {{(pid=75216) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 13 19:01:01 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Triggering sync for uuid 1e5f1164-a15e-40cf-b7bc-5aeb404a1216 {{(pid=75216) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 13 19:01:01 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Triggering sync for uuid 2f074d68-d0a7-4204-a79d-be619ee42d0c {{(pid=75216) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 13 19:01:01 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Triggering sync for uuid 71134725-e6cc-4426-b2c2-5be4991c53f7 {{(pid=75216) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 13 19:01:01 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Triggering sync for uuid af8089f7-6dc3-4655-9369-2177dbd7bf4d {{(pid=75216) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 13 19:01:01 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "a1a3e849-6570-4820-97c8-75468b5bea4f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:01:01 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "a1a3e849-6570-4820-97c8-75468b5bea4f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:01:01 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "d589d57e-de50-482a-843f-e8246b3d7528" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:01:01 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "d589d57e-de50-482a-843f-e8246b3d7528" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:01:01 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:01:01 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:01:01 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "1e5f1164-a15e-40cf-b7bc-5aeb404a1216" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:01:01 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "1e5f1164-a15e-40cf-b7bc-5aeb404a1216" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:01:01 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "2f074d68-d0a7-4204-a79d-be619ee42d0c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:01:01 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "2f074d68-d0a7-4204-a79d-be619ee42d0c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:01:01 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "71134725-e6cc-4426-b2c2-5be4991c53f7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:01:01 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "71134725-e6cc-4426-b2c2-5be4991c53f7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:01:01 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "af8089f7-6dc3-4655-9369-2177dbd7bf4d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:01:01 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "af8089f7-6dc3-4655-9369-2177dbd7bf4d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:01:01 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "a1a3e849-6570-4820-97c8-75468b5bea4f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.034s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:01:01 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "d589d57e-de50-482a-843f-e8246b3d7528" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.035s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:01:01 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "2f074d68-d0a7-4204-a79d-be619ee42d0c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.041s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:01:01 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "1e5f1164-a15e-40cf-b7bc-5aeb404a1216" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.043s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:01:01 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "af8089f7-6dc3-4655-9369-2177dbd7bf4d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.047s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:01:01 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.054s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:01:01 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "71134725-e6cc-4426-b2c2-5be4991c53f7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.060s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:01:01 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-ac99283f-818d-402f-b988-a5e81c5bf9c0 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 19:01:01 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-ac99283f-818d-402f-b988-a5e81c5bf9c0 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 19:01:01 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-ac99283f-818d-402f-b988-a5e81c5bf9c0 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.349s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:01:01 user nova-compute[75216]: DEBUG nova.compute.manager [None req-ac99283f-818d-402f-b988-a5e81c5bf9c0 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: 5c18c0ad-60e5-4ef2-97f2-b7008e89ac78] Start building networks asynchronously for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 19:01:01 user nova-compute[75216]: DEBUG nova.compute.manager [None req-ac99283f-818d-402f-b988-a5e81c5bf9c0 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: 5c18c0ad-60e5-4ef2-97f2-b7008e89ac78] Allocating IP information in the background. {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 19:01:01 user nova-compute[75216]: DEBUG nova.network.neutron [None req-ac99283f-818d-402f-b988-a5e81c5bf9c0 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: 5c18c0ad-60e5-4ef2-97f2-b7008e89ac78] allocate_for_instance() {{(pid=75216) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 19:01:01 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-ac99283f-818d-402f-b988-a5e81c5bf9c0 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: 5c18c0ad-60e5-4ef2-97f2-b7008e89ac78] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 19:01:01 user nova-compute[75216]: DEBUG nova.compute.manager [None req-ac99283f-818d-402f-b988-a5e81c5bf9c0 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: 5c18c0ad-60e5-4ef2-97f2-b7008e89ac78] Start building block device mappings for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 19:01:01 user nova-compute[75216]: DEBUG nova.policy [None req-ac99283f-818d-402f-b988-a5e81c5bf9c0 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b381ea98871846b1bfb29a202a058208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '903397a6c0474cfd8bd1a4fb338528aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75216) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 19:01:01 user nova-compute[75216]: DEBUG nova.compute.manager [None req-ac99283f-818d-402f-b988-a5e81c5bf9c0 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: 5c18c0ad-60e5-4ef2-97f2-b7008e89ac78] Start spawning the instance on the hypervisor. {{(pid=75216) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 19:01:01 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-ac99283f-818d-402f-b988-a5e81c5bf9c0 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: 5c18c0ad-60e5-4ef2-97f2-b7008e89ac78] Creating instance directory {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 19:01:01 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-ac99283f-818d-402f-b988-a5e81c5bf9c0 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: 5c18c0ad-60e5-4ef2-97f2-b7008e89ac78] Creating image(s)
Nov 13 19:01:01 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-ac99283f-818d-402f-b988-a5e81c5bf9c0 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Acquiring lock "/opt/stack/data/nova/instances/5c18c0ad-60e5-4ef2-97f2-b7008e89ac78/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:01:01 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-ac99283f-818d-402f-b988-a5e81c5bf9c0 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Lock "/opt/stack/data/nova/instances/5c18c0ad-60e5-4ef2-97f2-b7008e89ac78/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:01:01 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-ac99283f-818d-402f-b988-a5e81c5bf9c0 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Lock "/opt/stack/data/nova/instances/5c18c0ad-60e5-4ef2-97f2-b7008e89ac78/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:01:01 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-ac99283f-818d-402f-b988-a5e81c5bf9c0 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:01:01 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:01:01 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-ac99283f-818d-402f-b988-a5e81c5bf9c0 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json" returned: 0 in 0.180s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:01:01 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-ac99283f-818d-402f-b988-a5e81c5bf9c0 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Acquiring lock "88c50a45bec9d6b0427462b3242b9b8e5f49c2b6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:01:01 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-ac99283f-818d-402f-b988-a5e81c5bf9c0 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Lock "88c50a45bec9d6b0427462b3242b9b8e5f49c2b6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:01:01 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-ac99283f-818d-402f-b988-a5e81c5bf9c0 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:01:01 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-ac99283f-818d-402f-b988-a5e81c5bf9c0 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json" returned: 0 in 0.166s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:01:01 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-ac99283f-818d-402f-b988-a5e81c5bf9c0 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6,backing_fmt=raw /opt/stack/data/nova/instances/5c18c0ad-60e5-4ef2-97f2-b7008e89ac78/disk 1073741824 {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:01:01 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-ac99283f-818d-402f-b988-a5e81c5bf9c0 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6,backing_fmt=raw /opt/stack/data/nova/instances/5c18c0ad-60e5-4ef2-97f2-b7008e89ac78/disk 1073741824" returned: 0 in 0.054s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:01:02 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-ac99283f-818d-402f-b988-a5e81c5bf9c0 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Lock "88c50a45bec9d6b0427462b3242b9b8e5f49c2b6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.227s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:01:02 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-ac99283f-818d-402f-b988-a5e81c5bf9c0 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:01:02 user nova-compute[75216]: DEBUG nova.network.neutron [None req-ac99283f-818d-402f-b988-a5e81c5bf9c0 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: 5c18c0ad-60e5-4ef2-97f2-b7008e89ac78] Successfully created port: d92289be-85e7-4781-8889-2d0c7c38a9fa {{(pid=75216) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 19:01:02 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-ac99283f-818d-402f-b988-a5e81c5bf9c0 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json" returned: 0 in 0.168s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:01:02 user nova-compute[75216]: DEBUG nova.virt.disk.api [None req-ac99283f-818d-402f-b988-a5e81c5bf9c0 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5c18c0ad-60e5-4ef2-97f2-b7008e89ac78/disk. size=1073741824 {{(pid=75216) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 19:01:02 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-ac99283f-818d-402f-b988-a5e81c5bf9c0 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c18c0ad-60e5-4ef2-97f2-b7008e89ac78/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:01:02 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-ac99283f-818d-402f-b988-a5e81c5bf9c0 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c18c0ad-60e5-4ef2-97f2-b7008e89ac78/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:01:02 user nova-compute[75216]: DEBUG nova.virt.disk.api [None req-ac99283f-818d-402f-b988-a5e81c5bf9c0 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Cannot resize image /opt/stack/data/nova/instances/5c18c0ad-60e5-4ef2-97f2-b7008e89ac78/disk to a smaller size. {{(pid=75216) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 19:01:02 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-ac99283f-818d-402f-b988-a5e81c5bf9c0 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: 5c18c0ad-60e5-4ef2-97f2-b7008e89ac78] Created local disks {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 19:01:02 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-ac99283f-818d-402f-b988-a5e81c5bf9c0 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: 5c18c0ad-60e5-4ef2-97f2-b7008e89ac78] Ensure instance console log exists: /opt/stack/data/nova/instances/5c18c0ad-60e5-4ef2-97f2-b7008e89ac78/console.log {{(pid=75216) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 19:01:02 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-ac99283f-818d-402f-b988-a5e81c5bf9c0 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:01:02 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-ac99283f-818d-402f-b988-a5e81c5bf9c0 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:01:02 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-ac99283f-818d-402f-b988-a5e81c5bf9c0 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:01:02 user nova-compute[75216]: DEBUG nova.network.neutron [None req-ac99283f-818d-402f-b988-a5e81c5bf9c0 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: 5c18c0ad-60e5-4ef2-97f2-b7008e89ac78] Successfully updated port: d92289be-85e7-4781-8889-2d0c7c38a9fa {{(pid=75216) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 19:01:02 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-ac99283f-818d-402f-b988-a5e81c5bf9c0 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Acquiring lock "refresh_cache-5c18c0ad-60e5-4ef2-97f2-b7008e89ac78" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 19:01:02 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-ac99283f-818d-402f-b988-a5e81c5bf9c0 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Acquired lock "refresh_cache-5c18c0ad-60e5-4ef2-97f2-b7008e89ac78" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 19:01:02 user nova-compute[75216]: DEBUG nova.network.neutron [None req-ac99283f-818d-402f-b988-a5e81c5bf9c0 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: 5c18c0ad-60e5-4ef2-97f2-b7008e89ac78] Building network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 19:01:02 user nova-compute[75216]: DEBUG nova.compute.manager [req-44e2f3dc-d047-488d-8151-a945af403b57 req-b6e2c8d9-e37c-48b6-8f66-eb0bab7b6035 service nova] [instance: 5c18c0ad-60e5-4ef2-97f2-b7008e89ac78] Received event network-changed-d92289be-85e7-4781-8889-2d0c7c38a9fa {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:01:02 user nova-compute[75216]: DEBUG nova.compute.manager [req-44e2f3dc-d047-488d-8151-a945af403b57 req-b6e2c8d9-e37c-48b6-8f66-eb0bab7b6035 service nova] [instance: 5c18c0ad-60e5-4ef2-97f2-b7008e89ac78] Refreshing instance network info cache due to event network-changed-d92289be-85e7-4781-8889-2d0c7c38a9fa. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 19:01:02 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-44e2f3dc-d047-488d-8151-a945af403b57 req-b6e2c8d9-e37c-48b6-8f66-eb0bab7b6035 service nova] Acquiring lock "refresh_cache-5c18c0ad-60e5-4ef2-97f2-b7008e89ac78" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 19:01:02 user nova-compute[75216]: DEBUG nova.network.neutron [None req-ac99283f-818d-402f-b988-a5e81c5bf9c0 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: 5c18c0ad-60e5-4ef2-97f2-b7008e89ac78] Instance cache missing network info. {{(pid=75216) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 19:01:02 user nova-compute[75216]: DEBUG nova.network.neutron [None req-ac99283f-818d-402f-b988-a5e81c5bf9c0 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: 5c18c0ad-60e5-4ef2-97f2-b7008e89ac78] Updating instance_info_cache with network_info: [{"id": "d92289be-85e7-4781-8889-2d0c7c38a9fa", "address": "fa:16:3e:ec:0e:80", "network": {"id": "f8b821ef-8fae-42b9-9055-a9ea7be955ab", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-50594548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "903397a6c0474cfd8bd1a4fb338528aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd92289be-85", "ovs_interfaceid": "d92289be-85e7-4781-8889-2d0c7c38a9fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:01:02 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-ac99283f-818d-402f-b988-a5e81c5bf9c0 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Releasing lock "refresh_cache-5c18c0ad-60e5-4ef2-97f2-b7008e89ac78" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 19:01:02 user nova-compute[75216]: DEBUG nova.compute.manager [None req-ac99283f-818d-402f-b988-a5e81c5bf9c0 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: 5c18c0ad-60e5-4ef2-97f2-b7008e89ac78] Instance network_info: |[{"id": "d92289be-85e7-4781-8889-2d0c7c38a9fa", "address": "fa:16:3e:ec:0e:80", "network": {"id": "f8b821ef-8fae-42b9-9055-a9ea7be955ab", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-50594548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "903397a6c0474cfd8bd1a4fb338528aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd92289be-85", "ovs_interfaceid": "d92289be-85e7-4781-8889-2d0c7c38a9fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 19:01:02 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-44e2f3dc-d047-488d-8151-a945af403b57 req-b6e2c8d9-e37c-48b6-8f66-eb0bab7b6035 service nova] Acquired lock "refresh_cache-5c18c0ad-60e5-4ef2-97f2-b7008e89ac78" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 19:01:02 user nova-compute[75216]: DEBUG nova.network.neutron [req-44e2f3dc-d047-488d-8151-a945af403b57 req-b6e2c8d9-e37c-48b6-8f66-eb0bab7b6035 service nova] [instance: 5c18c0ad-60e5-4ef2-97f2-b7008e89ac78] Refreshing network info cache for port d92289be-85e7-4781-8889-2d0c7c38a9fa {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 19:01:02 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-ac99283f-818d-402f-b988-a5e81c5bf9c0 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: 5c18c0ad-60e5-4ef2-97f2-b7008e89ac78] Start _get_guest_xml network_info=[{"id": "d92289be-85e7-4781-8889-2d0c7c38a9fa", "address": "fa:16:3e:ec:0e:80", "network": {"id": "f8b821ef-8fae-42b9-9055-a9ea7be955ab", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-50594548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "903397a6c0474cfd8bd1a4fb338528aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd92289be-85", "ovs_interfaceid": "d92289be-85e7-4781-8889-2d0c7c38a9fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T18:41:06Z,direct_url=<?>,disk_format='qcow2',id=77bcb5ba-8510-41ec-a88d-96097bb431de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c465b7c26ec44582b6d1b7169536ecc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T18:41:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'guest_format': None, 'boot_index': 0, 'image_id': '77bcb5ba-8510-41ec-a88d-96097bb431de'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 19:01:02 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-ac99283f-818d-402f-b988-a5e81c5bf9c0 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 19:01:02 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-ac99283f-818d-402f-b988-a5e81c5bf9c0 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 19:01:02 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-ac99283f-818d-402f-b988-a5e81c5bf9c0 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 19:01:02 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-ac99283f-818d-402f-b988-a5e81c5bf9c0 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] CPU controller missing on host. {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 19:01:02 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-ac99283f-818d-402f-b988-a5e81c5bf9c0 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 19:01:02 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-ac99283f-818d-402f-b988-a5e81c5bf9c0 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] CPU controller found on host. {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 19:01:02 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-ac99283f-818d-402f-b988-a5e81c5bf9c0 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75216) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 19:01:02 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-ac99283f-818d-402f-b988-a5e81c5bf9c0 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T18:40:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T18:41:06Z,direct_url=<?>,disk_format='qcow2',id=77bcb5ba-8510-41ec-a88d-96097bb431de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c465b7c26ec44582b6d1b7169536ecc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T18:41:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 19:01:02 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-ac99283f-818d-402f-b988-a5e81c5bf9c0 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Flavor limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 19:01:02 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-ac99283f-818d-402f-b988-a5e81c5bf9c0 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Image limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 19:01:02 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-ac99283f-818d-402f-b988-a5e81c5bf9c0 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Flavor pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 19:01:02 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-ac99283f-818d-402f-b988-a5e81c5bf9c0 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Image pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 19:01:02 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-ac99283f-818d-402f-b988-a5e81c5bf9c0 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 19:01:02 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-ac99283f-818d-402f-b988-a5e81c5bf9c0 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 19:01:02 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-ac99283f-818d-402f-b988-a5e81c5bf9c0 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 19:01:02 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-ac99283f-818d-402f-b988-a5e81c5bf9c0 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Got 1 possible topologies {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 19:01:02 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-ac99283f-818d-402f-b988-a5e81c5bf9c0 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 19:01:02 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-ac99283f-818d-402f-b988-a5e81c5bf9c0 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 19:01:02 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-ac99283f-818d-402f-b988-a5e81c5bf9c0 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T19:01:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1664652434',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1664652434',id=28,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='903397a6c0474cfd8bd1a4fb338528aa',ramdisk_id='',reservation_id='r-0i5en3ub',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-197527955',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T19:01:02Z,user_data=None,user_id='b381ea98871846b1bfb29a202a058208',uuid=5c18c0ad-60e5-4ef2-97f2-b7008e89ac78,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d92289be-85e7-4781-8889-2d0c7c38a9fa", "address": "fa:16:3e:ec:0e:80", "network": {"id": "f8b821ef-8fae-42b9-9055-a9ea7be955ab", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-50594548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "903397a6c0474cfd8bd1a4fb338528aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd92289be-85", "ovs_interfaceid": "d92289be-85e7-4781-8889-2d0c7c38a9fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75216) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 19:01:02 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-ac99283f-818d-402f-b988-a5e81c5bf9c0 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Converting VIF {"id": "d92289be-85e7-4781-8889-2d0c7c38a9fa", "address": "fa:16:3e:ec:0e:80", "network": {"id": "f8b821ef-8fae-42b9-9055-a9ea7be955ab", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-50594548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "903397a6c0474cfd8bd1a4fb338528aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd92289be-85", "ovs_interfaceid": "d92289be-85e7-4781-8889-2d0c7c38a9fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 19:01:02 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-ac99283f-818d-402f-b988-a5e81c5bf9c0 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:0e:80,bridge_name='br-int',has_traffic_filtering=True,id=d92289be-85e7-4781-8889-2d0c7c38a9fa,network=Network(f8b821ef-8fae-42b9-9055-a9ea7be955ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd92289be-85') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 19:01:02 user nova-compute[75216]: DEBUG nova.objects.instance [None req-ac99283f-818d-402f-b988-a5e81c5bf9c0 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Lazy-loading 'pci_devices' on Instance uuid 5c18c0ad-60e5-4ef2-97f2-b7008e89ac78 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:01:02 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-ac99283f-818d-402f-b988-a5e81c5bf9c0 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: 5c18c0ad-60e5-4ef2-97f2-b7008e89ac78] End _get_guest_xml xml=<domain type="kvm">
Nov 13 19:01:02 user nova-compute[75216]:   <uuid>5c18c0ad-60e5-4ef2-97f2-b7008e89ac78</uuid>
Nov 13 19:01:02 user nova-compute[75216]:   <name>instance-0000001c</name>
Nov 13 19:01:02 user nova-compute[75216]:   <memory>524288</memory>
Nov 13 19:01:02 user nova-compute[75216]:   <vcpu>1</vcpu>
Nov 13 19:01:02 user nova-compute[75216]:   <metadata>
Nov 13 19:01:02 user nova-compute[75216]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 19:01:02 user nova-compute[75216]:       <nova:package version="0.0.0"/>
Nov 13 19:01:02 user nova-compute[75216]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1664652434</nova:name>
Nov 13 19:01:02 user nova-compute[75216]:       <nova:creationTime>2023-11-13 19:01:02</nova:creationTime>
Nov 13 19:01:02 user nova-compute[75216]:       <nova:flavor name="m1.tiny">
Nov 13 19:01:02 user nova-compute[75216]:         <nova:memory>512</nova:memory>
Nov 13 19:01:02 user nova-compute[75216]:         <nova:disk>1</nova:disk>
Nov 13 19:01:02 user nova-compute[75216]:         <nova:swap>0</nova:swap>
Nov 13 19:01:02 user nova-compute[75216]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 19:01:02 user nova-compute[75216]:         <nova:vcpus>1</nova:vcpus>
Nov 13 19:01:02 user nova-compute[75216]:       </nova:flavor>
Nov 13 19:01:02 user nova-compute[75216]:       <nova:owner>
Nov 13 19:01:02 user nova-compute[75216]:         <nova:user uuid="b381ea98871846b1bfb29a202a058208">tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member</nova:user>
Nov 13 19:01:02 user nova-compute[75216]:         <nova:project uuid="903397a6c0474cfd8bd1a4fb338528aa">tempest-ServerBootFromVolumeStableRescueTest-197527955</nova:project>
Nov 13 19:01:02 user nova-compute[75216]:       </nova:owner>
Nov 13 19:01:02 user nova-compute[75216]:       <nova:root type="image" uuid="77bcb5ba-8510-41ec-a88d-96097bb431de"/>
Nov 13 19:01:02 user nova-compute[75216]:       <nova:ports>
Nov 13 19:01:02 user nova-compute[75216]:         <nova:port uuid="d92289be-85e7-4781-8889-2d0c7c38a9fa">
Nov 13 19:01:02 user nova-compute[75216]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 13 19:01:02 user nova-compute[75216]:         </nova:port>
Nov 13 19:01:02 user nova-compute[75216]:       </nova:ports>
Nov 13 19:01:02 user nova-compute[75216]:     </nova:instance>
Nov 13 19:01:02 user nova-compute[75216]:   </metadata>
Nov 13 19:01:02 user nova-compute[75216]:   <sysinfo type="smbios">
Nov 13 19:01:02 user nova-compute[75216]:     <system>
Nov 13 19:01:02 user nova-compute[75216]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 19:01:02 user nova-compute[75216]:       <entry name="product">OpenStack Nova</entry>
Nov 13 19:01:02 user nova-compute[75216]:       <entry name="version">0.0.0</entry>
Nov 13 19:01:02 user nova-compute[75216]:       <entry name="serial">5c18c0ad-60e5-4ef2-97f2-b7008e89ac78</entry>
Nov 13 19:01:02 user nova-compute[75216]:       <entry name="uuid">5c18c0ad-60e5-4ef2-97f2-b7008e89ac78</entry>
Nov 13 19:01:02 user nova-compute[75216]:       <entry name="family">Virtual Machine</entry>
Nov 13 19:01:02 user nova-compute[75216]:     </system>
Nov 13 19:01:02 user nova-compute[75216]:   </sysinfo>
Nov 13 19:01:02 user nova-compute[75216]:   <os>
Nov 13 19:01:02 user nova-compute[75216]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 19:01:02 user nova-compute[75216]:     <boot dev="hd"/>
Nov 13 19:01:02 user nova-compute[75216]:     <smbios mode="sysinfo"/>
Nov 13 19:01:02 user nova-compute[75216]:   </os>
Nov 13 19:01:02 user nova-compute[75216]:   <features>
Nov 13 19:01:02 user nova-compute[75216]:     <acpi/>
Nov 13 19:01:02 user nova-compute[75216]:     <apic/>
Nov 13 19:01:02 user nova-compute[75216]:     <vmcoreinfo/>
Nov 13 19:01:02 user nova-compute[75216]:   </features>
Nov 13 19:01:02 user nova-compute[75216]:   <clock offset="utc">
Nov 13 19:01:02 user nova-compute[75216]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 19:01:02 user nova-compute[75216]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 19:01:02 user nova-compute[75216]:     <timer name="hpet" present="no"/>
Nov 13 19:01:02 user nova-compute[75216]:   </clock>
Nov 13 19:01:02 user nova-compute[75216]:   <cpu mode="custom" match="exact">
Nov 13 19:01:02 user nova-compute[75216]:     <model>Nehalem</model>
Nov 13 19:01:02 user nova-compute[75216]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 19:01:02 user nova-compute[75216]:   </cpu>
Nov 13 19:01:02 user nova-compute[75216]:   <devices>
Nov 13 19:01:02 user nova-compute[75216]:     <disk type="file" device="disk">
Nov 13 19:01:02 user nova-compute[75216]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 19:01:02 user nova-compute[75216]:       <source file="/opt/stack/data/nova/instances/5c18c0ad-60e5-4ef2-97f2-b7008e89ac78/disk"/>
Nov 13 19:01:02 user nova-compute[75216]:       <target dev="vda" bus="virtio"/>
Nov 13 19:01:02 user nova-compute[75216]:     </disk>
Nov 13 19:01:02 user nova-compute[75216]:     <interface type="ethernet">
Nov 13 19:01:02 user nova-compute[75216]:       <mac address="fa:16:3e:ec:0e:80"/>
Nov 13 19:01:02 user nova-compute[75216]:       <model type="virtio"/>
Nov 13 19:01:02 user nova-compute[75216]:       <mtu size="1442"/>
Nov 13 19:01:02 user nova-compute[75216]:       <target dev="tapd92289be-85"/>
Nov 13 19:01:02 user nova-compute[75216]:     </interface>
Nov 13 19:01:02 user nova-compute[75216]:     <serial type="pty">
Nov 13 19:01:02 user nova-compute[75216]:       <log file="/opt/stack/data/nova/instances/5c18c0ad-60e5-4ef2-97f2-b7008e89ac78/console.log" append="off"/>
Nov 13 19:01:02 user nova-compute[75216]:     </serial>
Nov 13 19:01:02 user nova-compute[75216]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 19:01:02 user nova-compute[75216]:     <video>
Nov 13 19:01:02 user nova-compute[75216]:       <model type="virtio"/>
Nov 13 19:01:02 user nova-compute[75216]:     </video>
Nov 13 19:01:02 user nova-compute[75216]:     <rng model="virtio">
Nov 13 19:01:02 user nova-compute[75216]:       <backend model="random">/dev/urandom</backend>
Nov 13 19:01:02 user nova-compute[75216]:     </rng>
Nov 13 19:01:02 user nova-compute[75216]:     <controller type="usb" index="0" model="none"/>
Nov 13 19:01:02 user nova-compute[75216]:     <memballoon model="virtio">
Nov 13 19:01:02 user nova-compute[75216]:       <stats period="10"/>
Nov 13 19:01:02 user nova-compute[75216]:     </memballoon>
Nov 13 19:01:02 user nova-compute[75216]:   </devices>
Nov 13 19:01:02 user nova-compute[75216]: </domain>
Nov 13 19:01:02 user nova-compute[75216]:  {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 19:01:03 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-ac99283f-818d-402f-b988-a5e81c5bf9c0 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T19:01:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1664652434',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1664652434',id=28,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='903397a6c0474cfd8bd1a4fb338528aa',ramdisk_id='',reservation_id='r-0i5en3ub',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-197527955',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T19:01:02Z,user_data=None,user_id='b381ea98871846b1bfb29a202a058208',uuid=5c18c0ad-60e5-4ef2-97f2-b7008e89ac78,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d92289be-85e7-4781-8889-2d0c7c38a9fa", "address": "fa:16:3e:ec:0e:80", "network": {"id": "f8b821ef-8fae-42b9-9055-a9ea7be955ab", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-50594548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "903397a6c0474cfd8bd1a4fb338528aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd92289be-85", "ovs_interfaceid": "d92289be-85e7-4781-8889-2d0c7c38a9fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 19:01:03 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-ac99283f-818d-402f-b988-a5e81c5bf9c0 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Converting VIF {"id": "d92289be-85e7-4781-8889-2d0c7c38a9fa", "address": "fa:16:3e:ec:0e:80", "network": {"id": "f8b821ef-8fae-42b9-9055-a9ea7be955ab", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-50594548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "903397a6c0474cfd8bd1a4fb338528aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd92289be-85", "ovs_interfaceid": "d92289be-85e7-4781-8889-2d0c7c38a9fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 19:01:03 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-ac99283f-818d-402f-b988-a5e81c5bf9c0 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:0e:80,bridge_name='br-int',has_traffic_filtering=True,id=d92289be-85e7-4781-8889-2d0c7c38a9fa,network=Network(f8b821ef-8fae-42b9-9055-a9ea7be955ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd92289be-85') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 19:01:03 user nova-compute[75216]: DEBUG os_vif [None req-ac99283f-818d-402f-b988-a5e81c5bf9c0 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:0e:80,bridge_name='br-int',has_traffic_filtering=True,id=d92289be-85e7-4781-8889-2d0c7c38a9fa,network=Network(f8b821ef-8fae-42b9-9055-a9ea7be955ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd92289be-85') {{(pid=75216) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 19:01:03 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:01:03 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:01:03 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 19:01:03 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:01:03 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4ef353c9-728e-5eda-8562-d2b4c42cb95d', '_type': 'linux-noop'}}, row=False) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:01:03 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:01:03 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:01:03 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:01:03 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd92289be-85, may_exist=True, interface_attrs={}) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:01:03 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd92289be-85, col_values=(('qos', UUID('1d85b86f-8214-4877-b0d1-05c181714527')),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:01:03 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd92289be-85, col_values=(('external_ids', {'iface-id': 'd92289be-85e7-4781-8889-2d0c7c38a9fa', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ec:0e:80', 'vm-uuid': '5c18c0ad-60e5-4ef2-97f2-b7008e89ac78'}),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:01:03 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:01:03 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:01:03 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:01:03 user nova-compute[75216]: INFO os_vif [None req-ac99283f-818d-402f-b988-a5e81c5bf9c0 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:0e:80,bridge_name='br-int',has_traffic_filtering=True,id=d92289be-85e7-4781-8889-2d0c7c38a9fa,network=Network(f8b821ef-8fae-42b9-9055-a9ea7be955ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd92289be-85')
Nov 13 19:01:03 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-ac99283f-818d-402f-b988-a5e81c5bf9c0 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 19:01:03 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-ac99283f-818d-402f-b988-a5e81c5bf9c0 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] No VIF found with MAC fa:16:3e:ec:0e:80, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 19:01:03 user nova-compute[75216]: DEBUG nova.network.neutron [req-44e2f3dc-d047-488d-8151-a945af403b57 req-b6e2c8d9-e37c-48b6-8f66-eb0bab7b6035 service nova] [instance: 5c18c0ad-60e5-4ef2-97f2-b7008e89ac78] Updated VIF entry in instance network info cache for port d92289be-85e7-4781-8889-2d0c7c38a9fa. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 19:01:03 user nova-compute[75216]: DEBUG nova.network.neutron [req-44e2f3dc-d047-488d-8151-a945af403b57 req-b6e2c8d9-e37c-48b6-8f66-eb0bab7b6035 service nova] [instance: 5c18c0ad-60e5-4ef2-97f2-b7008e89ac78] Updating instance_info_cache with network_info: [{"id": "d92289be-85e7-4781-8889-2d0c7c38a9fa", "address": "fa:16:3e:ec:0e:80", "network": {"id": "f8b821ef-8fae-42b9-9055-a9ea7be955ab", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-50594548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "903397a6c0474cfd8bd1a4fb338528aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd92289be-85", "ovs_interfaceid": "d92289be-85e7-4781-8889-2d0c7c38a9fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:01:03 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-44e2f3dc-d047-488d-8151-a945af403b57 req-b6e2c8d9-e37c-48b6-8f66-eb0bab7b6035 service nova] Releasing lock "refresh_cache-5c18c0ad-60e5-4ef2-97f2-b7008e89ac78" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 19:01:04 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:01:04 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:01:04 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:01:04 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:01:04 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:01:04 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:01:04 user nova-compute[75216]: DEBUG nova.compute.manager [req-a0912485-7534-4b6b-ac77-f9346c4a20ff req-04338aa0-9e71-4885-9836-31240c308f5b service nova] [instance: 5c18c0ad-60e5-4ef2-97f2-b7008e89ac78] Received event network-vif-plugged-d92289be-85e7-4781-8889-2d0c7c38a9fa {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:01:04 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-a0912485-7534-4b6b-ac77-f9346c4a20ff req-04338aa0-9e71-4885-9836-31240c308f5b service nova] Acquiring lock "5c18c0ad-60e5-4ef2-97f2-b7008e89ac78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:01:04 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-a0912485-7534-4b6b-ac77-f9346c4a20ff req-04338aa0-9e71-4885-9836-31240c308f5b service nova] Lock "5c18c0ad-60e5-4ef2-97f2-b7008e89ac78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:01:04 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-a0912485-7534-4b6b-ac77-f9346c4a20ff req-04338aa0-9e71-4885-9836-31240c308f5b service nova] Lock "5c18c0ad-60e5-4ef2-97f2-b7008e89ac78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:01:04 user nova-compute[75216]: DEBUG nova.compute.manager [req-a0912485-7534-4b6b-ac77-f9346c4a20ff req-04338aa0-9e71-4885-9836-31240c308f5b service nova] [instance: 5c18c0ad-60e5-4ef2-97f2-b7008e89ac78] No waiting events found dispatching network-vif-plugged-d92289be-85e7-4781-8889-2d0c7c38a9fa {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 19:01:04 user nova-compute[75216]: WARNING nova.compute.manager [req-a0912485-7534-4b6b-ac77-f9346c4a20ff req-04338aa0-9e71-4885-9836-31240c308f5b service nova] [instance: 5c18c0ad-60e5-4ef2-97f2-b7008e89ac78] Received unexpected event network-vif-plugged-d92289be-85e7-4781-8889-2d0c7c38a9fa for instance with vm_state building and task_state spawning.
Nov 13 19:01:05 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:01:05 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Cleaning up deleted instances {{(pid=75216) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 13 19:01:05 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] There are 0 instances to clean {{(pid=75216) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 13 19:01:06 user nova-compute[75216]: DEBUG nova.compute.manager [None req-ac99283f-818d-402f-b988-a5e81c5bf9c0 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: 5c18c0ad-60e5-4ef2-97f2-b7008e89ac78] Instance event wait completed in 0 seconds for  {{(pid=75216) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 19:01:06 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-ac99283f-818d-402f-b988-a5e81c5bf9c0 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: 5c18c0ad-60e5-4ef2-97f2-b7008e89ac78] Guest created on hypervisor {{(pid=75216) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 19:01:06 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 5c18c0ad-60e5-4ef2-97f2-b7008e89ac78] Instance spawned successfully.
Nov 13 19:01:06 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-ac99283f-818d-402f-b988-a5e81c5bf9c0 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: 5c18c0ad-60e5-4ef2-97f2-b7008e89ac78] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 19:01:06 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-ac99283f-818d-402f-b988-a5e81c5bf9c0 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: 5c18c0ad-60e5-4ef2-97f2-b7008e89ac78] Found default for hw_cdrom_bus of ide {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 19:01:06 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-ac99283f-818d-402f-b988-a5e81c5bf9c0 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: 5c18c0ad-60e5-4ef2-97f2-b7008e89ac78] Found default for hw_disk_bus of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 19:01:06 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-ac99283f-818d-402f-b988-a5e81c5bf9c0 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: 5c18c0ad-60e5-4ef2-97f2-b7008e89ac78] Found default for hw_input_bus of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 19:01:06 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-ac99283f-818d-402f-b988-a5e81c5bf9c0 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: 5c18c0ad-60e5-4ef2-97f2-b7008e89ac78] Found default for hw_pointer_model of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 19:01:06 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-ac99283f-818d-402f-b988-a5e81c5bf9c0 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: 5c18c0ad-60e5-4ef2-97f2-b7008e89ac78] Found default for hw_video_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 19:01:06 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-ac99283f-818d-402f-b988-a5e81c5bf9c0 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: 5c18c0ad-60e5-4ef2-97f2-b7008e89ac78] Found default for hw_vif_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 19:01:06 user nova-compute[75216]: INFO nova.compute.manager [None req-ac99283f-818d-402f-b988-a5e81c5bf9c0 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: 5c18c0ad-60e5-4ef2-97f2-b7008e89ac78] Took 4.95 seconds to spawn the instance on the hypervisor.
Nov 13 19:01:06 user nova-compute[75216]: DEBUG nova.compute.manager [None req-ac99283f-818d-402f-b988-a5e81c5bf9c0 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: 5c18c0ad-60e5-4ef2-97f2-b7008e89ac78] Checking state {{(pid=75216) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 19:01:06 user nova-compute[75216]: INFO nova.compute.manager [None req-ac99283f-818d-402f-b988-a5e81c5bf9c0 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: 5c18c0ad-60e5-4ef2-97f2-b7008e89ac78] Took 5.62 seconds to build instance.
Nov 13 19:01:06 user nova-compute[75216]: DEBUG nova.compute.manager [req-9c5e6860-e4be-4759-ad50-47ef83c0e285 req-3c2dc04b-1c05-4961-b10d-9df4650b4d2f service nova] [instance: 5c18c0ad-60e5-4ef2-97f2-b7008e89ac78] Received event network-vif-plugged-d92289be-85e7-4781-8889-2d0c7c38a9fa {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:01:06 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-9c5e6860-e4be-4759-ad50-47ef83c0e285 req-3c2dc04b-1c05-4961-b10d-9df4650b4d2f service nova] Acquiring lock "5c18c0ad-60e5-4ef2-97f2-b7008e89ac78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:01:06 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-9c5e6860-e4be-4759-ad50-47ef83c0e285 req-3c2dc04b-1c05-4961-b10d-9df4650b4d2f service nova] Lock "5c18c0ad-60e5-4ef2-97f2-b7008e89ac78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:01:06 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-9c5e6860-e4be-4759-ad50-47ef83c0e285 req-3c2dc04b-1c05-4961-b10d-9df4650b4d2f service nova] Lock "5c18c0ad-60e5-4ef2-97f2-b7008e89ac78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:01:06 user nova-compute[75216]: DEBUG nova.compute.manager [req-9c5e6860-e4be-4759-ad50-47ef83c0e285 req-3c2dc04b-1c05-4961-b10d-9df4650b4d2f service nova] [instance: 5c18c0ad-60e5-4ef2-97f2-b7008e89ac78] No waiting events found dispatching network-vif-plugged-d92289be-85e7-4781-8889-2d0c7c38a9fa {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 19:01:06 user nova-compute[75216]: WARNING nova.compute.manager [req-9c5e6860-e4be-4759-ad50-47ef83c0e285 req-3c2dc04b-1c05-4961-b10d-9df4650b4d2f service nova] [instance: 5c18c0ad-60e5-4ef2-97f2-b7008e89ac78] Received unexpected event network-vif-plugged-d92289be-85e7-4781-8889-2d0c7c38a9fa for instance with vm_state active and task_state None.
Nov 13 19:01:06 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-ac99283f-818d-402f-b988-a5e81c5bf9c0 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Lock "5c18c0ad-60e5-4ef2-97f2-b7008e89ac78" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.710s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:01:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:01:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:01:13 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:01:17 user nova-compute[75216]: DEBUG nova.compute.manager [req-bede0241-701a-4b9a-9a21-dbf345ab46b4 req-c6432f63-6520-475d-867c-95a7c881c700 service nova] [instance: 71134725-e6cc-4426-b2c2-5be4991c53f7] Received event network-changed-a1fda64d-c09d-45d7-b1ae-be416c60918d {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:01:17 user nova-compute[75216]: DEBUG nova.compute.manager [req-bede0241-701a-4b9a-9a21-dbf345ab46b4 req-c6432f63-6520-475d-867c-95a7c881c700 service nova] [instance: 71134725-e6cc-4426-b2c2-5be4991c53f7] Refreshing instance network info cache due to event network-changed-a1fda64d-c09d-45d7-b1ae-be416c60918d. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 19:01:17 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-bede0241-701a-4b9a-9a21-dbf345ab46b4 req-c6432f63-6520-475d-867c-95a7c881c700 service nova] Acquiring lock "refresh_cache-71134725-e6cc-4426-b2c2-5be4991c53f7" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 19:01:17 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-bede0241-701a-4b9a-9a21-dbf345ab46b4 req-c6432f63-6520-475d-867c-95a7c881c700 service nova] Acquired lock "refresh_cache-71134725-e6cc-4426-b2c2-5be4991c53f7" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 19:01:17 user nova-compute[75216]: DEBUG nova.network.neutron [req-bede0241-701a-4b9a-9a21-dbf345ab46b4 req-c6432f63-6520-475d-867c-95a7c881c700 service nova] [instance: 71134725-e6cc-4426-b2c2-5be4991c53f7] Refreshing network info cache for port a1fda64d-c09d-45d7-b1ae-be416c60918d {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 19:01:18 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:01:18 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:01:18 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75216) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 19:01:18 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 19:01:18 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 19:01:18 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:01:18 user nova-compute[75216]: DEBUG nova.network.neutron [req-bede0241-701a-4b9a-9a21-dbf345ab46b4 req-c6432f63-6520-475d-867c-95a7c881c700 service nova] [instance: 71134725-e6cc-4426-b2c2-5be4991c53f7] Updated VIF entry in instance network info cache for port a1fda64d-c09d-45d7-b1ae-be416c60918d. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 19:01:18 user nova-compute[75216]: DEBUG nova.network.neutron [req-bede0241-701a-4b9a-9a21-dbf345ab46b4 req-c6432f63-6520-475d-867c-95a7c881c700 service nova] [instance: 71134725-e6cc-4426-b2c2-5be4991c53f7] Updating instance_info_cache with network_info: [{"id": "a1fda64d-c09d-45d7-b1ae-be416c60918d", "address": "fa:16:3e:bd:0d:c9", "network": {"id": "8cbeb1cc-a067-4c8d-82d8-0dc5c2ac924c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-742672345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a58d1e76a793406bbdd3821ff74abd92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1fda64d-c0", "ovs_interfaceid": "a1fda64d-c09d-45d7-b1ae-be416c60918d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:01:18 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-bede0241-701a-4b9a-9a21-dbf345ab46b4 req-c6432f63-6520-475d-867c-95a7c881c700 service nova] Releasing lock "refresh_cache-71134725-e6cc-4426-b2c2-5be4991c53f7" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 19:01:18 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:01:20 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-4b4f9c1c-9a94-4f67-a67e-369601531df6 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Acquiring lock "71134725-e6cc-4426-b2c2-5be4991c53f7" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:01:20 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-4b4f9c1c-9a94-4f67-a67e-369601531df6 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Lock "71134725-e6cc-4426-b2c2-5be4991c53f7" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:01:20 user nova-compute[75216]: INFO nova.compute.manager [None req-4b4f9c1c-9a94-4f67-a67e-369601531df6 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] [instance: 71134725-e6cc-4426-b2c2-5be4991c53f7] Shelving
Nov 13 19:01:20 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:01:20 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:01:20 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:01:20 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:01:20 user nova-compute[75216]: DEBUG nova.compute.manager [req-79ee184a-37a0-4428-acd5-6aab5a07e7cc req-ec812853-c420-4e9a-9b47-3640e114119b service nova] [instance: 71134725-e6cc-4426-b2c2-5be4991c53f7] Received event network-vif-unplugged-a1fda64d-c09d-45d7-b1ae-be416c60918d {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:01:20 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-79ee184a-37a0-4428-acd5-6aab5a07e7cc req-ec812853-c420-4e9a-9b47-3640e114119b service nova] Acquiring lock "71134725-e6cc-4426-b2c2-5be4991c53f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:01:20 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-79ee184a-37a0-4428-acd5-6aab5a07e7cc req-ec812853-c420-4e9a-9b47-3640e114119b service nova] Lock "71134725-e6cc-4426-b2c2-5be4991c53f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:01:20 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-79ee184a-37a0-4428-acd5-6aab5a07e7cc req-ec812853-c420-4e9a-9b47-3640e114119b service nova] Lock "71134725-e6cc-4426-b2c2-5be4991c53f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:01:20 user nova-compute[75216]: DEBUG nova.compute.manager [req-79ee184a-37a0-4428-acd5-6aab5a07e7cc req-ec812853-c420-4e9a-9b47-3640e114119b service nova] [instance: 71134725-e6cc-4426-b2c2-5be4991c53f7] No waiting events found dispatching network-vif-unplugged-a1fda64d-c09d-45d7-b1ae-be416c60918d {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 19:01:20 user nova-compute[75216]: WARNING nova.compute.manager [req-79ee184a-37a0-4428-acd5-6aab5a07e7cc req-ec812853-c420-4e9a-9b47-3640e114119b service nova] [instance: 71134725-e6cc-4426-b2c2-5be4991c53f7] Received unexpected event network-vif-unplugged-a1fda64d-c09d-45d7-b1ae-be416c60918d for instance with vm_state active and task_state shelving.
Nov 13 19:01:21 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 71134725-e6cc-4426-b2c2-5be4991c53f7] Instance destroyed successfully.
Nov 13 19:01:21 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-4b4f9c1c-9a94-4f67-a67e-369601531df6 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] [instance: 71134725-e6cc-4426-b2c2-5be4991c53f7] Beginning cold snapshot process
Nov 13 19:01:21 user nova-compute[75216]: DEBUG nova.privsep.utils [None req-4b4f9c1c-9a94-4f67-a67e-369601531df6 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75216) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 13 19:01:21 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-4b4f9c1c-9a94-4f67-a67e-369601531df6 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/71134725-e6cc-4426-b2c2-5be4991c53f7/disk /opt/stack/data/nova/instances/snapshots/tmpfop3ttm_/ef26235fc58d47c692192ef5166b0889 {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:01:22 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-4b4f9c1c-9a94-4f67-a67e-369601531df6 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/71134725-e6cc-4426-b2c2-5be4991c53f7/disk /opt/stack/data/nova/instances/snapshots/tmpfop3ttm_/ef26235fc58d47c692192ef5166b0889" returned: 0 in 0.434s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:01:22 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-4b4f9c1c-9a94-4f67-a67e-369601531df6 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] [instance: 71134725-e6cc-4426-b2c2-5be4991c53f7] Snapshot extracted, beginning image upload
Nov 13 19:01:22 user nova-compute[75216]: DEBUG nova.compute.manager [req-a0960251-feb0-410c-86c3-069275632742 req-d875deda-1a6d-4daf-b7aa-466c4d07971c service nova] [instance: 71134725-e6cc-4426-b2c2-5be4991c53f7] Received event network-vif-plugged-a1fda64d-c09d-45d7-b1ae-be416c60918d {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:01:22 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-a0960251-feb0-410c-86c3-069275632742 req-d875deda-1a6d-4daf-b7aa-466c4d07971c service nova] Acquiring lock "71134725-e6cc-4426-b2c2-5be4991c53f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:01:22 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-a0960251-feb0-410c-86c3-069275632742 req-d875deda-1a6d-4daf-b7aa-466c4d07971c service nova] Lock "71134725-e6cc-4426-b2c2-5be4991c53f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:01:22 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-a0960251-feb0-410c-86c3-069275632742 req-d875deda-1a6d-4daf-b7aa-466c4d07971c service nova] Lock "71134725-e6cc-4426-b2c2-5be4991c53f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:01:22 user nova-compute[75216]: DEBUG nova.compute.manager [req-a0960251-feb0-410c-86c3-069275632742 req-d875deda-1a6d-4daf-b7aa-466c4d07971c service nova] [instance: 71134725-e6cc-4426-b2c2-5be4991c53f7] No waiting events found dispatching network-vif-plugged-a1fda64d-c09d-45d7-b1ae-be416c60918d {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 19:01:22 user nova-compute[75216]: WARNING nova.compute.manager [req-a0960251-feb0-410c-86c3-069275632742 req-d875deda-1a6d-4daf-b7aa-466c4d07971c service nova] [instance: 71134725-e6cc-4426-b2c2-5be4991c53f7] Received unexpected event network-vif-plugged-a1fda64d-c09d-45d7-b1ae-be416c60918d for instance with vm_state active and task_state shelving_image_uploading.
Nov 13 19:01:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:01:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:01:24 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-4b4f9c1c-9a94-4f67-a67e-369601531df6 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] [instance: 71134725-e6cc-4426-b2c2-5be4991c53f7] Snapshot image upload complete
Nov 13 19:01:24 user nova-compute[75216]: DEBUG nova.compute.manager [None req-4b4f9c1c-9a94-4f67-a67e-369601531df6 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] [instance: 71134725-e6cc-4426-b2c2-5be4991c53f7] Checking state {{(pid=75216) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 19:01:24 user nova-compute[75216]: INFO nova.compute.manager [None req-4b4f9c1c-9a94-4f67-a67e-369601531df6 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] [instance: 71134725-e6cc-4426-b2c2-5be4991c53f7] Shelve offloading
Nov 13 19:01:24 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 71134725-e6cc-4426-b2c2-5be4991c53f7] Instance destroyed successfully.
Nov 13 19:01:24 user nova-compute[75216]: DEBUG nova.compute.manager [None req-4b4f9c1c-9a94-4f67-a67e-369601531df6 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] [instance: 71134725-e6cc-4426-b2c2-5be4991c53f7] Checking state {{(pid=75216) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 19:01:24 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-4b4f9c1c-9a94-4f67-a67e-369601531df6 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Acquiring lock "refresh_cache-71134725-e6cc-4426-b2c2-5be4991c53f7" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 19:01:24 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-4b4f9c1c-9a94-4f67-a67e-369601531df6 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Acquired lock "refresh_cache-71134725-e6cc-4426-b2c2-5be4991c53f7" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 19:01:24 user nova-compute[75216]: DEBUG nova.network.neutron [None req-4b4f9c1c-9a94-4f67-a67e-369601531df6 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] [instance: 71134725-e6cc-4426-b2c2-5be4991c53f7] Building network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 19:01:25 user nova-compute[75216]: DEBUG nova.network.neutron [None req-4b4f9c1c-9a94-4f67-a67e-369601531df6 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] [instance: 71134725-e6cc-4426-b2c2-5be4991c53f7] Updating instance_info_cache with network_info: [{"id": "a1fda64d-c09d-45d7-b1ae-be416c60918d", "address": "fa:16:3e:bd:0d:c9", "network": {"id": "8cbeb1cc-a067-4c8d-82d8-0dc5c2ac924c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-742672345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a58d1e76a793406bbdd3821ff74abd92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1fda64d-c0", "ovs_interfaceid": "a1fda64d-c09d-45d7-b1ae-be416c60918d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:01:25 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-4b4f9c1c-9a94-4f67-a67e-369601531df6 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Releasing lock "refresh_cache-71134725-e6cc-4426-b2c2-5be4991c53f7" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 19:01:25 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 71134725-e6cc-4426-b2c2-5be4991c53f7] Instance destroyed successfully.
Nov 13 19:01:25 user nova-compute[75216]: DEBUG nova.objects.instance [None req-4b4f9c1c-9a94-4f67-a67e-369601531df6 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Lazy-loading 'resources' on Instance uuid 71134725-e6cc-4426-b2c2-5be4991c53f7 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:01:25 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-4b4f9c1c-9a94-4f67-a67e-369601531df6 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T18:59:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-617465978',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-617465978',id=26,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA6jERmHhwdzykQUbYQt2L5Y0wAwzhuoXtCyCIVaBHNHP63oR5trgspDL2RAZ8jteIRJfyEGc5Jooh7DEaXc2Dx/nzho69SJjdngZ26XtMGqh2TmVh3lXYk7mlLT7W85cQ==',key_name='tempest-keypair-1201518352',keypairs=<?>,launch_index=0,launched_at=2023-11-13T18:59:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='a58d1e76a793406bbdd3821ff74abd92',ramdisk_id='',reservation_id='r-04yvplgw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1861834155',owner_user_name='tempest-AttachVolumeShelveTestJSON-1861834155-project-member',shelved_at='2023-11-13T19:01:24.483533',shelved_host='user',shelved_image_id='6e7de34d-221f-437b-85d0-70c21dd9f47a'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T19:01:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e59bd525db64698b8e3587734cde6b8',uuid=71134725-e6cc-4426-b2c2-5be4991c53f7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "a1fda64d-c09d-45d7-b1ae-be416c60918d", "address": "fa:16:3e:bd:0d:c9", "network": {"id": "8cbeb1cc-a067-4c8d-82d8-0dc5c2ac924c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-742672345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a58d1e76a793406bbdd3821ff74abd92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1fda64d-c0", "ovs_interfaceid": "a1fda64d-c09d-45d7-b1ae-be416c60918d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 19:01:25 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-4b4f9c1c-9a94-4f67-a67e-369601531df6 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Converting VIF {"id": "a1fda64d-c09d-45d7-b1ae-be416c60918d", "address": "fa:16:3e:bd:0d:c9", "network": {"id": "8cbeb1cc-a067-4c8d-82d8-0dc5c2ac924c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-742672345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a58d1e76a793406bbdd3821ff74abd92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1fda64d-c0", "ovs_interfaceid": "a1fda64d-c09d-45d7-b1ae-be416c60918d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 19:01:25 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-4b4f9c1c-9a94-4f67-a67e-369601531df6 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:0d:c9,bridge_name='br-int',has_traffic_filtering=True,id=a1fda64d-c09d-45d7-b1ae-be416c60918d,network=Network(8cbeb1cc-a067-4c8d-82d8-0dc5c2ac924c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1fda64d-c0') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 19:01:25 user nova-compute[75216]: DEBUG os_vif [None req-4b4f9c1c-9a94-4f67-a67e-369601531df6 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:0d:c9,bridge_name='br-int',has_traffic_filtering=True,id=a1fda64d-c09d-45d7-b1ae-be416c60918d,network=Network(8cbeb1cc-a067-4c8d-82d8-0dc5c2ac924c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1fda64d-c0') {{(pid=75216) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 19:01:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:01:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa1fda64d-c0, bridge=br-int, if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:01:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:01:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:01:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=82864bb3-b022-45d9-9d6f-a502f9d324ca) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:01:25 user nova-compute[75216]: DEBUG nova.compute.manager [req-e3add429-e6d1-4c0b-a7b7-9ff679b9672e req-82fe4540-3603-41cf-94e1-18bab114bcb2 service nova] [instance: 71134725-e6cc-4426-b2c2-5be4991c53f7] Received event network-changed-a1fda64d-c09d-45d7-b1ae-be416c60918d {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:01:25 user nova-compute[75216]: DEBUG nova.compute.manager [req-e3add429-e6d1-4c0b-a7b7-9ff679b9672e req-82fe4540-3603-41cf-94e1-18bab114bcb2 service nova] [instance: 71134725-e6cc-4426-b2c2-5be4991c53f7] Refreshing instance network info cache due to event network-changed-a1fda64d-c09d-45d7-b1ae-be416c60918d. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 19:01:25 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-e3add429-e6d1-4c0b-a7b7-9ff679b9672e req-82fe4540-3603-41cf-94e1-18bab114bcb2 service nova] Acquiring lock "refresh_cache-71134725-e6cc-4426-b2c2-5be4991c53f7" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 19:01:25 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-e3add429-e6d1-4c0b-a7b7-9ff679b9672e req-82fe4540-3603-41cf-94e1-18bab114bcb2 service nova] Acquired lock "refresh_cache-71134725-e6cc-4426-b2c2-5be4991c53f7" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 19:01:25 user nova-compute[75216]: DEBUG nova.network.neutron [req-e3add429-e6d1-4c0b-a7b7-9ff679b9672e req-82fe4540-3603-41cf-94e1-18bab114bcb2 service nova] [instance: 71134725-e6cc-4426-b2c2-5be4991c53f7] Refreshing network info cache for port a1fda64d-c09d-45d7-b1ae-be416c60918d {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 19:01:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:01:25 user nova-compute[75216]: INFO os_vif [None req-4b4f9c1c-9a94-4f67-a67e-369601531df6 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:0d:c9,bridge_name='br-int',has_traffic_filtering=True,id=a1fda64d-c09d-45d7-b1ae-be416c60918d,network=Network(8cbeb1cc-a067-4c8d-82d8-0dc5c2ac924c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1fda64d-c0')
Nov 13 19:01:25 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-4b4f9c1c-9a94-4f67-a67e-369601531df6 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] [instance: 71134725-e6cc-4426-b2c2-5be4991c53f7] Deleting instance files /opt/stack/data/nova/instances/71134725-e6cc-4426-b2c2-5be4991c53f7_del
Nov 13 19:01:25 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-4b4f9c1c-9a94-4f67-a67e-369601531df6 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] [instance: 71134725-e6cc-4426-b2c2-5be4991c53f7] Deletion of /opt/stack/data/nova/instances/71134725-e6cc-4426-b2c2-5be4991c53f7_del complete
Nov 13 19:01:25 user nova-compute[75216]: INFO nova.scheduler.client.report [None req-4b4f9c1c-9a94-4f67-a67e-369601531df6 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Deleted allocations for instance 71134725-e6cc-4426-b2c2-5be4991c53f7
Nov 13 19:01:25 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-4b4f9c1c-9a94-4f67-a67e-369601531df6 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:01:25 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-4b4f9c1c-9a94-4f67-a67e-369601531df6 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:01:25 user nova-compute[75216]: DEBUG nova.objects.instance [None req-4b4f9c1c-9a94-4f67-a67e-369601531df6 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Lazy-loading 'numa_topology' on Instance uuid 71134725-e6cc-4426-b2c2-5be4991c53f7 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:01:25 user nova-compute[75216]: DEBUG nova.objects.base [None req-4b4f9c1c-9a94-4f67-a67e-369601531df6 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Object Instance<71134725-e6cc-4426-b2c2-5be4991c53f7> lazy-loaded attributes: resources,numa_topology {{(pid=75216) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 19:01:26 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-4b4f9c1c-9a94-4f67-a67e-369601531df6 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 19:01:26 user nova-compute[75216]: DEBUG nova.network.neutron [req-e3add429-e6d1-4c0b-a7b7-9ff679b9672e req-82fe4540-3603-41cf-94e1-18bab114bcb2 service nova] [instance: 71134725-e6cc-4426-b2c2-5be4991c53f7] Updated VIF entry in instance network info cache for port a1fda64d-c09d-45d7-b1ae-be416c60918d. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 19:01:26 user nova-compute[75216]: DEBUG nova.network.neutron [req-e3add429-e6d1-4c0b-a7b7-9ff679b9672e req-82fe4540-3603-41cf-94e1-18bab114bcb2 service nova] [instance: 71134725-e6cc-4426-b2c2-5be4991c53f7] Updating instance_info_cache with network_info: [{"id": "a1fda64d-c09d-45d7-b1ae-be416c60918d", "address": "fa:16:3e:bd:0d:c9", "network": {"id": "8cbeb1cc-a067-4c8d-82d8-0dc5c2ac924c", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-742672345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a58d1e76a793406bbdd3821ff74abd92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapa1fda64d-c0", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:01:26 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-4b4f9c1c-9a94-4f67-a67e-369601531df6 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 19:01:26 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-e3add429-e6d1-4c0b-a7b7-9ff679b9672e req-82fe4540-3603-41cf-94e1-18bab114bcb2 service nova] Releasing lock "refresh_cache-71134725-e6cc-4426-b2c2-5be4991c53f7" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 19:01:26 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-4b4f9c1c-9a94-4f67-a67e-369601531df6 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.288s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:01:26 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-4b4f9c1c-9a94-4f67-a67e-369601531df6 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Lock "71134725-e6cc-4426-b2c2-5be4991c53f7" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 5.691s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:01:26 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-21b3a4df-3539-4e60-a99e-0c974202e1a5 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Acquiring lock "af8089f7-6dc3-4655-9369-2177dbd7bf4d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:01:26 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-21b3a4df-3539-4e60-a99e-0c974202e1a5 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Lock "af8089f7-6dc3-4655-9369-2177dbd7bf4d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:01:26 user nova-compute[75216]: DEBUG nova.objects.instance [None req-21b3a4df-3539-4e60-a99e-0c974202e1a5 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Lazy-loading 'flavor' on Instance uuid af8089f7-6dc3-4655-9369-2177dbd7bf4d {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:01:26 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-21b3a4df-3539-4e60-a99e-0c974202e1a5 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Lock "af8089f7-6dc3-4655-9369-2177dbd7bf4d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:01:27 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-21b3a4df-3539-4e60-a99e-0c974202e1a5 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Acquiring lock "af8089f7-6dc3-4655-9369-2177dbd7bf4d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:01:27 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-21b3a4df-3539-4e60-a99e-0c974202e1a5 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Lock "af8089f7-6dc3-4655-9369-2177dbd7bf4d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:01:27 user nova-compute[75216]: INFO nova.compute.manager [None req-21b3a4df-3539-4e60-a99e-0c974202e1a5 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] [instance: af8089f7-6dc3-4655-9369-2177dbd7bf4d] Attaching volume 2dfdac0b-bc0c-4291-ae5c-8eb516d7b164 to /dev/vdb
Nov 13 19:01:27 user nova-compute[75216]: DEBUG os_brick.utils [None req-21b3a4df-3539-4e60-a99e-0c974202e1a5 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 19:01:27 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:01:27 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:01:27 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[da40e896-b1a5-4664-89ec-deadde6b7b4b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aea6fcfe14b9\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:01:27 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:01:27 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:01:27 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[b94b2190-dd0d-4a14-8363-9a08ed4a9b66]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:01:27 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:01:27 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:01:27 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e2c4385-dd15-4e22-ae50-dcb87c37339f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:01:27 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[1da37d13-82bb-4714-82dc-6fe8b704c4d0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:01:27 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-21b3a4df-3539-4e60-a99e-0c974202e1a5 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Running cmd (subprocess): nvme version {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:01:27 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-21b3a4df-3539-4e60-a99e-0c974202e1a5 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] 'nvme version' failed. Not Retrying. {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 19:01:27 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.nvmeof [None req-21b3a4df-3539-4e60-a99e-0c974202e1a5 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] nvme not present on system {{(pid=75216) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 19:01:27 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:01:27 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 19:01:27 user nova-compute[75216]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 19:01:27 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae3fd87a-8aa1-4e8f-854b-5970fdaafa30]: (4, '') {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:01:27 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-21b3a4df-3539-4e60-a99e-0c974202e1a5 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75216) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 19:01:27 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-21b3a4df-3539-4e60-a99e-0c974202e1a5 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 19:01:27 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-21b3a4df-3539-4e60-a99e-0c974202e1a5 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] LIGHTOS: no hostnqn found. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 19:01:27 user nova-compute[75216]: DEBUG os_brick.utils [None req-21b3a4df-3539-4e60-a99e-0c974202e1a5 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aea6fcfe14b9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 19:01:27 user nova-compute[75216]: DEBUG nova.virt.block_device [None req-21b3a4df-3539-4e60-a99e-0c974202e1a5 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] [instance: af8089f7-6dc3-4655-9369-2177dbd7bf4d] Updating existing volume attachment record: c37b1aee-1251-4421-873a-e159ad4fe2e4 {{(pid=75216) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 19:01:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:01:30 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:01:30 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:01:31 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-21b3a4df-3539-4e60-a99e-0c974202e1a5 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] [instance: af8089f7-6dc3-4655-9369-2177dbd7bf4d] Calling os-brick to attach iSCSI Volume {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 19:01:31 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-21b3a4df-3539-4e60-a99e-0c974202e1a5 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3a8669e40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2dfdac0b-bc0c-4291-ae5c-8eb516d7b164', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'otAVDyPL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 19:01:31 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-21b3a4df-3539-4e60-a99e-0c974202e1a5 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 19:01:31 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-21b3a4df-3539-4e60-a99e-0c974202e1a5 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 19:01:31 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-21b3a4df-3539-4e60-a99e-0c974202e1a5 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 19:01:31 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-21b3a4df-3539-4e60-a99e-0c974202e1a5 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 19:01:31 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-21b3a4df-3539-4e60-a99e-0c974202e1a5 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2dfdac0b-bc0c-4291-ae5c-8eb516d7b164" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 19:01:31 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-21b3a4df-3539-4e60-a99e-0c974202e1a5 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2dfdac0b-bc0c-4291-ae5c-8eb516d7b164" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 19:01:31 user nova-compute[75216]: INFO os_brick.initiator.connectors.iscsi [None req-21b3a4df-3539-4e60-a99e-0c974202e1a5 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 19:01:31 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2dfdac0b-bc0c-4291-ae5c-8eb516d7b164 -p 172.16.0.220:3260 {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:01:31 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2dfdac0b-bc0c-4291-ae5c-8eb516d7b164 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:01:31 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e8bed38-3963-4186-8f46-82f9588df399]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:01:31 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-21b3a4df-3539-4e60-a99e-0c974202e1a5 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 19:01:31 user nova-compute[75216]:  {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:01:31 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2dfdac0b-bc0c-4291-ae5c-8eb516d7b164 -p 172.16.0.220:3260 --interface default --op new {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:01:31 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2dfdac0b-bc0c-4291-ae5c-8eb516d7b164 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:01:31 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e0f560f-c6c8-478b-9f33-d78db60eeac9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2dfdac0b-bc0c-4291-ae5c-8eb516d7b164] added\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:01:31 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-21b3a4df-3539-4e60-a99e-0c974202e1a5 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2dfdac0b-bc0c-4291-ae5c-8eb516d7b164] added
Nov 13 19:01:31 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:01:31 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2dfdac0b-bc0c-4291-ae5c-8eb516d7b164 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:01:31 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2dfdac0b-bc0c-4291-ae5c-8eb516d7b164 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:01:31 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bedcccd-ba04-411f-8e87-c99283b2dcb8]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:01:31 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-21b3a4df-3539-4e60-a99e-0c974202e1a5 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:01:31 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2dfdac0b-bc0c-4291-ae5c-8eb516d7b164 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:01:31 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2dfdac0b-bc0c-4291-ae5c-8eb516d7b164 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:01:31 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[a64ffae2-d214-4a15-b67f-c714849ae2cc]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:01:31 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-21b3a4df-3539-4e60-a99e-0c974202e1a5 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:01:31 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2dfdac0b-bc0c-4291-ae5c-8eb516d7b164 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v otAVDyPL {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:01:31 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2dfdac0b-bc0c-4291-ae5c-8eb516d7b164 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v otAVDyPL" returned: 0 in 0.025s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:01:31 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[836af889-d5e1-4ed4-bac1-3b3098bbc65b]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:01:31 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-21b3a4df-3539-4e60-a99e-0c974202e1a5 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'otAVDyPL'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:01:31 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2dfdac0b-bc0c-4291-ae5c-8eb516d7b164 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:01:31 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2dfdac0b-bc0c-4291-ae5c-8eb516d7b164 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:01:31 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[daff1095-4dae-4ae6-97bb-37adc7680d4d]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:01:31 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-21b3a4df-3539-4e60-a99e-0c974202e1a5 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:01:31 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:01:31 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:01:31 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[41b472cd-460d-431d-a2b7-0bb1be3a58f6]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a7c3d74-e183-497b-b6c7-85be2b2f171e (non-flash)\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:01:31 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-21b3a4df-3539-4e60-a99e-0c974202e1a5 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1 (non-flash)
Nov 13 19:01:31 user nova-compute[75216]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a7c3d74-e183-497b-b6c7-85be2b2f171e (non-flash)
Nov 13 19:01:31 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 19:01:31 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-21b3a4df-3539-4e60-a99e-0c974202e1a5 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1 (non-flash)
Nov 13 19:01:31 user nova-compute[75216]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a7c3d74-e183-497b-b6c7-85be2b2f171e (non-flash)
Nov 13 19:01:31 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 19:01:31 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2dfdac0b-bc0c-4291-ae5c-8eb516d7b164 -p 172.16.0.220:3260 --login {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:01:31 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2dfdac0b-bc0c-4291-ae5c-8eb516d7b164 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:01:31 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9934930-4904-44e2-9c83-aa9373c9b959]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2dfdac0b-bc0c-4291-ae5c-8eb516d7b164, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2dfdac0b-bc0c-4291-ae5c-8eb516d7b164, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:01:31 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-21b3a4df-3539-4e60-a99e-0c974202e1a5 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2dfdac0b-bc0c-4291-ae5c-8eb516d7b164, portal: 172.16.0.220,3260]
Nov 13 19:01:31 user nova-compute[75216]: Login to [iface: default, target: iqn.2010-10.org.openstack:2dfdac0b-bc0c-4291-ae5c-8eb516d7b164, portal: 172.16.0.220,3260] successful.
Nov 13 19:01:31 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:01:31 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2dfdac0b-bc0c-4291-ae5c-8eb516d7b164 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:01:31 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2dfdac0b-bc0c-4291-ae5c-8eb516d7b164 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:01:31 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e6c3ad8-0af4-47be-9ca5-b0721d586830]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:01:31 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-21b3a4df-3539-4e60-a99e-0c974202e1a5 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:01:31 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:01:31 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:01:31 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[aff7d7c1-bf11-4194-acec-1fbc05d4ea2e]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a7c3d74-e183-497b-b6c7-85be2b2f171e (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dfdac0b-bc0c-4291-ae5c-8eb516d7b164 (non-flash)\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:01:31 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-21b3a4df-3539-4e60-a99e-0c974202e1a5 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1 (non-flash)
Nov 13 19:01:31 user nova-compute[75216]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a7c3d74-e183-497b-b6c7-85be2b2f171e (non-flash)
Nov 13 19:01:31 user nova-compute[75216]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dfdac0b-bc0c-4291-ae5c-8eb516d7b164 (non-flash)
Nov 13 19:01:31 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 19:01:31 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-21b3a4df-3539-4e60-a99e-0c974202e1a5 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1 (non-flash)
Nov 13 19:01:31 user nova-compute[75216]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a7c3d74-e183-497b-b6c7-85be2b2f171e (non-flash)
Nov 13 19:01:31 user nova-compute[75216]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dfdac0b-bc0c-4291-ae5c-8eb516d7b164 (non-flash)
Nov 13 19:01:31 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 19:01:31 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-21b3a4df-3539-4e60-a99e-0c974202e1a5 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2dfdac0b-bc0c-4291-ae5c-8eb516d7b164" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.275s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 19:01:31 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-21b3a4df-3539-4e60-a99e-0c974202e1a5 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Connected to 172.16.0.220:3260 {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 19:01:31 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-21b3a4df-3539-4e60-a99e-0c974202e1a5 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] HCTL ('34', '-', '-', 0) found on session 36 with lun 0 {{(pid=75216) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 19:01:31 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-21b3a4df-3539-4e60-a99e-0c974202e1a5 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75216) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 19:01:31 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:01:31 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:01:31 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ca1ee5e-6c08-4e3e-a1c5-dfcadc018666]: (4, ('- - 0', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:01:31 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-21b3a4df-3539-4e60-a99e-0c974202e1a5 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Searching for a device in session 36 and hctl ['34', '*', '*', 0] yield: None {{(pid=75216) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 19:01:32 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-21b3a4df-3539-4e60-a99e-0c974202e1a5 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Searching for a device in session 36 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75216) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 19:01:32 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-21b3a4df-3539-4e60-a99e-0c974202e1a5 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:2dfdac0b-bc0c-4291-ae5c-8eb516d7b164', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'otAVDyPL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 19:01:32 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-21b3a4df-3539-4e60-a99e-0c974202e1a5 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.304s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 19:01:32 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-21b3a4df-3539-4e60-a99e-0c974202e1a5 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] <== connect_volume: return (1305ms) {'type': 'block', 'scsi_wwn': '23630626430346665', 'path': '/dev/sdc'} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 19:01:32 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-21b3a4df-3539-4e60-a99e-0c974202e1a5 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] [instance: af8089f7-6dc3-4655-9369-2177dbd7bf4d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23630626430346665', 'path': '/dev/sdc'} {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 19:01:32 user nova-compute[75216]: DEBUG nova.objects.instance [None req-21b3a4df-3539-4e60-a99e-0c974202e1a5 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Lazy-loading 'flavor' on Instance uuid af8089f7-6dc3-4655-9369-2177dbd7bf4d {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:01:32 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-21b3a4df-3539-4e60-a99e-0c974202e1a5 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] attach device xml: <disk type="block" device="disk">
Nov 13 19:01:32 user nova-compute[75216]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 19:01:32 user nova-compute[75216]:   <source dev="/dev/sdc"/>
Nov 13 19:01:32 user nova-compute[75216]:   <target dev="vdb" bus="virtio"/>
Nov 13 19:01:32 user nova-compute[75216]:   <serial>2dfdac0b-bc0c-4291-ae5c-8eb516d7b164</serial>
Nov 13 19:01:32 user nova-compute[75216]: </disk>
Nov 13 19:01:32 user nova-compute[75216]:  {{(pid=75216) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 13 19:01:32 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-21b3a4df-3539-4e60-a99e-0c974202e1a5 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 19:01:32 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-21b3a4df-3539-4e60-a99e-0c974202e1a5 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 19:01:32 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-21b3a4df-3539-4e60-a99e-0c974202e1a5 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] No VIF found with MAC fa:16:3e:03:83:09, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 19:01:33 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-21b3a4df-3539-4e60-a99e-0c974202e1a5 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Lock "af8089f7-6dc3-4655-9369-2177dbd7bf4d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.021s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:01:33 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:01:35 user nova-compute[75216]: DEBUG nova.compute.manager [req-bb95252c-89d5-479b-9c73-16e693af8663 req-23d3cb75-cd9d-46f5-8cc1-1238abda0656 service nova] [instance: af8089f7-6dc3-4655-9369-2177dbd7bf4d] Received event network-changed-c26beff8-370e-431e-9a8c-d31c4ec912ec {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:01:35 user nova-compute[75216]: DEBUG nova.compute.manager [req-bb95252c-89d5-479b-9c73-16e693af8663 req-23d3cb75-cd9d-46f5-8cc1-1238abda0656 service nova] [instance: af8089f7-6dc3-4655-9369-2177dbd7bf4d] Refreshing instance network info cache due to event network-changed-c26beff8-370e-431e-9a8c-d31c4ec912ec. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 19:01:35 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-bb95252c-89d5-479b-9c73-16e693af8663 req-23d3cb75-cd9d-46f5-8cc1-1238abda0656 service nova] Acquiring lock "refresh_cache-af8089f7-6dc3-4655-9369-2177dbd7bf4d" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 19:01:35 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-bb95252c-89d5-479b-9c73-16e693af8663 req-23d3cb75-cd9d-46f5-8cc1-1238abda0656 service nova] Acquired lock "refresh_cache-af8089f7-6dc3-4655-9369-2177dbd7bf4d" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 19:01:35 user nova-compute[75216]: DEBUG nova.network.neutron [req-bb95252c-89d5-479b-9c73-16e693af8663 req-23d3cb75-cd9d-46f5-8cc1-1238abda0656 service nova] [instance: af8089f7-6dc3-4655-9369-2177dbd7bf4d] Refreshing network info cache for port c26beff8-370e-431e-9a8c-d31c4ec912ec {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 19:01:35 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:01:36 user nova-compute[75216]: DEBUG nova.network.neutron [req-bb95252c-89d5-479b-9c73-16e693af8663 req-23d3cb75-cd9d-46f5-8cc1-1238abda0656 service nova] [instance: af8089f7-6dc3-4655-9369-2177dbd7bf4d] Updated VIF entry in instance network info cache for port c26beff8-370e-431e-9a8c-d31c4ec912ec. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 19:01:36 user nova-compute[75216]: DEBUG nova.network.neutron [req-bb95252c-89d5-479b-9c73-16e693af8663 req-23d3cb75-cd9d-46f5-8cc1-1238abda0656 service nova] [instance: af8089f7-6dc3-4655-9369-2177dbd7bf4d] Updating instance_info_cache with network_info: [{"id": "c26beff8-370e-431e-9a8c-d31c4ec912ec", "address": "fa:16:3e:03:83:09", "network": {"id": "fea11c73-0074-4971-8b36-0aced430c730", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1420832282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84d0223a97ff4ecab9bf4273e3e465a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc26beff8-37", "ovs_interfaceid": "c26beff8-370e-431e-9a8c-d31c4ec912ec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:01:36 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-bb95252c-89d5-479b-9c73-16e693af8663 req-23d3cb75-cd9d-46f5-8cc1-1238abda0656 service nova] Releasing lock "refresh_cache-af8089f7-6dc3-4655-9369-2177dbd7bf4d" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 19:01:36 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:01:36 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-cdbd03f1-e943-42df-88ff-cc9a439a1c29 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Acquiring lock "d589d57e-de50-482a-843f-e8246b3d7528" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:01:36 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-cdbd03f1-e943-42df-88ff-cc9a439a1c29 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Lock "d589d57e-de50-482a-843f-e8246b3d7528" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:01:36 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-cdbd03f1-e943-42df-88ff-cc9a439a1c29 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Acquiring lock "d589d57e-de50-482a-843f-e8246b3d7528-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:01:36 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-cdbd03f1-e943-42df-88ff-cc9a439a1c29 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Lock "d589d57e-de50-482a-843f-e8246b3d7528-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:01:36 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-cdbd03f1-e943-42df-88ff-cc9a439a1c29 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Lock "d589d57e-de50-482a-843f-e8246b3d7528-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:01:36 user nova-compute[75216]: INFO nova.compute.manager [None req-cdbd03f1-e943-42df-88ff-cc9a439a1c29 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] [instance: d589d57e-de50-482a-843f-e8246b3d7528] Terminating instance
Nov 13 19:01:36 user nova-compute[75216]: DEBUG nova.compute.manager [None req-cdbd03f1-e943-42df-88ff-cc9a439a1c29 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] [instance: d589d57e-de50-482a-843f-e8246b3d7528] Start destroying the instance on the hypervisor. {{(pid=75216) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 19:01:36 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:01:36 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:01:36 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:01:36 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:01:36 user nova-compute[75216]: DEBUG nova.compute.manager [req-0e4cec2e-db2c-4c1c-8030-c1c744ec19c8 req-c4473973-81fe-4ba8-8485-b1a247c76363 service nova] [instance: d589d57e-de50-482a-843f-e8246b3d7528] Received event network-vif-unplugged-87426a6f-0164-4df3-aad0-becbbbfe8310 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:01:36 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-0e4cec2e-db2c-4c1c-8030-c1c744ec19c8 req-c4473973-81fe-4ba8-8485-b1a247c76363 service nova] Acquiring lock "d589d57e-de50-482a-843f-e8246b3d7528-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:01:36 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-0e4cec2e-db2c-4c1c-8030-c1c744ec19c8 req-c4473973-81fe-4ba8-8485-b1a247c76363 service nova] Lock "d589d57e-de50-482a-843f-e8246b3d7528-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:01:36 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-0e4cec2e-db2c-4c1c-8030-c1c744ec19c8 req-c4473973-81fe-4ba8-8485-b1a247c76363 service nova] Lock "d589d57e-de50-482a-843f-e8246b3d7528-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:01:36 user nova-compute[75216]: DEBUG nova.compute.manager [req-0e4cec2e-db2c-4c1c-8030-c1c744ec19c8 req-c4473973-81fe-4ba8-8485-b1a247c76363 service nova] [instance: d589d57e-de50-482a-843f-e8246b3d7528] No waiting events found dispatching network-vif-unplugged-87426a6f-0164-4df3-aad0-becbbbfe8310 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 19:01:36 user nova-compute[75216]: DEBUG nova.compute.manager [req-0e4cec2e-db2c-4c1c-8030-c1c744ec19c8 req-c4473973-81fe-4ba8-8485-b1a247c76363 service nova] [instance: d589d57e-de50-482a-843f-e8246b3d7528] Received event network-vif-unplugged-87426a6f-0164-4df3-aad0-becbbbfe8310 for instance with task_state deleting. {{(pid=75216) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 19:01:37 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: d589d57e-de50-482a-843f-e8246b3d7528] Instance destroyed successfully.
Nov 13 19:01:37 user nova-compute[75216]: DEBUG nova.objects.instance [None req-cdbd03f1-e943-42df-88ff-cc9a439a1c29 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Lazy-loading 'resources' on Instance uuid d589d57e-de50-482a-843f-e8246b3d7528 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:01:37 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-cdbd03f1-e943-42df-88ff-cc9a439a1c29 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T18:44:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2144084973',display_name='tempest-ServerRescueNegativeTestJSON-server-2144084973',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2144084973',id=3,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-13T18:49:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2efafc26c47c4050bd367c47469999fb',ramdisk_id='',reservation_id='r-4hj1xmlx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-165310019',owner_user_name='tempest-ServerRescueNegativeTestJSON-165310019-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T18:51:30Z,user_data=None,user_id='3587565f5b56450e95f2bd572d7e4f88',uuid=d589d57e-de50-482a-843f-e8246b3d7528,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "87426a6f-0164-4df3-aad0-becbbbfe8310", "address": "fa:16:3e:64:4d:81", "network": {"id": "6d182db1-03b5-4d1b-86cf-b9367921b7b0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1877006951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2efafc26c47c4050bd367c47469999fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87426a6f-01", "ovs_interfaceid": "87426a6f-0164-4df3-aad0-becbbbfe8310", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 19:01:37 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-cdbd03f1-e943-42df-88ff-cc9a439a1c29 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Converting VIF {"id": "87426a6f-0164-4df3-aad0-becbbbfe8310", "address": "fa:16:3e:64:4d:81", "network": {"id": "6d182db1-03b5-4d1b-86cf-b9367921b7b0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1877006951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2efafc26c47c4050bd367c47469999fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87426a6f-01", "ovs_interfaceid": "87426a6f-0164-4df3-aad0-becbbbfe8310", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 19:01:37 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-cdbd03f1-e943-42df-88ff-cc9a439a1c29 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:64:4d:81,bridge_name='br-int',has_traffic_filtering=True,id=87426a6f-0164-4df3-aad0-becbbbfe8310,network=Network(6d182db1-03b5-4d1b-86cf-b9367921b7b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87426a6f-01') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 19:01:37 user nova-compute[75216]: DEBUG os_vif [None req-cdbd03f1-e943-42df-88ff-cc9a439a1c29 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:64:4d:81,bridge_name='br-int',has_traffic_filtering=True,id=87426a6f-0164-4df3-aad0-becbbbfe8310,network=Network(6d182db1-03b5-4d1b-86cf-b9367921b7b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87426a6f-01') {{(pid=75216) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 19:01:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:01:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap87426a6f-01, bridge=br-int, if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:01:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:01:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:01:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:01:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c8c9eac1-e5b4-4bd1-bb11-7e5356f6fa1f) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:01:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:01:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:01:37 user nova-compute[75216]: INFO os_vif [None req-cdbd03f1-e943-42df-88ff-cc9a439a1c29 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:64:4d:81,bridge_name='br-int',has_traffic_filtering=True,id=87426a6f-0164-4df3-aad0-becbbbfe8310,network=Network(6d182db1-03b5-4d1b-86cf-b9367921b7b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87426a6f-01')
Nov 13 19:01:37 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-cdbd03f1-e943-42df-88ff-cc9a439a1c29 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] [instance: d589d57e-de50-482a-843f-e8246b3d7528] Deleting instance files /opt/stack/data/nova/instances/d589d57e-de50-482a-843f-e8246b3d7528_del
Nov 13 19:01:37 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-cdbd03f1-e943-42df-88ff-cc9a439a1c29 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] [instance: d589d57e-de50-482a-843f-e8246b3d7528] Deletion of /opt/stack/data/nova/instances/d589d57e-de50-482a-843f-e8246b3d7528_del complete
Nov 13 19:01:37 user nova-compute[75216]: INFO nova.compute.manager [None req-cdbd03f1-e943-42df-88ff-cc9a439a1c29 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] [instance: d589d57e-de50-482a-843f-e8246b3d7528] Took 0.90 seconds to destroy the instance on the hypervisor.
Nov 13 19:01:37 user nova-compute[75216]: DEBUG oslo.service.loopingcall [None req-cdbd03f1-e943-42df-88ff-cc9a439a1c29 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75216) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 19:01:37 user nova-compute[75216]: DEBUG nova.compute.manager [-] [instance: d589d57e-de50-482a-843f-e8246b3d7528] Deallocating network for instance {{(pid=75216) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 19:01:37 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: d589d57e-de50-482a-843f-e8246b3d7528] deallocate_for_instance() {{(pid=75216) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 19:01:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:01:37 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: d589d57e-de50-482a-843f-e8246b3d7528] Updating instance_info_cache with network_info: [] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:01:37 user nova-compute[75216]: INFO nova.compute.manager [-] [instance: d589d57e-de50-482a-843f-e8246b3d7528] Took 0.55 seconds to deallocate network for instance.
Nov 13 19:01:37 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-cdbd03f1-e943-42df-88ff-cc9a439a1c29 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:01:37 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-cdbd03f1-e943-42df-88ff-cc9a439a1c29 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:01:38 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-cdbd03f1-e943-42df-88ff-cc9a439a1c29 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 19:01:38 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-cdbd03f1-e943-42df-88ff-cc9a439a1c29 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 19:01:38 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-cdbd03f1-e943-42df-88ff-cc9a439a1c29 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.271s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:01:38 user nova-compute[75216]: INFO nova.scheduler.client.report [None req-cdbd03f1-e943-42df-88ff-cc9a439a1c29 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Deleted allocations for instance d589d57e-de50-482a-843f-e8246b3d7528
Nov 13 19:01:38 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-cdbd03f1-e943-42df-88ff-cc9a439a1c29 tempest-ServerRescueNegativeTestJSON-165310019 tempest-ServerRescueNegativeTestJSON-165310019-project-member] Lock "d589d57e-de50-482a-843f-e8246b3d7528" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.937s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:01:38 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-9b920632-293f-487d-b68b-a035b8ef4853 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Acquiring lock "af8089f7-6dc3-4655-9369-2177dbd7bf4d" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:01:38 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-9b920632-293f-487d-b68b-a035b8ef4853 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Lock "af8089f7-6dc3-4655-9369-2177dbd7bf4d" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:01:38 user nova-compute[75216]: INFO nova.compute.manager [None req-9b920632-293f-487d-b68b-a035b8ef4853 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] [instance: af8089f7-6dc3-4655-9369-2177dbd7bf4d] Rebooting instance
Nov 13 19:01:38 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:01:38 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-9b920632-293f-487d-b68b-a035b8ef4853 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Acquiring lock "refresh_cache-af8089f7-6dc3-4655-9369-2177dbd7bf4d" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 19:01:38 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-9b920632-293f-487d-b68b-a035b8ef4853 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Acquired lock "refresh_cache-af8089f7-6dc3-4655-9369-2177dbd7bf4d" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 19:01:38 user nova-compute[75216]: DEBUG nova.network.neutron [None req-9b920632-293f-487d-b68b-a035b8ef4853 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] [instance: af8089f7-6dc3-4655-9369-2177dbd7bf4d] Building network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 19:01:38 user nova-compute[75216]: DEBUG nova.compute.manager [req-944320df-68c6-4c94-8f8c-61b4f7ebbe13 req-6940fcb4-9c2b-475a-b61b-38c9f324b751 service nova] [instance: d589d57e-de50-482a-843f-e8246b3d7528] Received event network-vif-plugged-87426a6f-0164-4df3-aad0-becbbbfe8310 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:01:38 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-944320df-68c6-4c94-8f8c-61b4f7ebbe13 req-6940fcb4-9c2b-475a-b61b-38c9f324b751 service nova] Acquiring lock "d589d57e-de50-482a-843f-e8246b3d7528-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:01:38 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-944320df-68c6-4c94-8f8c-61b4f7ebbe13 req-6940fcb4-9c2b-475a-b61b-38c9f324b751 service nova] Lock "d589d57e-de50-482a-843f-e8246b3d7528-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:01:38 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-944320df-68c6-4c94-8f8c-61b4f7ebbe13 req-6940fcb4-9c2b-475a-b61b-38c9f324b751 service nova] Lock "d589d57e-de50-482a-843f-e8246b3d7528-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:01:38 user nova-compute[75216]: DEBUG nova.compute.manager [req-944320df-68c6-4c94-8f8c-61b4f7ebbe13 req-6940fcb4-9c2b-475a-b61b-38c9f324b751 service nova] [instance: d589d57e-de50-482a-843f-e8246b3d7528] No waiting events found dispatching network-vif-plugged-87426a6f-0164-4df3-aad0-becbbbfe8310 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 19:01:38 user nova-compute[75216]: WARNING nova.compute.manager [req-944320df-68c6-4c94-8f8c-61b4f7ebbe13 req-6940fcb4-9c2b-475a-b61b-38c9f324b751 service nova] [instance: d589d57e-de50-482a-843f-e8246b3d7528] Received unexpected event network-vif-plugged-87426a6f-0164-4df3-aad0-becbbbfe8310 for instance with vm_state deleted and task_state None.
Nov 13 19:01:38 user nova-compute[75216]: DEBUG nova.compute.manager [req-944320df-68c6-4c94-8f8c-61b4f7ebbe13 req-6940fcb4-9c2b-475a-b61b-38c9f324b751 service nova] [instance: d589d57e-de50-482a-843f-e8246b3d7528] Received event network-vif-deleted-87426a6f-0164-4df3-aad0-becbbbfe8310 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:01:38 user nova-compute[75216]: DEBUG nova.compute.manager [req-944320df-68c6-4c94-8f8c-61b4f7ebbe13 req-6940fcb4-9c2b-475a-b61b-38c9f324b751 service nova] [instance: af8089f7-6dc3-4655-9369-2177dbd7bf4d] Received event network-changed-c26beff8-370e-431e-9a8c-d31c4ec912ec {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:01:38 user nova-compute[75216]: DEBUG nova.compute.manager [req-944320df-68c6-4c94-8f8c-61b4f7ebbe13 req-6940fcb4-9c2b-475a-b61b-38c9f324b751 service nova] [instance: af8089f7-6dc3-4655-9369-2177dbd7bf4d] Refreshing instance network info cache due to event network-changed-c26beff8-370e-431e-9a8c-d31c4ec912ec. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 19:01:38 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-944320df-68c6-4c94-8f8c-61b4f7ebbe13 req-6940fcb4-9c2b-475a-b61b-38c9f324b751 service nova] Acquiring lock "refresh_cache-af8089f7-6dc3-4655-9369-2177dbd7bf4d" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 19:01:39 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:01:39 user nova-compute[75216]: DEBUG nova.network.neutron [None req-9b920632-293f-487d-b68b-a035b8ef4853 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] [instance: af8089f7-6dc3-4655-9369-2177dbd7bf4d] Updating instance_info_cache with network_info: [{"id": "c26beff8-370e-431e-9a8c-d31c4ec912ec", "address": "fa:16:3e:03:83:09", "network": {"id": "fea11c73-0074-4971-8b36-0aced430c730", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1420832282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84d0223a97ff4ecab9bf4273e3e465a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc26beff8-37", "ovs_interfaceid": "c26beff8-370e-431e-9a8c-d31c4ec912ec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:01:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-9b920632-293f-487d-b68b-a035b8ef4853 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Releasing lock "refresh_cache-af8089f7-6dc3-4655-9369-2177dbd7bf4d" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 19:01:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-944320df-68c6-4c94-8f8c-61b4f7ebbe13 req-6940fcb4-9c2b-475a-b61b-38c9f324b751 service nova] Acquired lock "refresh_cache-af8089f7-6dc3-4655-9369-2177dbd7bf4d" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 19:01:39 user nova-compute[75216]: DEBUG nova.network.neutron [req-944320df-68c6-4c94-8f8c-61b4f7ebbe13 req-6940fcb4-9c2b-475a-b61b-38c9f324b751 service nova] [instance: af8089f7-6dc3-4655-9369-2177dbd7bf4d] Refreshing network info cache for port c26beff8-370e-431e-9a8c-d31c4ec912ec {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 19:01:39 user nova-compute[75216]: DEBUG nova.compute.manager [None req-9b920632-293f-487d-b68b-a035b8ef4853 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] [instance: af8089f7-6dc3-4655-9369-2177dbd7bf4d] Checking state {{(pid=75216) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 19:01:40 user nova-compute[75216]: DEBUG nova.network.neutron [req-944320df-68c6-4c94-8f8c-61b4f7ebbe13 req-6940fcb4-9c2b-475a-b61b-38c9f324b751 service nova] [instance: af8089f7-6dc3-4655-9369-2177dbd7bf4d] Updated VIF entry in instance network info cache for port c26beff8-370e-431e-9a8c-d31c4ec912ec. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 19:01:40 user nova-compute[75216]: DEBUG nova.network.neutron [req-944320df-68c6-4c94-8f8c-61b4f7ebbe13 req-6940fcb4-9c2b-475a-b61b-38c9f324b751 service nova] [instance: af8089f7-6dc3-4655-9369-2177dbd7bf4d] Updating instance_info_cache with network_info: [{"id": "c26beff8-370e-431e-9a8c-d31c4ec912ec", "address": "fa:16:3e:03:83:09", "network": {"id": "fea11c73-0074-4971-8b36-0aced430c730", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1420832282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84d0223a97ff4ecab9bf4273e3e465a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc26beff8-37", "ovs_interfaceid": "c26beff8-370e-431e-9a8c-d31c4ec912ec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:01:40 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-944320df-68c6-4c94-8f8c-61b4f7ebbe13 req-6940fcb4-9c2b-475a-b61b-38c9f324b751 service nova] Releasing lock "refresh_cache-af8089f7-6dc3-4655-9369-2177dbd7bf4d" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 19:01:41 user nova-compute[75216]: INFO nova.compute.manager [None req-4980363c-9190-4b6a-b1d8-bb0d3f5a9fe9 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: 2f074d68-d0a7-4204-a79d-be619ee42d0c] Get console output
Nov 13 19:01:41 user nova-compute[75216]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Nov 13 19:01:41 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-d2a99ec1-e557-465b-a985-0e68bf2662b7 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Acquiring lock "7b752173-e573-426e-b9f1-bff92a4c2b55" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:01:41 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-d2a99ec1-e557-465b-a985-0e68bf2662b7 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Lock "7b752173-e573-426e-b9f1-bff92a4c2b55" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:01:41 user nova-compute[75216]: DEBUG nova.compute.manager [None req-d2a99ec1-e557-465b-a985-0e68bf2662b7 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] [instance: 7b752173-e573-426e-b9f1-bff92a4c2b55] Starting instance... {{(pid=75216) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 19:01:42 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-d2a99ec1-e557-465b-a985-0e68bf2662b7 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:01:42 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-d2a99ec1-e557-465b-a985-0e68bf2662b7 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:01:42 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-d2a99ec1-e557-465b-a985-0e68bf2662b7 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75216) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 19:01:42 user nova-compute[75216]: INFO nova.compute.claims [None req-d2a99ec1-e557-465b-a985-0e68bf2662b7 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] [instance: 7b752173-e573-426e-b9f1-bff92a4c2b55] Claim successful on node user
Nov 13 19:01:42 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:01:42 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:01:42 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:01:42 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:01:42 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:01:42 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-d2a99ec1-e557-465b-a985-0e68bf2662b7 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 19:01:42 user nova-compute[75216]: DEBUG nova.compute.manager [req-bd6f7a2b-09f3-4886-ac27-a0de87dff2e0 req-4703c459-1eea-4186-85dc-de47d2bf4a26 service nova] [instance: af8089f7-6dc3-4655-9369-2177dbd7bf4d] Received event network-vif-unplugged-c26beff8-370e-431e-9a8c-d31c4ec912ec {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:01:42 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-bd6f7a2b-09f3-4886-ac27-a0de87dff2e0 req-4703c459-1eea-4186-85dc-de47d2bf4a26 service nova] Acquiring lock "af8089f7-6dc3-4655-9369-2177dbd7bf4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:01:42 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-bd6f7a2b-09f3-4886-ac27-a0de87dff2e0 req-4703c459-1eea-4186-85dc-de47d2bf4a26 service nova] Lock "af8089f7-6dc3-4655-9369-2177dbd7bf4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:01:42 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-bd6f7a2b-09f3-4886-ac27-a0de87dff2e0 req-4703c459-1eea-4186-85dc-de47d2bf4a26 service nova] Lock "af8089f7-6dc3-4655-9369-2177dbd7bf4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:01:42 user nova-compute[75216]: DEBUG nova.compute.manager [req-bd6f7a2b-09f3-4886-ac27-a0de87dff2e0 req-4703c459-1eea-4186-85dc-de47d2bf4a26 service nova] [instance: af8089f7-6dc3-4655-9369-2177dbd7bf4d] No waiting events found dispatching network-vif-unplugged-c26beff8-370e-431e-9a8c-d31c4ec912ec {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 19:01:42 user nova-compute[75216]: WARNING nova.compute.manager [req-bd6f7a2b-09f3-4886-ac27-a0de87dff2e0 req-4703c459-1eea-4186-85dc-de47d2bf4a26 service nova] [instance: af8089f7-6dc3-4655-9369-2177dbd7bf4d] Received unexpected event network-vif-unplugged-c26beff8-370e-431e-9a8c-d31c4ec912ec for instance with vm_state active and task_state reboot_started.
Nov 13 19:01:42 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-d2a99ec1-e557-465b-a985-0e68bf2662b7 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 19:01:42 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-d2a99ec1-e557-465b-a985-0e68bf2662b7 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.368s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:01:42 user nova-compute[75216]: DEBUG nova.compute.manager [None req-d2a99ec1-e557-465b-a985-0e68bf2662b7 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] [instance: 7b752173-e573-426e-b9f1-bff92a4c2b55] Start building networks asynchronously for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 19:01:42 user nova-compute[75216]: DEBUG nova.compute.manager [None req-d2a99ec1-e557-465b-a985-0e68bf2662b7 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] [instance: 7b752173-e573-426e-b9f1-bff92a4c2b55] Allocating IP information in the background. {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 19:01:42 user nova-compute[75216]: DEBUG nova.network.neutron [None req-d2a99ec1-e557-465b-a985-0e68bf2662b7 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] [instance: 7b752173-e573-426e-b9f1-bff92a4c2b55] allocate_for_instance() {{(pid=75216) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 19:01:42 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-d2a99ec1-e557-465b-a985-0e68bf2662b7 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] [instance: 7b752173-e573-426e-b9f1-bff92a4c2b55] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 19:01:42 user nova-compute[75216]: DEBUG nova.compute.manager [None req-d2a99ec1-e557-465b-a985-0e68bf2662b7 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] [instance: 7b752173-e573-426e-b9f1-bff92a4c2b55] Start building block device mappings for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 19:01:42 user nova-compute[75216]: DEBUG nova.policy [None req-d2a99ec1-e557-465b-a985-0e68bf2662b7 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a7501ee4141241f2abc4d6bfce2924d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095f5765865140d29b3ecf1ab3427037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75216) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 19:01:42 user nova-compute[75216]: DEBUG nova.compute.manager [None req-d2a99ec1-e557-465b-a985-0e68bf2662b7 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] [instance: 7b752173-e573-426e-b9f1-bff92a4c2b55] Start spawning the instance on the hypervisor. {{(pid=75216) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 19:01:42 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-d2a99ec1-e557-465b-a985-0e68bf2662b7 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] [instance: 7b752173-e573-426e-b9f1-bff92a4c2b55] Creating instance directory {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 19:01:42 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-d2a99ec1-e557-465b-a985-0e68bf2662b7 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] [instance: 7b752173-e573-426e-b9f1-bff92a4c2b55] Creating image(s)
Nov 13 19:01:42 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-d2a99ec1-e557-465b-a985-0e68bf2662b7 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Acquiring lock "/opt/stack/data/nova/instances/7b752173-e573-426e-b9f1-bff92a4c2b55/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:01:42 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-d2a99ec1-e557-465b-a985-0e68bf2662b7 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Lock "/opt/stack/data/nova/instances/7b752173-e573-426e-b9f1-bff92a4c2b55/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:01:42 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-d2a99ec1-e557-465b-a985-0e68bf2662b7 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Lock "/opt/stack/data/nova/instances/7b752173-e573-426e-b9f1-bff92a4c2b55/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:01:42 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-d2a99ec1-e557-465b-a985-0e68bf2662b7 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:01:42 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:01:42 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-d2a99ec1-e557-465b-a985-0e68bf2662b7 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json" returned: 0 in 0.184s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:01:42 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-d2a99ec1-e557-465b-a985-0e68bf2662b7 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Acquiring lock "88c50a45bec9d6b0427462b3242b9b8e5f49c2b6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:01:42 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-d2a99ec1-e557-465b-a985-0e68bf2662b7 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Lock "88c50a45bec9d6b0427462b3242b9b8e5f49c2b6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:01:42 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-d2a99ec1-e557-465b-a985-0e68bf2662b7 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:01:43 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-d2a99ec1-e557-465b-a985-0e68bf2662b7 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json" returned: 0 in 0.176s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:01:43 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-d2a99ec1-e557-465b-a985-0e68bf2662b7 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6,backing_fmt=raw /opt/stack/data/nova/instances/7b752173-e573-426e-b9f1-bff92a4c2b55/disk 1073741824 {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:01:43 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-9b920632-293f-487d-b68b-a035b8ef4853 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] [instance: af8089f7-6dc3-4655-9369-2177dbd7bf4d] Instance shutdown successfully.
Nov 13 19:01:43 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-d2a99ec1-e557-465b-a985-0e68bf2662b7 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6,backing_fmt=raw /opt/stack/data/nova/instances/7b752173-e573-426e-b9f1-bff92a4c2b55/disk 1073741824" returned: 0 in 0.045s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:01:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-d2a99ec1-e557-465b-a985-0e68bf2662b7 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Lock "88c50a45bec9d6b0427462b3242b9b8e5f49c2b6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.226s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:01:43 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-d2a99ec1-e557-465b-a985-0e68bf2662b7 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:01:43 user nova-compute[75216]: DEBUG nova.network.neutron [None req-d2a99ec1-e557-465b-a985-0e68bf2662b7 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] [instance: 7b752173-e573-426e-b9f1-bff92a4c2b55] Successfully created port: 60dd7b11-cfc3-4965-a429-8b2ac4cdfcf4 {{(pid=75216) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 19:01:43 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-d2a99ec1-e557-465b-a985-0e68bf2662b7 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json" returned: 0 in 0.181s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:01:43 user nova-compute[75216]: DEBUG nova.virt.disk.api [None req-d2a99ec1-e557-465b-a985-0e68bf2662b7 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7b752173-e573-426e-b9f1-bff92a4c2b55/disk. size=1073741824 {{(pid=75216) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 19:01:43 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-d2a99ec1-e557-465b-a985-0e68bf2662b7 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b752173-e573-426e-b9f1-bff92a4c2b55/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:01:43 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-d2a99ec1-e557-465b-a985-0e68bf2662b7 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b752173-e573-426e-b9f1-bff92a4c2b55/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:01:43 user nova-compute[75216]: DEBUG nova.virt.disk.api [None req-d2a99ec1-e557-465b-a985-0e68bf2662b7 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Cannot resize image /opt/stack/data/nova/instances/7b752173-e573-426e-b9f1-bff92a4c2b55/disk to a smaller size. {{(pid=75216) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 19:01:43 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-d2a99ec1-e557-465b-a985-0e68bf2662b7 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] [instance: 7b752173-e573-426e-b9f1-bff92a4c2b55] Created local disks {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 19:01:43 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-d2a99ec1-e557-465b-a985-0e68bf2662b7 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] [instance: 7b752173-e573-426e-b9f1-bff92a4c2b55] Ensure instance console log exists: /opt/stack/data/nova/instances/7b752173-e573-426e-b9f1-bff92a4c2b55/console.log {{(pid=75216) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 19:01:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-d2a99ec1-e557-465b-a985-0e68bf2662b7 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:01:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-d2a99ec1-e557-465b-a985-0e68bf2662b7 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:01:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-d2a99ec1-e557-465b-a985-0e68bf2662b7 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:01:43 user nova-compute[75216]: DEBUG nova.network.neutron [None req-d2a99ec1-e557-465b-a985-0e68bf2662b7 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] [instance: 7b752173-e573-426e-b9f1-bff92a4c2b55] Successfully updated port: 60dd7b11-cfc3-4965-a429-8b2ac4cdfcf4 {{(pid=75216) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 19:01:43 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:01:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-d2a99ec1-e557-465b-a985-0e68bf2662b7 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Acquiring lock "refresh_cache-7b752173-e573-426e-b9f1-bff92a4c2b55" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 19:01:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-d2a99ec1-e557-465b-a985-0e68bf2662b7 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Acquired lock "refresh_cache-7b752173-e573-426e-b9f1-bff92a4c2b55" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 19:01:43 user nova-compute[75216]: DEBUG nova.network.neutron [None req-d2a99ec1-e557-465b-a985-0e68bf2662b7 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] [instance: 7b752173-e573-426e-b9f1-bff92a4c2b55] Building network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 19:01:43 user nova-compute[75216]: DEBUG nova.compute.manager [req-7c8a818e-8ef1-4efe-a013-55a3dea0f86c req-fa3b0711-aa12-4fdf-b66b-ed5326cc83dc service nova] [instance: 7b752173-e573-426e-b9f1-bff92a4c2b55] Received event network-changed-60dd7b11-cfc3-4965-a429-8b2ac4cdfcf4 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:01:43 user nova-compute[75216]: DEBUG nova.compute.manager [req-7c8a818e-8ef1-4efe-a013-55a3dea0f86c req-fa3b0711-aa12-4fdf-b66b-ed5326cc83dc service nova] [instance: 7b752173-e573-426e-b9f1-bff92a4c2b55] Refreshing instance network info cache due to event network-changed-60dd7b11-cfc3-4965-a429-8b2ac4cdfcf4. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 19:01:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-7c8a818e-8ef1-4efe-a013-55a3dea0f86c req-fa3b0711-aa12-4fdf-b66b-ed5326cc83dc service nova] Acquiring lock "refresh_cache-7b752173-e573-426e-b9f1-bff92a4c2b55" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 19:01:43 user nova-compute[75216]: DEBUG nova.network.neutron [None req-d2a99ec1-e557-465b-a985-0e68bf2662b7 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] [instance: 7b752173-e573-426e-b9f1-bff92a4c2b55] Instance cache missing network info. {{(pid=75216) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 19:01:44 user nova-compute[75216]: DEBUG nova.network.neutron [None req-d2a99ec1-e557-465b-a985-0e68bf2662b7 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] [instance: 7b752173-e573-426e-b9f1-bff92a4c2b55] Updating instance_info_cache with network_info: [{"id": "60dd7b11-cfc3-4965-a429-8b2ac4cdfcf4", "address": "fa:16:3e:d6:af:c5", "network": {"id": "53bb01d5-31a4-47af-a931-ac12fe72b986", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-802892643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "095f5765865140d29b3ecf1ab3427037", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60dd7b11-cf", "ovs_interfaceid": "60dd7b11-cfc3-4965-a429-8b2ac4cdfcf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:01:44 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-d2a99ec1-e557-465b-a985-0e68bf2662b7 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Releasing lock "refresh_cache-7b752173-e573-426e-b9f1-bff92a4c2b55" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 19:01:44 user nova-compute[75216]: DEBUG nova.compute.manager [None req-d2a99ec1-e557-465b-a985-0e68bf2662b7 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] [instance: 7b752173-e573-426e-b9f1-bff92a4c2b55] Instance network_info: |[{"id": "60dd7b11-cfc3-4965-a429-8b2ac4cdfcf4", "address": "fa:16:3e:d6:af:c5", "network": {"id": "53bb01d5-31a4-47af-a931-ac12fe72b986", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-802892643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "095f5765865140d29b3ecf1ab3427037", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60dd7b11-cf", "ovs_interfaceid": "60dd7b11-cfc3-4965-a429-8b2ac4cdfcf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 19:01:44 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-7c8a818e-8ef1-4efe-a013-55a3dea0f86c req-fa3b0711-aa12-4fdf-b66b-ed5326cc83dc service nova] Acquired lock "refresh_cache-7b752173-e573-426e-b9f1-bff92a4c2b55" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 19:01:44 user nova-compute[75216]: DEBUG nova.network.neutron [req-7c8a818e-8ef1-4efe-a013-55a3dea0f86c req-fa3b0711-aa12-4fdf-b66b-ed5326cc83dc service nova] [instance: 7b752173-e573-426e-b9f1-bff92a4c2b55] Refreshing network info cache for port 60dd7b11-cfc3-4965-a429-8b2ac4cdfcf4 {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 19:01:44 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-d2a99ec1-e557-465b-a985-0e68bf2662b7 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] [instance: 7b752173-e573-426e-b9f1-bff92a4c2b55] Start _get_guest_xml network_info=[{"id": "60dd7b11-cfc3-4965-a429-8b2ac4cdfcf4", "address": "fa:16:3e:d6:af:c5", "network": {"id": "53bb01d5-31a4-47af-a931-ac12fe72b986", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-802892643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "095f5765865140d29b3ecf1ab3427037", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60dd7b11-cf", "ovs_interfaceid": "60dd7b11-cfc3-4965-a429-8b2ac4cdfcf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T18:41:06Z,direct_url=<?>,disk_format='qcow2',id=77bcb5ba-8510-41ec-a88d-96097bb431de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c465b7c26ec44582b6d1b7169536ecc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T18:41:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'guest_format': None, 'boot_index': 0, 'image_id': '77bcb5ba-8510-41ec-a88d-96097bb431de'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 19:01:44 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-d2a99ec1-e557-465b-a985-0e68bf2662b7 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 19:01:44 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-d2a99ec1-e557-465b-a985-0e68bf2662b7 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 19:01:44 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-d2a99ec1-e557-465b-a985-0e68bf2662b7 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 19:01:44 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-d2a99ec1-e557-465b-a985-0e68bf2662b7 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] CPU controller missing on host. {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 19:01:44 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-d2a99ec1-e557-465b-a985-0e68bf2662b7 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 19:01:44 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-d2a99ec1-e557-465b-a985-0e68bf2662b7 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] CPU controller found on host. {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 19:01:44 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-d2a99ec1-e557-465b-a985-0e68bf2662b7 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75216) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 19:01:44 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-d2a99ec1-e557-465b-a985-0e68bf2662b7 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T18:40:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T18:41:06Z,direct_url=<?>,disk_format='qcow2',id=77bcb5ba-8510-41ec-a88d-96097bb431de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c465b7c26ec44582b6d1b7169536ecc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T18:41:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 19:01:44 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-d2a99ec1-e557-465b-a985-0e68bf2662b7 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Flavor limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 19:01:44 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-d2a99ec1-e557-465b-a985-0e68bf2662b7 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Image limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 19:01:44 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-d2a99ec1-e557-465b-a985-0e68bf2662b7 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Flavor pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 19:01:44 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-d2a99ec1-e557-465b-a985-0e68bf2662b7 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Image pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 19:01:44 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-d2a99ec1-e557-465b-a985-0e68bf2662b7 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 19:01:44 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-d2a99ec1-e557-465b-a985-0e68bf2662b7 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 19:01:44 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-d2a99ec1-e557-465b-a985-0e68bf2662b7 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 19:01:44 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-d2a99ec1-e557-465b-a985-0e68bf2662b7 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Got 1 possible topologies {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 19:01:44 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-d2a99ec1-e557-465b-a985-0e68bf2662b7 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 19:01:44 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-d2a99ec1-e557-465b-a985-0e68bf2662b7 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 19:01:44 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-d2a99ec1-e557-465b-a985-0e68bf2662b7 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T19:01:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1575865869',display_name='tempest-AttachVolumeTestJSON-server-1575865869',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1575865869',id=29,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGyAqjyHTP2pee8vnuPoZ/xrp7+kl5CQoOuvKblvMKUYsUK2V6arU3VG3TaEuVHw4+At5BuB9j/a8y246OC2wl7lhVwqAlIhS8np4Du9lzYGwetS0FdeZdBwrMXi36WP0A==',key_name='tempest-keypair-355509380',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='095f5765865140d29b3ecf1ab3427037',ramdisk_id='',reservation_id='r-0zzag7s9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-156429078',owner_user_name='tempest-AttachVolumeTestJSON-156429078-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T19:01:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a7501ee4141241f2abc4d6bfce2924d4',uuid=7b752173-e573-426e-b9f1-bff92a4c2b55,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "60dd7b11-cfc3-4965-a429-8b2ac4cdfcf4", "address": "fa:16:3e:d6:af:c5", "network": {"id": "53bb01d5-31a4-47af-a931-ac12fe72b986", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-802892643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "095f5765865140d29b3ecf1ab3427037", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60dd7b11-cf", "ovs_interfaceid": "60dd7b11-cfc3-4965-a429-8b2ac4cdfcf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75216) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 19:01:44 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-d2a99ec1-e557-465b-a985-0e68bf2662b7 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Converting VIF {"id": "60dd7b11-cfc3-4965-a429-8b2ac4cdfcf4", "address": "fa:16:3e:d6:af:c5", "network": {"id": "53bb01d5-31a4-47af-a931-ac12fe72b986", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-802892643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "095f5765865140d29b3ecf1ab3427037", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60dd7b11-cf", "ovs_interfaceid": "60dd7b11-cfc3-4965-a429-8b2ac4cdfcf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 19:01:44 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-d2a99ec1-e557-465b-a985-0e68bf2662b7 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:af:c5,bridge_name='br-int',has_traffic_filtering=True,id=60dd7b11-cfc3-4965-a429-8b2ac4cdfcf4,network=Network(53bb01d5-31a4-47af-a931-ac12fe72b986),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60dd7b11-cf') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 19:01:44 user nova-compute[75216]: DEBUG nova.objects.instance [None req-d2a99ec1-e557-465b-a985-0e68bf2662b7 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Lazy-loading 'pci_devices' on Instance uuid 7b752173-e573-426e-b9f1-bff92a4c2b55 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:01:44 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-d2a99ec1-e557-465b-a985-0e68bf2662b7 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] [instance: 7b752173-e573-426e-b9f1-bff92a4c2b55] End _get_guest_xml xml=<domain type="kvm">
Nov 13 19:01:44 user nova-compute[75216]:   <uuid>7b752173-e573-426e-b9f1-bff92a4c2b55</uuid>
Nov 13 19:01:44 user nova-compute[75216]:   <name>instance-0000001d</name>
Nov 13 19:01:44 user nova-compute[75216]:   <memory>524288</memory>
Nov 13 19:01:44 user nova-compute[75216]:   <vcpu>1</vcpu>
Nov 13 19:01:44 user nova-compute[75216]:   <metadata>
Nov 13 19:01:44 user nova-compute[75216]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 19:01:44 user nova-compute[75216]:       <nova:package version="0.0.0"/>
Nov 13 19:01:44 user nova-compute[75216]:       <nova:name>tempest-AttachVolumeTestJSON-server-1575865869</nova:name>
Nov 13 19:01:44 user nova-compute[75216]:       <nova:creationTime>2023-11-13 19:01:44</nova:creationTime>
Nov 13 19:01:44 user nova-compute[75216]:       <nova:flavor name="m1.tiny">
Nov 13 19:01:44 user nova-compute[75216]:         <nova:memory>512</nova:memory>
Nov 13 19:01:44 user nova-compute[75216]:         <nova:disk>1</nova:disk>
Nov 13 19:01:44 user nova-compute[75216]:         <nova:swap>0</nova:swap>
Nov 13 19:01:44 user nova-compute[75216]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 19:01:44 user nova-compute[75216]:         <nova:vcpus>1</nova:vcpus>
Nov 13 19:01:44 user nova-compute[75216]:       </nova:flavor>
Nov 13 19:01:44 user nova-compute[75216]:       <nova:owner>
Nov 13 19:01:44 user nova-compute[75216]:         <nova:user uuid="a7501ee4141241f2abc4d6bfce2924d4">tempest-AttachVolumeTestJSON-156429078-project-member</nova:user>
Nov 13 19:01:44 user nova-compute[75216]:         <nova:project uuid="095f5765865140d29b3ecf1ab3427037">tempest-AttachVolumeTestJSON-156429078</nova:project>
Nov 13 19:01:44 user nova-compute[75216]:       </nova:owner>
Nov 13 19:01:44 user nova-compute[75216]:       <nova:root type="image" uuid="77bcb5ba-8510-41ec-a88d-96097bb431de"/>
Nov 13 19:01:44 user nova-compute[75216]:       <nova:ports>
Nov 13 19:01:44 user nova-compute[75216]:         <nova:port uuid="60dd7b11-cfc3-4965-a429-8b2ac4cdfcf4">
Nov 13 19:01:44 user nova-compute[75216]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 13 19:01:44 user nova-compute[75216]:         </nova:port>
Nov 13 19:01:44 user nova-compute[75216]:       </nova:ports>
Nov 13 19:01:44 user nova-compute[75216]:     </nova:instance>
Nov 13 19:01:44 user nova-compute[75216]:   </metadata>
Nov 13 19:01:44 user nova-compute[75216]:   <sysinfo type="smbios">
Nov 13 19:01:44 user nova-compute[75216]:     <system>
Nov 13 19:01:44 user nova-compute[75216]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 19:01:44 user nova-compute[75216]:       <entry name="product">OpenStack Nova</entry>
Nov 13 19:01:44 user nova-compute[75216]:       <entry name="version">0.0.0</entry>
Nov 13 19:01:44 user nova-compute[75216]:       <entry name="serial">7b752173-e573-426e-b9f1-bff92a4c2b55</entry>
Nov 13 19:01:44 user nova-compute[75216]:       <entry name="uuid">7b752173-e573-426e-b9f1-bff92a4c2b55</entry>
Nov 13 19:01:44 user nova-compute[75216]:       <entry name="family">Virtual Machine</entry>
Nov 13 19:01:44 user nova-compute[75216]:     </system>
Nov 13 19:01:44 user nova-compute[75216]:   </sysinfo>
Nov 13 19:01:44 user nova-compute[75216]:   <os>
Nov 13 19:01:44 user nova-compute[75216]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 19:01:44 user nova-compute[75216]:     <boot dev="hd"/>
Nov 13 19:01:44 user nova-compute[75216]:     <smbios mode="sysinfo"/>
Nov 13 19:01:44 user nova-compute[75216]:   </os>
Nov 13 19:01:44 user nova-compute[75216]:   <features>
Nov 13 19:01:44 user nova-compute[75216]:     <acpi/>
Nov 13 19:01:44 user nova-compute[75216]:     <apic/>
Nov 13 19:01:44 user nova-compute[75216]:     <vmcoreinfo/>
Nov 13 19:01:44 user nova-compute[75216]:   </features>
Nov 13 19:01:44 user nova-compute[75216]:   <clock offset="utc">
Nov 13 19:01:44 user nova-compute[75216]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 19:01:44 user nova-compute[75216]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 19:01:44 user nova-compute[75216]:     <timer name="hpet" present="no"/>
Nov 13 19:01:44 user nova-compute[75216]:   </clock>
Nov 13 19:01:44 user nova-compute[75216]:   <cpu mode="custom" match="exact">
Nov 13 19:01:44 user nova-compute[75216]:     <model>Nehalem</model>
Nov 13 19:01:44 user nova-compute[75216]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 19:01:44 user nova-compute[75216]:   </cpu>
Nov 13 19:01:44 user nova-compute[75216]:   <devices>
Nov 13 19:01:44 user nova-compute[75216]:     <disk type="file" device="disk">
Nov 13 19:01:44 user nova-compute[75216]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 19:01:44 user nova-compute[75216]:       <source file="/opt/stack/data/nova/instances/7b752173-e573-426e-b9f1-bff92a4c2b55/disk"/>
Nov 13 19:01:44 user nova-compute[75216]:       <target dev="vda" bus="virtio"/>
Nov 13 19:01:44 user nova-compute[75216]:     </disk>
Nov 13 19:01:44 user nova-compute[75216]:     <interface type="ethernet">
Nov 13 19:01:44 user nova-compute[75216]:       <mac address="fa:16:3e:d6:af:c5"/>
Nov 13 19:01:44 user nova-compute[75216]:       <model type="virtio"/>
Nov 13 19:01:44 user nova-compute[75216]:       <mtu size="1442"/>
Nov 13 19:01:44 user nova-compute[75216]:       <target dev="tap60dd7b11-cf"/>
Nov 13 19:01:44 user nova-compute[75216]:     </interface>
Nov 13 19:01:44 user nova-compute[75216]:     <serial type="pty">
Nov 13 19:01:44 user nova-compute[75216]:       <log file="/opt/stack/data/nova/instances/7b752173-e573-426e-b9f1-bff92a4c2b55/console.log" append="off"/>
Nov 13 19:01:44 user nova-compute[75216]:     </serial>
Nov 13 19:01:44 user nova-compute[75216]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 19:01:44 user nova-compute[75216]:     <video>
Nov 13 19:01:44 user nova-compute[75216]:       <model type="virtio"/>
Nov 13 19:01:44 user nova-compute[75216]:     </video>
Nov 13 19:01:44 user nova-compute[75216]:     <rng model="virtio">
Nov 13 19:01:44 user nova-compute[75216]:       <backend model="random">/dev/urandom</backend>
Nov 13 19:01:44 user nova-compute[75216]:     </rng>
Nov 13 19:01:44 user nova-compute[75216]:     <controller type="usb" index="0" model="none"/>
Nov 13 19:01:44 user nova-compute[75216]:     <memballoon model="virtio">
Nov 13 19:01:44 user nova-compute[75216]:       <stats period="10"/>
Nov 13 19:01:44 user nova-compute[75216]:     </memballoon>
Nov 13 19:01:44 user nova-compute[75216]:   </devices>
Nov 13 19:01:44 user nova-compute[75216]: </domain>
Nov 13 19:01:44 user nova-compute[75216]:  {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 19:01:44 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-d2a99ec1-e557-465b-a985-0e68bf2662b7 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T19:01:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1575865869',display_name='tempest-AttachVolumeTestJSON-server-1575865869',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1575865869',id=29,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGyAqjyHTP2pee8vnuPoZ/xrp7+kl5CQoOuvKblvMKUYsUK2V6arU3VG3TaEuVHw4+At5BuB9j/a8y246OC2wl7lhVwqAlIhS8np4Du9lzYGwetS0FdeZdBwrMXi36WP0A==',key_name='tempest-keypair-355509380',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='095f5765865140d29b3ecf1ab3427037',ramdisk_id='',reservation_id='r-0zzag7s9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-156429078',owner_user_name='tempest-AttachVolumeTestJSON-156429078-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T19:01:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a7501ee4141241f2abc4d6bfce2924d4',uuid=7b752173-e573-426e-b9f1-bff92a4c2b55,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "60dd7b11-cfc3-4965-a429-8b2ac4cdfcf4", "address": "fa:16:3e:d6:af:c5", "network": {"id": "53bb01d5-31a4-47af-a931-ac12fe72b986", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-802892643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "095f5765865140d29b3ecf1ab3427037", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60dd7b11-cf", "ovs_interfaceid": "60dd7b11-cfc3-4965-a429-8b2ac4cdfcf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 19:01:44 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-d2a99ec1-e557-465b-a985-0e68bf2662b7 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Converting VIF {"id": "60dd7b11-cfc3-4965-a429-8b2ac4cdfcf4", "address": "fa:16:3e:d6:af:c5", "network": {"id": "53bb01d5-31a4-47af-a931-ac12fe72b986", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-802892643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "095f5765865140d29b3ecf1ab3427037", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60dd7b11-cf", "ovs_interfaceid": "60dd7b11-cfc3-4965-a429-8b2ac4cdfcf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 19:01:44 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-d2a99ec1-e557-465b-a985-0e68bf2662b7 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:af:c5,bridge_name='br-int',has_traffic_filtering=True,id=60dd7b11-cfc3-4965-a429-8b2ac4cdfcf4,network=Network(53bb01d5-31a4-47af-a931-ac12fe72b986),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60dd7b11-cf') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 19:01:44 user nova-compute[75216]: DEBUG os_vif [None req-d2a99ec1-e557-465b-a985-0e68bf2662b7 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:af:c5,bridge_name='br-int',has_traffic_filtering=True,id=60dd7b11-cfc3-4965-a429-8b2ac4cdfcf4,network=Network(53bb01d5-31a4-47af-a931-ac12fe72b986),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60dd7b11-cf') {{(pid=75216) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 19:01:44 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:01:44 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:01:44 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 19:01:44 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:01:44 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd3170150-d343-5a91-a21d-c456640494a4', '_type': 'linux-noop'}}, row=False) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:01:44 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:01:44 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:01:44 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:01:44 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:01:44 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap60dd7b11-cf, may_exist=True, interface_attrs={}) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:01:44 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap60dd7b11-cf, col_values=(('qos', UUID('05aa490c-4e9e-4ed0-ae26-83687afd281e')),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:01:44 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap60dd7b11-cf, col_values=(('external_ids', {'iface-id': '60dd7b11-cfc3-4965-a429-8b2ac4cdfcf4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d6:af:c5', 'vm-uuid': '7b752173-e573-426e-b9f1-bff92a4c2b55'}),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:01:44 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:01:44 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:01:44 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:01:44 user nova-compute[75216]: INFO os_vif [None req-d2a99ec1-e557-465b-a985-0e68bf2662b7 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:af:c5,bridge_name='br-int',has_traffic_filtering=True,id=60dd7b11-cfc3-4965-a429-8b2ac4cdfcf4,network=Network(53bb01d5-31a4-47af-a931-ac12fe72b986),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60dd7b11-cf')
Nov 13 19:01:44 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-d2a99ec1-e557-465b-a985-0e68bf2662b7 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 19:01:44 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-d2a99ec1-e557-465b-a985-0e68bf2662b7 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] No VIF found with MAC fa:16:3e:d6:af:c5, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 19:01:44 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:01:44 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:01:44 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:01:44 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:01:44 user nova-compute[75216]: DEBUG nova.compute.manager [req-588ef9d4-f193-48cf-bc9d-86df7ce49f82 req-6ef2c068-fae9-47f5-be45-d4903ac80ecd service nova] [instance: af8089f7-6dc3-4655-9369-2177dbd7bf4d] Received event network-vif-plugged-c26beff8-370e-431e-9a8c-d31c4ec912ec {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:01:44 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-588ef9d4-f193-48cf-bc9d-86df7ce49f82 req-6ef2c068-fae9-47f5-be45-d4903ac80ecd service nova] Acquiring lock "af8089f7-6dc3-4655-9369-2177dbd7bf4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:01:44 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-588ef9d4-f193-48cf-bc9d-86df7ce49f82 req-6ef2c068-fae9-47f5-be45-d4903ac80ecd service nova] Lock "af8089f7-6dc3-4655-9369-2177dbd7bf4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:01:44 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-588ef9d4-f193-48cf-bc9d-86df7ce49f82 req-6ef2c068-fae9-47f5-be45-d4903ac80ecd service nova] Lock "af8089f7-6dc3-4655-9369-2177dbd7bf4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:01:44 user nova-compute[75216]: DEBUG nova.compute.manager [req-588ef9d4-f193-48cf-bc9d-86df7ce49f82 req-6ef2c068-fae9-47f5-be45-d4903ac80ecd service nova] [instance: af8089f7-6dc3-4655-9369-2177dbd7bf4d] No waiting events found dispatching network-vif-plugged-c26beff8-370e-431e-9a8c-d31c4ec912ec {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 19:01:44 user nova-compute[75216]: WARNING nova.compute.manager [req-588ef9d4-f193-48cf-bc9d-86df7ce49f82 req-6ef2c068-fae9-47f5-be45-d4903ac80ecd service nova] [instance: af8089f7-6dc3-4655-9369-2177dbd7bf4d] Received unexpected event network-vif-plugged-c26beff8-370e-431e-9a8c-d31c4ec912ec for instance with vm_state active and task_state reboot_started.
Nov 13 19:01:44 user nova-compute[75216]: DEBUG nova.network.neutron [req-7c8a818e-8ef1-4efe-a013-55a3dea0f86c req-fa3b0711-aa12-4fdf-b66b-ed5326cc83dc service nova] [instance: 7b752173-e573-426e-b9f1-bff92a4c2b55] Updated VIF entry in instance network info cache for port 60dd7b11-cfc3-4965-a429-8b2ac4cdfcf4. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 19:01:44 user nova-compute[75216]: DEBUG nova.network.neutron [req-7c8a818e-8ef1-4efe-a013-55a3dea0f86c req-fa3b0711-aa12-4fdf-b66b-ed5326cc83dc service nova] [instance: 7b752173-e573-426e-b9f1-bff92a4c2b55] Updating instance_info_cache with network_info: [{"id": "60dd7b11-cfc3-4965-a429-8b2ac4cdfcf4", "address": "fa:16:3e:d6:af:c5", "network": {"id": "53bb01d5-31a4-47af-a931-ac12fe72b986", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-802892643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "095f5765865140d29b3ecf1ab3427037", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60dd7b11-cf", "ovs_interfaceid": "60dd7b11-cfc3-4965-a429-8b2ac4cdfcf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:01:44 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-7c8a818e-8ef1-4efe-a013-55a3dea0f86c req-fa3b0711-aa12-4fdf-b66b-ed5326cc83dc service nova] Releasing lock "refresh_cache-7b752173-e573-426e-b9f1-bff92a4c2b55" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 19:01:44 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:01:44 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:01:44 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:01:45 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:01:45 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:01:45 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:01:45 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:01:46 user nova-compute[75216]: DEBUG nova.compute.manager [req-c2ddfa3b-42b8-4d6c-a167-518e8cf3bd83 req-f77f0329-1099-4d2d-a477-2b4aa2efd2fa service nova] [instance: 7b752173-e573-426e-b9f1-bff92a4c2b55] Received event network-vif-plugged-60dd7b11-cfc3-4965-a429-8b2ac4cdfcf4 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:01:46 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-c2ddfa3b-42b8-4d6c-a167-518e8cf3bd83 req-f77f0329-1099-4d2d-a477-2b4aa2efd2fa service nova] Acquiring lock "7b752173-e573-426e-b9f1-bff92a4c2b55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:01:46 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-c2ddfa3b-42b8-4d6c-a167-518e8cf3bd83 req-f77f0329-1099-4d2d-a477-2b4aa2efd2fa service nova] Lock "7b752173-e573-426e-b9f1-bff92a4c2b55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:01:46 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-c2ddfa3b-42b8-4d6c-a167-518e8cf3bd83 req-f77f0329-1099-4d2d-a477-2b4aa2efd2fa service nova] Lock "7b752173-e573-426e-b9f1-bff92a4c2b55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:01:46 user nova-compute[75216]: DEBUG nova.compute.manager [req-c2ddfa3b-42b8-4d6c-a167-518e8cf3bd83 req-f77f0329-1099-4d2d-a477-2b4aa2efd2fa service nova] [instance: 7b752173-e573-426e-b9f1-bff92a4c2b55] No waiting events found dispatching network-vif-plugged-60dd7b11-cfc3-4965-a429-8b2ac4cdfcf4 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 19:01:46 user nova-compute[75216]: WARNING nova.compute.manager [req-c2ddfa3b-42b8-4d6c-a167-518e8cf3bd83 req-f77f0329-1099-4d2d-a477-2b4aa2efd2fa service nova] [instance: 7b752173-e573-426e-b9f1-bff92a4c2b55] Received unexpected event network-vif-plugged-60dd7b11-cfc3-4965-a429-8b2ac4cdfcf4 for instance with vm_state building and task_state spawning.
Nov 13 19:01:46 user nova-compute[75216]: DEBUG nova.compute.manager [req-5714f87c-ab70-4cef-8f01-e1e79600cfbe req-d8b499bb-cfa8-49ee-b9e4-a09215eb6ae0 service nova] [instance: af8089f7-6dc3-4655-9369-2177dbd7bf4d] Received event network-vif-plugged-c26beff8-370e-431e-9a8c-d31c4ec912ec {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:01:46 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-5714f87c-ab70-4cef-8f01-e1e79600cfbe req-d8b499bb-cfa8-49ee-b9e4-a09215eb6ae0 service nova] Acquiring lock "af8089f7-6dc3-4655-9369-2177dbd7bf4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:01:46 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-5714f87c-ab70-4cef-8f01-e1e79600cfbe req-d8b499bb-cfa8-49ee-b9e4-a09215eb6ae0 service nova] Lock "af8089f7-6dc3-4655-9369-2177dbd7bf4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:01:46 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-5714f87c-ab70-4cef-8f01-e1e79600cfbe req-d8b499bb-cfa8-49ee-b9e4-a09215eb6ae0 service nova] Lock "af8089f7-6dc3-4655-9369-2177dbd7bf4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:01:46 user nova-compute[75216]: DEBUG nova.compute.manager [req-5714f87c-ab70-4cef-8f01-e1e79600cfbe req-d8b499bb-cfa8-49ee-b9e4-a09215eb6ae0 service nova] [instance: af8089f7-6dc3-4655-9369-2177dbd7bf4d] No waiting events found dispatching network-vif-plugged-c26beff8-370e-431e-9a8c-d31c4ec912ec {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 19:01:46 user nova-compute[75216]: WARNING nova.compute.manager [req-5714f87c-ab70-4cef-8f01-e1e79600cfbe req-d8b499bb-cfa8-49ee-b9e4-a09215eb6ae0 service nova] [instance: af8089f7-6dc3-4655-9369-2177dbd7bf4d] Received unexpected event network-vif-plugged-c26beff8-370e-431e-9a8c-d31c4ec912ec for instance with vm_state active and task_state reboot_started.
Nov 13 19:01:46 user nova-compute[75216]: DEBUG nova.compute.manager [req-5714f87c-ab70-4cef-8f01-e1e79600cfbe req-d8b499bb-cfa8-49ee-b9e4-a09215eb6ae0 service nova] [instance: af8089f7-6dc3-4655-9369-2177dbd7bf4d] Received event network-vif-plugged-c26beff8-370e-431e-9a8c-d31c4ec912ec {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:01:46 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-5714f87c-ab70-4cef-8f01-e1e79600cfbe req-d8b499bb-cfa8-49ee-b9e4-a09215eb6ae0 service nova] Acquiring lock "af8089f7-6dc3-4655-9369-2177dbd7bf4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:01:46 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-5714f87c-ab70-4cef-8f01-e1e79600cfbe req-d8b499bb-cfa8-49ee-b9e4-a09215eb6ae0 service nova] Lock "af8089f7-6dc3-4655-9369-2177dbd7bf4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:01:46 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-5714f87c-ab70-4cef-8f01-e1e79600cfbe req-d8b499bb-cfa8-49ee-b9e4-a09215eb6ae0 service nova] Lock "af8089f7-6dc3-4655-9369-2177dbd7bf4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:01:46 user nova-compute[75216]: DEBUG nova.compute.manager [req-5714f87c-ab70-4cef-8f01-e1e79600cfbe req-d8b499bb-cfa8-49ee-b9e4-a09215eb6ae0 service nova] [instance: af8089f7-6dc3-4655-9369-2177dbd7bf4d] No waiting events found dispatching network-vif-plugged-c26beff8-370e-431e-9a8c-d31c4ec912ec {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 19:01:46 user nova-compute[75216]: WARNING nova.compute.manager [req-5714f87c-ab70-4cef-8f01-e1e79600cfbe req-d8b499bb-cfa8-49ee-b9e4-a09215eb6ae0 service nova] [instance: af8089f7-6dc3-4655-9369-2177dbd7bf4d] Received unexpected event network-vif-plugged-c26beff8-370e-431e-9a8c-d31c4ec912ec for instance with vm_state active and task_state reboot_started.
Nov 13 19:01:46 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:01:46 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:01:46 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:01:47 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: af8089f7-6dc3-4655-9369-2177dbd7bf4d] Instance running successfully.
Nov 13 19:01:47 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-9b920632-293f-487d-b68b-a035b8ef4853 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] [instance: af8089f7-6dc3-4655-9369-2177dbd7bf4d] Instance soft rebooted successfully.
Nov 13 19:01:47 user nova-compute[75216]: DEBUG nova.compute.manager [None req-9b920632-293f-487d-b68b-a035b8ef4853 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] [instance: af8089f7-6dc3-4655-9369-2177dbd7bf4d] Checking state {{(pid=75216) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 19:01:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-9b920632-293f-487d-b68b-a035b8ef4853 tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Lock "af8089f7-6dc3-4655-9369-2177dbd7bf4d" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 8.922s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:01:48 user nova-compute[75216]: DEBUG nova.compute.manager [None req-d2a99ec1-e557-465b-a985-0e68bf2662b7 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] [instance: 7b752173-e573-426e-b9f1-bff92a4c2b55] Instance event wait completed in 0 seconds for  {{(pid=75216) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 19:01:48 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-d2a99ec1-e557-465b-a985-0e68bf2662b7 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] [instance: 7b752173-e573-426e-b9f1-bff92a4c2b55] Guest created on hypervisor {{(pid=75216) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 19:01:48 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 7b752173-e573-426e-b9f1-bff92a4c2b55] Instance spawned successfully.
Nov 13 19:01:48 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-d2a99ec1-e557-465b-a985-0e68bf2662b7 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] [instance: 7b752173-e573-426e-b9f1-bff92a4c2b55] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 19:01:48 user nova-compute[75216]: DEBUG nova.compute.manager [req-631b4e10-712b-4cec-8bfb-86b10de0dead req-623ba8b8-822f-4c9d-8f74-ebde78c31a90 service nova] [instance: 7b752173-e573-426e-b9f1-bff92a4c2b55] Received event network-vif-plugged-60dd7b11-cfc3-4965-a429-8b2ac4cdfcf4 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:01:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-631b4e10-712b-4cec-8bfb-86b10de0dead req-623ba8b8-822f-4c9d-8f74-ebde78c31a90 service nova] Acquiring lock "7b752173-e573-426e-b9f1-bff92a4c2b55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:01:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-631b4e10-712b-4cec-8bfb-86b10de0dead req-623ba8b8-822f-4c9d-8f74-ebde78c31a90 service nova] Lock "7b752173-e573-426e-b9f1-bff92a4c2b55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:01:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-631b4e10-712b-4cec-8bfb-86b10de0dead req-623ba8b8-822f-4c9d-8f74-ebde78c31a90 service nova] Lock "7b752173-e573-426e-b9f1-bff92a4c2b55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:01:48 user nova-compute[75216]: DEBUG nova.compute.manager [req-631b4e10-712b-4cec-8bfb-86b10de0dead req-623ba8b8-822f-4c9d-8f74-ebde78c31a90 service nova] [instance: 7b752173-e573-426e-b9f1-bff92a4c2b55] No waiting events found dispatching network-vif-plugged-60dd7b11-cfc3-4965-a429-8b2ac4cdfcf4 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 19:01:48 user nova-compute[75216]: WARNING nova.compute.manager [req-631b4e10-712b-4cec-8bfb-86b10de0dead req-623ba8b8-822f-4c9d-8f74-ebde78c31a90 service nova] [instance: 7b752173-e573-426e-b9f1-bff92a4c2b55] Received unexpected event network-vif-plugged-60dd7b11-cfc3-4965-a429-8b2ac4cdfcf4 for instance with vm_state building and task_state spawning.
Nov 13 19:01:48 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-d2a99ec1-e557-465b-a985-0e68bf2662b7 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] [instance: 7b752173-e573-426e-b9f1-bff92a4c2b55] Found default for hw_cdrom_bus of ide {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 19:01:48 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-d2a99ec1-e557-465b-a985-0e68bf2662b7 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] [instance: 7b752173-e573-426e-b9f1-bff92a4c2b55] Found default for hw_disk_bus of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 19:01:48 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-d2a99ec1-e557-465b-a985-0e68bf2662b7 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] [instance: 7b752173-e573-426e-b9f1-bff92a4c2b55] Found default for hw_input_bus of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 19:01:48 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-d2a99ec1-e557-465b-a985-0e68bf2662b7 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] [instance: 7b752173-e573-426e-b9f1-bff92a4c2b55] Found default for hw_pointer_model of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 19:01:48 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-d2a99ec1-e557-465b-a985-0e68bf2662b7 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] [instance: 7b752173-e573-426e-b9f1-bff92a4c2b55] Found default for hw_video_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 19:01:48 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-d2a99ec1-e557-465b-a985-0e68bf2662b7 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] [instance: 7b752173-e573-426e-b9f1-bff92a4c2b55] Found default for hw_vif_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 19:01:48 user nova-compute[75216]: INFO nova.compute.manager [None req-d2a99ec1-e557-465b-a985-0e68bf2662b7 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] [instance: 7b752173-e573-426e-b9f1-bff92a4c2b55] Took 5.57 seconds to spawn the instance on the hypervisor.
Nov 13 19:01:48 user nova-compute[75216]: DEBUG nova.compute.manager [None req-d2a99ec1-e557-465b-a985-0e68bf2662b7 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] [instance: 7b752173-e573-426e-b9f1-bff92a4c2b55] Checking state {{(pid=75216) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 19:01:48 user nova-compute[75216]: INFO nova.compute.manager [None req-d2a99ec1-e557-465b-a985-0e68bf2662b7 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] [instance: 7b752173-e573-426e-b9f1-bff92a4c2b55] Took 6.31 seconds to build instance.
Nov 13 19:01:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-d2a99ec1-e557-465b-a985-0e68bf2662b7 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Lock "7b752173-e573-426e-b9f1-bff92a4c2b55" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.442s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:01:48 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:01:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:01:53 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:01:53 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:01:54 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:01:54 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:01:55 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:01:55 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:01:56 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:01:56 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75216) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 19:01:57 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:01:58 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:01:58 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Starting heal instance info cache {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 19:01:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "refresh_cache-1e5f1164-a15e-40cf-b7bc-5aeb404a1216" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 19:01:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquired lock "refresh_cache-1e5f1164-a15e-40cf-b7bc-5aeb404a1216" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 19:01:58 user nova-compute[75216]: DEBUG nova.network.neutron [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: 1e5f1164-a15e-40cf-b7bc-5aeb404a1216] Forcefully refreshing network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 19:01:58 user nova-compute[75216]: DEBUG nova.network.neutron [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: 1e5f1164-a15e-40cf-b7bc-5aeb404a1216] Updating instance_info_cache with network_info: [{"id": "96dfdc95-6a8e-43f3-8d7c-5b4f78a8f134", "address": "fa:16:3e:19:0b:3a", "network": {"id": "f8b821ef-8fae-42b9-9055-a9ea7be955ab", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-50594548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "903397a6c0474cfd8bd1a4fb338528aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96dfdc95-6a", "ovs_interfaceid": "96dfdc95-6a8e-43f3-8d7c-5b4f78a8f134", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:01:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Releasing lock "refresh_cache-1e5f1164-a15e-40cf-b7bc-5aeb404a1216" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 19:01:58 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: 1e5f1164-a15e-40cf-b7bc-5aeb404a1216] Updated the network info_cache for instance {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 19:01:58 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:01:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:01:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:01:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:01:58 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Auditing locally available compute resources for user (node: user) {{(pid=75216) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 19:01:59 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 19:01:59 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a3e849-6570-4820-97c8-75468b5bea4f/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:01:59 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a3e849-6570-4820-97c8-75468b5bea4f/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:01:59 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a3e849-6570-4820-97c8-75468b5bea4f/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:01:59 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:01:59 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a3e849-6570-4820-97c8-75468b5bea4f/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:01:59 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 19:01:59 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b752173-e573-426e-b9f1-bff92a4c2b55/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:01:59 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b752173-e573-426e-b9f1-bff92a4c2b55/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:01:59 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b752173-e573-426e-b9f1-bff92a4c2b55/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:01:59 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b752173-e573-426e-b9f1-bff92a4c2b55/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:01:59 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:01:59 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:01:59 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:02:00 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:02:00 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af8089f7-6dc3-4655-9369-2177dbd7bf4d/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:02:00 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af8089f7-6dc3-4655-9369-2177dbd7bf4d/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:02:00 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af8089f7-6dc3-4655-9369-2177dbd7bf4d/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:02:00 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af8089f7-6dc3-4655-9369-2177dbd7bf4d/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:02:00 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 19:02:00 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c18c0ad-60e5-4ef2-97f2-b7008e89ac78/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:02:00 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c18c0ad-60e5-4ef2-97f2-b7008e89ac78/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:02:00 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c18c0ad-60e5-4ef2-97f2-b7008e89ac78/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:02:00 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c18c0ad-60e5-4ef2-97f2-b7008e89ac78/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:02:01 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 19:02:01 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 19:02:01 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Hypervisor/Node resource view: name=user free_ram=8069MB free_disk=25.33568572998047GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75216) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 19:02:01 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:02:01 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:02:01 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance a1a3e849-6570-4820-97c8-75468b5bea4f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 19:02:01 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 19:02:01 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance 1e5f1164-a15e-40cf-b7bc-5aeb404a1216 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 19:02:01 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance 2f074d68-d0a7-4204-a79d-be619ee42d0c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 19:02:01 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance af8089f7-6dc3-4655-9369-2177dbd7bf4d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 19:02:01 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance 5c18c0ad-60e5-4ef2-97f2-b7008e89ac78 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 19:02:01 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance 7b752173-e573-426e-b9f1-bff92a4c2b55 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 19:02:01 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 19:02:01 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 19:02:01 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 19:02:01 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 19:02:01 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Compute_service record updated for user:user {{(pid=75216) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 19:02:01 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.584s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:02:02 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:02:03 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:02:04 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:02:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:02:09 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:02:13 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:02:14 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:02:18 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:02:19 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:02:24 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:02:24 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:02:24 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75216) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 19:02:24 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 19:02:24 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 19:02:24 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:02:27 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:02:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:02:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:02:34 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:02:34 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:02:35 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:02:38 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1e0a2a93-e4bf-4493-bce4-497a9c8311e8 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] Acquiring lock "884178b6-f98e-41fb-9f59-e41af82553b3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:02:38 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1e0a2a93-e4bf-4493-bce4-497a9c8311e8 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] Lock "884178b6-f98e-41fb-9f59-e41af82553b3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:02:38 user nova-compute[75216]: DEBUG nova.compute.manager [None req-1e0a2a93-e4bf-4493-bce4-497a9c8311e8 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] [instance: 884178b6-f98e-41fb-9f59-e41af82553b3] Starting instance... {{(pid=75216) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 19:02:38 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1e0a2a93-e4bf-4493-bce4-497a9c8311e8 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:02:38 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1e0a2a93-e4bf-4493-bce4-497a9c8311e8 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:02:38 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-1e0a2a93-e4bf-4493-bce4-497a9c8311e8 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75216) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 19:02:38 user nova-compute[75216]: INFO nova.compute.claims [None req-1e0a2a93-e4bf-4493-bce4-497a9c8311e8 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] [instance: 884178b6-f98e-41fb-9f59-e41af82553b3] Claim successful on node user
Nov 13 19:02:38 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:02:39 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-1e0a2a93-e4bf-4493-bce4-497a9c8311e8 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 19:02:39 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-1e0a2a93-e4bf-4493-bce4-497a9c8311e8 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 19:02:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1e0a2a93-e4bf-4493-bce4-497a9c8311e8 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.328s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:02:39 user nova-compute[75216]: DEBUG nova.compute.manager [None req-1e0a2a93-e4bf-4493-bce4-497a9c8311e8 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] [instance: 884178b6-f98e-41fb-9f59-e41af82553b3] Start building networks asynchronously for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 19:02:39 user nova-compute[75216]: DEBUG nova.compute.manager [None req-1e0a2a93-e4bf-4493-bce4-497a9c8311e8 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] [instance: 884178b6-f98e-41fb-9f59-e41af82553b3] Allocating IP information in the background. {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 19:02:39 user nova-compute[75216]: DEBUG nova.network.neutron [None req-1e0a2a93-e4bf-4493-bce4-497a9c8311e8 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] [instance: 884178b6-f98e-41fb-9f59-e41af82553b3] allocate_for_instance() {{(pid=75216) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 19:02:39 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-1e0a2a93-e4bf-4493-bce4-497a9c8311e8 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] [instance: 884178b6-f98e-41fb-9f59-e41af82553b3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 19:02:39 user nova-compute[75216]: DEBUG nova.compute.manager [None req-1e0a2a93-e4bf-4493-bce4-497a9c8311e8 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] [instance: 884178b6-f98e-41fb-9f59-e41af82553b3] Start building block device mappings for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 19:02:39 user nova-compute[75216]: DEBUG nova.compute.manager [None req-1e0a2a93-e4bf-4493-bce4-497a9c8311e8 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] [instance: 884178b6-f98e-41fb-9f59-e41af82553b3] Start spawning the instance on the hypervisor. {{(pid=75216) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 19:02:39 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-1e0a2a93-e4bf-4493-bce4-497a9c8311e8 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] [instance: 884178b6-f98e-41fb-9f59-e41af82553b3] Creating instance directory {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 19:02:39 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-1e0a2a93-e4bf-4493-bce4-497a9c8311e8 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] [instance: 884178b6-f98e-41fb-9f59-e41af82553b3] Creating image(s)
Nov 13 19:02:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1e0a2a93-e4bf-4493-bce4-497a9c8311e8 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] Acquiring lock "/opt/stack/data/nova/instances/884178b6-f98e-41fb-9f59-e41af82553b3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:02:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1e0a2a93-e4bf-4493-bce4-497a9c8311e8 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] Lock "/opt/stack/data/nova/instances/884178b6-f98e-41fb-9f59-e41af82553b3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:02:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1e0a2a93-e4bf-4493-bce4-497a9c8311e8 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] Lock "/opt/stack/data/nova/instances/884178b6-f98e-41fb-9f59-e41af82553b3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:02:39 user nova-compute[75216]: DEBUG nova.policy [None req-1e0a2a93-e4bf-4493-bce4-497a9c8311e8 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e24aca69921e43eaa7fea805c5d16e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c09fc0419834abe8a37c8817ab0a2e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75216) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 19:02:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-1e0a2a93-e4bf-4493-bce4-497a9c8311e8 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:02:39 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:02:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-1e0a2a93-e4bf-4493-bce4-497a9c8311e8 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json" returned: 0 in 0.168s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:02:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1e0a2a93-e4bf-4493-bce4-497a9c8311e8 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] Acquiring lock "88c50a45bec9d6b0427462b3242b9b8e5f49c2b6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:02:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1e0a2a93-e4bf-4493-bce4-497a9c8311e8 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] Lock "88c50a45bec9d6b0427462b3242b9b8e5f49c2b6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:02:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-1e0a2a93-e4bf-4493-bce4-497a9c8311e8 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:02:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-1e0a2a93-e4bf-4493-bce4-497a9c8311e8 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json" returned: 0 in 0.165s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:02:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-1e0a2a93-e4bf-4493-bce4-497a9c8311e8 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6,backing_fmt=raw /opt/stack/data/nova/instances/884178b6-f98e-41fb-9f59-e41af82553b3/disk 1073741824 {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:02:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-1e0a2a93-e4bf-4493-bce4-497a9c8311e8 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6,backing_fmt=raw /opt/stack/data/nova/instances/884178b6-f98e-41fb-9f59-e41af82553b3/disk 1073741824" returned: 0 in 0.054s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:02:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1e0a2a93-e4bf-4493-bce4-497a9c8311e8 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] Lock "88c50a45bec9d6b0427462b3242b9b8e5f49c2b6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.226s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:02:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-1e0a2a93-e4bf-4493-bce4-497a9c8311e8 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:02:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-1e0a2a93-e4bf-4493-bce4-497a9c8311e8 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json" returned: 0 in 0.167s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:02:39 user nova-compute[75216]: DEBUG nova.virt.disk.api [None req-1e0a2a93-e4bf-4493-bce4-497a9c8311e8 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] Checking if we can resize image /opt/stack/data/nova/instances/884178b6-f98e-41fb-9f59-e41af82553b3/disk. size=1073741824 {{(pid=75216) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 19:02:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-1e0a2a93-e4bf-4493-bce4-497a9c8311e8 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/884178b6-f98e-41fb-9f59-e41af82553b3/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:02:39 user nova-compute[75216]: DEBUG nova.network.neutron [None req-1e0a2a93-e4bf-4493-bce4-497a9c8311e8 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] [instance: 884178b6-f98e-41fb-9f59-e41af82553b3] Successfully created port: e18a9e5b-aa98-4ebb-bbd9-39be86d52170 {{(pid=75216) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 19:02:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-1e0a2a93-e4bf-4493-bce4-497a9c8311e8 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/884178b6-f98e-41fb-9f59-e41af82553b3/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:02:40 user nova-compute[75216]: DEBUG nova.virt.disk.api [None req-1e0a2a93-e4bf-4493-bce4-497a9c8311e8 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] Cannot resize image /opt/stack/data/nova/instances/884178b6-f98e-41fb-9f59-e41af82553b3/disk to a smaller size. {{(pid=75216) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 19:02:40 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-1e0a2a93-e4bf-4493-bce4-497a9c8311e8 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] [instance: 884178b6-f98e-41fb-9f59-e41af82553b3] Created local disks {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 19:02:40 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-1e0a2a93-e4bf-4493-bce4-497a9c8311e8 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] [instance: 884178b6-f98e-41fb-9f59-e41af82553b3] Ensure instance console log exists: /opt/stack/data/nova/instances/884178b6-f98e-41fb-9f59-e41af82553b3/console.log {{(pid=75216) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 19:02:40 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1e0a2a93-e4bf-4493-bce4-497a9c8311e8 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:02:40 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1e0a2a93-e4bf-4493-bce4-497a9c8311e8 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:02:40 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1e0a2a93-e4bf-4493-bce4-497a9c8311e8 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:02:40 user nova-compute[75216]: DEBUG nova.network.neutron [None req-1e0a2a93-e4bf-4493-bce4-497a9c8311e8 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] [instance: 884178b6-f98e-41fb-9f59-e41af82553b3] Successfully updated port: e18a9e5b-aa98-4ebb-bbd9-39be86d52170 {{(pid=75216) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 19:02:40 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1e0a2a93-e4bf-4493-bce4-497a9c8311e8 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] Acquiring lock "refresh_cache-884178b6-f98e-41fb-9f59-e41af82553b3" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 19:02:40 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1e0a2a93-e4bf-4493-bce4-497a9c8311e8 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] Acquired lock "refresh_cache-884178b6-f98e-41fb-9f59-e41af82553b3" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 19:02:40 user nova-compute[75216]: DEBUG nova.network.neutron [None req-1e0a2a93-e4bf-4493-bce4-497a9c8311e8 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] [instance: 884178b6-f98e-41fb-9f59-e41af82553b3] Building network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 19:02:40 user nova-compute[75216]: DEBUG nova.compute.manager [req-0a1400bc-e899-4dab-a10a-28ea397c0e61 req-617f188e-95cf-486c-a157-e4c2df764ec8 service nova] [instance: 884178b6-f98e-41fb-9f59-e41af82553b3] Received event network-changed-e18a9e5b-aa98-4ebb-bbd9-39be86d52170 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:02:40 user nova-compute[75216]: DEBUG nova.compute.manager [req-0a1400bc-e899-4dab-a10a-28ea397c0e61 req-617f188e-95cf-486c-a157-e4c2df764ec8 service nova] [instance: 884178b6-f98e-41fb-9f59-e41af82553b3] Refreshing instance network info cache due to event network-changed-e18a9e5b-aa98-4ebb-bbd9-39be86d52170. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 19:02:40 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-0a1400bc-e899-4dab-a10a-28ea397c0e61 req-617f188e-95cf-486c-a157-e4c2df764ec8 service nova] Acquiring lock "refresh_cache-884178b6-f98e-41fb-9f59-e41af82553b3" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 19:02:40 user nova-compute[75216]: DEBUG nova.network.neutron [None req-1e0a2a93-e4bf-4493-bce4-497a9c8311e8 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] [instance: 884178b6-f98e-41fb-9f59-e41af82553b3] Instance cache missing network info. {{(pid=75216) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 19:02:40 user nova-compute[75216]: DEBUG nova.network.neutron [None req-1e0a2a93-e4bf-4493-bce4-497a9c8311e8 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] [instance: 884178b6-f98e-41fb-9f59-e41af82553b3] Updating instance_info_cache with network_info: [{"id": "e18a9e5b-aa98-4ebb-bbd9-39be86d52170", "address": "fa:16:3e:be:6c:56", "network": {"id": "02039e96-caac-4d3a-b397-29eb94376074", "bridge": "br-int", "label": "tempest-VolumesActionsTest-98786948-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c09fc0419834abe8a37c8817ab0a2e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape18a9e5b-aa", "ovs_interfaceid": "e18a9e5b-aa98-4ebb-bbd9-39be86d52170", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:02:40 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1e0a2a93-e4bf-4493-bce4-497a9c8311e8 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] Releasing lock "refresh_cache-884178b6-f98e-41fb-9f59-e41af82553b3" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 19:02:40 user nova-compute[75216]: DEBUG nova.compute.manager [None req-1e0a2a93-e4bf-4493-bce4-497a9c8311e8 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] [instance: 884178b6-f98e-41fb-9f59-e41af82553b3] Instance network_info: |[{"id": "e18a9e5b-aa98-4ebb-bbd9-39be86d52170", "address": "fa:16:3e:be:6c:56", "network": {"id": "02039e96-caac-4d3a-b397-29eb94376074", "bridge": "br-int", "label": "tempest-VolumesActionsTest-98786948-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c09fc0419834abe8a37c8817ab0a2e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape18a9e5b-aa", "ovs_interfaceid": "e18a9e5b-aa98-4ebb-bbd9-39be86d52170", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 19:02:40 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-0a1400bc-e899-4dab-a10a-28ea397c0e61 req-617f188e-95cf-486c-a157-e4c2df764ec8 service nova] Acquired lock "refresh_cache-884178b6-f98e-41fb-9f59-e41af82553b3" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 19:02:40 user nova-compute[75216]: DEBUG nova.network.neutron [req-0a1400bc-e899-4dab-a10a-28ea397c0e61 req-617f188e-95cf-486c-a157-e4c2df764ec8 service nova] [instance: 884178b6-f98e-41fb-9f59-e41af82553b3] Refreshing network info cache for port e18a9e5b-aa98-4ebb-bbd9-39be86d52170 {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 19:02:40 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-1e0a2a93-e4bf-4493-bce4-497a9c8311e8 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] [instance: 884178b6-f98e-41fb-9f59-e41af82553b3] Start _get_guest_xml network_info=[{"id": "e18a9e5b-aa98-4ebb-bbd9-39be86d52170", "address": "fa:16:3e:be:6c:56", "network": {"id": "02039e96-caac-4d3a-b397-29eb94376074", "bridge": "br-int", "label": "tempest-VolumesActionsTest-98786948-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c09fc0419834abe8a37c8817ab0a2e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape18a9e5b-aa", "ovs_interfaceid": "e18a9e5b-aa98-4ebb-bbd9-39be86d52170", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T18:41:06Z,direct_url=<?>,disk_format='qcow2',id=77bcb5ba-8510-41ec-a88d-96097bb431de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c465b7c26ec44582b6d1b7169536ecc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T18:41:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'guest_format': None, 'boot_index': 0, 'image_id': '77bcb5ba-8510-41ec-a88d-96097bb431de'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 19:02:40 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-1e0a2a93-e4bf-4493-bce4-497a9c8311e8 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 19:02:40 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-1e0a2a93-e4bf-4493-bce4-497a9c8311e8 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 19:02:40 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-1e0a2a93-e4bf-4493-bce4-497a9c8311e8 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 19:02:40 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-1e0a2a93-e4bf-4493-bce4-497a9c8311e8 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] CPU controller missing on host. {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 19:02:40 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-1e0a2a93-e4bf-4493-bce4-497a9c8311e8 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 19:02:40 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-1e0a2a93-e4bf-4493-bce4-497a9c8311e8 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] CPU controller found on host. {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 19:02:40 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-1e0a2a93-e4bf-4493-bce4-497a9c8311e8 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75216) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 19:02:40 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-1e0a2a93-e4bf-4493-bce4-497a9c8311e8 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T18:40:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T18:41:06Z,direct_url=<?>,disk_format='qcow2',id=77bcb5ba-8510-41ec-a88d-96097bb431de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c465b7c26ec44582b6d1b7169536ecc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T18:41:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 19:02:40 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-1e0a2a93-e4bf-4493-bce4-497a9c8311e8 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] Flavor limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 19:02:40 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-1e0a2a93-e4bf-4493-bce4-497a9c8311e8 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] Image limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 19:02:40 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-1e0a2a93-e4bf-4493-bce4-497a9c8311e8 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] Flavor pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 19:02:40 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-1e0a2a93-e4bf-4493-bce4-497a9c8311e8 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] Image pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 19:02:40 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-1e0a2a93-e4bf-4493-bce4-497a9c8311e8 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 19:02:40 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-1e0a2a93-e4bf-4493-bce4-497a9c8311e8 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 19:02:40 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-1e0a2a93-e4bf-4493-bce4-497a9c8311e8 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 19:02:40 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-1e0a2a93-e4bf-4493-bce4-497a9c8311e8 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] Got 1 possible topologies {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 19:02:40 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-1e0a2a93-e4bf-4493-bce4-497a9c8311e8 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 19:02:40 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-1e0a2a93-e4bf-4493-bce4-497a9c8311e8 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 19:02:40 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-1e0a2a93-e4bf-4493-bce4-497a9c8311e8 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T19:02:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-743482989',display_name='tempest-VolumesActionsTest-instance-743482989',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-743482989',id=30,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5c09fc0419834abe8a37c8817ab0a2e2',ramdisk_id='',reservation_id='r-baaf99hc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-26118612',owner_user_name='tempest-VolumesActionsTest-26118612-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T19:02:39Z,user_data=None,user_id='e24aca69921e43eaa7fea805c5d16e71',uuid=884178b6-f98e-41fb-9f59-e41af82553b3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e18a9e5b-aa98-4ebb-bbd9-39be86d52170", "address": "fa:16:3e:be:6c:56", "network": {"id": "02039e96-caac-4d3a-b397-29eb94376074", "bridge": "br-int", "label": "tempest-VolumesActionsTest-98786948-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c09fc0419834abe8a37c8817ab0a2e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape18a9e5b-aa", "ovs_interfaceid": "e18a9e5b-aa98-4ebb-bbd9-39be86d52170", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75216) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 19:02:40 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-1e0a2a93-e4bf-4493-bce4-497a9c8311e8 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] Converting VIF {"id": "e18a9e5b-aa98-4ebb-bbd9-39be86d52170", "address": "fa:16:3e:be:6c:56", "network": {"id": "02039e96-caac-4d3a-b397-29eb94376074", "bridge": "br-int", "label": "tempest-VolumesActionsTest-98786948-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c09fc0419834abe8a37c8817ab0a2e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape18a9e5b-aa", "ovs_interfaceid": "e18a9e5b-aa98-4ebb-bbd9-39be86d52170", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 19:02:40 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-1e0a2a93-e4bf-4493-bce4-497a9c8311e8 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:6c:56,bridge_name='br-int',has_traffic_filtering=True,id=e18a9e5b-aa98-4ebb-bbd9-39be86d52170,network=Network(02039e96-caac-4d3a-b397-29eb94376074),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape18a9e5b-aa') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 19:02:40 user nova-compute[75216]: DEBUG nova.objects.instance [None req-1e0a2a93-e4bf-4493-bce4-497a9c8311e8 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] Lazy-loading 'pci_devices' on Instance uuid 884178b6-f98e-41fb-9f59-e41af82553b3 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:02:40 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-1e0a2a93-e4bf-4493-bce4-497a9c8311e8 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] [instance: 884178b6-f98e-41fb-9f59-e41af82553b3] End _get_guest_xml xml=<domain type="kvm">
Nov 13 19:02:40 user nova-compute[75216]:   <uuid>884178b6-f98e-41fb-9f59-e41af82553b3</uuid>
Nov 13 19:02:40 user nova-compute[75216]:   <name>instance-0000001e</name>
Nov 13 19:02:40 user nova-compute[75216]:   <memory>524288</memory>
Nov 13 19:02:40 user nova-compute[75216]:   <vcpu>1</vcpu>
Nov 13 19:02:40 user nova-compute[75216]:   <metadata>
Nov 13 19:02:40 user nova-compute[75216]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 19:02:40 user nova-compute[75216]:       <nova:package version="0.0.0"/>
Nov 13 19:02:40 user nova-compute[75216]:       <nova:name>tempest-VolumesActionsTest-instance-743482989</nova:name>
Nov 13 19:02:40 user nova-compute[75216]:       <nova:creationTime>2023-11-13 19:02:40</nova:creationTime>
Nov 13 19:02:40 user nova-compute[75216]:       <nova:flavor name="m1.tiny">
Nov 13 19:02:40 user nova-compute[75216]:         <nova:memory>512</nova:memory>
Nov 13 19:02:40 user nova-compute[75216]:         <nova:disk>1</nova:disk>
Nov 13 19:02:40 user nova-compute[75216]:         <nova:swap>0</nova:swap>
Nov 13 19:02:40 user nova-compute[75216]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 19:02:40 user nova-compute[75216]:         <nova:vcpus>1</nova:vcpus>
Nov 13 19:02:40 user nova-compute[75216]:       </nova:flavor>
Nov 13 19:02:40 user nova-compute[75216]:       <nova:owner>
Nov 13 19:02:40 user nova-compute[75216]:         <nova:user uuid="e24aca69921e43eaa7fea805c5d16e71">tempest-VolumesActionsTest-26118612-project-member</nova:user>
Nov 13 19:02:40 user nova-compute[75216]:         <nova:project uuid="5c09fc0419834abe8a37c8817ab0a2e2">tempest-VolumesActionsTest-26118612</nova:project>
Nov 13 19:02:40 user nova-compute[75216]:       </nova:owner>
Nov 13 19:02:40 user nova-compute[75216]:       <nova:root type="image" uuid="77bcb5ba-8510-41ec-a88d-96097bb431de"/>
Nov 13 19:02:40 user nova-compute[75216]:       <nova:ports>
Nov 13 19:02:40 user nova-compute[75216]:         <nova:port uuid="e18a9e5b-aa98-4ebb-bbd9-39be86d52170">
Nov 13 19:02:40 user nova-compute[75216]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 13 19:02:40 user nova-compute[75216]:         </nova:port>
Nov 13 19:02:40 user nova-compute[75216]:       </nova:ports>
Nov 13 19:02:40 user nova-compute[75216]:     </nova:instance>
Nov 13 19:02:40 user nova-compute[75216]:   </metadata>
Nov 13 19:02:40 user nova-compute[75216]:   <sysinfo type="smbios">
Nov 13 19:02:40 user nova-compute[75216]:     <system>
Nov 13 19:02:40 user nova-compute[75216]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 19:02:40 user nova-compute[75216]:       <entry name="product">OpenStack Nova</entry>
Nov 13 19:02:40 user nova-compute[75216]:       <entry name="version">0.0.0</entry>
Nov 13 19:02:40 user nova-compute[75216]:       <entry name="serial">884178b6-f98e-41fb-9f59-e41af82553b3</entry>
Nov 13 19:02:40 user nova-compute[75216]:       <entry name="uuid">884178b6-f98e-41fb-9f59-e41af82553b3</entry>
Nov 13 19:02:40 user nova-compute[75216]:       <entry name="family">Virtual Machine</entry>
Nov 13 19:02:40 user nova-compute[75216]:     </system>
Nov 13 19:02:40 user nova-compute[75216]:   </sysinfo>
Nov 13 19:02:40 user nova-compute[75216]:   <os>
Nov 13 19:02:40 user nova-compute[75216]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 19:02:40 user nova-compute[75216]:     <boot dev="hd"/>
Nov 13 19:02:40 user nova-compute[75216]:     <smbios mode="sysinfo"/>
Nov 13 19:02:40 user nova-compute[75216]:   </os>
Nov 13 19:02:40 user nova-compute[75216]:   <features>
Nov 13 19:02:40 user nova-compute[75216]:     <acpi/>
Nov 13 19:02:40 user nova-compute[75216]:     <apic/>
Nov 13 19:02:40 user nova-compute[75216]:     <vmcoreinfo/>
Nov 13 19:02:40 user nova-compute[75216]:   </features>
Nov 13 19:02:40 user nova-compute[75216]:   <clock offset="utc">
Nov 13 19:02:40 user nova-compute[75216]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 19:02:40 user nova-compute[75216]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 19:02:40 user nova-compute[75216]:     <timer name="hpet" present="no"/>
Nov 13 19:02:40 user nova-compute[75216]:   </clock>
Nov 13 19:02:40 user nova-compute[75216]:   <cpu mode="custom" match="exact">
Nov 13 19:02:40 user nova-compute[75216]:     <model>Nehalem</model>
Nov 13 19:02:40 user nova-compute[75216]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 19:02:40 user nova-compute[75216]:   </cpu>
Nov 13 19:02:40 user nova-compute[75216]:   <devices>
Nov 13 19:02:40 user nova-compute[75216]:     <disk type="file" device="disk">
Nov 13 19:02:40 user nova-compute[75216]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 19:02:40 user nova-compute[75216]:       <source file="/opt/stack/data/nova/instances/884178b6-f98e-41fb-9f59-e41af82553b3/disk"/>
Nov 13 19:02:40 user nova-compute[75216]:       <target dev="vda" bus="virtio"/>
Nov 13 19:02:40 user nova-compute[75216]:     </disk>
Nov 13 19:02:40 user nova-compute[75216]:     <interface type="ethernet">
Nov 13 19:02:40 user nova-compute[75216]:       <mac address="fa:16:3e:be:6c:56"/>
Nov 13 19:02:40 user nova-compute[75216]:       <model type="virtio"/>
Nov 13 19:02:40 user nova-compute[75216]:       <mtu size="1442"/>
Nov 13 19:02:40 user nova-compute[75216]:       <target dev="tape18a9e5b-aa"/>
Nov 13 19:02:40 user nova-compute[75216]:     </interface>
Nov 13 19:02:40 user nova-compute[75216]:     <serial type="pty">
Nov 13 19:02:40 user nova-compute[75216]:       <log file="/opt/stack/data/nova/instances/884178b6-f98e-41fb-9f59-e41af82553b3/console.log" append="off"/>
Nov 13 19:02:40 user nova-compute[75216]:     </serial>
Nov 13 19:02:40 user nova-compute[75216]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 19:02:40 user nova-compute[75216]:     <video>
Nov 13 19:02:40 user nova-compute[75216]:       <model type="virtio"/>
Nov 13 19:02:40 user nova-compute[75216]:     </video>
Nov 13 19:02:40 user nova-compute[75216]:     <rng model="virtio">
Nov 13 19:02:40 user nova-compute[75216]:       <backend model="random">/dev/urandom</backend>
Nov 13 19:02:40 user nova-compute[75216]:     </rng>
Nov 13 19:02:40 user nova-compute[75216]:     <controller type="usb" index="0" model="none"/>
Nov 13 19:02:40 user nova-compute[75216]:     <memballoon model="virtio">
Nov 13 19:02:40 user nova-compute[75216]:       <stats period="10"/>
Nov 13 19:02:40 user nova-compute[75216]:     </memballoon>
Nov 13 19:02:40 user nova-compute[75216]:   </devices>
Nov 13 19:02:40 user nova-compute[75216]: </domain>
Nov 13 19:02:40 user nova-compute[75216]:  {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 19:02:40 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-1e0a2a93-e4bf-4493-bce4-497a9c8311e8 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T19:02:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-743482989',display_name='tempest-VolumesActionsTest-instance-743482989',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-743482989',id=30,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5c09fc0419834abe8a37c8817ab0a2e2',ramdisk_id='',reservation_id='r-baaf99hc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-26118612',owner_user_name='tempest-VolumesActionsTest-26118612-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T19:02:39Z,user_data=None,user_id='e24aca69921e43eaa7fea805c5d16e71',uuid=884178b6-f98e-41fb-9f59-e41af82553b3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e18a9e5b-aa98-4ebb-bbd9-39be86d52170", "address": "fa:16:3e:be:6c:56", "network": {"id": "02039e96-caac-4d3a-b397-29eb94376074", "bridge": "br-int", "label": "tempest-VolumesActionsTest-98786948-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c09fc0419834abe8a37c8817ab0a2e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape18a9e5b-aa", "ovs_interfaceid": "e18a9e5b-aa98-4ebb-bbd9-39be86d52170", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 19:02:40 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-1e0a2a93-e4bf-4493-bce4-497a9c8311e8 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] Converting VIF {"id": "e18a9e5b-aa98-4ebb-bbd9-39be86d52170", "address": "fa:16:3e:be:6c:56", "network": {"id": "02039e96-caac-4d3a-b397-29eb94376074", "bridge": "br-int", "label": "tempest-VolumesActionsTest-98786948-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c09fc0419834abe8a37c8817ab0a2e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape18a9e5b-aa", "ovs_interfaceid": "e18a9e5b-aa98-4ebb-bbd9-39be86d52170", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 19:02:40 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-1e0a2a93-e4bf-4493-bce4-497a9c8311e8 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:6c:56,bridge_name='br-int',has_traffic_filtering=True,id=e18a9e5b-aa98-4ebb-bbd9-39be86d52170,network=Network(02039e96-caac-4d3a-b397-29eb94376074),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape18a9e5b-aa') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 19:02:40 user nova-compute[75216]: DEBUG os_vif [None req-1e0a2a93-e4bf-4493-bce4-497a9c8311e8 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:6c:56,bridge_name='br-int',has_traffic_filtering=True,id=e18a9e5b-aa98-4ebb-bbd9-39be86d52170,network=Network(02039e96-caac-4d3a-b397-29eb94376074),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape18a9e5b-aa') {{(pid=75216) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 19:02:40 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:02:40 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:02:40 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 19:02:40 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:02:40 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '23ae1317-0514-5807-8c14-63c7510e30a3', '_type': 'linux-noop'}}, row=False) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:02:40 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:02:40 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:02:40 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:02:40 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape18a9e5b-aa, may_exist=True, interface_attrs={}) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:02:40 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape18a9e5b-aa, col_values=(('qos', UUID('d0264adf-7fa5-41ac-b848-d4aaf7d2a80b')),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:02:40 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape18a9e5b-aa, col_values=(('external_ids', {'iface-id': 'e18a9e5b-aa98-4ebb-bbd9-39be86d52170', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:be:6c:56', 'vm-uuid': '884178b6-f98e-41fb-9f59-e41af82553b3'}),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:02:40 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:02:40 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:02:40 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:02:40 user nova-compute[75216]: INFO os_vif [None req-1e0a2a93-e4bf-4493-bce4-497a9c8311e8 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:6c:56,bridge_name='br-int',has_traffic_filtering=True,id=e18a9e5b-aa98-4ebb-bbd9-39be86d52170,network=Network(02039e96-caac-4d3a-b397-29eb94376074),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape18a9e5b-aa')
Nov 13 19:02:40 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-1e0a2a93-e4bf-4493-bce4-497a9c8311e8 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 19:02:40 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-1e0a2a93-e4bf-4493-bce4-497a9c8311e8 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] No VIF found with MAC fa:16:3e:be:6c:56, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 19:02:41 user nova-compute[75216]: DEBUG nova.network.neutron [req-0a1400bc-e899-4dab-a10a-28ea397c0e61 req-617f188e-95cf-486c-a157-e4c2df764ec8 service nova] [instance: 884178b6-f98e-41fb-9f59-e41af82553b3] Updated VIF entry in instance network info cache for port e18a9e5b-aa98-4ebb-bbd9-39be86d52170. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 19:02:41 user nova-compute[75216]: DEBUG nova.network.neutron [req-0a1400bc-e899-4dab-a10a-28ea397c0e61 req-617f188e-95cf-486c-a157-e4c2df764ec8 service nova] [instance: 884178b6-f98e-41fb-9f59-e41af82553b3] Updating instance_info_cache with network_info: [{"id": "e18a9e5b-aa98-4ebb-bbd9-39be86d52170", "address": "fa:16:3e:be:6c:56", "network": {"id": "02039e96-caac-4d3a-b397-29eb94376074", "bridge": "br-int", "label": "tempest-VolumesActionsTest-98786948-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c09fc0419834abe8a37c8817ab0a2e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape18a9e5b-aa", "ovs_interfaceid": "e18a9e5b-aa98-4ebb-bbd9-39be86d52170", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:02:41 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-0a1400bc-e899-4dab-a10a-28ea397c0e61 req-617f188e-95cf-486c-a157-e4c2df764ec8 service nova] Releasing lock "refresh_cache-884178b6-f98e-41fb-9f59-e41af82553b3" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 19:02:41 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-aa159e28-9a69-4b37-946c-55d31d208d47 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Acquiring lock "2f074d68-d0a7-4204-a79d-be619ee42d0c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:02:41 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-aa159e28-9a69-4b37-946c-55d31d208d47 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Lock "2f074d68-d0a7-4204-a79d-be619ee42d0c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:02:41 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-aa159e28-9a69-4b37-946c-55d31d208d47 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Acquiring lock "2f074d68-d0a7-4204-a79d-be619ee42d0c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:02:41 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-aa159e28-9a69-4b37-946c-55d31d208d47 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Lock "2f074d68-d0a7-4204-a79d-be619ee42d0c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:02:41 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-aa159e28-9a69-4b37-946c-55d31d208d47 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Lock "2f074d68-d0a7-4204-a79d-be619ee42d0c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:02:41 user nova-compute[75216]: INFO nova.compute.manager [None req-aa159e28-9a69-4b37-946c-55d31d208d47 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: 2f074d68-d0a7-4204-a79d-be619ee42d0c] Terminating instance
Nov 13 19:02:41 user nova-compute[75216]: DEBUG nova.compute.manager [None req-aa159e28-9a69-4b37-946c-55d31d208d47 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: 2f074d68-d0a7-4204-a79d-be619ee42d0c] Start destroying the instance on the hypervisor. {{(pid=75216) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 19:02:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:02:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:02:42 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:02:42 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:02:42 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:02:42 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:02:42 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:02:42 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:02:42 user nova-compute[75216]: DEBUG nova.compute.manager [req-176cbd92-2bff-4e59-86eb-997555b083a0 req-c937bd1c-871f-47f0-96a1-20f1d31592d0 service nova] [instance: 2f074d68-d0a7-4204-a79d-be619ee42d0c] Received event network-vif-unplugged-3d9260c2-c8da-47b8-884c-8c66259c7c2b {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:02:42 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-176cbd92-2bff-4e59-86eb-997555b083a0 req-c937bd1c-871f-47f0-96a1-20f1d31592d0 service nova] Acquiring lock "2f074d68-d0a7-4204-a79d-be619ee42d0c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:02:42 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-176cbd92-2bff-4e59-86eb-997555b083a0 req-c937bd1c-871f-47f0-96a1-20f1d31592d0 service nova] Lock "2f074d68-d0a7-4204-a79d-be619ee42d0c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:02:42 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-176cbd92-2bff-4e59-86eb-997555b083a0 req-c937bd1c-871f-47f0-96a1-20f1d31592d0 service nova] Lock "2f074d68-d0a7-4204-a79d-be619ee42d0c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:02:42 user nova-compute[75216]: DEBUG nova.compute.manager [req-176cbd92-2bff-4e59-86eb-997555b083a0 req-c937bd1c-871f-47f0-96a1-20f1d31592d0 service nova] [instance: 2f074d68-d0a7-4204-a79d-be619ee42d0c] No waiting events found dispatching network-vif-unplugged-3d9260c2-c8da-47b8-884c-8c66259c7c2b {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 19:02:42 user nova-compute[75216]: DEBUG nova.compute.manager [req-176cbd92-2bff-4e59-86eb-997555b083a0 req-c937bd1c-871f-47f0-96a1-20f1d31592d0 service nova] [instance: 2f074d68-d0a7-4204-a79d-be619ee42d0c] Received event network-vif-unplugged-3d9260c2-c8da-47b8-884c-8c66259c7c2b for instance with task_state deleting. {{(pid=75216) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 19:02:42 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 2f074d68-d0a7-4204-a79d-be619ee42d0c] Instance destroyed successfully.
Nov 13 19:02:42 user nova-compute[75216]: DEBUG nova.objects.instance [None req-aa159e28-9a69-4b37-946c-55d31d208d47 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Lazy-loading 'resources' on Instance uuid 2f074d68-d0a7-4204-a79d-be619ee42d0c {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:02:43 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:02:43 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:02:43 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-aa159e28-9a69-4b37-946c-55d31d208d47 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T18:56:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1279111656',display_name='tempest-ServerActionsTestOtherA-server-1279111656',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1279111656',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKz099Lx1XxYKMwpEh9A7Hze8Yy5EijTt+h0RSW+LWAAdums7McTLzxWcs+4M2TWx6M56tfd+yHdLdlnr7vz5lvq3aL+fZolVlZV3LeOornnUO38Y1O0XVUZqifXtvNPtQ==',key_name='tempest-keypair-1574128026',keypairs=<?>,launch_index=0,launched_at=2023-11-13T18:58:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b9b7e11038e54e368acd22d06e54a351',ramdisk_id='',reservation_id='r-59nswt1o',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-537419316',owner_user_name='tempest-ServerActionsTestOtherA-537419316-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T18:59:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='23f029ff09464d699e5bd6dbf44a905d',uuid=2f074d68-d0a7-4204-a79d-be619ee42d0c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3d9260c2-c8da-47b8-884c-8c66259c7c2b", "address": "fa:16:3e:12:97:81", "network": {"id": "d7a691f0-4495-40ad-a349-91b5dc9c635a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-961583097-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9b7e11038e54e368acd22d06e54a351", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d9260c2-c8", "ovs_interfaceid": "3d9260c2-c8da-47b8-884c-8c66259c7c2b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 19:02:43 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-aa159e28-9a69-4b37-946c-55d31d208d47 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Converting VIF {"id": "3d9260c2-c8da-47b8-884c-8c66259c7c2b", "address": "fa:16:3e:12:97:81", "network": {"id": "d7a691f0-4495-40ad-a349-91b5dc9c635a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-961583097-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9b7e11038e54e368acd22d06e54a351", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d9260c2-c8", "ovs_interfaceid": "3d9260c2-c8da-47b8-884c-8c66259c7c2b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 19:02:43 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-aa159e28-9a69-4b37-946c-55d31d208d47 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:12:97:81,bridge_name='br-int',has_traffic_filtering=True,id=3d9260c2-c8da-47b8-884c-8c66259c7c2b,network=Network(d7a691f0-4495-40ad-a349-91b5dc9c635a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d9260c2-c8') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 19:02:43 user nova-compute[75216]: DEBUG os_vif [None req-aa159e28-9a69-4b37-946c-55d31d208d47 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:12:97:81,bridge_name='br-int',has_traffic_filtering=True,id=3d9260c2-c8da-47b8-884c-8c66259c7c2b,network=Network(d7a691f0-4495-40ad-a349-91b5dc9c635a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d9260c2-c8') {{(pid=75216) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 19:02:43 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:02:43 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3d9260c2-c8, bridge=br-int, if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:02:43 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:02:43 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:02:43 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:02:43 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:02:43 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:02:43 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0e74f6e1-05ec-4ee7-8ade-f38e33cd6390) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:02:43 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:02:43 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:02:43 user nova-compute[75216]: INFO os_vif [None req-aa159e28-9a69-4b37-946c-55d31d208d47 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:12:97:81,bridge_name='br-int',has_traffic_filtering=True,id=3d9260c2-c8da-47b8-884c-8c66259c7c2b,network=Network(d7a691f0-4495-40ad-a349-91b5dc9c635a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d9260c2-c8')
Nov 13 19:02:43 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa159e28-9a69-4b37-946c-55d31d208d47 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: 2f074d68-d0a7-4204-a79d-be619ee42d0c] calling os-brick to detach iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 19:02:43 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa159e28-9a69-4b37-946c-55d31d208d47 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3a8669e40>, {'target_iqn': 'iqn.2010-10.org.openstack:8a7c3d74-e183-497b-b6c7-85be2b2f171e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'umwcQxTI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 19:02:43 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-aa159e28-9a69-4b37-946c-55d31d208d47 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 19:02:43 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-aa159e28-9a69-4b37-946c-55d31d208d47 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 19:02:43 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-aa159e28-9a69-4b37-946c-55d31d208d47 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 19:02:43 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:02:43 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:02:43 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[fae92229-e47a-40b3-9279-e0a68e3f1aa4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8a7c3d74-e183-497b-b6c7-85be2b2f171e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2dfdac0b-bc0c-4291-ae5c-8eb516d7b164\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:02:43 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa159e28-9a69-4b37-946c-55d31d208d47 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 19:02:43 user nova-compute[75216]: No targets found.
Nov 13 19:02:43 user nova-compute[75216]: iSNS:
Nov 13 19:02:43 user nova-compute[75216]: No targets found.
Nov 13 19:02:43 user nova-compute[75216]: STATIC:
Nov 13 19:02:43 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:8a7c3d74-e183-497b-b6c7-85be2b2f171e
Nov 13 19:02:43 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 19:02:43 user nova-compute[75216]:                 Iface Name: default
Nov 13 19:02:43 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1
Nov 13 19:02:43 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 19:02:43 user nova-compute[75216]:                 Iface Name: default
Nov 13 19:02:43 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:2dfdac0b-bc0c-4291-ae5c-8eb516d7b164
Nov 13 19:02:43 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 19:02:43 user nova-compute[75216]:                 Iface Name: default
Nov 13 19:02:43 user nova-compute[75216]: FIRMWARE:
Nov 13 19:02:43 user nova-compute[75216]: No targets found.
Nov 13 19:02:43 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 19:02:43 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa159e28-9a69-4b37-946c-55d31d208d47 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 19:02:43 user nova-compute[75216]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 19:02:43 user nova-compute[75216]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75216) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 19:02:43 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa159e28-9a69-4b37-946c-55d31d208d47 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8a7c3d74-e183-497b-b6c7-85be2b2f171e', 0)] {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 19:02:43 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:02:43 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:02:43 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce7f0ec5-8018-4a10-8a77-45a4f7416c57]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2dfdac0b-bc0c-4291-ae5c-8eb516d7b164\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8a7c3d74-e183-497b-b6c7-85be2b2f171e\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:02:43 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:02:43 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:02:43 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[dba19d25-da1a-420a-9061-7cb49d4a7294]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a7c3d74-e183-497b-b6c7-85be2b2f171e (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dfdac0b-bc0c-4291-ae5c-8eb516d7b164 (non-flash)\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:02:43 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa159e28-9a69-4b37-946c-55d31d208d47 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1 (non-flash)
Nov 13 19:02:43 user nova-compute[75216]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a7c3d74-e183-497b-b6c7-85be2b2f171e (non-flash)
Nov 13 19:02:43 user nova-compute[75216]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dfdac0b-bc0c-4291-ae5c-8eb516d7b164 (non-flash)
Nov 13 19:02:43 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 19:02:43 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa159e28-9a69-4b37-946c-55d31d208d47 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1 (non-flash)
Nov 13 19:02:43 user nova-compute[75216]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a7c3d74-e183-497b-b6c7-85be2b2f171e (non-flash)
Nov 13 19:02:43 user nova-compute[75216]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dfdac0b-bc0c-4291-ae5c-8eb516d7b164 (non-flash)
Nov 13 19:02:43 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 19:02:43 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa159e28-9a69-4b37-946c-55d31d208d47 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe3a82f1e10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8a7c3d74-e183-497b-b6c7-85be2b2f171e'): ({'sdf'}, set())}) {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 19:02:43 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-aa159e28-9a69-4b37-946c-55d31d208d47 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Removing single pathed devices sdf {{(pid=75216) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 19:02:43 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:02:43 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:02:43 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[16b86b38-9589-4057-9783-9a8f27b20174]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:02:43 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:02:43 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:02:43 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[180d8cc0-21e9-4a07-8ee3-7ceef89fbf7b]: (4, ('ok\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:02:43 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-aa159e28-9a69-4b37-946c-55d31d208d47 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Flushing IO for device /dev/sdf {{(pid=75216) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 19:02:43 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:02:43 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.015s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:02:43 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[685dea18-30aa-4112-822a-856722a4baa4]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:02:43 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-aa159e28-9a69-4b37-946c-55d31d208d47 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75216) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 19:02:43 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:02:43 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.052s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:02:43 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[54b98b35-4c5c-4b12-be4b-562491cf9f11]: (4, ('1', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:02:43 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-aa159e28-9a69-4b37-946c-55d31d208d47 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 19:02:43 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-aa159e28-9a69-4b37-946c-55d31d208d47 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] SCSI volumes sdf have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 19:02:43 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa159e28-9a69-4b37-946c-55d31d208d47 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8a7c3d74-e183-497b-b6c7-85be2b2f171e')] {{(pid=75216) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 19:02:43 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a7c3d74-e183-497b-b6c7-85be2b2f171e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:02:43 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a7c3d74-e183-497b-b6c7-85be2b2f171e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:02:43 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e728edc-249a-4a35-b79e-347797263299]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:02:43 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa159e28-9a69-4b37-946c-55d31d208d47 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:02:43 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a7c3d74-e183-497b-b6c7-85be2b2f171e -p 172.16.0.220:3260 --logout {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:02:43 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a7c3d74-e183-497b-b6c7-85be2b2f171e -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:02:43 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[9902a6b4-5337-4469-92e7-dc43c5ea447a]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:8a7c3d74-e183-497b-b6c7-85be2b2f171e, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:8a7c3d74-e183-497b-b6c7-85be2b2f171e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:02:43 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa159e28-9a69-4b37-946c-55d31d208d47 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:8a7c3d74-e183-497b-b6c7-85be2b2f171e, portal: 172.16.0.220,3260]
Nov 13 19:02:43 user nova-compute[75216]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:8a7c3d74-e183-497b-b6c7-85be2b2f171e, portal: 172.16.0.220,3260] successful.
Nov 13 19:02:43 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:02:43 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a7c3d74-e183-497b-b6c7-85be2b2f171e -p 172.16.0.220:3260 --op delete {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:02:43 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a7c3d74-e183-497b-b6c7-85be2b2f171e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:02:43 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[15c6bf65-262d-41d0-b95f-f098ed0751b0]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:02:43 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa159e28-9a69-4b37-946c-55d31d208d47 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:02:43 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-aa159e28-9a69-4b37-946c-55d31d208d47 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.343s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 19:02:43 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa159e28-9a69-4b37-946c-55d31d208d47 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] <== disconnect_volume: return (345ms) None {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 19:02:43 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa159e28-9a69-4b37-946c-55d31d208d47 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: 2f074d68-d0a7-4204-a79d-be619ee42d0c] Disconnected iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 19:02:43 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-aa159e28-9a69-4b37-946c-55d31d208d47 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: 2f074d68-d0a7-4204-a79d-be619ee42d0c] Deleting instance files /opt/stack/data/nova/instances/2f074d68-d0a7-4204-a79d-be619ee42d0c_del
Nov 13 19:02:43 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-aa159e28-9a69-4b37-946c-55d31d208d47 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: 2f074d68-d0a7-4204-a79d-be619ee42d0c] Deletion of /opt/stack/data/nova/instances/2f074d68-d0a7-4204-a79d-be619ee42d0c_del complete
Nov 13 19:02:43 user nova-compute[75216]: INFO nova.compute.manager [None req-aa159e28-9a69-4b37-946c-55d31d208d47 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: 2f074d68-d0a7-4204-a79d-be619ee42d0c] Took 1.70 seconds to destroy the instance on the hypervisor.
Nov 13 19:02:43 user nova-compute[75216]: DEBUG oslo.service.loopingcall [None req-aa159e28-9a69-4b37-946c-55d31d208d47 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75216) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 19:02:43 user nova-compute[75216]: DEBUG nova.compute.manager [-] [instance: 2f074d68-d0a7-4204-a79d-be619ee42d0c] Deallocating network for instance {{(pid=75216) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 19:02:43 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: 2f074d68-d0a7-4204-a79d-be619ee42d0c] deallocate_for_instance() {{(pid=75216) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 19:02:43 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:02:44 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: 2f074d68-d0a7-4204-a79d-be619ee42d0c] Updating instance_info_cache with network_info: [] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:02:44 user nova-compute[75216]: INFO nova.compute.manager [-] [instance: 2f074d68-d0a7-4204-a79d-be619ee42d0c] Took 0.58 seconds to deallocate network for instance.
Nov 13 19:02:44 user nova-compute[75216]: DEBUG nova.compute.manager [req-9ec90539-37fb-441a-838a-f66fcea1be50 req-fdebc8fd-db17-4907-91fa-a3b66feaba7e service nova] [instance: 2f074d68-d0a7-4204-a79d-be619ee42d0c] Received event network-vif-plugged-3d9260c2-c8da-47b8-884c-8c66259c7c2b {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:02:44 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-9ec90539-37fb-441a-838a-f66fcea1be50 req-fdebc8fd-db17-4907-91fa-a3b66feaba7e service nova] Acquiring lock "2f074d68-d0a7-4204-a79d-be619ee42d0c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:02:44 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-9ec90539-37fb-441a-838a-f66fcea1be50 req-fdebc8fd-db17-4907-91fa-a3b66feaba7e service nova] Lock "2f074d68-d0a7-4204-a79d-be619ee42d0c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:02:44 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-9ec90539-37fb-441a-838a-f66fcea1be50 req-fdebc8fd-db17-4907-91fa-a3b66feaba7e service nova] Lock "2f074d68-d0a7-4204-a79d-be619ee42d0c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:02:44 user nova-compute[75216]: DEBUG nova.compute.manager [req-9ec90539-37fb-441a-838a-f66fcea1be50 req-fdebc8fd-db17-4907-91fa-a3b66feaba7e service nova] [instance: 2f074d68-d0a7-4204-a79d-be619ee42d0c] No waiting events found dispatching network-vif-plugged-3d9260c2-c8da-47b8-884c-8c66259c7c2b {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 19:02:44 user nova-compute[75216]: WARNING nova.compute.manager [req-9ec90539-37fb-441a-838a-f66fcea1be50 req-fdebc8fd-db17-4907-91fa-a3b66feaba7e service nova] [instance: 2f074d68-d0a7-4204-a79d-be619ee42d0c] Received unexpected event network-vif-plugged-3d9260c2-c8da-47b8-884c-8c66259c7c2b for instance with vm_state active and task_state deleting.
Nov 13 19:02:44 user nova-compute[75216]: DEBUG nova.compute.manager [req-9ec90539-37fb-441a-838a-f66fcea1be50 req-fdebc8fd-db17-4907-91fa-a3b66feaba7e service nova] [instance: 884178b6-f98e-41fb-9f59-e41af82553b3] Received event network-vif-plugged-e18a9e5b-aa98-4ebb-bbd9-39be86d52170 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:02:44 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-9ec90539-37fb-441a-838a-f66fcea1be50 req-fdebc8fd-db17-4907-91fa-a3b66feaba7e service nova] Acquiring lock "884178b6-f98e-41fb-9f59-e41af82553b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:02:44 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-9ec90539-37fb-441a-838a-f66fcea1be50 req-fdebc8fd-db17-4907-91fa-a3b66feaba7e service nova] Lock "884178b6-f98e-41fb-9f59-e41af82553b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:02:44 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-9ec90539-37fb-441a-838a-f66fcea1be50 req-fdebc8fd-db17-4907-91fa-a3b66feaba7e service nova] Lock "884178b6-f98e-41fb-9f59-e41af82553b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:02:44 user nova-compute[75216]: DEBUG nova.compute.manager [req-9ec90539-37fb-441a-838a-f66fcea1be50 req-fdebc8fd-db17-4907-91fa-a3b66feaba7e service nova] [instance: 884178b6-f98e-41fb-9f59-e41af82553b3] No waiting events found dispatching network-vif-plugged-e18a9e5b-aa98-4ebb-bbd9-39be86d52170 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 19:02:44 user nova-compute[75216]: WARNING nova.compute.manager [req-9ec90539-37fb-441a-838a-f66fcea1be50 req-fdebc8fd-db17-4907-91fa-a3b66feaba7e service nova] [instance: 884178b6-f98e-41fb-9f59-e41af82553b3] Received unexpected event network-vif-plugged-e18a9e5b-aa98-4ebb-bbd9-39be86d52170 for instance with vm_state building and task_state spawning.
Nov 13 19:02:44 user nova-compute[75216]: DEBUG nova.compute.manager [req-9ec90539-37fb-441a-838a-f66fcea1be50 req-fdebc8fd-db17-4907-91fa-a3b66feaba7e service nova] [instance: 884178b6-f98e-41fb-9f59-e41af82553b3] Received event network-vif-plugged-e18a9e5b-aa98-4ebb-bbd9-39be86d52170 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:02:44 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-9ec90539-37fb-441a-838a-f66fcea1be50 req-fdebc8fd-db17-4907-91fa-a3b66feaba7e service nova] Acquiring lock "884178b6-f98e-41fb-9f59-e41af82553b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:02:44 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-9ec90539-37fb-441a-838a-f66fcea1be50 req-fdebc8fd-db17-4907-91fa-a3b66feaba7e service nova] Lock "884178b6-f98e-41fb-9f59-e41af82553b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:02:44 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-9ec90539-37fb-441a-838a-f66fcea1be50 req-fdebc8fd-db17-4907-91fa-a3b66feaba7e service nova] Lock "884178b6-f98e-41fb-9f59-e41af82553b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:02:44 user nova-compute[75216]: DEBUG nova.compute.manager [req-9ec90539-37fb-441a-838a-f66fcea1be50 req-fdebc8fd-db17-4907-91fa-a3b66feaba7e service nova] [instance: 884178b6-f98e-41fb-9f59-e41af82553b3] No waiting events found dispatching network-vif-plugged-e18a9e5b-aa98-4ebb-bbd9-39be86d52170 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 19:02:44 user nova-compute[75216]: WARNING nova.compute.manager [req-9ec90539-37fb-441a-838a-f66fcea1be50 req-fdebc8fd-db17-4907-91fa-a3b66feaba7e service nova] [instance: 884178b6-f98e-41fb-9f59-e41af82553b3] Received unexpected event network-vif-plugged-e18a9e5b-aa98-4ebb-bbd9-39be86d52170 for instance with vm_state building and task_state spawning.
Nov 13 19:02:44 user nova-compute[75216]: DEBUG nova.compute.manager [req-9ec90539-37fb-441a-838a-f66fcea1be50 req-fdebc8fd-db17-4907-91fa-a3b66feaba7e service nova] [instance: 2f074d68-d0a7-4204-a79d-be619ee42d0c] Received event network-vif-deleted-3d9260c2-c8da-47b8-884c-8c66259c7c2b {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:02:44 user nova-compute[75216]: DEBUG nova.compute.manager [None req-1e0a2a93-e4bf-4493-bce4-497a9c8311e8 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] [instance: 884178b6-f98e-41fb-9f59-e41af82553b3] Instance event wait completed in 0 seconds for  {{(pid=75216) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 19:02:44 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-1e0a2a93-e4bf-4493-bce4-497a9c8311e8 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] [instance: 884178b6-f98e-41fb-9f59-e41af82553b3] Guest created on hypervisor {{(pid=75216) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 19:02:44 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 884178b6-f98e-41fb-9f59-e41af82553b3] Instance spawned successfully.
Nov 13 19:02:44 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-1e0a2a93-e4bf-4493-bce4-497a9c8311e8 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] [instance: 884178b6-f98e-41fb-9f59-e41af82553b3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 19:02:44 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-1e0a2a93-e4bf-4493-bce4-497a9c8311e8 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] [instance: 884178b6-f98e-41fb-9f59-e41af82553b3] Found default for hw_cdrom_bus of ide {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 19:02:44 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-1e0a2a93-e4bf-4493-bce4-497a9c8311e8 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] [instance: 884178b6-f98e-41fb-9f59-e41af82553b3] Found default for hw_disk_bus of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 19:02:44 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-1e0a2a93-e4bf-4493-bce4-497a9c8311e8 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] [instance: 884178b6-f98e-41fb-9f59-e41af82553b3] Found default for hw_input_bus of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 19:02:44 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-1e0a2a93-e4bf-4493-bce4-497a9c8311e8 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] [instance: 884178b6-f98e-41fb-9f59-e41af82553b3] Found default for hw_pointer_model of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 19:02:44 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-1e0a2a93-e4bf-4493-bce4-497a9c8311e8 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] [instance: 884178b6-f98e-41fb-9f59-e41af82553b3] Found default for hw_video_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 19:02:44 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-1e0a2a93-e4bf-4493-bce4-497a9c8311e8 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] [instance: 884178b6-f98e-41fb-9f59-e41af82553b3] Found default for hw_vif_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 19:02:44 user nova-compute[75216]: INFO nova.compute.manager [None req-aa159e28-9a69-4b37-946c-55d31d208d47 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: 2f074d68-d0a7-4204-a79d-be619ee42d0c] Took 0.75 seconds to detach 1 volumes for instance.
Nov 13 19:02:44 user nova-compute[75216]: DEBUG nova.compute.manager [None req-aa159e28-9a69-4b37-946c-55d31d208d47 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: 2f074d68-d0a7-4204-a79d-be619ee42d0c] Deleting volume: 8a7c3d74-e183-497b-b6c7-85be2b2f171e {{(pid=75216) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 13 19:02:44 user nova-compute[75216]: INFO nova.compute.manager [None req-1e0a2a93-e4bf-4493-bce4-497a9c8311e8 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] [instance: 884178b6-f98e-41fb-9f59-e41af82553b3] Took 5.64 seconds to spawn the instance on the hypervisor.
Nov 13 19:02:44 user nova-compute[75216]: DEBUG nova.compute.manager [None req-1e0a2a93-e4bf-4493-bce4-497a9c8311e8 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] [instance: 884178b6-f98e-41fb-9f59-e41af82553b3] Checking state {{(pid=75216) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 19:02:44 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-aa159e28-9a69-4b37-946c-55d31d208d47 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:02:44 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-aa159e28-9a69-4b37-946c-55d31d208d47 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:02:44 user nova-compute[75216]: INFO nova.compute.manager [None req-1e0a2a93-e4bf-4493-bce4-497a9c8311e8 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] [instance: 884178b6-f98e-41fb-9f59-e41af82553b3] Took 6.30 seconds to build instance.
Nov 13 19:02:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1e0a2a93-e4bf-4493-bce4-497a9c8311e8 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] Lock "884178b6-f98e-41fb-9f59-e41af82553b3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.390s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:02:45 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-aa159e28-9a69-4b37-946c-55d31d208d47 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 19:02:45 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-aa159e28-9a69-4b37-946c-55d31d208d47 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 19:02:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-aa159e28-9a69-4b37-946c-55d31d208d47 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.324s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:02:45 user nova-compute[75216]: INFO nova.scheduler.client.report [None req-aa159e28-9a69-4b37-946c-55d31d208d47 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Deleted allocations for instance 2f074d68-d0a7-4204-a79d-be619ee42d0c
Nov 13 19:02:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-aa159e28-9a69-4b37-946c-55d31d208d47 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Lock "2f074d68-d0a7-4204-a79d-be619ee42d0c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.652s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:02:48 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:02:48 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:02:51 user nova-compute[75216]: DEBUG nova.compute.manager [None req-6fbc66c8-a9d6-4efa-83d1-1dbb5c7d863f tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: 5c18c0ad-60e5-4ef2-97f2-b7008e89ac78] Checking state {{(pid=75216) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 19:02:51 user nova-compute[75216]: INFO nova.compute.manager [None req-6fbc66c8-a9d6-4efa-83d1-1dbb5c7d863f tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: 5c18c0ad-60e5-4ef2-97f2-b7008e89ac78] instance snapshotting
Nov 13 19:02:51 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-6fbc66c8-a9d6-4efa-83d1-1dbb5c7d863f tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: 5c18c0ad-60e5-4ef2-97f2-b7008e89ac78] Beginning live snapshot process
Nov 13 19:02:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-6fbc66c8-a9d6-4efa-83d1-1dbb5c7d863f tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c18c0ad-60e5-4ef2-97f2-b7008e89ac78/disk --force-share --output=json -f qcow2 {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:02:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-6fbc66c8-a9d6-4efa-83d1-1dbb5c7d863f tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c18c0ad-60e5-4ef2-97f2-b7008e89ac78/disk --force-share --output=json -f qcow2" returned: 0 in 0.187s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:02:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-6fbc66c8-a9d6-4efa-83d1-1dbb5c7d863f tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c18c0ad-60e5-4ef2-97f2-b7008e89ac78/disk --force-share --output=json -f qcow2 {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:02:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-6fbc66c8-a9d6-4efa-83d1-1dbb5c7d863f tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c18c0ad-60e5-4ef2-97f2-b7008e89ac78/disk --force-share --output=json -f qcow2" returned: 0 in 0.179s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:02:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-6fbc66c8-a9d6-4efa-83d1-1dbb5c7d863f tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:02:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-6fbc66c8-a9d6-4efa-83d1-1dbb5c7d863f tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json" returned: 0 in 0.174s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:02:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-6fbc66c8-a9d6-4efa-83d1-1dbb5c7d863f tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpfdxkhw46/3e579b12aadb4df788d1232308a034c1.delta 1073741824 {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:02:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-6fbc66c8-a9d6-4efa-83d1-1dbb5c7d863f tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpfdxkhw46/3e579b12aadb4df788d1232308a034c1.delta 1073741824" returned: 0 in 0.048s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:02:52 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-6fbc66c8-a9d6-4efa-83d1-1dbb5c7d863f tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: 5c18c0ad-60e5-4ef2-97f2-b7008e89ac78] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 13 19:02:53 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:02:53 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-6fbc66c8-a9d6-4efa-83d1-1dbb5c7d863f tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75216) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 13 19:02:53 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:02:53 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:02:53 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-6fbc66c8-a9d6-4efa-83d1-1dbb5c7d863f tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75216) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 13 19:02:53 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-6fbc66c8-a9d6-4efa-83d1-1dbb5c7d863f tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: 5c18c0ad-60e5-4ef2-97f2-b7008e89ac78] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 13 19:02:53 user nova-compute[75216]: DEBUG nova.privsep.utils [None req-6fbc66c8-a9d6-4efa-83d1-1dbb5c7d863f tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75216) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 13 19:02:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-6fbc66c8-a9d6-4efa-83d1-1dbb5c7d863f tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpfdxkhw46/3e579b12aadb4df788d1232308a034c1.delta /opt/stack/data/nova/instances/snapshots/tmpfdxkhw46/3e579b12aadb4df788d1232308a034c1 {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:02:54 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-6fbc66c8-a9d6-4efa-83d1-1dbb5c7d863f tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpfdxkhw46/3e579b12aadb4df788d1232308a034c1.delta /opt/stack/data/nova/instances/snapshots/tmpfdxkhw46/3e579b12aadb4df788d1232308a034c1" returned: 0 in 0.261s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:02:54 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-6fbc66c8-a9d6-4efa-83d1-1dbb5c7d863f tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: 5c18c0ad-60e5-4ef2-97f2-b7008e89ac78] Snapshot extracted, beginning image upload
Nov 13 19:02:55 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:02:56 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:02:56 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:02:56 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-6fbc66c8-a9d6-4efa-83d1-1dbb5c7d863f tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: 5c18c0ad-60e5-4ef2-97f2-b7008e89ac78] Snapshot image upload complete
Nov 13 19:02:56 user nova-compute[75216]: INFO nova.compute.manager [None req-6fbc66c8-a9d6-4efa-83d1-1dbb5c7d863f tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: 5c18c0ad-60e5-4ef2-97f2-b7008e89ac78] Took 4.82 seconds to snapshot the instance on the hypervisor.
Nov 13 19:02:57 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:02:57 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75216) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 19:02:58 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:02:58 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:02:58 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:02:59 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:02:59 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Starting heal instance info cache {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 19:02:59 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Didn't find any instances for network info cache update. {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 13 19:02:59 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:03:00 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:03:00 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:03:00 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:03:00 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:03:00 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Auditing locally available compute resources for user (node: user) {{(pid=75216) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 19:03:00 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 19:03:00 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a3e849-6570-4820-97c8-75468b5bea4f/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:03:00 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a3e849-6570-4820-97c8-75468b5bea4f/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:03:00 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a3e849-6570-4820-97c8-75468b5bea4f/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:03:00 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a3e849-6570-4820-97c8-75468b5bea4f/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:03:00 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b752173-e573-426e-b9f1-bff92a4c2b55/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:03:01 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b752173-e573-426e-b9f1-bff92a4c2b55/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:03:01 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b752173-e573-426e-b9f1-bff92a4c2b55/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:03:01 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b752173-e573-426e-b9f1-bff92a4c2b55/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:03:01 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:03:01 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:03:01 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:03:01 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:03:01 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af8089f7-6dc3-4655-9369-2177dbd7bf4d/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:03:01 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af8089f7-6dc3-4655-9369-2177dbd7bf4d/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:03:01 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af8089f7-6dc3-4655-9369-2177dbd7bf4d/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:03:02 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af8089f7-6dc3-4655-9369-2177dbd7bf4d/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:03:02 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 19:03:02 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c18c0ad-60e5-4ef2-97f2-b7008e89ac78/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:03:02 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c18c0ad-60e5-4ef2-97f2-b7008e89ac78/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:03:02 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c18c0ad-60e5-4ef2-97f2-b7008e89ac78/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:03:02 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c18c0ad-60e5-4ef2-97f2-b7008e89ac78/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:03:02 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/884178b6-f98e-41fb-9f59-e41af82553b3/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:03:02 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/884178b6-f98e-41fb-9f59-e41af82553b3/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:03:02 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/884178b6-f98e-41fb-9f59-e41af82553b3/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:03:02 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/884178b6-f98e-41fb-9f59-e41af82553b3/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:03:03 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:03:03 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 19:03:03 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 19:03:03 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Hypervisor/Node resource view: name=user free_ram=8177MB free_disk=25.23003387451172GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75216) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 19:03:03 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:03:03 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:03:03 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance a1a3e849-6570-4820-97c8-75468b5bea4f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 19:03:03 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 19:03:03 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance 1e5f1164-a15e-40cf-b7bc-5aeb404a1216 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 19:03:03 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance af8089f7-6dc3-4655-9369-2177dbd7bf4d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 19:03:03 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance 5c18c0ad-60e5-4ef2-97f2-b7008e89ac78 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 19:03:03 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance 7b752173-e573-426e-b9f1-bff92a4c2b55 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 19:03:03 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance 884178b6-f98e-41fb-9f59-e41af82553b3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 19:03:03 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 19:03:03 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 19:03:03 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 19:03:03 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 19:03:03 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Compute_service record updated for user:user {{(pid=75216) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 19:03:03 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.388s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:03:03 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:03:05 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:03:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:03:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:03:12 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-0355e818-d4e1-478c-8bb2-56e98e682b36 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Acquiring lock "71134725-e6cc-4426-b2c2-5be4991c53f7" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:03:12 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-0355e818-d4e1-478c-8bb2-56e98e682b36 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Lock "71134725-e6cc-4426-b2c2-5be4991c53f7" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:03:12 user nova-compute[75216]: INFO nova.compute.manager [None req-0355e818-d4e1-478c-8bb2-56e98e682b36 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] [instance: 71134725-e6cc-4426-b2c2-5be4991c53f7] Unshelving
Nov 13 19:03:12 user nova-compute[75216]: INFO nova.virt.block_device [None req-0355e818-d4e1-478c-8bb2-56e98e682b36 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] [instance: 71134725-e6cc-4426-b2c2-5be4991c53f7] Booting with volume 3e8fd410-a0f1-42e1-a536-cd6112122746 at /dev/vdc
Nov 13 19:03:12 user nova-compute[75216]: DEBUG os_brick.utils [None req-0355e818-d4e1-478c-8bb2-56e98e682b36 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 19:03:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:03:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:03:12 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[88de1422-d97d-4252-aba2-885940fc0169]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aea6fcfe14b9\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:03:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:03:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:03:12 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a9501a4-e69d-41d5-b486-fbb8f37431a6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:03:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:03:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:03:12 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[950e2bcc-4eba-4c69-9b35-67a36f861a32]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:03:12 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[4745e6b0-d77a-49ce-af45-794930eff564]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:03:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-0355e818-d4e1-478c-8bb2-56e98e682b36 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Running cmd (subprocess): nvme version {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:03:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-0355e818-d4e1-478c-8bb2-56e98e682b36 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] 'nvme version' failed. Not Retrying. {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 19:03:12 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0355e818-d4e1-478c-8bb2-56e98e682b36 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] nvme not present on system {{(pid=75216) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 19:03:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:03:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 19:03:12 user nova-compute[75216]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 19:03:12 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e425819-4d64-46cf-8d37-23458738e208]: (4, '') {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:03:12 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-0355e818-d4e1-478c-8bb2-56e98e682b36 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75216) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 19:03:12 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-0355e818-d4e1-478c-8bb2-56e98e682b36 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 19:03:12 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-0355e818-d4e1-478c-8bb2-56e98e682b36 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] LIGHTOS: no hostnqn found. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 19:03:12 user nova-compute[75216]: DEBUG os_brick.utils [None req-0355e818-d4e1-478c-8bb2-56e98e682b36 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] <== get_connector_properties: return (148ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aea6fcfe14b9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 19:03:12 user nova-compute[75216]: DEBUG nova.virt.block_device [None req-0355e818-d4e1-478c-8bb2-56e98e682b36 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] [instance: 71134725-e6cc-4426-b2c2-5be4991c53f7] Updating existing volume attachment record: 42884f55-3c7c-40ce-ac29-4f252f4d3391 {{(pid=75216) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 19:03:13 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:03:13 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:03:16 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-0355e818-d4e1-478c-8bb2-56e98e682b36 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:03:16 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-0355e818-d4e1-478c-8bb2-56e98e682b36 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:03:16 user nova-compute[75216]: DEBUG nova.objects.instance [None req-0355e818-d4e1-478c-8bb2-56e98e682b36 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Lazy-loading 'pci_requests' on Instance uuid 71134725-e6cc-4426-b2c2-5be4991c53f7 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:03:16 user nova-compute[75216]: DEBUG nova.objects.instance [None req-0355e818-d4e1-478c-8bb2-56e98e682b36 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Lazy-loading 'numa_topology' on Instance uuid 71134725-e6cc-4426-b2c2-5be4991c53f7 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:03:16 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-0355e818-d4e1-478c-8bb2-56e98e682b36 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75216) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 19:03:16 user nova-compute[75216]: INFO nova.compute.claims [None req-0355e818-d4e1-478c-8bb2-56e98e682b36 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] [instance: 71134725-e6cc-4426-b2c2-5be4991c53f7] Claim successful on node user
Nov 13 19:03:17 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-0355e818-d4e1-478c-8bb2-56e98e682b36 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 19:03:17 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-0355e818-d4e1-478c-8bb2-56e98e682b36 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 19:03:17 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-0355e818-d4e1-478c-8bb2-56e98e682b36 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.420s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:03:17 user nova-compute[75216]: INFO nova.network.neutron [None req-0355e818-d4e1-478c-8bb2-56e98e682b36 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] [instance: 71134725-e6cc-4426-b2c2-5be4991c53f7] Updating port a1fda64d-c09d-45d7-b1ae-be416c60918d with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 13 19:03:17 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-0355e818-d4e1-478c-8bb2-56e98e682b36 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Acquiring lock "refresh_cache-71134725-e6cc-4426-b2c2-5be4991c53f7" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 19:03:17 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-0355e818-d4e1-478c-8bb2-56e98e682b36 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Acquired lock "refresh_cache-71134725-e6cc-4426-b2c2-5be4991c53f7" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 19:03:17 user nova-compute[75216]: DEBUG nova.network.neutron [None req-0355e818-d4e1-478c-8bb2-56e98e682b36 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] [instance: 71134725-e6cc-4426-b2c2-5be4991c53f7] Building network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 19:03:18 user nova-compute[75216]: DEBUG nova.compute.manager [req-8cff2951-4c65-462a-a22f-586e81a7fe38 req-648e245d-eab9-4d50-bc17-9127e2a32b2d service nova] [instance: 71134725-e6cc-4426-b2c2-5be4991c53f7] Received event network-changed-a1fda64d-c09d-45d7-b1ae-be416c60918d {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:03:18 user nova-compute[75216]: DEBUG nova.compute.manager [req-8cff2951-4c65-462a-a22f-586e81a7fe38 req-648e245d-eab9-4d50-bc17-9127e2a32b2d service nova] [instance: 71134725-e6cc-4426-b2c2-5be4991c53f7] Refreshing instance network info cache due to event network-changed-a1fda64d-c09d-45d7-b1ae-be416c60918d. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 19:03:18 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-8cff2951-4c65-462a-a22f-586e81a7fe38 req-648e245d-eab9-4d50-bc17-9127e2a32b2d service nova] Acquiring lock "refresh_cache-71134725-e6cc-4426-b2c2-5be4991c53f7" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 19:03:18 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:03:18 user nova-compute[75216]: DEBUG nova.network.neutron [None req-0355e818-d4e1-478c-8bb2-56e98e682b36 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] [instance: 71134725-e6cc-4426-b2c2-5be4991c53f7] Updating instance_info_cache with network_info: [{"id": "a1fda64d-c09d-45d7-b1ae-be416c60918d", "address": "fa:16:3e:bd:0d:c9", "network": {"id": "8cbeb1cc-a067-4c8d-82d8-0dc5c2ac924c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-742672345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a58d1e76a793406bbdd3821ff74abd92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1fda64d-c0", "ovs_interfaceid": "a1fda64d-c09d-45d7-b1ae-be416c60918d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:03:18 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-0355e818-d4e1-478c-8bb2-56e98e682b36 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Releasing lock "refresh_cache-71134725-e6cc-4426-b2c2-5be4991c53f7" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 19:03:18 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-0355e818-d4e1-478c-8bb2-56e98e682b36 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] [instance: 71134725-e6cc-4426-b2c2-5be4991c53f7] Creating instance directory {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 19:03:18 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-0355e818-d4e1-478c-8bb2-56e98e682b36 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] [instance: 71134725-e6cc-4426-b2c2-5be4991c53f7] Creating image(s)
Nov 13 19:03:18 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-0355e818-d4e1-478c-8bb2-56e98e682b36 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Acquiring lock "/opt/stack/data/nova/instances/71134725-e6cc-4426-b2c2-5be4991c53f7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:03:18 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-0355e818-d4e1-478c-8bb2-56e98e682b36 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Lock "/opt/stack/data/nova/instances/71134725-e6cc-4426-b2c2-5be4991c53f7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:03:18 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-0355e818-d4e1-478c-8bb2-56e98e682b36 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Lock "/opt/stack/data/nova/instances/71134725-e6cc-4426-b2c2-5be4991c53f7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:03:18 user nova-compute[75216]: DEBUG nova.objects.instance [None req-0355e818-d4e1-478c-8bb2-56e98e682b36 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Lazy-loading 'trusted_certs' on Instance uuid 71134725-e6cc-4426-b2c2-5be4991c53f7 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:03:18 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-8cff2951-4c65-462a-a22f-586e81a7fe38 req-648e245d-eab9-4d50-bc17-9127e2a32b2d service nova] Acquired lock "refresh_cache-71134725-e6cc-4426-b2c2-5be4991c53f7" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 19:03:18 user nova-compute[75216]: DEBUG nova.network.neutron [req-8cff2951-4c65-462a-a22f-586e81a7fe38 req-648e245d-eab9-4d50-bc17-9127e2a32b2d service nova] [instance: 71134725-e6cc-4426-b2c2-5be4991c53f7] Refreshing network info cache for port a1fda64d-c09d-45d7-b1ae-be416c60918d {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 19:03:18 user nova-compute[75216]: DEBUG nova.objects.base [None req-0355e818-d4e1-478c-8bb2-56e98e682b36 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Object Instance<71134725-e6cc-4426-b2c2-5be4991c53f7> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=75216) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 19:03:18 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-0355e818-d4e1-478c-8bb2-56e98e682b36 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Acquiring lock "0f6017f6df39adbb7b100164a0e31980a309298d" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:03:18 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-0355e818-d4e1-478c-8bb2-56e98e682b36 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Lock "0f6017f6df39adbb7b100164a0e31980a309298d" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.003s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:03:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-0355e818-d4e1-478c-8bb2-56e98e682b36 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f6017f6df39adbb7b100164a0e31980a309298d.part --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:03:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-0355e818-d4e1-478c-8bb2-56e98e682b36 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f6017f6df39adbb7b100164a0e31980a309298d.part --force-share --output=json" returned: 0 in 0.190s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:03:19 user nova-compute[75216]: DEBUG nova.virt.images [None req-0355e818-d4e1-478c-8bb2-56e98e682b36 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] 6e7de34d-221f-437b-85d0-70c21dd9f47a was qcow2, converting to raw {{(pid=75216) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 13 19:03:19 user nova-compute[75216]: DEBUG nova.privsep.utils [None req-0355e818-d4e1-478c-8bb2-56e98e682b36 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75216) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 13 19:03:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-0355e818-d4e1-478c-8bb2-56e98e682b36 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/0f6017f6df39adbb7b100164a0e31980a309298d.part /opt/stack/data/nova/instances/_base/0f6017f6df39adbb7b100164a0e31980a309298d.converted {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:03:19 user nova-compute[75216]: DEBUG nova.network.neutron [req-8cff2951-4c65-462a-a22f-586e81a7fe38 req-648e245d-eab9-4d50-bc17-9127e2a32b2d service nova] [instance: 71134725-e6cc-4426-b2c2-5be4991c53f7] Updated VIF entry in instance network info cache for port a1fda64d-c09d-45d7-b1ae-be416c60918d. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 19:03:19 user nova-compute[75216]: DEBUG nova.network.neutron [req-8cff2951-4c65-462a-a22f-586e81a7fe38 req-648e245d-eab9-4d50-bc17-9127e2a32b2d service nova] [instance: 71134725-e6cc-4426-b2c2-5be4991c53f7] Updating instance_info_cache with network_info: [{"id": "a1fda64d-c09d-45d7-b1ae-be416c60918d", "address": "fa:16:3e:bd:0d:c9", "network": {"id": "8cbeb1cc-a067-4c8d-82d8-0dc5c2ac924c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-742672345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a58d1e76a793406bbdd3821ff74abd92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1fda64d-c0", "ovs_interfaceid": "a1fda64d-c09d-45d7-b1ae-be416c60918d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:03:19 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-8cff2951-4c65-462a-a22f-586e81a7fe38 req-648e245d-eab9-4d50-bc17-9127e2a32b2d service nova] Releasing lock "refresh_cache-71134725-e6cc-4426-b2c2-5be4991c53f7" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 19:03:20 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-0355e818-d4e1-478c-8bb2-56e98e682b36 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/0f6017f6df39adbb7b100164a0e31980a309298d.part /opt/stack/data/nova/instances/_base/0f6017f6df39adbb7b100164a0e31980a309298d.converted" returned: 0 in 0.417s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:03:20 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-0355e818-d4e1-478c-8bb2-56e98e682b36 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f6017f6df39adbb7b100164a0e31980a309298d.converted --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:03:20 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-0355e818-d4e1-478c-8bb2-56e98e682b36 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f6017f6df39adbb7b100164a0e31980a309298d.converted --force-share --output=json" returned: 0 in 0.170s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:03:20 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-0355e818-d4e1-478c-8bb2-56e98e682b36 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Lock "0f6017f6df39adbb7b100164a0e31980a309298d" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.951s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:03:20 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-0355e818-d4e1-478c-8bb2-56e98e682b36 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f6017f6df39adbb7b100164a0e31980a309298d --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:03:20 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-0355e818-d4e1-478c-8bb2-56e98e682b36 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f6017f6df39adbb7b100164a0e31980a309298d --force-share --output=json" returned: 0 in 0.172s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:03:20 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-0355e818-d4e1-478c-8bb2-56e98e682b36 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Acquiring lock "0f6017f6df39adbb7b100164a0e31980a309298d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:03:20 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-0355e818-d4e1-478c-8bb2-56e98e682b36 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Lock "0f6017f6df39adbb7b100164a0e31980a309298d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:03:20 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-0355e818-d4e1-478c-8bb2-56e98e682b36 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f6017f6df39adbb7b100164a0e31980a309298d --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:03:20 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-0355e818-d4e1-478c-8bb2-56e98e682b36 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f6017f6df39adbb7b100164a0e31980a309298d --force-share --output=json" returned: 0 in 0.181s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:03:20 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-0355e818-d4e1-478c-8bb2-56e98e682b36 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0f6017f6df39adbb7b100164a0e31980a309298d,backing_fmt=raw /opt/stack/data/nova/instances/71134725-e6cc-4426-b2c2-5be4991c53f7/disk 1073741824 {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:03:20 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-0355e818-d4e1-478c-8bb2-56e98e682b36 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0f6017f6df39adbb7b100164a0e31980a309298d,backing_fmt=raw /opt/stack/data/nova/instances/71134725-e6cc-4426-b2c2-5be4991c53f7/disk 1073741824" returned: 0 in 0.052s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:03:20 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-0355e818-d4e1-478c-8bb2-56e98e682b36 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Lock "0f6017f6df39adbb7b100164a0e31980a309298d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.240s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:03:20 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-0355e818-d4e1-478c-8bb2-56e98e682b36 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f6017f6df39adbb7b100164a0e31980a309298d --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:03:20 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-0355e818-d4e1-478c-8bb2-56e98e682b36 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f6017f6df39adbb7b100164a0e31980a309298d --force-share --output=json" returned: 0 in 0.169s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:03:20 user nova-compute[75216]: DEBUG nova.objects.instance [None req-0355e818-d4e1-478c-8bb2-56e98e682b36 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Lazy-loading 'migration_context' on Instance uuid 71134725-e6cc-4426-b2c2-5be4991c53f7 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:03:20 user nova-compute[75216]: DEBUG nova.objects.base [None req-0355e818-d4e1-478c-8bb2-56e98e682b36 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Object Instance<71134725-e6cc-4426-b2c2-5be4991c53f7> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=75216) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 19:03:20 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-0355e818-d4e1-478c-8bb2-56e98e682b36 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] [instance: 71134725-e6cc-4426-b2c2-5be4991c53f7] Rebasing disk image.
Nov 13 19:03:20 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-0355e818-d4e1-478c-8bb2-56e98e682b36 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:03:21 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-0355e818-d4e1-478c-8bb2-56e98e682b36 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json" returned: 0 in 0.169s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:03:21 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-0355e818-d4e1-478c-8bb2-56e98e682b36 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 -F raw /opt/stack/data/nova/instances/71134725-e6cc-4426-b2c2-5be4991c53f7/disk {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:03:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:03:23 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-0355e818-d4e1-478c-8bb2-56e98e682b36 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 -F raw /opt/stack/data/nova/instances/71134725-e6cc-4426-b2c2-5be4991c53f7/disk" returned: 0 in 2.409s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:03:23 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-0355e818-d4e1-478c-8bb2-56e98e682b36 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] [instance: 71134725-e6cc-4426-b2c2-5be4991c53f7] Created local disks {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 19:03:23 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-0355e818-d4e1-478c-8bb2-56e98e682b36 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] [instance: 71134725-e6cc-4426-b2c2-5be4991c53f7] Ensure instance console log exists: /opt/stack/data/nova/instances/71134725-e6cc-4426-b2c2-5be4991c53f7/console.log {{(pid=75216) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 19:03:23 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-0355e818-d4e1-478c-8bb2-56e98e682b36 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:03:23 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-0355e818-d4e1-478c-8bb2-56e98e682b36 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:03:23 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-0355e818-d4e1-478c-8bb2-56e98e682b36 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:03:23 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-0355e818-d4e1-478c-8bb2-56e98e682b36 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] [instance: 71134725-e6cc-4426-b2c2-5be4991c53f7] Start _get_guest_xml network_info=[{"id": "a1fda64d-c09d-45d7-b1ae-be416c60918d", "address": "fa:16:3e:bd:0d:c9", "network": {"id": "8cbeb1cc-a067-4c8d-82d8-0dc5c2ac924c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-742672345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a58d1e76a793406bbdd3821ff74abd92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1fda64d-c0", "ovs_interfaceid": "a1fda64d-c09d-45d7-b1ae-be416c60918d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='24eb4361e5e8afdaf175a4f02555d9f8',container_format='bare',created_at=2023-11-13T19:01:21Z,direct_url=<?>,disk_format='qcow2',id=6e7de34d-221f-437b-85d0-70c21dd9f47a,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-617465978-shelved',owner='a58d1e76a793406bbdd3821ff74abd92',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-13T19:01:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'guest_format': None, 'boot_index': 0, 'image_id': '77bcb5ba-8510-41ec-a88d-96097bb431de'}], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3e8fd410-a0f1-42e1-a536-cd6112122746', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RzvSGPHt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': '71134725-e6cc-4426-b2c2-5be4991c53f7', 'attached_at': '', 'detached_at': '', 'volume_id': '3e8fd410-a0f1-42e1-a536-cd6112122746', 'serial': '3e8fd410-a0f1-42e1-a536-cd6112122746'}, 'attachment_id': '42884f55-3c7c-40ce-ac29-4f252f4d3391', 'guest_format': None, 'mount_device': '/dev/vdc', 'delete_on_termination': False, 'boot_index': None, 'volume_type': None} {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 19:03:23 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-0355e818-d4e1-478c-8bb2-56e98e682b36 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 19:03:23 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-0355e818-d4e1-478c-8bb2-56e98e682b36 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 19:03:23 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-0355e818-d4e1-478c-8bb2-56e98e682b36 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 19:03:23 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-0355e818-d4e1-478c-8bb2-56e98e682b36 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] CPU controller missing on host. {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 19:03:23 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-0355e818-d4e1-478c-8bb2-56e98e682b36 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 19:03:23 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-0355e818-d4e1-478c-8bb2-56e98e682b36 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] CPU controller found on host. {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 19:03:23 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-0355e818-d4e1-478c-8bb2-56e98e682b36 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75216) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 19:03:23 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-0355e818-d4e1-478c-8bb2-56e98e682b36 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T18:40:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='24eb4361e5e8afdaf175a4f02555d9f8',container_format='bare',created_at=2023-11-13T19:01:21Z,direct_url=<?>,disk_format='qcow2',id=6e7de34d-221f-437b-85d0-70c21dd9f47a,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-617465978-shelved',owner='a58d1e76a793406bbdd3821ff74abd92',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-13T19:01:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 19:03:23 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-0355e818-d4e1-478c-8bb2-56e98e682b36 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Flavor limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 19:03:23 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-0355e818-d4e1-478c-8bb2-56e98e682b36 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Image limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 19:03:23 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-0355e818-d4e1-478c-8bb2-56e98e682b36 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Flavor pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 19:03:23 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-0355e818-d4e1-478c-8bb2-56e98e682b36 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Image pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 19:03:23 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-0355e818-d4e1-478c-8bb2-56e98e682b36 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 19:03:23 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-0355e818-d4e1-478c-8bb2-56e98e682b36 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 19:03:23 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-0355e818-d4e1-478c-8bb2-56e98e682b36 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 19:03:23 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-0355e818-d4e1-478c-8bb2-56e98e682b36 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Got 1 possible topologies {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 19:03:23 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-0355e818-d4e1-478c-8bb2-56e98e682b36 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 19:03:23 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-0355e818-d4e1-478c-8bb2-56e98e682b36 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 19:03:23 user nova-compute[75216]: DEBUG nova.objects.instance [None req-0355e818-d4e1-478c-8bb2-56e98e682b36 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Lazy-loading 'vcpu_model' on Instance uuid 71134725-e6cc-4426-b2c2-5be4991c53f7 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:03:23 user nova-compute[75216]: DEBUG nova.objects.base [None req-0355e818-d4e1-478c-8bb2-56e98e682b36 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Object Instance<71134725-e6cc-4426-b2c2-5be4991c53f7> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=75216) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 19:03:23 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0355e818-d4e1-478c-8bb2-56e98e682b36 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] [instance: 71134725-e6cc-4426-b2c2-5be4991c53f7] Calling os-brick to attach iSCSI Volume {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 19:03:23 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-0355e818-d4e1-478c-8bb2-56e98e682b36 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3a8669e40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3e8fd410-a0f1-42e1-a536-cd6112122746', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RzvSGPHt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 19:03:23 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-0355e818-d4e1-478c-8bb2-56e98e682b36 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 19:03:23 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-0355e818-d4e1-478c-8bb2-56e98e682b36 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 19:03:23 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-0355e818-d4e1-478c-8bb2-56e98e682b36 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 19:03:23 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-0355e818-d4e1-478c-8bb2-56e98e682b36 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 19:03:23 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-0355e818-d4e1-478c-8bb2-56e98e682b36 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3e8fd410-a0f1-42e1-a536-cd6112122746" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 19:03:23 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-0355e818-d4e1-478c-8bb2-56e98e682b36 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3e8fd410-a0f1-42e1-a536-cd6112122746" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 19:03:23 user nova-compute[75216]: INFO os_brick.initiator.connectors.iscsi [None req-0355e818-d4e1-478c-8bb2-56e98e682b36 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 19:03:23 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e8fd410-a0f1-42e1-a536-cd6112122746 -p 172.16.0.220:3260 {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:03:23 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e8fd410-a0f1-42e1-a536-cd6112122746 -p 172.16.0.220:3260" returned: 21 in 0.120s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:03:23 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[883f073c-aa2c-475e-b75d-cb733f487e4f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:03:23 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-0355e818-d4e1-478c-8bb2-56e98e682b36 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 19:03:23 user nova-compute[75216]:  {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:03:23 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e8fd410-a0f1-42e1-a536-cd6112122746 -p 172.16.0.220:3260 --interface default --op new {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:03:23 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e8fd410-a0f1-42e1-a536-cd6112122746 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:03:23 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9d861c9-2815-4c35-99f3-b6046d1e0510]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3e8fd410-a0f1-42e1-a536-cd6112122746] added\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:03:23 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-0355e818-d4e1-478c-8bb2-56e98e682b36 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3e8fd410-a0f1-42e1-a536-cd6112122746] added
Nov 13 19:03:23 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:03:23 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e8fd410-a0f1-42e1-a536-cd6112122746 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:03:23 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e8fd410-a0f1-42e1-a536-cd6112122746 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:03:23 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[10e5e188-9333-4a3b-ad66-ab48684e5d3e]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:03:23 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-0355e818-d4e1-478c-8bb2-56e98e682b36 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:03:23 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e8fd410-a0f1-42e1-a536-cd6112122746 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:03:23 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e8fd410-a0f1-42e1-a536-cd6112122746 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.062s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:03:23 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec8c9a56-1fd2-43f7-96de-bec0d66fba10]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:03:23 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-0355e818-d4e1-478c-8bb2-56e98e682b36 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:03:23 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e8fd410-a0f1-42e1-a536-cd6112122746 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RzvSGPHt {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:03:23 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e8fd410-a0f1-42e1-a536-cd6112122746 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RzvSGPHt" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:03:23 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[39e3788b-b203-4a00-afa3-ec40b9324f43]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:03:23 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-0355e818-d4e1-478c-8bb2-56e98e682b36 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RzvSGPHt'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:03:23 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e8fd410-a0f1-42e1-a536-cd6112122746 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:03:23 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e8fd410-a0f1-42e1-a536-cd6112122746 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:03:23 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e69dd80-d417-4f6d-a727-d683202d5305]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:03:23 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-0355e818-d4e1-478c-8bb2-56e98e682b36 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:03:23 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:03:23 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:03:23 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdff33d6-ce3e-4d7b-b112-6fb10ac7013a]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dfdac0b-bc0c-4291-ae5c-8eb516d7b164 (non-flash)\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:03:23 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-0355e818-d4e1-478c-8bb2-56e98e682b36 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1 (non-flash)
Nov 13 19:03:23 user nova-compute[75216]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dfdac0b-bc0c-4291-ae5c-8eb516d7b164 (non-flash)
Nov 13 19:03:23 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 19:03:23 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-0355e818-d4e1-478c-8bb2-56e98e682b36 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1 (non-flash)
Nov 13 19:03:23 user nova-compute[75216]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dfdac0b-bc0c-4291-ae5c-8eb516d7b164 (non-flash)
Nov 13 19:03:23 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 19:03:23 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e8fd410-a0f1-42e1-a536-cd6112122746 -p 172.16.0.220:3260 --login {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:03:23 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e8fd410-a0f1-42e1-a536-cd6112122746 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:03:23 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[27f7a28f-c969-4550-96c9-a66593a49a44]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3e8fd410-a0f1-42e1-a536-cd6112122746, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3e8fd410-a0f1-42e1-a536-cd6112122746, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:03:23 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-0355e818-d4e1-478c-8bb2-56e98e682b36 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3e8fd410-a0f1-42e1-a536-cd6112122746, portal: 172.16.0.220,3260]
Nov 13 19:03:23 user nova-compute[75216]: Login to [iface: default, target: iqn.2010-10.org.openstack:3e8fd410-a0f1-42e1-a536-cd6112122746, portal: 172.16.0.220,3260] successful.
Nov 13 19:03:23 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:03:23 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e8fd410-a0f1-42e1-a536-cd6112122746 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:03:24 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e8fd410-a0f1-42e1-a536-cd6112122746 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:03:24 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ebb50cc-da98-4f31-bf96-49bfd84f9b68]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:03:24 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-0355e818-d4e1-478c-8bb2-56e98e682b36 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:03:24 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:03:24 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:03:24 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcd60dee-9a81-4353-907d-4d02bb16577b]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dfdac0b-bc0c-4291-ae5c-8eb516d7b164 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e8fd410-a0f1-42e1-a536-cd6112122746 (non-flash)\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:03:24 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-0355e818-d4e1-478c-8bb2-56e98e682b36 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1 (non-flash)
Nov 13 19:03:24 user nova-compute[75216]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dfdac0b-bc0c-4291-ae5c-8eb516d7b164 (non-flash)
Nov 13 19:03:24 user nova-compute[75216]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e8fd410-a0f1-42e1-a536-cd6112122746 (non-flash)
Nov 13 19:03:24 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 19:03:24 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-0355e818-d4e1-478c-8bb2-56e98e682b36 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1 (non-flash)
Nov 13 19:03:24 user nova-compute[75216]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dfdac0b-bc0c-4291-ae5c-8eb516d7b164 (non-flash)
Nov 13 19:03:24 user nova-compute[75216]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e8fd410-a0f1-42e1-a536-cd6112122746 (non-flash)
Nov 13 19:03:24 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 19:03:24 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-0355e818-d4e1-478c-8bb2-56e98e682b36 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3e8fd410-a0f1-42e1-a536-cd6112122746" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.412s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 19:03:24 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-0355e818-d4e1-478c-8bb2-56e98e682b36 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Connected to 172.16.0.220:3260 {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 19:03:24 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-0355e818-d4e1-478c-8bb2-56e98e682b36 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] HCTL ('35', '-', '-', 0) found on session 37 with lun 0 {{(pid=75216) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 19:03:24 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-0355e818-d4e1-478c-8bb2-56e98e682b36 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75216) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 19:03:24 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:03:24 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:03:24 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[51dc3af4-7d09-4a14-aadc-c9e6f6ea779d]: (4, ('- - 0', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:03:24 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-0355e818-d4e1-478c-8bb2-56e98e682b36 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Searching for a device in session 37 and hctl ['35', '*', '*', 0] yield: None {{(pid=75216) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 19:03:25 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-0355e818-d4e1-478c-8bb2-56e98e682b36 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Searching for a device in session 37 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75216) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 19:03:25 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-0355e818-d4e1-478c-8bb2-56e98e682b36 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:3e8fd410-a0f1-42e1-a536-cd6112122746', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RzvSGPHt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 19:03:25 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-0355e818-d4e1-478c-8bb2-56e98e682b36 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.439s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 19:03:25 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-0355e818-d4e1-478c-8bb2-56e98e682b36 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] <== connect_volume: return (1441ms) {'type': 'block', 'scsi_wwn': '26338623039616232', 'path': '/dev/sdd'} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 19:03:25 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0355e818-d4e1-478c-8bb2-56e98e682b36 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] [instance: 71134725-e6cc-4426-b2c2-5be4991c53f7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26338623039616232', 'path': '/dev/sdd'} {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 19:03:25 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-0355e818-d4e1-478c-8bb2-56e98e682b36 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-13T18:59:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-617465978',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-617465978',id=26,image_ref='6e7de34d-221f-437b-85d0-70c21dd9f47a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1201518352',keypairs=<?>,launch_index=0,launched_at=2023-11-13T18:59:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='a58d1e76a793406bbdd3821ff74abd92',ramdisk_id='',reservation_id='r-04yvplgw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1861834155',owner_user_name='tempest-AttachVolumeShelveTestJSON-1861834155-project-member',shelved_at='2023-11-13T19:01:24.483533',shelved_host='user',shelved_image_id='6e7de34d-221f-437b-85d0-70c21dd9f47a'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T19:03:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e59bd525db64698b8e3587734cde6b8',uuid=71134725-e6cc-4426-b2c2-5be4991c53f7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "a1fda64d-c09d-45d7-b1ae-be416c60918d", "address": "fa:16:3e:bd:0d:c9", "network": {"id": "8cbeb1cc-a067-4c8d-82d8-0dc5c2ac924c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-742672345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a58d1e76a793406bbdd3821ff74abd92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1fda64d-c0", "ovs_interfaceid": "a1fda64d-c09d-45d7-b1ae-be416c60918d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75216) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 19:03:25 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-0355e818-d4e1-478c-8bb2-56e98e682b36 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Converting VIF {"id": "a1fda64d-c09d-45d7-b1ae-be416c60918d", "address": "fa:16:3e:bd:0d:c9", "network": {"id": "8cbeb1cc-a067-4c8d-82d8-0dc5c2ac924c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-742672345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a58d1e76a793406bbdd3821ff74abd92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1fda64d-c0", "ovs_interfaceid": "a1fda64d-c09d-45d7-b1ae-be416c60918d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 19:03:25 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-0355e818-d4e1-478c-8bb2-56e98e682b36 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:0d:c9,bridge_name='br-int',has_traffic_filtering=True,id=a1fda64d-c09d-45d7-b1ae-be416c60918d,network=Network(8cbeb1cc-a067-4c8d-82d8-0dc5c2ac924c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1fda64d-c0') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 19:03:25 user nova-compute[75216]: DEBUG nova.objects.instance [None req-0355e818-d4e1-478c-8bb2-56e98e682b36 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Lazy-loading 'pci_devices' on Instance uuid 71134725-e6cc-4426-b2c2-5be4991c53f7 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:03:25 user nova-compute[75216]: DEBUG nova.objects.base [None req-0355e818-d4e1-478c-8bb2-56e98e682b36 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Object Instance<71134725-e6cc-4426-b2c2-5be4991c53f7> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=75216) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 19:03:25 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-0355e818-d4e1-478c-8bb2-56e98e682b36 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] [instance: 71134725-e6cc-4426-b2c2-5be4991c53f7] End _get_guest_xml xml=<domain type="kvm">
Nov 13 19:03:25 user nova-compute[75216]:   <uuid>71134725-e6cc-4426-b2c2-5be4991c53f7</uuid>
Nov 13 19:03:25 user nova-compute[75216]:   <name>instance-0000001a</name>
Nov 13 19:03:25 user nova-compute[75216]:   <memory>524288</memory>
Nov 13 19:03:25 user nova-compute[75216]:   <vcpu>1</vcpu>
Nov 13 19:03:25 user nova-compute[75216]:   <metadata>
Nov 13 19:03:25 user nova-compute[75216]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 19:03:25 user nova-compute[75216]:       <nova:package version="0.0.0"/>
Nov 13 19:03:25 user nova-compute[75216]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-617465978</nova:name>
Nov 13 19:03:25 user nova-compute[75216]:       <nova:creationTime>2023-11-13 19:03:23</nova:creationTime>
Nov 13 19:03:25 user nova-compute[75216]:       <nova:flavor name="m1.tiny">
Nov 13 19:03:25 user nova-compute[75216]:         <nova:memory>512</nova:memory>
Nov 13 19:03:25 user nova-compute[75216]:         <nova:disk>1</nova:disk>
Nov 13 19:03:25 user nova-compute[75216]:         <nova:swap>0</nova:swap>
Nov 13 19:03:25 user nova-compute[75216]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 19:03:25 user nova-compute[75216]:         <nova:vcpus>1</nova:vcpus>
Nov 13 19:03:25 user nova-compute[75216]:       </nova:flavor>
Nov 13 19:03:25 user nova-compute[75216]:       <nova:owner>
Nov 13 19:03:25 user nova-compute[75216]:         <nova:user uuid="7e59bd525db64698b8e3587734cde6b8">tempest-AttachVolumeShelveTestJSON-1861834155-project-member</nova:user>
Nov 13 19:03:25 user nova-compute[75216]:         <nova:project uuid="a58d1e76a793406bbdd3821ff74abd92">tempest-AttachVolumeShelveTestJSON-1861834155</nova:project>
Nov 13 19:03:25 user nova-compute[75216]:       </nova:owner>
Nov 13 19:03:25 user nova-compute[75216]:       <nova:root type="image" uuid="6e7de34d-221f-437b-85d0-70c21dd9f47a"/>
Nov 13 19:03:25 user nova-compute[75216]:       <nova:ports>
Nov 13 19:03:25 user nova-compute[75216]:         <nova:port uuid="a1fda64d-c09d-45d7-b1ae-be416c60918d">
Nov 13 19:03:25 user nova-compute[75216]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 13 19:03:25 user nova-compute[75216]:         </nova:port>
Nov 13 19:03:25 user nova-compute[75216]:       </nova:ports>
Nov 13 19:03:25 user nova-compute[75216]:     </nova:instance>
Nov 13 19:03:25 user nova-compute[75216]:   </metadata>
Nov 13 19:03:25 user nova-compute[75216]:   <sysinfo type="smbios">
Nov 13 19:03:25 user nova-compute[75216]:     <system>
Nov 13 19:03:25 user nova-compute[75216]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 19:03:25 user nova-compute[75216]:       <entry name="product">OpenStack Nova</entry>
Nov 13 19:03:25 user nova-compute[75216]:       <entry name="version">0.0.0</entry>
Nov 13 19:03:25 user nova-compute[75216]:       <entry name="serial">71134725-e6cc-4426-b2c2-5be4991c53f7</entry>
Nov 13 19:03:25 user nova-compute[75216]:       <entry name="uuid">71134725-e6cc-4426-b2c2-5be4991c53f7</entry>
Nov 13 19:03:25 user nova-compute[75216]:       <entry name="family">Virtual Machine</entry>
Nov 13 19:03:25 user nova-compute[75216]:     </system>
Nov 13 19:03:25 user nova-compute[75216]:   </sysinfo>
Nov 13 19:03:25 user nova-compute[75216]:   <os>
Nov 13 19:03:25 user nova-compute[75216]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 19:03:25 user nova-compute[75216]:     <boot dev="hd"/>
Nov 13 19:03:25 user nova-compute[75216]:     <smbios mode="sysinfo"/>
Nov 13 19:03:25 user nova-compute[75216]:   </os>
Nov 13 19:03:25 user nova-compute[75216]:   <features>
Nov 13 19:03:25 user nova-compute[75216]:     <acpi/>
Nov 13 19:03:25 user nova-compute[75216]:     <apic/>
Nov 13 19:03:25 user nova-compute[75216]:     <vmcoreinfo/>
Nov 13 19:03:25 user nova-compute[75216]:   </features>
Nov 13 19:03:25 user nova-compute[75216]:   <clock offset="utc">
Nov 13 19:03:25 user nova-compute[75216]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 19:03:25 user nova-compute[75216]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 19:03:25 user nova-compute[75216]:     <timer name="hpet" present="no"/>
Nov 13 19:03:25 user nova-compute[75216]:   </clock>
Nov 13 19:03:25 user nova-compute[75216]:   <cpu mode="custom" match="exact">
Nov 13 19:03:25 user nova-compute[75216]:     <model>Nehalem</model>
Nov 13 19:03:25 user nova-compute[75216]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 19:03:25 user nova-compute[75216]:   </cpu>
Nov 13 19:03:25 user nova-compute[75216]:   <devices>
Nov 13 19:03:25 user nova-compute[75216]:     <disk type="file" device="disk">
Nov 13 19:03:25 user nova-compute[75216]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 19:03:25 user nova-compute[75216]:       <source file="/opt/stack/data/nova/instances/71134725-e6cc-4426-b2c2-5be4991c53f7/disk"/>
Nov 13 19:03:25 user nova-compute[75216]:       <target dev="vda" bus="virtio"/>
Nov 13 19:03:25 user nova-compute[75216]:     </disk>
Nov 13 19:03:25 user nova-compute[75216]:     <disk type="block" device="disk">
Nov 13 19:03:25 user nova-compute[75216]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 19:03:25 user nova-compute[75216]:       <source dev="/dev/sdd"/>
Nov 13 19:03:25 user nova-compute[75216]:       <target dev="vdc" bus="virtio"/>
Nov 13 19:03:25 user nova-compute[75216]:       <serial>3e8fd410-a0f1-42e1-a536-cd6112122746</serial>
Nov 13 19:03:25 user nova-compute[75216]:     </disk>
Nov 13 19:03:25 user nova-compute[75216]:     <interface type="ethernet">
Nov 13 19:03:25 user nova-compute[75216]:       <mac address="fa:16:3e:bd:0d:c9"/>
Nov 13 19:03:25 user nova-compute[75216]:       <model type="virtio"/>
Nov 13 19:03:25 user nova-compute[75216]:       <mtu size="1442"/>
Nov 13 19:03:25 user nova-compute[75216]:       <target dev="tapa1fda64d-c0"/>
Nov 13 19:03:25 user nova-compute[75216]:     </interface>
Nov 13 19:03:25 user nova-compute[75216]:     <serial type="pty">
Nov 13 19:03:25 user nova-compute[75216]:       <log file="/opt/stack/data/nova/instances/71134725-e6cc-4426-b2c2-5be4991c53f7/console.log" append="off"/>
Nov 13 19:03:25 user nova-compute[75216]:     </serial>
Nov 13 19:03:25 user nova-compute[75216]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 19:03:25 user nova-compute[75216]:     <video>
Nov 13 19:03:25 user nova-compute[75216]:       <model type="virtio"/>
Nov 13 19:03:25 user nova-compute[75216]:     </video>
Nov 13 19:03:25 user nova-compute[75216]:     <rng model="virtio">
Nov 13 19:03:25 user nova-compute[75216]:       <backend model="random">/dev/urandom</backend>
Nov 13 19:03:25 user nova-compute[75216]:     </rng>
Nov 13 19:03:25 user nova-compute[75216]:     <controller type="usb" index="0" model="none"/>
Nov 13 19:03:25 user nova-compute[75216]:     <memballoon model="virtio">
Nov 13 19:03:25 user nova-compute[75216]:       <stats period="10"/>
Nov 13 19:03:25 user nova-compute[75216]:     </memballoon>
Nov 13 19:03:25 user nova-compute[75216]:   </devices>
Nov 13 19:03:25 user nova-compute[75216]: </domain>
Nov 13 19:03:25 user nova-compute[75216]:  {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 19:03:25 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-0355e818-d4e1-478c-8bb2-56e98e682b36 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-13T18:59:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-617465978',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-617465978',id=26,image_ref='6e7de34d-221f-437b-85d0-70c21dd9f47a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1201518352',keypairs=<?>,launch_index=0,launched_at=2023-11-13T18:59:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='a58d1e76a793406bbdd3821ff74abd92',ramdisk_id='',reservation_id='r-04yvplgw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1861834155',owner_user_name='tempest-AttachVolumeShelveTestJSON-1861834155-project-member',shelved_at='2023-11-13T19:01:24.483533',shelved_host='user',shelved_image_id='6e7de34d-221f-437b-85d0-70c21dd9f47a'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T19:03:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e59bd525db64698b8e3587734cde6b8',uuid=71134725-e6cc-4426-b2c2-5be4991c53f7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "a1fda64d-c09d-45d7-b1ae-be416c60918d", "address": "fa:16:3e:bd:0d:c9", "network": {"id": "8cbeb1cc-a067-4c8d-82d8-0dc5c2ac924c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-742672345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a58d1e76a793406bbdd3821ff74abd92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1fda64d-c0", "ovs_interfaceid": "a1fda64d-c09d-45d7-b1ae-be416c60918d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 19:03:25 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-0355e818-d4e1-478c-8bb2-56e98e682b36 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Converting VIF {"id": "a1fda64d-c09d-45d7-b1ae-be416c60918d", "address": "fa:16:3e:bd:0d:c9", "network": {"id": "8cbeb1cc-a067-4c8d-82d8-0dc5c2ac924c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-742672345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a58d1e76a793406bbdd3821ff74abd92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1fda64d-c0", "ovs_interfaceid": "a1fda64d-c09d-45d7-b1ae-be416c60918d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 19:03:25 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-0355e818-d4e1-478c-8bb2-56e98e682b36 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:0d:c9,bridge_name='br-int',has_traffic_filtering=True,id=a1fda64d-c09d-45d7-b1ae-be416c60918d,network=Network(8cbeb1cc-a067-4c8d-82d8-0dc5c2ac924c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1fda64d-c0') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 19:03:25 user nova-compute[75216]: DEBUG os_vif [None req-0355e818-d4e1-478c-8bb2-56e98e682b36 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:0d:c9,bridge_name='br-int',has_traffic_filtering=True,id=a1fda64d-c09d-45d7-b1ae-be416c60918d,network=Network(8cbeb1cc-a067-4c8d-82d8-0dc5c2ac924c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1fda64d-c0') {{(pid=75216) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 19:03:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:03:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:03:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 19:03:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:03:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cb900019-bb95-54cb-8c76-fc93ca535dd3', '_type': 'linux-noop'}}, row=False) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:03:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:03:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:03:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:03:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa1fda64d-c0, may_exist=True, interface_attrs={}) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:03:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa1fda64d-c0, col_values=(('qos', UUID('9604370e-aedb-459a-b957-9addc2a93e28')),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:03:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa1fda64d-c0, col_values=(('external_ids', {'iface-id': 'a1fda64d-c09d-45d7-b1ae-be416c60918d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bd:0d:c9', 'vm-uuid': '71134725-e6cc-4426-b2c2-5be4991c53f7'}),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:03:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:03:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:03:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:03:25 user nova-compute[75216]: INFO os_vif [None req-0355e818-d4e1-478c-8bb2-56e98e682b36 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:0d:c9,bridge_name='br-int',has_traffic_filtering=True,id=a1fda64d-c09d-45d7-b1ae-be416c60918d,network=Network(8cbeb1cc-a067-4c8d-82d8-0dc5c2ac924c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1fda64d-c0')
Nov 13 19:03:25 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-0355e818-d4e1-478c-8bb2-56e98e682b36 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 19:03:25 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-0355e818-d4e1-478c-8bb2-56e98e682b36 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 19:03:25 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-0355e818-d4e1-478c-8bb2-56e98e682b36 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] No VIF found with MAC fa:16:3e:bd:0d:c9, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 19:03:26 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:03:26 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:03:26 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:03:26 user nova-compute[75216]: DEBUG nova.compute.manager [req-a8899732-efaa-446f-9173-50bcb7dfc9e4 req-f658aae4-fd59-4c40-87a2-189d130497fd service nova] [instance: 71134725-e6cc-4426-b2c2-5be4991c53f7] Received event network-vif-plugged-a1fda64d-c09d-45d7-b1ae-be416c60918d {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:03:26 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-a8899732-efaa-446f-9173-50bcb7dfc9e4 req-f658aae4-fd59-4c40-87a2-189d130497fd service nova] Acquiring lock "71134725-e6cc-4426-b2c2-5be4991c53f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:03:26 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-a8899732-efaa-446f-9173-50bcb7dfc9e4 req-f658aae4-fd59-4c40-87a2-189d130497fd service nova] Lock "71134725-e6cc-4426-b2c2-5be4991c53f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:03:26 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-a8899732-efaa-446f-9173-50bcb7dfc9e4 req-f658aae4-fd59-4c40-87a2-189d130497fd service nova] Lock "71134725-e6cc-4426-b2c2-5be4991c53f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:03:26 user nova-compute[75216]: DEBUG nova.compute.manager [req-a8899732-efaa-446f-9173-50bcb7dfc9e4 req-f658aae4-fd59-4c40-87a2-189d130497fd service nova] [instance: 71134725-e6cc-4426-b2c2-5be4991c53f7] No waiting events found dispatching network-vif-plugged-a1fda64d-c09d-45d7-b1ae-be416c60918d {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 19:03:26 user nova-compute[75216]: WARNING nova.compute.manager [req-a8899732-efaa-446f-9173-50bcb7dfc9e4 req-f658aae4-fd59-4c40-87a2-189d130497fd service nova] [instance: 71134725-e6cc-4426-b2c2-5be4991c53f7] Received unexpected event network-vif-plugged-a1fda64d-c09d-45d7-b1ae-be416c60918d for instance with vm_state shelved_offloaded and task_state spawning.
Nov 13 19:03:27 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:03:27 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:03:27 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:03:27 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:03:28 user nova-compute[75216]: DEBUG nova.compute.manager [None req-0355e818-d4e1-478c-8bb2-56e98e682b36 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] [instance: 71134725-e6cc-4426-b2c2-5be4991c53f7] Instance event wait completed in 0 seconds for  {{(pid=75216) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 19:03:28 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-0355e818-d4e1-478c-8bb2-56e98e682b36 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] [instance: 71134725-e6cc-4426-b2c2-5be4991c53f7] Guest created on hypervisor {{(pid=75216) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 19:03:28 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 71134725-e6cc-4426-b2c2-5be4991c53f7] Instance spawned successfully.
Nov 13 19:03:28 user nova-compute[75216]: DEBUG nova.compute.manager [req-1c0cbd63-0c85-4805-b719-c1fb8147a28f req-1862e4c5-795b-4906-a904-9ebb2ab15dfa service nova] [instance: 71134725-e6cc-4426-b2c2-5be4991c53f7] Received event network-vif-plugged-a1fda64d-c09d-45d7-b1ae-be416c60918d {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:03:28 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-1c0cbd63-0c85-4805-b719-c1fb8147a28f req-1862e4c5-795b-4906-a904-9ebb2ab15dfa service nova] Acquiring lock "71134725-e6cc-4426-b2c2-5be4991c53f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:03:28 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-1c0cbd63-0c85-4805-b719-c1fb8147a28f req-1862e4c5-795b-4906-a904-9ebb2ab15dfa service nova] Lock "71134725-e6cc-4426-b2c2-5be4991c53f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:03:28 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-1c0cbd63-0c85-4805-b719-c1fb8147a28f req-1862e4c5-795b-4906-a904-9ebb2ab15dfa service nova] Lock "71134725-e6cc-4426-b2c2-5be4991c53f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:03:28 user nova-compute[75216]: DEBUG nova.compute.manager [req-1c0cbd63-0c85-4805-b719-c1fb8147a28f req-1862e4c5-795b-4906-a904-9ebb2ab15dfa service nova] [instance: 71134725-e6cc-4426-b2c2-5be4991c53f7] No waiting events found dispatching network-vif-plugged-a1fda64d-c09d-45d7-b1ae-be416c60918d {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 19:03:28 user nova-compute[75216]: WARNING nova.compute.manager [req-1c0cbd63-0c85-4805-b719-c1fb8147a28f req-1862e4c5-795b-4906-a904-9ebb2ab15dfa service nova] [instance: 71134725-e6cc-4426-b2c2-5be4991c53f7] Received unexpected event network-vif-plugged-a1fda64d-c09d-45d7-b1ae-be416c60918d for instance with vm_state shelved_offloaded and task_state spawning.
Nov 13 19:03:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:03:28 user nova-compute[75216]: DEBUG nova.compute.manager [None req-0355e818-d4e1-478c-8bb2-56e98e682b36 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] [instance: 71134725-e6cc-4426-b2c2-5be4991c53f7] Checking state {{(pid=75216) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 19:03:29 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-0355e818-d4e1-478c-8bb2-56e98e682b36 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Lock "71134725-e6cc-4426-b2c2-5be4991c53f7" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 16.427s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:03:30 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:03:30 user nova-compute[75216]: DEBUG nova.compute.manager [req-8bfb7300-a41e-4741-be24-bafb44d0762f req-8778e8b9-f3ce-4630-981d-f072a2e12da0 service nova] [instance: af8089f7-6dc3-4655-9369-2177dbd7bf4d] Received event network-changed-c26beff8-370e-431e-9a8c-d31c4ec912ec {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:03:30 user nova-compute[75216]: DEBUG nova.compute.manager [req-8bfb7300-a41e-4741-be24-bafb44d0762f req-8778e8b9-f3ce-4630-981d-f072a2e12da0 service nova] [instance: af8089f7-6dc3-4655-9369-2177dbd7bf4d] Refreshing instance network info cache due to event network-changed-c26beff8-370e-431e-9a8c-d31c4ec912ec. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 19:03:30 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-8bfb7300-a41e-4741-be24-bafb44d0762f req-8778e8b9-f3ce-4630-981d-f072a2e12da0 service nova] Acquiring lock "refresh_cache-af8089f7-6dc3-4655-9369-2177dbd7bf4d" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 19:03:30 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-8bfb7300-a41e-4741-be24-bafb44d0762f req-8778e8b9-f3ce-4630-981d-f072a2e12da0 service nova] Acquired lock "refresh_cache-af8089f7-6dc3-4655-9369-2177dbd7bf4d" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 19:03:30 user nova-compute[75216]: DEBUG nova.network.neutron [req-8bfb7300-a41e-4741-be24-bafb44d0762f req-8778e8b9-f3ce-4630-981d-f072a2e12da0 service nova] [instance: af8089f7-6dc3-4655-9369-2177dbd7bf4d] Refreshing network info cache for port c26beff8-370e-431e-9a8c-d31c4ec912ec {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 19:03:30 user nova-compute[75216]: DEBUG nova.network.neutron [req-8bfb7300-a41e-4741-be24-bafb44d0762f req-8778e8b9-f3ce-4630-981d-f072a2e12da0 service nova] [instance: af8089f7-6dc3-4655-9369-2177dbd7bf4d] Updated VIF entry in instance network info cache for port c26beff8-370e-431e-9a8c-d31c4ec912ec. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 19:03:30 user nova-compute[75216]: DEBUG nova.network.neutron [req-8bfb7300-a41e-4741-be24-bafb44d0762f req-8778e8b9-f3ce-4630-981d-f072a2e12da0 service nova] [instance: af8089f7-6dc3-4655-9369-2177dbd7bf4d] Updating instance_info_cache with network_info: [{"id": "c26beff8-370e-431e-9a8c-d31c4ec912ec", "address": "fa:16:3e:03:83:09", "network": {"id": "fea11c73-0074-4971-8b36-0aced430c730", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1420832282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84d0223a97ff4ecab9bf4273e3e465a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc26beff8-37", "ovs_interfaceid": "c26beff8-370e-431e-9a8c-d31c4ec912ec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:03:30 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-8bfb7300-a41e-4741-be24-bafb44d0762f req-8778e8b9-f3ce-4630-981d-f072a2e12da0 service nova] Releasing lock "refresh_cache-af8089f7-6dc3-4655-9369-2177dbd7bf4d" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 19:03:31 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:03:31 user nova-compute[75216]: DEBUG nova.compute.manager [req-92117359-8819-49f8-b2a8-0ae64992e18d req-7c3b827e-9918-48d2-bc3d-cf8c5cf9d781 service nova] [instance: af8089f7-6dc3-4655-9369-2177dbd7bf4d] Received event network-changed-c26beff8-370e-431e-9a8c-d31c4ec912ec {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:03:31 user nova-compute[75216]: DEBUG nova.compute.manager [req-92117359-8819-49f8-b2a8-0ae64992e18d req-7c3b827e-9918-48d2-bc3d-cf8c5cf9d781 service nova] [instance: af8089f7-6dc3-4655-9369-2177dbd7bf4d] Refreshing instance network info cache due to event network-changed-c26beff8-370e-431e-9a8c-d31c4ec912ec. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 19:03:31 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-92117359-8819-49f8-b2a8-0ae64992e18d req-7c3b827e-9918-48d2-bc3d-cf8c5cf9d781 service nova] Acquiring lock "refresh_cache-af8089f7-6dc3-4655-9369-2177dbd7bf4d" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 19:03:31 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-92117359-8819-49f8-b2a8-0ae64992e18d req-7c3b827e-9918-48d2-bc3d-cf8c5cf9d781 service nova] Acquired lock "refresh_cache-af8089f7-6dc3-4655-9369-2177dbd7bf4d" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 19:03:31 user nova-compute[75216]: DEBUG nova.network.neutron [req-92117359-8819-49f8-b2a8-0ae64992e18d req-7c3b827e-9918-48d2-bc3d-cf8c5cf9d781 service nova] [instance: af8089f7-6dc3-4655-9369-2177dbd7bf4d] Refreshing network info cache for port c26beff8-370e-431e-9a8c-d31c4ec912ec {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 19:03:31 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-4dbf8c0d-bd43-45c4-896a-b72c9da467de tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Acquiring lock "af8089f7-6dc3-4655-9369-2177dbd7bf4d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:03:31 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-4dbf8c0d-bd43-45c4-896a-b72c9da467de tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Lock "af8089f7-6dc3-4655-9369-2177dbd7bf4d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:03:31 user nova-compute[75216]: INFO nova.compute.manager [None req-4dbf8c0d-bd43-45c4-896a-b72c9da467de tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] [instance: af8089f7-6dc3-4655-9369-2177dbd7bf4d] Detaching volume 2dfdac0b-bc0c-4291-ae5c-8eb516d7b164
Nov 13 19:03:31 user nova-compute[75216]: INFO nova.virt.block_device [None req-4dbf8c0d-bd43-45c4-896a-b72c9da467de tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] [instance: af8089f7-6dc3-4655-9369-2177dbd7bf4d] Attempting to driver detach volume 2dfdac0b-bc0c-4291-ae5c-8eb516d7b164 from mountpoint /dev/vdb
Nov 13 19:03:31 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-4dbf8c0d-bd43-45c4-896a-b72c9da467de tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Attempting to detach device vdb from instance af8089f7-6dc3-4655-9369-2177dbd7bf4d from the persistent domain config. {{(pid=75216) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 13 19:03:31 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-4dbf8c0d-bd43-45c4-896a-b72c9da467de tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 19:03:31 user nova-compute[75216]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 19:03:31 user nova-compute[75216]:   <source dev="/dev/sdc"/>
Nov 13 19:03:31 user nova-compute[75216]:   <target dev="vdb" bus="virtio"/>
Nov 13 19:03:31 user nova-compute[75216]:   <serial>2dfdac0b-bc0c-4291-ae5c-8eb516d7b164</serial>
Nov 13 19:03:31 user nova-compute[75216]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 19:03:31 user nova-compute[75216]: </disk>
Nov 13 19:03:31 user nova-compute[75216]:  {{(pid=75216) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 19:03:31 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-4dbf8c0d-bd43-45c4-896a-b72c9da467de tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Successfully detached device vdb from instance af8089f7-6dc3-4655-9369-2177dbd7bf4d from the persistent domain config.
Nov 13 19:03:31 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-4dbf8c0d-bd43-45c4-896a-b72c9da467de tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance af8089f7-6dc3-4655-9369-2177dbd7bf4d from the live domain config. {{(pid=75216) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 13 19:03:31 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-4dbf8c0d-bd43-45c4-896a-b72c9da467de tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 19:03:31 user nova-compute[75216]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 19:03:31 user nova-compute[75216]:   <source dev="/dev/sdc"/>
Nov 13 19:03:31 user nova-compute[75216]:   <target dev="vdb" bus="virtio"/>
Nov 13 19:03:31 user nova-compute[75216]:   <serial>2dfdac0b-bc0c-4291-ae5c-8eb516d7b164</serial>
Nov 13 19:03:31 user nova-compute[75216]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 19:03:31 user nova-compute[75216]: </disk>
Nov 13 19:03:31 user nova-compute[75216]:  {{(pid=75216) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 19:03:31 user nova-compute[75216]: DEBUG nova.network.neutron [req-92117359-8819-49f8-b2a8-0ae64992e18d req-7c3b827e-9918-48d2-bc3d-cf8c5cf9d781 service nova] [instance: af8089f7-6dc3-4655-9369-2177dbd7bf4d] Updated VIF entry in instance network info cache for port c26beff8-370e-431e-9a8c-d31c4ec912ec. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 19:03:31 user nova-compute[75216]: DEBUG nova.network.neutron [req-92117359-8819-49f8-b2a8-0ae64992e18d req-7c3b827e-9918-48d2-bc3d-cf8c5cf9d781 service nova] [instance: af8089f7-6dc3-4655-9369-2177dbd7bf4d] Updating instance_info_cache with network_info: [{"id": "c26beff8-370e-431e-9a8c-d31c4ec912ec", "address": "fa:16:3e:03:83:09", "network": {"id": "fea11c73-0074-4971-8b36-0aced430c730", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1420832282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84d0223a97ff4ecab9bf4273e3e465a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc26beff8-37", "ovs_interfaceid": "c26beff8-370e-431e-9a8c-d31c4ec912ec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:03:31 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-92117359-8819-49f8-b2a8-0ae64992e18d req-7c3b827e-9918-48d2-bc3d-cf8c5cf9d781 service nova] Releasing lock "refresh_cache-af8089f7-6dc3-4655-9369-2177dbd7bf4d" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 19:03:31 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-4dbf8c0d-bd43-45c4-896a-b72c9da467de tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance af8089f7-6dc3-4655-9369-2177dbd7bf4d {{(pid=75216) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 13 19:03:33 user nova-compute[75216]: DEBUG nova.compute.manager [req-abde8537-2fba-43e0-ae9d-9793db2590ee req-394b6dff-4992-4d31-ac2d-d285d96341ba service nova] [instance: 7b752173-e573-426e-b9f1-bff92a4c2b55] Received event network-changed-60dd7b11-cfc3-4965-a429-8b2ac4cdfcf4 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:03:33 user nova-compute[75216]: DEBUG nova.compute.manager [req-abde8537-2fba-43e0-ae9d-9793db2590ee req-394b6dff-4992-4d31-ac2d-d285d96341ba service nova] [instance: 7b752173-e573-426e-b9f1-bff92a4c2b55] Refreshing instance network info cache due to event network-changed-60dd7b11-cfc3-4965-a429-8b2ac4cdfcf4. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 19:03:33 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-abde8537-2fba-43e0-ae9d-9793db2590ee req-394b6dff-4992-4d31-ac2d-d285d96341ba service nova] Acquiring lock "refresh_cache-7b752173-e573-426e-b9f1-bff92a4c2b55" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 19:03:33 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-abde8537-2fba-43e0-ae9d-9793db2590ee req-394b6dff-4992-4d31-ac2d-d285d96341ba service nova] Acquired lock "refresh_cache-7b752173-e573-426e-b9f1-bff92a4c2b55" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 19:03:33 user nova-compute[75216]: DEBUG nova.network.neutron [req-abde8537-2fba-43e0-ae9d-9793db2590ee req-394b6dff-4992-4d31-ac2d-d285d96341ba service nova] [instance: 7b752173-e573-426e-b9f1-bff92a4c2b55] Refreshing network info cache for port 60dd7b11-cfc3-4965-a429-8b2ac4cdfcf4 {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 19:03:33 user nova-compute[75216]: DEBUG nova.network.neutron [req-abde8537-2fba-43e0-ae9d-9793db2590ee req-394b6dff-4992-4d31-ac2d-d285d96341ba service nova] [instance: 7b752173-e573-426e-b9f1-bff92a4c2b55] Updated VIF entry in instance network info cache for port 60dd7b11-cfc3-4965-a429-8b2ac4cdfcf4. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 19:03:33 user nova-compute[75216]: DEBUG nova.network.neutron [req-abde8537-2fba-43e0-ae9d-9793db2590ee req-394b6dff-4992-4d31-ac2d-d285d96341ba service nova] [instance: 7b752173-e573-426e-b9f1-bff92a4c2b55] Updating instance_info_cache with network_info: [{"id": "60dd7b11-cfc3-4965-a429-8b2ac4cdfcf4", "address": "fa:16:3e:d6:af:c5", "network": {"id": "53bb01d5-31a4-47af-a931-ac12fe72b986", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-802892643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "095f5765865140d29b3ecf1ab3427037", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60dd7b11-cf", "ovs_interfaceid": "60dd7b11-cfc3-4965-a429-8b2ac4cdfcf4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:03:33 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-abde8537-2fba-43e0-ae9d-9793db2590ee req-394b6dff-4992-4d31-ac2d-d285d96341ba service nova] Releasing lock "refresh_cache-7b752173-e573-426e-b9f1-bff92a4c2b55" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 19:03:33 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:03:33 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1703d810-c890-43f7-920f-1a7b74a2b759 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Acquiring lock "a1a3e849-6570-4820-97c8-75468b5bea4f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:03:33 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1703d810-c890-43f7-920f-1a7b74a2b759 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Lock "a1a3e849-6570-4820-97c8-75468b5bea4f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:03:33 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1703d810-c890-43f7-920f-1a7b74a2b759 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Acquiring lock "a1a3e849-6570-4820-97c8-75468b5bea4f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:03:33 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1703d810-c890-43f7-920f-1a7b74a2b759 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Lock "a1a3e849-6570-4820-97c8-75468b5bea4f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:03:33 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1703d810-c890-43f7-920f-1a7b74a2b759 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Lock "a1a3e849-6570-4820-97c8-75468b5bea4f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:03:33 user nova-compute[75216]: INFO nova.compute.manager [None req-1703d810-c890-43f7-920f-1a7b74a2b759 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: a1a3e849-6570-4820-97c8-75468b5bea4f] Terminating instance
Nov 13 19:03:33 user nova-compute[75216]: DEBUG nova.compute.manager [None req-1703d810-c890-43f7-920f-1a7b74a2b759 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: a1a3e849-6570-4820-97c8-75468b5bea4f] Start destroying the instance on the hypervisor. {{(pid=75216) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 19:03:34 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:03:34 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:03:34 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:03:34 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:03:34 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:03:34 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f4f488f0-fc71-4456-80ee-555161009e37 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Acquiring lock "7b752173-e573-426e-b9f1-bff92a4c2b55" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:03:34 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f4f488f0-fc71-4456-80ee-555161009e37 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Lock "7b752173-e573-426e-b9f1-bff92a4c2b55" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:03:34 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: a1a3e849-6570-4820-97c8-75468b5bea4f] Instance destroyed successfully.
Nov 13 19:03:34 user nova-compute[75216]: DEBUG nova.objects.instance [None req-1703d810-c890-43f7-920f-1a7b74a2b759 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Lazy-loading 'resources' on Instance uuid a1a3e849-6570-4820-97c8-75468b5bea4f {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:03:34 user nova-compute[75216]: DEBUG nova.objects.instance [None req-f4f488f0-fc71-4456-80ee-555161009e37 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Lazy-loading 'flavor' on Instance uuid 7b752173-e573-426e-b9f1-bff92a4c2b55 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:03:34 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-1703d810-c890-43f7-920f-1a7b74a2b759 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T18:44:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1633727482',display_name='tempest-ServerActionsTestOtherA-server-1633727482',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1633727482',id=1,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKz099Lx1XxYKMwpEh9A7Hze8Yy5EijTt+h0RSW+LWAAdums7McTLzxWcs+4M2TWx6M56tfd+yHdLdlnr7vz5lvq3aL+fZolVlZV3LeOornnUO38Y1O0XVUZqifXtvNPtQ==',key_name='tempest-keypair-1574128026',keypairs=<?>,launch_index=0,launched_at=2023-11-13T18:45:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b9b7e11038e54e368acd22d06e54a351',ramdisk_id='',reservation_id='r-iklkbpl8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-537419316',owner_user_name='tempest-ServerActionsTestOtherA-537419316-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T18:45:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='23f029ff09464d699e5bd6dbf44a905d',uuid=a1a3e849-6570-4820-97c8-75468b5bea4f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3544d3e3-8dfa-4043-b225-77f690cd3760", "address": "fa:16:3e:9e:b9:f7", "network": {"id": "d7a691f0-4495-40ad-a349-91b5dc9c635a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-961583097-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9b7e11038e54e368acd22d06e54a351", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3544d3e3-8d", "ovs_interfaceid": "3544d3e3-8dfa-4043-b225-77f690cd3760", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 19:03:34 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-1703d810-c890-43f7-920f-1a7b74a2b759 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Converting VIF {"id": "3544d3e3-8dfa-4043-b225-77f690cd3760", "address": "fa:16:3e:9e:b9:f7", "network": {"id": "d7a691f0-4495-40ad-a349-91b5dc9c635a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-961583097-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9b7e11038e54e368acd22d06e54a351", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3544d3e3-8d", "ovs_interfaceid": "3544d3e3-8dfa-4043-b225-77f690cd3760", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 19:03:34 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-1703d810-c890-43f7-920f-1a7b74a2b759 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9e:b9:f7,bridge_name='br-int',has_traffic_filtering=True,id=3544d3e3-8dfa-4043-b225-77f690cd3760,network=Network(d7a691f0-4495-40ad-a349-91b5dc9c635a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3544d3e3-8d') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 19:03:34 user nova-compute[75216]: DEBUG os_vif [None req-1703d810-c890-43f7-920f-1a7b74a2b759 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9e:b9:f7,bridge_name='br-int',has_traffic_filtering=True,id=3544d3e3-8dfa-4043-b225-77f690cd3760,network=Network(d7a691f0-4495-40ad-a349-91b5dc9c635a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3544d3e3-8d') {{(pid=75216) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 19:03:34 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:03:34 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3544d3e3-8d, bridge=br-int, if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:03:34 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:03:34 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:03:34 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:03:34 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=38af537d-9881-4d25-886e-2d959116e89e) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:03:34 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:03:34 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:03:34 user nova-compute[75216]: INFO os_vif [None req-1703d810-c890-43f7-920f-1a7b74a2b759 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9e:b9:f7,bridge_name='br-int',has_traffic_filtering=True,id=3544d3e3-8dfa-4043-b225-77f690cd3760,network=Network(d7a691f0-4495-40ad-a349-91b5dc9c635a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3544d3e3-8d')
Nov 13 19:03:34 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-1703d810-c890-43f7-920f-1a7b74a2b759 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: a1a3e849-6570-4820-97c8-75468b5bea4f] Deleting instance files /opt/stack/data/nova/instances/a1a3e849-6570-4820-97c8-75468b5bea4f_del
Nov 13 19:03:34 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-1703d810-c890-43f7-920f-1a7b74a2b759 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: a1a3e849-6570-4820-97c8-75468b5bea4f] Deletion of /opt/stack/data/nova/instances/a1a3e849-6570-4820-97c8-75468b5bea4f_del complete
Nov 13 19:03:34 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f4f488f0-fc71-4456-80ee-555161009e37 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Lock "7b752173-e573-426e-b9f1-bff92a4c2b55" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:03:34 user nova-compute[75216]: INFO nova.compute.manager [None req-1703d810-c890-43f7-920f-1a7b74a2b759 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] [instance: a1a3e849-6570-4820-97c8-75468b5bea4f] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 13 19:03:34 user nova-compute[75216]: DEBUG oslo.service.loopingcall [None req-1703d810-c890-43f7-920f-1a7b74a2b759 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75216) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 19:03:34 user nova-compute[75216]: DEBUG nova.compute.manager [-] [instance: a1a3e849-6570-4820-97c8-75468b5bea4f] Deallocating network for instance {{(pid=75216) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 19:03:34 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: a1a3e849-6570-4820-97c8-75468b5bea4f] deallocate_for_instance() {{(pid=75216) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 19:03:34 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f4f488f0-fc71-4456-80ee-555161009e37 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Acquiring lock "7b752173-e573-426e-b9f1-bff92a4c2b55" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:03:34 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f4f488f0-fc71-4456-80ee-555161009e37 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Lock "7b752173-e573-426e-b9f1-bff92a4c2b55" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:03:34 user nova-compute[75216]: INFO nova.compute.manager [None req-f4f488f0-fc71-4456-80ee-555161009e37 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] [instance: 7b752173-e573-426e-b9f1-bff92a4c2b55] Attaching volume dce55498-5eed-4a20-a00b-3f98b1e93c4f to /dev/vdb
Nov 13 19:03:35 user nova-compute[75216]: DEBUG os_brick.utils [None req-f4f488f0-fc71-4456-80ee-555161009e37 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 19:03:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:03:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:03:35 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8497dd8-315c-4eac-96f6-fa08f39285d7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aea6fcfe14b9\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:03:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:03:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:03:35 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[469967cb-a6b0-45d9-8e28-f4576485c95e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:03:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:03:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:03:35 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[e276f524-9adb-4682-a9c3-023337c317e9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:03:35 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ccbbe51-cfa2-4bf7-9492-dad301a161c0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:03:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-f4f488f0-fc71-4456-80ee-555161009e37 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Running cmd (subprocess): nvme version {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:03:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-f4f488f0-fc71-4456-80ee-555161009e37 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] 'nvme version' failed. Not Retrying. {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 19:03:35 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f4f488f0-fc71-4456-80ee-555161009e37 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] nvme not present on system {{(pid=75216) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 19:03:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:03:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 19:03:35 user nova-compute[75216]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 19:03:35 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[78fdab84-afc4-44e1-866a-edfe23e4e704]: (4, '') {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:03:35 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-f4f488f0-fc71-4456-80ee-555161009e37 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75216) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 19:03:35 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-f4f488f0-fc71-4456-80ee-555161009e37 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 19:03:35 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-f4f488f0-fc71-4456-80ee-555161009e37 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] LIGHTOS: no hostnqn found. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 19:03:35 user nova-compute[75216]: DEBUG os_brick.utils [None req-f4f488f0-fc71-4456-80ee-555161009e37 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aea6fcfe14b9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 19:03:35 user nova-compute[75216]: DEBUG nova.virt.block_device [None req-f4f488f0-fc71-4456-80ee-555161009e37 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] [instance: 7b752173-e573-426e-b9f1-bff92a4c2b55] Updating existing volume attachment record: 97800581-4642-4c3e-899a-4e7a09534170 {{(pid=75216) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 19:03:35 user nova-compute[75216]: DEBUG nova.compute.manager [req-2032bca3-ab5b-492a-a1b1-44d5db79d660 req-45caa6d5-dadc-4077-87c5-e4dec542e802 service nova] [instance: a1a3e849-6570-4820-97c8-75468b5bea4f] Received event network-vif-unplugged-3544d3e3-8dfa-4043-b225-77f690cd3760 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:03:35 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-2032bca3-ab5b-492a-a1b1-44d5db79d660 req-45caa6d5-dadc-4077-87c5-e4dec542e802 service nova] Acquiring lock "a1a3e849-6570-4820-97c8-75468b5bea4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:03:35 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-2032bca3-ab5b-492a-a1b1-44d5db79d660 req-45caa6d5-dadc-4077-87c5-e4dec542e802 service nova] Lock "a1a3e849-6570-4820-97c8-75468b5bea4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:03:35 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-2032bca3-ab5b-492a-a1b1-44d5db79d660 req-45caa6d5-dadc-4077-87c5-e4dec542e802 service nova] Lock "a1a3e849-6570-4820-97c8-75468b5bea4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:03:35 user nova-compute[75216]: DEBUG nova.compute.manager [req-2032bca3-ab5b-492a-a1b1-44d5db79d660 req-45caa6d5-dadc-4077-87c5-e4dec542e802 service nova] [instance: a1a3e849-6570-4820-97c8-75468b5bea4f] No waiting events found dispatching network-vif-unplugged-3544d3e3-8dfa-4043-b225-77f690cd3760 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 19:03:35 user nova-compute[75216]: DEBUG nova.compute.manager [req-2032bca3-ab5b-492a-a1b1-44d5db79d660 req-45caa6d5-dadc-4077-87c5-e4dec542e802 service nova] [instance: a1a3e849-6570-4820-97c8-75468b5bea4f] Received event network-vif-unplugged-3544d3e3-8dfa-4043-b225-77f690cd3760 for instance with task_state deleting. {{(pid=75216) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 19:03:35 user nova-compute[75216]: DEBUG nova.compute.manager [req-2032bca3-ab5b-492a-a1b1-44d5db79d660 req-45caa6d5-dadc-4077-87c5-e4dec542e802 service nova] [instance: a1a3e849-6570-4820-97c8-75468b5bea4f] Received event network-vif-plugged-3544d3e3-8dfa-4043-b225-77f690cd3760 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:03:35 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-2032bca3-ab5b-492a-a1b1-44d5db79d660 req-45caa6d5-dadc-4077-87c5-e4dec542e802 service nova] Acquiring lock "a1a3e849-6570-4820-97c8-75468b5bea4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:03:35 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-2032bca3-ab5b-492a-a1b1-44d5db79d660 req-45caa6d5-dadc-4077-87c5-e4dec542e802 service nova] Lock "a1a3e849-6570-4820-97c8-75468b5bea4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:03:35 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-2032bca3-ab5b-492a-a1b1-44d5db79d660 req-45caa6d5-dadc-4077-87c5-e4dec542e802 service nova] Lock "a1a3e849-6570-4820-97c8-75468b5bea4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:03:35 user nova-compute[75216]: DEBUG nova.compute.manager [req-2032bca3-ab5b-492a-a1b1-44d5db79d660 req-45caa6d5-dadc-4077-87c5-e4dec542e802 service nova] [instance: a1a3e849-6570-4820-97c8-75468b5bea4f] No waiting events found dispatching network-vif-plugged-3544d3e3-8dfa-4043-b225-77f690cd3760 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 19:03:35 user nova-compute[75216]: WARNING nova.compute.manager [req-2032bca3-ab5b-492a-a1b1-44d5db79d660 req-45caa6d5-dadc-4077-87c5-e4dec542e802 service nova] [instance: a1a3e849-6570-4820-97c8-75468b5bea4f] Received unexpected event network-vif-plugged-3544d3e3-8dfa-4043-b225-77f690cd3760 for instance with vm_state active and task_state deleting.
Nov 13 19:03:35 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: a1a3e849-6570-4820-97c8-75468b5bea4f] Updating instance_info_cache with network_info: [] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:03:35 user nova-compute[75216]: DEBUG nova.compute.manager [req-ebd76aa8-f9b8-4396-b23d-289469bf8111 req-afe2d41d-5c44-4d6c-8f9c-2d482cd56a8d service nova] [instance: a1a3e849-6570-4820-97c8-75468b5bea4f] Received event network-vif-deleted-3544d3e3-8dfa-4043-b225-77f690cd3760 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:03:35 user nova-compute[75216]: INFO nova.compute.manager [req-ebd76aa8-f9b8-4396-b23d-289469bf8111 req-afe2d41d-5c44-4d6c-8f9c-2d482cd56a8d service nova] [instance: a1a3e849-6570-4820-97c8-75468b5bea4f] Neutron deleted interface 3544d3e3-8dfa-4043-b225-77f690cd3760; detaching it from the instance and deleting it from the info cache
Nov 13 19:03:35 user nova-compute[75216]: DEBUG nova.network.neutron [req-ebd76aa8-f9b8-4396-b23d-289469bf8111 req-afe2d41d-5c44-4d6c-8f9c-2d482cd56a8d service nova] [instance: a1a3e849-6570-4820-97c8-75468b5bea4f] Updating instance_info_cache with network_info: [] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:03:35 user nova-compute[75216]: INFO nova.compute.manager [-] [instance: a1a3e849-6570-4820-97c8-75468b5bea4f] Took 0.52 seconds to deallocate network for instance.
Nov 13 19:03:35 user nova-compute[75216]: DEBUG nova.compute.manager [req-ebd76aa8-f9b8-4396-b23d-289469bf8111 req-afe2d41d-5c44-4d6c-8f9c-2d482cd56a8d service nova] [instance: a1a3e849-6570-4820-97c8-75468b5bea4f] Detach interface failed, port_id=3544d3e3-8dfa-4043-b225-77f690cd3760, reason: Instance a1a3e849-6570-4820-97c8-75468b5bea4f could not be found. {{(pid=75216) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 13 19:03:35 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1703d810-c890-43f7-920f-1a7b74a2b759 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:03:35 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1703d810-c890-43f7-920f-1a7b74a2b759 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:03:35 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-1703d810-c890-43f7-920f-1a7b74a2b759 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 19:03:35 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-1703d810-c890-43f7-920f-1a7b74a2b759 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 19:03:35 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1703d810-c890-43f7-920f-1a7b74a2b759 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.322s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:03:35 user nova-compute[75216]: INFO nova.scheduler.client.report [None req-1703d810-c890-43f7-920f-1a7b74a2b759 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Deleted allocations for instance a1a3e849-6570-4820-97c8-75468b5bea4f
Nov 13 19:03:35 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1703d810-c890-43f7-920f-1a7b74a2b759 tempest-ServerActionsTestOtherA-537419316 tempest-ServerActionsTestOtherA-537419316-project-member] Lock "a1a3e849-6570-4820-97c8-75468b5bea4f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.903s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:03:38 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:03:39 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f4f488f0-fc71-4456-80ee-555161009e37 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] [instance: 7b752173-e573-426e-b9f1-bff92a4c2b55] Calling os-brick to attach iSCSI Volume {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 19:03:39 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4f488f0-fc71-4456-80ee-555161009e37 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3a8669e40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:dce55498-5eed-4a20-a00b-3f98b1e93c4f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SdDJHbtF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 19:03:39 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-f4f488f0-fc71-4456-80ee-555161009e37 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 19:03:39 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-f4f488f0-fc71-4456-80ee-555161009e37 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 19:03:39 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-f4f488f0-fc71-4456-80ee-555161009e37 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 19:03:39 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-f4f488f0-fc71-4456-80ee-555161009e37 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 19:03:39 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-f4f488f0-fc71-4456-80ee-555161009e37 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dce55498-5eed-4a20-a00b-3f98b1e93c4f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 19:03:39 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-f4f488f0-fc71-4456-80ee-555161009e37 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dce55498-5eed-4a20-a00b-3f98b1e93c4f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 19:03:39 user nova-compute[75216]: INFO os_brick.initiator.connectors.iscsi [None req-f4f488f0-fc71-4456-80ee-555161009e37 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 19:03:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dce55498-5eed-4a20-a00b-3f98b1e93c4f -p 172.16.0.220:3260 {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:03:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dce55498-5eed-4a20-a00b-3f98b1e93c4f -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:03:39 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[18ff6140-61de-470c-a299-3540ec524840]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:03:39 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4f488f0-fc71-4456-80ee-555161009e37 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 19:03:39 user nova-compute[75216]:  {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:03:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dce55498-5eed-4a20-a00b-3f98b1e93c4f -p 172.16.0.220:3260 --interface default --op new {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:03:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dce55498-5eed-4a20-a00b-3f98b1e93c4f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:03:39 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[defee1f4-17a6-41f6-8fcc-63710e96a17e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dce55498-5eed-4a20-a00b-3f98b1e93c4f] added\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:03:39 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4f488f0-fc71-4456-80ee-555161009e37 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dce55498-5eed-4a20-a00b-3f98b1e93c4f] added
Nov 13 19:03:39 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:03:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dce55498-5eed-4a20-a00b-3f98b1e93c4f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:03:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dce55498-5eed-4a20-a00b-3f98b1e93c4f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:03:39 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[421828dd-6e9d-4250-9928-1c13695d29be]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:03:39 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4f488f0-fc71-4456-80ee-555161009e37 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:03:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dce55498-5eed-4a20-a00b-3f98b1e93c4f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:03:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dce55498-5eed-4a20-a00b-3f98b1e93c4f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:03:39 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[14bb61a9-5c66-4341-b3bd-2654c78394d8]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:03:39 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4f488f0-fc71-4456-80ee-555161009e37 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:03:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dce55498-5eed-4a20-a00b-3f98b1e93c4f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SdDJHbtF {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:03:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dce55498-5eed-4a20-a00b-3f98b1e93c4f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SdDJHbtF" returned: 0 in 0.022s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:03:39 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[cec2707f-5a8a-4f82-8ecc-b45cf680103b]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:03:39 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4f488f0-fc71-4456-80ee-555161009e37 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SdDJHbtF'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:03:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dce55498-5eed-4a20-a00b-3f98b1e93c4f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:03:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dce55498-5eed-4a20-a00b-3f98b1e93c4f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:03:39 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f60e784-f93e-4749-8dd5-58e72e83511c]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:03:39 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4f488f0-fc71-4456-80ee-555161009e37 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:03:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:03:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:03:39 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[84a8ef60-45e4-40c3-83e3-3caa9e0101c5]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dfdac0b-bc0c-4291-ae5c-8eb516d7b164 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e8fd410-a0f1-42e1-a536-cd6112122746 (non-flash)\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:03:39 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4f488f0-fc71-4456-80ee-555161009e37 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1 (non-flash)
Nov 13 19:03:39 user nova-compute[75216]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dfdac0b-bc0c-4291-ae5c-8eb516d7b164 (non-flash)
Nov 13 19:03:39 user nova-compute[75216]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e8fd410-a0f1-42e1-a536-cd6112122746 (non-flash)
Nov 13 19:03:39 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 19:03:39 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4f488f0-fc71-4456-80ee-555161009e37 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1 (non-flash)
Nov 13 19:03:39 user nova-compute[75216]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dfdac0b-bc0c-4291-ae5c-8eb516d7b164 (non-flash)
Nov 13 19:03:39 user nova-compute[75216]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e8fd410-a0f1-42e1-a536-cd6112122746 (non-flash)
Nov 13 19:03:39 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 19:03:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dce55498-5eed-4a20-a00b-3f98b1e93c4f -p 172.16.0.220:3260 --login {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:03:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dce55498-5eed-4a20-a00b-3f98b1e93c4f -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:03:39 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[e587e6a0-b03a-4b3c-862c-7b6d12d4e5c9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:dce55498-5eed-4a20-a00b-3f98b1e93c4f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:dce55498-5eed-4a20-a00b-3f98b1e93c4f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:03:39 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4f488f0-fc71-4456-80ee-555161009e37 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:dce55498-5eed-4a20-a00b-3f98b1e93c4f, portal: 172.16.0.220,3260]
Nov 13 19:03:39 user nova-compute[75216]: Login to [iface: default, target: iqn.2010-10.org.openstack:dce55498-5eed-4a20-a00b-3f98b1e93c4f, portal: 172.16.0.220,3260] successful.
Nov 13 19:03:39 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:03:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dce55498-5eed-4a20-a00b-3f98b1e93c4f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:03:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dce55498-5eed-4a20-a00b-3f98b1e93c4f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:03:39 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1741bbd-1afa-434f-b3fe-71d676e0e357]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:03:39 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4f488f0-fc71-4456-80ee-555161009e37 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:03:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:03:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:03:39 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b19f66a-0187-4f2a-bf95-7e13b94f6790]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dfdac0b-bc0c-4291-ae5c-8eb516d7b164 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e8fd410-a0f1-42e1-a536-cd6112122746 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dce55498-5eed-4a20-a00b-3f98b1e93c4f (non-flash)\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:03:39 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4f488f0-fc71-4456-80ee-555161009e37 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1 (non-flash)
Nov 13 19:03:39 user nova-compute[75216]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dfdac0b-bc0c-4291-ae5c-8eb516d7b164 (non-flash)
Nov 13 19:03:39 user nova-compute[75216]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e8fd410-a0f1-42e1-a536-cd6112122746 (non-flash)
Nov 13 19:03:39 user nova-compute[75216]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dce55498-5eed-4a20-a00b-3f98b1e93c4f (non-flash)
Nov 13 19:03:39 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 19:03:39 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4f488f0-fc71-4456-80ee-555161009e37 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1 (non-flash)
Nov 13 19:03:39 user nova-compute[75216]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dfdac0b-bc0c-4291-ae5c-8eb516d7b164 (non-flash)
Nov 13 19:03:39 user nova-compute[75216]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e8fd410-a0f1-42e1-a536-cd6112122746 (non-flash)
Nov 13 19:03:39 user nova-compute[75216]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dce55498-5eed-4a20-a00b-3f98b1e93c4f (non-flash)
Nov 13 19:03:39 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 19:03:39 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-f4f488f0-fc71-4456-80ee-555161009e37 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dce55498-5eed-4a20-a00b-3f98b1e93c4f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.282s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 19:03:39 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4f488f0-fc71-4456-80ee-555161009e37 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Connected to 172.16.0.220:3260 {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 19:03:39 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-f4f488f0-fc71-4456-80ee-555161009e37 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] HCTL ('36', '-', '-', 0) found on session 38 with lun 0 {{(pid=75216) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 19:03:39 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-f4f488f0-fc71-4456-80ee-555161009e37 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75216) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 19:03:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:03:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.015s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:03:39 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[63336760-7ba6-431f-bcc6-4469ddee5909]: (4, ('- - 0', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:03:39 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-f4f488f0-fc71-4456-80ee-555161009e37 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Searching for a device in session 38 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75216) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 19:03:39 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4f488f0-fc71-4456-80ee-555161009e37 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:dce55498-5eed-4a20-a00b-3f98b1e93c4f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SdDJHbtF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 19:03:39 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:03:40 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-f4f488f0-fc71-4456-80ee-555161009e37 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.320s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 19:03:40 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4f488f0-fc71-4456-80ee-555161009e37 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] <== connect_volume: return (1322ms) {'type': 'block', 'scsi_wwn': '23165353631613136', 'path': '/dev/sde'} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 19:03:40 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f4f488f0-fc71-4456-80ee-555161009e37 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] [instance: 7b752173-e573-426e-b9f1-bff92a4c2b55] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23165353631613136', 'path': '/dev/sde'} {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 19:03:40 user nova-compute[75216]: DEBUG nova.objects.instance [None req-f4f488f0-fc71-4456-80ee-555161009e37 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Lazy-loading 'flavor' on Instance uuid 7b752173-e573-426e-b9f1-bff92a4c2b55 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:03:40 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-f4f488f0-fc71-4456-80ee-555161009e37 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] attach device xml: <disk type="block" device="disk">
Nov 13 19:03:40 user nova-compute[75216]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 19:03:40 user nova-compute[75216]:   <source dev="/dev/sde"/>
Nov 13 19:03:40 user nova-compute[75216]:   <target dev="vdb" bus="virtio"/>
Nov 13 19:03:40 user nova-compute[75216]:   <serial>dce55498-5eed-4a20-a00b-3f98b1e93c4f</serial>
Nov 13 19:03:40 user nova-compute[75216]: </disk>
Nov 13 19:03:40 user nova-compute[75216]:  {{(pid=75216) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 13 19:03:41 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-f4f488f0-fc71-4456-80ee-555161009e37 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 19:03:41 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-f4f488f0-fc71-4456-80ee-555161009e37 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 19:03:41 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-f4f488f0-fc71-4456-80ee-555161009e37 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] No VIF found with MAC fa:16:3e:d6:af:c5, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 19:03:41 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f4f488f0-fc71-4456-80ee-555161009e37 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Lock "7b752173-e573-426e-b9f1-bff92a4c2b55" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.239s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:03:41 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-9e9fdca8-7e46-40bd-b5c0-b89341a75116 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Acquiring lock "7b752173-e573-426e-b9f1-bff92a4c2b55" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:03:41 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-9e9fdca8-7e46-40bd-b5c0-b89341a75116 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Lock "7b752173-e573-426e-b9f1-bff92a4c2b55" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:03:41 user nova-compute[75216]: DEBUG nova.compute.manager [None req-9e9fdca8-7e46-40bd-b5c0-b89341a75116 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] [instance: 7b752173-e573-426e-b9f1-bff92a4c2b55] Checking state {{(pid=75216) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 19:03:41 user nova-compute[75216]: DEBUG nova.compute.manager [None req-9e9fdca8-7e46-40bd-b5c0-b89341a75116 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] [instance: 7b752173-e573-426e-b9f1-bff92a4c2b55] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=75216) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 13 19:03:41 user nova-compute[75216]: DEBUG nova.objects.instance [None req-9e9fdca8-7e46-40bd-b5c0-b89341a75116 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Lazy-loading 'flavor' on Instance uuid 7b752173-e573-426e-b9f1-bff92a4c2b55 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:03:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:03:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:03:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:03:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:03:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:03:41 user nova-compute[75216]: DEBUG nova.compute.manager [req-2de4ad96-3149-4839-b7ac-f2c9919f64eb req-3ccf38ec-f4f0-4179-b136-6ad36746695f service nova] [instance: 7b752173-e573-426e-b9f1-bff92a4c2b55] Received event network-vif-unplugged-60dd7b11-cfc3-4965-a429-8b2ac4cdfcf4 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:03:41 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-2de4ad96-3149-4839-b7ac-f2c9919f64eb req-3ccf38ec-f4f0-4179-b136-6ad36746695f service nova] Acquiring lock "7b752173-e573-426e-b9f1-bff92a4c2b55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:03:41 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-2de4ad96-3149-4839-b7ac-f2c9919f64eb req-3ccf38ec-f4f0-4179-b136-6ad36746695f service nova] Lock "7b752173-e573-426e-b9f1-bff92a4c2b55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:03:41 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-2de4ad96-3149-4839-b7ac-f2c9919f64eb req-3ccf38ec-f4f0-4179-b136-6ad36746695f service nova] Lock "7b752173-e573-426e-b9f1-bff92a4c2b55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:03:41 user nova-compute[75216]: DEBUG nova.compute.manager [req-2de4ad96-3149-4839-b7ac-f2c9919f64eb req-3ccf38ec-f4f0-4179-b136-6ad36746695f service nova] [instance: 7b752173-e573-426e-b9f1-bff92a4c2b55] No waiting events found dispatching network-vif-unplugged-60dd7b11-cfc3-4965-a429-8b2ac4cdfcf4 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 19:03:41 user nova-compute[75216]: WARNING nova.compute.manager [req-2de4ad96-3149-4839-b7ac-f2c9919f64eb req-3ccf38ec-f4f0-4179-b136-6ad36746695f service nova] [instance: 7b752173-e573-426e-b9f1-bff92a4c2b55] Received unexpected event network-vif-unplugged-60dd7b11-cfc3-4965-a429-8b2ac4cdfcf4 for instance with vm_state active and task_state powering-off.
Nov 13 19:03:42 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 7b752173-e573-426e-b9f1-bff92a4c2b55] Instance destroyed successfully.
Nov 13 19:03:42 user nova-compute[75216]: DEBUG nova.compute.manager [None req-9e9fdca8-7e46-40bd-b5c0-b89341a75116 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] [instance: 7b752173-e573-426e-b9f1-bff92a4c2b55] Checking state {{(pid=75216) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 19:03:42 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-9e9fdca8-7e46-40bd-b5c0-b89341a75116 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Lock "7b752173-e573-426e-b9f1-bff92a4c2b55" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.841s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:03:43 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:03:43 user nova-compute[75216]: DEBUG nova.compute.manager [req-dcb65f9c-3371-414e-b440-e0ebef17db15 req-b1acda9d-bc95-4fdc-af01-42eb5f55ae21 service nova] [instance: 7b752173-e573-426e-b9f1-bff92a4c2b55] Received event network-vif-plugged-60dd7b11-cfc3-4965-a429-8b2ac4cdfcf4 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:03:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-dcb65f9c-3371-414e-b440-e0ebef17db15 req-b1acda9d-bc95-4fdc-af01-42eb5f55ae21 service nova] Acquiring lock "7b752173-e573-426e-b9f1-bff92a4c2b55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:03:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-dcb65f9c-3371-414e-b440-e0ebef17db15 req-b1acda9d-bc95-4fdc-af01-42eb5f55ae21 service nova] Lock "7b752173-e573-426e-b9f1-bff92a4c2b55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:03:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-dcb65f9c-3371-414e-b440-e0ebef17db15 req-b1acda9d-bc95-4fdc-af01-42eb5f55ae21 service nova] Lock "7b752173-e573-426e-b9f1-bff92a4c2b55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:03:43 user nova-compute[75216]: DEBUG nova.compute.manager [req-dcb65f9c-3371-414e-b440-e0ebef17db15 req-b1acda9d-bc95-4fdc-af01-42eb5f55ae21 service nova] [instance: 7b752173-e573-426e-b9f1-bff92a4c2b55] No waiting events found dispatching network-vif-plugged-60dd7b11-cfc3-4965-a429-8b2ac4cdfcf4 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 19:03:43 user nova-compute[75216]: WARNING nova.compute.manager [req-dcb65f9c-3371-414e-b440-e0ebef17db15 req-b1acda9d-bc95-4fdc-af01-42eb5f55ae21 service nova] [instance: 7b752173-e573-426e-b9f1-bff92a4c2b55] Received unexpected event network-vif-plugged-60dd7b11-cfc3-4965-a429-8b2ac4cdfcf4 for instance with vm_state stopped and task_state None.
Nov 13 19:03:44 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:03:48 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:03:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:03:51 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-4dbf8c0d-bd43-45c4-896a-b72c9da467de tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance af8089f7-6dc3-4655-9369-2177dbd7bf4d is timed out.
Nov 13 19:03:51 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-4dbf8c0d-bd43-45c4-896a-b72c9da467de tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Successfully detached device vdb from instance af8089f7-6dc3-4655-9369-2177dbd7bf4d from the live domain config.
Nov 13 19:03:51 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4dbf8c0d-bd43-45c4-896a-b72c9da467de tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] [instance: af8089f7-6dc3-4655-9369-2177dbd7bf4d] calling os-brick to detach iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 19:03:51 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dbf8c0d-bd43-45c4-896a-b72c9da467de tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3a8669e40>, {'target_iqn': 'iqn.2010-10.org.openstack:2dfdac0b-bc0c-4291-ae5c-8eb516d7b164', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'otAVDyPL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 19:03:51 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-4dbf8c0d-bd43-45c4-896a-b72c9da467de tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 19:03:51 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-4dbf8c0d-bd43-45c4-896a-b72c9da467de tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 19:03:51 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-4dbf8c0d-bd43-45c4-896a-b72c9da467de tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 19:03:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:03:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:03:51 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e1f9038-1d72-48b5-bd2f-6dfadee1cd51]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3e8fd410-a0f1-42e1-a536-cd6112122746\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2dfdac0b-bc0c-4291-ae5c-8eb516d7b164\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dce55498-5eed-4a20-a00b-3f98b1e93c4f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:03:51 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dbf8c0d-bd43-45c4-896a-b72c9da467de tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 19:03:51 user nova-compute[75216]: No targets found.
Nov 13 19:03:51 user nova-compute[75216]: iSNS:
Nov 13 19:03:51 user nova-compute[75216]: No targets found.
Nov 13 19:03:51 user nova-compute[75216]: STATIC:
Nov 13 19:03:51 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:3e8fd410-a0f1-42e1-a536-cd6112122746
Nov 13 19:03:51 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 19:03:51 user nova-compute[75216]:                 Iface Name: default
Nov 13 19:03:51 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1
Nov 13 19:03:51 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 19:03:51 user nova-compute[75216]:                 Iface Name: default
Nov 13 19:03:51 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:2dfdac0b-bc0c-4291-ae5c-8eb516d7b164
Nov 13 19:03:51 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 19:03:51 user nova-compute[75216]:                 Iface Name: default
Nov 13 19:03:51 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:dce55498-5eed-4a20-a00b-3f98b1e93c4f
Nov 13 19:03:51 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 19:03:51 user nova-compute[75216]:                 Iface Name: default
Nov 13 19:03:51 user nova-compute[75216]: FIRMWARE:
Nov 13 19:03:51 user nova-compute[75216]: No targets found.
Nov 13 19:03:51 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 19:03:51 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dbf8c0d-bd43-45c4-896a-b72c9da467de tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 19:03:51 user nova-compute[75216]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 19:03:51 user nova-compute[75216]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75216) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 19:03:51 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dbf8c0d-bd43-45c4-896a-b72c9da467de tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2dfdac0b-bc0c-4291-ae5c-8eb516d7b164', 0)] {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 19:03:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:03:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:03:52 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[c91f0cdf-4a12-4a0b-ae8a-eafd2dc08c0c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2dfdac0b-bc0c-4291-ae5c-8eb516d7b164\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3e8fd410-a0f1-42e1-a536-cd6112122746\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dce55498-5eed-4a20-a00b-3f98b1e93c4f\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:03:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:03:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:03:52 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7d24416-a9b2-4794-91e1-f82d71e3e682]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dfdac0b-bc0c-4291-ae5c-8eb516d7b164 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e8fd410-a0f1-42e1-a536-cd6112122746 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dce55498-5eed-4a20-a00b-3f98b1e93c4f (non-flash)\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:03:52 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dbf8c0d-bd43-45c4-896a-b72c9da467de tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1 (non-flash)
Nov 13 19:03:52 user nova-compute[75216]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dfdac0b-bc0c-4291-ae5c-8eb516d7b164 (non-flash)
Nov 13 19:03:52 user nova-compute[75216]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e8fd410-a0f1-42e1-a536-cd6112122746 (non-flash)
Nov 13 19:03:52 user nova-compute[75216]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dce55498-5eed-4a20-a00b-3f98b1e93c4f (non-flash)
Nov 13 19:03:52 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 19:03:52 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dbf8c0d-bd43-45c4-896a-b72c9da467de tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1 (non-flash)
Nov 13 19:03:52 user nova-compute[75216]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dfdac0b-bc0c-4291-ae5c-8eb516d7b164 (non-flash)
Nov 13 19:03:52 user nova-compute[75216]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e8fd410-a0f1-42e1-a536-cd6112122746 (non-flash)
Nov 13 19:03:52 user nova-compute[75216]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dce55498-5eed-4a20-a00b-3f98b1e93c4f (non-flash)
Nov 13 19:03:52 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 19:03:52 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dbf8c0d-bd43-45c4-896a-b72c9da467de tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe3a82f0ca0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2dfdac0b-bc0c-4291-ae5c-8eb516d7b164'): ({'sdc'}, set())}) {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 19:03:52 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-4dbf8c0d-bd43-45c4-896a-b72c9da467de tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Removing single pathed devices sdc {{(pid=75216) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 19:03:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:03:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:03:52 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc67694a-b2e9-49ec-9ff8-ffef27da166e]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:03:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:03:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:03:52 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fdd88ce-fa29-4d56-a1d3-7303b7aae883]: (4, ('ok\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:03:52 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-4dbf8c0d-bd43-45c4-896a-b72c9da467de tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Flushing IO for device /dev/sdc {{(pid=75216) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 19:03:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:03:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:03:52 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[afaba28d-f460-441a-99d7-5d148c2ea078]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:03:52 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-4dbf8c0d-bd43-45c4-896a-b72c9da467de tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75216) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 19:03:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:03:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.050s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:03:52 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[47a23b84-e23f-4052-92aa-5734447a6425]: (4, ('1', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:03:52 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-4dbf8c0d-bd43-45c4-896a-b72c9da467de tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 19:03:52 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-4dbf8c0d-bd43-45c4-896a-b72c9da467de tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] SCSI volumes sdc have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 19:03:52 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dbf8c0d-bd43-45c4-896a-b72c9da467de tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2dfdac0b-bc0c-4291-ae5c-8eb516d7b164')] {{(pid=75216) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 19:03:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2dfdac0b-bc0c-4291-ae5c-8eb516d7b164 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:03:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2dfdac0b-bc0c-4291-ae5c-8eb516d7b164 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:03:52 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[96d77d85-6bee-48dd-8871-9c03a88ffe15]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:03:52 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dbf8c0d-bd43-45c4-896a-b72c9da467de tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:03:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2dfdac0b-bc0c-4291-ae5c-8eb516d7b164 -p 172.16.0.220:3260 --logout {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:03:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2dfdac0b-bc0c-4291-ae5c-8eb516d7b164 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:03:52 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf58e670-1b31-41a6-93f0-b9b719d188ba]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:2dfdac0b-bc0c-4291-ae5c-8eb516d7b164, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:2dfdac0b-bc0c-4291-ae5c-8eb516d7b164, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:03:52 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dbf8c0d-bd43-45c4-896a-b72c9da467de tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:2dfdac0b-bc0c-4291-ae5c-8eb516d7b164, portal: 172.16.0.220,3260]
Nov 13 19:03:52 user nova-compute[75216]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:2dfdac0b-bc0c-4291-ae5c-8eb516d7b164, portal: 172.16.0.220,3260] successful.
Nov 13 19:03:52 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:03:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2dfdac0b-bc0c-4291-ae5c-8eb516d7b164 -p 172.16.0.220:3260 --op delete {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:03:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2dfdac0b-bc0c-4291-ae5c-8eb516d7b164 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:03:52 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a0b0f18-c5c2-4954-95e0-f800dfded17a]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:03:52 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dbf8c0d-bd43-45c4-896a-b72c9da467de tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:03:52 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-4dbf8c0d-bd43-45c4-896a-b72c9da467de tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 19:03:52 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dbf8c0d-bd43-45c4-896a-b72c9da467de tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] <== disconnect_volume: return (306ms) None {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 19:03:52 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4dbf8c0d-bd43-45c4-896a-b72c9da467de tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] [instance: af8089f7-6dc3-4655-9369-2177dbd7bf4d] Disconnected iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 19:03:53 user nova-compute[75216]: DEBUG nova.objects.instance [None req-4dbf8c0d-bd43-45c4-896a-b72c9da467de tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Lazy-loading 'flavor' on Instance uuid af8089f7-6dc3-4655-9369-2177dbd7bf4d {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:03:53 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-4dbf8c0d-bd43-45c4-896a-b72c9da467de tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Lock "af8089f7-6dc3-4655-9369-2177dbd7bf4d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.752s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:03:53 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:03:54 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:03:54 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:03:55 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:03:56 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:03:57 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:03:57 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:03:57 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75216) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 19:03:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-6168a2ee-86fa-4d0d-8aac-155d6833f392 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Acquiring lock "8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:03:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-6168a2ee-86fa-4d0d-8aac-155d6833f392 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Lock "8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:03:58 user nova-compute[75216]: DEBUG nova.compute.manager [None req-6168a2ee-86fa-4d0d-8aac-155d6833f392 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: 8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa] Starting instance... {{(pid=75216) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 19:03:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-6168a2ee-86fa-4d0d-8aac-155d6833f392 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:03:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-6168a2ee-86fa-4d0d-8aac-155d6833f392 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:03:58 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-6168a2ee-86fa-4d0d-8aac-155d6833f392 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75216) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 19:03:58 user nova-compute[75216]: INFO nova.compute.claims [None req-6168a2ee-86fa-4d0d-8aac-155d6833f392 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: 8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa] Claim successful on node user
Nov 13 19:03:58 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-6168a2ee-86fa-4d0d-8aac-155d6833f392 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 19:03:58 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-6168a2ee-86fa-4d0d-8aac-155d6833f392 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 19:03:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-6168a2ee-86fa-4d0d-8aac-155d6833f392 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.382s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:03:58 user nova-compute[75216]: DEBUG nova.compute.manager [None req-6168a2ee-86fa-4d0d-8aac-155d6833f392 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: 8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa] Start building networks asynchronously for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 19:03:58 user nova-compute[75216]: DEBUG nova.compute.manager [None req-6168a2ee-86fa-4d0d-8aac-155d6833f392 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: 8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa] Allocating IP information in the background. {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 19:03:58 user nova-compute[75216]: DEBUG nova.network.neutron [None req-6168a2ee-86fa-4d0d-8aac-155d6833f392 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: 8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa] allocate_for_instance() {{(pid=75216) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 19:03:58 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:03:58 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-6168a2ee-86fa-4d0d-8aac-155d6833f392 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: 8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 19:03:58 user nova-compute[75216]: DEBUG nova.compute.manager [None req-6168a2ee-86fa-4d0d-8aac-155d6833f392 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: 8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa] Start building block device mappings for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 19:03:58 user nova-compute[75216]: DEBUG nova.policy [None req-6168a2ee-86fa-4d0d-8aac-155d6833f392 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b381ea98871846b1bfb29a202a058208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '903397a6c0474cfd8bd1a4fb338528aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75216) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 19:03:58 user nova-compute[75216]: INFO nova.virt.block_device [None req-6168a2ee-86fa-4d0d-8aac-155d6833f392 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: 8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa] Booting with volume-backed-image 77bcb5ba-8510-41ec-a88d-96097bb431de at /dev/vda
Nov 13 19:03:59 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:03:59 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:03:59 user nova-compute[75216]: DEBUG nova.network.neutron [None req-6168a2ee-86fa-4d0d-8aac-155d6833f392 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: 8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa] Successfully created port: 0f86c64c-3da6-44d9-8c74-e276f2496f35 {{(pid=75216) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 19:04:00 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:04:00 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Starting heal instance info cache {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 19:04:00 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Rebuilding the list of instances to heal {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 13 19:04:00 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: 8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa] Skipping network cache update for instance because it is Building. {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 13 19:04:00 user nova-compute[75216]: DEBUG nova.network.neutron [None req-6168a2ee-86fa-4d0d-8aac-155d6833f392 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: 8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa] Successfully updated port: 0f86c64c-3da6-44d9-8c74-e276f2496f35 {{(pid=75216) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 19:04:00 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-6168a2ee-86fa-4d0d-8aac-155d6833f392 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Acquiring lock "refresh_cache-8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 19:04:00 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-6168a2ee-86fa-4d0d-8aac-155d6833f392 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Acquired lock "refresh_cache-8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 19:04:00 user nova-compute[75216]: DEBUG nova.network.neutron [None req-6168a2ee-86fa-4d0d-8aac-155d6833f392 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: 8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa] Building network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 19:04:00 user nova-compute[75216]: DEBUG nova.compute.manager [req-4e94f580-07e4-4236-b1f3-629b6c32afeb req-9953c718-88c0-4161-a975-67f60fb66093 service nova] [instance: 8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa] Received event network-changed-0f86c64c-3da6-44d9-8c74-e276f2496f35 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:04:00 user nova-compute[75216]: DEBUG nova.compute.manager [req-4e94f580-07e4-4236-b1f3-629b6c32afeb req-9953c718-88c0-4161-a975-67f60fb66093 service nova] [instance: 8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa] Refreshing instance network info cache due to event network-changed-0f86c64c-3da6-44d9-8c74-e276f2496f35. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 19:04:00 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-4e94f580-07e4-4236-b1f3-629b6c32afeb req-9953c718-88c0-4161-a975-67f60fb66093 service nova] Acquiring lock "refresh_cache-8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 19:04:00 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "refresh_cache-f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 19:04:00 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquired lock "refresh_cache-f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 19:04:00 user nova-compute[75216]: DEBUG nova.network.neutron [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1] Forcefully refreshing network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 19:04:00 user nova-compute[75216]: DEBUG nova.objects.instance [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lazy-loading 'info_cache' on Instance uuid f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:04:00 user nova-compute[75216]: DEBUG nova.network.neutron [None req-6168a2ee-86fa-4d0d-8aac-155d6833f392 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: 8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa] Instance cache missing network info. {{(pid=75216) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 19:04:00 user nova-compute[75216]: DEBUG nova.network.neutron [None req-6168a2ee-86fa-4d0d-8aac-155d6833f392 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: 8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa] Updating instance_info_cache with network_info: [{"id": "0f86c64c-3da6-44d9-8c74-e276f2496f35", "address": "fa:16:3e:21:5b:c2", "network": {"id": "f8b821ef-8fae-42b9-9055-a9ea7be955ab", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-50594548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "903397a6c0474cfd8bd1a4fb338528aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f86c64c-3d", "ovs_interfaceid": "0f86c64c-3da6-44d9-8c74-e276f2496f35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:04:00 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-6168a2ee-86fa-4d0d-8aac-155d6833f392 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Releasing lock "refresh_cache-8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 19:04:00 user nova-compute[75216]: DEBUG nova.compute.manager [None req-6168a2ee-86fa-4d0d-8aac-155d6833f392 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: 8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa] Instance network_info: |[{"id": "0f86c64c-3da6-44d9-8c74-e276f2496f35", "address": "fa:16:3e:21:5b:c2", "network": {"id": "f8b821ef-8fae-42b9-9055-a9ea7be955ab", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-50594548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "903397a6c0474cfd8bd1a4fb338528aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f86c64c-3d", "ovs_interfaceid": "0f86c64c-3da6-44d9-8c74-e276f2496f35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 19:04:00 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-4e94f580-07e4-4236-b1f3-629b6c32afeb req-9953c718-88c0-4161-a975-67f60fb66093 service nova] Acquired lock "refresh_cache-8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 19:04:00 user nova-compute[75216]: DEBUG nova.network.neutron [req-4e94f580-07e4-4236-b1f3-629b6c32afeb req-9953c718-88c0-4161-a975-67f60fb66093 service nova] [instance: 8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa] Refreshing network info cache for port 0f86c64c-3da6-44d9-8c74-e276f2496f35 {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 19:04:01 user nova-compute[75216]: DEBUG nova.network.neutron [req-4e94f580-07e4-4236-b1f3-629b6c32afeb req-9953c718-88c0-4161-a975-67f60fb66093 service nova] [instance: 8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa] Updated VIF entry in instance network info cache for port 0f86c64c-3da6-44d9-8c74-e276f2496f35. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 19:04:01 user nova-compute[75216]: DEBUG nova.network.neutron [req-4e94f580-07e4-4236-b1f3-629b6c32afeb req-9953c718-88c0-4161-a975-67f60fb66093 service nova] [instance: 8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa] Updating instance_info_cache with network_info: [{"id": "0f86c64c-3da6-44d9-8c74-e276f2496f35", "address": "fa:16:3e:21:5b:c2", "network": {"id": "f8b821ef-8fae-42b9-9055-a9ea7be955ab", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-50594548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "903397a6c0474cfd8bd1a4fb338528aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f86c64c-3d", "ovs_interfaceid": "0f86c64c-3da6-44d9-8c74-e276f2496f35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:04:01 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-4e94f580-07e4-4236-b1f3-629b6c32afeb req-9953c718-88c0-4161-a975-67f60fb66093 service nova] Releasing lock "refresh_cache-8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 19:04:01 user nova-compute[75216]: DEBUG nova.network.neutron [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1] Updating instance_info_cache with network_info: [{"id": "5419f8b4-31da-434a-b131-6476134a71bf", "address": "fa:16:3e:9a:08:ac", "network": {"id": "f8b821ef-8fae-42b9-9055-a9ea7be955ab", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-50594548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "903397a6c0474cfd8bd1a4fb338528aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5419f8b4-31", "ovs_interfaceid": "5419f8b4-31da-434a-b131-6476134a71bf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:04:01 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Releasing lock "refresh_cache-f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 19:04:01 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1] Updated the network info_cache for instance {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 19:04:01 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:04:02 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:04:02 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:04:02 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:04:02 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:04:02 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Auditing locally available compute resources for user (node: user) {{(pid=75216) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 19:04:02 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 19:04:02 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b752173-e573-426e-b9f1-bff92a4c2b55/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:04:02 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b752173-e573-426e-b9f1-bff92a4c2b55/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:04:02 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b752173-e573-426e-b9f1-bff92a4c2b55/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:04:02 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b752173-e573-426e-b9f1-bff92a4c2b55/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:04:02 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 19:04:02 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:04:03 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:04:03 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:04:03 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:04:03 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71134725-e6cc-4426-b2c2-5be4991c53f7/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:04:03 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71134725-e6cc-4426-b2c2-5be4991c53f7/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:04:03 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71134725-e6cc-4426-b2c2-5be4991c53f7/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:04:03 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71134725-e6cc-4426-b2c2-5be4991c53f7/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:04:03 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 19:04:03 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af8089f7-6dc3-4655-9369-2177dbd7bf4d/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:04:03 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:04:03 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af8089f7-6dc3-4655-9369-2177dbd7bf4d/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:04:03 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af8089f7-6dc3-4655-9369-2177dbd7bf4d/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:04:04 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af8089f7-6dc3-4655-9369-2177dbd7bf4d/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:04:04 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c18c0ad-60e5-4ef2-97f2-b7008e89ac78/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:04:04 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c18c0ad-60e5-4ef2-97f2-b7008e89ac78/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:04:04 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c18c0ad-60e5-4ef2-97f2-b7008e89ac78/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:04:04 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c18c0ad-60e5-4ef2-97f2-b7008e89ac78/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:04:04 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/884178b6-f98e-41fb-9f59-e41af82553b3/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:04:04 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/884178b6-f98e-41fb-9f59-e41af82553b3/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:04:04 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/884178b6-f98e-41fb-9f59-e41af82553b3/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:04:04 user nova-compute[75216]: DEBUG os_brick.utils [None req-6168a2ee-86fa-4d0d-8aac-155d6833f392 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 19:04:04 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:04:04 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:04:04 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[c24c5db1-6cbd-4802-8776-3bbace3856de]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aea6fcfe14b9\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:04:04 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:04:04 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:04:04 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[d178973e-8801-4af8-921e-37f2fa9d98d4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:04:04 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:04:04 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:04:04 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:04:04 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[963a67e9-3678-492d-9e03-404d2fe0762c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:04:04 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[795ab5da-e6b2-4043-bff1-a52a560d8648]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:04:04 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-6168a2ee-86fa-4d0d-8aac-155d6833f392 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Running cmd (subprocess): nvme version {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:04:04 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-6168a2ee-86fa-4d0d-8aac-155d6833f392 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] 'nvme version' failed. Not Retrying. {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 19:04:04 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6168a2ee-86fa-4d0d-8aac-155d6833f392 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] nvme not present on system {{(pid=75216) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 19:04:04 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:04:04 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 19:04:04 user nova-compute[75216]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 19:04:04 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d63ef06-a1bb-4ea3-b9dc-afa0655177b8]: (4, '') {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:04:04 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-6168a2ee-86fa-4d0d-8aac-155d6833f392 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75216) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 19:04:04 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-6168a2ee-86fa-4d0d-8aac-155d6833f392 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 19:04:04 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-6168a2ee-86fa-4d0d-8aac-155d6833f392 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] LIGHTOS: no hostnqn found. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 19:04:04 user nova-compute[75216]: DEBUG os_brick.utils [None req-6168a2ee-86fa-4d0d-8aac-155d6833f392 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] <== get_connector_properties: return (109ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aea6fcfe14b9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 19:04:04 user nova-compute[75216]: DEBUG nova.virt.block_device [None req-6168a2ee-86fa-4d0d-8aac-155d6833f392 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: 8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa] Updating existing volume attachment record: 0eee4b25-b73e-4892-9033-9e0687c0f999 {{(pid=75216) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 19:04:04 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/884178b6-f98e-41fb-9f59-e41af82553b3/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:04:05 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 19:04:05 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 19:04:05 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Hypervisor/Node resource view: name=user free_ram=8261MB free_disk=25.220718383789062GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75216) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 19:04:05 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:04:05 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:04:05 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 19:04:05 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance 1e5f1164-a15e-40cf-b7bc-5aeb404a1216 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 19:04:05 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance af8089f7-6dc3-4655-9369-2177dbd7bf4d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 19:04:05 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance 5c18c0ad-60e5-4ef2-97f2-b7008e89ac78 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 19:04:05 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance 7b752173-e573-426e-b9f1-bff92a4c2b55 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 19:04:05 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance 884178b6-f98e-41fb-9f59-e41af82553b3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 19:04:05 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance 71134725-e6cc-4426-b2c2-5be4991c53f7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 19:04:05 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance 8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 19:04:05 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 19:04:05 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 19:04:05 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 19:04:05 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 19:04:05 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Compute_service record updated for user:user {{(pid=75216) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 19:04:05 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.392s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:04:08 user nova-compute[75216]: DEBUG nova.compute.manager [None req-6168a2ee-86fa-4d0d-8aac-155d6833f392 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: 8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa] Start spawning the instance on the hypervisor. {{(pid=75216) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 19:04:08 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-6168a2ee-86fa-4d0d-8aac-155d6833f392 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: 8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa] Creating instance directory {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 19:04:08 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-6168a2ee-86fa-4d0d-8aac-155d6833f392 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: 8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa] Creating image(s)
Nov 13 19:04:08 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-6168a2ee-86fa-4d0d-8aac-155d6833f392 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: 8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa] Did not create local disks {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 13 19:04:08 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-6168a2ee-86fa-4d0d-8aac-155d6833f392 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: 8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa] Ensure instance console log exists: /opt/stack/data/nova/instances/8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa/console.log {{(pid=75216) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 19:04:08 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-6168a2ee-86fa-4d0d-8aac-155d6833f392 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:04:08 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-6168a2ee-86fa-4d0d-8aac-155d6833f392 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:04:08 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-6168a2ee-86fa-4d0d-8aac-155d6833f392 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:04:08 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-6168a2ee-86fa-4d0d-8aac-155d6833f392 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: 8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa] Start _get_guest_xml network_info=[{"id": "0f86c64c-3da6-44d9-8c74-e276f2496f35", "address": "fa:16:3e:21:5b:c2", "network": {"id": "f8b821ef-8fae-42b9-9055-a9ea7be955ab", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-50594548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "903397a6c0474cfd8bd1a4fb338528aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f86c64c-3d", "ovs_interfaceid": "0f86c64c-3da6-44d9-8c74-e276f2496f35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T18:41:06Z,direct_url=<?>,disk_format='qcow2',id=77bcb5ba-8510-41ec-a88d-96097bb431de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c465b7c26ec44582b6d1b7169536ecc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T18:41:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3bda4ab6-9834-40ad-b9fc-88186d2ffceb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hZOIpwel', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa', 'attached_at': '', 'detached_at': '', 'volume_id': '3bda4ab6-9834-40ad-b9fc-88186d2ffceb', 'serial': '3bda4ab6-9834-40ad-b9fc-88186d2ffceb'}, 'attachment_id': '0eee4b25-b73e-4892-9033-9e0687c0f999', 'guest_format': None, 'mount_device': '/dev/vda', 'delete_on_termination': False, 'boot_index': 0, 'volume_type': None} {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 19:04:08 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-6168a2ee-86fa-4d0d-8aac-155d6833f392 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 19:04:08 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-6168a2ee-86fa-4d0d-8aac-155d6833f392 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 19:04:08 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-6168a2ee-86fa-4d0d-8aac-155d6833f392 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 19:04:08 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-6168a2ee-86fa-4d0d-8aac-155d6833f392 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] CPU controller missing on host. {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 19:04:08 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-6168a2ee-86fa-4d0d-8aac-155d6833f392 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 19:04:08 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-6168a2ee-86fa-4d0d-8aac-155d6833f392 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] CPU controller found on host. {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 19:04:08 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-6168a2ee-86fa-4d0d-8aac-155d6833f392 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75216) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 19:04:08 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-6168a2ee-86fa-4d0d-8aac-155d6833f392 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T18:40:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T18:41:06Z,direct_url=<?>,disk_format='qcow2',id=77bcb5ba-8510-41ec-a88d-96097bb431de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c465b7c26ec44582b6d1b7169536ecc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T18:41:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 19:04:08 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-6168a2ee-86fa-4d0d-8aac-155d6833f392 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Flavor limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 19:04:08 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-6168a2ee-86fa-4d0d-8aac-155d6833f392 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Image limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 19:04:08 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-6168a2ee-86fa-4d0d-8aac-155d6833f392 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Flavor pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 19:04:08 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-6168a2ee-86fa-4d0d-8aac-155d6833f392 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Image pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 19:04:08 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-6168a2ee-86fa-4d0d-8aac-155d6833f392 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 19:04:08 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-6168a2ee-86fa-4d0d-8aac-155d6833f392 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 19:04:08 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-6168a2ee-86fa-4d0d-8aac-155d6833f392 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 19:04:08 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-6168a2ee-86fa-4d0d-8aac-155d6833f392 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Got 1 possible topologies {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 19:04:08 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-6168a2ee-86fa-4d0d-8aac-155d6833f392 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 19:04:08 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-6168a2ee-86fa-4d0d-8aac-155d6833f392 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 19:04:08 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6168a2ee-86fa-4d0d-8aac-155d6833f392 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: 8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa] Calling os-brick to attach iSCSI Volume {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 19:04:08 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6168a2ee-86fa-4d0d-8aac-155d6833f392 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3a8669e40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3bda4ab6-9834-40ad-b9fc-88186d2ffceb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hZOIpwel', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 19:04:08 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-6168a2ee-86fa-4d0d-8aac-155d6833f392 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 19:04:08 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-6168a2ee-86fa-4d0d-8aac-155d6833f392 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 19:04:08 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-6168a2ee-86fa-4d0d-8aac-155d6833f392 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 19:04:08 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-6168a2ee-86fa-4d0d-8aac-155d6833f392 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 19:04:08 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-6168a2ee-86fa-4d0d-8aac-155d6833f392 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3bda4ab6-9834-40ad-b9fc-88186d2ffceb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 19:04:08 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-6168a2ee-86fa-4d0d-8aac-155d6833f392 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3bda4ab6-9834-40ad-b9fc-88186d2ffceb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 19:04:08 user nova-compute[75216]: INFO os_brick.initiator.connectors.iscsi [None req-6168a2ee-86fa-4d0d-8aac-155d6833f392 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 19:04:08 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bda4ab6-9834-40ad-b9fc-88186d2ffceb -p 172.16.0.220:3260 {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:04:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bda4ab6-9834-40ad-b9fc-88186d2ffceb -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:04:09 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[db7bdf6f-3344-4ba7-903b-2d2ac7341375]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:04:09 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6168a2ee-86fa-4d0d-8aac-155d6833f392 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 19:04:09 user nova-compute[75216]:  {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:04:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bda4ab6-9834-40ad-b9fc-88186d2ffceb -p 172.16.0.220:3260 --interface default --op new {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:04:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bda4ab6-9834-40ad-b9fc-88186d2ffceb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:04:09 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e9db469-3c42-4b2c-bd74-cc689c6f581a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3bda4ab6-9834-40ad-b9fc-88186d2ffceb] added\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:04:09 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6168a2ee-86fa-4d0d-8aac-155d6833f392 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3bda4ab6-9834-40ad-b9fc-88186d2ffceb] added
Nov 13 19:04:09 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:04:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bda4ab6-9834-40ad-b9fc-88186d2ffceb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:04:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bda4ab6-9834-40ad-b9fc-88186d2ffceb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:04:09 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[c422a48b-14f8-4eaa-9daa-82cb2fbc9043]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:04:09 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6168a2ee-86fa-4d0d-8aac-155d6833f392 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:04:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bda4ab6-9834-40ad-b9fc-88186d2ffceb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:04:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bda4ab6-9834-40ad-b9fc-88186d2ffceb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:04:09 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[804113f1-7915-45a4-ac26-30fb6f852c07]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:04:09 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6168a2ee-86fa-4d0d-8aac-155d6833f392 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:04:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bda4ab6-9834-40ad-b9fc-88186d2ffceb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hZOIpwel {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:04:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bda4ab6-9834-40ad-b9fc-88186d2ffceb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hZOIpwel" returned: 0 in 0.019s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:04:09 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf0f235d-31f0-4c31-9beb-e80a03af4a60]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:04:09 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6168a2ee-86fa-4d0d-8aac-155d6833f392 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hZOIpwel'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:04:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bda4ab6-9834-40ad-b9fc-88186d2ffceb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:04:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bda4ab6-9834-40ad-b9fc-88186d2ffceb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:04:09 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[66390167-3391-4025-96ed-30b8c8de2bc9]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:04:09 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6168a2ee-86fa-4d0d-8aac-155d6833f392 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:04:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:04:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:04:09 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[817cfe77-3477-47ff-a0d0-7fe90c5271ad]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e8fd410-a0f1-42e1-a536-cd6112122746 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dce55498-5eed-4a20-a00b-3f98b1e93c4f (non-flash)\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:04:09 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6168a2ee-86fa-4d0d-8aac-155d6833f392 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1 (non-flash)
Nov 13 19:04:09 user nova-compute[75216]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e8fd410-a0f1-42e1-a536-cd6112122746 (non-flash)
Nov 13 19:04:09 user nova-compute[75216]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dce55498-5eed-4a20-a00b-3f98b1e93c4f (non-flash)
Nov 13 19:04:09 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 19:04:09 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6168a2ee-86fa-4d0d-8aac-155d6833f392 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1 (non-flash)
Nov 13 19:04:09 user nova-compute[75216]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e8fd410-a0f1-42e1-a536-cd6112122746 (non-flash)
Nov 13 19:04:09 user nova-compute[75216]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dce55498-5eed-4a20-a00b-3f98b1e93c4f (non-flash)
Nov 13 19:04:09 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 19:04:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bda4ab6-9834-40ad-b9fc-88186d2ffceb -p 172.16.0.220:3260 --login {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:04:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bda4ab6-9834-40ad-b9fc-88186d2ffceb -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:04:09 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[58103718-a687-4a3e-ba13-e5c3d6862ded]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3bda4ab6-9834-40ad-b9fc-88186d2ffceb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3bda4ab6-9834-40ad-b9fc-88186d2ffceb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:04:09 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6168a2ee-86fa-4d0d-8aac-155d6833f392 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3bda4ab6-9834-40ad-b9fc-88186d2ffceb, portal: 172.16.0.220,3260]
Nov 13 19:04:09 user nova-compute[75216]: Login to [iface: default, target: iqn.2010-10.org.openstack:3bda4ab6-9834-40ad-b9fc-88186d2ffceb, portal: 172.16.0.220,3260] successful.
Nov 13 19:04:09 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:04:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bda4ab6-9834-40ad-b9fc-88186d2ffceb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:04:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bda4ab6-9834-40ad-b9fc-88186d2ffceb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:04:09 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[baa33b19-9ba3-4640-a897-ad65242b8ccc]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:04:09 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6168a2ee-86fa-4d0d-8aac-155d6833f392 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:04:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:04:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:04:09 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[b40d6ce4-6981-404c-8ad4-a59c57bd3f8c]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e8fd410-a0f1-42e1-a536-cd6112122746 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dce55498-5eed-4a20-a00b-3f98b1e93c4f (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bda4ab6-9834-40ad-b9fc-88186d2ffceb (non-flash)\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:04:09 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6168a2ee-86fa-4d0d-8aac-155d6833f392 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1 (non-flash)
Nov 13 19:04:09 user nova-compute[75216]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e8fd410-a0f1-42e1-a536-cd6112122746 (non-flash)
Nov 13 19:04:09 user nova-compute[75216]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dce55498-5eed-4a20-a00b-3f98b1e93c4f (non-flash)
Nov 13 19:04:09 user nova-compute[75216]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bda4ab6-9834-40ad-b9fc-88186d2ffceb (non-flash)
Nov 13 19:04:09 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 19:04:09 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6168a2ee-86fa-4d0d-8aac-155d6833f392 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1 (non-flash)
Nov 13 19:04:09 user nova-compute[75216]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e8fd410-a0f1-42e1-a536-cd6112122746 (non-flash)
Nov 13 19:04:09 user nova-compute[75216]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dce55498-5eed-4a20-a00b-3f98b1e93c4f (non-flash)
Nov 13 19:04:09 user nova-compute[75216]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bda4ab6-9834-40ad-b9fc-88186d2ffceb (non-flash)
Nov 13 19:04:09 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 19:04:09 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-6168a2ee-86fa-4d0d-8aac-155d6833f392 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3bda4ab6-9834-40ad-b9fc-88186d2ffceb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.299s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 19:04:09 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6168a2ee-86fa-4d0d-8aac-155d6833f392 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Connected to 172.16.0.220:3260 {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 19:04:09 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-6168a2ee-86fa-4d0d-8aac-155d6833f392 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] HCTL ('34', '-', '-', 0) found on session 39 with lun 0 {{(pid=75216) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 19:04:09 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-6168a2ee-86fa-4d0d-8aac-155d6833f392 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75216) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 19:04:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:04:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:04:09 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[5765a8d6-1d83-4569-ac72-b355ed6ff412]: (4, ('- - 0', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:04:09 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-6168a2ee-86fa-4d0d-8aac-155d6833f392 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Searching for a device in session 39 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75216) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 19:04:09 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6168a2ee-86fa-4d0d-8aac-155d6833f392 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:3bda4ab6-9834-40ad-b9fc-88186d2ffceb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hZOIpwel', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 19:04:09 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:04:10 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-6168a2ee-86fa-4d0d-8aac-155d6833f392 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.334s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 19:04:10 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6168a2ee-86fa-4d0d-8aac-155d6833f392 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] <== connect_volume: return (1335ms) {'type': 'block', 'scsi_wwn': '23039633739383234', 'path': '/dev/sdc'} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 19:04:10 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6168a2ee-86fa-4d0d-8aac-155d6833f392 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: 8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23039633739383234', 'path': '/dev/sdc'} {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 19:04:10 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-6168a2ee-86fa-4d0d-8aac-155d6833f392 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T19:03:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1397198855',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1397198855',id=31,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='903397a6c0474cfd8bd1a4fb338528aa',ramdisk_id='',reservation_id='r-ytgh7qju',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-197527955',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T19:03:59Z,user_data=None,user_id='b381ea98871846b1bfb29a202a058208',uuid=8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0f86c64c-3da6-44d9-8c74-e276f2496f35", "address": "fa:16:3e:21:5b:c2", "network": {"id": "f8b821ef-8fae-42b9-9055-a9ea7be955ab", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-50594548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "903397a6c0474cfd8bd1a4fb338528aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f86c64c-3d", "ovs_interfaceid": "0f86c64c-3da6-44d9-8c74-e276f2496f35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75216) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 19:04:10 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-6168a2ee-86fa-4d0d-8aac-155d6833f392 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Converting VIF {"id": "0f86c64c-3da6-44d9-8c74-e276f2496f35", "address": "fa:16:3e:21:5b:c2", "network": {"id": "f8b821ef-8fae-42b9-9055-a9ea7be955ab", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-50594548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "903397a6c0474cfd8bd1a4fb338528aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f86c64c-3d", "ovs_interfaceid": "0f86c64c-3da6-44d9-8c74-e276f2496f35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 19:04:10 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-6168a2ee-86fa-4d0d-8aac-155d6833f392 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:5b:c2,bridge_name='br-int',has_traffic_filtering=True,id=0f86c64c-3da6-44d9-8c74-e276f2496f35,network=Network(f8b821ef-8fae-42b9-9055-a9ea7be955ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f86c64c-3d') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 19:04:10 user nova-compute[75216]: DEBUG nova.objects.instance [None req-6168a2ee-86fa-4d0d-8aac-155d6833f392 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Lazy-loading 'pci_devices' on Instance uuid 8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:04:10 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-6168a2ee-86fa-4d0d-8aac-155d6833f392 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: 8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa] End _get_guest_xml xml=<domain type="kvm">
Nov 13 19:04:10 user nova-compute[75216]:   <uuid>8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa</uuid>
Nov 13 19:04:10 user nova-compute[75216]:   <name>instance-0000001f</name>
Nov 13 19:04:10 user nova-compute[75216]:   <memory>524288</memory>
Nov 13 19:04:10 user nova-compute[75216]:   <vcpu>1</vcpu>
Nov 13 19:04:10 user nova-compute[75216]:   <metadata>
Nov 13 19:04:10 user nova-compute[75216]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 19:04:10 user nova-compute[75216]:       <nova:package version="0.0.0"/>
Nov 13 19:04:10 user nova-compute[75216]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1397198855</nova:name>
Nov 13 19:04:10 user nova-compute[75216]:       <nova:creationTime>2023-11-13 19:04:08</nova:creationTime>
Nov 13 19:04:10 user nova-compute[75216]:       <nova:flavor name="m1.tiny">
Nov 13 19:04:10 user nova-compute[75216]:         <nova:memory>512</nova:memory>
Nov 13 19:04:10 user nova-compute[75216]:         <nova:disk>1</nova:disk>
Nov 13 19:04:10 user nova-compute[75216]:         <nova:swap>0</nova:swap>
Nov 13 19:04:10 user nova-compute[75216]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 19:04:10 user nova-compute[75216]:         <nova:vcpus>1</nova:vcpus>
Nov 13 19:04:10 user nova-compute[75216]:       </nova:flavor>
Nov 13 19:04:10 user nova-compute[75216]:       <nova:owner>
Nov 13 19:04:10 user nova-compute[75216]:         <nova:user uuid="b381ea98871846b1bfb29a202a058208">tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member</nova:user>
Nov 13 19:04:10 user nova-compute[75216]:         <nova:project uuid="903397a6c0474cfd8bd1a4fb338528aa">tempest-ServerBootFromVolumeStableRescueTest-197527955</nova:project>
Nov 13 19:04:10 user nova-compute[75216]:       </nova:owner>
Nov 13 19:04:10 user nova-compute[75216]:       <nova:root type="image" uuid="77bcb5ba-8510-41ec-a88d-96097bb431de"/>
Nov 13 19:04:10 user nova-compute[75216]:       <nova:ports>
Nov 13 19:04:10 user nova-compute[75216]:         <nova:port uuid="0f86c64c-3da6-44d9-8c74-e276f2496f35">
Nov 13 19:04:10 user nova-compute[75216]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 13 19:04:10 user nova-compute[75216]:         </nova:port>
Nov 13 19:04:10 user nova-compute[75216]:       </nova:ports>
Nov 13 19:04:10 user nova-compute[75216]:     </nova:instance>
Nov 13 19:04:10 user nova-compute[75216]:   </metadata>
Nov 13 19:04:10 user nova-compute[75216]:   <sysinfo type="smbios">
Nov 13 19:04:10 user nova-compute[75216]:     <system>
Nov 13 19:04:10 user nova-compute[75216]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 19:04:10 user nova-compute[75216]:       <entry name="product">OpenStack Nova</entry>
Nov 13 19:04:10 user nova-compute[75216]:       <entry name="version">0.0.0</entry>
Nov 13 19:04:10 user nova-compute[75216]:       <entry name="serial">8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa</entry>
Nov 13 19:04:10 user nova-compute[75216]:       <entry name="uuid">8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa</entry>
Nov 13 19:04:10 user nova-compute[75216]:       <entry name="family">Virtual Machine</entry>
Nov 13 19:04:10 user nova-compute[75216]:     </system>
Nov 13 19:04:10 user nova-compute[75216]:   </sysinfo>
Nov 13 19:04:10 user nova-compute[75216]:   <os>
Nov 13 19:04:10 user nova-compute[75216]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 19:04:10 user nova-compute[75216]:     <boot dev="hd"/>
Nov 13 19:04:10 user nova-compute[75216]:     <smbios mode="sysinfo"/>
Nov 13 19:04:10 user nova-compute[75216]:   </os>
Nov 13 19:04:10 user nova-compute[75216]:   <features>
Nov 13 19:04:10 user nova-compute[75216]:     <acpi/>
Nov 13 19:04:10 user nova-compute[75216]:     <apic/>
Nov 13 19:04:10 user nova-compute[75216]:     <vmcoreinfo/>
Nov 13 19:04:10 user nova-compute[75216]:   </features>
Nov 13 19:04:10 user nova-compute[75216]:   <clock offset="utc">
Nov 13 19:04:10 user nova-compute[75216]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 19:04:10 user nova-compute[75216]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 19:04:10 user nova-compute[75216]:     <timer name="hpet" present="no"/>
Nov 13 19:04:10 user nova-compute[75216]:   </clock>
Nov 13 19:04:10 user nova-compute[75216]:   <cpu mode="custom" match="exact">
Nov 13 19:04:10 user nova-compute[75216]:     <model>Nehalem</model>
Nov 13 19:04:10 user nova-compute[75216]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 19:04:10 user nova-compute[75216]:   </cpu>
Nov 13 19:04:10 user nova-compute[75216]:   <devices>
Nov 13 19:04:10 user nova-compute[75216]:     <disk type="block" device="disk">
Nov 13 19:04:10 user nova-compute[75216]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 19:04:10 user nova-compute[75216]:       <source dev="/dev/sdc"/>
Nov 13 19:04:10 user nova-compute[75216]:       <target dev="vda" bus="virtio"/>
Nov 13 19:04:10 user nova-compute[75216]:       <serial>3bda4ab6-9834-40ad-b9fc-88186d2ffceb</serial>
Nov 13 19:04:10 user nova-compute[75216]:     </disk>
Nov 13 19:04:10 user nova-compute[75216]:     <interface type="ethernet">
Nov 13 19:04:10 user nova-compute[75216]:       <mac address="fa:16:3e:21:5b:c2"/>
Nov 13 19:04:10 user nova-compute[75216]:       <model type="virtio"/>
Nov 13 19:04:10 user nova-compute[75216]:       <mtu size="1442"/>
Nov 13 19:04:10 user nova-compute[75216]:       <target dev="tap0f86c64c-3d"/>
Nov 13 19:04:10 user nova-compute[75216]:     </interface>
Nov 13 19:04:10 user nova-compute[75216]:     <serial type="pty">
Nov 13 19:04:10 user nova-compute[75216]:       <log file="/opt/stack/data/nova/instances/8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa/console.log" append="off"/>
Nov 13 19:04:10 user nova-compute[75216]:     </serial>
Nov 13 19:04:10 user nova-compute[75216]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 19:04:10 user nova-compute[75216]:     <video>
Nov 13 19:04:10 user nova-compute[75216]:       <model type="virtio"/>
Nov 13 19:04:10 user nova-compute[75216]:     </video>
Nov 13 19:04:10 user nova-compute[75216]:     <rng model="virtio">
Nov 13 19:04:10 user nova-compute[75216]:       <backend model="random">/dev/urandom</backend>
Nov 13 19:04:10 user nova-compute[75216]:     </rng>
Nov 13 19:04:10 user nova-compute[75216]:     <controller type="usb" index="0" model="none"/>
Nov 13 19:04:10 user nova-compute[75216]:     <memballoon model="virtio">
Nov 13 19:04:10 user nova-compute[75216]:       <stats period="10"/>
Nov 13 19:04:10 user nova-compute[75216]:     </memballoon>
Nov 13 19:04:10 user nova-compute[75216]:   </devices>
Nov 13 19:04:10 user nova-compute[75216]: </domain>
Nov 13 19:04:10 user nova-compute[75216]:  {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 19:04:10 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-6168a2ee-86fa-4d0d-8aac-155d6833f392 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T19:03:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1397198855',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1397198855',id=31,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='903397a6c0474cfd8bd1a4fb338528aa',ramdisk_id='',reservation_id='r-ytgh7qju',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-197527955',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T19:03:59Z,user_data=None,user_id='b381ea98871846b1bfb29a202a058208',uuid=8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0f86c64c-3da6-44d9-8c74-e276f2496f35", "address": "fa:16:3e:21:5b:c2", "network": {"id": "f8b821ef-8fae-42b9-9055-a9ea7be955ab", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-50594548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "903397a6c0474cfd8bd1a4fb338528aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f86c64c-3d", "ovs_interfaceid": "0f86c64c-3da6-44d9-8c74-e276f2496f35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 19:04:10 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-6168a2ee-86fa-4d0d-8aac-155d6833f392 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Converting VIF {"id": "0f86c64c-3da6-44d9-8c74-e276f2496f35", "address": "fa:16:3e:21:5b:c2", "network": {"id": "f8b821ef-8fae-42b9-9055-a9ea7be955ab", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-50594548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "903397a6c0474cfd8bd1a4fb338528aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f86c64c-3d", "ovs_interfaceid": "0f86c64c-3da6-44d9-8c74-e276f2496f35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 19:04:10 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-6168a2ee-86fa-4d0d-8aac-155d6833f392 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:5b:c2,bridge_name='br-int',has_traffic_filtering=True,id=0f86c64c-3da6-44d9-8c74-e276f2496f35,network=Network(f8b821ef-8fae-42b9-9055-a9ea7be955ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f86c64c-3d') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 19:04:10 user nova-compute[75216]: DEBUG os_vif [None req-6168a2ee-86fa-4d0d-8aac-155d6833f392 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:5b:c2,bridge_name='br-int',has_traffic_filtering=True,id=0f86c64c-3da6-44d9-8c74-e276f2496f35,network=Network(f8b821ef-8fae-42b9-9055-a9ea7be955ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f86c64c-3d') {{(pid=75216) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 19:04:10 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:04:10 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:04:10 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 19:04:10 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:04:10 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bc1c1131-46bc-53ea-8000-5e4657fe5dec', '_type': 'linux-noop'}}, row=False) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:04:10 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:04:10 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:04:10 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:04:10 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:04:10 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0f86c64c-3d, may_exist=True, interface_attrs={}) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:04:10 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0f86c64c-3d, col_values=(('qos', UUID('3725c799-2d54-4112-9eff-20782aba8622')),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:04:10 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0f86c64c-3d, col_values=(('external_ids', {'iface-id': '0f86c64c-3da6-44d9-8c74-e276f2496f35', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:21:5b:c2', 'vm-uuid': '8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa'}),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:04:10 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:04:10 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:04:10 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:04:10 user nova-compute[75216]: INFO os_vif [None req-6168a2ee-86fa-4d0d-8aac-155d6833f392 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:5b:c2,bridge_name='br-int',has_traffic_filtering=True,id=0f86c64c-3da6-44d9-8c74-e276f2496f35,network=Network(f8b821ef-8fae-42b9-9055-a9ea7be955ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f86c64c-3d')
Nov 13 19:04:10 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-6168a2ee-86fa-4d0d-8aac-155d6833f392 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 19:04:10 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-6168a2ee-86fa-4d0d-8aac-155d6833f392 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] No VIF found with MAC fa:16:3e:21:5b:c2, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 19:04:11 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:04:11 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:04:11 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:04:11 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:04:11 user nova-compute[75216]: DEBUG nova.compute.manager [req-7f7a1487-32c1-46e2-b4f1-fe27329bd8f9 req-81fe5189-a4cd-4eb1-8df5-99ed01386b41 service nova] [instance: 8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa] Received event network-vif-plugged-0f86c64c-3da6-44d9-8c74-e276f2496f35 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:04:11 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-7f7a1487-32c1-46e2-b4f1-fe27329bd8f9 req-81fe5189-a4cd-4eb1-8df5-99ed01386b41 service nova] Acquiring lock "8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:04:11 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-7f7a1487-32c1-46e2-b4f1-fe27329bd8f9 req-81fe5189-a4cd-4eb1-8df5-99ed01386b41 service nova] Lock "8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:04:11 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-7f7a1487-32c1-46e2-b4f1-fe27329bd8f9 req-81fe5189-a4cd-4eb1-8df5-99ed01386b41 service nova] Lock "8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:04:11 user nova-compute[75216]: DEBUG nova.compute.manager [req-7f7a1487-32c1-46e2-b4f1-fe27329bd8f9 req-81fe5189-a4cd-4eb1-8df5-99ed01386b41 service nova] [instance: 8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa] No waiting events found dispatching network-vif-plugged-0f86c64c-3da6-44d9-8c74-e276f2496f35 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 19:04:11 user nova-compute[75216]: WARNING nova.compute.manager [req-7f7a1487-32c1-46e2-b4f1-fe27329bd8f9 req-81fe5189-a4cd-4eb1-8df5-99ed01386b41 service nova] [instance: 8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa] Received unexpected event network-vif-plugged-0f86c64c-3da6-44d9-8c74-e276f2496f35 for instance with vm_state building and task_state spawning.
Nov 13 19:04:11 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:04:11 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:04:12 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:04:13 user nova-compute[75216]: DEBUG nova.compute.manager [None req-6168a2ee-86fa-4d0d-8aac-155d6833f392 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: 8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa] Instance event wait completed in 0 seconds for  {{(pid=75216) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 19:04:13 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-6168a2ee-86fa-4d0d-8aac-155d6833f392 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: 8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa] Guest created on hypervisor {{(pid=75216) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 19:04:13 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa] Instance spawned successfully.
Nov 13 19:04:13 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-6168a2ee-86fa-4d0d-8aac-155d6833f392 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: 8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 19:04:13 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-6168a2ee-86fa-4d0d-8aac-155d6833f392 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: 8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa] Found default for hw_cdrom_bus of ide {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 19:04:13 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-6168a2ee-86fa-4d0d-8aac-155d6833f392 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: 8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa] Found default for hw_disk_bus of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 19:04:13 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-6168a2ee-86fa-4d0d-8aac-155d6833f392 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: 8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa] Found default for hw_input_bus of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 19:04:13 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-6168a2ee-86fa-4d0d-8aac-155d6833f392 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: 8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa] Found default for hw_pointer_model of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 19:04:13 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-6168a2ee-86fa-4d0d-8aac-155d6833f392 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: 8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa] Found default for hw_video_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 19:04:13 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-6168a2ee-86fa-4d0d-8aac-155d6833f392 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: 8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa] Found default for hw_vif_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 19:04:13 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:04:13 user nova-compute[75216]: INFO nova.compute.manager [None req-6168a2ee-86fa-4d0d-8aac-155d6833f392 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: 8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa] Took 4.97 seconds to spawn the instance on the hypervisor.
Nov 13 19:04:13 user nova-compute[75216]: DEBUG nova.compute.manager [None req-6168a2ee-86fa-4d0d-8aac-155d6833f392 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: 8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa] Checking state {{(pid=75216) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 19:04:13 user nova-compute[75216]: INFO nova.compute.manager [None req-6168a2ee-86fa-4d0d-8aac-155d6833f392 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: 8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa] Took 15.60 seconds to build instance.
Nov 13 19:04:13 user nova-compute[75216]: DEBUG nova.compute.manager [req-16954a96-5427-4b73-a9ac-fb6b9992844c req-35ac5e25-6c44-4d28-82e2-efa5b6d87fb9 service nova] [instance: 8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa] Received event network-vif-plugged-0f86c64c-3da6-44d9-8c74-e276f2496f35 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:04:13 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-16954a96-5427-4b73-a9ac-fb6b9992844c req-35ac5e25-6c44-4d28-82e2-efa5b6d87fb9 service nova] Acquiring lock "8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:04:13 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-16954a96-5427-4b73-a9ac-fb6b9992844c req-35ac5e25-6c44-4d28-82e2-efa5b6d87fb9 service nova] Lock "8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:04:13 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-16954a96-5427-4b73-a9ac-fb6b9992844c req-35ac5e25-6c44-4d28-82e2-efa5b6d87fb9 service nova] Lock "8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:04:13 user nova-compute[75216]: DEBUG nova.compute.manager [req-16954a96-5427-4b73-a9ac-fb6b9992844c req-35ac5e25-6c44-4d28-82e2-efa5b6d87fb9 service nova] [instance: 8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa] No waiting events found dispatching network-vif-plugged-0f86c64c-3da6-44d9-8c74-e276f2496f35 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 19:04:13 user nova-compute[75216]: WARNING nova.compute.manager [req-16954a96-5427-4b73-a9ac-fb6b9992844c req-35ac5e25-6c44-4d28-82e2-efa5b6d87fb9 service nova] [instance: 8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa] Received unexpected event network-vif-plugged-0f86c64c-3da6-44d9-8c74-e276f2496f35 for instance with vm_state active and task_state None.
Nov 13 19:04:13 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-6168a2ee-86fa-4d0d-8aac-155d6833f392 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Lock "8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.692s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:04:15 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:04:20 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:04:22 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-279bd331-668b-4b0e-9ab5-d4310224aa0d tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Acquiring lock "af8089f7-6dc3-4655-9369-2177dbd7bf4d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:04:22 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-279bd331-668b-4b0e-9ab5-d4310224aa0d tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Lock "af8089f7-6dc3-4655-9369-2177dbd7bf4d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:04:22 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-279bd331-668b-4b0e-9ab5-d4310224aa0d tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Acquiring lock "af8089f7-6dc3-4655-9369-2177dbd7bf4d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:04:22 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-279bd331-668b-4b0e-9ab5-d4310224aa0d tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Lock "af8089f7-6dc3-4655-9369-2177dbd7bf4d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:04:22 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-279bd331-668b-4b0e-9ab5-d4310224aa0d tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Lock "af8089f7-6dc3-4655-9369-2177dbd7bf4d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:04:22 user nova-compute[75216]: INFO nova.compute.manager [None req-279bd331-668b-4b0e-9ab5-d4310224aa0d tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] [instance: af8089f7-6dc3-4655-9369-2177dbd7bf4d] Terminating instance
Nov 13 19:04:22 user nova-compute[75216]: DEBUG nova.compute.manager [None req-279bd331-668b-4b0e-9ab5-d4310224aa0d tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] [instance: af8089f7-6dc3-4655-9369-2177dbd7bf4d] Start destroying the instance on the hypervisor. {{(pid=75216) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 19:04:22 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:04:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:04:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:04:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:04:23 user nova-compute[75216]: DEBUG nova.compute.manager [req-29a9ad79-6100-4b7d-96bb-dc89c5bf11be req-ba38121e-7bd6-4885-9fde-fa36424694d8 service nova] [instance: af8089f7-6dc3-4655-9369-2177dbd7bf4d] Received event network-vif-unplugged-c26beff8-370e-431e-9a8c-d31c4ec912ec {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:04:23 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-29a9ad79-6100-4b7d-96bb-dc89c5bf11be req-ba38121e-7bd6-4885-9fde-fa36424694d8 service nova] Acquiring lock "af8089f7-6dc3-4655-9369-2177dbd7bf4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:04:23 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-29a9ad79-6100-4b7d-96bb-dc89c5bf11be req-ba38121e-7bd6-4885-9fde-fa36424694d8 service nova] Lock "af8089f7-6dc3-4655-9369-2177dbd7bf4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:04:23 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-29a9ad79-6100-4b7d-96bb-dc89c5bf11be req-ba38121e-7bd6-4885-9fde-fa36424694d8 service nova] Lock "af8089f7-6dc3-4655-9369-2177dbd7bf4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:04:23 user nova-compute[75216]: DEBUG nova.compute.manager [req-29a9ad79-6100-4b7d-96bb-dc89c5bf11be req-ba38121e-7bd6-4885-9fde-fa36424694d8 service nova] [instance: af8089f7-6dc3-4655-9369-2177dbd7bf4d] No waiting events found dispatching network-vif-unplugged-c26beff8-370e-431e-9a8c-d31c4ec912ec {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 19:04:23 user nova-compute[75216]: DEBUG nova.compute.manager [req-29a9ad79-6100-4b7d-96bb-dc89c5bf11be req-ba38121e-7bd6-4885-9fde-fa36424694d8 service nova] [instance: af8089f7-6dc3-4655-9369-2177dbd7bf4d] Received event network-vif-unplugged-c26beff8-370e-431e-9a8c-d31c4ec912ec for instance with task_state deleting. {{(pid=75216) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 19:04:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:04:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:04:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:04:23 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: af8089f7-6dc3-4655-9369-2177dbd7bf4d] Instance destroyed successfully.
Nov 13 19:04:23 user nova-compute[75216]: DEBUG nova.objects.instance [None req-279bd331-668b-4b0e-9ab5-d4310224aa0d tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Lazy-loading 'resources' on Instance uuid af8089f7-6dc3-4655-9369-2177dbd7bf4d {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:04:23 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-279bd331-668b-4b0e-9ab5-d4310224aa0d tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T18:59:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-780279528',display_name='tempest-TestMinimumBasicScenario-server-780279528',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-780279528',id=27,image_ref='c1c8eeb9-2ea4-4665-94c5-b399df123710',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMkFC1l0t0GBOtzT2bLiJ8lAjyzCHTdr7Xj4oBWrTAaMd1//fCspfw4r2vuGqo9b1iSdtFSJATkMSuJELCx7MDHe2xx0PHl1FK/K0yjaXgUddzBQSnf3lRM5pnUKjvgUNg==',key_name='tempest-TestMinimumBasicScenario-1870399637',keypairs=<?>,launch_index=0,launched_at=2023-11-13T18:59:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='84d0223a97ff4ecab9bf4273e3e465a9',ramdisk_id='',reservation_id='r-902ox0es',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c1c8eeb9-2ea4-4665-94c5-b399df123710',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1197015828',owner_user_name='tempest-TestMinimumBasicScenario-1197015828-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T19:01:48Z,user_data=None,user_id='83cc10163cd04fffb40b36e6c0cdd484',uuid=af8089f7-6dc3-4655-9369-2177dbd7bf4d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c26beff8-370e-431e-9a8c-d31c4ec912ec", "address": "fa:16:3e:03:83:09", "network": {"id": "fea11c73-0074-4971-8b36-0aced430c730", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1420832282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84d0223a97ff4ecab9bf4273e3e465a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc26beff8-37", "ovs_interfaceid": "c26beff8-370e-431e-9a8c-d31c4ec912ec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 19:04:23 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-279bd331-668b-4b0e-9ab5-d4310224aa0d tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Converting VIF {"id": "c26beff8-370e-431e-9a8c-d31c4ec912ec", "address": "fa:16:3e:03:83:09", "network": {"id": "fea11c73-0074-4971-8b36-0aced430c730", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1420832282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84d0223a97ff4ecab9bf4273e3e465a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc26beff8-37", "ovs_interfaceid": "c26beff8-370e-431e-9a8c-d31c4ec912ec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 19:04:23 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-279bd331-668b-4b0e-9ab5-d4310224aa0d tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:03:83:09,bridge_name='br-int',has_traffic_filtering=True,id=c26beff8-370e-431e-9a8c-d31c4ec912ec,network=Network(fea11c73-0074-4971-8b36-0aced430c730),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc26beff8-37') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 19:04:23 user nova-compute[75216]: DEBUG os_vif [None req-279bd331-668b-4b0e-9ab5-d4310224aa0d tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:03:83:09,bridge_name='br-int',has_traffic_filtering=True,id=c26beff8-370e-431e-9a8c-d31c4ec912ec,network=Network(fea11c73-0074-4971-8b36-0aced430c730),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc26beff8-37') {{(pid=75216) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 19:04:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:04:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc26beff8-37, bridge=br-int, if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:04:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:04:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:04:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:04:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:04:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c78e97cc-7005-4b13-a276-fc179dd7dfe5) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:04:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:04:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:04:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:04:23 user nova-compute[75216]: INFO os_vif [None req-279bd331-668b-4b0e-9ab5-d4310224aa0d tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:03:83:09,bridge_name='br-int',has_traffic_filtering=True,id=c26beff8-370e-431e-9a8c-d31c4ec912ec,network=Network(fea11c73-0074-4971-8b36-0aced430c730),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc26beff8-37')
Nov 13 19:04:23 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-279bd331-668b-4b0e-9ab5-d4310224aa0d tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] [instance: af8089f7-6dc3-4655-9369-2177dbd7bf4d] Deleting instance files /opt/stack/data/nova/instances/af8089f7-6dc3-4655-9369-2177dbd7bf4d_del
Nov 13 19:04:23 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-279bd331-668b-4b0e-9ab5-d4310224aa0d tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] [instance: af8089f7-6dc3-4655-9369-2177dbd7bf4d] Deletion of /opt/stack/data/nova/instances/af8089f7-6dc3-4655-9369-2177dbd7bf4d_del complete
Nov 13 19:04:23 user nova-compute[75216]: INFO nova.compute.manager [None req-279bd331-668b-4b0e-9ab5-d4310224aa0d tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] [instance: af8089f7-6dc3-4655-9369-2177dbd7bf4d] Took 0.94 seconds to destroy the instance on the hypervisor.
Nov 13 19:04:23 user nova-compute[75216]: DEBUG oslo.service.loopingcall [None req-279bd331-668b-4b0e-9ab5-d4310224aa0d tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75216) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 19:04:23 user nova-compute[75216]: DEBUG nova.compute.manager [-] [instance: af8089f7-6dc3-4655-9369-2177dbd7bf4d] Deallocating network for instance {{(pid=75216) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 19:04:23 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: af8089f7-6dc3-4655-9369-2177dbd7bf4d] deallocate_for_instance() {{(pid=75216) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 19:04:24 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:04:24 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:04:24 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:04:24 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:04:24 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:04:24 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:04:24 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:04:24 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: af8089f7-6dc3-4655-9369-2177dbd7bf4d] Updating instance_info_cache with network_info: [] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:04:24 user nova-compute[75216]: INFO nova.compute.manager [-] [instance: af8089f7-6dc3-4655-9369-2177dbd7bf4d] Took 0.86 seconds to deallocate network for instance.
Nov 13 19:04:24 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-279bd331-668b-4b0e-9ab5-d4310224aa0d tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:04:24 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-279bd331-668b-4b0e-9ab5-d4310224aa0d tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:04:25 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-279bd331-668b-4b0e-9ab5-d4310224aa0d tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 19:04:25 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-279bd331-668b-4b0e-9ab5-d4310224aa0d tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 19:04:25 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-279bd331-668b-4b0e-9ab5-d4310224aa0d tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.307s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:04:25 user nova-compute[75216]: INFO nova.scheduler.client.report [None req-279bd331-668b-4b0e-9ab5-d4310224aa0d tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Deleted allocations for instance af8089f7-6dc3-4655-9369-2177dbd7bf4d
Nov 13 19:04:25 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-279bd331-668b-4b0e-9ab5-d4310224aa0d tempest-TestMinimumBasicScenario-1197015828 tempest-TestMinimumBasicScenario-1197015828-project-member] Lock "af8089f7-6dc3-4655-9369-2177dbd7bf4d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.322s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:04:25 user nova-compute[75216]: DEBUG nova.compute.manager [req-bae11a41-3240-4f8f-8c6b-c7281be078f2 req-21adc8be-f7b9-4c81-ad4b-992849bb8d16 service nova] [instance: af8089f7-6dc3-4655-9369-2177dbd7bf4d] Received event network-vif-plugged-c26beff8-370e-431e-9a8c-d31c4ec912ec {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:04:25 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-bae11a41-3240-4f8f-8c6b-c7281be078f2 req-21adc8be-f7b9-4c81-ad4b-992849bb8d16 service nova] Acquiring lock "af8089f7-6dc3-4655-9369-2177dbd7bf4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:04:25 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-bae11a41-3240-4f8f-8c6b-c7281be078f2 req-21adc8be-f7b9-4c81-ad4b-992849bb8d16 service nova] Lock "af8089f7-6dc3-4655-9369-2177dbd7bf4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:04:25 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-bae11a41-3240-4f8f-8c6b-c7281be078f2 req-21adc8be-f7b9-4c81-ad4b-992849bb8d16 service nova] Lock "af8089f7-6dc3-4655-9369-2177dbd7bf4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:04:25 user nova-compute[75216]: DEBUG nova.compute.manager [req-bae11a41-3240-4f8f-8c6b-c7281be078f2 req-21adc8be-f7b9-4c81-ad4b-992849bb8d16 service nova] [instance: af8089f7-6dc3-4655-9369-2177dbd7bf4d] No waiting events found dispatching network-vif-plugged-c26beff8-370e-431e-9a8c-d31c4ec912ec {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 19:04:25 user nova-compute[75216]: WARNING nova.compute.manager [req-bae11a41-3240-4f8f-8c6b-c7281be078f2 req-21adc8be-f7b9-4c81-ad4b-992849bb8d16 service nova] [instance: af8089f7-6dc3-4655-9369-2177dbd7bf4d] Received unexpected event network-vif-plugged-c26beff8-370e-431e-9a8c-d31c4ec912ec for instance with vm_state deleted and task_state None.
Nov 13 19:04:25 user nova-compute[75216]: DEBUG nova.compute.manager [req-bae11a41-3240-4f8f-8c6b-c7281be078f2 req-21adc8be-f7b9-4c81-ad4b-992849bb8d16 service nova] [instance: af8089f7-6dc3-4655-9369-2177dbd7bf4d] Received event network-vif-plugged-c26beff8-370e-431e-9a8c-d31c4ec912ec {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:04:25 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-bae11a41-3240-4f8f-8c6b-c7281be078f2 req-21adc8be-f7b9-4c81-ad4b-992849bb8d16 service nova] Acquiring lock "af8089f7-6dc3-4655-9369-2177dbd7bf4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:04:25 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-bae11a41-3240-4f8f-8c6b-c7281be078f2 req-21adc8be-f7b9-4c81-ad4b-992849bb8d16 service nova] Lock "af8089f7-6dc3-4655-9369-2177dbd7bf4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:04:25 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-bae11a41-3240-4f8f-8c6b-c7281be078f2 req-21adc8be-f7b9-4c81-ad4b-992849bb8d16 service nova] Lock "af8089f7-6dc3-4655-9369-2177dbd7bf4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:04:25 user nova-compute[75216]: DEBUG nova.compute.manager [req-bae11a41-3240-4f8f-8c6b-c7281be078f2 req-21adc8be-f7b9-4c81-ad4b-992849bb8d16 service nova] [instance: af8089f7-6dc3-4655-9369-2177dbd7bf4d] No waiting events found dispatching network-vif-plugged-c26beff8-370e-431e-9a8c-d31c4ec912ec {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 19:04:25 user nova-compute[75216]: WARNING nova.compute.manager [req-bae11a41-3240-4f8f-8c6b-c7281be078f2 req-21adc8be-f7b9-4c81-ad4b-992849bb8d16 service nova] [instance: af8089f7-6dc3-4655-9369-2177dbd7bf4d] Received unexpected event network-vif-plugged-c26beff8-370e-431e-9a8c-d31c4ec912ec for instance with vm_state deleted and task_state None.
Nov 13 19:04:25 user nova-compute[75216]: DEBUG nova.compute.manager [req-bae11a41-3240-4f8f-8c6b-c7281be078f2 req-21adc8be-f7b9-4c81-ad4b-992849bb8d16 service nova] [instance: af8089f7-6dc3-4655-9369-2177dbd7bf4d] Received event network-vif-plugged-c26beff8-370e-431e-9a8c-d31c4ec912ec {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:04:25 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-bae11a41-3240-4f8f-8c6b-c7281be078f2 req-21adc8be-f7b9-4c81-ad4b-992849bb8d16 service nova] Acquiring lock "af8089f7-6dc3-4655-9369-2177dbd7bf4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:04:25 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-bae11a41-3240-4f8f-8c6b-c7281be078f2 req-21adc8be-f7b9-4c81-ad4b-992849bb8d16 service nova] Lock "af8089f7-6dc3-4655-9369-2177dbd7bf4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:04:25 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-bae11a41-3240-4f8f-8c6b-c7281be078f2 req-21adc8be-f7b9-4c81-ad4b-992849bb8d16 service nova] Lock "af8089f7-6dc3-4655-9369-2177dbd7bf4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:04:25 user nova-compute[75216]: DEBUG nova.compute.manager [req-bae11a41-3240-4f8f-8c6b-c7281be078f2 req-21adc8be-f7b9-4c81-ad4b-992849bb8d16 service nova] [instance: af8089f7-6dc3-4655-9369-2177dbd7bf4d] No waiting events found dispatching network-vif-plugged-c26beff8-370e-431e-9a8c-d31c4ec912ec {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 19:04:25 user nova-compute[75216]: WARNING nova.compute.manager [req-bae11a41-3240-4f8f-8c6b-c7281be078f2 req-21adc8be-f7b9-4c81-ad4b-992849bb8d16 service nova] [instance: af8089f7-6dc3-4655-9369-2177dbd7bf4d] Received unexpected event network-vif-plugged-c26beff8-370e-431e-9a8c-d31c4ec912ec for instance with vm_state deleted and task_state None.
Nov 13 19:04:25 user nova-compute[75216]: DEBUG nova.compute.manager [req-bae11a41-3240-4f8f-8c6b-c7281be078f2 req-21adc8be-f7b9-4c81-ad4b-992849bb8d16 service nova] [instance: af8089f7-6dc3-4655-9369-2177dbd7bf4d] Received event network-vif-deleted-c26beff8-370e-431e-9a8c-d31c4ec912ec {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:04:27 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:04:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:04:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:04:29 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-df95bf28-63e7-4d51-b625-b25fc24785a4 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] Acquiring lock "884178b6-f98e-41fb-9f59-e41af82553b3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:04:29 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-df95bf28-63e7-4d51-b625-b25fc24785a4 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] Lock "884178b6-f98e-41fb-9f59-e41af82553b3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:04:29 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-df95bf28-63e7-4d51-b625-b25fc24785a4 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] Acquiring lock "884178b6-f98e-41fb-9f59-e41af82553b3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:04:29 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-df95bf28-63e7-4d51-b625-b25fc24785a4 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] Lock "884178b6-f98e-41fb-9f59-e41af82553b3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:04:29 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-df95bf28-63e7-4d51-b625-b25fc24785a4 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] Lock "884178b6-f98e-41fb-9f59-e41af82553b3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:04:29 user nova-compute[75216]: INFO nova.compute.manager [None req-df95bf28-63e7-4d51-b625-b25fc24785a4 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] [instance: 884178b6-f98e-41fb-9f59-e41af82553b3] Terminating instance
Nov 13 19:04:29 user nova-compute[75216]: DEBUG nova.compute.manager [None req-df95bf28-63e7-4d51-b625-b25fc24785a4 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] [instance: 884178b6-f98e-41fb-9f59-e41af82553b3] Start destroying the instance on the hypervisor. {{(pid=75216) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 19:04:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:04:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:04:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:04:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:04:29 user nova-compute[75216]: DEBUG nova.compute.manager [req-88c0a0cd-ae05-4acd-a028-3270d95b495c req-a69b9b48-30fb-434f-b71f-e64fdf750ffd service nova] [instance: 884178b6-f98e-41fb-9f59-e41af82553b3] Received event network-vif-unplugged-e18a9e5b-aa98-4ebb-bbd9-39be86d52170 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:04:29 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-88c0a0cd-ae05-4acd-a028-3270d95b495c req-a69b9b48-30fb-434f-b71f-e64fdf750ffd service nova] Acquiring lock "884178b6-f98e-41fb-9f59-e41af82553b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:04:29 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-88c0a0cd-ae05-4acd-a028-3270d95b495c req-a69b9b48-30fb-434f-b71f-e64fdf750ffd service nova] Lock "884178b6-f98e-41fb-9f59-e41af82553b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:04:29 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-88c0a0cd-ae05-4acd-a028-3270d95b495c req-a69b9b48-30fb-434f-b71f-e64fdf750ffd service nova] Lock "884178b6-f98e-41fb-9f59-e41af82553b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:04:29 user nova-compute[75216]: DEBUG nova.compute.manager [req-88c0a0cd-ae05-4acd-a028-3270d95b495c req-a69b9b48-30fb-434f-b71f-e64fdf750ffd service nova] [instance: 884178b6-f98e-41fb-9f59-e41af82553b3] No waiting events found dispatching network-vif-unplugged-e18a9e5b-aa98-4ebb-bbd9-39be86d52170 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 19:04:29 user nova-compute[75216]: DEBUG nova.compute.manager [req-88c0a0cd-ae05-4acd-a028-3270d95b495c req-a69b9b48-30fb-434f-b71f-e64fdf750ffd service nova] [instance: 884178b6-f98e-41fb-9f59-e41af82553b3] Received event network-vif-unplugged-e18a9e5b-aa98-4ebb-bbd9-39be86d52170 for instance with task_state deleting. {{(pid=75216) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 19:04:30 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 884178b6-f98e-41fb-9f59-e41af82553b3] Instance destroyed successfully.
Nov 13 19:04:30 user nova-compute[75216]: DEBUG nova.objects.instance [None req-df95bf28-63e7-4d51-b625-b25fc24785a4 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] Lazy-loading 'resources' on Instance uuid 884178b6-f98e-41fb-9f59-e41af82553b3 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:04:30 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-df95bf28-63e7-4d51-b625-b25fc24785a4 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T19:02:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-743482989',display_name='tempest-VolumesActionsTest-instance-743482989',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-743482989',id=30,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-13T19:02:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5c09fc0419834abe8a37c8817ab0a2e2',ramdisk_id='',reservation_id='r-baaf99hc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-26118612',owner_user_name='tempest-VolumesActionsTest-26118612-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T19:02:45Z,user_data=None,user_id='e24aca69921e43eaa7fea805c5d16e71',uuid=884178b6-f98e-41fb-9f59-e41af82553b3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e18a9e5b-aa98-4ebb-bbd9-39be86d52170", "address": "fa:16:3e:be:6c:56", "network": {"id": "02039e96-caac-4d3a-b397-29eb94376074", "bridge": "br-int", "label": "tempest-VolumesActionsTest-98786948-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c09fc0419834abe8a37c8817ab0a2e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape18a9e5b-aa", "ovs_interfaceid": "e18a9e5b-aa98-4ebb-bbd9-39be86d52170", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 19:04:30 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-df95bf28-63e7-4d51-b625-b25fc24785a4 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] Converting VIF {"id": "e18a9e5b-aa98-4ebb-bbd9-39be86d52170", "address": "fa:16:3e:be:6c:56", "network": {"id": "02039e96-caac-4d3a-b397-29eb94376074", "bridge": "br-int", "label": "tempest-VolumesActionsTest-98786948-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c09fc0419834abe8a37c8817ab0a2e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape18a9e5b-aa", "ovs_interfaceid": "e18a9e5b-aa98-4ebb-bbd9-39be86d52170", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 19:04:30 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-df95bf28-63e7-4d51-b625-b25fc24785a4 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:6c:56,bridge_name='br-int',has_traffic_filtering=True,id=e18a9e5b-aa98-4ebb-bbd9-39be86d52170,network=Network(02039e96-caac-4d3a-b397-29eb94376074),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape18a9e5b-aa') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 19:04:30 user nova-compute[75216]: DEBUG os_vif [None req-df95bf28-63e7-4d51-b625-b25fc24785a4 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:6c:56,bridge_name='br-int',has_traffic_filtering=True,id=e18a9e5b-aa98-4ebb-bbd9-39be86d52170,network=Network(02039e96-caac-4d3a-b397-29eb94376074),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape18a9e5b-aa') {{(pid=75216) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 19:04:30 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:04:30 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape18a9e5b-aa, bridge=br-int, if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:04:30 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:04:30 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:04:30 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:04:30 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:04:30 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d0264adf-7fa5-41ac-b848-d4aaf7d2a80b) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:04:30 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:04:30 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:04:30 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:04:30 user nova-compute[75216]: INFO os_vif [None req-df95bf28-63e7-4d51-b625-b25fc24785a4 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:6c:56,bridge_name='br-int',has_traffic_filtering=True,id=e18a9e5b-aa98-4ebb-bbd9-39be86d52170,network=Network(02039e96-caac-4d3a-b397-29eb94376074),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape18a9e5b-aa')
Nov 13 19:04:30 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-df95bf28-63e7-4d51-b625-b25fc24785a4 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] [instance: 884178b6-f98e-41fb-9f59-e41af82553b3] Deleting instance files /opt/stack/data/nova/instances/884178b6-f98e-41fb-9f59-e41af82553b3_del
Nov 13 19:04:30 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-df95bf28-63e7-4d51-b625-b25fc24785a4 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] [instance: 884178b6-f98e-41fb-9f59-e41af82553b3] Deletion of /opt/stack/data/nova/instances/884178b6-f98e-41fb-9f59-e41af82553b3_del complete
Nov 13 19:04:30 user nova-compute[75216]: INFO nova.compute.manager [None req-df95bf28-63e7-4d51-b625-b25fc24785a4 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] [instance: 884178b6-f98e-41fb-9f59-e41af82553b3] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 13 19:04:30 user nova-compute[75216]: DEBUG oslo.service.loopingcall [None req-df95bf28-63e7-4d51-b625-b25fc24785a4 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75216) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 19:04:30 user nova-compute[75216]: DEBUG nova.compute.manager [-] [instance: 884178b6-f98e-41fb-9f59-e41af82553b3] Deallocating network for instance {{(pid=75216) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 19:04:30 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: 884178b6-f98e-41fb-9f59-e41af82553b3] deallocate_for_instance() {{(pid=75216) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 19:04:30 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: 884178b6-f98e-41fb-9f59-e41af82553b3] Updating instance_info_cache with network_info: [] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:04:30 user nova-compute[75216]: INFO nova.compute.manager [-] [instance: 884178b6-f98e-41fb-9f59-e41af82553b3] Took 0.50 seconds to deallocate network for instance.
Nov 13 19:04:30 user nova-compute[75216]: DEBUG nova.compute.manager [req-0dff3e81-42fa-4e29-945a-2bf7bd800963 req-9abd60b2-65b4-4aa1-8bbf-f98247486544 service nova] [instance: 884178b6-f98e-41fb-9f59-e41af82553b3] Received event network-vif-deleted-e18a9e5b-aa98-4ebb-bbd9-39be86d52170 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:04:30 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-df95bf28-63e7-4d51-b625-b25fc24785a4 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:04:30 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-df95bf28-63e7-4d51-b625-b25fc24785a4 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:04:31 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-df95bf28-63e7-4d51-b625-b25fc24785a4 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 19:04:31 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-df95bf28-63e7-4d51-b625-b25fc24785a4 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 19:04:31 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-df95bf28-63e7-4d51-b625-b25fc24785a4 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.331s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:04:31 user nova-compute[75216]: INFO nova.scheduler.client.report [None req-df95bf28-63e7-4d51-b625-b25fc24785a4 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] Deleted allocations for instance 884178b6-f98e-41fb-9f59-e41af82553b3
Nov 13 19:04:31 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-df95bf28-63e7-4d51-b625-b25fc24785a4 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] Lock "884178b6-f98e-41fb-9f59-e41af82553b3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.964s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:04:31 user nova-compute[75216]: DEBUG nova.compute.manager [req-4070d19c-5ae6-4624-8226-8cc35cd982dc req-30d79579-7ed8-46af-a9d7-866292f4eda1 service nova] [instance: 884178b6-f98e-41fb-9f59-e41af82553b3] Received event network-vif-plugged-e18a9e5b-aa98-4ebb-bbd9-39be86d52170 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:04:31 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-4070d19c-5ae6-4624-8226-8cc35cd982dc req-30d79579-7ed8-46af-a9d7-866292f4eda1 service nova] Acquiring lock "884178b6-f98e-41fb-9f59-e41af82553b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:04:31 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-4070d19c-5ae6-4624-8226-8cc35cd982dc req-30d79579-7ed8-46af-a9d7-866292f4eda1 service nova] Lock "884178b6-f98e-41fb-9f59-e41af82553b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:04:31 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-4070d19c-5ae6-4624-8226-8cc35cd982dc req-30d79579-7ed8-46af-a9d7-866292f4eda1 service nova] Lock "884178b6-f98e-41fb-9f59-e41af82553b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:04:31 user nova-compute[75216]: DEBUG nova.compute.manager [req-4070d19c-5ae6-4624-8226-8cc35cd982dc req-30d79579-7ed8-46af-a9d7-866292f4eda1 service nova] [instance: 884178b6-f98e-41fb-9f59-e41af82553b3] No waiting events found dispatching network-vif-plugged-e18a9e5b-aa98-4ebb-bbd9-39be86d52170 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 19:04:31 user nova-compute[75216]: WARNING nova.compute.manager [req-4070d19c-5ae6-4624-8226-8cc35cd982dc req-30d79579-7ed8-46af-a9d7-866292f4eda1 service nova] [instance: 884178b6-f98e-41fb-9f59-e41af82553b3] Received unexpected event network-vif-plugged-e18a9e5b-aa98-4ebb-bbd9-39be86d52170 for instance with vm_state deleted and task_state None.
Nov 13 19:04:33 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:04:35 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:04:38 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:04:40 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:04:43 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:04:45 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:04:48 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:04:50 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:04:55 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:04:57 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:04:57 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:04:57 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:04:58 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:04:59 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:04:59 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75216) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 19:05:00 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:05:00 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:05:00 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75216) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 19:05:00 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 19:05:00 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 19:05:00 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:05:00 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:05:02 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:05:02 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Starting heal instance info cache {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 19:05:02 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "refresh_cache-1e5f1164-a15e-40cf-b7bc-5aeb404a1216" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 19:05:02 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquired lock "refresh_cache-1e5f1164-a15e-40cf-b7bc-5aeb404a1216" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 19:05:02 user nova-compute[75216]: DEBUG nova.network.neutron [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: 1e5f1164-a15e-40cf-b7bc-5aeb404a1216] Forcefully refreshing network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 19:05:03 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e3de7dfa-3125-4448-a4b5-f764762d942d tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Acquiring lock "71134725-e6cc-4426-b2c2-5be4991c53f7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:05:03 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e3de7dfa-3125-4448-a4b5-f764762d942d tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Lock "71134725-e6cc-4426-b2c2-5be4991c53f7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:05:03 user nova-compute[75216]: INFO nova.compute.manager [None req-e3de7dfa-3125-4448-a4b5-f764762d942d tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] [instance: 71134725-e6cc-4426-b2c2-5be4991c53f7] Detaching volume 3e8fd410-a0f1-42e1-a536-cd6112122746
Nov 13 19:05:03 user nova-compute[75216]: INFO nova.virt.block_device [None req-e3de7dfa-3125-4448-a4b5-f764762d942d tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] [instance: 71134725-e6cc-4426-b2c2-5be4991c53f7] Attempting to driver detach volume 3e8fd410-a0f1-42e1-a536-cd6112122746 from mountpoint /dev/vdc
Nov 13 19:05:03 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-e3de7dfa-3125-4448-a4b5-f764762d942d tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Attempting to detach device vdc from instance 71134725-e6cc-4426-b2c2-5be4991c53f7 from the persistent domain config. {{(pid=75216) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 13 19:05:03 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-e3de7dfa-3125-4448-a4b5-f764762d942d tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 19:05:03 user nova-compute[75216]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 19:05:03 user nova-compute[75216]:   <source dev="/dev/sdd"/>
Nov 13 19:05:03 user nova-compute[75216]:   <target dev="vdc" bus="virtio"/>
Nov 13 19:05:03 user nova-compute[75216]:   <serial>3e8fd410-a0f1-42e1-a536-cd6112122746</serial>
Nov 13 19:05:03 user nova-compute[75216]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 13 19:05:03 user nova-compute[75216]: </disk>
Nov 13 19:05:03 user nova-compute[75216]:  {{(pid=75216) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 19:05:03 user nova-compute[75216]: DEBUG nova.network.neutron [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: 1e5f1164-a15e-40cf-b7bc-5aeb404a1216] Updating instance_info_cache with network_info: [{"id": "96dfdc95-6a8e-43f3-8d7c-5b4f78a8f134", "address": "fa:16:3e:19:0b:3a", "network": {"id": "f8b821ef-8fae-42b9-9055-a9ea7be955ab", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-50594548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "903397a6c0474cfd8bd1a4fb338528aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96dfdc95-6a", "ovs_interfaceid": "96dfdc95-6a8e-43f3-8d7c-5b4f78a8f134", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:05:03 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-e3de7dfa-3125-4448-a4b5-f764762d942d tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Successfully detached device vdc from instance 71134725-e6cc-4426-b2c2-5be4991c53f7 from the persistent domain config.
Nov 13 19:05:03 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-e3de7dfa-3125-4448-a4b5-f764762d942d tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 71134725-e6cc-4426-b2c2-5be4991c53f7 from the live domain config. {{(pid=75216) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 13 19:05:03 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-e3de7dfa-3125-4448-a4b5-f764762d942d tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 19:05:03 user nova-compute[75216]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 19:05:03 user nova-compute[75216]:   <source dev="/dev/sdd"/>
Nov 13 19:05:03 user nova-compute[75216]:   <target dev="vdc" bus="virtio"/>
Nov 13 19:05:03 user nova-compute[75216]:   <serial>3e8fd410-a0f1-42e1-a536-cd6112122746</serial>
Nov 13 19:05:03 user nova-compute[75216]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 13 19:05:03 user nova-compute[75216]: </disk>
Nov 13 19:05:03 user nova-compute[75216]:  {{(pid=75216) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 19:05:03 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Releasing lock "refresh_cache-1e5f1164-a15e-40cf-b7bc-5aeb404a1216" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 19:05:03 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: 1e5f1164-a15e-40cf-b7bc-5aeb404a1216] Updated the network info_cache for instance {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 19:05:03 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:05:03 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:05:03 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:05:03 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:05:03 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:05:03 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Auditing locally available compute resources for user (node: user) {{(pid=75216) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 19:05:03 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-e3de7dfa-3125-4448-a4b5-f764762d942d tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 71134725-e6cc-4426-b2c2-5be4991c53f7 {{(pid=75216) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 13 19:05:03 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 19:05:03 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 19:05:03 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b752173-e573-426e-b9f1-bff92a4c2b55/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:05:03 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b752173-e573-426e-b9f1-bff92a4c2b55/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:05:03 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b752173-e573-426e-b9f1-bff92a4c2b55/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:05:03 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:05:04 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b752173-e573-426e-b9f1-bff92a4c2b55/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:05:04 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 19:05:04 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:05:04 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:05:04 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:05:04 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:05:04 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71134725-e6cc-4426-b2c2-5be4991c53f7/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:05:04 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71134725-e6cc-4426-b2c2-5be4991c53f7/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:05:04 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71134725-e6cc-4426-b2c2-5be4991c53f7/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:05:04 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71134725-e6cc-4426-b2c2-5be4991c53f7/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:05:04 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c18c0ad-60e5-4ef2-97f2-b7008e89ac78/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:05:04 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c18c0ad-60e5-4ef2-97f2-b7008e89ac78/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:05:04 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c18c0ad-60e5-4ef2-97f2-b7008e89ac78/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:05:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c18c0ad-60e5-4ef2-97f2-b7008e89ac78/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:05:05 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:05:05 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 19:05:05 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 19:05:05 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Hypervisor/Node resource view: name=user free_ram=8393MB free_disk=25.272727966308594GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75216) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 19:05:05 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:05:05 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:05:05 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 19:05:05 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance 1e5f1164-a15e-40cf-b7bc-5aeb404a1216 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 19:05:05 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance 5c18c0ad-60e5-4ef2-97f2-b7008e89ac78 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 19:05:05 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance 7b752173-e573-426e-b9f1-bff92a4c2b55 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 19:05:05 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance 71134725-e6cc-4426-b2c2-5be4991c53f7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 19:05:05 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance 8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 19:05:05 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 19:05:05 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 19:05:05 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 19:05:05 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 19:05:05 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Compute_service record updated for user:user {{(pid=75216) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 19:05:05 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.348s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:05:06 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:05:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:05:10 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:05:14 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:05:15 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:05:16 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:05:19 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:05:20 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:05:21 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-304fef8a-4e20-4e6e-bcaa-b3709f93e061 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] Acquiring lock "f21b2014-51e5-423d-baad-7ee2a7a74ca4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:05:21 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-304fef8a-4e20-4e6e-bcaa-b3709f93e061 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] Lock "f21b2014-51e5-423d-baad-7ee2a7a74ca4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:05:21 user nova-compute[75216]: DEBUG nova.compute.manager [None req-304fef8a-4e20-4e6e-bcaa-b3709f93e061 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] [instance: f21b2014-51e5-423d-baad-7ee2a7a74ca4] Starting instance... {{(pid=75216) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 19:05:21 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-304fef8a-4e20-4e6e-bcaa-b3709f93e061 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:05:21 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-304fef8a-4e20-4e6e-bcaa-b3709f93e061 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:05:21 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-304fef8a-4e20-4e6e-bcaa-b3709f93e061 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75216) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 19:05:21 user nova-compute[75216]: INFO nova.compute.claims [None req-304fef8a-4e20-4e6e-bcaa-b3709f93e061 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] [instance: f21b2014-51e5-423d-baad-7ee2a7a74ca4] Claim successful on node user
Nov 13 19:05:21 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-304fef8a-4e20-4e6e-bcaa-b3709f93e061 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 19:05:21 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-304fef8a-4e20-4e6e-bcaa-b3709f93e061 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 19:05:21 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-304fef8a-4e20-4e6e-bcaa-b3709f93e061 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.309s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:05:21 user nova-compute[75216]: DEBUG nova.compute.manager [None req-304fef8a-4e20-4e6e-bcaa-b3709f93e061 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] [instance: f21b2014-51e5-423d-baad-7ee2a7a74ca4] Start building networks asynchronously for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 19:05:21 user nova-compute[75216]: DEBUG nova.compute.manager [None req-304fef8a-4e20-4e6e-bcaa-b3709f93e061 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] [instance: f21b2014-51e5-423d-baad-7ee2a7a74ca4] Allocating IP information in the background. {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 19:05:21 user nova-compute[75216]: DEBUG nova.network.neutron [None req-304fef8a-4e20-4e6e-bcaa-b3709f93e061 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] [instance: f21b2014-51e5-423d-baad-7ee2a7a74ca4] allocate_for_instance() {{(pid=75216) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 19:05:21 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-304fef8a-4e20-4e6e-bcaa-b3709f93e061 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] [instance: f21b2014-51e5-423d-baad-7ee2a7a74ca4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 19:05:21 user nova-compute[75216]: DEBUG nova.compute.manager [None req-304fef8a-4e20-4e6e-bcaa-b3709f93e061 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] [instance: f21b2014-51e5-423d-baad-7ee2a7a74ca4] Start building block device mappings for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 19:05:21 user nova-compute[75216]: DEBUG nova.policy [None req-304fef8a-4e20-4e6e-bcaa-b3709f93e061 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e24aca69921e43eaa7fea805c5d16e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c09fc0419834abe8a37c8817ab0a2e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75216) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 19:05:21 user nova-compute[75216]: DEBUG nova.compute.manager [None req-304fef8a-4e20-4e6e-bcaa-b3709f93e061 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] [instance: f21b2014-51e5-423d-baad-7ee2a7a74ca4] Start spawning the instance on the hypervisor. {{(pid=75216) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 19:05:21 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-304fef8a-4e20-4e6e-bcaa-b3709f93e061 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] [instance: f21b2014-51e5-423d-baad-7ee2a7a74ca4] Creating instance directory {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 19:05:21 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-304fef8a-4e20-4e6e-bcaa-b3709f93e061 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] [instance: f21b2014-51e5-423d-baad-7ee2a7a74ca4] Creating image(s)
Nov 13 19:05:21 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-304fef8a-4e20-4e6e-bcaa-b3709f93e061 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] Acquiring lock "/opt/stack/data/nova/instances/f21b2014-51e5-423d-baad-7ee2a7a74ca4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:05:21 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-304fef8a-4e20-4e6e-bcaa-b3709f93e061 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] Lock "/opt/stack/data/nova/instances/f21b2014-51e5-423d-baad-7ee2a7a74ca4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:05:21 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-304fef8a-4e20-4e6e-bcaa-b3709f93e061 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] Lock "/opt/stack/data/nova/instances/f21b2014-51e5-423d-baad-7ee2a7a74ca4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:05:21 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-304fef8a-4e20-4e6e-bcaa-b3709f93e061 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:05:22 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-304fef8a-4e20-4e6e-bcaa-b3709f93e061 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json" returned: 0 in 0.197s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:05:22 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-304fef8a-4e20-4e6e-bcaa-b3709f93e061 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] Acquiring lock "88c50a45bec9d6b0427462b3242b9b8e5f49c2b6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:05:22 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-304fef8a-4e20-4e6e-bcaa-b3709f93e061 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] Lock "88c50a45bec9d6b0427462b3242b9b8e5f49c2b6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:05:22 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-304fef8a-4e20-4e6e-bcaa-b3709f93e061 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:05:22 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-304fef8a-4e20-4e6e-bcaa-b3709f93e061 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json" returned: 0 in 0.177s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:05:22 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-304fef8a-4e20-4e6e-bcaa-b3709f93e061 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6,backing_fmt=raw /opt/stack/data/nova/instances/f21b2014-51e5-423d-baad-7ee2a7a74ca4/disk 1073741824 {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:05:22 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-304fef8a-4e20-4e6e-bcaa-b3709f93e061 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6,backing_fmt=raw /opt/stack/data/nova/instances/f21b2014-51e5-423d-baad-7ee2a7a74ca4/disk 1073741824" returned: 0 in 0.050s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:05:22 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-304fef8a-4e20-4e6e-bcaa-b3709f93e061 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] Lock "88c50a45bec9d6b0427462b3242b9b8e5f49c2b6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.235s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:05:22 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-304fef8a-4e20-4e6e-bcaa-b3709f93e061 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:05:22 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-304fef8a-4e20-4e6e-bcaa-b3709f93e061 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json" returned: 0 in 0.181s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:05:22 user nova-compute[75216]: DEBUG nova.virt.disk.api [None req-304fef8a-4e20-4e6e-bcaa-b3709f93e061 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f21b2014-51e5-423d-baad-7ee2a7a74ca4/disk. size=1073741824 {{(pid=75216) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 19:05:22 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-304fef8a-4e20-4e6e-bcaa-b3709f93e061 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f21b2014-51e5-423d-baad-7ee2a7a74ca4/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:05:22 user nova-compute[75216]: DEBUG nova.network.neutron [None req-304fef8a-4e20-4e6e-bcaa-b3709f93e061 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] [instance: f21b2014-51e5-423d-baad-7ee2a7a74ca4] Successfully created port: cb1d37f1-236d-4d0e-9097-243fae73908e {{(pid=75216) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 19:05:22 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-304fef8a-4e20-4e6e-bcaa-b3709f93e061 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f21b2014-51e5-423d-baad-7ee2a7a74ca4/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:05:22 user nova-compute[75216]: DEBUG nova.virt.disk.api [None req-304fef8a-4e20-4e6e-bcaa-b3709f93e061 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] Cannot resize image /opt/stack/data/nova/instances/f21b2014-51e5-423d-baad-7ee2a7a74ca4/disk to a smaller size. {{(pid=75216) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 19:05:22 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-304fef8a-4e20-4e6e-bcaa-b3709f93e061 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] [instance: f21b2014-51e5-423d-baad-7ee2a7a74ca4] Created local disks {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 19:05:22 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-304fef8a-4e20-4e6e-bcaa-b3709f93e061 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] [instance: f21b2014-51e5-423d-baad-7ee2a7a74ca4] Ensure instance console log exists: /opt/stack/data/nova/instances/f21b2014-51e5-423d-baad-7ee2a7a74ca4/console.log {{(pid=75216) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 19:05:22 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-304fef8a-4e20-4e6e-bcaa-b3709f93e061 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:05:22 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-304fef8a-4e20-4e6e-bcaa-b3709f93e061 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:05:22 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-304fef8a-4e20-4e6e-bcaa-b3709f93e061 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:05:23 user nova-compute[75216]: DEBUG nova.network.neutron [None req-304fef8a-4e20-4e6e-bcaa-b3709f93e061 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] [instance: f21b2014-51e5-423d-baad-7ee2a7a74ca4] Successfully updated port: cb1d37f1-236d-4d0e-9097-243fae73908e {{(pid=75216) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 19:05:23 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-304fef8a-4e20-4e6e-bcaa-b3709f93e061 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] Acquiring lock "refresh_cache-f21b2014-51e5-423d-baad-7ee2a7a74ca4" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 19:05:23 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-304fef8a-4e20-4e6e-bcaa-b3709f93e061 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] Acquired lock "refresh_cache-f21b2014-51e5-423d-baad-7ee2a7a74ca4" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 19:05:23 user nova-compute[75216]: DEBUG nova.network.neutron [None req-304fef8a-4e20-4e6e-bcaa-b3709f93e061 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] [instance: f21b2014-51e5-423d-baad-7ee2a7a74ca4] Building network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 19:05:23 user nova-compute[75216]: DEBUG nova.compute.manager [req-8b43d13f-d642-4c7b-939f-d3079b9d84ad req-04e2bdea-a82d-4ed8-a5b5-21778cc4e2cd service nova] [instance: f21b2014-51e5-423d-baad-7ee2a7a74ca4] Received event network-changed-cb1d37f1-236d-4d0e-9097-243fae73908e {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:05:23 user nova-compute[75216]: DEBUG nova.compute.manager [req-8b43d13f-d642-4c7b-939f-d3079b9d84ad req-04e2bdea-a82d-4ed8-a5b5-21778cc4e2cd service nova] [instance: f21b2014-51e5-423d-baad-7ee2a7a74ca4] Refreshing instance network info cache due to event network-changed-cb1d37f1-236d-4d0e-9097-243fae73908e. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 19:05:23 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-8b43d13f-d642-4c7b-939f-d3079b9d84ad req-04e2bdea-a82d-4ed8-a5b5-21778cc4e2cd service nova] Acquiring lock "refresh_cache-f21b2014-51e5-423d-baad-7ee2a7a74ca4" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 19:05:23 user nova-compute[75216]: DEBUG nova.network.neutron [None req-304fef8a-4e20-4e6e-bcaa-b3709f93e061 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] [instance: f21b2014-51e5-423d-baad-7ee2a7a74ca4] Instance cache missing network info. {{(pid=75216) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 19:05:23 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-e3de7dfa-3125-4448-a4b5-f764762d942d tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 71134725-e6cc-4426-b2c2-5be4991c53f7 is timed out.
Nov 13 19:05:23 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-e3de7dfa-3125-4448-a4b5-f764762d942d tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Successfully detached device vdc from instance 71134725-e6cc-4426-b2c2-5be4991c53f7 from the live domain config.
Nov 13 19:05:23 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e3de7dfa-3125-4448-a4b5-f764762d942d tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] [instance: 71134725-e6cc-4426-b2c2-5be4991c53f7] calling os-brick to detach iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 19:05:23 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3de7dfa-3125-4448-a4b5-f764762d942d tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3a8669e40>, {'target_iqn': 'iqn.2010-10.org.openstack:3e8fd410-a0f1-42e1-a536-cd6112122746', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RzvSGPHt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 19:05:23 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-e3de7dfa-3125-4448-a4b5-f764762d942d tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 19:05:23 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-e3de7dfa-3125-4448-a4b5-f764762d942d tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 19:05:23 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-e3de7dfa-3125-4448-a4b5-f764762d942d tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 19:05:23 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:05:23 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:05:23 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b0606e0-3f8e-4b50-8625-243afff6c157]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3e8fd410-a0f1-42e1-a536-cd6112122746\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3bda4ab6-9834-40ad-b9fc-88186d2ffceb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dce55498-5eed-4a20-a00b-3f98b1e93c4f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:05:23 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3de7dfa-3125-4448-a4b5-f764762d942d tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 19:05:23 user nova-compute[75216]: No targets found.
Nov 13 19:05:23 user nova-compute[75216]: iSNS:
Nov 13 19:05:23 user nova-compute[75216]: No targets found.
Nov 13 19:05:23 user nova-compute[75216]: STATIC:
Nov 13 19:05:23 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:3e8fd410-a0f1-42e1-a536-cd6112122746
Nov 13 19:05:23 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 19:05:23 user nova-compute[75216]:                 Iface Name: default
Nov 13 19:05:23 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:3bda4ab6-9834-40ad-b9fc-88186d2ffceb
Nov 13 19:05:23 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 19:05:23 user nova-compute[75216]:                 Iface Name: default
Nov 13 19:05:23 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1
Nov 13 19:05:23 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 19:05:23 user nova-compute[75216]:                 Iface Name: default
Nov 13 19:05:23 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:dce55498-5eed-4a20-a00b-3f98b1e93c4f
Nov 13 19:05:23 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 19:05:23 user nova-compute[75216]:                 Iface Name: default
Nov 13 19:05:23 user nova-compute[75216]: FIRMWARE:
Nov 13 19:05:23 user nova-compute[75216]: No targets found.
Nov 13 19:05:23 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 19:05:23 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3de7dfa-3125-4448-a4b5-f764762d942d tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 19:05:23 user nova-compute[75216]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 19:05:23 user nova-compute[75216]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75216) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 19:05:23 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3de7dfa-3125-4448-a4b5-f764762d942d tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3e8fd410-a0f1-42e1-a536-cd6112122746', 0)] {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 19:05:23 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:05:23 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:05:23 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[17774d7e-84a0-4730-8aa4-6f6b0ed49960]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3bda4ab6-9834-40ad-b9fc-88186d2ffceb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3e8fd410-a0f1-42e1-a536-cd6112122746\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dce55498-5eed-4a20-a00b-3f98b1e93c4f\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:05:23 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:05:23 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:05:23 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3802b4e-96ce-4eaf-8498-9b23dd987f92]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e8fd410-a0f1-42e1-a536-cd6112122746 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dce55498-5eed-4a20-a00b-3f98b1e93c4f (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bda4ab6-9834-40ad-b9fc-88186d2ffceb (non-flash)\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:05:23 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3de7dfa-3125-4448-a4b5-f764762d942d tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1 (non-flash)
Nov 13 19:05:23 user nova-compute[75216]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e8fd410-a0f1-42e1-a536-cd6112122746 (non-flash)
Nov 13 19:05:23 user nova-compute[75216]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dce55498-5eed-4a20-a00b-3f98b1e93c4f (non-flash)
Nov 13 19:05:23 user nova-compute[75216]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bda4ab6-9834-40ad-b9fc-88186d2ffceb (non-flash)
Nov 13 19:05:23 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 19:05:23 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3de7dfa-3125-4448-a4b5-f764762d942d tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1 (non-flash)
Nov 13 19:05:23 user nova-compute[75216]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e8fd410-a0f1-42e1-a536-cd6112122746 (non-flash)
Nov 13 19:05:23 user nova-compute[75216]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dce55498-5eed-4a20-a00b-3f98b1e93c4f (non-flash)
Nov 13 19:05:23 user nova-compute[75216]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bda4ab6-9834-40ad-b9fc-88186d2ffceb (non-flash)
Nov 13 19:05:23 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 19:05:23 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3de7dfa-3125-4448-a4b5-f764762d942d tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe3c8205e10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3e8fd410-a0f1-42e1-a536-cd6112122746'): ({'sdd'}, set())}) {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 19:05:23 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-e3de7dfa-3125-4448-a4b5-f764762d942d tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Removing single pathed devices sdd {{(pid=75216) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 19:05:23 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:05:23 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:05:23 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[9df8775f-e3c5-4e47-994c-bcb13d89c22b]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:05:23 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:05:23 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:05:23 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[8302e172-f18c-40fc-9ac6-9b9ec44f69e8]: (4, ('ok\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:05:23 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-e3de7dfa-3125-4448-a4b5-f764762d942d tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Flushing IO for device /dev/sdd {{(pid=75216) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 19:05:23 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:05:23 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:05:23 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[50532f8e-8c1c-4f4c-8e4a-15027b2e6836]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:05:23 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-e3de7dfa-3125-4448-a4b5-f764762d942d tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75216) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 19:05:23 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:05:23 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.035s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:05:23 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9fc44f9-840c-4dfc-92d8-b6a8d8028b16]: (4, ('1', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:05:23 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-e3de7dfa-3125-4448-a4b5-f764762d942d tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 19:05:23 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-e3de7dfa-3125-4448-a4b5-f764762d942d tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] SCSI volumes sdd have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 19:05:23 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3de7dfa-3125-4448-a4b5-f764762d942d tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3e8fd410-a0f1-42e1-a536-cd6112122746')] {{(pid=75216) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 19:05:23 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e8fd410-a0f1-42e1-a536-cd6112122746 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:05:23 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e8fd410-a0f1-42e1-a536-cd6112122746 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:05:23 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[270d6ace-9fb7-4c22-8221-066917c951ea]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:05:23 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3de7dfa-3125-4448-a4b5-f764762d942d tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:05:23 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e8fd410-a0f1-42e1-a536-cd6112122746 -p 172.16.0.220:3260 --logout {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:05:23 user nova-compute[75216]: DEBUG nova.network.neutron [None req-304fef8a-4e20-4e6e-bcaa-b3709f93e061 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] [instance: f21b2014-51e5-423d-baad-7ee2a7a74ca4] Updating instance_info_cache with network_info: [{"id": "cb1d37f1-236d-4d0e-9097-243fae73908e", "address": "fa:16:3e:2b:a7:2a", "network": {"id": "02039e96-caac-4d3a-b397-29eb94376074", "bridge": "br-int", "label": "tempest-VolumesActionsTest-98786948-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c09fc0419834abe8a37c8817ab0a2e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb1d37f1-23", "ovs_interfaceid": "cb1d37f1-236d-4d0e-9097-243fae73908e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:05:23 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-304fef8a-4e20-4e6e-bcaa-b3709f93e061 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] Releasing lock "refresh_cache-f21b2014-51e5-423d-baad-7ee2a7a74ca4" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 19:05:23 user nova-compute[75216]: DEBUG nova.compute.manager [None req-304fef8a-4e20-4e6e-bcaa-b3709f93e061 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] [instance: f21b2014-51e5-423d-baad-7ee2a7a74ca4] Instance network_info: |[{"id": "cb1d37f1-236d-4d0e-9097-243fae73908e", "address": "fa:16:3e:2b:a7:2a", "network": {"id": "02039e96-caac-4d3a-b397-29eb94376074", "bridge": "br-int", "label": "tempest-VolumesActionsTest-98786948-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c09fc0419834abe8a37c8817ab0a2e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb1d37f1-23", "ovs_interfaceid": "cb1d37f1-236d-4d0e-9097-243fae73908e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 19:05:23 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-8b43d13f-d642-4c7b-939f-d3079b9d84ad req-04e2bdea-a82d-4ed8-a5b5-21778cc4e2cd service nova] Acquired lock "refresh_cache-f21b2014-51e5-423d-baad-7ee2a7a74ca4" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 19:05:23 user nova-compute[75216]: DEBUG nova.network.neutron [req-8b43d13f-d642-4c7b-939f-d3079b9d84ad req-04e2bdea-a82d-4ed8-a5b5-21778cc4e2cd service nova] [instance: f21b2014-51e5-423d-baad-7ee2a7a74ca4] Refreshing network info cache for port cb1d37f1-236d-4d0e-9097-243fae73908e {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 19:05:23 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-304fef8a-4e20-4e6e-bcaa-b3709f93e061 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] [instance: f21b2014-51e5-423d-baad-7ee2a7a74ca4] Start _get_guest_xml network_info=[{"id": "cb1d37f1-236d-4d0e-9097-243fae73908e", "address": "fa:16:3e:2b:a7:2a", "network": {"id": "02039e96-caac-4d3a-b397-29eb94376074", "bridge": "br-int", "label": "tempest-VolumesActionsTest-98786948-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c09fc0419834abe8a37c8817ab0a2e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb1d37f1-23", "ovs_interfaceid": "cb1d37f1-236d-4d0e-9097-243fae73908e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T18:41:06Z,direct_url=<?>,disk_format='qcow2',id=77bcb5ba-8510-41ec-a88d-96097bb431de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c465b7c26ec44582b6d1b7169536ecc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T18:41:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'guest_format': None, 'boot_index': 0, 'image_id': '77bcb5ba-8510-41ec-a88d-96097bb431de'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 19:05:23 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-304fef8a-4e20-4e6e-bcaa-b3709f93e061 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 19:05:23 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-304fef8a-4e20-4e6e-bcaa-b3709f93e061 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 19:05:23 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e8fd410-a0f1-42e1-a536-cd6112122746 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:05:23 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[529da143-aea3-4661-9fb5-c31ee914b635]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:3e8fd410-a0f1-42e1-a536-cd6112122746, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:3e8fd410-a0f1-42e1-a536-cd6112122746, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:05:23 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3de7dfa-3125-4448-a4b5-f764762d942d tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:3e8fd410-a0f1-42e1-a536-cd6112122746, portal: 172.16.0.220,3260]
Nov 13 19:05:23 user nova-compute[75216]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:3e8fd410-a0f1-42e1-a536-cd6112122746, portal: 172.16.0.220,3260] successful.
Nov 13 19:05:23 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:05:23 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-304fef8a-4e20-4e6e-bcaa-b3709f93e061 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 19:05:23 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-304fef8a-4e20-4e6e-bcaa-b3709f93e061 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] CPU controller missing on host. {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 19:05:23 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e8fd410-a0f1-42e1-a536-cd6112122746 -p 172.16.0.220:3260 --op delete {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:05:23 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-304fef8a-4e20-4e6e-bcaa-b3709f93e061 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 19:05:23 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-304fef8a-4e20-4e6e-bcaa-b3709f93e061 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] CPU controller found on host. {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 19:05:23 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-304fef8a-4e20-4e6e-bcaa-b3709f93e061 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75216) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 19:05:23 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-304fef8a-4e20-4e6e-bcaa-b3709f93e061 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T18:40:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T18:41:06Z,direct_url=<?>,disk_format='qcow2',id=77bcb5ba-8510-41ec-a88d-96097bb431de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c465b7c26ec44582b6d1b7169536ecc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T18:41:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 19:05:23 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-304fef8a-4e20-4e6e-bcaa-b3709f93e061 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] Flavor limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 19:05:23 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-304fef8a-4e20-4e6e-bcaa-b3709f93e061 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] Image limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 19:05:23 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-304fef8a-4e20-4e6e-bcaa-b3709f93e061 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] Flavor pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 19:05:23 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-304fef8a-4e20-4e6e-bcaa-b3709f93e061 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] Image pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 19:05:23 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-304fef8a-4e20-4e6e-bcaa-b3709f93e061 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 19:05:23 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-304fef8a-4e20-4e6e-bcaa-b3709f93e061 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 19:05:23 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-304fef8a-4e20-4e6e-bcaa-b3709f93e061 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 19:05:23 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-304fef8a-4e20-4e6e-bcaa-b3709f93e061 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] Got 1 possible topologies {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 19:05:23 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-304fef8a-4e20-4e6e-bcaa-b3709f93e061 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 19:05:23 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-304fef8a-4e20-4e6e-bcaa-b3709f93e061 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 19:05:23 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-304fef8a-4e20-4e6e-bcaa-b3709f93e061 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T19:05:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1609213754',display_name='tempest-VolumesActionsTest-instance-1609213754',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1609213754',id=32,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5c09fc0419834abe8a37c8817ab0a2e2',ramdisk_id='',reservation_id='r-ewcbrzt1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-26118612',owner_user_name='tempest-VolumesActionsTest-26118612-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T19:05:22Z,user_data=None,user_id='e24aca69921e43eaa7fea805c5d16e71',uuid=f21b2014-51e5-423d-baad-7ee2a7a74ca4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cb1d37f1-236d-4d0e-9097-243fae73908e", "address": "fa:16:3e:2b:a7:2a", "network": {"id": "02039e96-caac-4d3a-b397-29eb94376074", "bridge": "br-int", "label": "tempest-VolumesActionsTest-98786948-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c09fc0419834abe8a37c8817ab0a2e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb1d37f1-23", "ovs_interfaceid": "cb1d37f1-236d-4d0e-9097-243fae73908e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75216) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 19:05:23 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-304fef8a-4e20-4e6e-bcaa-b3709f93e061 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] Converting VIF {"id": "cb1d37f1-236d-4d0e-9097-243fae73908e", "address": "fa:16:3e:2b:a7:2a", "network": {"id": "02039e96-caac-4d3a-b397-29eb94376074", "bridge": "br-int", "label": "tempest-VolumesActionsTest-98786948-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c09fc0419834abe8a37c8817ab0a2e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb1d37f1-23", "ovs_interfaceid": "cb1d37f1-236d-4d0e-9097-243fae73908e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 19:05:23 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-304fef8a-4e20-4e6e-bcaa-b3709f93e061 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2b:a7:2a,bridge_name='br-int',has_traffic_filtering=True,id=cb1d37f1-236d-4d0e-9097-243fae73908e,network=Network(02039e96-caac-4d3a-b397-29eb94376074),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb1d37f1-23') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 19:05:23 user nova-compute[75216]: DEBUG nova.objects.instance [None req-304fef8a-4e20-4e6e-bcaa-b3709f93e061 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] Lazy-loading 'pci_devices' on Instance uuid f21b2014-51e5-423d-baad-7ee2a7a74ca4 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:05:23 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e8fd410-a0f1-42e1-a536-cd6112122746 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:05:23 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[462b2484-e3ec-4ec8-a25c-a80af5d68f2a]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:05:23 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3de7dfa-3125-4448-a4b5-f764762d942d tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:05:23 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-e3de7dfa-3125-4448-a4b5-f764762d942d tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.357s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 19:05:23 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3de7dfa-3125-4448-a4b5-f764762d942d tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] <== disconnect_volume: return (358ms) None {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 19:05:23 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e3de7dfa-3125-4448-a4b5-f764762d942d tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] [instance: 71134725-e6cc-4426-b2c2-5be4991c53f7] Disconnected iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 19:05:23 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-304fef8a-4e20-4e6e-bcaa-b3709f93e061 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] [instance: f21b2014-51e5-423d-baad-7ee2a7a74ca4] End _get_guest_xml xml=<domain type="kvm">
Nov 13 19:05:23 user nova-compute[75216]:   <uuid>f21b2014-51e5-423d-baad-7ee2a7a74ca4</uuid>
Nov 13 19:05:23 user nova-compute[75216]:   <name>instance-00000020</name>
Nov 13 19:05:23 user nova-compute[75216]:   <memory>524288</memory>
Nov 13 19:05:23 user nova-compute[75216]:   <vcpu>1</vcpu>
Nov 13 19:05:23 user nova-compute[75216]:   <metadata>
Nov 13 19:05:23 user nova-compute[75216]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 19:05:23 user nova-compute[75216]:       <nova:package version="0.0.0"/>
Nov 13 19:05:23 user nova-compute[75216]:       <nova:name>tempest-VolumesActionsTest-instance-1609213754</nova:name>
Nov 13 19:05:23 user nova-compute[75216]:       <nova:creationTime>2023-11-13 19:05:23</nova:creationTime>
Nov 13 19:05:23 user nova-compute[75216]:       <nova:flavor name="m1.tiny">
Nov 13 19:05:23 user nova-compute[75216]:         <nova:memory>512</nova:memory>
Nov 13 19:05:23 user nova-compute[75216]:         <nova:disk>1</nova:disk>
Nov 13 19:05:23 user nova-compute[75216]:         <nova:swap>0</nova:swap>
Nov 13 19:05:23 user nova-compute[75216]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 19:05:23 user nova-compute[75216]:         <nova:vcpus>1</nova:vcpus>
Nov 13 19:05:23 user nova-compute[75216]:       </nova:flavor>
Nov 13 19:05:23 user nova-compute[75216]:       <nova:owner>
Nov 13 19:05:23 user nova-compute[75216]:         <nova:user uuid="e24aca69921e43eaa7fea805c5d16e71">tempest-VolumesActionsTest-26118612-project-member</nova:user>
Nov 13 19:05:23 user nova-compute[75216]:         <nova:project uuid="5c09fc0419834abe8a37c8817ab0a2e2">tempest-VolumesActionsTest-26118612</nova:project>
Nov 13 19:05:23 user nova-compute[75216]:       </nova:owner>
Nov 13 19:05:23 user nova-compute[75216]:       <nova:root type="image" uuid="77bcb5ba-8510-41ec-a88d-96097bb431de"/>
Nov 13 19:05:23 user nova-compute[75216]:       <nova:ports>
Nov 13 19:05:23 user nova-compute[75216]:         <nova:port uuid="cb1d37f1-236d-4d0e-9097-243fae73908e">
Nov 13 19:05:23 user nova-compute[75216]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 13 19:05:23 user nova-compute[75216]:         </nova:port>
Nov 13 19:05:23 user nova-compute[75216]:       </nova:ports>
Nov 13 19:05:23 user nova-compute[75216]:     </nova:instance>
Nov 13 19:05:23 user nova-compute[75216]:   </metadata>
Nov 13 19:05:23 user nova-compute[75216]:   <sysinfo type="smbios">
Nov 13 19:05:23 user nova-compute[75216]:     <system>
Nov 13 19:05:23 user nova-compute[75216]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 19:05:23 user nova-compute[75216]:       <entry name="product">OpenStack Nova</entry>
Nov 13 19:05:23 user nova-compute[75216]:       <entry name="version">0.0.0</entry>
Nov 13 19:05:23 user nova-compute[75216]:       <entry name="serial">f21b2014-51e5-423d-baad-7ee2a7a74ca4</entry>
Nov 13 19:05:23 user nova-compute[75216]:       <entry name="uuid">f21b2014-51e5-423d-baad-7ee2a7a74ca4</entry>
Nov 13 19:05:23 user nova-compute[75216]:       <entry name="family">Virtual Machine</entry>
Nov 13 19:05:23 user nova-compute[75216]:     </system>
Nov 13 19:05:23 user nova-compute[75216]:   </sysinfo>
Nov 13 19:05:23 user nova-compute[75216]:   <os>
Nov 13 19:05:23 user nova-compute[75216]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 19:05:23 user nova-compute[75216]:     <boot dev="hd"/>
Nov 13 19:05:23 user nova-compute[75216]:     <smbios mode="sysinfo"/>
Nov 13 19:05:23 user nova-compute[75216]:   </os>
Nov 13 19:05:23 user nova-compute[75216]:   <features>
Nov 13 19:05:23 user nova-compute[75216]:     <acpi/>
Nov 13 19:05:23 user nova-compute[75216]:     <apic/>
Nov 13 19:05:23 user nova-compute[75216]:     <vmcoreinfo/>
Nov 13 19:05:23 user nova-compute[75216]:   </features>
Nov 13 19:05:23 user nova-compute[75216]:   <clock offset="utc">
Nov 13 19:05:23 user nova-compute[75216]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 19:05:23 user nova-compute[75216]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 19:05:23 user nova-compute[75216]:     <timer name="hpet" present="no"/>
Nov 13 19:05:23 user nova-compute[75216]:   </clock>
Nov 13 19:05:23 user nova-compute[75216]:   <cpu mode="custom" match="exact">
Nov 13 19:05:23 user nova-compute[75216]:     <model>Nehalem</model>
Nov 13 19:05:23 user nova-compute[75216]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 19:05:23 user nova-compute[75216]:   </cpu>
Nov 13 19:05:23 user nova-compute[75216]:   <devices>
Nov 13 19:05:23 user nova-compute[75216]:     <disk type="file" device="disk">
Nov 13 19:05:23 user nova-compute[75216]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 19:05:23 user nova-compute[75216]:       <source file="/opt/stack/data/nova/instances/f21b2014-51e5-423d-baad-7ee2a7a74ca4/disk"/>
Nov 13 19:05:23 user nova-compute[75216]:       <target dev="vda" bus="virtio"/>
Nov 13 19:05:23 user nova-compute[75216]:     </disk>
Nov 13 19:05:23 user nova-compute[75216]:     <interface type="ethernet">
Nov 13 19:05:23 user nova-compute[75216]:       <mac address="fa:16:3e:2b:a7:2a"/>
Nov 13 19:05:23 user nova-compute[75216]:       <model type="virtio"/>
Nov 13 19:05:23 user nova-compute[75216]:       <mtu size="1442"/>
Nov 13 19:05:23 user nova-compute[75216]:       <target dev="tapcb1d37f1-23"/>
Nov 13 19:05:23 user nova-compute[75216]:     </interface>
Nov 13 19:05:23 user nova-compute[75216]:     <serial type="pty">
Nov 13 19:05:23 user nova-compute[75216]:       <log file="/opt/stack/data/nova/instances/f21b2014-51e5-423d-baad-7ee2a7a74ca4/console.log" append="off"/>
Nov 13 19:05:23 user nova-compute[75216]:     </serial>
Nov 13 19:05:23 user nova-compute[75216]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 19:05:23 user nova-compute[75216]:     <video>
Nov 13 19:05:23 user nova-compute[75216]:       <model type="virtio"/>
Nov 13 19:05:23 user nova-compute[75216]:     </video>
Nov 13 19:05:23 user nova-compute[75216]:     <rng model="virtio">
Nov 13 19:05:23 user nova-compute[75216]:       <backend model="random">/dev/urandom</backend>
Nov 13 19:05:23 user nova-compute[75216]:     </rng>
Nov 13 19:05:23 user nova-compute[75216]:     <controller type="usb" index="0" model="none"/>
Nov 13 19:05:23 user nova-compute[75216]:     <memballoon model="virtio">
Nov 13 19:05:23 user nova-compute[75216]:       <stats period="10"/>
Nov 13 19:05:23 user nova-compute[75216]:     </memballoon>
Nov 13 19:05:23 user nova-compute[75216]:   </devices>
Nov 13 19:05:23 user nova-compute[75216]: </domain>
Nov 13 19:05:23 user nova-compute[75216]:  {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 19:05:23 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-304fef8a-4e20-4e6e-bcaa-b3709f93e061 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T19:05:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1609213754',display_name='tempest-VolumesActionsTest-instance-1609213754',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1609213754',id=32,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5c09fc0419834abe8a37c8817ab0a2e2',ramdisk_id='',reservation_id='r-ewcbrzt1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-26118612',owner_user_name='tempest-VolumesActionsTest-26118612-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T19:05:22Z,user_data=None,user_id='e24aca69921e43eaa7fea805c5d16e71',uuid=f21b2014-51e5-423d-baad-7ee2a7a74ca4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cb1d37f1-236d-4d0e-9097-243fae73908e", "address": "fa:16:3e:2b:a7:2a", "network": {"id": "02039e96-caac-4d3a-b397-29eb94376074", "bridge": "br-int", "label": "tempest-VolumesActionsTest-98786948-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c09fc0419834abe8a37c8817ab0a2e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb1d37f1-23", "ovs_interfaceid": "cb1d37f1-236d-4d0e-9097-243fae73908e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 19:05:23 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-304fef8a-4e20-4e6e-bcaa-b3709f93e061 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] Converting VIF {"id": "cb1d37f1-236d-4d0e-9097-243fae73908e", "address": "fa:16:3e:2b:a7:2a", "network": {"id": "02039e96-caac-4d3a-b397-29eb94376074", "bridge": "br-int", "label": "tempest-VolumesActionsTest-98786948-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c09fc0419834abe8a37c8817ab0a2e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb1d37f1-23", "ovs_interfaceid": "cb1d37f1-236d-4d0e-9097-243fae73908e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 19:05:23 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-304fef8a-4e20-4e6e-bcaa-b3709f93e061 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2b:a7:2a,bridge_name='br-int',has_traffic_filtering=True,id=cb1d37f1-236d-4d0e-9097-243fae73908e,network=Network(02039e96-caac-4d3a-b397-29eb94376074),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb1d37f1-23') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 19:05:23 user nova-compute[75216]: DEBUG os_vif [None req-304fef8a-4e20-4e6e-bcaa-b3709f93e061 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:a7:2a,bridge_name='br-int',has_traffic_filtering=True,id=cb1d37f1-236d-4d0e-9097-243fae73908e,network=Network(02039e96-caac-4d3a-b397-29eb94376074),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb1d37f1-23') {{(pid=75216) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 19:05:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:05:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:05:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 19:05:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:05:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b3efa8d8-ee98-5297-936d-15fedb74b027', '_type': 'linux-noop'}}, row=False) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:05:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:05:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:05:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:05:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:05:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcb1d37f1-23, may_exist=True, interface_attrs={}) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:05:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcb1d37f1-23, col_values=(('qos', UUID('fd520ce2-5f3e-4675-bcaa-5be8322a94e5')),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:05:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcb1d37f1-23, col_values=(('external_ids', {'iface-id': 'cb1d37f1-236d-4d0e-9097-243fae73908e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2b:a7:2a', 'vm-uuid': 'f21b2014-51e5-423d-baad-7ee2a7a74ca4'}),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:05:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:05:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:05:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:05:24 user nova-compute[75216]: INFO os_vif [None req-304fef8a-4e20-4e6e-bcaa-b3709f93e061 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:a7:2a,bridge_name='br-int',has_traffic_filtering=True,id=cb1d37f1-236d-4d0e-9097-243fae73908e,network=Network(02039e96-caac-4d3a-b397-29eb94376074),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb1d37f1-23')
Nov 13 19:05:24 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-304fef8a-4e20-4e6e-bcaa-b3709f93e061 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 19:05:24 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-304fef8a-4e20-4e6e-bcaa-b3709f93e061 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] No VIF found with MAC fa:16:3e:2b:a7:2a, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 19:05:24 user nova-compute[75216]: DEBUG nova.network.neutron [req-8b43d13f-d642-4c7b-939f-d3079b9d84ad req-04e2bdea-a82d-4ed8-a5b5-21778cc4e2cd service nova] [instance: f21b2014-51e5-423d-baad-7ee2a7a74ca4] Updated VIF entry in instance network info cache for port cb1d37f1-236d-4d0e-9097-243fae73908e. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 19:05:24 user nova-compute[75216]: DEBUG nova.network.neutron [req-8b43d13f-d642-4c7b-939f-d3079b9d84ad req-04e2bdea-a82d-4ed8-a5b5-21778cc4e2cd service nova] [instance: f21b2014-51e5-423d-baad-7ee2a7a74ca4] Updating instance_info_cache with network_info: [{"id": "cb1d37f1-236d-4d0e-9097-243fae73908e", "address": "fa:16:3e:2b:a7:2a", "network": {"id": "02039e96-caac-4d3a-b397-29eb94376074", "bridge": "br-int", "label": "tempest-VolumesActionsTest-98786948-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c09fc0419834abe8a37c8817ab0a2e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb1d37f1-23", "ovs_interfaceid": "cb1d37f1-236d-4d0e-9097-243fae73908e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:05:24 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-8b43d13f-d642-4c7b-939f-d3079b9d84ad req-04e2bdea-a82d-4ed8-a5b5-21778cc4e2cd service nova] Releasing lock "refresh_cache-f21b2014-51e5-423d-baad-7ee2a7a74ca4" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 19:05:24 user nova-compute[75216]: DEBUG nova.objects.instance [None req-e3de7dfa-3125-4448-a4b5-f764762d942d tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Lazy-loading 'flavor' on Instance uuid 71134725-e6cc-4426-b2c2-5be4991c53f7 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:05:24 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e3de7dfa-3125-4448-a4b5-f764762d942d tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Lock "71134725-e6cc-4426-b2c2-5be4991c53f7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.711s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:05:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:05:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:05:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:05:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:05:25 user nova-compute[75216]: DEBUG nova.compute.manager [req-cd2061d1-e9c9-4f36-b322-c740544f9093 req-10b7a89e-e9df-4a2c-8b85-5aaf43101d7a service nova] [instance: f21b2014-51e5-423d-baad-7ee2a7a74ca4] Received event network-vif-plugged-cb1d37f1-236d-4d0e-9097-243fae73908e {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:05:25 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-cd2061d1-e9c9-4f36-b322-c740544f9093 req-10b7a89e-e9df-4a2c-8b85-5aaf43101d7a service nova] Acquiring lock "f21b2014-51e5-423d-baad-7ee2a7a74ca4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:05:25 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-cd2061d1-e9c9-4f36-b322-c740544f9093 req-10b7a89e-e9df-4a2c-8b85-5aaf43101d7a service nova] Lock "f21b2014-51e5-423d-baad-7ee2a7a74ca4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:05:25 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-cd2061d1-e9c9-4f36-b322-c740544f9093 req-10b7a89e-e9df-4a2c-8b85-5aaf43101d7a service nova] Lock "f21b2014-51e5-423d-baad-7ee2a7a74ca4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:05:25 user nova-compute[75216]: DEBUG nova.compute.manager [req-cd2061d1-e9c9-4f36-b322-c740544f9093 req-10b7a89e-e9df-4a2c-8b85-5aaf43101d7a service nova] [instance: f21b2014-51e5-423d-baad-7ee2a7a74ca4] No waiting events found dispatching network-vif-plugged-cb1d37f1-236d-4d0e-9097-243fae73908e {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 19:05:25 user nova-compute[75216]: WARNING nova.compute.manager [req-cd2061d1-e9c9-4f36-b322-c740544f9093 req-10b7a89e-e9df-4a2c-8b85-5aaf43101d7a service nova] [instance: f21b2014-51e5-423d-baad-7ee2a7a74ca4] Received unexpected event network-vif-plugged-cb1d37f1-236d-4d0e-9097-243fae73908e for instance with vm_state building and task_state spawning.
Nov 13 19:05:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:05:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:05:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:05:26 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:05:26 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:05:27 user nova-compute[75216]: DEBUG nova.compute.manager [None req-304fef8a-4e20-4e6e-bcaa-b3709f93e061 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] [instance: f21b2014-51e5-423d-baad-7ee2a7a74ca4] Instance event wait completed in 0 seconds for  {{(pid=75216) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 19:05:27 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-304fef8a-4e20-4e6e-bcaa-b3709f93e061 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] [instance: f21b2014-51e5-423d-baad-7ee2a7a74ca4] Guest created on hypervisor {{(pid=75216) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 19:05:27 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: f21b2014-51e5-423d-baad-7ee2a7a74ca4] Instance spawned successfully.
Nov 13 19:05:27 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-304fef8a-4e20-4e6e-bcaa-b3709f93e061 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] [instance: f21b2014-51e5-423d-baad-7ee2a7a74ca4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 19:05:27 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-304fef8a-4e20-4e6e-bcaa-b3709f93e061 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] [instance: f21b2014-51e5-423d-baad-7ee2a7a74ca4] Found default for hw_cdrom_bus of ide {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 19:05:27 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-304fef8a-4e20-4e6e-bcaa-b3709f93e061 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] [instance: f21b2014-51e5-423d-baad-7ee2a7a74ca4] Found default for hw_disk_bus of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 19:05:27 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-304fef8a-4e20-4e6e-bcaa-b3709f93e061 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] [instance: f21b2014-51e5-423d-baad-7ee2a7a74ca4] Found default for hw_input_bus of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 19:05:27 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-304fef8a-4e20-4e6e-bcaa-b3709f93e061 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] [instance: f21b2014-51e5-423d-baad-7ee2a7a74ca4] Found default for hw_pointer_model of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 19:05:27 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-304fef8a-4e20-4e6e-bcaa-b3709f93e061 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] [instance: f21b2014-51e5-423d-baad-7ee2a7a74ca4] Found default for hw_video_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 19:05:27 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-304fef8a-4e20-4e6e-bcaa-b3709f93e061 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] [instance: f21b2014-51e5-423d-baad-7ee2a7a74ca4] Found default for hw_vif_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 19:05:27 user nova-compute[75216]: INFO nova.compute.manager [None req-304fef8a-4e20-4e6e-bcaa-b3709f93e061 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] [instance: f21b2014-51e5-423d-baad-7ee2a7a74ca4] Took 5.59 seconds to spawn the instance on the hypervisor.
Nov 13 19:05:27 user nova-compute[75216]: DEBUG nova.compute.manager [None req-304fef8a-4e20-4e6e-bcaa-b3709f93e061 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] [instance: f21b2014-51e5-423d-baad-7ee2a7a74ca4] Checking state {{(pid=75216) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 19:05:27 user nova-compute[75216]: DEBUG nova.compute.manager [req-e1927966-ac58-4992-8498-ad9c0750c6e6 req-708e0945-18a6-4fa8-9700-94a236f89538 service nova] [instance: f21b2014-51e5-423d-baad-7ee2a7a74ca4] Received event network-vif-plugged-cb1d37f1-236d-4d0e-9097-243fae73908e {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:05:27 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-e1927966-ac58-4992-8498-ad9c0750c6e6 req-708e0945-18a6-4fa8-9700-94a236f89538 service nova] Acquiring lock "f21b2014-51e5-423d-baad-7ee2a7a74ca4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:05:27 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-e1927966-ac58-4992-8498-ad9c0750c6e6 req-708e0945-18a6-4fa8-9700-94a236f89538 service nova] Lock "f21b2014-51e5-423d-baad-7ee2a7a74ca4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:05:27 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-e1927966-ac58-4992-8498-ad9c0750c6e6 req-708e0945-18a6-4fa8-9700-94a236f89538 service nova] Lock "f21b2014-51e5-423d-baad-7ee2a7a74ca4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:05:27 user nova-compute[75216]: DEBUG nova.compute.manager [req-e1927966-ac58-4992-8498-ad9c0750c6e6 req-708e0945-18a6-4fa8-9700-94a236f89538 service nova] [instance: f21b2014-51e5-423d-baad-7ee2a7a74ca4] No waiting events found dispatching network-vif-plugged-cb1d37f1-236d-4d0e-9097-243fae73908e {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 19:05:27 user nova-compute[75216]: WARNING nova.compute.manager [req-e1927966-ac58-4992-8498-ad9c0750c6e6 req-708e0945-18a6-4fa8-9700-94a236f89538 service nova] [instance: f21b2014-51e5-423d-baad-7ee2a7a74ca4] Received unexpected event network-vif-plugged-cb1d37f1-236d-4d0e-9097-243fae73908e for instance with vm_state building and task_state spawning.
Nov 13 19:05:27 user nova-compute[75216]: INFO nova.compute.manager [None req-304fef8a-4e20-4e6e-bcaa-b3709f93e061 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] [instance: f21b2014-51e5-423d-baad-7ee2a7a74ca4] Took 6.25 seconds to build instance.
Nov 13 19:05:27 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-304fef8a-4e20-4e6e-bcaa-b3709f93e061 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] Lock "f21b2014-51e5-423d-baad-7ee2a7a74ca4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.391s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:05:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:05:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:05:32 user nova-compute[75216]: DEBUG nova.objects.instance [None req-6bbb95e1-982e-4199-a775-9476c62e8abe tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Lazy-loading 'flavor' on Instance uuid 7b752173-e573-426e-b9f1-bff92a4c2b55 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:05:32 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-6bbb95e1-982e-4199-a775-9476c62e8abe tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Acquiring lock "refresh_cache-7b752173-e573-426e-b9f1-bff92a4c2b55" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 19:05:32 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-6bbb95e1-982e-4199-a775-9476c62e8abe tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Acquired lock "refresh_cache-7b752173-e573-426e-b9f1-bff92a4c2b55" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 19:05:32 user nova-compute[75216]: DEBUG nova.network.neutron [None req-6bbb95e1-982e-4199-a775-9476c62e8abe tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] [instance: 7b752173-e573-426e-b9f1-bff92a4c2b55] Building network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 19:05:32 user nova-compute[75216]: DEBUG nova.objects.instance [None req-6bbb95e1-982e-4199-a775-9476c62e8abe tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Lazy-loading 'info_cache' on Instance uuid 7b752173-e573-426e-b9f1-bff92a4c2b55 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:05:32 user nova-compute[75216]: DEBUG nova.objects.base [None req-6bbb95e1-982e-4199-a775-9476c62e8abe tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Object Instance<7b752173-e573-426e-b9f1-bff92a4c2b55> lazy-loaded attributes: flavor,info_cache {{(pid=75216) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 19:05:32 user nova-compute[75216]: DEBUG nova.network.neutron [None req-6bbb95e1-982e-4199-a775-9476c62e8abe tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] [instance: 7b752173-e573-426e-b9f1-bff92a4c2b55] Updating instance_info_cache with network_info: [{"id": "60dd7b11-cfc3-4965-a429-8b2ac4cdfcf4", "address": "fa:16:3e:d6:af:c5", "network": {"id": "53bb01d5-31a4-47af-a931-ac12fe72b986", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-802892643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "095f5765865140d29b3ecf1ab3427037", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60dd7b11-cf", "ovs_interfaceid": "60dd7b11-cfc3-4965-a429-8b2ac4cdfcf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:05:32 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-6bbb95e1-982e-4199-a775-9476c62e8abe tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Releasing lock "refresh_cache-7b752173-e573-426e-b9f1-bff92a4c2b55" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 19:05:32 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 7b752173-e573-426e-b9f1-bff92a4c2b55] Instance destroyed successfully.
Nov 13 19:05:32 user nova-compute[75216]: DEBUG nova.objects.instance [None req-6bbb95e1-982e-4199-a775-9476c62e8abe tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Lazy-loading 'resources' on Instance uuid 7b752173-e573-426e-b9f1-bff92a4c2b55 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:05:33 user nova-compute[75216]: DEBUG nova.objects.base [None req-6bbb95e1-982e-4199-a775-9476c62e8abe tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Object Instance<7b752173-e573-426e-b9f1-bff92a4c2b55> lazy-loaded attributes: flavor,info_cache,resources {{(pid=75216) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 19:05:33 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-6bbb95e1-982e-4199-a775-9476c62e8abe tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T19:01:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1575865869',display_name='tempest-AttachVolumeTestJSON-server-1575865869',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1575865869',id=29,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGyAqjyHTP2pee8vnuPoZ/xrp7+kl5CQoOuvKblvMKUYsUK2V6arU3VG3TaEuVHw4+At5BuB9j/a8y246OC2wl7lhVwqAlIhS8np4Du9lzYGwetS0FdeZdBwrMXi36WP0A==',key_name='tempest-keypair-355509380',keypairs=<?>,launch_index=0,launched_at=2023-11-13T19:01:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='095f5765865140d29b3ecf1ab3427037',ramdisk_id='',reservation_id='r-0zzag7s9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-156429078',owner_user_name='tempest-AttachVolumeTestJSON-156429078-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T19:03:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a7501ee4141241f2abc4d6bfce2924d4',uuid=7b752173-e573-426e-b9f1-bff92a4c2b55,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "60dd7b11-cfc3-4965-a429-8b2ac4cdfcf4", "address": "fa:16:3e:d6:af:c5", "network": {"id": "53bb01d5-31a4-47af-a931-ac12fe72b986", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-802892643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "095f5765865140d29b3ecf1ab3427037", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60dd7b11-cf", "ovs_interfaceid": "60dd7b11-cfc3-4965-a429-8b2ac4cdfcf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 19:05:33 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-6bbb95e1-982e-4199-a775-9476c62e8abe tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Converting VIF {"id": "60dd7b11-cfc3-4965-a429-8b2ac4cdfcf4", "address": "fa:16:3e:d6:af:c5", "network": {"id": "53bb01d5-31a4-47af-a931-ac12fe72b986", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-802892643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "095f5765865140d29b3ecf1ab3427037", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60dd7b11-cf", "ovs_interfaceid": "60dd7b11-cfc3-4965-a429-8b2ac4cdfcf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 19:05:33 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-6bbb95e1-982e-4199-a775-9476c62e8abe tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:af:c5,bridge_name='br-int',has_traffic_filtering=True,id=60dd7b11-cfc3-4965-a429-8b2ac4cdfcf4,network=Network(53bb01d5-31a4-47af-a931-ac12fe72b986),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60dd7b11-cf') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 19:05:33 user nova-compute[75216]: DEBUG os_vif [None req-6bbb95e1-982e-4199-a775-9476c62e8abe tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:af:c5,bridge_name='br-int',has_traffic_filtering=True,id=60dd7b11-cfc3-4965-a429-8b2ac4cdfcf4,network=Network(53bb01d5-31a4-47af-a931-ac12fe72b986),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60dd7b11-cf') {{(pid=75216) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 19:05:33 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:05:33 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap60dd7b11-cf, bridge=br-int, if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:05:33 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:05:33 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:05:33 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:05:33 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=05aa490c-4e9e-4ed0-ae26-83687afd281e) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:05:33 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:05:33 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:05:33 user nova-compute[75216]: INFO os_vif [None req-6bbb95e1-982e-4199-a775-9476c62e8abe tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:af:c5,bridge_name='br-int',has_traffic_filtering=True,id=60dd7b11-cfc3-4965-a429-8b2ac4cdfcf4,network=Network(53bb01d5-31a4-47af-a931-ac12fe72b986),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60dd7b11-cf')
Nov 13 19:05:33 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6bbb95e1-982e-4199-a775-9476c62e8abe tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] [instance: 7b752173-e573-426e-b9f1-bff92a4c2b55] calling os-brick to detach iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 19:05:33 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bbb95e1-982e-4199-a775-9476c62e8abe tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3a8669e40>, {'target_iqn': 'iqn.2010-10.org.openstack:dce55498-5eed-4a20-a00b-3f98b1e93c4f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SdDJHbtF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 19:05:33 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-6bbb95e1-982e-4199-a775-9476c62e8abe tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 19:05:33 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-6bbb95e1-982e-4199-a775-9476c62e8abe tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 19:05:33 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-6bbb95e1-982e-4199-a775-9476c62e8abe tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 19:05:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:05:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:05:33 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[13b29b1d-f3a9-4825-b337-bdc67435c249]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3bda4ab6-9834-40ad-b9fc-88186d2ffceb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dce55498-5eed-4a20-a00b-3f98b1e93c4f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:05:33 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bbb95e1-982e-4199-a775-9476c62e8abe tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 19:05:33 user nova-compute[75216]: No targets found.
Nov 13 19:05:33 user nova-compute[75216]: iSNS:
Nov 13 19:05:33 user nova-compute[75216]: No targets found.
Nov 13 19:05:33 user nova-compute[75216]: STATIC:
Nov 13 19:05:33 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:3bda4ab6-9834-40ad-b9fc-88186d2ffceb
Nov 13 19:05:33 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 19:05:33 user nova-compute[75216]:                 Iface Name: default
Nov 13 19:05:33 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1
Nov 13 19:05:33 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 19:05:33 user nova-compute[75216]:                 Iface Name: default
Nov 13 19:05:33 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:dce55498-5eed-4a20-a00b-3f98b1e93c4f
Nov 13 19:05:33 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 19:05:33 user nova-compute[75216]:                 Iface Name: default
Nov 13 19:05:33 user nova-compute[75216]: FIRMWARE:
Nov 13 19:05:33 user nova-compute[75216]: No targets found.
Nov 13 19:05:33 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 19:05:33 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bbb95e1-982e-4199-a775-9476c62e8abe tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 19:05:33 user nova-compute[75216]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 19:05:33 user nova-compute[75216]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75216) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 19:05:33 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bbb95e1-982e-4199-a775-9476c62e8abe tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dce55498-5eed-4a20-a00b-3f98b1e93c4f', 0)] {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 19:05:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:05:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:05:33 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bbb5d37-5d4a-44be-9ca2-c63f67e79092]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3bda4ab6-9834-40ad-b9fc-88186d2ffceb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dce55498-5eed-4a20-a00b-3f98b1e93c4f\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:05:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:05:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:05:33 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb6602d2-7664-4158-b073-8c483f57dff9]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dce55498-5eed-4a20-a00b-3f98b1e93c4f (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bda4ab6-9834-40ad-b9fc-88186d2ffceb (non-flash)\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:05:33 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bbb95e1-982e-4199-a775-9476c62e8abe tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1 (non-flash)
Nov 13 19:05:33 user nova-compute[75216]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dce55498-5eed-4a20-a00b-3f98b1e93c4f (non-flash)
Nov 13 19:05:33 user nova-compute[75216]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bda4ab6-9834-40ad-b9fc-88186d2ffceb (non-flash)
Nov 13 19:05:33 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 19:05:33 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bbb95e1-982e-4199-a775-9476c62e8abe tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1 (non-flash)
Nov 13 19:05:33 user nova-compute[75216]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dce55498-5eed-4a20-a00b-3f98b1e93c4f (non-flash)
Nov 13 19:05:33 user nova-compute[75216]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bda4ab6-9834-40ad-b9fc-88186d2ffceb (non-flash)
Nov 13 19:05:33 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 19:05:33 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bbb95e1-982e-4199-a775-9476c62e8abe tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe3a879ec20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dce55498-5eed-4a20-a00b-3f98b1e93c4f'): ({'sde'}, set())}) {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 19:05:33 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-6bbb95e1-982e-4199-a775-9476c62e8abe tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Removing single pathed devices sde {{(pid=75216) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 19:05:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:05:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:05:33 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[6118aac8-819a-40de-95fa-bc7badc6f475]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:05:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:05:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:05:33 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[68f4198f-6feb-4a82-bc06-91ce21cc2591]: (4, ('ok\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:05:33 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-6bbb95e1-982e-4199-a775-9476c62e8abe tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Flushing IO for device /dev/sde {{(pid=75216) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 19:05:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:05:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:05:33 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aa14f99-9134-45d0-8402-c8456cedc690]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:05:33 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-6bbb95e1-982e-4199-a775-9476c62e8abe tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75216) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 19:05:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:05:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.041s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:05:33 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[599c9ba7-f7d8-413c-a5ea-5b33d1accb7c]: (4, ('1', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:05:33 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-6bbb95e1-982e-4199-a775-9476c62e8abe tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 19:05:33 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-6bbb95e1-982e-4199-a775-9476c62e8abe tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] SCSI volumes sde have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 19:05:33 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bbb95e1-982e-4199-a775-9476c62e8abe tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dce55498-5eed-4a20-a00b-3f98b1e93c4f')] {{(pid=75216) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 19:05:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dce55498-5eed-4a20-a00b-3f98b1e93c4f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:05:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dce55498-5eed-4a20-a00b-3f98b1e93c4f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:05:33 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[9101a4c3-3597-4465-b55d-47ff03498889]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:05:33 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bbb95e1-982e-4199-a775-9476c62e8abe tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:05:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dce55498-5eed-4a20-a00b-3f98b1e93c4f -p 172.16.0.220:3260 --logout {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:05:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dce55498-5eed-4a20-a00b-3f98b1e93c4f -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:05:33 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ad40ae3-27a2-4242-a043-82476c02e724]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:dce55498-5eed-4a20-a00b-3f98b1e93c4f, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:dce55498-5eed-4a20-a00b-3f98b1e93c4f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:05:33 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bbb95e1-982e-4199-a775-9476c62e8abe tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:dce55498-5eed-4a20-a00b-3f98b1e93c4f, portal: 172.16.0.220,3260]
Nov 13 19:05:33 user nova-compute[75216]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:dce55498-5eed-4a20-a00b-3f98b1e93c4f, portal: 172.16.0.220,3260] successful.
Nov 13 19:05:33 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:05:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dce55498-5eed-4a20-a00b-3f98b1e93c4f -p 172.16.0.220:3260 --op delete {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:05:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dce55498-5eed-4a20-a00b-3f98b1e93c4f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:05:33 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d7f9928-75e9-4deb-8872-20891210cbd9]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:05:33 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bbb95e1-982e-4199-a775-9476c62e8abe tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:05:33 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-6bbb95e1-982e-4199-a775-9476c62e8abe tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.309s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 19:05:33 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bbb95e1-982e-4199-a775-9476c62e8abe tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] <== disconnect_volume: return (310ms) None {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 19:05:33 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6bbb95e1-982e-4199-a775-9476c62e8abe tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] [instance: 7b752173-e573-426e-b9f1-bff92a4c2b55] Disconnected iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 19:05:33 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-6bbb95e1-982e-4199-a775-9476c62e8abe tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] [instance: 7b752173-e573-426e-b9f1-bff92a4c2b55] Start _get_guest_xml network_info=[{"id": "60dd7b11-cfc3-4965-a429-8b2ac4cdfcf4", "address": "fa:16:3e:d6:af:c5", "network": {"id": "53bb01d5-31a4-47af-a931-ac12fe72b986", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-802892643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "095f5765865140d29b3ecf1ab3427037", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60dd7b11-cf", "ovs_interfaceid": "60dd7b11-cfc3-4965-a429-8b2ac4cdfcf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=77bcb5ba-8510-41ec-a88d-96097bb431de,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'guest_format': None, 'boot_index': 0, 'image_id': '77bcb5ba-8510-41ec-a88d-96097bb431de'}], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:dce55498-5eed-4a20-a00b-3f98b1e93c4f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SdDJHbtF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': '7b752173-e573-426e-b9f1-bff92a4c2b55', 'attached_at': '', 'detached_at': '', 'volume_id': 'dce55498-5eed-4a20-a00b-3f98b1e93c4f', 'serial': 'dce55498-5eed-4a20-a00b-3f98b1e93c4f'}, 'attachment_id': '97800581-4642-4c3e-899a-4e7a09534170', 'guest_format': None, 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'boot_index': None, 'volume_type': None} {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 19:05:33 user nova-compute[75216]: DEBUG nova.objects.instance [None req-6bbb95e1-982e-4199-a775-9476c62e8abe tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Lazy-loading 'numa_topology' on Instance uuid 7b752173-e573-426e-b9f1-bff92a4c2b55 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:05:33 user nova-compute[75216]: DEBUG nova.objects.base [None req-6bbb95e1-982e-4199-a775-9476c62e8abe tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Object Instance<7b752173-e573-426e-b9f1-bff92a4c2b55> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=75216) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 19:05:33 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-6bbb95e1-982e-4199-a775-9476c62e8abe tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 19:05:33 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-6bbb95e1-982e-4199-a775-9476c62e8abe tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 19:05:33 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-6bbb95e1-982e-4199-a775-9476c62e8abe tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 19:05:33 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-6bbb95e1-982e-4199-a775-9476c62e8abe tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] CPU controller missing on host. {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 19:05:33 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-6bbb95e1-982e-4199-a775-9476c62e8abe tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 19:05:33 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-6bbb95e1-982e-4199-a775-9476c62e8abe tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] CPU controller found on host. {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 19:05:33 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-6bbb95e1-982e-4199-a775-9476c62e8abe tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75216) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 19:05:33 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-6bbb95e1-982e-4199-a775-9476c62e8abe tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T18:40:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=77bcb5ba-8510-41ec-a88d-96097bb431de,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 19:05:33 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-6bbb95e1-982e-4199-a775-9476c62e8abe tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Flavor limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 19:05:33 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-6bbb95e1-982e-4199-a775-9476c62e8abe tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Image limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 19:05:33 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-6bbb95e1-982e-4199-a775-9476c62e8abe tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Flavor pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 19:05:33 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-6bbb95e1-982e-4199-a775-9476c62e8abe tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Image pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 19:05:33 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-6bbb95e1-982e-4199-a775-9476c62e8abe tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 19:05:33 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-6bbb95e1-982e-4199-a775-9476c62e8abe tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 19:05:33 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-6bbb95e1-982e-4199-a775-9476c62e8abe tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 19:05:33 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-6bbb95e1-982e-4199-a775-9476c62e8abe tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Got 1 possible topologies {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 19:05:33 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-6bbb95e1-982e-4199-a775-9476c62e8abe tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 19:05:33 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-6bbb95e1-982e-4199-a775-9476c62e8abe tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 19:05:33 user nova-compute[75216]: DEBUG nova.objects.instance [None req-6bbb95e1-982e-4199-a775-9476c62e8abe tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Lazy-loading 'vcpu_model' on Instance uuid 7b752173-e573-426e-b9f1-bff92a4c2b55 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:05:33 user nova-compute[75216]: DEBUG nova.objects.base [None req-6bbb95e1-982e-4199-a775-9476c62e8abe tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Object Instance<7b752173-e573-426e-b9f1-bff92a4c2b55> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=75216) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 19:05:33 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6bbb95e1-982e-4199-a775-9476c62e8abe tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] [instance: 7b752173-e573-426e-b9f1-bff92a4c2b55] Calling os-brick to attach iSCSI Volume {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 19:05:33 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bbb95e1-982e-4199-a775-9476c62e8abe tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3a8669e40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:dce55498-5eed-4a20-a00b-3f98b1e93c4f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SdDJHbtF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 19:05:33 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-6bbb95e1-982e-4199-a775-9476c62e8abe tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 19:05:33 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-6bbb95e1-982e-4199-a775-9476c62e8abe tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 19:05:33 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-6bbb95e1-982e-4199-a775-9476c62e8abe tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 19:05:33 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-6bbb95e1-982e-4199-a775-9476c62e8abe tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 19:05:33 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-6bbb95e1-982e-4199-a775-9476c62e8abe tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dce55498-5eed-4a20-a00b-3f98b1e93c4f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 19:05:33 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-6bbb95e1-982e-4199-a775-9476c62e8abe tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dce55498-5eed-4a20-a00b-3f98b1e93c4f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 19:05:33 user nova-compute[75216]: INFO os_brick.initiator.connectors.iscsi [None req-6bbb95e1-982e-4199-a775-9476c62e8abe tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 19:05:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dce55498-5eed-4a20-a00b-3f98b1e93c4f -p 172.16.0.220:3260 {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:05:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dce55498-5eed-4a20-a00b-3f98b1e93c4f -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:05:33 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[875be96e-9fa0-4b47-a0f7-19d1481931a0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:05:33 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bbb95e1-982e-4199-a775-9476c62e8abe tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 19:05:33 user nova-compute[75216]:  {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:05:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dce55498-5eed-4a20-a00b-3f98b1e93c4f -p 172.16.0.220:3260 --interface default --op new {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:05:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dce55498-5eed-4a20-a00b-3f98b1e93c4f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:05:33 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[e09ea333-cb6c-4329-ad4d-b2d6896632bd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dce55498-5eed-4a20-a00b-3f98b1e93c4f] added\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:05:33 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bbb95e1-982e-4199-a775-9476c62e8abe tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dce55498-5eed-4a20-a00b-3f98b1e93c4f] added
Nov 13 19:05:33 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:05:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dce55498-5eed-4a20-a00b-3f98b1e93c4f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:05:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dce55498-5eed-4a20-a00b-3f98b1e93c4f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:05:33 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[11db09e3-36ad-4cb3-a5b7-33a84f17f2ac]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:05:33 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bbb95e1-982e-4199-a775-9476c62e8abe tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:05:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dce55498-5eed-4a20-a00b-3f98b1e93c4f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:05:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dce55498-5eed-4a20-a00b-3f98b1e93c4f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:05:33 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[82a2eeb0-c7c6-4c28-834a-a26165218c9b]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:05:33 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bbb95e1-982e-4199-a775-9476c62e8abe tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:05:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dce55498-5eed-4a20-a00b-3f98b1e93c4f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SdDJHbtF {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:05:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dce55498-5eed-4a20-a00b-3f98b1e93c4f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SdDJHbtF" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:05:33 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[df62d9a6-afa0-41f4-a416-c752c9f29191]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:05:33 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bbb95e1-982e-4199-a775-9476c62e8abe tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SdDJHbtF'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:05:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dce55498-5eed-4a20-a00b-3f98b1e93c4f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:05:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dce55498-5eed-4a20-a00b-3f98b1e93c4f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:05:33 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[723e9ca6-11d1-4940-a89f-76fe8eec737f]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:05:33 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bbb95e1-982e-4199-a775-9476c62e8abe tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:05:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:05:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:05:33 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[daa67a13-0846-4d78-8680-bb54cfc5d549]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bda4ab6-9834-40ad-b9fc-88186d2ffceb (non-flash)\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:05:33 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bbb95e1-982e-4199-a775-9476c62e8abe tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1 (non-flash)
Nov 13 19:05:33 user nova-compute[75216]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bda4ab6-9834-40ad-b9fc-88186d2ffceb (non-flash)
Nov 13 19:05:33 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 19:05:33 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bbb95e1-982e-4199-a775-9476c62e8abe tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1 (non-flash)
Nov 13 19:05:33 user nova-compute[75216]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bda4ab6-9834-40ad-b9fc-88186d2ffceb (non-flash)
Nov 13 19:05:33 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 19:05:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dce55498-5eed-4a20-a00b-3f98b1e93c4f -p 172.16.0.220:3260 --login {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:05:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dce55498-5eed-4a20-a00b-3f98b1e93c4f -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:05:33 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[c85e1751-0fe2-48df-91d4-1bab8a4aa201]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:dce55498-5eed-4a20-a00b-3f98b1e93c4f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:dce55498-5eed-4a20-a00b-3f98b1e93c4f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:05:33 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bbb95e1-982e-4199-a775-9476c62e8abe tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:dce55498-5eed-4a20-a00b-3f98b1e93c4f, portal: 172.16.0.220,3260]
Nov 13 19:05:33 user nova-compute[75216]: Login to [iface: default, target: iqn.2010-10.org.openstack:dce55498-5eed-4a20-a00b-3f98b1e93c4f, portal: 172.16.0.220,3260] successful.
Nov 13 19:05:33 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:05:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dce55498-5eed-4a20-a00b-3f98b1e93c4f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:05:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dce55498-5eed-4a20-a00b-3f98b1e93c4f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:05:33 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd6d358f-fc55-4452-b232-3299ac623c37]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:05:33 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bbb95e1-982e-4199-a775-9476c62e8abe tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:05:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:05:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:05:33 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf6df44c-f246-4530-95d7-1bff314a45e4]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bda4ab6-9834-40ad-b9fc-88186d2ffceb (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dce55498-5eed-4a20-a00b-3f98b1e93c4f (non-flash)\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:05:33 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bbb95e1-982e-4199-a775-9476c62e8abe tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1 (non-flash)
Nov 13 19:05:33 user nova-compute[75216]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bda4ab6-9834-40ad-b9fc-88186d2ffceb (non-flash)
Nov 13 19:05:33 user nova-compute[75216]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dce55498-5eed-4a20-a00b-3f98b1e93c4f (non-flash)
Nov 13 19:05:33 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 19:05:33 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bbb95e1-982e-4199-a775-9476c62e8abe tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1 (non-flash)
Nov 13 19:05:33 user nova-compute[75216]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bda4ab6-9834-40ad-b9fc-88186d2ffceb (non-flash)
Nov 13 19:05:33 user nova-compute[75216]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dce55498-5eed-4a20-a00b-3f98b1e93c4f (non-flash)
Nov 13 19:05:33 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 19:05:33 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-6bbb95e1-982e-4199-a775-9476c62e8abe tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dce55498-5eed-4a20-a00b-3f98b1e93c4f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.268s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 19:05:33 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bbb95e1-982e-4199-a775-9476c62e8abe tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Connected to 172.16.0.220:3260 {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 19:05:33 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-6bbb95e1-982e-4199-a775-9476c62e8abe tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] HCTL ('35', '-', '-', 0) found on session 40 with lun 0 {{(pid=75216) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 19:05:33 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-6bbb95e1-982e-4199-a775-9476c62e8abe tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75216) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 19:05:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:05:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:05:33 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[743feb96-337f-46c5-a43b-8daa326e1a3b]: (4, ('- - 0', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:05:33 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-6bbb95e1-982e-4199-a775-9476c62e8abe tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Searching for a device in session 40 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75216) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 19:05:33 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bbb95e1-982e-4199-a775-9476c62e8abe tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:dce55498-5eed-4a20-a00b-3f98b1e93c4f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SdDJHbtF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 19:05:34 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-6bbb95e1-982e-4199-a775-9476c62e8abe tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.309s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 19:05:34 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bbb95e1-982e-4199-a775-9476c62e8abe tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] <== connect_volume: return (1311ms) {'type': 'block', 'scsi_wwn': '23165353631613136', 'path': '/dev/sdd'} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 19:05:34 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6bbb95e1-982e-4199-a775-9476c62e8abe tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] [instance: 7b752173-e573-426e-b9f1-bff92a4c2b55] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23165353631613136', 'path': '/dev/sdd'} {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 19:05:34 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-6bbb95e1-982e-4199-a775-9476c62e8abe tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T19:01:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1575865869',display_name='tempest-AttachVolumeTestJSON-server-1575865869',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1575865869',id=29,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGyAqjyHTP2pee8vnuPoZ/xrp7+kl5CQoOuvKblvMKUYsUK2V6arU3VG3TaEuVHw4+At5BuB9j/a8y246OC2wl7lhVwqAlIhS8np4Du9lzYGwetS0FdeZdBwrMXi36WP0A==',key_name='tempest-keypair-355509380',keypairs=<?>,launch_index=0,launched_at=2023-11-13T19:01:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='095f5765865140d29b3ecf1ab3427037',ramdisk_id='',reservation_id='r-0zzag7s9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-156429078',owner_user_name='tempest-AttachVolumeTestJSON-156429078-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T19:03:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a7501ee4141241f2abc4d6bfce2924d4',uuid=7b752173-e573-426e-b9f1-bff92a4c2b55,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "60dd7b11-cfc3-4965-a429-8b2ac4cdfcf4", "address": "fa:16:3e:d6:af:c5", "network": {"id": "53bb01d5-31a4-47af-a931-ac12fe72b986", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-802892643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "095f5765865140d29b3ecf1ab3427037", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60dd7b11-cf", "ovs_interfaceid": "60dd7b11-cfc3-4965-a429-8b2ac4cdfcf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75216) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 19:05:34 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-6bbb95e1-982e-4199-a775-9476c62e8abe tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Converting VIF {"id": "60dd7b11-cfc3-4965-a429-8b2ac4cdfcf4", "address": "fa:16:3e:d6:af:c5", "network": {"id": "53bb01d5-31a4-47af-a931-ac12fe72b986", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-802892643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "095f5765865140d29b3ecf1ab3427037", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60dd7b11-cf", "ovs_interfaceid": "60dd7b11-cfc3-4965-a429-8b2ac4cdfcf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 19:05:34 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-6bbb95e1-982e-4199-a775-9476c62e8abe tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:af:c5,bridge_name='br-int',has_traffic_filtering=True,id=60dd7b11-cfc3-4965-a429-8b2ac4cdfcf4,network=Network(53bb01d5-31a4-47af-a931-ac12fe72b986),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60dd7b11-cf') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 19:05:34 user nova-compute[75216]: DEBUG nova.objects.instance [None req-6bbb95e1-982e-4199-a775-9476c62e8abe tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Lazy-loading 'pci_devices' on Instance uuid 7b752173-e573-426e-b9f1-bff92a4c2b55 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:05:34 user nova-compute[75216]: DEBUG nova.objects.base [None req-6bbb95e1-982e-4199-a775-9476c62e8abe tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Object Instance<7b752173-e573-426e-b9f1-bff92a4c2b55> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=75216) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 19:05:34 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-6bbb95e1-982e-4199-a775-9476c62e8abe tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] [instance: 7b752173-e573-426e-b9f1-bff92a4c2b55] End _get_guest_xml xml=<domain type="kvm">
Nov 13 19:05:34 user nova-compute[75216]:   <uuid>7b752173-e573-426e-b9f1-bff92a4c2b55</uuid>
Nov 13 19:05:34 user nova-compute[75216]:   <name>instance-0000001d</name>
Nov 13 19:05:34 user nova-compute[75216]:   <memory>524288</memory>
Nov 13 19:05:34 user nova-compute[75216]:   <vcpu>1</vcpu>
Nov 13 19:05:34 user nova-compute[75216]:   <metadata>
Nov 13 19:05:34 user nova-compute[75216]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 19:05:34 user nova-compute[75216]:       <nova:package version="0.0.0"/>
Nov 13 19:05:34 user nova-compute[75216]:       <nova:name>tempest-AttachVolumeTestJSON-server-1575865869</nova:name>
Nov 13 19:05:34 user nova-compute[75216]:       <nova:creationTime>2023-11-13 19:05:33</nova:creationTime>
Nov 13 19:05:34 user nova-compute[75216]:       <nova:flavor name="m1.tiny">
Nov 13 19:05:34 user nova-compute[75216]:         <nova:memory>512</nova:memory>
Nov 13 19:05:34 user nova-compute[75216]:         <nova:disk>1</nova:disk>
Nov 13 19:05:34 user nova-compute[75216]:         <nova:swap>0</nova:swap>
Nov 13 19:05:34 user nova-compute[75216]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 19:05:34 user nova-compute[75216]:         <nova:vcpus>1</nova:vcpus>
Nov 13 19:05:34 user nova-compute[75216]:       </nova:flavor>
Nov 13 19:05:34 user nova-compute[75216]:       <nova:owner>
Nov 13 19:05:34 user nova-compute[75216]:         <nova:user uuid="a7501ee4141241f2abc4d6bfce2924d4">tempest-AttachVolumeTestJSON-156429078-project-member</nova:user>
Nov 13 19:05:34 user nova-compute[75216]:         <nova:project uuid="095f5765865140d29b3ecf1ab3427037">tempest-AttachVolumeTestJSON-156429078</nova:project>
Nov 13 19:05:34 user nova-compute[75216]:       </nova:owner>
Nov 13 19:05:34 user nova-compute[75216]:       <nova:root type="image" uuid="77bcb5ba-8510-41ec-a88d-96097bb431de"/>
Nov 13 19:05:34 user nova-compute[75216]:       <nova:ports>
Nov 13 19:05:34 user nova-compute[75216]:         <nova:port uuid="60dd7b11-cfc3-4965-a429-8b2ac4cdfcf4">
Nov 13 19:05:34 user nova-compute[75216]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 13 19:05:34 user nova-compute[75216]:         </nova:port>
Nov 13 19:05:34 user nova-compute[75216]:       </nova:ports>
Nov 13 19:05:34 user nova-compute[75216]:     </nova:instance>
Nov 13 19:05:34 user nova-compute[75216]:   </metadata>
Nov 13 19:05:34 user nova-compute[75216]:   <sysinfo type="smbios">
Nov 13 19:05:34 user nova-compute[75216]:     <system>
Nov 13 19:05:34 user nova-compute[75216]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 19:05:34 user nova-compute[75216]:       <entry name="product">OpenStack Nova</entry>
Nov 13 19:05:34 user nova-compute[75216]:       <entry name="version">0.0.0</entry>
Nov 13 19:05:34 user nova-compute[75216]:       <entry name="serial">7b752173-e573-426e-b9f1-bff92a4c2b55</entry>
Nov 13 19:05:34 user nova-compute[75216]:       <entry name="uuid">7b752173-e573-426e-b9f1-bff92a4c2b55</entry>
Nov 13 19:05:34 user nova-compute[75216]:       <entry name="family">Virtual Machine</entry>
Nov 13 19:05:34 user nova-compute[75216]:     </system>
Nov 13 19:05:34 user nova-compute[75216]:   </sysinfo>
Nov 13 19:05:34 user nova-compute[75216]:   <os>
Nov 13 19:05:34 user nova-compute[75216]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 19:05:34 user nova-compute[75216]:     <boot dev="hd"/>
Nov 13 19:05:34 user nova-compute[75216]:     <smbios mode="sysinfo"/>
Nov 13 19:05:34 user nova-compute[75216]:   </os>
Nov 13 19:05:34 user nova-compute[75216]:   <features>
Nov 13 19:05:34 user nova-compute[75216]:     <acpi/>
Nov 13 19:05:34 user nova-compute[75216]:     <apic/>
Nov 13 19:05:34 user nova-compute[75216]:     <vmcoreinfo/>
Nov 13 19:05:34 user nova-compute[75216]:   </features>
Nov 13 19:05:34 user nova-compute[75216]:   <clock offset="utc">
Nov 13 19:05:34 user nova-compute[75216]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 19:05:34 user nova-compute[75216]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 19:05:34 user nova-compute[75216]:     <timer name="hpet" present="no"/>
Nov 13 19:05:34 user nova-compute[75216]:   </clock>
Nov 13 19:05:34 user nova-compute[75216]:   <cpu mode="custom" match="exact">
Nov 13 19:05:34 user nova-compute[75216]:     <model>Nehalem</model>
Nov 13 19:05:34 user nova-compute[75216]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 19:05:34 user nova-compute[75216]:   </cpu>
Nov 13 19:05:34 user nova-compute[75216]:   <devices>
Nov 13 19:05:34 user nova-compute[75216]:     <disk type="file" device="disk">
Nov 13 19:05:34 user nova-compute[75216]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 19:05:34 user nova-compute[75216]:       <source file="/opt/stack/data/nova/instances/7b752173-e573-426e-b9f1-bff92a4c2b55/disk"/>
Nov 13 19:05:34 user nova-compute[75216]:       <target dev="vda" bus="virtio"/>
Nov 13 19:05:34 user nova-compute[75216]:     </disk>
Nov 13 19:05:34 user nova-compute[75216]:     <disk type="block" device="disk">
Nov 13 19:05:34 user nova-compute[75216]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 19:05:34 user nova-compute[75216]:       <source dev="/dev/sdd"/>
Nov 13 19:05:34 user nova-compute[75216]:       <target dev="vdb" bus="virtio"/>
Nov 13 19:05:34 user nova-compute[75216]:       <serial>dce55498-5eed-4a20-a00b-3f98b1e93c4f</serial>
Nov 13 19:05:34 user nova-compute[75216]:     </disk>
Nov 13 19:05:34 user nova-compute[75216]:     <interface type="ethernet">
Nov 13 19:05:34 user nova-compute[75216]:       <mac address="fa:16:3e:d6:af:c5"/>
Nov 13 19:05:34 user nova-compute[75216]:       <model type="virtio"/>
Nov 13 19:05:34 user nova-compute[75216]:       <mtu size="1442"/>
Nov 13 19:05:34 user nova-compute[75216]:       <target dev="tap60dd7b11-cf"/>
Nov 13 19:05:34 user nova-compute[75216]:     </interface>
Nov 13 19:05:34 user nova-compute[75216]:     <serial type="pty">
Nov 13 19:05:34 user nova-compute[75216]:       <log file="/opt/stack/data/nova/instances/7b752173-e573-426e-b9f1-bff92a4c2b55/console.log" append="off"/>
Nov 13 19:05:34 user nova-compute[75216]:     </serial>
Nov 13 19:05:34 user nova-compute[75216]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 19:05:34 user nova-compute[75216]:     <video>
Nov 13 19:05:34 user nova-compute[75216]:       <model type="virtio"/>
Nov 13 19:05:34 user nova-compute[75216]:     </video>
Nov 13 19:05:34 user nova-compute[75216]:     <rng model="virtio">
Nov 13 19:05:34 user nova-compute[75216]:       <backend model="random">/dev/urandom</backend>
Nov 13 19:05:34 user nova-compute[75216]:     </rng>
Nov 13 19:05:34 user nova-compute[75216]:     <controller type="usb" index="0" model="none"/>
Nov 13 19:05:34 user nova-compute[75216]:     <memballoon model="virtio">
Nov 13 19:05:34 user nova-compute[75216]:       <stats period="10"/>
Nov 13 19:05:34 user nova-compute[75216]:     </memballoon>
Nov 13 19:05:34 user nova-compute[75216]:   </devices>
Nov 13 19:05:34 user nova-compute[75216]: </domain>
Nov 13 19:05:34 user nova-compute[75216]:  {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 19:05:34 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-6bbb95e1-982e-4199-a775-9476c62e8abe tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b752173-e573-426e-b9f1-bff92a4c2b55/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:05:34 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-6bbb95e1-982e-4199-a775-9476c62e8abe tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b752173-e573-426e-b9f1-bff92a4c2b55/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:05:34 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-6bbb95e1-982e-4199-a775-9476c62e8abe tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b752173-e573-426e-b9f1-bff92a4c2b55/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:05:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-6bbb95e1-982e-4199-a775-9476c62e8abe tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b752173-e573-426e-b9f1-bff92a4c2b55/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:05:35 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-6bbb95e1-982e-4199-a775-9476c62e8abe tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 19:05:35 user nova-compute[75216]: DEBUG nova.objects.instance [None req-6bbb95e1-982e-4199-a775-9476c62e8abe tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Lazy-loading 'trusted_certs' on Instance uuid 7b752173-e573-426e-b9f1-bff92a4c2b55 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:05:35 user nova-compute[75216]: DEBUG nova.objects.base [None req-6bbb95e1-982e-4199-a775-9476c62e8abe tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Object Instance<7b752173-e573-426e-b9f1-bff92a4c2b55> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=75216) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 19:05:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-6bbb95e1-982e-4199-a775-9476c62e8abe tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:05:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-6bbb95e1-982e-4199-a775-9476c62e8abe tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json" returned: 0 in 0.177s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:05:35 user nova-compute[75216]: DEBUG nova.virt.disk.api [None req-6bbb95e1-982e-4199-a775-9476c62e8abe tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7b752173-e573-426e-b9f1-bff92a4c2b55/disk. size=1073741824 {{(pid=75216) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 19:05:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-6bbb95e1-982e-4199-a775-9476c62e8abe tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b752173-e573-426e-b9f1-bff92a4c2b55/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:05:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-6bbb95e1-982e-4199-a775-9476c62e8abe tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b752173-e573-426e-b9f1-bff92a4c2b55/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:05:35 user nova-compute[75216]: DEBUG nova.virt.disk.api [None req-6bbb95e1-982e-4199-a775-9476c62e8abe tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Cannot resize image /opt/stack/data/nova/instances/7b752173-e573-426e-b9f1-bff92a4c2b55/disk to a smaller size. {{(pid=75216) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 19:05:35 user nova-compute[75216]: DEBUG nova.objects.instance [None req-6bbb95e1-982e-4199-a775-9476c62e8abe tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Lazy-loading 'migration_context' on Instance uuid 7b752173-e573-426e-b9f1-bff92a4c2b55 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:05:35 user nova-compute[75216]: DEBUG nova.objects.base [None req-6bbb95e1-982e-4199-a775-9476c62e8abe tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Object Instance<7b752173-e573-426e-b9f1-bff92a4c2b55> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75216) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 19:05:35 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-6bbb95e1-982e-4199-a775-9476c62e8abe tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T19:01:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1575865869',display_name='tempest-AttachVolumeTestJSON-server-1575865869',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1575865869',id=29,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGyAqjyHTP2pee8vnuPoZ/xrp7+kl5CQoOuvKblvMKUYsUK2V6arU3VG3TaEuVHw4+At5BuB9j/a8y246OC2wl7lhVwqAlIhS8np4Du9lzYGwetS0FdeZdBwrMXi36WP0A==',key_name='tempest-keypair-355509380',keypairs=<?>,launch_index=0,launched_at=2023-11-13T19:01:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='095f5765865140d29b3ecf1ab3427037',ramdisk_id='',reservation_id='r-0zzag7s9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-156429078',owner_user_name='tempest-AttachVolumeTestJSON-156429078-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T19:03:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a7501ee4141241f2abc4d6bfce2924d4',uuid=7b752173-e573-426e-b9f1-bff92a4c2b55,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "60dd7b11-cfc3-4965-a429-8b2ac4cdfcf4", "address": "fa:16:3e:d6:af:c5", "network": {"id": "53bb01d5-31a4-47af-a931-ac12fe72b986", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-802892643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "095f5765865140d29b3ecf1ab3427037", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60dd7b11-cf", "ovs_interfaceid": "60dd7b11-cfc3-4965-a429-8b2ac4cdfcf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 19:05:35 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-6bbb95e1-982e-4199-a775-9476c62e8abe tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Converting VIF {"id": "60dd7b11-cfc3-4965-a429-8b2ac4cdfcf4", "address": "fa:16:3e:d6:af:c5", "network": {"id": "53bb01d5-31a4-47af-a931-ac12fe72b986", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-802892643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "095f5765865140d29b3ecf1ab3427037", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60dd7b11-cf", "ovs_interfaceid": "60dd7b11-cfc3-4965-a429-8b2ac4cdfcf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 19:05:35 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-6bbb95e1-982e-4199-a775-9476c62e8abe tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:af:c5,bridge_name='br-int',has_traffic_filtering=True,id=60dd7b11-cfc3-4965-a429-8b2ac4cdfcf4,network=Network(53bb01d5-31a4-47af-a931-ac12fe72b986),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60dd7b11-cf') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 19:05:35 user nova-compute[75216]: DEBUG os_vif [None req-6bbb95e1-982e-4199-a775-9476c62e8abe tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:af:c5,bridge_name='br-int',has_traffic_filtering=True,id=60dd7b11-cfc3-4965-a429-8b2ac4cdfcf4,network=Network(53bb01d5-31a4-47af-a931-ac12fe72b986),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60dd7b11-cf') {{(pid=75216) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 19:05:35 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:05:35 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:05:35 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 19:05:35 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:05:35 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd3170150-d343-5a91-a21d-c456640494a4', '_type': 'linux-noop'}}, row=False) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:05:35 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:05:35 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:05:35 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:05:35 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap60dd7b11-cf, may_exist=True, interface_attrs={}) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:05:35 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap60dd7b11-cf, col_values=(('qos', UUID('835859ca-ed9d-44d7-a042-0543f1b3b67d')),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:05:35 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap60dd7b11-cf, col_values=(('external_ids', {'iface-id': '60dd7b11-cfc3-4965-a429-8b2ac4cdfcf4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d6:af:c5', 'vm-uuid': '7b752173-e573-426e-b9f1-bff92a4c2b55'}),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:05:35 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:05:35 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:05:35 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:05:35 user nova-compute[75216]: INFO os_vif [None req-6bbb95e1-982e-4199-a775-9476c62e8abe tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:af:c5,bridge_name='br-int',has_traffic_filtering=True,id=60dd7b11-cfc3-4965-a429-8b2ac4cdfcf4,network=Network(53bb01d5-31a4-47af-a931-ac12fe72b986),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60dd7b11-cf')
Nov 13 19:05:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:05:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:05:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:05:37 user nova-compute[75216]: DEBUG nova.compute.manager [req-8c33f0ea-3e2d-4598-9c40-fb6ad10eee13 req-ca0876c0-79f6-4df9-bf6b-611bc1906970 service nova] [instance: 7b752173-e573-426e-b9f1-bff92a4c2b55] Received event network-vif-plugged-60dd7b11-cfc3-4965-a429-8b2ac4cdfcf4 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:05:37 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-8c33f0ea-3e2d-4598-9c40-fb6ad10eee13 req-ca0876c0-79f6-4df9-bf6b-611bc1906970 service nova] Acquiring lock "7b752173-e573-426e-b9f1-bff92a4c2b55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:05:37 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-8c33f0ea-3e2d-4598-9c40-fb6ad10eee13 req-ca0876c0-79f6-4df9-bf6b-611bc1906970 service nova] Lock "7b752173-e573-426e-b9f1-bff92a4c2b55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:05:37 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-8c33f0ea-3e2d-4598-9c40-fb6ad10eee13 req-ca0876c0-79f6-4df9-bf6b-611bc1906970 service nova] Lock "7b752173-e573-426e-b9f1-bff92a4c2b55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:05:37 user nova-compute[75216]: DEBUG nova.compute.manager [req-8c33f0ea-3e2d-4598-9c40-fb6ad10eee13 req-ca0876c0-79f6-4df9-bf6b-611bc1906970 service nova] [instance: 7b752173-e573-426e-b9f1-bff92a4c2b55] No waiting events found dispatching network-vif-plugged-60dd7b11-cfc3-4965-a429-8b2ac4cdfcf4 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 19:05:37 user nova-compute[75216]: WARNING nova.compute.manager [req-8c33f0ea-3e2d-4598-9c40-fb6ad10eee13 req-ca0876c0-79f6-4df9-bf6b-611bc1906970 service nova] [instance: 7b752173-e573-426e-b9f1-bff92a4c2b55] Received unexpected event network-vif-plugged-60dd7b11-cfc3-4965-a429-8b2ac4cdfcf4 for instance with vm_state stopped and task_state powering-on.
Nov 13 19:05:38 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:05:38 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:05:38 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:05:38 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:05:38 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:05:38 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:05:39 user nova-compute[75216]: DEBUG nova.compute.manager [None req-6bbb95e1-982e-4199-a775-9476c62e8abe tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] [instance: 7b752173-e573-426e-b9f1-bff92a4c2b55] Instance event wait completed in 0 seconds for  {{(pid=75216) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 19:05:39 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 7b752173-e573-426e-b9f1-bff92a4c2b55] Instance rebooted successfully.
Nov 13 19:05:39 user nova-compute[75216]: DEBUG nova.compute.manager [None req-6bbb95e1-982e-4199-a775-9476c62e8abe tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] [instance: 7b752173-e573-426e-b9f1-bff92a4c2b55] Checking state {{(pid=75216) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 19:05:39 user nova-compute[75216]: DEBUG nova.compute.manager [req-d0425e80-91ec-4702-b2b0-9c6ab94ed37e req-4b1c6d76-6b6a-4f07-9171-23948dc00fe4 service nova] [instance: 7b752173-e573-426e-b9f1-bff92a4c2b55] Received event network-vif-plugged-60dd7b11-cfc3-4965-a429-8b2ac4cdfcf4 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:05:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-d0425e80-91ec-4702-b2b0-9c6ab94ed37e req-4b1c6d76-6b6a-4f07-9171-23948dc00fe4 service nova] Acquiring lock "7b752173-e573-426e-b9f1-bff92a4c2b55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:05:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-d0425e80-91ec-4702-b2b0-9c6ab94ed37e req-4b1c6d76-6b6a-4f07-9171-23948dc00fe4 service nova] Lock "7b752173-e573-426e-b9f1-bff92a4c2b55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:05:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-d0425e80-91ec-4702-b2b0-9c6ab94ed37e req-4b1c6d76-6b6a-4f07-9171-23948dc00fe4 service nova] Lock "7b752173-e573-426e-b9f1-bff92a4c2b55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:05:39 user nova-compute[75216]: DEBUG nova.compute.manager [req-d0425e80-91ec-4702-b2b0-9c6ab94ed37e req-4b1c6d76-6b6a-4f07-9171-23948dc00fe4 service nova] [instance: 7b752173-e573-426e-b9f1-bff92a4c2b55] No waiting events found dispatching network-vif-plugged-60dd7b11-cfc3-4965-a429-8b2ac4cdfcf4 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 19:05:39 user nova-compute[75216]: WARNING nova.compute.manager [req-d0425e80-91ec-4702-b2b0-9c6ab94ed37e req-4b1c6d76-6b6a-4f07-9171-23948dc00fe4 service nova] [instance: 7b752173-e573-426e-b9f1-bff92a4c2b55] Received unexpected event network-vif-plugged-60dd7b11-cfc3-4965-a429-8b2ac4cdfcf4 for instance with vm_state active and task_state None.
Nov 13 19:05:40 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:05:43 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:05:45 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:05:48 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:05:49 user nova-compute[75216]: INFO nova.compute.manager [None req-494c27d0-a1d3-4545-9381-44f5a714f99e tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: 8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa] Rescuing
Nov 13 19:05:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-494c27d0-a1d3-4545-9381-44f5a714f99e tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Acquiring lock "refresh_cache-8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 19:05:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-494c27d0-a1d3-4545-9381-44f5a714f99e tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Acquired lock "refresh_cache-8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 19:05:49 user nova-compute[75216]: DEBUG nova.network.neutron [None req-494c27d0-a1d3-4545-9381-44f5a714f99e tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: 8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa] Building network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 19:05:50 user nova-compute[75216]: DEBUG nova.network.neutron [None req-494c27d0-a1d3-4545-9381-44f5a714f99e tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: 8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa] Updating instance_info_cache with network_info: [{"id": "0f86c64c-3da6-44d9-8c74-e276f2496f35", "address": "fa:16:3e:21:5b:c2", "network": {"id": "f8b821ef-8fae-42b9-9055-a9ea7be955ab", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-50594548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "903397a6c0474cfd8bd1a4fb338528aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f86c64c-3d", "ovs_interfaceid": "0f86c64c-3da6-44d9-8c74-e276f2496f35", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:05:50 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-494c27d0-a1d3-4545-9381-44f5a714f99e tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Releasing lock "refresh_cache-8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 19:05:50 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:05:50 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:05:50 user nova-compute[75216]: DEBUG nova.compute.manager [req-d284b149-fcfe-4d31-92a9-be547d2b1513 req-05ca87b1-be10-482b-b716-46689b3f6882 service nova] [instance: 8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa] Received event network-vif-unplugged-0f86c64c-3da6-44d9-8c74-e276f2496f35 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:05:50 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-d284b149-fcfe-4d31-92a9-be547d2b1513 req-05ca87b1-be10-482b-b716-46689b3f6882 service nova] Acquiring lock "8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:05:50 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-d284b149-fcfe-4d31-92a9-be547d2b1513 req-05ca87b1-be10-482b-b716-46689b3f6882 service nova] Lock "8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:05:50 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-d284b149-fcfe-4d31-92a9-be547d2b1513 req-05ca87b1-be10-482b-b716-46689b3f6882 service nova] Lock "8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:05:50 user nova-compute[75216]: DEBUG nova.compute.manager [req-d284b149-fcfe-4d31-92a9-be547d2b1513 req-05ca87b1-be10-482b-b716-46689b3f6882 service nova] [instance: 8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa] No waiting events found dispatching network-vif-unplugged-0f86c64c-3da6-44d9-8c74-e276f2496f35 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 19:05:50 user nova-compute[75216]: WARNING nova.compute.manager [req-d284b149-fcfe-4d31-92a9-be547d2b1513 req-05ca87b1-be10-482b-b716-46689b3f6882 service nova] [instance: 8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa] Received unexpected event network-vif-unplugged-0f86c64c-3da6-44d9-8c74-e276f2496f35 for instance with vm_state active and task_state rescuing.
Nov 13 19:05:50 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:05:50 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:05:50 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:05:50 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa] Instance destroyed successfully.
Nov 13 19:05:50 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-494c27d0-a1d3-4545-9381-44f5a714f99e tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: 8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa] Attempting a stable device rescue
Nov 13 19:05:50 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-494c27d0-a1d3-4545-9381-44f5a714f99e tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75216) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 13 19:05:50 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-494c27d0-a1d3-4545-9381-44f5a714f99e tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: 8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa] Instance directory exists: not creating {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 13 19:05:50 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-494c27d0-a1d3-4545-9381-44f5a714f99e tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: 8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa] Creating image(s)
Nov 13 19:05:50 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-494c27d0-a1d3-4545-9381-44f5a714f99e tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Acquiring lock "/opt/stack/data/nova/instances/8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:05:50 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-494c27d0-a1d3-4545-9381-44f5a714f99e tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Lock "/opt/stack/data/nova/instances/8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:05:50 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-494c27d0-a1d3-4545-9381-44f5a714f99e tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Lock "/opt/stack/data/nova/instances/8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:05:50 user nova-compute[75216]: DEBUG nova.objects.instance [None req-494c27d0-a1d3-4545-9381-44f5a714f99e tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Lazy-loading 'trusted_certs' on Instance uuid 8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:05:50 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-494c27d0-a1d3-4545-9381-44f5a714f99e tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Acquiring lock "015cc816bc48a395e2ae0409eb6cf8380c6040d9" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:05:50 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-494c27d0-a1d3-4545-9381-44f5a714f99e tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Lock "015cc816bc48a395e2ae0409eb6cf8380c6040d9" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:05:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-494c27d0-a1d3-4545-9381-44f5a714f99e tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/015cc816bc48a395e2ae0409eb6cf8380c6040d9.part --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:05:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-494c27d0-a1d3-4545-9381-44f5a714f99e tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/015cc816bc48a395e2ae0409eb6cf8380c6040d9.part --force-share --output=json" returned: 0 in 0.194s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:05:51 user nova-compute[75216]: DEBUG nova.virt.images [None req-494c27d0-a1d3-4545-9381-44f5a714f99e tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] 2767d36e-07eb-4ddd-a843-aac4783bd2e6 was qcow2, converting to raw {{(pid=75216) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 13 19:05:51 user nova-compute[75216]: DEBUG nova.privsep.utils [None req-494c27d0-a1d3-4545-9381-44f5a714f99e tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75216) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 13 19:05:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-494c27d0-a1d3-4545-9381-44f5a714f99e tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/015cc816bc48a395e2ae0409eb6cf8380c6040d9.part /opt/stack/data/nova/instances/_base/015cc816bc48a395e2ae0409eb6cf8380c6040d9.converted {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:05:52 user nova-compute[75216]: DEBUG nova.compute.manager [req-1218a428-1617-487c-88b6-2baeb8042a03 req-87300832-1e27-455e-8277-22305b947499 service nova] [instance: 8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa] Received event network-vif-plugged-0f86c64c-3da6-44d9-8c74-e276f2496f35 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:05:52 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-1218a428-1617-487c-88b6-2baeb8042a03 req-87300832-1e27-455e-8277-22305b947499 service nova] Acquiring lock "8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:05:52 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-1218a428-1617-487c-88b6-2baeb8042a03 req-87300832-1e27-455e-8277-22305b947499 service nova] Lock "8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:05:52 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-1218a428-1617-487c-88b6-2baeb8042a03 req-87300832-1e27-455e-8277-22305b947499 service nova] Lock "8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:05:52 user nova-compute[75216]: DEBUG nova.compute.manager [req-1218a428-1617-487c-88b6-2baeb8042a03 req-87300832-1e27-455e-8277-22305b947499 service nova] [instance: 8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa] No waiting events found dispatching network-vif-plugged-0f86c64c-3da6-44d9-8c74-e276f2496f35 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 19:05:52 user nova-compute[75216]: WARNING nova.compute.manager [req-1218a428-1617-487c-88b6-2baeb8042a03 req-87300832-1e27-455e-8277-22305b947499 service nova] [instance: 8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa] Received unexpected event network-vif-plugged-0f86c64c-3da6-44d9-8c74-e276f2496f35 for instance with vm_state active and task_state rescuing.
Nov 13 19:05:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-494c27d0-a1d3-4545-9381-44f5a714f99e tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/015cc816bc48a395e2ae0409eb6cf8380c6040d9.part /opt/stack/data/nova/instances/_base/015cc816bc48a395e2ae0409eb6cf8380c6040d9.converted" returned: 0 in 0.832s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:05:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-494c27d0-a1d3-4545-9381-44f5a714f99e tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/015cc816bc48a395e2ae0409eb6cf8380c6040d9.converted --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:05:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-494c27d0-a1d3-4545-9381-44f5a714f99e tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/015cc816bc48a395e2ae0409eb6cf8380c6040d9.converted --force-share --output=json" returned: 0 in 0.176s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:05:52 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-494c27d0-a1d3-4545-9381-44f5a714f99e tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Lock "015cc816bc48a395e2ae0409eb6cf8380c6040d9" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.059s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:05:52 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-494c27d0-a1d3-4545-9381-44f5a714f99e tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Acquiring lock "015cc816bc48a395e2ae0409eb6cf8380c6040d9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:05:53 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-494c27d0-a1d3-4545-9381-44f5a714f99e tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Lock "015cc816bc48a395e2ae0409eb6cf8380c6040d9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:05:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-494c27d0-a1d3-4545-9381-44f5a714f99e tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/015cc816bc48a395e2ae0409eb6cf8380c6040d9 --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:05:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-494c27d0-a1d3-4545-9381-44f5a714f99e tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/015cc816bc48a395e2ae0409eb6cf8380c6040d9 --force-share --output=json" returned: 0 in 0.193s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:05:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-494c27d0-a1d3-4545-9381-44f5a714f99e tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/015cc816bc48a395e2ae0409eb6cf8380c6040d9,backing_fmt=raw /opt/stack/data/nova/instances/8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa/disk.rescue {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:05:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-494c27d0-a1d3-4545-9381-44f5a714f99e tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/015cc816bc48a395e2ae0409eb6cf8380c6040d9,backing_fmt=raw /opt/stack/data/nova/instances/8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa/disk.rescue" returned: 0 in 0.059s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:05:53 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-494c27d0-a1d3-4545-9381-44f5a714f99e tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Lock "015cc816bc48a395e2ae0409eb6cf8380c6040d9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.259s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:05:53 user nova-compute[75216]: DEBUG nova.objects.instance [None req-494c27d0-a1d3-4545-9381-44f5a714f99e tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Lazy-loading 'migration_context' on Instance uuid 8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:05:53 user nova-compute[75216]: DEBUG nova.objects.base [None req-494c27d0-a1d3-4545-9381-44f5a714f99e tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Object Instance<8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75216) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 19:05:53 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-494c27d0-a1d3-4545-9381-44f5a714f99e tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: 8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa] Created local disks {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 19:05:53 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-494c27d0-a1d3-4545-9381-44f5a714f99e tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: 8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa] Start _get_guest_xml network_info=[{"id": "0f86c64c-3da6-44d9-8c74-e276f2496f35", "address": "fa:16:3e:21:5b:c2", "network": {"id": "f8b821ef-8fae-42b9-9055-a9ea7be955ab", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-50594548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-50594548-network", "vif_mac": "fa:16:3e:21:5b:c2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "903397a6c0474cfd8bd1a4fb338528aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f86c64c-3d", "ovs_interfaceid": "0f86c64c-3da6-44d9-8c74-e276f2496f35", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T18:41:06Z,direct_url=<?>,disk_format='qcow2',id=77bcb5ba-8510-41ec-a88d-96097bb431de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c465b7c26ec44582b6d1b7169536ecc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T18:41:07Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '2767d36e-07eb-4ddd-a843-aac4783bd2e6', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3bda4ab6-9834-40ad-b9fc-88186d2ffceb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hZOIpwel', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa', 'attached_at': '', 'detached_at': '', 'volume_id': '3bda4ab6-9834-40ad-b9fc-88186d2ffceb', 'serial': '3bda4ab6-9834-40ad-b9fc-88186d2ffceb'}, 'attachment_id': '0eee4b25-b73e-4892-9033-9e0687c0f999', 'guest_format': None, 'mount_device': '/dev/vda', 'delete_on_termination': False, 'boot_index': 0, 'volume_type': None} {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 19:05:53 user nova-compute[75216]: DEBUG nova.objects.instance [None req-494c27d0-a1d3-4545-9381-44f5a714f99e tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Lazy-loading 'resources' on Instance uuid 8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:05:53 user nova-compute[75216]: DEBUG nova.objects.base [None req-494c27d0-a1d3-4545-9381-44f5a714f99e tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Object Instance<8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75216) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 19:05:53 user nova-compute[75216]: DEBUG nova.objects.instance [None req-494c27d0-a1d3-4545-9381-44f5a714f99e tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Lazy-loading 'numa_topology' on Instance uuid 8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:05:53 user nova-compute[75216]: DEBUG nova.objects.base [None req-494c27d0-a1d3-4545-9381-44f5a714f99e tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Object Instance<8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75216) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 19:05:53 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-494c27d0-a1d3-4545-9381-44f5a714f99e tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 19:05:53 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-494c27d0-a1d3-4545-9381-44f5a714f99e tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 19:05:53 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-494c27d0-a1d3-4545-9381-44f5a714f99e tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 19:05:53 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-494c27d0-a1d3-4545-9381-44f5a714f99e tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] CPU controller missing on host. {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 19:05:53 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-494c27d0-a1d3-4545-9381-44f5a714f99e tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 19:05:53 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-494c27d0-a1d3-4545-9381-44f5a714f99e tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] CPU controller found on host. {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 19:05:53 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-494c27d0-a1d3-4545-9381-44f5a714f99e tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75216) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 19:05:53 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-494c27d0-a1d3-4545-9381-44f5a714f99e tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T18:40:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T18:41:06Z,direct_url=<?>,disk_format='qcow2',id=77bcb5ba-8510-41ec-a88d-96097bb431de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c465b7c26ec44582b6d1b7169536ecc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T18:41:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 19:05:53 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-494c27d0-a1d3-4545-9381-44f5a714f99e tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Flavor limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 19:05:53 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-494c27d0-a1d3-4545-9381-44f5a714f99e tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Image limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 19:05:53 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-494c27d0-a1d3-4545-9381-44f5a714f99e tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Flavor pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 19:05:53 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-494c27d0-a1d3-4545-9381-44f5a714f99e tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Image pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 19:05:53 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-494c27d0-a1d3-4545-9381-44f5a714f99e tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 19:05:53 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-494c27d0-a1d3-4545-9381-44f5a714f99e tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 19:05:53 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-494c27d0-a1d3-4545-9381-44f5a714f99e tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 19:05:53 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-494c27d0-a1d3-4545-9381-44f5a714f99e tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Got 1 possible topologies {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 19:05:53 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-494c27d0-a1d3-4545-9381-44f5a714f99e tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 19:05:53 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-494c27d0-a1d3-4545-9381-44f5a714f99e tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 19:05:53 user nova-compute[75216]: DEBUG nova.objects.instance [None req-494c27d0-a1d3-4545-9381-44f5a714f99e tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Lazy-loading 'vcpu_model' on Instance uuid 8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:05:53 user nova-compute[75216]: DEBUG nova.objects.base [None req-494c27d0-a1d3-4545-9381-44f5a714f99e tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Object Instance<8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75216) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 19:05:53 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-494c27d0-a1d3-4545-9381-44f5a714f99e tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: 8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa] Calling os-brick to attach iSCSI Volume {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 19:05:53 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-494c27d0-a1d3-4545-9381-44f5a714f99e tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3a8669e40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3bda4ab6-9834-40ad-b9fc-88186d2ffceb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hZOIpwel', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 19:05:53 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-494c27d0-a1d3-4545-9381-44f5a714f99e tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 19:05:53 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-494c27d0-a1d3-4545-9381-44f5a714f99e tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 19:05:53 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-494c27d0-a1d3-4545-9381-44f5a714f99e tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 19:05:53 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-494c27d0-a1d3-4545-9381-44f5a714f99e tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 19:05:53 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-494c27d0-a1d3-4545-9381-44f5a714f99e tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3bda4ab6-9834-40ad-b9fc-88186d2ffceb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 19:05:53 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-494c27d0-a1d3-4545-9381-44f5a714f99e tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3bda4ab6-9834-40ad-b9fc-88186d2ffceb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 19:05:53 user nova-compute[75216]: INFO os_brick.initiator.connectors.iscsi [None req-494c27d0-a1d3-4545-9381-44f5a714f99e tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 19:05:53 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-5d1db8d2-58e3-4506-a4c7-8f5f3a675898 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Acquiring lock "71134725-e6cc-4426-b2c2-5be4991c53f7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:05:53 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-5d1db8d2-58e3-4506-a4c7-8f5f3a675898 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Lock "71134725-e6cc-4426-b2c2-5be4991c53f7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:05:53 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-5d1db8d2-58e3-4506-a4c7-8f5f3a675898 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Acquiring lock "71134725-e6cc-4426-b2c2-5be4991c53f7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:05:53 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-5d1db8d2-58e3-4506-a4c7-8f5f3a675898 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Lock "71134725-e6cc-4426-b2c2-5be4991c53f7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:05:53 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-5d1db8d2-58e3-4506-a4c7-8f5f3a675898 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Lock "71134725-e6cc-4426-b2c2-5be4991c53f7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:05:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bda4ab6-9834-40ad-b9fc-88186d2ffceb -p 172.16.0.220:3260 {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:05:53 user nova-compute[75216]: INFO nova.compute.manager [None req-5d1db8d2-58e3-4506-a4c7-8f5f3a675898 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] [instance: 71134725-e6cc-4426-b2c2-5be4991c53f7] Terminating instance
Nov 13 19:05:53 user nova-compute[75216]: DEBUG nova.compute.manager [None req-5d1db8d2-58e3-4506-a4c7-8f5f3a675898 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] [instance: 71134725-e6cc-4426-b2c2-5be4991c53f7] Start destroying the instance on the hypervisor. {{(pid=75216) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 19:05:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bda4ab6-9834-40ad-b9fc-88186d2ffceb -p 172.16.0.220:3260" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:05:53 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[b204e7dc-e583-4484-83d0-04b23af79fa8]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:3bda4ab6-9834-40ad-b9fc-88186d2ffceb\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = hZOIpwel\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:05:53 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-494c27d0-a1d3-4545-9381-44f5a714f99e tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 13 19:05:53 user nova-compute[75216]: node.name = iqn.2010-10.org.openstack:3bda4ab6-9834-40ad-b9fc-88186d2ffceb
Nov 13 19:05:53 user nova-compute[75216]: node.tpgt = -1
Nov 13 19:05:53 user nova-compute[75216]: node.startup = automatic
Nov 13 19:05:53 user nova-compute[75216]: node.leading_login = No
Nov 13 19:05:53 user nova-compute[75216]: iface.iscsi_ifacename = default
Nov 13 19:05:53 user nova-compute[75216]: iface.net_ifacename = <empty>
Nov 13 19:05:53 user nova-compute[75216]: iface.ipaddress = <empty>
Nov 13 19:05:53 user nova-compute[75216]: iface.prefix_len = 0
Nov 13 19:05:53 user nova-compute[75216]: iface.hwaddress = <empty>
Nov 13 19:05:53 user nova-compute[75216]: iface.transport_name = tcp
Nov 13 19:05:53 user nova-compute[75216]: iface.initiatorname = <empty>
Nov 13 19:05:53 user nova-compute[75216]: iface.state = <empty>
Nov 13 19:05:53 user nova-compute[75216]: iface.vlan_id = 0
Nov 13 19:05:53 user nova-compute[75216]: iface.vlan_priority = 0
Nov 13 19:05:53 user nova-compute[75216]: iface.vlan_state = <empty>
Nov 13 19:05:53 user nova-compute[75216]: iface.iface_num = 0
Nov 13 19:05:53 user nova-compute[75216]: iface.mtu = 0
Nov 13 19:05:53 user nova-compute[75216]: iface.port = 0
Nov 13 19:05:53 user nova-compute[75216]: iface.bootproto = <empty>
Nov 13 19:05:53 user nova-compute[75216]: iface.subnet_mask = <empty>
Nov 13 19:05:53 user nova-compute[75216]: iface.gateway = <empty>
Nov 13 19:05:53 user nova-compute[75216]: iface.dhcp_alt_client_id_state = <empty>
Nov 13 19:05:53 user nova-compute[75216]: iface.dhcp_alt_client_id = <empty>
Nov 13 19:05:53 user nova-compute[75216]: iface.dhcp_dns = <empty>
Nov 13 19:05:53 user nova-compute[75216]: iface.dhcp_learn_iqn = <empty>
Nov 13 19:05:53 user nova-compute[75216]: iface.dhcp_req_vendor_id_state = <empty>
Nov 13 19:05:53 user nova-compute[75216]: iface.dhcp_vendor_id_state = <empty>
Nov 13 19:05:53 user nova-compute[75216]: iface.dhcp_vendor_id = <empty>
Nov 13 19:05:53 user nova-compute[75216]: iface.dhcp_slp_da = <empty>
Nov 13 19:05:53 user nova-compute[75216]: iface.fragmentation = <empty>
Nov 13 19:05:53 user nova-compute[75216]: iface.gratuitous_arp = <empty>
Nov 13 19:05:53 user nova-compute[75216]: iface.incoming_forwarding = <empty>
Nov 13 19:05:53 user nova-compute[75216]: iface.tos_state = <empty>
Nov 13 19:05:53 user nova-compute[75216]: iface.tos = 0
Nov 13 19:05:53 user nova-compute[75216]: iface.ttl = 0
Nov 13 19:05:53 user nova-compute[75216]: iface.delayed_ack = <empty>
Nov 13 19:05:53 user nova-compute[75216]: iface.tcp_nagle = <empty>
Nov 13 19:05:53 user nova-compute[75216]: iface.tcp_wsf_state = <empty>
Nov 13 19:05:53 user nova-compute[75216]: iface.tcp_wsf = 0
Nov 13 19:05:53 user nova-compute[75216]: iface.tcp_timer_scale = 0
Nov 13 19:05:53 user nova-compute[75216]: iface.tcp_timestamp = <empty>
Nov 13 19:05:53 user nova-compute[75216]: iface.redirect = <empty>
Nov 13 19:05:53 user nova-compute[75216]: iface.def_task_mgmt_timeout = 0
Nov 13 19:05:53 user nova-compute[75216]: iface.header_digest = <empty>
Nov 13 19:05:53 user nova-compute[75216]: iface.data_digest = <empty>
Nov 13 19:05:53 user nova-compute[75216]: iface.immediate_data = <empty>
Nov 13 19:05:53 user nova-compute[75216]: iface.initial_r2t = <empty>
Nov 13 19:05:53 user nova-compute[75216]: iface.data_seq_inorder = <empty>
Nov 13 19:05:53 user nova-compute[75216]: iface.data_pdu_inorder = <empty>
Nov 13 19:05:53 user nova-compute[75216]: iface.erl = 0
Nov 13 19:05:53 user nova-compute[75216]: iface.max_receive_data_len = 0
Nov 13 19:05:53 user nova-compute[75216]: iface.first_burst_len = 0
Nov 13 19:05:53 user nova-compute[75216]: iface.max_outstanding_r2t = 0
Nov 13 19:05:53 user nova-compute[75216]: iface.max_burst_len = 0
Nov 13 19:05:53 user nova-compute[75216]: iface.chap_auth = <empty>
Nov 13 19:05:53 user nova-compute[75216]: iface.bidi_chap = <empty>
Nov 13 19:05:53 user nova-compute[75216]: iface.strict_login_compliance = <empty>
Nov 13 19:05:53 user nova-compute[75216]: iface.discovery_auth = <empty>
Nov 13 19:05:53 user nova-compute[75216]: iface.discovery_logout = <empty>
Nov 13 19:05:53 user nova-compute[75216]: node.discovery_address = <empty>
Nov 13 19:05:53 user nova-compute[75216]: node.discovery_port = 0
Nov 13 19:05:53 user nova-compute[75216]: node.discovery_type = static
Nov 13 19:05:53 user nova-compute[75216]: node.session.initial_cmdsn = 0
Nov 13 19:05:53 user nova-compute[75216]: node.session.initial_login_retry_max = 8
Nov 13 19:05:53 user nova-compute[75216]: node.session.xmit_thread_priority = -20
Nov 13 19:05:53 user nova-compute[75216]: node.session.cmds_max = 128
Nov 13 19:05:53 user nova-compute[75216]: node.session.queue_depth = 32
Nov 13 19:05:53 user nova-compute[75216]: node.session.nr_sessions = 1
Nov 13 19:05:53 user nova-compute[75216]: node.session.auth.authmethod = CHAP
Nov 13 19:05:53 user nova-compute[75216]: node.session.auth.username = hZOIpwel
Nov 13 19:05:53 user nova-compute[75216]: node.session.auth.password = ***
Nov 13 19:05:53 user nova-compute[75216]: node.session.auth.username_in = <empty>
Nov 13 19:05:53 user nova-compute[75216]: node.session.auth.password_in = <empty>
Nov 13 19:05:53 user nova-compute[75216]: node.session.auth.chap_algs = MD5
Nov 13 19:05:53 user nova-compute[75216]: node.session.timeo.replacement_timeout = 120
Nov 13 19:05:53 user nova-compute[75216]: node.session.err_timeo.abort_timeout = 15
Nov 13 19:05:53 user nova-compute[75216]: node.session.err_timeo.lu_reset_timeout = 30
Nov 13 19:05:53 user nova-compute[75216]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 13 19:05:53 user nova-compute[75216]: node.session.err_timeo.host_reset_timeout = 60
Nov 13 19:05:53 user nova-compute[75216]: node.session.iscsi.FastAbort = Yes
Nov 13 19:05:53 user nova-compute[75216]: node.session.iscsi.InitialR2T = No
Nov 13 19:05:53 user nova-compute[75216]: node.session.iscsi.ImmediateData = Yes
Nov 13 19:05:53 user nova-compute[75216]: node.session.iscsi.FirstBurstLength = 262144
Nov 13 19:05:53 user nova-compute[75216]: node.session.iscsi.MaxBurstLength = 16776192
Nov 13 19:05:53 user nova-compute[75216]: node.session.iscsi.DefaultTime2Retain = 0
Nov 13 19:05:53 user nova-compute[75216]: node.session.iscsi.DefaultTime2Wait = 2
Nov 13 19:05:53 user nova-compute[75216]: node.session.iscsi.MaxConnections = 1
Nov 13 19:05:53 user nova-compute[75216]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 13 19:05:53 user nova-compute[75216]: node.session.iscsi.ERL = 0
Nov 13 19:05:53 user nova-compute[75216]: node.session.scan = manual
Nov 13 19:05:53 user nova-compute[75216]: node.session.reopen_max = 0
Nov 13 19:05:53 user nova-compute[75216]: node.conn[0].address = 172.16.0.220
Nov 13 19:05:53 user nova-compute[75216]: node.conn[0].port = 3260
Nov 13 19:05:53 user nova-compute[75216]: node.conn[0].startup = manual
Nov 13 19:05:53 user nova-compute[75216]: node.conn[0].tcp.window_size = 524288
Nov 13 19:05:53 user nova-compute[75216]: node.conn[0].tcp.type_of_service = 0
Nov 13 19:05:53 user nova-compute[75216]: node.conn[0].timeo.logout_timeout = 15
Nov 13 19:05:53 user nova-compute[75216]: node.conn[0].timeo.login_timeout = 15
Nov 13 19:05:53 user nova-compute[75216]: node.conn[0].timeo.auth_timeout = 45
Nov 13 19:05:53 user nova-compute[75216]: node.conn[0].timeo.noop_out_interval = 5
Nov 13 19:05:53 user nova-compute[75216]: node.conn[0].timeo.noop_out_timeout = 5
Nov 13 19:05:53 user nova-compute[75216]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 13 19:05:53 user nova-compute[75216]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 13 19:05:53 user nova-compute[75216]: node.conn[0].iscsi.HeaderDigest = None
Nov 13 19:05:53 user nova-compute[75216]: node.conn[0].iscsi.DataDigest = None
Nov 13 19:05:53 user nova-compute[75216]: node.conn[0].iscsi.IFMarker = No
Nov 13 19:05:53 user nova-compute[75216]: node.conn[0].iscsi.OFMarker = No
Nov 13 19:05:53 user nova-compute[75216]: # END RECORD
Nov 13 19:05:53 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:05:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bda4ab6-9834-40ad-b9fc-88186d2ffceb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:05:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bda4ab6-9834-40ad-b9fc-88186d2ffceb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:05:53 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[cafddeda-f3c7-44b3-805d-421e7b885d8b]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:05:53 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-494c27d0-a1d3-4545-9381-44f5a714f99e tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:05:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bda4ab6-9834-40ad-b9fc-88186d2ffceb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:05:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bda4ab6-9834-40ad-b9fc-88186d2ffceb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:05:53 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[28fa38a6-fbd5-41ac-8142-f07ff00ad108]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:05:53 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-494c27d0-a1d3-4545-9381-44f5a714f99e tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:05:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bda4ab6-9834-40ad-b9fc-88186d2ffceb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hZOIpwel {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:05:53 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:05:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bda4ab6-9834-40ad-b9fc-88186d2ffceb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hZOIpwel" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:05:53 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[e52146b6-cb60-495e-a3bd-5a8126373297]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:05:53 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-494c27d0-a1d3-4545-9381-44f5a714f99e tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hZOIpwel'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:05:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bda4ab6-9834-40ad-b9fc-88186d2ffceb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:05:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bda4ab6-9834-40ad-b9fc-88186d2ffceb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:05:53 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[530bbd9c-cb14-4d3a-837d-8f298083261b]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:05:53 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-494c27d0-a1d3-4545-9381-44f5a714f99e tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:05:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:05:53 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:05:53 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:05:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:05:53 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e2e4806-488b-430e-afdb-1f54347bbb86]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bda4ab6-9834-40ad-b9fc-88186d2ffceb (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dce55498-5eed-4a20-a00b-3f98b1e93c4f (non-flash)\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:05:53 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-494c27d0-a1d3-4545-9381-44f5a714f99e tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1 (non-flash)
Nov 13 19:05:53 user nova-compute[75216]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bda4ab6-9834-40ad-b9fc-88186d2ffceb (non-flash)
Nov 13 19:05:53 user nova-compute[75216]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dce55498-5eed-4a20-a00b-3f98b1e93c4f (non-flash)
Nov 13 19:05:53 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 19:05:53 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-494c27d0-a1d3-4545-9381-44f5a714f99e tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1 (non-flash)
Nov 13 19:05:53 user nova-compute[75216]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bda4ab6-9834-40ad-b9fc-88186d2ffceb (non-flash)
Nov 13 19:05:53 user nova-compute[75216]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dce55498-5eed-4a20-a00b-3f98b1e93c4f (non-flash)
Nov 13 19:05:53 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 19:05:53 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-494c27d0-a1d3-4545-9381-44f5a714f99e tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3bda4ab6-9834-40ad-b9fc-88186d2ffceb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.159s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 19:05:53 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-494c27d0-a1d3-4545-9381-44f5a714f99e tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Connected to 172.16.0.220:3260 {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 19:05:53 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-494c27d0-a1d3-4545-9381-44f5a714f99e tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] HCTL ('34', '0', '0', 0) found on session 39 with lun 0 {{(pid=75216) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 19:05:53 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-494c27d0-a1d3-4545-9381-44f5a714f99e tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=75216) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 19:05:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:05:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:05:53 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[224406d1-6a44-4c5e-9476-2fdde6d18679]: (4, ('0 0 0', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:05:53 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-494c27d0-a1d3-4545-9381-44f5a714f99e tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Searching for a device in session 39 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=75216) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 19:05:53 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-494c27d0-a1d3-4545-9381-44f5a714f99e tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:3bda4ab6-9834-40ad-b9fc-88186d2ffceb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hZOIpwel', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 19:05:53 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-494c27d0-a1d3-4545-9381-44f5a714f99e tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.184s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 19:05:53 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-494c27d0-a1d3-4545-9381-44f5a714f99e tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] <== connect_volume: return (185ms) {'type': 'block', 'scsi_wwn': '23039633739383234', 'path': '/dev/sdc'} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 19:05:53 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-494c27d0-a1d3-4545-9381-44f5a714f99e tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: 8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23039633739383234', 'path': '/dev/sdc'} {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 19:05:53 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:05:53 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-494c27d0-a1d3-4545-9381-44f5a714f99e tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T19:03:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1397198855',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1397198855',id=31,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-13T19:04:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='903397a6c0474cfd8bd1a4fb338528aa',ramdisk_id='',reservation_id='r-ytgh7qju',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-197527955',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T19:04:14Z,user_data=None,user_id='b381ea98871846b1bfb29a202a058208',uuid=8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0f86c64c-3da6-44d9-8c74-e276f2496f35", "address": "fa:16:3e:21:5b:c2", "network": {"id": "f8b821ef-8fae-42b9-9055-a9ea7be955ab", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-50594548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-50594548-network", "vif_mac": "fa:16:3e:21:5b:c2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "903397a6c0474cfd8bd1a4fb338528aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f86c64c-3d", "ovs_interfaceid": "0f86c64c-3da6-44d9-8c74-e276f2496f35", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75216) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 19:05:53 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-494c27d0-a1d3-4545-9381-44f5a714f99e tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Converting VIF {"id": "0f86c64c-3da6-44d9-8c74-e276f2496f35", "address": "fa:16:3e:21:5b:c2", "network": {"id": "f8b821ef-8fae-42b9-9055-a9ea7be955ab", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-50594548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-50594548-network", "vif_mac": "fa:16:3e:21:5b:c2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "903397a6c0474cfd8bd1a4fb338528aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f86c64c-3d", "ovs_interfaceid": "0f86c64c-3da6-44d9-8c74-e276f2496f35", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 19:05:53 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-494c27d0-a1d3-4545-9381-44f5a714f99e tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:21:5b:c2,bridge_name='br-int',has_traffic_filtering=True,id=0f86c64c-3da6-44d9-8c74-e276f2496f35,network=Network(f8b821ef-8fae-42b9-9055-a9ea7be955ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f86c64c-3d') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 19:05:53 user nova-compute[75216]: DEBUG nova.objects.instance [None req-494c27d0-a1d3-4545-9381-44f5a714f99e tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Lazy-loading 'pci_devices' on Instance uuid 8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:05:53 user nova-compute[75216]: DEBUG nova.objects.base [None req-494c27d0-a1d3-4545-9381-44f5a714f99e tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Object Instance<8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75216) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 19:05:53 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-494c27d0-a1d3-4545-9381-44f5a714f99e tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: 8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa] End _get_guest_xml xml=<domain type="kvm">
Nov 13 19:05:53 user nova-compute[75216]:   <uuid>8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa</uuid>
Nov 13 19:05:53 user nova-compute[75216]:   <name>instance-0000001f</name>
Nov 13 19:05:53 user nova-compute[75216]:   <memory>524288</memory>
Nov 13 19:05:53 user nova-compute[75216]:   <vcpu>1</vcpu>
Nov 13 19:05:53 user nova-compute[75216]:   <metadata>
Nov 13 19:05:53 user nova-compute[75216]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 19:05:53 user nova-compute[75216]:       <nova:package version="0.0.0"/>
Nov 13 19:05:53 user nova-compute[75216]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1397198855</nova:name>
Nov 13 19:05:53 user nova-compute[75216]:       <nova:creationTime>2023-11-13 19:05:53</nova:creationTime>
Nov 13 19:05:53 user nova-compute[75216]:       <nova:flavor name="m1.tiny">
Nov 13 19:05:53 user nova-compute[75216]:         <nova:memory>512</nova:memory>
Nov 13 19:05:53 user nova-compute[75216]:         <nova:disk>1</nova:disk>
Nov 13 19:05:53 user nova-compute[75216]:         <nova:swap>0</nova:swap>
Nov 13 19:05:53 user nova-compute[75216]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 19:05:53 user nova-compute[75216]:         <nova:vcpus>1</nova:vcpus>
Nov 13 19:05:53 user nova-compute[75216]:       </nova:flavor>
Nov 13 19:05:53 user nova-compute[75216]:       <nova:owner>
Nov 13 19:05:53 user nova-compute[75216]:         <nova:user uuid="b381ea98871846b1bfb29a202a058208">tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member</nova:user>
Nov 13 19:05:53 user nova-compute[75216]:         <nova:project uuid="903397a6c0474cfd8bd1a4fb338528aa">tempest-ServerBootFromVolumeStableRescueTest-197527955</nova:project>
Nov 13 19:05:53 user nova-compute[75216]:       </nova:owner>
Nov 13 19:05:53 user nova-compute[75216]:       <nova:root type="image" uuid="77bcb5ba-8510-41ec-a88d-96097bb431de"/>
Nov 13 19:05:53 user nova-compute[75216]:       <nova:ports>
Nov 13 19:05:53 user nova-compute[75216]:         <nova:port uuid="0f86c64c-3da6-44d9-8c74-e276f2496f35">
Nov 13 19:05:53 user nova-compute[75216]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 13 19:05:53 user nova-compute[75216]:         </nova:port>
Nov 13 19:05:53 user nova-compute[75216]:       </nova:ports>
Nov 13 19:05:53 user nova-compute[75216]:     </nova:instance>
Nov 13 19:05:53 user nova-compute[75216]:   </metadata>
Nov 13 19:05:53 user nova-compute[75216]:   <sysinfo type="smbios">
Nov 13 19:05:53 user nova-compute[75216]:     <system>
Nov 13 19:05:53 user nova-compute[75216]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 19:05:53 user nova-compute[75216]:       <entry name="product">OpenStack Nova</entry>
Nov 13 19:05:53 user nova-compute[75216]:       <entry name="version">0.0.0</entry>
Nov 13 19:05:53 user nova-compute[75216]:       <entry name="serial">8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa</entry>
Nov 13 19:05:53 user nova-compute[75216]:       <entry name="uuid">8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa</entry>
Nov 13 19:05:53 user nova-compute[75216]:       <entry name="family">Virtual Machine</entry>
Nov 13 19:05:53 user nova-compute[75216]:     </system>
Nov 13 19:05:53 user nova-compute[75216]:   </sysinfo>
Nov 13 19:05:53 user nova-compute[75216]:   <os>
Nov 13 19:05:53 user nova-compute[75216]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 19:05:53 user nova-compute[75216]:     <smbios mode="sysinfo"/>
Nov 13 19:05:53 user nova-compute[75216]:   </os>
Nov 13 19:05:53 user nova-compute[75216]:   <features>
Nov 13 19:05:53 user nova-compute[75216]:     <acpi/>
Nov 13 19:05:53 user nova-compute[75216]:     <apic/>
Nov 13 19:05:53 user nova-compute[75216]:     <vmcoreinfo/>
Nov 13 19:05:53 user nova-compute[75216]:   </features>
Nov 13 19:05:53 user nova-compute[75216]:   <clock offset="utc">
Nov 13 19:05:53 user nova-compute[75216]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 19:05:53 user nova-compute[75216]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 19:05:53 user nova-compute[75216]:     <timer name="hpet" present="no"/>
Nov 13 19:05:53 user nova-compute[75216]:   </clock>
Nov 13 19:05:53 user nova-compute[75216]:   <cpu mode="custom" match="exact">
Nov 13 19:05:53 user nova-compute[75216]:     <model>Nehalem</model>
Nov 13 19:05:53 user nova-compute[75216]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 19:05:53 user nova-compute[75216]:   </cpu>
Nov 13 19:05:53 user nova-compute[75216]:   <devices>
Nov 13 19:05:53 user nova-compute[75216]:     <disk type="block" device="disk">
Nov 13 19:05:53 user nova-compute[75216]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 19:05:53 user nova-compute[75216]:       <source dev="/dev/sdc"/>
Nov 13 19:05:53 user nova-compute[75216]:       <target dev="vda" bus="virtio"/>
Nov 13 19:05:53 user nova-compute[75216]:       <serial>3bda4ab6-9834-40ad-b9fc-88186d2ffceb</serial>
Nov 13 19:05:53 user nova-compute[75216]:     </disk>
Nov 13 19:05:53 user nova-compute[75216]:     <disk type="file" device="disk">
Nov 13 19:05:53 user nova-compute[75216]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 19:05:53 user nova-compute[75216]:       <source file="/opt/stack/data/nova/instances/8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa/disk.rescue"/>
Nov 13 19:05:53 user nova-compute[75216]:       <target dev="vdb" bus="virtio"/>
Nov 13 19:05:53 user nova-compute[75216]:       <boot order="1"/>
Nov 13 19:05:53 user nova-compute[75216]:     </disk>
Nov 13 19:05:53 user nova-compute[75216]:     <interface type="ethernet">
Nov 13 19:05:53 user nova-compute[75216]:       <mac address="fa:16:3e:21:5b:c2"/>
Nov 13 19:05:53 user nova-compute[75216]:       <model type="virtio"/>
Nov 13 19:05:53 user nova-compute[75216]:       <mtu size="1442"/>
Nov 13 19:05:53 user nova-compute[75216]:       <target dev="tap0f86c64c-3d"/>
Nov 13 19:05:53 user nova-compute[75216]:     </interface>
Nov 13 19:05:53 user nova-compute[75216]:     <serial type="pty">
Nov 13 19:05:53 user nova-compute[75216]:       <log file="/opt/stack/data/nova/instances/8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa/console.log" append="off"/>
Nov 13 19:05:53 user nova-compute[75216]:     </serial>
Nov 13 19:05:53 user nova-compute[75216]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 19:05:53 user nova-compute[75216]:     <video>
Nov 13 19:05:53 user nova-compute[75216]:       <model type="virtio"/>
Nov 13 19:05:53 user nova-compute[75216]:     </video>
Nov 13 19:05:53 user nova-compute[75216]:     <rng model="virtio">
Nov 13 19:05:53 user nova-compute[75216]:       <backend model="random">/dev/urandom</backend>
Nov 13 19:05:53 user nova-compute[75216]:     </rng>
Nov 13 19:05:53 user nova-compute[75216]:     <controller type="usb" index="0" model="none"/>
Nov 13 19:05:53 user nova-compute[75216]:     <memballoon model="virtio">
Nov 13 19:05:53 user nova-compute[75216]:       <stats period="10"/>
Nov 13 19:05:53 user nova-compute[75216]:     </memballoon>
Nov 13 19:05:53 user nova-compute[75216]:   </devices>
Nov 13 19:05:53 user nova-compute[75216]: </domain>
Nov 13 19:05:53 user nova-compute[75216]:  {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 19:05:53 user nova-compute[75216]: DEBUG nova.compute.manager [req-85b29cc0-db3b-48a0-a130-25b227108f76 req-6452ffe0-2f74-46da-a5c4-3ee1c74de52d service nova] [instance: 71134725-e6cc-4426-b2c2-5be4991c53f7] Received event network-vif-unplugged-a1fda64d-c09d-45d7-b1ae-be416c60918d {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:05:53 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-85b29cc0-db3b-48a0-a130-25b227108f76 req-6452ffe0-2f74-46da-a5c4-3ee1c74de52d service nova] Acquiring lock "71134725-e6cc-4426-b2c2-5be4991c53f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:05:53 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-85b29cc0-db3b-48a0-a130-25b227108f76 req-6452ffe0-2f74-46da-a5c4-3ee1c74de52d service nova] Lock "71134725-e6cc-4426-b2c2-5be4991c53f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:05:53 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-85b29cc0-db3b-48a0-a130-25b227108f76 req-6452ffe0-2f74-46da-a5c4-3ee1c74de52d service nova] Lock "71134725-e6cc-4426-b2c2-5be4991c53f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:05:53 user nova-compute[75216]: DEBUG nova.compute.manager [req-85b29cc0-db3b-48a0-a130-25b227108f76 req-6452ffe0-2f74-46da-a5c4-3ee1c74de52d service nova] [instance: 71134725-e6cc-4426-b2c2-5be4991c53f7] No waiting events found dispatching network-vif-unplugged-a1fda64d-c09d-45d7-b1ae-be416c60918d {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 19:05:53 user nova-compute[75216]: DEBUG nova.compute.manager [req-85b29cc0-db3b-48a0-a130-25b227108f76 req-6452ffe0-2f74-46da-a5c4-3ee1c74de52d service nova] [instance: 71134725-e6cc-4426-b2c2-5be4991c53f7] Received event network-vif-unplugged-a1fda64d-c09d-45d7-b1ae-be416c60918d for instance with task_state deleting. {{(pid=75216) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 19:05:53 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa] Instance destroyed successfully.
Nov 13 19:05:53 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-494c27d0-a1d3-4545-9381-44f5a714f99e tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 19:05:53 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-494c27d0-a1d3-4545-9381-44f5a714f99e tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 19:05:53 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-494c27d0-a1d3-4545-9381-44f5a714f99e tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] No VIF found with MAC fa:16:3e:21:5b:c2, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 19:05:53 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:05:53 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:05:54 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:05:54 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:05:54 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:05:54 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:05:54 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:05:54 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:05:54 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:05:54 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 71134725-e6cc-4426-b2c2-5be4991c53f7] Instance destroyed successfully.
Nov 13 19:05:54 user nova-compute[75216]: DEBUG nova.objects.instance [None req-5d1db8d2-58e3-4506-a4c7-8f5f3a675898 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Lazy-loading 'resources' on Instance uuid 71134725-e6cc-4426-b2c2-5be4991c53f7 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:05:54 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-5d1db8d2-58e3-4506-a4c7-8f5f3a675898 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-13T18:59:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-617465978',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-617465978',id=26,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA6jERmHhwdzykQUbYQt2L5Y0wAwzhuoXtCyCIVaBHNHP63oR5trgspDL2RAZ8jteIRJfyEGc5Jooh7DEaXc2Dx/nzho69SJjdngZ26XtMGqh2TmVh3lXYk7mlLT7W85cQ==',key_name='tempest-keypair-1201518352',keypairs=<?>,launch_index=0,launched_at=2023-11-13T19:03:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a58d1e76a793406bbdd3821ff74abd92',ramdisk_id='',reservation_id='r-04yvplgw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1861834155',owner_user_name='tempest-AttachVolumeShelveTestJSON-1861834155-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T19:03:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e59bd525db64698b8e3587734cde6b8',uuid=71134725-e6cc-4426-b2c2-5be4991c53f7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a1fda64d-c09d-45d7-b1ae-be416c60918d", "address": "fa:16:3e:bd:0d:c9", "network": {"id": "8cbeb1cc-a067-4c8d-82d8-0dc5c2ac924c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-742672345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a58d1e76a793406bbdd3821ff74abd92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1fda64d-c0", "ovs_interfaceid": "a1fda64d-c09d-45d7-b1ae-be416c60918d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 19:05:54 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-5d1db8d2-58e3-4506-a4c7-8f5f3a675898 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Converting VIF {"id": "a1fda64d-c09d-45d7-b1ae-be416c60918d", "address": "fa:16:3e:bd:0d:c9", "network": {"id": "8cbeb1cc-a067-4c8d-82d8-0dc5c2ac924c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-742672345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a58d1e76a793406bbdd3821ff74abd92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1fda64d-c0", "ovs_interfaceid": "a1fda64d-c09d-45d7-b1ae-be416c60918d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 19:05:54 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-5d1db8d2-58e3-4506-a4c7-8f5f3a675898 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:0d:c9,bridge_name='br-int',has_traffic_filtering=True,id=a1fda64d-c09d-45d7-b1ae-be416c60918d,network=Network(8cbeb1cc-a067-4c8d-82d8-0dc5c2ac924c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1fda64d-c0') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 19:05:54 user nova-compute[75216]: DEBUG os_vif [None req-5d1db8d2-58e3-4506-a4c7-8f5f3a675898 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:0d:c9,bridge_name='br-int',has_traffic_filtering=True,id=a1fda64d-c09d-45d7-b1ae-be416c60918d,network=Network(8cbeb1cc-a067-4c8d-82d8-0dc5c2ac924c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1fda64d-c0') {{(pid=75216) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 19:05:54 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:05:54 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa1fda64d-c0, bridge=br-int, if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:05:54 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:05:54 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:05:54 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:05:54 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:05:54 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9604370e-aedb-459a-b957-9addc2a93e28) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:05:54 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:05:54 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:05:54 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:05:54 user nova-compute[75216]: INFO os_vif [None req-5d1db8d2-58e3-4506-a4c7-8f5f3a675898 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:0d:c9,bridge_name='br-int',has_traffic_filtering=True,id=a1fda64d-c09d-45d7-b1ae-be416c60918d,network=Network(8cbeb1cc-a067-4c8d-82d8-0dc5c2ac924c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1fda64d-c0')
Nov 13 19:05:54 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-5d1db8d2-58e3-4506-a4c7-8f5f3a675898 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] [instance: 71134725-e6cc-4426-b2c2-5be4991c53f7] Deleting instance files /opt/stack/data/nova/instances/71134725-e6cc-4426-b2c2-5be4991c53f7_del
Nov 13 19:05:54 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-5d1db8d2-58e3-4506-a4c7-8f5f3a675898 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] [instance: 71134725-e6cc-4426-b2c2-5be4991c53f7] Deletion of /opt/stack/data/nova/instances/71134725-e6cc-4426-b2c2-5be4991c53f7_del complete
Nov 13 19:05:54 user nova-compute[75216]: INFO nova.compute.manager [None req-5d1db8d2-58e3-4506-a4c7-8f5f3a675898 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] [instance: 71134725-e6cc-4426-b2c2-5be4991c53f7] Took 1.41 seconds to destroy the instance on the hypervisor.
Nov 13 19:05:54 user nova-compute[75216]: DEBUG oslo.service.loopingcall [None req-5d1db8d2-58e3-4506-a4c7-8f5f3a675898 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75216) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 19:05:54 user nova-compute[75216]: DEBUG nova.compute.manager [-] [instance: 71134725-e6cc-4426-b2c2-5be4991c53f7] Deallocating network for instance {{(pid=75216) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 19:05:54 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: 71134725-e6cc-4426-b2c2-5be4991c53f7] deallocate_for_instance() {{(pid=75216) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 19:05:54 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:05:54 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:05:54 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:05:54 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:05:54 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:05:55 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:05:55 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:05:55 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:05:55 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:05:55 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:05:55 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:05:55 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:05:55 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:05:55 user nova-compute[75216]: DEBUG nova.compute.manager [req-281f73a9-6c64-4f84-b385-72d2916b2c11 req-aeb15465-aef1-46f0-894c-e4f4271742cd service nova] [instance: 8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa] Received event network-vif-plugged-0f86c64c-3da6-44d9-8c74-e276f2496f35 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:05:55 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-281f73a9-6c64-4f84-b385-72d2916b2c11 req-aeb15465-aef1-46f0-894c-e4f4271742cd service nova] Acquiring lock "8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:05:55 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-281f73a9-6c64-4f84-b385-72d2916b2c11 req-aeb15465-aef1-46f0-894c-e4f4271742cd service nova] Lock "8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:05:55 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-281f73a9-6c64-4f84-b385-72d2916b2c11 req-aeb15465-aef1-46f0-894c-e4f4271742cd service nova] Lock "8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:05:55 user nova-compute[75216]: DEBUG nova.compute.manager [req-281f73a9-6c64-4f84-b385-72d2916b2c11 req-aeb15465-aef1-46f0-894c-e4f4271742cd service nova] [instance: 8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa] No waiting events found dispatching network-vif-plugged-0f86c64c-3da6-44d9-8c74-e276f2496f35 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 19:05:55 user nova-compute[75216]: WARNING nova.compute.manager [req-281f73a9-6c64-4f84-b385-72d2916b2c11 req-aeb15465-aef1-46f0-894c-e4f4271742cd service nova] [instance: 8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa] Received unexpected event network-vif-plugged-0f86c64c-3da6-44d9-8c74-e276f2496f35 for instance with vm_state active and task_state rescuing.
Nov 13 19:05:55 user nova-compute[75216]: DEBUG nova.compute.manager [req-6d09fce8-cb02-4216-be43-68eb670f059e req-8cc13e96-cd15-479d-bbfc-78d0c9dff4dd service nova] [instance: 71134725-e6cc-4426-b2c2-5be4991c53f7] Received event network-vif-plugged-a1fda64d-c09d-45d7-b1ae-be416c60918d {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:05:55 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-6d09fce8-cb02-4216-be43-68eb670f059e req-8cc13e96-cd15-479d-bbfc-78d0c9dff4dd service nova] Acquiring lock "71134725-e6cc-4426-b2c2-5be4991c53f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:05:55 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-6d09fce8-cb02-4216-be43-68eb670f059e req-8cc13e96-cd15-479d-bbfc-78d0c9dff4dd service nova] Lock "71134725-e6cc-4426-b2c2-5be4991c53f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:05:55 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-6d09fce8-cb02-4216-be43-68eb670f059e req-8cc13e96-cd15-479d-bbfc-78d0c9dff4dd service nova] Lock "71134725-e6cc-4426-b2c2-5be4991c53f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:05:55 user nova-compute[75216]: DEBUG nova.compute.manager [req-6d09fce8-cb02-4216-be43-68eb670f059e req-8cc13e96-cd15-479d-bbfc-78d0c9dff4dd service nova] [instance: 71134725-e6cc-4426-b2c2-5be4991c53f7] No waiting events found dispatching network-vif-plugged-a1fda64d-c09d-45d7-b1ae-be416c60918d {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 19:05:55 user nova-compute[75216]: WARNING nova.compute.manager [req-6d09fce8-cb02-4216-be43-68eb670f059e req-8cc13e96-cd15-479d-bbfc-78d0c9dff4dd service nova] [instance: 71134725-e6cc-4426-b2c2-5be4991c53f7] Received unexpected event network-vif-plugged-a1fda64d-c09d-45d7-b1ae-be416c60918d for instance with vm_state active and task_state deleting.
Nov 13 19:05:56 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: 71134725-e6cc-4426-b2c2-5be4991c53f7] Updating instance_info_cache with network_info: [] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:05:56 user nova-compute[75216]: INFO nova.compute.manager [-] [instance: 71134725-e6cc-4426-b2c2-5be4991c53f7] Took 1.58 seconds to deallocate network for instance.
Nov 13 19:05:56 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-5d1db8d2-58e3-4506-a4c7-8f5f3a675898 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:05:56 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-5d1db8d2-58e3-4506-a4c7-8f5f3a675898 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:05:56 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-5d1db8d2-58e3-4506-a4c7-8f5f3a675898 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 19:05:56 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-5d1db8d2-58e3-4506-a4c7-8f5f3a675898 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 19:05:56 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-5d1db8d2-58e3-4506-a4c7-8f5f3a675898 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.274s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:05:56 user nova-compute[75216]: INFO nova.scheduler.client.report [None req-5d1db8d2-58e3-4506-a4c7-8f5f3a675898 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Deleted allocations for instance 71134725-e6cc-4426-b2c2-5be4991c53f7
Nov 13 19:05:56 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-5d1db8d2-58e3-4506-a4c7-8f5f3a675898 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Lock "71134725-e6cc-4426-b2c2-5be4991c53f7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.446s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:05:57 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:05:57 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:05:57 user nova-compute[75216]: DEBUG nova.compute.manager [req-8e04d659-818b-4073-b8a5-03c4408ea5ed req-486055ac-14fe-4816-831f-5605e2a6c94a service nova] [instance: 8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa] Received event network-vif-plugged-0f86c64c-3da6-44d9-8c74-e276f2496f35 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:05:57 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-8e04d659-818b-4073-b8a5-03c4408ea5ed req-486055ac-14fe-4816-831f-5605e2a6c94a service nova] Acquiring lock "8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:05:57 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-8e04d659-818b-4073-b8a5-03c4408ea5ed req-486055ac-14fe-4816-831f-5605e2a6c94a service nova] Lock "8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:05:57 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-8e04d659-818b-4073-b8a5-03c4408ea5ed req-486055ac-14fe-4816-831f-5605e2a6c94a service nova] Lock "8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:05:57 user nova-compute[75216]: DEBUG nova.compute.manager [req-8e04d659-818b-4073-b8a5-03c4408ea5ed req-486055ac-14fe-4816-831f-5605e2a6c94a service nova] [instance: 8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa] No waiting events found dispatching network-vif-plugged-0f86c64c-3da6-44d9-8c74-e276f2496f35 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 19:05:57 user nova-compute[75216]: WARNING nova.compute.manager [req-8e04d659-818b-4073-b8a5-03c4408ea5ed req-486055ac-14fe-4816-831f-5605e2a6c94a service nova] [instance: 8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa] Received unexpected event network-vif-plugged-0f86c64c-3da6-44d9-8c74-e276f2496f35 for instance with vm_state active and task_state rescuing.
Nov 13 19:05:57 user nova-compute[75216]: DEBUG nova.compute.manager [req-8e04d659-818b-4073-b8a5-03c4408ea5ed req-486055ac-14fe-4816-831f-5605e2a6c94a service nova] [instance: 71134725-e6cc-4426-b2c2-5be4991c53f7] Received event network-vif-deleted-a1fda64d-c09d-45d7-b1ae-be416c60918d {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:05:57 user nova-compute[75216]: DEBUG nova.compute.manager [None req-494c27d0-a1d3-4545-9381-44f5a714f99e tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: 8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa] Checking state {{(pid=75216) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 19:05:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-4e1e1157-668a-4551-a1f8-ee1c01bbc68d tempest-VolumesNegativeTest-1403808012 tempest-VolumesNegativeTest-1403808012-project-member] Acquiring lock "4cc8ac6f-4187-4a76-836e-f7c50d68680d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:05:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-4e1e1157-668a-4551-a1f8-ee1c01bbc68d tempest-VolumesNegativeTest-1403808012 tempest-VolumesNegativeTest-1403808012-project-member] Lock "4cc8ac6f-4187-4a76-836e-f7c50d68680d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:05:58 user nova-compute[75216]: DEBUG nova.compute.manager [None req-4e1e1157-668a-4551-a1f8-ee1c01bbc68d tempest-VolumesNegativeTest-1403808012 tempest-VolumesNegativeTest-1403808012-project-member] [instance: 4cc8ac6f-4187-4a76-836e-f7c50d68680d] Starting instance... {{(pid=75216) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 19:05:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-4e1e1157-668a-4551-a1f8-ee1c01bbc68d tempest-VolumesNegativeTest-1403808012 tempest-VolumesNegativeTest-1403808012-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:05:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-4e1e1157-668a-4551-a1f8-ee1c01bbc68d tempest-VolumesNegativeTest-1403808012 tempest-VolumesNegativeTest-1403808012-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:05:58 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-4e1e1157-668a-4551-a1f8-ee1c01bbc68d tempest-VolumesNegativeTest-1403808012 tempest-VolumesNegativeTest-1403808012-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75216) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 19:05:58 user nova-compute[75216]: INFO nova.compute.claims [None req-4e1e1157-668a-4551-a1f8-ee1c01bbc68d tempest-VolumesNegativeTest-1403808012 tempest-VolumesNegativeTest-1403808012-project-member] [instance: 4cc8ac6f-4187-4a76-836e-f7c50d68680d] Claim successful on node user
Nov 13 19:05:58 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-4e1e1157-668a-4551-a1f8-ee1c01bbc68d tempest-VolumesNegativeTest-1403808012 tempest-VolumesNegativeTest-1403808012-project-member] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 19:05:58 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-4e1e1157-668a-4551-a1f8-ee1c01bbc68d tempest-VolumesNegativeTest-1403808012 tempest-VolumesNegativeTest-1403808012-project-member] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 19:05:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-4e1e1157-668a-4551-a1f8-ee1c01bbc68d tempest-VolumesNegativeTest-1403808012 tempest-VolumesNegativeTest-1403808012-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.312s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:05:58 user nova-compute[75216]: DEBUG nova.compute.manager [None req-4e1e1157-668a-4551-a1f8-ee1c01bbc68d tempest-VolumesNegativeTest-1403808012 tempest-VolumesNegativeTest-1403808012-project-member] [instance: 4cc8ac6f-4187-4a76-836e-f7c50d68680d] Start building networks asynchronously for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 19:05:58 user nova-compute[75216]: DEBUG nova.compute.manager [None req-4e1e1157-668a-4551-a1f8-ee1c01bbc68d tempest-VolumesNegativeTest-1403808012 tempest-VolumesNegativeTest-1403808012-project-member] [instance: 4cc8ac6f-4187-4a76-836e-f7c50d68680d] Allocating IP information in the background. {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 19:05:58 user nova-compute[75216]: DEBUG nova.network.neutron [None req-4e1e1157-668a-4551-a1f8-ee1c01bbc68d tempest-VolumesNegativeTest-1403808012 tempest-VolumesNegativeTest-1403808012-project-member] [instance: 4cc8ac6f-4187-4a76-836e-f7c50d68680d] allocate_for_instance() {{(pid=75216) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 19:05:58 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-4e1e1157-668a-4551-a1f8-ee1c01bbc68d tempest-VolumesNegativeTest-1403808012 tempest-VolumesNegativeTest-1403808012-project-member] [instance: 4cc8ac6f-4187-4a76-836e-f7c50d68680d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 19:05:58 user nova-compute[75216]: DEBUG nova.compute.manager [None req-4e1e1157-668a-4551-a1f8-ee1c01bbc68d tempest-VolumesNegativeTest-1403808012 tempest-VolumesNegativeTest-1403808012-project-member] [instance: 4cc8ac6f-4187-4a76-836e-f7c50d68680d] Start building block device mappings for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 19:05:58 user nova-compute[75216]: DEBUG nova.compute.manager [None req-4e1e1157-668a-4551-a1f8-ee1c01bbc68d tempest-VolumesNegativeTest-1403808012 tempest-VolumesNegativeTest-1403808012-project-member] [instance: 4cc8ac6f-4187-4a76-836e-f7c50d68680d] Start spawning the instance on the hypervisor. {{(pid=75216) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 19:05:58 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-4e1e1157-668a-4551-a1f8-ee1c01bbc68d tempest-VolumesNegativeTest-1403808012 tempest-VolumesNegativeTest-1403808012-project-member] [instance: 4cc8ac6f-4187-4a76-836e-f7c50d68680d] Creating instance directory {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 19:05:58 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-4e1e1157-668a-4551-a1f8-ee1c01bbc68d tempest-VolumesNegativeTest-1403808012 tempest-VolumesNegativeTest-1403808012-project-member] [instance: 4cc8ac6f-4187-4a76-836e-f7c50d68680d] Creating image(s)
Nov 13 19:05:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-4e1e1157-668a-4551-a1f8-ee1c01bbc68d tempest-VolumesNegativeTest-1403808012 tempest-VolumesNegativeTest-1403808012-project-member] Acquiring lock "/opt/stack/data/nova/instances/4cc8ac6f-4187-4a76-836e-f7c50d68680d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:05:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-4e1e1157-668a-4551-a1f8-ee1c01bbc68d tempest-VolumesNegativeTest-1403808012 tempest-VolumesNegativeTest-1403808012-project-member] Lock "/opt/stack/data/nova/instances/4cc8ac6f-4187-4a76-836e-f7c50d68680d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:05:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-4e1e1157-668a-4551-a1f8-ee1c01bbc68d tempest-VolumesNegativeTest-1403808012 tempest-VolumesNegativeTest-1403808012-project-member] Lock "/opt/stack/data/nova/instances/4cc8ac6f-4187-4a76-836e-f7c50d68680d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:05:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-4e1e1157-668a-4551-a1f8-ee1c01bbc68d tempest-VolumesNegativeTest-1403808012 tempest-VolumesNegativeTest-1403808012-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:05:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-4e1e1157-668a-4551-a1f8-ee1c01bbc68d tempest-VolumesNegativeTest-1403808012 tempest-VolumesNegativeTest-1403808012-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json" returned: 0 in 0.185s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:05:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-4e1e1157-668a-4551-a1f8-ee1c01bbc68d tempest-VolumesNegativeTest-1403808012 tempest-VolumesNegativeTest-1403808012-project-member] Acquiring lock "88c50a45bec9d6b0427462b3242b9b8e5f49c2b6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:05:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-4e1e1157-668a-4551-a1f8-ee1c01bbc68d tempest-VolumesNegativeTest-1403808012 tempest-VolumesNegativeTest-1403808012-project-member] Lock "88c50a45bec9d6b0427462b3242b9b8e5f49c2b6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:05:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-4e1e1157-668a-4551-a1f8-ee1c01bbc68d tempest-VolumesNegativeTest-1403808012 tempest-VolumesNegativeTest-1403808012-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:05:58 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:05:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-4e1e1157-668a-4551-a1f8-ee1c01bbc68d tempest-VolumesNegativeTest-1403808012 tempest-VolumesNegativeTest-1403808012-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json" returned: 0 in 0.178s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:05:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-4e1e1157-668a-4551-a1f8-ee1c01bbc68d tempest-VolumesNegativeTest-1403808012 tempest-VolumesNegativeTest-1403808012-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6,backing_fmt=raw /opt/stack/data/nova/instances/4cc8ac6f-4187-4a76-836e-f7c50d68680d/disk 1073741824 {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:05:59 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-4e1e1157-668a-4551-a1f8-ee1c01bbc68d tempest-VolumesNegativeTest-1403808012 tempest-VolumesNegativeTest-1403808012-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6,backing_fmt=raw /opt/stack/data/nova/instances/4cc8ac6f-4187-4a76-836e-f7c50d68680d/disk 1073741824" returned: 0 in 0.054s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:05:59 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-4e1e1157-668a-4551-a1f8-ee1c01bbc68d tempest-VolumesNegativeTest-1403808012 tempest-VolumesNegativeTest-1403808012-project-member] Lock "88c50a45bec9d6b0427462b3242b9b8e5f49c2b6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.238s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:05:59 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-4e1e1157-668a-4551-a1f8-ee1c01bbc68d tempest-VolumesNegativeTest-1403808012 tempest-VolumesNegativeTest-1403808012-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:05:59 user nova-compute[75216]: DEBUG nova.policy [None req-4e1e1157-668a-4551-a1f8-ee1c01bbc68d tempest-VolumesNegativeTest-1403808012 tempest-VolumesNegativeTest-1403808012-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'baaf879bc0154d429f1c0232ccdc883e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd76d07bda377422f9567698320bd873f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75216) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 19:05:59 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-4e1e1157-668a-4551-a1f8-ee1c01bbc68d tempest-VolumesNegativeTest-1403808012 tempest-VolumesNegativeTest-1403808012-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json" returned: 0 in 0.174s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:05:59 user nova-compute[75216]: DEBUG nova.virt.disk.api [None req-4e1e1157-668a-4551-a1f8-ee1c01bbc68d tempest-VolumesNegativeTest-1403808012 tempest-VolumesNegativeTest-1403808012-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4cc8ac6f-4187-4a76-836e-f7c50d68680d/disk. size=1073741824 {{(pid=75216) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 19:05:59 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-4e1e1157-668a-4551-a1f8-ee1c01bbc68d tempest-VolumesNegativeTest-1403808012 tempest-VolumesNegativeTest-1403808012-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cc8ac6f-4187-4a76-836e-f7c50d68680d/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:05:59 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-4e1e1157-668a-4551-a1f8-ee1c01bbc68d tempest-VolumesNegativeTest-1403808012 tempest-VolumesNegativeTest-1403808012-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cc8ac6f-4187-4a76-836e-f7c50d68680d/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:05:59 user nova-compute[75216]: DEBUG nova.virt.disk.api [None req-4e1e1157-668a-4551-a1f8-ee1c01bbc68d tempest-VolumesNegativeTest-1403808012 tempest-VolumesNegativeTest-1403808012-project-member] Cannot resize image /opt/stack/data/nova/instances/4cc8ac6f-4187-4a76-836e-f7c50d68680d/disk to a smaller size. {{(pid=75216) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 19:05:59 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-4e1e1157-668a-4551-a1f8-ee1c01bbc68d tempest-VolumesNegativeTest-1403808012 tempest-VolumesNegativeTest-1403808012-project-member] [instance: 4cc8ac6f-4187-4a76-836e-f7c50d68680d] Created local disks {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 19:05:59 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-4e1e1157-668a-4551-a1f8-ee1c01bbc68d tempest-VolumesNegativeTest-1403808012 tempest-VolumesNegativeTest-1403808012-project-member] [instance: 4cc8ac6f-4187-4a76-836e-f7c50d68680d] Ensure instance console log exists: /opt/stack/data/nova/instances/4cc8ac6f-4187-4a76-836e-f7c50d68680d/console.log {{(pid=75216) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 19:05:59 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-4e1e1157-668a-4551-a1f8-ee1c01bbc68d tempest-VolumesNegativeTest-1403808012 tempest-VolumesNegativeTest-1403808012-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:05:59 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-4e1e1157-668a-4551-a1f8-ee1c01bbc68d tempest-VolumesNegativeTest-1403808012 tempest-VolumesNegativeTest-1403808012-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:05:59 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-4e1e1157-668a-4551-a1f8-ee1c01bbc68d tempest-VolumesNegativeTest-1403808012 tempest-VolumesNegativeTest-1403808012-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:05:59 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:05:59 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:05:59 user nova-compute[75216]: DEBUG nova.network.neutron [None req-4e1e1157-668a-4551-a1f8-ee1c01bbc68d tempest-VolumesNegativeTest-1403808012 tempest-VolumesNegativeTest-1403808012-project-member] [instance: 4cc8ac6f-4187-4a76-836e-f7c50d68680d] Successfully created port: cc7c390d-5c06-4c13-bf6b-ac36420e8a21 {{(pid=75216) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 19:06:00 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:06:00 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75216) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 19:06:00 user nova-compute[75216]: DEBUG nova.network.neutron [None req-4e1e1157-668a-4551-a1f8-ee1c01bbc68d tempest-VolumesNegativeTest-1403808012 tempest-VolumesNegativeTest-1403808012-project-member] [instance: 4cc8ac6f-4187-4a76-836e-f7c50d68680d] Successfully updated port: cc7c390d-5c06-4c13-bf6b-ac36420e8a21 {{(pid=75216) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 19:06:00 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-4e1e1157-668a-4551-a1f8-ee1c01bbc68d tempest-VolumesNegativeTest-1403808012 tempest-VolumesNegativeTest-1403808012-project-member] Acquiring lock "refresh_cache-4cc8ac6f-4187-4a76-836e-f7c50d68680d" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 19:06:00 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-4e1e1157-668a-4551-a1f8-ee1c01bbc68d tempest-VolumesNegativeTest-1403808012 tempest-VolumesNegativeTest-1403808012-project-member] Acquired lock "refresh_cache-4cc8ac6f-4187-4a76-836e-f7c50d68680d" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 19:06:00 user nova-compute[75216]: DEBUG nova.network.neutron [None req-4e1e1157-668a-4551-a1f8-ee1c01bbc68d tempest-VolumesNegativeTest-1403808012 tempest-VolumesNegativeTest-1403808012-project-member] [instance: 4cc8ac6f-4187-4a76-836e-f7c50d68680d] Building network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 19:06:00 user nova-compute[75216]: DEBUG nova.compute.manager [req-29b561c5-378c-4066-aef4-89dbe1c4feb4 req-65af7da6-d84d-49aa-abe8-80cc648c6638 service nova] [instance: 4cc8ac6f-4187-4a76-836e-f7c50d68680d] Received event network-changed-cc7c390d-5c06-4c13-bf6b-ac36420e8a21 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:06:00 user nova-compute[75216]: DEBUG nova.compute.manager [req-29b561c5-378c-4066-aef4-89dbe1c4feb4 req-65af7da6-d84d-49aa-abe8-80cc648c6638 service nova] [instance: 4cc8ac6f-4187-4a76-836e-f7c50d68680d] Refreshing instance network info cache due to event network-changed-cc7c390d-5c06-4c13-bf6b-ac36420e8a21. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 19:06:00 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-29b561c5-378c-4066-aef4-89dbe1c4feb4 req-65af7da6-d84d-49aa-abe8-80cc648c6638 service nova] Acquiring lock "refresh_cache-4cc8ac6f-4187-4a76-836e-f7c50d68680d" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 19:06:00 user nova-compute[75216]: DEBUG nova.network.neutron [None req-4e1e1157-668a-4551-a1f8-ee1c01bbc68d tempest-VolumesNegativeTest-1403808012 tempest-VolumesNegativeTest-1403808012-project-member] [instance: 4cc8ac6f-4187-4a76-836e-f7c50d68680d] Instance cache missing network info. {{(pid=75216) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 19:06:00 user nova-compute[75216]: DEBUG nova.network.neutron [None req-4e1e1157-668a-4551-a1f8-ee1c01bbc68d tempest-VolumesNegativeTest-1403808012 tempest-VolumesNegativeTest-1403808012-project-member] [instance: 4cc8ac6f-4187-4a76-836e-f7c50d68680d] Updating instance_info_cache with network_info: [{"id": "cc7c390d-5c06-4c13-bf6b-ac36420e8a21", "address": "fa:16:3e:f0:de:30", "network": {"id": "318e2136-b0d7-42f0-9fed-da0a9463f72e", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.42", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "c465b7c26ec44582b6d1b7169536ecc0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc7c390d-5c", "ovs_interfaceid": "cc7c390d-5c06-4c13-bf6b-ac36420e8a21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:06:00 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-4e1e1157-668a-4551-a1f8-ee1c01bbc68d tempest-VolumesNegativeTest-1403808012 tempest-VolumesNegativeTest-1403808012-project-member] Releasing lock "refresh_cache-4cc8ac6f-4187-4a76-836e-f7c50d68680d" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 19:06:00 user nova-compute[75216]: DEBUG nova.compute.manager [None req-4e1e1157-668a-4551-a1f8-ee1c01bbc68d tempest-VolumesNegativeTest-1403808012 tempest-VolumesNegativeTest-1403808012-project-member] [instance: 4cc8ac6f-4187-4a76-836e-f7c50d68680d] Instance network_info: |[{"id": "cc7c390d-5c06-4c13-bf6b-ac36420e8a21", "address": "fa:16:3e:f0:de:30", "network": {"id": "318e2136-b0d7-42f0-9fed-da0a9463f72e", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.42", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "c465b7c26ec44582b6d1b7169536ecc0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc7c390d-5c", "ovs_interfaceid": "cc7c390d-5c06-4c13-bf6b-ac36420e8a21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 19:06:00 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-29b561c5-378c-4066-aef4-89dbe1c4feb4 req-65af7da6-d84d-49aa-abe8-80cc648c6638 service nova] Acquired lock "refresh_cache-4cc8ac6f-4187-4a76-836e-f7c50d68680d" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 19:06:00 user nova-compute[75216]: DEBUG nova.network.neutron [req-29b561c5-378c-4066-aef4-89dbe1c4feb4 req-65af7da6-d84d-49aa-abe8-80cc648c6638 service nova] [instance: 4cc8ac6f-4187-4a76-836e-f7c50d68680d] Refreshing network info cache for port cc7c390d-5c06-4c13-bf6b-ac36420e8a21 {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 19:06:00 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-4e1e1157-668a-4551-a1f8-ee1c01bbc68d tempest-VolumesNegativeTest-1403808012 tempest-VolumesNegativeTest-1403808012-project-member] [instance: 4cc8ac6f-4187-4a76-836e-f7c50d68680d] Start _get_guest_xml network_info=[{"id": "cc7c390d-5c06-4c13-bf6b-ac36420e8a21", "address": "fa:16:3e:f0:de:30", "network": {"id": "318e2136-b0d7-42f0-9fed-da0a9463f72e", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.42", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "c465b7c26ec44582b6d1b7169536ecc0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc7c390d-5c", "ovs_interfaceid": "cc7c390d-5c06-4c13-bf6b-ac36420e8a21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T18:41:06Z,direct_url=<?>,disk_format='qcow2',id=77bcb5ba-8510-41ec-a88d-96097bb431de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c465b7c26ec44582b6d1b7169536ecc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T18:41:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'guest_format': None, 'boot_index': 0, 'image_id': '77bcb5ba-8510-41ec-a88d-96097bb431de'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 19:06:00 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-4e1e1157-668a-4551-a1f8-ee1c01bbc68d tempest-VolumesNegativeTest-1403808012 tempest-VolumesNegativeTest-1403808012-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 19:06:00 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-4e1e1157-668a-4551-a1f8-ee1c01bbc68d tempest-VolumesNegativeTest-1403808012 tempest-VolumesNegativeTest-1403808012-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 19:06:00 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-4e1e1157-668a-4551-a1f8-ee1c01bbc68d tempest-VolumesNegativeTest-1403808012 tempest-VolumesNegativeTest-1403808012-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 19:06:00 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-4e1e1157-668a-4551-a1f8-ee1c01bbc68d tempest-VolumesNegativeTest-1403808012 tempest-VolumesNegativeTest-1403808012-project-member] CPU controller missing on host. {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 19:06:00 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-4e1e1157-668a-4551-a1f8-ee1c01bbc68d tempest-VolumesNegativeTest-1403808012 tempest-VolumesNegativeTest-1403808012-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 19:06:00 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-4e1e1157-668a-4551-a1f8-ee1c01bbc68d tempest-VolumesNegativeTest-1403808012 tempest-VolumesNegativeTest-1403808012-project-member] CPU controller found on host. {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 19:06:00 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-4e1e1157-668a-4551-a1f8-ee1c01bbc68d tempest-VolumesNegativeTest-1403808012 tempest-VolumesNegativeTest-1403808012-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75216) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 19:06:00 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-4e1e1157-668a-4551-a1f8-ee1c01bbc68d tempest-VolumesNegativeTest-1403808012 tempest-VolumesNegativeTest-1403808012-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T18:40:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T18:41:06Z,direct_url=<?>,disk_format='qcow2',id=77bcb5ba-8510-41ec-a88d-96097bb431de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c465b7c26ec44582b6d1b7169536ecc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T18:41:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 19:06:00 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-4e1e1157-668a-4551-a1f8-ee1c01bbc68d tempest-VolumesNegativeTest-1403808012 tempest-VolumesNegativeTest-1403808012-project-member] Flavor limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 19:06:00 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-4e1e1157-668a-4551-a1f8-ee1c01bbc68d tempest-VolumesNegativeTest-1403808012 tempest-VolumesNegativeTest-1403808012-project-member] Image limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 19:06:00 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-4e1e1157-668a-4551-a1f8-ee1c01bbc68d tempest-VolumesNegativeTest-1403808012 tempest-VolumesNegativeTest-1403808012-project-member] Flavor pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 19:06:00 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-4e1e1157-668a-4551-a1f8-ee1c01bbc68d tempest-VolumesNegativeTest-1403808012 tempest-VolumesNegativeTest-1403808012-project-member] Image pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 19:06:00 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-4e1e1157-668a-4551-a1f8-ee1c01bbc68d tempest-VolumesNegativeTest-1403808012 tempest-VolumesNegativeTest-1403808012-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 19:06:00 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-4e1e1157-668a-4551-a1f8-ee1c01bbc68d tempest-VolumesNegativeTest-1403808012 tempest-VolumesNegativeTest-1403808012-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 19:06:00 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-4e1e1157-668a-4551-a1f8-ee1c01bbc68d tempest-VolumesNegativeTest-1403808012 tempest-VolumesNegativeTest-1403808012-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 19:06:00 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-4e1e1157-668a-4551-a1f8-ee1c01bbc68d tempest-VolumesNegativeTest-1403808012 tempest-VolumesNegativeTest-1403808012-project-member] Got 1 possible topologies {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 19:06:00 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-4e1e1157-668a-4551-a1f8-ee1c01bbc68d tempest-VolumesNegativeTest-1403808012 tempest-VolumesNegativeTest-1403808012-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 19:06:00 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-4e1e1157-668a-4551-a1f8-ee1c01bbc68d tempest-VolumesNegativeTest-1403808012 tempest-VolumesNegativeTest-1403808012-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 19:06:00 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-4e1e1157-668a-4551-a1f8-ee1c01bbc68d tempest-VolumesNegativeTest-1403808012 tempest-VolumesNegativeTest-1403808012-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T19:05:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-300777468',display_name='tempest-VolumesNegativeTest-instance-300777468',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-300777468',id=33,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d76d07bda377422f9567698320bd873f',ramdisk_id='',reservation_id='r-hyhzt7t2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1403808012',owner_user_name='tempest-VolumesNegativeTest-1403808012-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T19:05:59Z,user_data=None,user_id='baaf879bc0154d429f1c0232ccdc883e',uuid=4cc8ac6f-4187-4a76-836e-f7c50d68680d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cc7c390d-5c06-4c13-bf6b-ac36420e8a21", "address": "fa:16:3e:f0:de:30", "network": {"id": "318e2136-b0d7-42f0-9fed-da0a9463f72e", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.42", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "c465b7c26ec44582b6d1b7169536ecc0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc7c390d-5c", "ovs_interfaceid": "cc7c390d-5c06-4c13-bf6b-ac36420e8a21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75216) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 19:06:00 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-4e1e1157-668a-4551-a1f8-ee1c01bbc68d tempest-VolumesNegativeTest-1403808012 tempest-VolumesNegativeTest-1403808012-project-member] Converting VIF {"id": "cc7c390d-5c06-4c13-bf6b-ac36420e8a21", "address": "fa:16:3e:f0:de:30", "network": {"id": "318e2136-b0d7-42f0-9fed-da0a9463f72e", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.42", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "c465b7c26ec44582b6d1b7169536ecc0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc7c390d-5c", "ovs_interfaceid": "cc7c390d-5c06-4c13-bf6b-ac36420e8a21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 19:06:00 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-4e1e1157-668a-4551-a1f8-ee1c01bbc68d tempest-VolumesNegativeTest-1403808012 tempest-VolumesNegativeTest-1403808012-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:de:30,bridge_name='br-int',has_traffic_filtering=True,id=cc7c390d-5c06-4c13-bf6b-ac36420e8a21,network=Network(318e2136-b0d7-42f0-9fed-da0a9463f72e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc7c390d-5c') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 19:06:00 user nova-compute[75216]: DEBUG nova.objects.instance [None req-4e1e1157-668a-4551-a1f8-ee1c01bbc68d tempest-VolumesNegativeTest-1403808012 tempest-VolumesNegativeTest-1403808012-project-member] Lazy-loading 'pci_devices' on Instance uuid 4cc8ac6f-4187-4a76-836e-f7c50d68680d {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:06:00 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-4e1e1157-668a-4551-a1f8-ee1c01bbc68d tempest-VolumesNegativeTest-1403808012 tempest-VolumesNegativeTest-1403808012-project-member] [instance: 4cc8ac6f-4187-4a76-836e-f7c50d68680d] End _get_guest_xml xml=<domain type="kvm">
Nov 13 19:06:00 user nova-compute[75216]:   <uuid>4cc8ac6f-4187-4a76-836e-f7c50d68680d</uuid>
Nov 13 19:06:00 user nova-compute[75216]:   <name>instance-00000021</name>
Nov 13 19:06:00 user nova-compute[75216]:   <memory>524288</memory>
Nov 13 19:06:00 user nova-compute[75216]:   <vcpu>1</vcpu>
Nov 13 19:06:00 user nova-compute[75216]:   <metadata>
Nov 13 19:06:00 user nova-compute[75216]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 19:06:00 user nova-compute[75216]:       <nova:package version="0.0.0"/>
Nov 13 19:06:00 user nova-compute[75216]:       <nova:name>tempest-VolumesNegativeTest-instance-300777468</nova:name>
Nov 13 19:06:00 user nova-compute[75216]:       <nova:creationTime>2023-11-13 19:06:00</nova:creationTime>
Nov 13 19:06:00 user nova-compute[75216]:       <nova:flavor name="m1.tiny">
Nov 13 19:06:00 user nova-compute[75216]:         <nova:memory>512</nova:memory>
Nov 13 19:06:00 user nova-compute[75216]:         <nova:disk>1</nova:disk>
Nov 13 19:06:00 user nova-compute[75216]:         <nova:swap>0</nova:swap>
Nov 13 19:06:00 user nova-compute[75216]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 19:06:00 user nova-compute[75216]:         <nova:vcpus>1</nova:vcpus>
Nov 13 19:06:00 user nova-compute[75216]:       </nova:flavor>
Nov 13 19:06:00 user nova-compute[75216]:       <nova:owner>
Nov 13 19:06:00 user nova-compute[75216]:         <nova:user uuid="baaf879bc0154d429f1c0232ccdc883e">tempest-VolumesNegativeTest-1403808012-project-member</nova:user>
Nov 13 19:06:00 user nova-compute[75216]:         <nova:project uuid="d76d07bda377422f9567698320bd873f">tempest-VolumesNegativeTest-1403808012</nova:project>
Nov 13 19:06:00 user nova-compute[75216]:       </nova:owner>
Nov 13 19:06:00 user nova-compute[75216]:       <nova:root type="image" uuid="77bcb5ba-8510-41ec-a88d-96097bb431de"/>
Nov 13 19:06:00 user nova-compute[75216]:       <nova:ports>
Nov 13 19:06:00 user nova-compute[75216]:         <nova:port uuid="cc7c390d-5c06-4c13-bf6b-ac36420e8a21">
Nov 13 19:06:00 user nova-compute[75216]:           <nova:ip type="fixed" address="192.168.233.42" ipVersion="4"/>
Nov 13 19:06:00 user nova-compute[75216]:         </nova:port>
Nov 13 19:06:00 user nova-compute[75216]:       </nova:ports>
Nov 13 19:06:00 user nova-compute[75216]:     </nova:instance>
Nov 13 19:06:00 user nova-compute[75216]:   </metadata>
Nov 13 19:06:00 user nova-compute[75216]:   <sysinfo type="smbios">
Nov 13 19:06:00 user nova-compute[75216]:     <system>
Nov 13 19:06:00 user nova-compute[75216]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 19:06:00 user nova-compute[75216]:       <entry name="product">OpenStack Nova</entry>
Nov 13 19:06:00 user nova-compute[75216]:       <entry name="version">0.0.0</entry>
Nov 13 19:06:00 user nova-compute[75216]:       <entry name="serial">4cc8ac6f-4187-4a76-836e-f7c50d68680d</entry>
Nov 13 19:06:00 user nova-compute[75216]:       <entry name="uuid">4cc8ac6f-4187-4a76-836e-f7c50d68680d</entry>
Nov 13 19:06:00 user nova-compute[75216]:       <entry name="family">Virtual Machine</entry>
Nov 13 19:06:00 user nova-compute[75216]:     </system>
Nov 13 19:06:00 user nova-compute[75216]:   </sysinfo>
Nov 13 19:06:00 user nova-compute[75216]:   <os>
Nov 13 19:06:00 user nova-compute[75216]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 19:06:00 user nova-compute[75216]:     <boot dev="hd"/>
Nov 13 19:06:00 user nova-compute[75216]:     <smbios mode="sysinfo"/>
Nov 13 19:06:00 user nova-compute[75216]:   </os>
Nov 13 19:06:00 user nova-compute[75216]:   <features>
Nov 13 19:06:00 user nova-compute[75216]:     <acpi/>
Nov 13 19:06:00 user nova-compute[75216]:     <apic/>
Nov 13 19:06:00 user nova-compute[75216]:     <vmcoreinfo/>
Nov 13 19:06:00 user nova-compute[75216]:   </features>
Nov 13 19:06:00 user nova-compute[75216]:   <clock offset="utc">
Nov 13 19:06:00 user nova-compute[75216]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 19:06:00 user nova-compute[75216]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 19:06:00 user nova-compute[75216]:     <timer name="hpet" present="no"/>
Nov 13 19:06:00 user nova-compute[75216]:   </clock>
Nov 13 19:06:00 user nova-compute[75216]:   <cpu mode="custom" match="exact">
Nov 13 19:06:00 user nova-compute[75216]:     <model>Nehalem</model>
Nov 13 19:06:00 user nova-compute[75216]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 19:06:00 user nova-compute[75216]:   </cpu>
Nov 13 19:06:00 user nova-compute[75216]:   <devices>
Nov 13 19:06:00 user nova-compute[75216]:     <disk type="file" device="disk">
Nov 13 19:06:00 user nova-compute[75216]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 19:06:00 user nova-compute[75216]:       <source file="/opt/stack/data/nova/instances/4cc8ac6f-4187-4a76-836e-f7c50d68680d/disk"/>
Nov 13 19:06:00 user nova-compute[75216]:       <target dev="vda" bus="virtio"/>
Nov 13 19:06:00 user nova-compute[75216]:     </disk>
Nov 13 19:06:00 user nova-compute[75216]:     <interface type="ethernet">
Nov 13 19:06:00 user nova-compute[75216]:       <mac address="fa:16:3e:f0:de:30"/>
Nov 13 19:06:00 user nova-compute[75216]:       <model type="virtio"/>
Nov 13 19:06:00 user nova-compute[75216]:       <mtu size="1442"/>
Nov 13 19:06:00 user nova-compute[75216]:       <target dev="tapcc7c390d-5c"/>
Nov 13 19:06:00 user nova-compute[75216]:     </interface>
Nov 13 19:06:00 user nova-compute[75216]:     <serial type="pty">
Nov 13 19:06:00 user nova-compute[75216]:       <log file="/opt/stack/data/nova/instances/4cc8ac6f-4187-4a76-836e-f7c50d68680d/console.log" append="off"/>
Nov 13 19:06:00 user nova-compute[75216]:     </serial>
Nov 13 19:06:00 user nova-compute[75216]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 19:06:00 user nova-compute[75216]:     <video>
Nov 13 19:06:00 user nova-compute[75216]:       <model type="virtio"/>
Nov 13 19:06:00 user nova-compute[75216]:     </video>
Nov 13 19:06:00 user nova-compute[75216]:     <rng model="virtio">
Nov 13 19:06:00 user nova-compute[75216]:       <backend model="random">/dev/urandom</backend>
Nov 13 19:06:00 user nova-compute[75216]:     </rng>
Nov 13 19:06:00 user nova-compute[75216]:     <controller type="usb" index="0" model="none"/>
Nov 13 19:06:00 user nova-compute[75216]:     <memballoon model="virtio">
Nov 13 19:06:00 user nova-compute[75216]:       <stats period="10"/>
Nov 13 19:06:00 user nova-compute[75216]:     </memballoon>
Nov 13 19:06:00 user nova-compute[75216]:   </devices>
Nov 13 19:06:00 user nova-compute[75216]: </domain>
Nov 13 19:06:00 user nova-compute[75216]:  {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 19:06:00 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-4e1e1157-668a-4551-a1f8-ee1c01bbc68d tempest-VolumesNegativeTest-1403808012 tempest-VolumesNegativeTest-1403808012-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T19:05:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-300777468',display_name='tempest-VolumesNegativeTest-instance-300777468',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-300777468',id=33,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d76d07bda377422f9567698320bd873f',ramdisk_id='',reservation_id='r-hyhzt7t2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1403808012',owner_user_name='tempest-VolumesNegativeTest-1403808012-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T19:05:59Z,user_data=None,user_id='baaf879bc0154d429f1c0232ccdc883e',uuid=4cc8ac6f-4187-4a76-836e-f7c50d68680d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cc7c390d-5c06-4c13-bf6b-ac36420e8a21", "address": "fa:16:3e:f0:de:30", "network": {"id": "318e2136-b0d7-42f0-9fed-da0a9463f72e", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.42", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "c465b7c26ec44582b6d1b7169536ecc0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc7c390d-5c", "ovs_interfaceid": "cc7c390d-5c06-4c13-bf6b-ac36420e8a21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 19:06:00 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-4e1e1157-668a-4551-a1f8-ee1c01bbc68d tempest-VolumesNegativeTest-1403808012 tempest-VolumesNegativeTest-1403808012-project-member] Converting VIF {"id": "cc7c390d-5c06-4c13-bf6b-ac36420e8a21", "address": "fa:16:3e:f0:de:30", "network": {"id": "318e2136-b0d7-42f0-9fed-da0a9463f72e", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.42", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "c465b7c26ec44582b6d1b7169536ecc0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc7c390d-5c", "ovs_interfaceid": "cc7c390d-5c06-4c13-bf6b-ac36420e8a21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 19:06:00 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-4e1e1157-668a-4551-a1f8-ee1c01bbc68d tempest-VolumesNegativeTest-1403808012 tempest-VolumesNegativeTest-1403808012-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:de:30,bridge_name='br-int',has_traffic_filtering=True,id=cc7c390d-5c06-4c13-bf6b-ac36420e8a21,network=Network(318e2136-b0d7-42f0-9fed-da0a9463f72e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc7c390d-5c') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 19:06:00 user nova-compute[75216]: DEBUG os_vif [None req-4e1e1157-668a-4551-a1f8-ee1c01bbc68d tempest-VolumesNegativeTest-1403808012 tempest-VolumesNegativeTest-1403808012-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:de:30,bridge_name='br-int',has_traffic_filtering=True,id=cc7c390d-5c06-4c13-bf6b-ac36420e8a21,network=Network(318e2136-b0d7-42f0-9fed-da0a9463f72e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc7c390d-5c') {{(pid=75216) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 19:06:00 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:06:00 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:06:00 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 19:06:00 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:06:00 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '45ce87d7-83a7-5a68-9205-af5d6c852226', '_type': 'linux-noop'}}, row=False) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:06:00 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:06:00 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:06:00 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:06:00 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcc7c390d-5c, may_exist=True, interface_attrs={}) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:06:00 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcc7c390d-5c, col_values=(('qos', UUID('77777971-6b99-46d5-83e5-89d0699f2ece')),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:06:00 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcc7c390d-5c, col_values=(('external_ids', {'iface-id': 'cc7c390d-5c06-4c13-bf6b-ac36420e8a21', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f0:de:30', 'vm-uuid': '4cc8ac6f-4187-4a76-836e-f7c50d68680d'}),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:06:00 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:06:00 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:06:00 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:06:00 user nova-compute[75216]: INFO os_vif [None req-4e1e1157-668a-4551-a1f8-ee1c01bbc68d tempest-VolumesNegativeTest-1403808012 tempest-VolumesNegativeTest-1403808012-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:de:30,bridge_name='br-int',has_traffic_filtering=True,id=cc7c390d-5c06-4c13-bf6b-ac36420e8a21,network=Network(318e2136-b0d7-42f0-9fed-da0a9463f72e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc7c390d-5c')
Nov 13 19:06:00 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-4e1e1157-668a-4551-a1f8-ee1c01bbc68d tempest-VolumesNegativeTest-1403808012 tempest-VolumesNegativeTest-1403808012-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 19:06:00 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-4e1e1157-668a-4551-a1f8-ee1c01bbc68d tempest-VolumesNegativeTest-1403808012 tempest-VolumesNegativeTest-1403808012-project-member] No VIF found with MAC fa:16:3e:f0:de:30, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 19:06:01 user nova-compute[75216]: DEBUG nova.network.neutron [req-29b561c5-378c-4066-aef4-89dbe1c4feb4 req-65af7da6-d84d-49aa-abe8-80cc648c6638 service nova] [instance: 4cc8ac6f-4187-4a76-836e-f7c50d68680d] Updated VIF entry in instance network info cache for port cc7c390d-5c06-4c13-bf6b-ac36420e8a21. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 19:06:01 user nova-compute[75216]: DEBUG nova.network.neutron [req-29b561c5-378c-4066-aef4-89dbe1c4feb4 req-65af7da6-d84d-49aa-abe8-80cc648c6638 service nova] [instance: 4cc8ac6f-4187-4a76-836e-f7c50d68680d] Updating instance_info_cache with network_info: [{"id": "cc7c390d-5c06-4c13-bf6b-ac36420e8a21", "address": "fa:16:3e:f0:de:30", "network": {"id": "318e2136-b0d7-42f0-9fed-da0a9463f72e", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.42", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "c465b7c26ec44582b6d1b7169536ecc0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc7c390d-5c", "ovs_interfaceid": "cc7c390d-5c06-4c13-bf6b-ac36420e8a21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:06:01 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-29b561c5-378c-4066-aef4-89dbe1c4feb4 req-65af7da6-d84d-49aa-abe8-80cc648c6638 service nova] Releasing lock "refresh_cache-4cc8ac6f-4187-4a76-836e-f7c50d68680d" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 19:06:01 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:06:02 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:06:02 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:06:02 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:06:02 user nova-compute[75216]: DEBUG nova.compute.manager [req-ad230324-5ac0-48b8-a920-c765ee4aaf32 req-13abeb45-210e-4190-84e4-9f65d0ab73a1 service nova] [instance: 4cc8ac6f-4187-4a76-836e-f7c50d68680d] Received event network-vif-plugged-cc7c390d-5c06-4c13-bf6b-ac36420e8a21 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:06:02 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-ad230324-5ac0-48b8-a920-c765ee4aaf32 req-13abeb45-210e-4190-84e4-9f65d0ab73a1 service nova] Acquiring lock "4cc8ac6f-4187-4a76-836e-f7c50d68680d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:06:02 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-ad230324-5ac0-48b8-a920-c765ee4aaf32 req-13abeb45-210e-4190-84e4-9f65d0ab73a1 service nova] Lock "4cc8ac6f-4187-4a76-836e-f7c50d68680d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:06:02 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-ad230324-5ac0-48b8-a920-c765ee4aaf32 req-13abeb45-210e-4190-84e4-9f65d0ab73a1 service nova] Lock "4cc8ac6f-4187-4a76-836e-f7c50d68680d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:06:02 user nova-compute[75216]: DEBUG nova.compute.manager [req-ad230324-5ac0-48b8-a920-c765ee4aaf32 req-13abeb45-210e-4190-84e4-9f65d0ab73a1 service nova] [instance: 4cc8ac6f-4187-4a76-836e-f7c50d68680d] No waiting events found dispatching network-vif-plugged-cc7c390d-5c06-4c13-bf6b-ac36420e8a21 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 19:06:02 user nova-compute[75216]: WARNING nova.compute.manager [req-ad230324-5ac0-48b8-a920-c765ee4aaf32 req-13abeb45-210e-4190-84e4-9f65d0ab73a1 service nova] [instance: 4cc8ac6f-4187-4a76-836e-f7c50d68680d] Received unexpected event network-vif-plugged-cc7c390d-5c06-4c13-bf6b-ac36420e8a21 for instance with vm_state building and task_state spawning.
Nov 13 19:06:02 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:06:02 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:06:03 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:06:03 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:06:03 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:06:03 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:06:03 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:06:04 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:06:04 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Starting heal instance info cache {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 19:06:04 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "refresh_cache-5c18c0ad-60e5-4ef2-97f2-b7008e89ac78" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 19:06:04 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquired lock "refresh_cache-5c18c0ad-60e5-4ef2-97f2-b7008e89ac78" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 19:06:04 user nova-compute[75216]: DEBUG nova.network.neutron [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: 5c18c0ad-60e5-4ef2-97f2-b7008e89ac78] Forcefully refreshing network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 19:06:04 user nova-compute[75216]: DEBUG nova.compute.manager [None req-4e1e1157-668a-4551-a1f8-ee1c01bbc68d tempest-VolumesNegativeTest-1403808012 tempest-VolumesNegativeTest-1403808012-project-member] [instance: 4cc8ac6f-4187-4a76-836e-f7c50d68680d] Instance event wait completed in 0 seconds for  {{(pid=75216) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 19:06:04 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-4e1e1157-668a-4551-a1f8-ee1c01bbc68d tempest-VolumesNegativeTest-1403808012 tempest-VolumesNegativeTest-1403808012-project-member] [instance: 4cc8ac6f-4187-4a76-836e-f7c50d68680d] Guest created on hypervisor {{(pid=75216) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 19:06:04 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 4cc8ac6f-4187-4a76-836e-f7c50d68680d] Instance spawned successfully.
Nov 13 19:06:04 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-4e1e1157-668a-4551-a1f8-ee1c01bbc68d tempest-VolumesNegativeTest-1403808012 tempest-VolumesNegativeTest-1403808012-project-member] [instance: 4cc8ac6f-4187-4a76-836e-f7c50d68680d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 19:06:04 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-4e1e1157-668a-4551-a1f8-ee1c01bbc68d tempest-VolumesNegativeTest-1403808012 tempest-VolumesNegativeTest-1403808012-project-member] [instance: 4cc8ac6f-4187-4a76-836e-f7c50d68680d] Found default for hw_cdrom_bus of ide {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 19:06:04 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-4e1e1157-668a-4551-a1f8-ee1c01bbc68d tempest-VolumesNegativeTest-1403808012 tempest-VolumesNegativeTest-1403808012-project-member] [instance: 4cc8ac6f-4187-4a76-836e-f7c50d68680d] Found default for hw_disk_bus of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 19:06:04 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-4e1e1157-668a-4551-a1f8-ee1c01bbc68d tempest-VolumesNegativeTest-1403808012 tempest-VolumesNegativeTest-1403808012-project-member] [instance: 4cc8ac6f-4187-4a76-836e-f7c50d68680d] Found default for hw_input_bus of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 19:06:04 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-4e1e1157-668a-4551-a1f8-ee1c01bbc68d tempest-VolumesNegativeTest-1403808012 tempest-VolumesNegativeTest-1403808012-project-member] [instance: 4cc8ac6f-4187-4a76-836e-f7c50d68680d] Found default for hw_pointer_model of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 19:06:04 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-4e1e1157-668a-4551-a1f8-ee1c01bbc68d tempest-VolumesNegativeTest-1403808012 tempest-VolumesNegativeTest-1403808012-project-member] [instance: 4cc8ac6f-4187-4a76-836e-f7c50d68680d] Found default for hw_video_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 19:06:04 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-4e1e1157-668a-4551-a1f8-ee1c01bbc68d tempest-VolumesNegativeTest-1403808012 tempest-VolumesNegativeTest-1403808012-project-member] [instance: 4cc8ac6f-4187-4a76-836e-f7c50d68680d] Found default for hw_vif_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 19:06:04 user nova-compute[75216]: DEBUG nova.compute.manager [req-e9df118c-3639-4377-bc58-4cd02577f8b6 req-f65600cb-2dea-4469-bc67-9d5712985d93 service nova] [instance: 4cc8ac6f-4187-4a76-836e-f7c50d68680d] Received event network-vif-plugged-cc7c390d-5c06-4c13-bf6b-ac36420e8a21 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:06:04 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-e9df118c-3639-4377-bc58-4cd02577f8b6 req-f65600cb-2dea-4469-bc67-9d5712985d93 service nova] Acquiring lock "4cc8ac6f-4187-4a76-836e-f7c50d68680d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:06:04 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-e9df118c-3639-4377-bc58-4cd02577f8b6 req-f65600cb-2dea-4469-bc67-9d5712985d93 service nova] Lock "4cc8ac6f-4187-4a76-836e-f7c50d68680d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:06:04 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-e9df118c-3639-4377-bc58-4cd02577f8b6 req-f65600cb-2dea-4469-bc67-9d5712985d93 service nova] Lock "4cc8ac6f-4187-4a76-836e-f7c50d68680d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:06:04 user nova-compute[75216]: DEBUG nova.compute.manager [req-e9df118c-3639-4377-bc58-4cd02577f8b6 req-f65600cb-2dea-4469-bc67-9d5712985d93 service nova] [instance: 4cc8ac6f-4187-4a76-836e-f7c50d68680d] No waiting events found dispatching network-vif-plugged-cc7c390d-5c06-4c13-bf6b-ac36420e8a21 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 19:06:04 user nova-compute[75216]: WARNING nova.compute.manager [req-e9df118c-3639-4377-bc58-4cd02577f8b6 req-f65600cb-2dea-4469-bc67-9d5712985d93 service nova] [instance: 4cc8ac6f-4187-4a76-836e-f7c50d68680d] Received unexpected event network-vif-plugged-cc7c390d-5c06-4c13-bf6b-ac36420e8a21 for instance with vm_state building and task_state spawning.
Nov 13 19:06:04 user nova-compute[75216]: INFO nova.compute.manager [None req-4e1e1157-668a-4551-a1f8-ee1c01bbc68d tempest-VolumesNegativeTest-1403808012 tempest-VolumesNegativeTest-1403808012-project-member] [instance: 4cc8ac6f-4187-4a76-836e-f7c50d68680d] Took 6.02 seconds to spawn the instance on the hypervisor.
Nov 13 19:06:04 user nova-compute[75216]: DEBUG nova.compute.manager [None req-4e1e1157-668a-4551-a1f8-ee1c01bbc68d tempest-VolumesNegativeTest-1403808012 tempest-VolumesNegativeTest-1403808012-project-member] [instance: 4cc8ac6f-4187-4a76-836e-f7c50d68680d] Checking state {{(pid=75216) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 19:06:04 user nova-compute[75216]: INFO nova.compute.manager [None req-4e1e1157-668a-4551-a1f8-ee1c01bbc68d tempest-VolumesNegativeTest-1403808012 tempest-VolumesNegativeTest-1403808012-project-member] [instance: 4cc8ac6f-4187-4a76-836e-f7c50d68680d] Took 6.63 seconds to build instance.
Nov 13 19:06:04 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-4e1e1157-668a-4551-a1f8-ee1c01bbc68d tempest-VolumesNegativeTest-1403808012 tempest-VolumesNegativeTest-1403808012-project-member] Lock "4cc8ac6f-4187-4a76-836e-f7c50d68680d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.728s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:06:04 user nova-compute[75216]: DEBUG nova.network.neutron [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: 5c18c0ad-60e5-4ef2-97f2-b7008e89ac78] Updating instance_info_cache with network_info: [{"id": "d92289be-85e7-4781-8889-2d0c7c38a9fa", "address": "fa:16:3e:ec:0e:80", "network": {"id": "f8b821ef-8fae-42b9-9055-a9ea7be955ab", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-50594548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "903397a6c0474cfd8bd1a4fb338528aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd92289be-85", "ovs_interfaceid": "d92289be-85e7-4781-8889-2d0c7c38a9fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:06:04 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Releasing lock "refresh_cache-5c18c0ad-60e5-4ef2-97f2-b7008e89ac78" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 19:06:04 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: 5c18c0ad-60e5-4ef2-97f2-b7008e89ac78] Updated the network info_cache for instance {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 19:06:04 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:06:04 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:06:04 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:06:04 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:06:04 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Auditing locally available compute resources for user (node: user) {{(pid=75216) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 19:06:05 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 19:06:05 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 19:06:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa/disk.rescue --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:06:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:06:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa/disk.rescue --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:06:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:06:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b752173-e573-426e-b9f1-bff92a4c2b55/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:06:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b752173-e573-426e-b9f1-bff92a4c2b55/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:06:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b752173-e573-426e-b9f1-bff92a4c2b55/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:06:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b752173-e573-426e-b9f1-bff92a4c2b55/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:06:05 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 19:06:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:06:05 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:06:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:06:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:06:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:06:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cc8ac6f-4187-4a76-836e-f7c50d68680d/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:06:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cc8ac6f-4187-4a76-836e-f7c50d68680d/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:06:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cc8ac6f-4187-4a76-836e-f7c50d68680d/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:06:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cc8ac6f-4187-4a76-836e-f7c50d68680d/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:06:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f21b2014-51e5-423d-baad-7ee2a7a74ca4/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:06:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f21b2014-51e5-423d-baad-7ee2a7a74ca4/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:06:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f21b2014-51e5-423d-baad-7ee2a7a74ca4/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:06:07 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f21b2014-51e5-423d-baad-7ee2a7a74ca4/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:06:07 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c18c0ad-60e5-4ef2-97f2-b7008e89ac78/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:06:07 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c18c0ad-60e5-4ef2-97f2-b7008e89ac78/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:06:07 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c18c0ad-60e5-4ef2-97f2-b7008e89ac78/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:06:07 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c18c0ad-60e5-4ef2-97f2-b7008e89ac78/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:06:07 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 19:06:07 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 19:06:07 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Hypervisor/Node resource view: name=user free_ram=8195MB free_disk=25.202869415283203GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75216) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 19:06:07 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:06:07 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:06:08 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 19:06:08 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance 1e5f1164-a15e-40cf-b7bc-5aeb404a1216 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 19:06:08 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance 5c18c0ad-60e5-4ef2-97f2-b7008e89ac78 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 19:06:08 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance 7b752173-e573-426e-b9f1-bff92a4c2b55 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 19:06:08 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance 8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 19:06:08 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance f21b2014-51e5-423d-baad-7ee2a7a74ca4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 19:06:08 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance 4cc8ac6f-4187-4a76-836e-f7c50d68680d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 19:06:08 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 19:06:08 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 19:06:08 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Refreshing inventories for resource provider d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 13 19:06:08 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Updating ProviderTree inventory for provider d927e00d-5a8b-43f7-ac04-6437958fac1f from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 13 19:06:08 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Updating inventory in ProviderTree for provider d927e00d-5a8b-43f7-ac04-6437958fac1f with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 13 19:06:08 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Refreshing aggregate associations for resource provider d927e00d-5a8b-43f7-ac04-6437958fac1f, aggregates: None {{(pid=75216) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 13 19:06:08 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Refreshing trait associations for resource provider d927e00d-5a8b-43f7-ac04-6437958fac1f, traits: COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_MMX {{(pid=75216) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 13 19:06:08 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 19:06:08 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 19:06:08 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Compute_service record updated for user:user {{(pid=75216) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 19:06:08 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.840s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:06:08 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:06:08 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Cleaning up deleted instances {{(pid=75216) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 13 19:06:08 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] There are 0 instances to clean {{(pid=75216) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 13 19:06:08 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:06:08 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75216) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 13 19:06:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:06:10 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:06:13 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:06:15 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:06:18 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:06:20 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:06:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:06:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:06:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:06:30 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:06:33 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:06:35 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:06:38 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:06:40 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:06:44 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:06:45 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:06:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e5251281-d049-4ee5-ae0f-91423eeb4714 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Acquiring lock "fc2b6a17-b3bf-42da-ad68-2f125c952a31" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:06:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e5251281-d049-4ee5-ae0f-91423eeb4714 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Lock "fc2b6a17-b3bf-42da-ad68-2f125c952a31" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:06:47 user nova-compute[75216]: DEBUG nova.compute.manager [None req-e5251281-d049-4ee5-ae0f-91423eeb4714 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] [instance: fc2b6a17-b3bf-42da-ad68-2f125c952a31] Starting instance... {{(pid=75216) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 19:06:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e5251281-d049-4ee5-ae0f-91423eeb4714 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:06:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e5251281-d049-4ee5-ae0f-91423eeb4714 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:06:47 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-e5251281-d049-4ee5-ae0f-91423eeb4714 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75216) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 19:06:47 user nova-compute[75216]: INFO nova.compute.claims [None req-e5251281-d049-4ee5-ae0f-91423eeb4714 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] [instance: fc2b6a17-b3bf-42da-ad68-2f125c952a31] Claim successful on node user
Nov 13 19:06:47 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-e5251281-d049-4ee5-ae0f-91423eeb4714 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 19:06:47 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-e5251281-d049-4ee5-ae0f-91423eeb4714 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 19:06:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e5251281-d049-4ee5-ae0f-91423eeb4714 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.333s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:06:47 user nova-compute[75216]: DEBUG nova.compute.manager [None req-e5251281-d049-4ee5-ae0f-91423eeb4714 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] [instance: fc2b6a17-b3bf-42da-ad68-2f125c952a31] Start building networks asynchronously for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 19:06:47 user nova-compute[75216]: DEBUG nova.compute.manager [None req-e5251281-d049-4ee5-ae0f-91423eeb4714 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] [instance: fc2b6a17-b3bf-42da-ad68-2f125c952a31] Allocating IP information in the background. {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 19:06:47 user nova-compute[75216]: DEBUG nova.network.neutron [None req-e5251281-d049-4ee5-ae0f-91423eeb4714 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] [instance: fc2b6a17-b3bf-42da-ad68-2f125c952a31] allocate_for_instance() {{(pid=75216) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 19:06:47 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-e5251281-d049-4ee5-ae0f-91423eeb4714 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] [instance: fc2b6a17-b3bf-42da-ad68-2f125c952a31] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 19:06:47 user nova-compute[75216]: DEBUG nova.compute.manager [None req-e5251281-d049-4ee5-ae0f-91423eeb4714 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] [instance: fc2b6a17-b3bf-42da-ad68-2f125c952a31] Start building block device mappings for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 19:06:47 user nova-compute[75216]: DEBUG nova.policy [None req-e5251281-d049-4ee5-ae0f-91423eeb4714 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7e59bd525db64698b8e3587734cde6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58d1e76a793406bbdd3821ff74abd92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75216) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 19:06:47 user nova-compute[75216]: DEBUG nova.compute.manager [None req-e5251281-d049-4ee5-ae0f-91423eeb4714 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] [instance: fc2b6a17-b3bf-42da-ad68-2f125c952a31] Start spawning the instance on the hypervisor. {{(pid=75216) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 19:06:47 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-e5251281-d049-4ee5-ae0f-91423eeb4714 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] [instance: fc2b6a17-b3bf-42da-ad68-2f125c952a31] Creating instance directory {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 19:06:47 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-e5251281-d049-4ee5-ae0f-91423eeb4714 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] [instance: fc2b6a17-b3bf-42da-ad68-2f125c952a31] Creating image(s)
Nov 13 19:06:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e5251281-d049-4ee5-ae0f-91423eeb4714 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Acquiring lock "/opt/stack/data/nova/instances/fc2b6a17-b3bf-42da-ad68-2f125c952a31/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:06:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e5251281-d049-4ee5-ae0f-91423eeb4714 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Lock "/opt/stack/data/nova/instances/fc2b6a17-b3bf-42da-ad68-2f125c952a31/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:06:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e5251281-d049-4ee5-ae0f-91423eeb4714 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Lock "/opt/stack/data/nova/instances/fc2b6a17-b3bf-42da-ad68-2f125c952a31/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:06:47 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-e5251281-d049-4ee5-ae0f-91423eeb4714 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:06:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-e5251281-d049-4ee5-ae0f-91423eeb4714 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json" returned: 0 in 0.171s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:06:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e5251281-d049-4ee5-ae0f-91423eeb4714 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Acquiring lock "88c50a45bec9d6b0427462b3242b9b8e5f49c2b6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:06:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e5251281-d049-4ee5-ae0f-91423eeb4714 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Lock "88c50a45bec9d6b0427462b3242b9b8e5f49c2b6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:06:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-e5251281-d049-4ee5-ae0f-91423eeb4714 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:06:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-e5251281-d049-4ee5-ae0f-91423eeb4714 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json" returned: 0 in 0.170s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:06:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-e5251281-d049-4ee5-ae0f-91423eeb4714 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6,backing_fmt=raw /opt/stack/data/nova/instances/fc2b6a17-b3bf-42da-ad68-2f125c952a31/disk 1073741824 {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:06:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-e5251281-d049-4ee5-ae0f-91423eeb4714 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6,backing_fmt=raw /opt/stack/data/nova/instances/fc2b6a17-b3bf-42da-ad68-2f125c952a31/disk 1073741824" returned: 0 in 0.050s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:06:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e5251281-d049-4ee5-ae0f-91423eeb4714 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Lock "88c50a45bec9d6b0427462b3242b9b8e5f49c2b6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.229s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:06:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-e5251281-d049-4ee5-ae0f-91423eeb4714 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:06:48 user nova-compute[75216]: DEBUG nova.network.neutron [None req-e5251281-d049-4ee5-ae0f-91423eeb4714 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] [instance: fc2b6a17-b3bf-42da-ad68-2f125c952a31] Successfully created port: 4621e43a-a523-4506-8520-bcca759faa35 {{(pid=75216) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 19:06:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-e5251281-d049-4ee5-ae0f-91423eeb4714 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json" returned: 0 in 0.172s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:06:48 user nova-compute[75216]: DEBUG nova.virt.disk.api [None req-e5251281-d049-4ee5-ae0f-91423eeb4714 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fc2b6a17-b3bf-42da-ad68-2f125c952a31/disk. size=1073741824 {{(pid=75216) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 19:06:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-e5251281-d049-4ee5-ae0f-91423eeb4714 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc2b6a17-b3bf-42da-ad68-2f125c952a31/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:06:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-e5251281-d049-4ee5-ae0f-91423eeb4714 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc2b6a17-b3bf-42da-ad68-2f125c952a31/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:06:48 user nova-compute[75216]: DEBUG nova.virt.disk.api [None req-e5251281-d049-4ee5-ae0f-91423eeb4714 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Cannot resize image /opt/stack/data/nova/instances/fc2b6a17-b3bf-42da-ad68-2f125c952a31/disk to a smaller size. {{(pid=75216) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 19:06:48 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-e5251281-d049-4ee5-ae0f-91423eeb4714 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] [instance: fc2b6a17-b3bf-42da-ad68-2f125c952a31] Created local disks {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 19:06:48 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-e5251281-d049-4ee5-ae0f-91423eeb4714 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] [instance: fc2b6a17-b3bf-42da-ad68-2f125c952a31] Ensure instance console log exists: /opt/stack/data/nova/instances/fc2b6a17-b3bf-42da-ad68-2f125c952a31/console.log {{(pid=75216) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 19:06:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e5251281-d049-4ee5-ae0f-91423eeb4714 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:06:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e5251281-d049-4ee5-ae0f-91423eeb4714 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:06:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e5251281-d049-4ee5-ae0f-91423eeb4714 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:06:48 user nova-compute[75216]: DEBUG nova.network.neutron [None req-e5251281-d049-4ee5-ae0f-91423eeb4714 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] [instance: fc2b6a17-b3bf-42da-ad68-2f125c952a31] Successfully updated port: 4621e43a-a523-4506-8520-bcca759faa35 {{(pid=75216) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 19:06:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e5251281-d049-4ee5-ae0f-91423eeb4714 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Acquiring lock "refresh_cache-fc2b6a17-b3bf-42da-ad68-2f125c952a31" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 19:06:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e5251281-d049-4ee5-ae0f-91423eeb4714 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Acquired lock "refresh_cache-fc2b6a17-b3bf-42da-ad68-2f125c952a31" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 19:06:48 user nova-compute[75216]: DEBUG nova.network.neutron [None req-e5251281-d049-4ee5-ae0f-91423eeb4714 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] [instance: fc2b6a17-b3bf-42da-ad68-2f125c952a31] Building network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 19:06:49 user nova-compute[75216]: DEBUG nova.network.neutron [None req-e5251281-d049-4ee5-ae0f-91423eeb4714 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] [instance: fc2b6a17-b3bf-42da-ad68-2f125c952a31] Instance cache missing network info. {{(pid=75216) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 19:06:49 user nova-compute[75216]: DEBUG nova.compute.manager [req-2b227ff0-3d3b-4fb2-8e61-14bc6929779d req-4e2c2f02-ef2c-46c7-ad3f-c89b1f9a22ea service nova] [instance: fc2b6a17-b3bf-42da-ad68-2f125c952a31] Received event network-changed-4621e43a-a523-4506-8520-bcca759faa35 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:06:49 user nova-compute[75216]: DEBUG nova.compute.manager [req-2b227ff0-3d3b-4fb2-8e61-14bc6929779d req-4e2c2f02-ef2c-46c7-ad3f-c89b1f9a22ea service nova] [instance: fc2b6a17-b3bf-42da-ad68-2f125c952a31] Refreshing instance network info cache due to event network-changed-4621e43a-a523-4506-8520-bcca759faa35. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 19:06:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-2b227ff0-3d3b-4fb2-8e61-14bc6929779d req-4e2c2f02-ef2c-46c7-ad3f-c89b1f9a22ea service nova] Acquiring lock "refresh_cache-fc2b6a17-b3bf-42da-ad68-2f125c952a31" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 19:06:49 user nova-compute[75216]: DEBUG nova.network.neutron [None req-e5251281-d049-4ee5-ae0f-91423eeb4714 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] [instance: fc2b6a17-b3bf-42da-ad68-2f125c952a31] Updating instance_info_cache with network_info: [{"id": "4621e43a-a523-4506-8520-bcca759faa35", "address": "fa:16:3e:58:6e:5f", "network": {"id": "8cbeb1cc-a067-4c8d-82d8-0dc5c2ac924c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-742672345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a58d1e76a793406bbdd3821ff74abd92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4621e43a-a5", "ovs_interfaceid": "4621e43a-a523-4506-8520-bcca759faa35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:06:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e5251281-d049-4ee5-ae0f-91423eeb4714 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Releasing lock "refresh_cache-fc2b6a17-b3bf-42da-ad68-2f125c952a31" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 19:06:49 user nova-compute[75216]: DEBUG nova.compute.manager [None req-e5251281-d049-4ee5-ae0f-91423eeb4714 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] [instance: fc2b6a17-b3bf-42da-ad68-2f125c952a31] Instance network_info: |[{"id": "4621e43a-a523-4506-8520-bcca759faa35", "address": "fa:16:3e:58:6e:5f", "network": {"id": "8cbeb1cc-a067-4c8d-82d8-0dc5c2ac924c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-742672345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a58d1e76a793406bbdd3821ff74abd92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4621e43a-a5", "ovs_interfaceid": "4621e43a-a523-4506-8520-bcca759faa35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 19:06:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-2b227ff0-3d3b-4fb2-8e61-14bc6929779d req-4e2c2f02-ef2c-46c7-ad3f-c89b1f9a22ea service nova] Acquired lock "refresh_cache-fc2b6a17-b3bf-42da-ad68-2f125c952a31" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 19:06:49 user nova-compute[75216]: DEBUG nova.network.neutron [req-2b227ff0-3d3b-4fb2-8e61-14bc6929779d req-4e2c2f02-ef2c-46c7-ad3f-c89b1f9a22ea service nova] [instance: fc2b6a17-b3bf-42da-ad68-2f125c952a31] Refreshing network info cache for port 4621e43a-a523-4506-8520-bcca759faa35 {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 19:06:49 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-e5251281-d049-4ee5-ae0f-91423eeb4714 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] [instance: fc2b6a17-b3bf-42da-ad68-2f125c952a31] Start _get_guest_xml network_info=[{"id": "4621e43a-a523-4506-8520-bcca759faa35", "address": "fa:16:3e:58:6e:5f", "network": {"id": "8cbeb1cc-a067-4c8d-82d8-0dc5c2ac924c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-742672345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a58d1e76a793406bbdd3821ff74abd92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4621e43a-a5", "ovs_interfaceid": "4621e43a-a523-4506-8520-bcca759faa35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T18:41:06Z,direct_url=<?>,disk_format='qcow2',id=77bcb5ba-8510-41ec-a88d-96097bb431de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c465b7c26ec44582b6d1b7169536ecc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T18:41:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'guest_format': None, 'boot_index': 0, 'image_id': '77bcb5ba-8510-41ec-a88d-96097bb431de'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 19:06:49 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-e5251281-d049-4ee5-ae0f-91423eeb4714 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 19:06:49 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-e5251281-d049-4ee5-ae0f-91423eeb4714 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 19:06:49 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-e5251281-d049-4ee5-ae0f-91423eeb4714 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 19:06:49 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-e5251281-d049-4ee5-ae0f-91423eeb4714 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] CPU controller missing on host. {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 19:06:49 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-e5251281-d049-4ee5-ae0f-91423eeb4714 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 19:06:49 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-e5251281-d049-4ee5-ae0f-91423eeb4714 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] CPU controller found on host. {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 19:06:49 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-e5251281-d049-4ee5-ae0f-91423eeb4714 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75216) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 19:06:49 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-e5251281-d049-4ee5-ae0f-91423eeb4714 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T18:40:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T18:41:06Z,direct_url=<?>,disk_format='qcow2',id=77bcb5ba-8510-41ec-a88d-96097bb431de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c465b7c26ec44582b6d1b7169536ecc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T18:41:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 19:06:49 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-e5251281-d049-4ee5-ae0f-91423eeb4714 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Flavor limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 19:06:49 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-e5251281-d049-4ee5-ae0f-91423eeb4714 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Image limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 19:06:49 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-e5251281-d049-4ee5-ae0f-91423eeb4714 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Flavor pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 19:06:49 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-e5251281-d049-4ee5-ae0f-91423eeb4714 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Image pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 19:06:49 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-e5251281-d049-4ee5-ae0f-91423eeb4714 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 19:06:49 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-e5251281-d049-4ee5-ae0f-91423eeb4714 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 19:06:49 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-e5251281-d049-4ee5-ae0f-91423eeb4714 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 19:06:49 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-e5251281-d049-4ee5-ae0f-91423eeb4714 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Got 1 possible topologies {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 19:06:49 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-e5251281-d049-4ee5-ae0f-91423eeb4714 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 19:06:49 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-e5251281-d049-4ee5-ae0f-91423eeb4714 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 19:06:49 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-e5251281-d049-4ee5-ae0f-91423eeb4714 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T19:06:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1100425294',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1100425294',id=34,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLQQ4b0ZgFgW0WLUck0T8rTYpv9XskxQgqhkS9uzqraM7b70xziVxvyZlVKxIrkuAfXiPHYbxqzjoM3edHEog9CZ0MEhMfcDmXiqrq1oF6XaoxsWh3j2G+HncdUW44bIuw==',key_name='tempest-keypair-569881079',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a58d1e76a793406bbdd3821ff74abd92',ramdisk_id='',reservation_id='r-ie2w7xdd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1861834155',owner_user_name='tempest-AttachVolumeShelveTestJSON-1861834155-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T19:06:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e59bd525db64698b8e3587734cde6b8',uuid=fc2b6a17-b3bf-42da-ad68-2f125c952a31,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4621e43a-a523-4506-8520-bcca759faa35", "address": "fa:16:3e:58:6e:5f", "network": {"id": "8cbeb1cc-a067-4c8d-82d8-0dc5c2ac924c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-742672345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a58d1e76a793406bbdd3821ff74abd92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4621e43a-a5", "ovs_interfaceid": "4621e43a-a523-4506-8520-bcca759faa35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75216) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 19:06:49 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-e5251281-d049-4ee5-ae0f-91423eeb4714 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Converting VIF {"id": "4621e43a-a523-4506-8520-bcca759faa35", "address": "fa:16:3e:58:6e:5f", "network": {"id": "8cbeb1cc-a067-4c8d-82d8-0dc5c2ac924c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-742672345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a58d1e76a793406bbdd3821ff74abd92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4621e43a-a5", "ovs_interfaceid": "4621e43a-a523-4506-8520-bcca759faa35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 19:06:49 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-e5251281-d049-4ee5-ae0f-91423eeb4714 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:6e:5f,bridge_name='br-int',has_traffic_filtering=True,id=4621e43a-a523-4506-8520-bcca759faa35,network=Network(8cbeb1cc-a067-4c8d-82d8-0dc5c2ac924c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4621e43a-a5') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 19:06:49 user nova-compute[75216]: DEBUG nova.objects.instance [None req-e5251281-d049-4ee5-ae0f-91423eeb4714 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Lazy-loading 'pci_devices' on Instance uuid fc2b6a17-b3bf-42da-ad68-2f125c952a31 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:06:49 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-e5251281-d049-4ee5-ae0f-91423eeb4714 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] [instance: fc2b6a17-b3bf-42da-ad68-2f125c952a31] End _get_guest_xml xml=<domain type="kvm">
Nov 13 19:06:49 user nova-compute[75216]:   <uuid>fc2b6a17-b3bf-42da-ad68-2f125c952a31</uuid>
Nov 13 19:06:49 user nova-compute[75216]:   <name>instance-00000022</name>
Nov 13 19:06:49 user nova-compute[75216]:   <memory>524288</memory>
Nov 13 19:06:49 user nova-compute[75216]:   <vcpu>1</vcpu>
Nov 13 19:06:49 user nova-compute[75216]:   <metadata>
Nov 13 19:06:49 user nova-compute[75216]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 19:06:49 user nova-compute[75216]:       <nova:package version="0.0.0"/>
Nov 13 19:06:49 user nova-compute[75216]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1100425294</nova:name>
Nov 13 19:06:49 user nova-compute[75216]:       <nova:creationTime>2023-11-13 19:06:49</nova:creationTime>
Nov 13 19:06:49 user nova-compute[75216]:       <nova:flavor name="m1.tiny">
Nov 13 19:06:49 user nova-compute[75216]:         <nova:memory>512</nova:memory>
Nov 13 19:06:49 user nova-compute[75216]:         <nova:disk>1</nova:disk>
Nov 13 19:06:49 user nova-compute[75216]:         <nova:swap>0</nova:swap>
Nov 13 19:06:49 user nova-compute[75216]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 19:06:49 user nova-compute[75216]:         <nova:vcpus>1</nova:vcpus>
Nov 13 19:06:49 user nova-compute[75216]:       </nova:flavor>
Nov 13 19:06:49 user nova-compute[75216]:       <nova:owner>
Nov 13 19:06:49 user nova-compute[75216]:         <nova:user uuid="7e59bd525db64698b8e3587734cde6b8">tempest-AttachVolumeShelveTestJSON-1861834155-project-member</nova:user>
Nov 13 19:06:49 user nova-compute[75216]:         <nova:project uuid="a58d1e76a793406bbdd3821ff74abd92">tempest-AttachVolumeShelveTestJSON-1861834155</nova:project>
Nov 13 19:06:49 user nova-compute[75216]:       </nova:owner>
Nov 13 19:06:49 user nova-compute[75216]:       <nova:root type="image" uuid="77bcb5ba-8510-41ec-a88d-96097bb431de"/>
Nov 13 19:06:49 user nova-compute[75216]:       <nova:ports>
Nov 13 19:06:49 user nova-compute[75216]:         <nova:port uuid="4621e43a-a523-4506-8520-bcca759faa35">
Nov 13 19:06:49 user nova-compute[75216]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 13 19:06:49 user nova-compute[75216]:         </nova:port>
Nov 13 19:06:49 user nova-compute[75216]:       </nova:ports>
Nov 13 19:06:49 user nova-compute[75216]:     </nova:instance>
Nov 13 19:06:49 user nova-compute[75216]:   </metadata>
Nov 13 19:06:49 user nova-compute[75216]:   <sysinfo type="smbios">
Nov 13 19:06:49 user nova-compute[75216]:     <system>
Nov 13 19:06:49 user nova-compute[75216]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 19:06:49 user nova-compute[75216]:       <entry name="product">OpenStack Nova</entry>
Nov 13 19:06:49 user nova-compute[75216]:       <entry name="version">0.0.0</entry>
Nov 13 19:06:49 user nova-compute[75216]:       <entry name="serial">fc2b6a17-b3bf-42da-ad68-2f125c952a31</entry>
Nov 13 19:06:49 user nova-compute[75216]:       <entry name="uuid">fc2b6a17-b3bf-42da-ad68-2f125c952a31</entry>
Nov 13 19:06:49 user nova-compute[75216]:       <entry name="family">Virtual Machine</entry>
Nov 13 19:06:49 user nova-compute[75216]:     </system>
Nov 13 19:06:49 user nova-compute[75216]:   </sysinfo>
Nov 13 19:06:49 user nova-compute[75216]:   <os>
Nov 13 19:06:49 user nova-compute[75216]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 19:06:49 user nova-compute[75216]:     <boot dev="hd"/>
Nov 13 19:06:49 user nova-compute[75216]:     <smbios mode="sysinfo"/>
Nov 13 19:06:49 user nova-compute[75216]:   </os>
Nov 13 19:06:49 user nova-compute[75216]:   <features>
Nov 13 19:06:49 user nova-compute[75216]:     <acpi/>
Nov 13 19:06:49 user nova-compute[75216]:     <apic/>
Nov 13 19:06:49 user nova-compute[75216]:     <vmcoreinfo/>
Nov 13 19:06:49 user nova-compute[75216]:   </features>
Nov 13 19:06:49 user nova-compute[75216]:   <clock offset="utc">
Nov 13 19:06:49 user nova-compute[75216]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 19:06:49 user nova-compute[75216]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 19:06:49 user nova-compute[75216]:     <timer name="hpet" present="no"/>
Nov 13 19:06:49 user nova-compute[75216]:   </clock>
Nov 13 19:06:49 user nova-compute[75216]:   <cpu mode="custom" match="exact">
Nov 13 19:06:49 user nova-compute[75216]:     <model>Nehalem</model>
Nov 13 19:06:49 user nova-compute[75216]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 19:06:49 user nova-compute[75216]:   </cpu>
Nov 13 19:06:49 user nova-compute[75216]:   <devices>
Nov 13 19:06:49 user nova-compute[75216]:     <disk type="file" device="disk">
Nov 13 19:06:49 user nova-compute[75216]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 19:06:49 user nova-compute[75216]:       <source file="/opt/stack/data/nova/instances/fc2b6a17-b3bf-42da-ad68-2f125c952a31/disk"/>
Nov 13 19:06:49 user nova-compute[75216]:       <target dev="vda" bus="virtio"/>
Nov 13 19:06:49 user nova-compute[75216]:     </disk>
Nov 13 19:06:49 user nova-compute[75216]:     <interface type="ethernet">
Nov 13 19:06:49 user nova-compute[75216]:       <mac address="fa:16:3e:58:6e:5f"/>
Nov 13 19:06:49 user nova-compute[75216]:       <model type="virtio"/>
Nov 13 19:06:49 user nova-compute[75216]:       <mtu size="1442"/>
Nov 13 19:06:49 user nova-compute[75216]:       <target dev="tap4621e43a-a5"/>
Nov 13 19:06:49 user nova-compute[75216]:     </interface>
Nov 13 19:06:49 user nova-compute[75216]:     <serial type="pty">
Nov 13 19:06:49 user nova-compute[75216]:       <log file="/opt/stack/data/nova/instances/fc2b6a17-b3bf-42da-ad68-2f125c952a31/console.log" append="off"/>
Nov 13 19:06:49 user nova-compute[75216]:     </serial>
Nov 13 19:06:49 user nova-compute[75216]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 19:06:49 user nova-compute[75216]:     <video>
Nov 13 19:06:49 user nova-compute[75216]:       <model type="virtio"/>
Nov 13 19:06:49 user nova-compute[75216]:     </video>
Nov 13 19:06:49 user nova-compute[75216]:     <rng model="virtio">
Nov 13 19:06:49 user nova-compute[75216]:       <backend model="random">/dev/urandom</backend>
Nov 13 19:06:49 user nova-compute[75216]:     </rng>
Nov 13 19:06:49 user nova-compute[75216]:     <controller type="usb" index="0" model="none"/>
Nov 13 19:06:49 user nova-compute[75216]:     <memballoon model="virtio">
Nov 13 19:06:49 user nova-compute[75216]:       <stats period="10"/>
Nov 13 19:06:49 user nova-compute[75216]:     </memballoon>
Nov 13 19:06:49 user nova-compute[75216]:   </devices>
Nov 13 19:06:49 user nova-compute[75216]: </domain>
Nov 13 19:06:49 user nova-compute[75216]:  {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 19:06:49 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-e5251281-d049-4ee5-ae0f-91423eeb4714 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T19:06:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1100425294',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1100425294',id=34,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLQQ4b0ZgFgW0WLUck0T8rTYpv9XskxQgqhkS9uzqraM7b70xziVxvyZlVKxIrkuAfXiPHYbxqzjoM3edHEog9CZ0MEhMfcDmXiqrq1oF6XaoxsWh3j2G+HncdUW44bIuw==',key_name='tempest-keypair-569881079',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a58d1e76a793406bbdd3821ff74abd92',ramdisk_id='',reservation_id='r-ie2w7xdd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1861834155',owner_user_name='tempest-AttachVolumeShelveTestJSON-1861834155-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T19:06:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e59bd525db64698b8e3587734cde6b8',uuid=fc2b6a17-b3bf-42da-ad68-2f125c952a31,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4621e43a-a523-4506-8520-bcca759faa35", "address": "fa:16:3e:58:6e:5f", "network": {"id": "8cbeb1cc-a067-4c8d-82d8-0dc5c2ac924c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-742672345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a58d1e76a793406bbdd3821ff74abd92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4621e43a-a5", "ovs_interfaceid": "4621e43a-a523-4506-8520-bcca759faa35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 19:06:49 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-e5251281-d049-4ee5-ae0f-91423eeb4714 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Converting VIF {"id": "4621e43a-a523-4506-8520-bcca759faa35", "address": "fa:16:3e:58:6e:5f", "network": {"id": "8cbeb1cc-a067-4c8d-82d8-0dc5c2ac924c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-742672345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a58d1e76a793406bbdd3821ff74abd92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4621e43a-a5", "ovs_interfaceid": "4621e43a-a523-4506-8520-bcca759faa35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 19:06:49 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-e5251281-d049-4ee5-ae0f-91423eeb4714 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:6e:5f,bridge_name='br-int',has_traffic_filtering=True,id=4621e43a-a523-4506-8520-bcca759faa35,network=Network(8cbeb1cc-a067-4c8d-82d8-0dc5c2ac924c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4621e43a-a5') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 19:06:49 user nova-compute[75216]: DEBUG os_vif [None req-e5251281-d049-4ee5-ae0f-91423eeb4714 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:6e:5f,bridge_name='br-int',has_traffic_filtering=True,id=4621e43a-a523-4506-8520-bcca759faa35,network=Network(8cbeb1cc-a067-4c8d-82d8-0dc5c2ac924c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4621e43a-a5') {{(pid=75216) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 19:06:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:06:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:06:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 19:06:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:06:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ee114007-50e8-54f5-9905-a7d2a6373cd4', '_type': 'linux-noop'}}, row=False) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:06:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:06:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:06:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:06:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4621e43a-a5, may_exist=True, interface_attrs={}) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:06:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4621e43a-a5, col_values=(('qos', UUID('005553b9-54c4-4d93-8532-07dbeb85c820')),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:06:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4621e43a-a5, col_values=(('external_ids', {'iface-id': '4621e43a-a523-4506-8520-bcca759faa35', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:58:6e:5f', 'vm-uuid': 'fc2b6a17-b3bf-42da-ad68-2f125c952a31'}),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:06:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:06:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:06:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:06:49 user nova-compute[75216]: INFO os_vif [None req-e5251281-d049-4ee5-ae0f-91423eeb4714 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:6e:5f,bridge_name='br-int',has_traffic_filtering=True,id=4621e43a-a523-4506-8520-bcca759faa35,network=Network(8cbeb1cc-a067-4c8d-82d8-0dc5c2ac924c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4621e43a-a5')
Nov 13 19:06:49 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-e5251281-d049-4ee5-ae0f-91423eeb4714 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 19:06:49 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-e5251281-d049-4ee5-ae0f-91423eeb4714 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] No VIF found with MAC fa:16:3e:58:6e:5f, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 19:06:49 user nova-compute[75216]: DEBUG nova.network.neutron [req-2b227ff0-3d3b-4fb2-8e61-14bc6929779d req-4e2c2f02-ef2c-46c7-ad3f-c89b1f9a22ea service nova] [instance: fc2b6a17-b3bf-42da-ad68-2f125c952a31] Updated VIF entry in instance network info cache for port 4621e43a-a523-4506-8520-bcca759faa35. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 19:06:49 user nova-compute[75216]: DEBUG nova.network.neutron [req-2b227ff0-3d3b-4fb2-8e61-14bc6929779d req-4e2c2f02-ef2c-46c7-ad3f-c89b1f9a22ea service nova] [instance: fc2b6a17-b3bf-42da-ad68-2f125c952a31] Updating instance_info_cache with network_info: [{"id": "4621e43a-a523-4506-8520-bcca759faa35", "address": "fa:16:3e:58:6e:5f", "network": {"id": "8cbeb1cc-a067-4c8d-82d8-0dc5c2ac924c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-742672345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a58d1e76a793406bbdd3821ff74abd92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4621e43a-a5", "ovs_interfaceid": "4621e43a-a523-4506-8520-bcca759faa35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:06:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-2b227ff0-3d3b-4fb2-8e61-14bc6929779d req-4e2c2f02-ef2c-46c7-ad3f-c89b1f9a22ea service nova] Releasing lock "refresh_cache-fc2b6a17-b3bf-42da-ad68-2f125c952a31" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 19:06:50 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:06:50 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:06:50 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:06:51 user nova-compute[75216]: DEBUG nova.compute.manager [req-eb856ac5-ae08-478f-b740-b436eeb086e7 req-d098e14a-61e1-42dd-9443-fc9a486aabe9 service nova] [instance: fc2b6a17-b3bf-42da-ad68-2f125c952a31] Received event network-vif-plugged-4621e43a-a523-4506-8520-bcca759faa35 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:06:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-eb856ac5-ae08-478f-b740-b436eeb086e7 req-d098e14a-61e1-42dd-9443-fc9a486aabe9 service nova] Acquiring lock "fc2b6a17-b3bf-42da-ad68-2f125c952a31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:06:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-eb856ac5-ae08-478f-b740-b436eeb086e7 req-d098e14a-61e1-42dd-9443-fc9a486aabe9 service nova] Lock "fc2b6a17-b3bf-42da-ad68-2f125c952a31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:06:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-eb856ac5-ae08-478f-b740-b436eeb086e7 req-d098e14a-61e1-42dd-9443-fc9a486aabe9 service nova] Lock "fc2b6a17-b3bf-42da-ad68-2f125c952a31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:06:51 user nova-compute[75216]: DEBUG nova.compute.manager [req-eb856ac5-ae08-478f-b740-b436eeb086e7 req-d098e14a-61e1-42dd-9443-fc9a486aabe9 service nova] [instance: fc2b6a17-b3bf-42da-ad68-2f125c952a31] No waiting events found dispatching network-vif-plugged-4621e43a-a523-4506-8520-bcca759faa35 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 19:06:51 user nova-compute[75216]: WARNING nova.compute.manager [req-eb856ac5-ae08-478f-b740-b436eeb086e7 req-d098e14a-61e1-42dd-9443-fc9a486aabe9 service nova] [instance: fc2b6a17-b3bf-42da-ad68-2f125c952a31] Received unexpected event network-vif-plugged-4621e43a-a523-4506-8520-bcca759faa35 for instance with vm_state building and task_state spawning.
Nov 13 19:06:51 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:06:51 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:06:51 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:06:52 user nova-compute[75216]: DEBUG nova.compute.manager [None req-e5251281-d049-4ee5-ae0f-91423eeb4714 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] [instance: fc2b6a17-b3bf-42da-ad68-2f125c952a31] Instance event wait completed in 0 seconds for  {{(pid=75216) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 19:06:52 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-e5251281-d049-4ee5-ae0f-91423eeb4714 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] [instance: fc2b6a17-b3bf-42da-ad68-2f125c952a31] Guest created on hypervisor {{(pid=75216) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 19:06:52 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: fc2b6a17-b3bf-42da-ad68-2f125c952a31] Instance spawned successfully.
Nov 13 19:06:52 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-e5251281-d049-4ee5-ae0f-91423eeb4714 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] [instance: fc2b6a17-b3bf-42da-ad68-2f125c952a31] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 19:06:52 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-e5251281-d049-4ee5-ae0f-91423eeb4714 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] [instance: fc2b6a17-b3bf-42da-ad68-2f125c952a31] Found default for hw_cdrom_bus of ide {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 19:06:52 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-e5251281-d049-4ee5-ae0f-91423eeb4714 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] [instance: fc2b6a17-b3bf-42da-ad68-2f125c952a31] Found default for hw_disk_bus of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 19:06:52 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-e5251281-d049-4ee5-ae0f-91423eeb4714 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] [instance: fc2b6a17-b3bf-42da-ad68-2f125c952a31] Found default for hw_input_bus of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 19:06:52 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-e5251281-d049-4ee5-ae0f-91423eeb4714 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] [instance: fc2b6a17-b3bf-42da-ad68-2f125c952a31] Found default for hw_pointer_model of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 19:06:52 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-e5251281-d049-4ee5-ae0f-91423eeb4714 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] [instance: fc2b6a17-b3bf-42da-ad68-2f125c952a31] Found default for hw_video_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 19:06:52 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-e5251281-d049-4ee5-ae0f-91423eeb4714 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] [instance: fc2b6a17-b3bf-42da-ad68-2f125c952a31] Found default for hw_vif_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 19:06:52 user nova-compute[75216]: INFO nova.compute.manager [None req-e5251281-d049-4ee5-ae0f-91423eeb4714 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] [instance: fc2b6a17-b3bf-42da-ad68-2f125c952a31] Took 5.10 seconds to spawn the instance on the hypervisor.
Nov 13 19:06:52 user nova-compute[75216]: DEBUG nova.compute.manager [None req-e5251281-d049-4ee5-ae0f-91423eeb4714 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] [instance: fc2b6a17-b3bf-42da-ad68-2f125c952a31] Checking state {{(pid=75216) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 19:06:53 user nova-compute[75216]: INFO nova.compute.manager [None req-e5251281-d049-4ee5-ae0f-91423eeb4714 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] [instance: fc2b6a17-b3bf-42da-ad68-2f125c952a31] Took 5.86 seconds to build instance.
Nov 13 19:06:53 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e5251281-d049-4ee5-ae0f-91423eeb4714 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Lock "fc2b6a17-b3bf-42da-ad68-2f125c952a31" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.970s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:06:53 user nova-compute[75216]: DEBUG nova.compute.manager [req-73099fb8-22d9-449d-8851-826b3d70e464 req-e6e5032a-7e63-447a-a892-01535fbea4e2 service nova] [instance: fc2b6a17-b3bf-42da-ad68-2f125c952a31] Received event network-vif-plugged-4621e43a-a523-4506-8520-bcca759faa35 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:06:53 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-73099fb8-22d9-449d-8851-826b3d70e464 req-e6e5032a-7e63-447a-a892-01535fbea4e2 service nova] Acquiring lock "fc2b6a17-b3bf-42da-ad68-2f125c952a31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:06:53 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-73099fb8-22d9-449d-8851-826b3d70e464 req-e6e5032a-7e63-447a-a892-01535fbea4e2 service nova] Lock "fc2b6a17-b3bf-42da-ad68-2f125c952a31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:06:53 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-73099fb8-22d9-449d-8851-826b3d70e464 req-e6e5032a-7e63-447a-a892-01535fbea4e2 service nova] Lock "fc2b6a17-b3bf-42da-ad68-2f125c952a31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:06:53 user nova-compute[75216]: DEBUG nova.compute.manager [req-73099fb8-22d9-449d-8851-826b3d70e464 req-e6e5032a-7e63-447a-a892-01535fbea4e2 service nova] [instance: fc2b6a17-b3bf-42da-ad68-2f125c952a31] No waiting events found dispatching network-vif-plugged-4621e43a-a523-4506-8520-bcca759faa35 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 19:06:53 user nova-compute[75216]: WARNING nova.compute.manager [req-73099fb8-22d9-449d-8851-826b3d70e464 req-e6e5032a-7e63-447a-a892-01535fbea4e2 service nova] [instance: fc2b6a17-b3bf-42da-ad68-2f125c952a31] Received unexpected event network-vif-plugged-4621e43a-a523-4506-8520-bcca759faa35 for instance with vm_state active and task_state None.
Nov 13 19:06:53 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:06:54 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:06:59 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:06:59 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:06:59 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75216) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 19:06:59 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 19:06:59 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 19:06:59 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:07:00 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:07:00 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:07:00 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:07:00 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:07:00 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:07:00 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75216) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 19:07:02 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:07:04 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:07:04 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:07:04 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:07:04 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:07:04 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75216) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 19:07:04 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 19:07:04 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 19:07:04 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:07:04 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:07:04 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:07:04 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:07:04 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Auditing locally available compute resources for user (node: user) {{(pid=75216) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 19:07:04 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 19:07:04 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc2b6a17-b3bf-42da-ad68-2f125c952a31/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:07:04 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc2b6a17-b3bf-42da-ad68-2f125c952a31/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:07:04 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc2b6a17-b3bf-42da-ad68-2f125c952a31/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:07:04 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc2b6a17-b3bf-42da-ad68-2f125c952a31/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:07:04 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 19:07:04 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa/disk.rescue --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:07:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa/disk.rescue --force-share --output=json" returned: 0 in 0.167s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:07:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa/disk.rescue --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:07:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:07:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b752173-e573-426e-b9f1-bff92a4c2b55/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:07:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b752173-e573-426e-b9f1-bff92a4c2b55/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:07:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b752173-e573-426e-b9f1-bff92a4c2b55/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:07:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b752173-e573-426e-b9f1-bff92a4c2b55/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:07:05 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 19:07:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:07:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:07:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:07:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:07:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cc8ac6f-4187-4a76-836e-f7c50d68680d/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:07:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cc8ac6f-4187-4a76-836e-f7c50d68680d/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:07:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cc8ac6f-4187-4a76-836e-f7c50d68680d/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:07:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cc8ac6f-4187-4a76-836e-f7c50d68680d/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:07:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f21b2014-51e5-423d-baad-7ee2a7a74ca4/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:07:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f21b2014-51e5-423d-baad-7ee2a7a74ca4/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:07:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f21b2014-51e5-423d-baad-7ee2a7a74ca4/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:07:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f21b2014-51e5-423d-baad-7ee2a7a74ca4/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:07:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c18c0ad-60e5-4ef2-97f2-b7008e89ac78/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:07:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c18c0ad-60e5-4ef2-97f2-b7008e89ac78/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:07:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c18c0ad-60e5-4ef2-97f2-b7008e89ac78/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:07:07 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c18c0ad-60e5-4ef2-97f2-b7008e89ac78/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:07:07 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 19:07:07 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 19:07:07 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Hypervisor/Node resource view: name=user free_ram=8069MB free_disk=25.17163848876953GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75216) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 19:07:07 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:07:07 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:07:07 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 19:07:07 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance 1e5f1164-a15e-40cf-b7bc-5aeb404a1216 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 19:07:07 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance 5c18c0ad-60e5-4ef2-97f2-b7008e89ac78 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 19:07:07 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance 7b752173-e573-426e-b9f1-bff92a4c2b55 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 19:07:07 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance 8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 19:07:07 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance f21b2014-51e5-423d-baad-7ee2a7a74ca4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 19:07:07 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance 4cc8ac6f-4187-4a76-836e-f7c50d68680d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 19:07:07 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance fc2b6a17-b3bf-42da-ad68-2f125c952a31 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 19:07:07 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 19:07:07 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 19:07:07 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 19:07:07 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 19:07:07 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Compute_service record updated for user:user {{(pid=75216) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 19:07:07 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.411s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:07:08 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:07:08 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:07:08 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Starting heal instance info cache {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 19:07:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:07:09 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "refresh_cache-7b752173-e573-426e-b9f1-bff92a4c2b55" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 19:07:09 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquired lock "refresh_cache-7b752173-e573-426e-b9f1-bff92a4c2b55" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 19:07:09 user nova-compute[75216]: DEBUG nova.network.neutron [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: 7b752173-e573-426e-b9f1-bff92a4c2b55] Forcefully refreshing network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 19:07:09 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:07:09 user nova-compute[75216]: DEBUG nova.network.neutron [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: 7b752173-e573-426e-b9f1-bff92a4c2b55] Updating instance_info_cache with network_info: [{"id": "60dd7b11-cfc3-4965-a429-8b2ac4cdfcf4", "address": "fa:16:3e:d6:af:c5", "network": {"id": "53bb01d5-31a4-47af-a931-ac12fe72b986", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-802892643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "095f5765865140d29b3ecf1ab3427037", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60dd7b11-cf", "ovs_interfaceid": "60dd7b11-cfc3-4965-a429-8b2ac4cdfcf4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:07:09 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Releasing lock "refresh_cache-7b752173-e573-426e-b9f1-bff92a4c2b55" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 19:07:09 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: 7b752173-e573-426e-b9f1-bff92a4c2b55] Updated the network info_cache for instance {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 19:07:11 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-378371c0-0e92-442d-b2b2-c38162e44406 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] Acquiring lock "f21b2014-51e5-423d-baad-7ee2a7a74ca4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:07:11 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-378371c0-0e92-442d-b2b2-c38162e44406 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] Lock "f21b2014-51e5-423d-baad-7ee2a7a74ca4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:07:11 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-378371c0-0e92-442d-b2b2-c38162e44406 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] Acquiring lock "f21b2014-51e5-423d-baad-7ee2a7a74ca4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:07:11 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-378371c0-0e92-442d-b2b2-c38162e44406 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] Lock "f21b2014-51e5-423d-baad-7ee2a7a74ca4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:07:11 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-378371c0-0e92-442d-b2b2-c38162e44406 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] Lock "f21b2014-51e5-423d-baad-7ee2a7a74ca4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:07:11 user nova-compute[75216]: INFO nova.compute.manager [None req-378371c0-0e92-442d-b2b2-c38162e44406 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] [instance: f21b2014-51e5-423d-baad-7ee2a7a74ca4] Terminating instance
Nov 13 19:07:11 user nova-compute[75216]: DEBUG nova.compute.manager [None req-378371c0-0e92-442d-b2b2-c38162e44406 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] [instance: f21b2014-51e5-423d-baad-7ee2a7a74ca4] Start destroying the instance on the hypervisor. {{(pid=75216) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 19:07:11 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:07:11 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:07:11 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:07:11 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:07:12 user nova-compute[75216]: DEBUG nova.compute.manager [req-55e688c4-28dc-42d5-8260-d4bd2a69ed7c req-b3c12f21-7d29-49ea-b96b-d2f7e4908053 service nova] [instance: f21b2014-51e5-423d-baad-7ee2a7a74ca4] Received event network-vif-unplugged-cb1d37f1-236d-4d0e-9097-243fae73908e {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:07:12 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-55e688c4-28dc-42d5-8260-d4bd2a69ed7c req-b3c12f21-7d29-49ea-b96b-d2f7e4908053 service nova] Acquiring lock "f21b2014-51e5-423d-baad-7ee2a7a74ca4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:07:12 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-55e688c4-28dc-42d5-8260-d4bd2a69ed7c req-b3c12f21-7d29-49ea-b96b-d2f7e4908053 service nova] Lock "f21b2014-51e5-423d-baad-7ee2a7a74ca4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:07:12 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-55e688c4-28dc-42d5-8260-d4bd2a69ed7c req-b3c12f21-7d29-49ea-b96b-d2f7e4908053 service nova] Lock "f21b2014-51e5-423d-baad-7ee2a7a74ca4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:07:12 user nova-compute[75216]: DEBUG nova.compute.manager [req-55e688c4-28dc-42d5-8260-d4bd2a69ed7c req-b3c12f21-7d29-49ea-b96b-d2f7e4908053 service nova] [instance: f21b2014-51e5-423d-baad-7ee2a7a74ca4] No waiting events found dispatching network-vif-unplugged-cb1d37f1-236d-4d0e-9097-243fae73908e {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 19:07:12 user nova-compute[75216]: DEBUG nova.compute.manager [req-55e688c4-28dc-42d5-8260-d4bd2a69ed7c req-b3c12f21-7d29-49ea-b96b-d2f7e4908053 service nova] [instance: f21b2014-51e5-423d-baad-7ee2a7a74ca4] Received event network-vif-unplugged-cb1d37f1-236d-4d0e-9097-243fae73908e for instance with task_state deleting. {{(pid=75216) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 19:07:12 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: f21b2014-51e5-423d-baad-7ee2a7a74ca4] Instance destroyed successfully.
Nov 13 19:07:12 user nova-compute[75216]: DEBUG nova.objects.instance [None req-378371c0-0e92-442d-b2b2-c38162e44406 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] Lazy-loading 'resources' on Instance uuid f21b2014-51e5-423d-baad-7ee2a7a74ca4 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:07:12 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-378371c0-0e92-442d-b2b2-c38162e44406 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T19:05:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1609213754',display_name='tempest-VolumesActionsTest-instance-1609213754',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1609213754',id=32,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-13T19:05:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5c09fc0419834abe8a37c8817ab0a2e2',ramdisk_id='',reservation_id='r-ewcbrzt1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-26118612',owner_user_name='tempest-VolumesActionsTest-26118612-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T19:05:28Z,user_data=None,user_id='e24aca69921e43eaa7fea805c5d16e71',uuid=f21b2014-51e5-423d-baad-7ee2a7a74ca4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cb1d37f1-236d-4d0e-9097-243fae73908e", "address": "fa:16:3e:2b:a7:2a", "network": {"id": "02039e96-caac-4d3a-b397-29eb94376074", "bridge": "br-int", "label": "tempest-VolumesActionsTest-98786948-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c09fc0419834abe8a37c8817ab0a2e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb1d37f1-23", "ovs_interfaceid": "cb1d37f1-236d-4d0e-9097-243fae73908e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 19:07:12 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-378371c0-0e92-442d-b2b2-c38162e44406 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] Converting VIF {"id": "cb1d37f1-236d-4d0e-9097-243fae73908e", "address": "fa:16:3e:2b:a7:2a", "network": {"id": "02039e96-caac-4d3a-b397-29eb94376074", "bridge": "br-int", "label": "tempest-VolumesActionsTest-98786948-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c09fc0419834abe8a37c8817ab0a2e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb1d37f1-23", "ovs_interfaceid": "cb1d37f1-236d-4d0e-9097-243fae73908e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 19:07:12 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-378371c0-0e92-442d-b2b2-c38162e44406 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2b:a7:2a,bridge_name='br-int',has_traffic_filtering=True,id=cb1d37f1-236d-4d0e-9097-243fae73908e,network=Network(02039e96-caac-4d3a-b397-29eb94376074),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb1d37f1-23') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 19:07:12 user nova-compute[75216]: DEBUG os_vif [None req-378371c0-0e92-442d-b2b2-c38162e44406 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:a7:2a,bridge_name='br-int',has_traffic_filtering=True,id=cb1d37f1-236d-4d0e-9097-243fae73908e,network=Network(02039e96-caac-4d3a-b397-29eb94376074),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb1d37f1-23') {{(pid=75216) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 19:07:12 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:07:12 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcb1d37f1-23, bridge=br-int, if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:07:12 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:07:12 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:07:12 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:07:12 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fd520ce2-5f3e-4675-bcaa-5be8322a94e5) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:07:12 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:07:12 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:07:12 user nova-compute[75216]: INFO os_vif [None req-378371c0-0e92-442d-b2b2-c38162e44406 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:a7:2a,bridge_name='br-int',has_traffic_filtering=True,id=cb1d37f1-236d-4d0e-9097-243fae73908e,network=Network(02039e96-caac-4d3a-b397-29eb94376074),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb1d37f1-23')
Nov 13 19:07:12 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-378371c0-0e92-442d-b2b2-c38162e44406 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] [instance: f21b2014-51e5-423d-baad-7ee2a7a74ca4] Deleting instance files /opt/stack/data/nova/instances/f21b2014-51e5-423d-baad-7ee2a7a74ca4_del
Nov 13 19:07:12 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-378371c0-0e92-442d-b2b2-c38162e44406 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] [instance: f21b2014-51e5-423d-baad-7ee2a7a74ca4] Deletion of /opt/stack/data/nova/instances/f21b2014-51e5-423d-baad-7ee2a7a74ca4_del complete
Nov 13 19:07:12 user nova-compute[75216]: INFO nova.compute.manager [None req-378371c0-0e92-442d-b2b2-c38162e44406 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] [instance: f21b2014-51e5-423d-baad-7ee2a7a74ca4] Took 0.68 seconds to destroy the instance on the hypervisor.
Nov 13 19:07:12 user nova-compute[75216]: DEBUG oslo.service.loopingcall [None req-378371c0-0e92-442d-b2b2-c38162e44406 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75216) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 19:07:12 user nova-compute[75216]: DEBUG nova.compute.manager [-] [instance: f21b2014-51e5-423d-baad-7ee2a7a74ca4] Deallocating network for instance {{(pid=75216) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 19:07:12 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: f21b2014-51e5-423d-baad-7ee2a7a74ca4] deallocate_for_instance() {{(pid=75216) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 19:07:13 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: f21b2014-51e5-423d-baad-7ee2a7a74ca4] Updating instance_info_cache with network_info: [] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:07:13 user nova-compute[75216]: INFO nova.compute.manager [-] [instance: f21b2014-51e5-423d-baad-7ee2a7a74ca4] Took 0.92 seconds to deallocate network for instance.
Nov 13 19:07:13 user nova-compute[75216]: DEBUG nova.compute.manager [req-ace9ed8b-6dd5-4097-963c-cb10326ecac6 req-56b25eec-2e4d-4c8f-82bc-9a937ea67f1f service nova] [instance: f21b2014-51e5-423d-baad-7ee2a7a74ca4] Received event network-vif-deleted-cb1d37f1-236d-4d0e-9097-243fae73908e {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:07:13 user nova-compute[75216]: INFO nova.compute.manager [req-ace9ed8b-6dd5-4097-963c-cb10326ecac6 req-56b25eec-2e4d-4c8f-82bc-9a937ea67f1f service nova] [instance: f21b2014-51e5-423d-baad-7ee2a7a74ca4] Neutron deleted interface cb1d37f1-236d-4d0e-9097-243fae73908e; detaching it from the instance and deleting it from the info cache
Nov 13 19:07:13 user nova-compute[75216]: DEBUG nova.network.neutron [req-ace9ed8b-6dd5-4097-963c-cb10326ecac6 req-56b25eec-2e4d-4c8f-82bc-9a937ea67f1f service nova] [instance: f21b2014-51e5-423d-baad-7ee2a7a74ca4] Updating instance_info_cache with network_info: [] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:07:13 user nova-compute[75216]: DEBUG nova.compute.manager [req-ace9ed8b-6dd5-4097-963c-cb10326ecac6 req-56b25eec-2e4d-4c8f-82bc-9a937ea67f1f service nova] [instance: f21b2014-51e5-423d-baad-7ee2a7a74ca4] Detach interface failed, port_id=cb1d37f1-236d-4d0e-9097-243fae73908e, reason: Instance f21b2014-51e5-423d-baad-7ee2a7a74ca4 could not be found. {{(pid=75216) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 13 19:07:13 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-378371c0-0e92-442d-b2b2-c38162e44406 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:07:13 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-378371c0-0e92-442d-b2b2-c38162e44406 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:07:13 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-378371c0-0e92-442d-b2b2-c38162e44406 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 19:07:13 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-378371c0-0e92-442d-b2b2-c38162e44406 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 19:07:13 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-378371c0-0e92-442d-b2b2-c38162e44406 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.278s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:07:13 user nova-compute[75216]: INFO nova.scheduler.client.report [None req-378371c0-0e92-442d-b2b2-c38162e44406 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] Deleted allocations for instance f21b2014-51e5-423d-baad-7ee2a7a74ca4
Nov 13 19:07:13 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-378371c0-0e92-442d-b2b2-c38162e44406 tempest-VolumesActionsTest-26118612 tempest-VolumesActionsTest-26118612-project-member] Lock "f21b2014-51e5-423d-baad-7ee2a7a74ca4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.053s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:07:13 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:07:14 user nova-compute[75216]: DEBUG nova.compute.manager [req-9761df4c-7a21-4967-b274-c015619dcfc7 req-6202f637-2b7f-4483-b74e-030f7740a241 service nova] [instance: f21b2014-51e5-423d-baad-7ee2a7a74ca4] Received event network-vif-plugged-cb1d37f1-236d-4d0e-9097-243fae73908e {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:07:14 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-9761df4c-7a21-4967-b274-c015619dcfc7 req-6202f637-2b7f-4483-b74e-030f7740a241 service nova] Acquiring lock "f21b2014-51e5-423d-baad-7ee2a7a74ca4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:07:14 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-9761df4c-7a21-4967-b274-c015619dcfc7 req-6202f637-2b7f-4483-b74e-030f7740a241 service nova] Lock "f21b2014-51e5-423d-baad-7ee2a7a74ca4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:07:14 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-9761df4c-7a21-4967-b274-c015619dcfc7 req-6202f637-2b7f-4483-b74e-030f7740a241 service nova] Lock "f21b2014-51e5-423d-baad-7ee2a7a74ca4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:07:14 user nova-compute[75216]: DEBUG nova.compute.manager [req-9761df4c-7a21-4967-b274-c015619dcfc7 req-6202f637-2b7f-4483-b74e-030f7740a241 service nova] [instance: f21b2014-51e5-423d-baad-7ee2a7a74ca4] No waiting events found dispatching network-vif-plugged-cb1d37f1-236d-4d0e-9097-243fae73908e {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 19:07:14 user nova-compute[75216]: WARNING nova.compute.manager [req-9761df4c-7a21-4967-b274-c015619dcfc7 req-6202f637-2b7f-4483-b74e-030f7740a241 service nova] [instance: f21b2014-51e5-423d-baad-7ee2a7a74ca4] Received unexpected event network-vif-plugged-cb1d37f1-236d-4d0e-9097-243fae73908e for instance with vm_state deleted and task_state None.
Nov 13 19:07:17 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:07:18 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:07:22 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:07:23 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f122bd6a-3660-4ca8-9e30-a753d863f0a9 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Acquiring lock "7b752173-e573-426e-b9f1-bff92a4c2b55" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:07:23 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f122bd6a-3660-4ca8-9e30-a753d863f0a9 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Lock "7b752173-e573-426e-b9f1-bff92a4c2b55" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:07:23 user nova-compute[75216]: INFO nova.compute.manager [None req-f122bd6a-3660-4ca8-9e30-a753d863f0a9 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] [instance: 7b752173-e573-426e-b9f1-bff92a4c2b55] Detaching volume dce55498-5eed-4a20-a00b-3f98b1e93c4f
Nov 13 19:07:23 user nova-compute[75216]: INFO nova.virt.block_device [None req-f122bd6a-3660-4ca8-9e30-a753d863f0a9 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] [instance: 7b752173-e573-426e-b9f1-bff92a4c2b55] Attempting to driver detach volume dce55498-5eed-4a20-a00b-3f98b1e93c4f from mountpoint /dev/vdb
Nov 13 19:07:23 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-f122bd6a-3660-4ca8-9e30-a753d863f0a9 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Attempting to detach device vdb from instance 7b752173-e573-426e-b9f1-bff92a4c2b55 from the persistent domain config. {{(pid=75216) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 13 19:07:23 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-f122bd6a-3660-4ca8-9e30-a753d863f0a9 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 19:07:23 user nova-compute[75216]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 19:07:23 user nova-compute[75216]:   <source dev="/dev/sdd"/>
Nov 13 19:07:23 user nova-compute[75216]:   <target dev="vdb" bus="virtio"/>
Nov 13 19:07:23 user nova-compute[75216]:   <serial>dce55498-5eed-4a20-a00b-3f98b1e93c4f</serial>
Nov 13 19:07:23 user nova-compute[75216]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 13 19:07:23 user nova-compute[75216]: </disk>
Nov 13 19:07:23 user nova-compute[75216]:  {{(pid=75216) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 19:07:23 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-f122bd6a-3660-4ca8-9e30-a753d863f0a9 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Successfully detached device vdb from instance 7b752173-e573-426e-b9f1-bff92a4c2b55 from the persistent domain config.
Nov 13 19:07:23 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-f122bd6a-3660-4ca8-9e30-a753d863f0a9 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7b752173-e573-426e-b9f1-bff92a4c2b55 from the live domain config. {{(pid=75216) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 13 19:07:23 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-f122bd6a-3660-4ca8-9e30-a753d863f0a9 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 19:07:23 user nova-compute[75216]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 19:07:23 user nova-compute[75216]:   <source dev="/dev/sdd"/>
Nov 13 19:07:23 user nova-compute[75216]:   <target dev="vdb" bus="virtio"/>
Nov 13 19:07:23 user nova-compute[75216]:   <serial>dce55498-5eed-4a20-a00b-3f98b1e93c4f</serial>
Nov 13 19:07:23 user nova-compute[75216]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 13 19:07:23 user nova-compute[75216]: </disk>
Nov 13 19:07:23 user nova-compute[75216]:  {{(pid=75216) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 19:07:23 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-f122bd6a-3660-4ca8-9e30-a753d863f0a9 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7b752173-e573-426e-b9f1-bff92a4c2b55 {{(pid=75216) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 13 19:07:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:07:27 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:07:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:07:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:07:40 user nova-compute[75216]: INFO nova.compute.manager [None req-0779e5cb-767a-4812-a26c-5c18a8fc45a7 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: 8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa] Unrescuing
Nov 13 19:07:40 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-0779e5cb-767a-4812-a26c-5c18a8fc45a7 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Acquiring lock "refresh_cache-8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 19:07:40 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-0779e5cb-767a-4812-a26c-5c18a8fc45a7 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Acquired lock "refresh_cache-8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 19:07:40 user nova-compute[75216]: DEBUG nova.network.neutron [None req-0779e5cb-767a-4812-a26c-5c18a8fc45a7 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: 8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa] Building network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 19:07:40 user nova-compute[75216]: DEBUG nova.network.neutron [None req-0779e5cb-767a-4812-a26c-5c18a8fc45a7 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: 8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa] Updating instance_info_cache with network_info: [{"id": "0f86c64c-3da6-44d9-8c74-e276f2496f35", "address": "fa:16:3e:21:5b:c2", "network": {"id": "f8b821ef-8fae-42b9-9055-a9ea7be955ab", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-50594548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "903397a6c0474cfd8bd1a4fb338528aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f86c64c-3d", "ovs_interfaceid": "0f86c64c-3da6-44d9-8c74-e276f2496f35", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:07:40 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-0779e5cb-767a-4812-a26c-5c18a8fc45a7 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Releasing lock "refresh_cache-8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 19:07:40 user nova-compute[75216]: DEBUG nova.objects.instance [None req-0779e5cb-767a-4812-a26c-5c18a8fc45a7 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Lazy-loading 'flavor' on Instance uuid 8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:07:40 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:07:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:07:41 user nova-compute[75216]: DEBUG nova.compute.manager [req-a0924a7c-7e89-450e-a2f5-bf3424e87766 req-7a7132ef-ab2b-4744-affd-aac2924d1514 service nova] [instance: 8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa] Received event network-vif-unplugged-0f86c64c-3da6-44d9-8c74-e276f2496f35 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:07:41 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-a0924a7c-7e89-450e-a2f5-bf3424e87766 req-7a7132ef-ab2b-4744-affd-aac2924d1514 service nova] Acquiring lock "8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:07:41 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-a0924a7c-7e89-450e-a2f5-bf3424e87766 req-7a7132ef-ab2b-4744-affd-aac2924d1514 service nova] Lock "8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:07:41 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-a0924a7c-7e89-450e-a2f5-bf3424e87766 req-7a7132ef-ab2b-4744-affd-aac2924d1514 service nova] Lock "8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:07:41 user nova-compute[75216]: DEBUG nova.compute.manager [req-a0924a7c-7e89-450e-a2f5-bf3424e87766 req-7a7132ef-ab2b-4744-affd-aac2924d1514 service nova] [instance: 8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa] No waiting events found dispatching network-vif-unplugged-0f86c64c-3da6-44d9-8c74-e276f2496f35 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 19:07:41 user nova-compute[75216]: WARNING nova.compute.manager [req-a0924a7c-7e89-450e-a2f5-bf3424e87766 req-7a7132ef-ab2b-4744-affd-aac2924d1514 service nova] [instance: 8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa] Received unexpected event network-vif-unplugged-0f86c64c-3da6-44d9-8c74-e276f2496f35 for instance with vm_state rescued and task_state unrescuing.
Nov 13 19:07:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:07:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:07:41 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa] Instance destroyed successfully.
Nov 13 19:07:42 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:07:42 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:07:42 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:07:42 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:07:42 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:07:43 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:07:43 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:07:43 user nova-compute[75216]: DEBUG nova.compute.manager [req-90aa3e75-62b6-4731-aaca-db0a499a4881 req-a9caaec2-927c-4176-8074-af8f6b0d0405 service nova] [instance: 8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa] Received event network-vif-plugged-0f86c64c-3da6-44d9-8c74-e276f2496f35 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:07:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-90aa3e75-62b6-4731-aaca-db0a499a4881 req-a9caaec2-927c-4176-8074-af8f6b0d0405 service nova] Acquiring lock "8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:07:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-90aa3e75-62b6-4731-aaca-db0a499a4881 req-a9caaec2-927c-4176-8074-af8f6b0d0405 service nova] Lock "8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:07:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-90aa3e75-62b6-4731-aaca-db0a499a4881 req-a9caaec2-927c-4176-8074-af8f6b0d0405 service nova] Lock "8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:07:43 user nova-compute[75216]: DEBUG nova.compute.manager [req-90aa3e75-62b6-4731-aaca-db0a499a4881 req-a9caaec2-927c-4176-8074-af8f6b0d0405 service nova] [instance: 8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa] No waiting events found dispatching network-vif-plugged-0f86c64c-3da6-44d9-8c74-e276f2496f35 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 19:07:43 user nova-compute[75216]: WARNING nova.compute.manager [req-90aa3e75-62b6-4731-aaca-db0a499a4881 req-a9caaec2-927c-4176-8074-af8f6b0d0405 service nova] [instance: 8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa] Received unexpected event network-vif-plugged-0f86c64c-3da6-44d9-8c74-e276f2496f35 for instance with vm_state rescued and task_state unrescuing.
Nov 13 19:07:43 user nova-compute[75216]: DEBUG nova.compute.manager [req-90aa3e75-62b6-4731-aaca-db0a499a4881 req-a9caaec2-927c-4176-8074-af8f6b0d0405 service nova] [instance: 8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa] Received event network-vif-plugged-0f86c64c-3da6-44d9-8c74-e276f2496f35 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:07:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-90aa3e75-62b6-4731-aaca-db0a499a4881 req-a9caaec2-927c-4176-8074-af8f6b0d0405 service nova] Acquiring lock "8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:07:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-90aa3e75-62b6-4731-aaca-db0a499a4881 req-a9caaec2-927c-4176-8074-af8f6b0d0405 service nova] Lock "8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:07:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-90aa3e75-62b6-4731-aaca-db0a499a4881 req-a9caaec2-927c-4176-8074-af8f6b0d0405 service nova] Lock "8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:07:43 user nova-compute[75216]: DEBUG nova.compute.manager [req-90aa3e75-62b6-4731-aaca-db0a499a4881 req-a9caaec2-927c-4176-8074-af8f6b0d0405 service nova] [instance: 8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa] No waiting events found dispatching network-vif-plugged-0f86c64c-3da6-44d9-8c74-e276f2496f35 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 19:07:43 user nova-compute[75216]: WARNING nova.compute.manager [req-90aa3e75-62b6-4731-aaca-db0a499a4881 req-a9caaec2-927c-4176-8074-af8f6b0d0405 service nova] [instance: 8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa] Received unexpected event network-vif-plugged-0f86c64c-3da6-44d9-8c74-e276f2496f35 for instance with vm_state rescued and task_state unrescuing.
Nov 13 19:07:43 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-f122bd6a-3660-4ca8-9e30-a753d863f0a9 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 7b752173-e573-426e-b9f1-bff92a4c2b55 is timed out.
Nov 13 19:07:43 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-f122bd6a-3660-4ca8-9e30-a753d863f0a9 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Successfully detached device vdb from instance 7b752173-e573-426e-b9f1-bff92a4c2b55 from the live domain config.
Nov 13 19:07:43 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f122bd6a-3660-4ca8-9e30-a753d863f0a9 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] [instance: 7b752173-e573-426e-b9f1-bff92a4c2b55] calling os-brick to detach iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 19:07:43 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f122bd6a-3660-4ca8-9e30-a753d863f0a9 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3a8669e40>, {'target_iqn': 'iqn.2010-10.org.openstack:dce55498-5eed-4a20-a00b-3f98b1e93c4f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SdDJHbtF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 19:07:43 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-f122bd6a-3660-4ca8-9e30-a753d863f0a9 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 19:07:43 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-f122bd6a-3660-4ca8-9e30-a753d863f0a9 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 19:07:43 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-f122bd6a-3660-4ca8-9e30-a753d863f0a9 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 19:07:43 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:07:43 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:07:43 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:07:43 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1eea935-60ee-494d-998d-77d4713314c9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3bda4ab6-9834-40ad-b9fc-88186d2ffceb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dce55498-5eed-4a20-a00b-3f98b1e93c4f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:07:43 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f122bd6a-3660-4ca8-9e30-a753d863f0a9 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 19:07:43 user nova-compute[75216]: No targets found.
Nov 13 19:07:43 user nova-compute[75216]: iSNS:
Nov 13 19:07:43 user nova-compute[75216]: No targets found.
Nov 13 19:07:43 user nova-compute[75216]: STATIC:
Nov 13 19:07:43 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:3bda4ab6-9834-40ad-b9fc-88186d2ffceb
Nov 13 19:07:43 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 19:07:43 user nova-compute[75216]:                 Iface Name: default
Nov 13 19:07:43 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1
Nov 13 19:07:43 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 19:07:43 user nova-compute[75216]:                 Iface Name: default
Nov 13 19:07:43 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:dce55498-5eed-4a20-a00b-3f98b1e93c4f
Nov 13 19:07:43 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 19:07:43 user nova-compute[75216]:                 Iface Name: default
Nov 13 19:07:43 user nova-compute[75216]: FIRMWARE:
Nov 13 19:07:43 user nova-compute[75216]: No targets found.
Nov 13 19:07:43 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 19:07:43 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f122bd6a-3660-4ca8-9e30-a753d863f0a9 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 19:07:43 user nova-compute[75216]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 19:07:43 user nova-compute[75216]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75216) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 19:07:43 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f122bd6a-3660-4ca8-9e30-a753d863f0a9 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dce55498-5eed-4a20-a00b-3f98b1e93c4f', 0)] {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 19:07:43 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:07:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:07:44 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fb80370-8390-4634-b214-2350c654b9d0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3bda4ab6-9834-40ad-b9fc-88186d2ffceb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dce55498-5eed-4a20-a00b-3f98b1e93c4f\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:07:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:07:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:07:44 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[04577b97-8bfa-4174-9d62-74e007a7d04c]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bda4ab6-9834-40ad-b9fc-88186d2ffceb (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dce55498-5eed-4a20-a00b-3f98b1e93c4f (non-flash)\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:07:44 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f122bd6a-3660-4ca8-9e30-a753d863f0a9 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1 (non-flash)
Nov 13 19:07:44 user nova-compute[75216]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bda4ab6-9834-40ad-b9fc-88186d2ffceb (non-flash)
Nov 13 19:07:44 user nova-compute[75216]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dce55498-5eed-4a20-a00b-3f98b1e93c4f (non-flash)
Nov 13 19:07:44 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 19:07:44 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f122bd6a-3660-4ca8-9e30-a753d863f0a9 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1 (non-flash)
Nov 13 19:07:44 user nova-compute[75216]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bda4ab6-9834-40ad-b9fc-88186d2ffceb (non-flash)
Nov 13 19:07:44 user nova-compute[75216]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dce55498-5eed-4a20-a00b-3f98b1e93c4f (non-flash)
Nov 13 19:07:44 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 19:07:44 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f122bd6a-3660-4ca8-9e30-a753d863f0a9 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe3a8579c60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dce55498-5eed-4a20-a00b-3f98b1e93c4f'): ({'sdd'}, set())}) {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 19:07:44 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-f122bd6a-3660-4ca8-9e30-a753d863f0a9 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Removing single pathed devices sdd {{(pid=75216) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 19:07:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:07:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:07:44 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[df862642-b902-4ebf-88f6-5f6963c6157b]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:07:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:07:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.017s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:07:44 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[b23980ad-5f4f-4742-9dca-cd5c46af01b7]: (4, ('ok\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:07:44 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-f122bd6a-3660-4ca8-9e30-a753d863f0a9 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Flushing IO for device /dev/sdd {{(pid=75216) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 19:07:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:07:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:07:44 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[e26a3c11-9094-48c1-b0c4-13ad3be49044]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:07:44 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-f122bd6a-3660-4ca8-9e30-a753d863f0a9 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75216) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 19:07:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:07:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.039s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:07:44 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a960fa3-80e8-4803-8cc5-2f1575939b98]: (4, ('1', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:07:44 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-f122bd6a-3660-4ca8-9e30-a753d863f0a9 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 19:07:44 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-f122bd6a-3660-4ca8-9e30-a753d863f0a9 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] SCSI volumes sdd have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 19:07:44 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f122bd6a-3660-4ca8-9e30-a753d863f0a9 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dce55498-5eed-4a20-a00b-3f98b1e93c4f')] {{(pid=75216) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 19:07:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dce55498-5eed-4a20-a00b-3f98b1e93c4f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:07:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dce55498-5eed-4a20-a00b-3f98b1e93c4f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:07:44 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[111d8c40-f595-4362-8153-2905d46657de]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:07:44 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f122bd6a-3660-4ca8-9e30-a753d863f0a9 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:07:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dce55498-5eed-4a20-a00b-3f98b1e93c4f -p 172.16.0.220:3260 --logout {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:07:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dce55498-5eed-4a20-a00b-3f98b1e93c4f -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:07:44 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[16ededc4-4dfe-4289-bc57-60e4ce11c285]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:dce55498-5eed-4a20-a00b-3f98b1e93c4f, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:dce55498-5eed-4a20-a00b-3f98b1e93c4f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:07:44 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f122bd6a-3660-4ca8-9e30-a753d863f0a9 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:dce55498-5eed-4a20-a00b-3f98b1e93c4f, portal: 172.16.0.220,3260]
Nov 13 19:07:44 user nova-compute[75216]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:dce55498-5eed-4a20-a00b-3f98b1e93c4f, portal: 172.16.0.220,3260] successful.
Nov 13 19:07:44 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:07:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dce55498-5eed-4a20-a00b-3f98b1e93c4f -p 172.16.0.220:3260 --op delete {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:07:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dce55498-5eed-4a20-a00b-3f98b1e93c4f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:07:44 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[3972995e-42f8-4eb1-a6fa-76293a861b6d]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:07:44 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f122bd6a-3660-4ca8-9e30-a753d863f0a9 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:07:44 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-f122bd6a-3660-4ca8-9e30-a753d863f0a9 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.296s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 19:07:44 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f122bd6a-3660-4ca8-9e30-a753d863f0a9 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] <== disconnect_volume: return (297ms) None {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 19:07:44 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f122bd6a-3660-4ca8-9e30-a753d863f0a9 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] [instance: 7b752173-e573-426e-b9f1-bff92a4c2b55] Disconnected iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 19:07:44 user nova-compute[75216]: DEBUG nova.objects.instance [None req-f122bd6a-3660-4ca8-9e30-a753d863f0a9 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Lazy-loading 'flavor' on Instance uuid 7b752173-e573-426e-b9f1-bff92a4c2b55 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:07:45 user nova-compute[75216]: DEBUG nova.compute.manager [None req-0779e5cb-767a-4812-a26c-5c18a8fc45a7 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: 8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa] Checking state {{(pid=75216) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 19:07:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f122bd6a-3660-4ca8-9e30-a753d863f0a9 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Lock "7b752173-e573-426e-b9f1-bff92a4c2b55" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.690s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:07:45 user nova-compute[75216]: DEBUG nova.compute.manager [req-2f3a9eb0-dace-43b1-9370-cf10e5475b66 req-ac49cb59-ccb4-48b4-9894-bc2bfbbd3224 service nova] [instance: 8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa] Received event network-vif-plugged-0f86c64c-3da6-44d9-8c74-e276f2496f35 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:07:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-2f3a9eb0-dace-43b1-9370-cf10e5475b66 req-ac49cb59-ccb4-48b4-9894-bc2bfbbd3224 service nova] Acquiring lock "8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:07:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-2f3a9eb0-dace-43b1-9370-cf10e5475b66 req-ac49cb59-ccb4-48b4-9894-bc2bfbbd3224 service nova] Lock "8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:07:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-2f3a9eb0-dace-43b1-9370-cf10e5475b66 req-ac49cb59-ccb4-48b4-9894-bc2bfbbd3224 service nova] Lock "8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:07:45 user nova-compute[75216]: DEBUG nova.compute.manager [req-2f3a9eb0-dace-43b1-9370-cf10e5475b66 req-ac49cb59-ccb4-48b4-9894-bc2bfbbd3224 service nova] [instance: 8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa] No waiting events found dispatching network-vif-plugged-0f86c64c-3da6-44d9-8c74-e276f2496f35 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 19:07:45 user nova-compute[75216]: WARNING nova.compute.manager [req-2f3a9eb0-dace-43b1-9370-cf10e5475b66 req-ac49cb59-ccb4-48b4-9894-bc2bfbbd3224 service nova] [instance: 8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa] Received unexpected event network-vif-plugged-0f86c64c-3da6-44d9-8c74-e276f2496f35 for instance with vm_state active and task_state None.
Nov 13 19:07:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-63c686c4-fab9-489e-9faa-3ae1de48ccbe tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Acquiring lock "7b752173-e573-426e-b9f1-bff92a4c2b55" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:07:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-63c686c4-fab9-489e-9faa-3ae1de48ccbe tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Lock "7b752173-e573-426e-b9f1-bff92a4c2b55" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:07:45 user nova-compute[75216]: DEBUG nova.compute.manager [None req-63c686c4-fab9-489e-9faa-3ae1de48ccbe tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] [instance: 7b752173-e573-426e-b9f1-bff92a4c2b55] Checking state {{(pid=75216) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 19:07:45 user nova-compute[75216]: DEBUG nova.compute.manager [None req-63c686c4-fab9-489e-9faa-3ae1de48ccbe tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] [instance: 7b752173-e573-426e-b9f1-bff92a4c2b55] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=75216) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 13 19:07:45 user nova-compute[75216]: DEBUG nova.objects.instance [None req-63c686c4-fab9-489e-9faa-3ae1de48ccbe tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Lazy-loading 'flavor' on Instance uuid 7b752173-e573-426e-b9f1-bff92a4c2b55 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:07:45 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:07:45 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:07:45 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:07:45 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:07:46 user nova-compute[75216]: DEBUG nova.compute.manager [req-2b32e23d-0b8b-4cd8-a383-6c920a1f2b86 req-72dff60e-420d-49ee-b95f-fe824486e015 service nova] [instance: 7b752173-e573-426e-b9f1-bff92a4c2b55] Received event network-vif-unplugged-60dd7b11-cfc3-4965-a429-8b2ac4cdfcf4 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:07:46 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-2b32e23d-0b8b-4cd8-a383-6c920a1f2b86 req-72dff60e-420d-49ee-b95f-fe824486e015 service nova] Acquiring lock "7b752173-e573-426e-b9f1-bff92a4c2b55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:07:46 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-2b32e23d-0b8b-4cd8-a383-6c920a1f2b86 req-72dff60e-420d-49ee-b95f-fe824486e015 service nova] Lock "7b752173-e573-426e-b9f1-bff92a4c2b55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:07:46 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-2b32e23d-0b8b-4cd8-a383-6c920a1f2b86 req-72dff60e-420d-49ee-b95f-fe824486e015 service nova] Lock "7b752173-e573-426e-b9f1-bff92a4c2b55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:07:46 user nova-compute[75216]: DEBUG nova.compute.manager [req-2b32e23d-0b8b-4cd8-a383-6c920a1f2b86 req-72dff60e-420d-49ee-b95f-fe824486e015 service nova] [instance: 7b752173-e573-426e-b9f1-bff92a4c2b55] No waiting events found dispatching network-vif-unplugged-60dd7b11-cfc3-4965-a429-8b2ac4cdfcf4 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 19:07:46 user nova-compute[75216]: WARNING nova.compute.manager [req-2b32e23d-0b8b-4cd8-a383-6c920a1f2b86 req-72dff60e-420d-49ee-b95f-fe824486e015 service nova] [instance: 7b752173-e573-426e-b9f1-bff92a4c2b55] Received unexpected event network-vif-unplugged-60dd7b11-cfc3-4965-a429-8b2ac4cdfcf4 for instance with vm_state active and task_state powering-off.
Nov 13 19:07:46 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 7b752173-e573-426e-b9f1-bff92a4c2b55] Instance destroyed successfully.
Nov 13 19:07:46 user nova-compute[75216]: DEBUG nova.compute.manager [None req-63c686c4-fab9-489e-9faa-3ae1de48ccbe tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] [instance: 7b752173-e573-426e-b9f1-bff92a4c2b55] Checking state {{(pid=75216) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 19:07:46 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-63c686c4-fab9-489e-9faa-3ae1de48ccbe tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Lock "7b752173-e573-426e-b9f1-bff92a4c2b55" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.863s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:07:47 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:07:48 user nova-compute[75216]: DEBUG nova.compute.manager [req-21584a04-6c80-410c-9b99-6f46ebcdebf1 req-fa82f591-f8d0-49bc-bb22-d74938e35322 service nova] [instance: 7b752173-e573-426e-b9f1-bff92a4c2b55] Received event network-vif-plugged-60dd7b11-cfc3-4965-a429-8b2ac4cdfcf4 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:07:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-21584a04-6c80-410c-9b99-6f46ebcdebf1 req-fa82f591-f8d0-49bc-bb22-d74938e35322 service nova] Acquiring lock "7b752173-e573-426e-b9f1-bff92a4c2b55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:07:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-21584a04-6c80-410c-9b99-6f46ebcdebf1 req-fa82f591-f8d0-49bc-bb22-d74938e35322 service nova] Lock "7b752173-e573-426e-b9f1-bff92a4c2b55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:07:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-21584a04-6c80-410c-9b99-6f46ebcdebf1 req-fa82f591-f8d0-49bc-bb22-d74938e35322 service nova] Lock "7b752173-e573-426e-b9f1-bff92a4c2b55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:07:48 user nova-compute[75216]: DEBUG nova.compute.manager [req-21584a04-6c80-410c-9b99-6f46ebcdebf1 req-fa82f591-f8d0-49bc-bb22-d74938e35322 service nova] [instance: 7b752173-e573-426e-b9f1-bff92a4c2b55] No waiting events found dispatching network-vif-plugged-60dd7b11-cfc3-4965-a429-8b2ac4cdfcf4 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 19:07:48 user nova-compute[75216]: WARNING nova.compute.manager [req-21584a04-6c80-410c-9b99-6f46ebcdebf1 req-fa82f591-f8d0-49bc-bb22-d74938e35322 service nova] [instance: 7b752173-e573-426e-b9f1-bff92a4c2b55] Received unexpected event network-vif-plugged-60dd7b11-cfc3-4965-a429-8b2ac4cdfcf4 for instance with vm_state stopped and task_state None.
Nov 13 19:07:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f3469d28-8a6e-469c-ac6f-9bca627e5a6e tempest-VolumesNegativeTest-1403808012 tempest-VolumesNegativeTest-1403808012-project-member] Acquiring lock "4cc8ac6f-4187-4a76-836e-f7c50d68680d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:07:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f3469d28-8a6e-469c-ac6f-9bca627e5a6e tempest-VolumesNegativeTest-1403808012 tempest-VolumesNegativeTest-1403808012-project-member] Lock "4cc8ac6f-4187-4a76-836e-f7c50d68680d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:07:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f3469d28-8a6e-469c-ac6f-9bca627e5a6e tempest-VolumesNegativeTest-1403808012 tempest-VolumesNegativeTest-1403808012-project-member] Acquiring lock "4cc8ac6f-4187-4a76-836e-f7c50d68680d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:07:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f3469d28-8a6e-469c-ac6f-9bca627e5a6e tempest-VolumesNegativeTest-1403808012 tempest-VolumesNegativeTest-1403808012-project-member] Lock "4cc8ac6f-4187-4a76-836e-f7c50d68680d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:07:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f3469d28-8a6e-469c-ac6f-9bca627e5a6e tempest-VolumesNegativeTest-1403808012 tempest-VolumesNegativeTest-1403808012-project-member] Lock "4cc8ac6f-4187-4a76-836e-f7c50d68680d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:07:48 user nova-compute[75216]: INFO nova.compute.manager [None req-f3469d28-8a6e-469c-ac6f-9bca627e5a6e tempest-VolumesNegativeTest-1403808012 tempest-VolumesNegativeTest-1403808012-project-member] [instance: 4cc8ac6f-4187-4a76-836e-f7c50d68680d] Terminating instance
Nov 13 19:07:48 user nova-compute[75216]: DEBUG nova.compute.manager [None req-f3469d28-8a6e-469c-ac6f-9bca627e5a6e tempest-VolumesNegativeTest-1403808012 tempest-VolumesNegativeTest-1403808012-project-member] [instance: 4cc8ac6f-4187-4a76-836e-f7c50d68680d] Start destroying the instance on the hypervisor. {{(pid=75216) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 19:07:48 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:07:48 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:07:48 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:07:48 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:07:48 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:07:48 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 4cc8ac6f-4187-4a76-836e-f7c50d68680d] Instance destroyed successfully.
Nov 13 19:07:48 user nova-compute[75216]: DEBUG nova.objects.instance [None req-f3469d28-8a6e-469c-ac6f-9bca627e5a6e tempest-VolumesNegativeTest-1403808012 tempest-VolumesNegativeTest-1403808012-project-member] Lazy-loading 'resources' on Instance uuid 4cc8ac6f-4187-4a76-836e-f7c50d68680d {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:07:48 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-f3469d28-8a6e-469c-ac6f-9bca627e5a6e tempest-VolumesNegativeTest-1403808012 tempest-VolumesNegativeTest-1403808012-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T19:05:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-300777468',display_name='tempest-VolumesNegativeTest-instance-300777468',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-300777468',id=33,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-13T19:06:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d76d07bda377422f9567698320bd873f',ramdisk_id='',reservation_id='r-hyhzt7t2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-1403808012',owner_user_name='tempest-VolumesNegativeTest-1403808012-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T19:06:05Z,user_data=None,user_id='baaf879bc0154d429f1c0232ccdc883e',uuid=4cc8ac6f-4187-4a76-836e-f7c50d68680d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cc7c390d-5c06-4c13-bf6b-ac36420e8a21", "address": "fa:16:3e:f0:de:30", "network": {"id": "318e2136-b0d7-42f0-9fed-da0a9463f72e", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.42", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "c465b7c26ec44582b6d1b7169536ecc0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc7c390d-5c", "ovs_interfaceid": "cc7c390d-5c06-4c13-bf6b-ac36420e8a21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 19:07:48 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-f3469d28-8a6e-469c-ac6f-9bca627e5a6e tempest-VolumesNegativeTest-1403808012 tempest-VolumesNegativeTest-1403808012-project-member] Converting VIF {"id": "cc7c390d-5c06-4c13-bf6b-ac36420e8a21", "address": "fa:16:3e:f0:de:30", "network": {"id": "318e2136-b0d7-42f0-9fed-da0a9463f72e", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.42", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "c465b7c26ec44582b6d1b7169536ecc0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc7c390d-5c", "ovs_interfaceid": "cc7c390d-5c06-4c13-bf6b-ac36420e8a21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 19:07:48 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-f3469d28-8a6e-469c-ac6f-9bca627e5a6e tempest-VolumesNegativeTest-1403808012 tempest-VolumesNegativeTest-1403808012-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:de:30,bridge_name='br-int',has_traffic_filtering=True,id=cc7c390d-5c06-4c13-bf6b-ac36420e8a21,network=Network(318e2136-b0d7-42f0-9fed-da0a9463f72e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc7c390d-5c') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 19:07:48 user nova-compute[75216]: DEBUG os_vif [None req-f3469d28-8a6e-469c-ac6f-9bca627e5a6e tempest-VolumesNegativeTest-1403808012 tempest-VolumesNegativeTest-1403808012-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:de:30,bridge_name='br-int',has_traffic_filtering=True,id=cc7c390d-5c06-4c13-bf6b-ac36420e8a21,network=Network(318e2136-b0d7-42f0-9fed-da0a9463f72e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc7c390d-5c') {{(pid=75216) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 19:07:48 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:07:48 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcc7c390d-5c, bridge=br-int, if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:07:48 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:07:48 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:07:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:07:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:07:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=77777971-6b99-46d5-83e5-89d0699f2ece) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:07:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:07:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:07:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:07:49 user nova-compute[75216]: INFO os_vif [None req-f3469d28-8a6e-469c-ac6f-9bca627e5a6e tempest-VolumesNegativeTest-1403808012 tempest-VolumesNegativeTest-1403808012-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:de:30,bridge_name='br-int',has_traffic_filtering=True,id=cc7c390d-5c06-4c13-bf6b-ac36420e8a21,network=Network(318e2136-b0d7-42f0-9fed-da0a9463f72e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc7c390d-5c')
Nov 13 19:07:49 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-f3469d28-8a6e-469c-ac6f-9bca627e5a6e tempest-VolumesNegativeTest-1403808012 tempest-VolumesNegativeTest-1403808012-project-member] [instance: 4cc8ac6f-4187-4a76-836e-f7c50d68680d] Deleting instance files /opt/stack/data/nova/instances/4cc8ac6f-4187-4a76-836e-f7c50d68680d_del
Nov 13 19:07:49 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-f3469d28-8a6e-469c-ac6f-9bca627e5a6e tempest-VolumesNegativeTest-1403808012 tempest-VolumesNegativeTest-1403808012-project-member] [instance: 4cc8ac6f-4187-4a76-836e-f7c50d68680d] Deletion of /opt/stack/data/nova/instances/4cc8ac6f-4187-4a76-836e-f7c50d68680d_del complete
Nov 13 19:07:49 user nova-compute[75216]: INFO nova.compute.manager [None req-f3469d28-8a6e-469c-ac6f-9bca627e5a6e tempest-VolumesNegativeTest-1403808012 tempest-VolumesNegativeTest-1403808012-project-member] [instance: 4cc8ac6f-4187-4a76-836e-f7c50d68680d] Took 0.70 seconds to destroy the instance on the hypervisor.
Nov 13 19:07:49 user nova-compute[75216]: DEBUG oslo.service.loopingcall [None req-f3469d28-8a6e-469c-ac6f-9bca627e5a6e tempest-VolumesNegativeTest-1403808012 tempest-VolumesNegativeTest-1403808012-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75216) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 19:07:49 user nova-compute[75216]: DEBUG nova.compute.manager [-] [instance: 4cc8ac6f-4187-4a76-836e-f7c50d68680d] Deallocating network for instance {{(pid=75216) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 19:07:49 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: 4cc8ac6f-4187-4a76-836e-f7c50d68680d] deallocate_for_instance() {{(pid=75216) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 19:07:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:07:49 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: 4cc8ac6f-4187-4a76-836e-f7c50d68680d] Updating instance_info_cache with network_info: [] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:07:49 user nova-compute[75216]: INFO nova.compute.manager [-] [instance: 4cc8ac6f-4187-4a76-836e-f7c50d68680d] Took 0.50 seconds to deallocate network for instance.
Nov 13 19:07:49 user nova-compute[75216]: DEBUG nova.compute.manager [req-982e682a-f206-4b39-b69c-a56a9ddcb4a6 req-33337ab5-e536-4690-92e9-6242793c6f43 service nova] [instance: 4cc8ac6f-4187-4a76-836e-f7c50d68680d] Received event network-vif-deleted-cc7c390d-5c06-4c13-bf6b-ac36420e8a21 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:07:49 user nova-compute[75216]: INFO nova.compute.manager [req-982e682a-f206-4b39-b69c-a56a9ddcb4a6 req-33337ab5-e536-4690-92e9-6242793c6f43 service nova] [instance: 4cc8ac6f-4187-4a76-836e-f7c50d68680d] Neutron deleted interface cc7c390d-5c06-4c13-bf6b-ac36420e8a21; detaching it from the instance and deleting it from the info cache
Nov 13 19:07:49 user nova-compute[75216]: DEBUG nova.network.neutron [req-982e682a-f206-4b39-b69c-a56a9ddcb4a6 req-33337ab5-e536-4690-92e9-6242793c6f43 service nova] [instance: 4cc8ac6f-4187-4a76-836e-f7c50d68680d] Updating instance_info_cache with network_info: [] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:07:49 user nova-compute[75216]: DEBUG nova.compute.manager [req-982e682a-f206-4b39-b69c-a56a9ddcb4a6 req-33337ab5-e536-4690-92e9-6242793c6f43 service nova] [instance: 4cc8ac6f-4187-4a76-836e-f7c50d68680d] Detach interface failed, port_id=cc7c390d-5c06-4c13-bf6b-ac36420e8a21, reason: Instance 4cc8ac6f-4187-4a76-836e-f7c50d68680d could not be found. {{(pid=75216) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 13 19:07:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f3469d28-8a6e-469c-ac6f-9bca627e5a6e tempest-VolumesNegativeTest-1403808012 tempest-VolumesNegativeTest-1403808012-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:07:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f3469d28-8a6e-469c-ac6f-9bca627e5a6e tempest-VolumesNegativeTest-1403808012 tempest-VolumesNegativeTest-1403808012-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:07:49 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-f3469d28-8a6e-469c-ac6f-9bca627e5a6e tempest-VolumesNegativeTest-1403808012 tempest-VolumesNegativeTest-1403808012-project-member] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 19:07:49 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-f3469d28-8a6e-469c-ac6f-9bca627e5a6e tempest-VolumesNegativeTest-1403808012 tempest-VolumesNegativeTest-1403808012-project-member] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 19:07:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f3469d28-8a6e-469c-ac6f-9bca627e5a6e tempest-VolumesNegativeTest-1403808012 tempest-VolumesNegativeTest-1403808012-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.304s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:07:49 user nova-compute[75216]: INFO nova.scheduler.client.report [None req-f3469d28-8a6e-469c-ac6f-9bca627e5a6e tempest-VolumesNegativeTest-1403808012 tempest-VolumesNegativeTest-1403808012-project-member] Deleted allocations for instance 4cc8ac6f-4187-4a76-836e-f7c50d68680d
Nov 13 19:07:50 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f3469d28-8a6e-469c-ac6f-9bca627e5a6e tempest-VolumesNegativeTest-1403808012 tempest-VolumesNegativeTest-1403808012-project-member] Lock "4cc8ac6f-4187-4a76-836e-f7c50d68680d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.708s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:07:50 user nova-compute[75216]: DEBUG nova.compute.manager [req-4bde2407-9923-4b93-92ea-184a04548739 req-b3bb6c6e-e430-4bfb-b671-3ffbb0ea0012 service nova] [instance: 4cc8ac6f-4187-4a76-836e-f7c50d68680d] Received event network-vif-unplugged-cc7c390d-5c06-4c13-bf6b-ac36420e8a21 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:07:50 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-4bde2407-9923-4b93-92ea-184a04548739 req-b3bb6c6e-e430-4bfb-b671-3ffbb0ea0012 service nova] Acquiring lock "4cc8ac6f-4187-4a76-836e-f7c50d68680d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:07:50 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-4bde2407-9923-4b93-92ea-184a04548739 req-b3bb6c6e-e430-4bfb-b671-3ffbb0ea0012 service nova] Lock "4cc8ac6f-4187-4a76-836e-f7c50d68680d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:07:50 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-4bde2407-9923-4b93-92ea-184a04548739 req-b3bb6c6e-e430-4bfb-b671-3ffbb0ea0012 service nova] Lock "4cc8ac6f-4187-4a76-836e-f7c50d68680d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:07:50 user nova-compute[75216]: DEBUG nova.compute.manager [req-4bde2407-9923-4b93-92ea-184a04548739 req-b3bb6c6e-e430-4bfb-b671-3ffbb0ea0012 service nova] [instance: 4cc8ac6f-4187-4a76-836e-f7c50d68680d] No waiting events found dispatching network-vif-unplugged-cc7c390d-5c06-4c13-bf6b-ac36420e8a21 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 19:07:50 user nova-compute[75216]: WARNING nova.compute.manager [req-4bde2407-9923-4b93-92ea-184a04548739 req-b3bb6c6e-e430-4bfb-b671-3ffbb0ea0012 service nova] [instance: 4cc8ac6f-4187-4a76-836e-f7c50d68680d] Received unexpected event network-vif-unplugged-cc7c390d-5c06-4c13-bf6b-ac36420e8a21 for instance with vm_state deleted and task_state None.
Nov 13 19:07:50 user nova-compute[75216]: DEBUG nova.compute.manager [req-4bde2407-9923-4b93-92ea-184a04548739 req-b3bb6c6e-e430-4bfb-b671-3ffbb0ea0012 service nova] [instance: 4cc8ac6f-4187-4a76-836e-f7c50d68680d] Received event network-vif-plugged-cc7c390d-5c06-4c13-bf6b-ac36420e8a21 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:07:50 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-4bde2407-9923-4b93-92ea-184a04548739 req-b3bb6c6e-e430-4bfb-b671-3ffbb0ea0012 service nova] Acquiring lock "4cc8ac6f-4187-4a76-836e-f7c50d68680d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:07:50 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-4bde2407-9923-4b93-92ea-184a04548739 req-b3bb6c6e-e430-4bfb-b671-3ffbb0ea0012 service nova] Lock "4cc8ac6f-4187-4a76-836e-f7c50d68680d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:07:50 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-4bde2407-9923-4b93-92ea-184a04548739 req-b3bb6c6e-e430-4bfb-b671-3ffbb0ea0012 service nova] Lock "4cc8ac6f-4187-4a76-836e-f7c50d68680d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:07:50 user nova-compute[75216]: DEBUG nova.compute.manager [req-4bde2407-9923-4b93-92ea-184a04548739 req-b3bb6c6e-e430-4bfb-b671-3ffbb0ea0012 service nova] [instance: 4cc8ac6f-4187-4a76-836e-f7c50d68680d] No waiting events found dispatching network-vif-plugged-cc7c390d-5c06-4c13-bf6b-ac36420e8a21 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 19:07:50 user nova-compute[75216]: WARNING nova.compute.manager [req-4bde2407-9923-4b93-92ea-184a04548739 req-b3bb6c6e-e430-4bfb-b671-3ffbb0ea0012 service nova] [instance: 4cc8ac6f-4187-4a76-836e-f7c50d68680d] Received unexpected event network-vif-plugged-cc7c390d-5c06-4c13-bf6b-ac36420e8a21 for instance with vm_state deleted and task_state None.
Nov 13 19:07:54 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:07:57 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:07:57 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:07:58 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:07:59 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:07:59 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:07:59 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:08:01 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:08:01 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75216) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 19:08:03 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:08:03 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:08:04 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:08:04 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:08:05 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:08:05 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:08:05 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:08:05 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:08:05 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Auditing locally available compute resources for user (node: user) {{(pid=75216) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 19:08:05 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 19:08:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc2b6a17-b3bf-42da-ad68-2f125c952a31/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:08:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc2b6a17-b3bf-42da-ad68-2f125c952a31/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:08:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc2b6a17-b3bf-42da-ad68-2f125c952a31/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:08:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc2b6a17-b3bf-42da-ad68-2f125c952a31/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:08:05 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 19:08:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b752173-e573-426e-b9f1-bff92a4c2b55/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:08:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b752173-e573-426e-b9f1-bff92a4c2b55/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:08:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b752173-e573-426e-b9f1-bff92a4c2b55/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:08:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b752173-e573-426e-b9f1-bff92a4c2b55/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:08:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:08:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:08:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:08:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:08:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c18c0ad-60e5-4ef2-97f2-b7008e89ac78/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:08:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c18c0ad-60e5-4ef2-97f2-b7008e89ac78/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:08:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c18c0ad-60e5-4ef2-97f2-b7008e89ac78/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:08:07 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c18c0ad-60e5-4ef2-97f2-b7008e89ac78/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:08:07 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 19:08:07 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 19:08:07 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Hypervisor/Node resource view: name=user free_ram=8425MB free_disk=25.183292388916016GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75216) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 19:08:07 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:08:07 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:08:07 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 19:08:07 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance 1e5f1164-a15e-40cf-b7bc-5aeb404a1216 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 19:08:07 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance 5c18c0ad-60e5-4ef2-97f2-b7008e89ac78 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 19:08:07 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance 7b752173-e573-426e-b9f1-bff92a4c2b55 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 19:08:07 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance 8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 19:08:07 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance fc2b6a17-b3bf-42da-ad68-2f125c952a31 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 19:08:07 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 19:08:07 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 19:08:07 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 19:08:07 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 19:08:07 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Compute_service record updated for user:user {{(pid=75216) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 19:08:07 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.450s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:08:08 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:08:08 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Starting heal instance info cache {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 19:08:08 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Didn't find any instances for network info cache update. {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 13 19:08:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:08:09 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:08:14 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:08:14 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:08:19 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:08:19 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:08:19 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75216) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 19:08:19 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 19:08:19 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 19:08:19 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:08:24 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:08:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:08:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:08:30 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:08:34 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:08:36 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:08:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:08:38 user nova-compute[75216]: DEBUG nova.compute.manager [req-e4c6b21a-d141-4b09-93f8-f5cb681311af req-8352c660-4057-400c-bfd2-d1df5647c712 service nova] [instance: fc2b6a17-b3bf-42da-ad68-2f125c952a31] Received event network-changed-4621e43a-a523-4506-8520-bcca759faa35 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:08:38 user nova-compute[75216]: DEBUG nova.compute.manager [req-e4c6b21a-d141-4b09-93f8-f5cb681311af req-8352c660-4057-400c-bfd2-d1df5647c712 service nova] [instance: fc2b6a17-b3bf-42da-ad68-2f125c952a31] Refreshing instance network info cache due to event network-changed-4621e43a-a523-4506-8520-bcca759faa35. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 19:08:38 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-e4c6b21a-d141-4b09-93f8-f5cb681311af req-8352c660-4057-400c-bfd2-d1df5647c712 service nova] Acquiring lock "refresh_cache-fc2b6a17-b3bf-42da-ad68-2f125c952a31" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 19:08:38 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-e4c6b21a-d141-4b09-93f8-f5cb681311af req-8352c660-4057-400c-bfd2-d1df5647c712 service nova] Acquired lock "refresh_cache-fc2b6a17-b3bf-42da-ad68-2f125c952a31" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 19:08:38 user nova-compute[75216]: DEBUG nova.network.neutron [req-e4c6b21a-d141-4b09-93f8-f5cb681311af req-8352c660-4057-400c-bfd2-d1df5647c712 service nova] [instance: fc2b6a17-b3bf-42da-ad68-2f125c952a31] Refreshing network info cache for port 4621e43a-a523-4506-8520-bcca759faa35 {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 19:08:38 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:08:39 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:08:39 user nova-compute[75216]: DEBUG nova.network.neutron [req-e4c6b21a-d141-4b09-93f8-f5cb681311af req-8352c660-4057-400c-bfd2-d1df5647c712 service nova] [instance: fc2b6a17-b3bf-42da-ad68-2f125c952a31] Updated VIF entry in instance network info cache for port 4621e43a-a523-4506-8520-bcca759faa35. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 19:08:39 user nova-compute[75216]: DEBUG nova.network.neutron [req-e4c6b21a-d141-4b09-93f8-f5cb681311af req-8352c660-4057-400c-bfd2-d1df5647c712 service nova] [instance: fc2b6a17-b3bf-42da-ad68-2f125c952a31] Updating instance_info_cache with network_info: [{"id": "4621e43a-a523-4506-8520-bcca759faa35", "address": "fa:16:3e:58:6e:5f", "network": {"id": "8cbeb1cc-a067-4c8d-82d8-0dc5c2ac924c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-742672345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a58d1e76a793406bbdd3821ff74abd92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4621e43a-a5", "ovs_interfaceid": "4621e43a-a523-4506-8520-bcca759faa35", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:08:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-e4c6b21a-d141-4b09-93f8-f5cb681311af req-8352c660-4057-400c-bfd2-d1df5647c712 service nova] Releasing lock "refresh_cache-fc2b6a17-b3bf-42da-ad68-2f125c952a31" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 19:08:41 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-44bd827d-fce8-493e-af80-62193e77be9e tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Acquiring lock "fc2b6a17-b3bf-42da-ad68-2f125c952a31" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:08:41 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-44bd827d-fce8-493e-af80-62193e77be9e tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Lock "fc2b6a17-b3bf-42da-ad68-2f125c952a31" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:08:41 user nova-compute[75216]: INFO nova.compute.manager [None req-44bd827d-fce8-493e-af80-62193e77be9e tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] [instance: fc2b6a17-b3bf-42da-ad68-2f125c952a31] Shelving
Nov 13 19:08:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:08:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:08:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:08:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:08:41 user nova-compute[75216]: DEBUG nova.compute.manager [req-47bfb9b0-459f-4c9b-83bb-e312f518f889 req-220f63b1-dc59-4e21-ac04-48dff38bffd4 service nova] [instance: fc2b6a17-b3bf-42da-ad68-2f125c952a31] Received event network-vif-unplugged-4621e43a-a523-4506-8520-bcca759faa35 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:08:41 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-47bfb9b0-459f-4c9b-83bb-e312f518f889 req-220f63b1-dc59-4e21-ac04-48dff38bffd4 service nova] Acquiring lock "fc2b6a17-b3bf-42da-ad68-2f125c952a31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:08:41 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-47bfb9b0-459f-4c9b-83bb-e312f518f889 req-220f63b1-dc59-4e21-ac04-48dff38bffd4 service nova] Lock "fc2b6a17-b3bf-42da-ad68-2f125c952a31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:08:41 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-47bfb9b0-459f-4c9b-83bb-e312f518f889 req-220f63b1-dc59-4e21-ac04-48dff38bffd4 service nova] Lock "fc2b6a17-b3bf-42da-ad68-2f125c952a31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:08:41 user nova-compute[75216]: DEBUG nova.compute.manager [req-47bfb9b0-459f-4c9b-83bb-e312f518f889 req-220f63b1-dc59-4e21-ac04-48dff38bffd4 service nova] [instance: fc2b6a17-b3bf-42da-ad68-2f125c952a31] No waiting events found dispatching network-vif-unplugged-4621e43a-a523-4506-8520-bcca759faa35 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 19:08:41 user nova-compute[75216]: WARNING nova.compute.manager [req-47bfb9b0-459f-4c9b-83bb-e312f518f889 req-220f63b1-dc59-4e21-ac04-48dff38bffd4 service nova] [instance: fc2b6a17-b3bf-42da-ad68-2f125c952a31] Received unexpected event network-vif-unplugged-4621e43a-a523-4506-8520-bcca759faa35 for instance with vm_state active and task_state shelving.
Nov 13 19:08:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:08:41 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: fc2b6a17-b3bf-42da-ad68-2f125c952a31] Instance destroyed successfully.
Nov 13 19:08:41 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-44bd827d-fce8-493e-af80-62193e77be9e tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] [instance: fc2b6a17-b3bf-42da-ad68-2f125c952a31] Beginning cold snapshot process
Nov 13 19:08:42 user nova-compute[75216]: DEBUG nova.privsep.utils [None req-44bd827d-fce8-493e-af80-62193e77be9e tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75216) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 13 19:08:42 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-44bd827d-fce8-493e-af80-62193e77be9e tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/fc2b6a17-b3bf-42da-ad68-2f125c952a31/disk /opt/stack/data/nova/instances/snapshots/tmp_2d6f6ok/cf6b87d59cef4b95a578ef7de6076d83 {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:08:43 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-44bd827d-fce8-493e-af80-62193e77be9e tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/fc2b6a17-b3bf-42da-ad68-2f125c952a31/disk /opt/stack/data/nova/instances/snapshots/tmp_2d6f6ok/cf6b87d59cef4b95a578ef7de6076d83" returned: 0 in 1.094s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:08:43 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-44bd827d-fce8-493e-af80-62193e77be9e tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] [instance: fc2b6a17-b3bf-42da-ad68-2f125c952a31] Snapshot extracted, beginning image upload
Nov 13 19:08:43 user nova-compute[75216]: DEBUG nova.compute.manager [req-f1f19e50-da59-452b-8f04-b924426848e5 req-7a2f416e-db1c-476a-bd51-863bc6860aa6 service nova] [instance: fc2b6a17-b3bf-42da-ad68-2f125c952a31] Received event network-vif-plugged-4621e43a-a523-4506-8520-bcca759faa35 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:08:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-f1f19e50-da59-452b-8f04-b924426848e5 req-7a2f416e-db1c-476a-bd51-863bc6860aa6 service nova] Acquiring lock "fc2b6a17-b3bf-42da-ad68-2f125c952a31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:08:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-f1f19e50-da59-452b-8f04-b924426848e5 req-7a2f416e-db1c-476a-bd51-863bc6860aa6 service nova] Lock "fc2b6a17-b3bf-42da-ad68-2f125c952a31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:08:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-f1f19e50-da59-452b-8f04-b924426848e5 req-7a2f416e-db1c-476a-bd51-863bc6860aa6 service nova] Lock "fc2b6a17-b3bf-42da-ad68-2f125c952a31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:08:43 user nova-compute[75216]: DEBUG nova.compute.manager [req-f1f19e50-da59-452b-8f04-b924426848e5 req-7a2f416e-db1c-476a-bd51-863bc6860aa6 service nova] [instance: fc2b6a17-b3bf-42da-ad68-2f125c952a31] No waiting events found dispatching network-vif-plugged-4621e43a-a523-4506-8520-bcca759faa35 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 19:08:43 user nova-compute[75216]: WARNING nova.compute.manager [req-f1f19e50-da59-452b-8f04-b924426848e5 req-7a2f416e-db1c-476a-bd51-863bc6860aa6 service nova] [instance: fc2b6a17-b3bf-42da-ad68-2f125c952a31] Received unexpected event network-vif-plugged-4621e43a-a523-4506-8520-bcca759faa35 for instance with vm_state active and task_state shelving_image_uploading.
Nov 13 19:08:43 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:08:43 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:08:44 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:08:45 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-44bd827d-fce8-493e-af80-62193e77be9e tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] [instance: fc2b6a17-b3bf-42da-ad68-2f125c952a31] Snapshot image upload complete
Nov 13 19:08:45 user nova-compute[75216]: DEBUG nova.compute.manager [None req-44bd827d-fce8-493e-af80-62193e77be9e tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] [instance: fc2b6a17-b3bf-42da-ad68-2f125c952a31] Checking state {{(pid=75216) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 19:08:46 user nova-compute[75216]: INFO nova.compute.manager [None req-44bd827d-fce8-493e-af80-62193e77be9e tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] [instance: fc2b6a17-b3bf-42da-ad68-2f125c952a31] Shelve offloading
Nov 13 19:08:46 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: fc2b6a17-b3bf-42da-ad68-2f125c952a31] Instance destroyed successfully.
Nov 13 19:08:46 user nova-compute[75216]: DEBUG nova.compute.manager [None req-44bd827d-fce8-493e-af80-62193e77be9e tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] [instance: fc2b6a17-b3bf-42da-ad68-2f125c952a31] Checking state {{(pid=75216) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 19:08:46 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-44bd827d-fce8-493e-af80-62193e77be9e tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Acquiring lock "refresh_cache-fc2b6a17-b3bf-42da-ad68-2f125c952a31" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 19:08:46 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-44bd827d-fce8-493e-af80-62193e77be9e tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Acquired lock "refresh_cache-fc2b6a17-b3bf-42da-ad68-2f125c952a31" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 19:08:46 user nova-compute[75216]: DEBUG nova.network.neutron [None req-44bd827d-fce8-493e-af80-62193e77be9e tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] [instance: fc2b6a17-b3bf-42da-ad68-2f125c952a31] Building network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 19:08:46 user nova-compute[75216]: DEBUG nova.network.neutron [None req-44bd827d-fce8-493e-af80-62193e77be9e tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] [instance: fc2b6a17-b3bf-42da-ad68-2f125c952a31] Updating instance_info_cache with network_info: [{"id": "4621e43a-a523-4506-8520-bcca759faa35", "address": "fa:16:3e:58:6e:5f", "network": {"id": "8cbeb1cc-a067-4c8d-82d8-0dc5c2ac924c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-742672345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a58d1e76a793406bbdd3821ff74abd92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4621e43a-a5", "ovs_interfaceid": "4621e43a-a523-4506-8520-bcca759faa35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:08:46 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-44bd827d-fce8-493e-af80-62193e77be9e tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Releasing lock "refresh_cache-fc2b6a17-b3bf-42da-ad68-2f125c952a31" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 19:08:46 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-444810bd-33b5-4b80-9033-55632be29fc1 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] Acquiring lock "33d6832f-1d6a-4f64-9e1b-07078e7e84a5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:08:46 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-444810bd-33b5-4b80-9033-55632be29fc1 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] Lock "33d6832f-1d6a-4f64-9e1b-07078e7e84a5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:08:46 user nova-compute[75216]: DEBUG nova.compute.manager [None req-444810bd-33b5-4b80-9033-55632be29fc1 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] [instance: 33d6832f-1d6a-4f64-9e1b-07078e7e84a5] Starting instance... {{(pid=75216) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 19:08:46 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-444810bd-33b5-4b80-9033-55632be29fc1 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:08:46 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-444810bd-33b5-4b80-9033-55632be29fc1 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:08:46 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-444810bd-33b5-4b80-9033-55632be29fc1 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75216) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 19:08:46 user nova-compute[75216]: INFO nova.compute.claims [None req-444810bd-33b5-4b80-9033-55632be29fc1 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] [instance: 33d6832f-1d6a-4f64-9e1b-07078e7e84a5] Claim successful on node user
Nov 13 19:08:46 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: fc2b6a17-b3bf-42da-ad68-2f125c952a31] Instance destroyed successfully.
Nov 13 19:08:46 user nova-compute[75216]: DEBUG nova.objects.instance [None req-44bd827d-fce8-493e-af80-62193e77be9e tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Lazy-loading 'resources' on Instance uuid fc2b6a17-b3bf-42da-ad68-2f125c952a31 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:08:46 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-44bd827d-fce8-493e-af80-62193e77be9e tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T19:06:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1100425294',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1100425294',id=34,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLQQ4b0ZgFgW0WLUck0T8rTYpv9XskxQgqhkS9uzqraM7b70xziVxvyZlVKxIrkuAfXiPHYbxqzjoM3edHEog9CZ0MEhMfcDmXiqrq1oF6XaoxsWh3j2G+HncdUW44bIuw==',key_name='tempest-keypair-569881079',keypairs=<?>,launch_index=0,launched_at=2023-11-13T19:06:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='a58d1e76a793406bbdd3821ff74abd92',ramdisk_id='',reservation_id='r-ie2w7xdd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1861834155',owner_user_name='tempest-AttachVolumeShelveTestJSON-1861834155-project-member',shelved_at='2023-11-13T19:08:45.947141',shelved_host='user',shelved_image_id='20909060-0bdd-4e57-a052-325c7f65d799'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T19:08:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e59bd525db64698b8e3587734cde6b8',uuid=fc2b6a17-b3bf-42da-ad68-2f125c952a31,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "4621e43a-a523-4506-8520-bcca759faa35", "address": "fa:16:3e:58:6e:5f", "network": {"id": "8cbeb1cc-a067-4c8d-82d8-0dc5c2ac924c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-742672345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a58d1e76a793406bbdd3821ff74abd92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4621e43a-a5", "ovs_interfaceid": "4621e43a-a523-4506-8520-bcca759faa35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 19:08:46 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-44bd827d-fce8-493e-af80-62193e77be9e tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Converting VIF {"id": "4621e43a-a523-4506-8520-bcca759faa35", "address": "fa:16:3e:58:6e:5f", "network": {"id": "8cbeb1cc-a067-4c8d-82d8-0dc5c2ac924c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-742672345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a58d1e76a793406bbdd3821ff74abd92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4621e43a-a5", "ovs_interfaceid": "4621e43a-a523-4506-8520-bcca759faa35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 19:08:46 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-44bd827d-fce8-493e-af80-62193e77be9e tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:6e:5f,bridge_name='br-int',has_traffic_filtering=True,id=4621e43a-a523-4506-8520-bcca759faa35,network=Network(8cbeb1cc-a067-4c8d-82d8-0dc5c2ac924c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4621e43a-a5') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 19:08:46 user nova-compute[75216]: DEBUG os_vif [None req-44bd827d-fce8-493e-af80-62193e77be9e tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:6e:5f,bridge_name='br-int',has_traffic_filtering=True,id=4621e43a-a523-4506-8520-bcca759faa35,network=Network(8cbeb1cc-a067-4c8d-82d8-0dc5c2ac924c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4621e43a-a5') {{(pid=75216) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 19:08:46 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:08:46 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4621e43a-a5, bridge=br-int, if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:08:47 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:08:47 user nova-compute[75216]: DEBUG nova.compute.manager [req-4e030c06-254d-48b9-a82e-f3b44fc428fd req-071ecd25-35af-46a9-84a5-93abb75a402c service nova] [instance: fc2b6a17-b3bf-42da-ad68-2f125c952a31] Received event network-changed-4621e43a-a523-4506-8520-bcca759faa35 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:08:47 user nova-compute[75216]: DEBUG nova.compute.manager [req-4e030c06-254d-48b9-a82e-f3b44fc428fd req-071ecd25-35af-46a9-84a5-93abb75a402c service nova] [instance: fc2b6a17-b3bf-42da-ad68-2f125c952a31] Refreshing instance network info cache due to event network-changed-4621e43a-a523-4506-8520-bcca759faa35. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 19:08:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-4e030c06-254d-48b9-a82e-f3b44fc428fd req-071ecd25-35af-46a9-84a5-93abb75a402c service nova] Acquiring lock "refresh_cache-fc2b6a17-b3bf-42da-ad68-2f125c952a31" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 19:08:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-4e030c06-254d-48b9-a82e-f3b44fc428fd req-071ecd25-35af-46a9-84a5-93abb75a402c service nova] Acquired lock "refresh_cache-fc2b6a17-b3bf-42da-ad68-2f125c952a31" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 19:08:47 user nova-compute[75216]: DEBUG nova.network.neutron [req-4e030c06-254d-48b9-a82e-f3b44fc428fd req-071ecd25-35af-46a9-84a5-93abb75a402c service nova] [instance: fc2b6a17-b3bf-42da-ad68-2f125c952a31] Refreshing network info cache for port 4621e43a-a523-4506-8520-bcca759faa35 {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 19:08:47 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:08:47 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:08:47 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=005553b9-54c4-4d93-8532-07dbeb85c820) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:08:47 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:08:47 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:08:47 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:08:47 user nova-compute[75216]: INFO os_vif [None req-44bd827d-fce8-493e-af80-62193e77be9e tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:6e:5f,bridge_name='br-int',has_traffic_filtering=True,id=4621e43a-a523-4506-8520-bcca759faa35,network=Network(8cbeb1cc-a067-4c8d-82d8-0dc5c2ac924c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4621e43a-a5')
Nov 13 19:08:47 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-44bd827d-fce8-493e-af80-62193e77be9e tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] [instance: fc2b6a17-b3bf-42da-ad68-2f125c952a31] Deleting instance files /opt/stack/data/nova/instances/fc2b6a17-b3bf-42da-ad68-2f125c952a31_del
Nov 13 19:08:47 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-44bd827d-fce8-493e-af80-62193e77be9e tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] [instance: fc2b6a17-b3bf-42da-ad68-2f125c952a31] Deletion of /opt/stack/data/nova/instances/fc2b6a17-b3bf-42da-ad68-2f125c952a31_del complete
Nov 13 19:08:47 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-444810bd-33b5-4b80-9033-55632be29fc1 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 19:08:47 user nova-compute[75216]: INFO nova.scheduler.client.report [None req-44bd827d-fce8-493e-af80-62193e77be9e tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Deleted allocations for instance fc2b6a17-b3bf-42da-ad68-2f125c952a31
Nov 13 19:08:47 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-444810bd-33b5-4b80-9033-55632be29fc1 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 19:08:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-444810bd-33b5-4b80-9033-55632be29fc1 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.387s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:08:47 user nova-compute[75216]: DEBUG nova.compute.manager [None req-444810bd-33b5-4b80-9033-55632be29fc1 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] [instance: 33d6832f-1d6a-4f64-9e1b-07078e7e84a5] Start building networks asynchronously for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 19:08:47 user nova-compute[75216]: DEBUG nova.network.neutron [req-4e030c06-254d-48b9-a82e-f3b44fc428fd req-071ecd25-35af-46a9-84a5-93abb75a402c service nova] [instance: fc2b6a17-b3bf-42da-ad68-2f125c952a31] Updated VIF entry in instance network info cache for port 4621e43a-a523-4506-8520-bcca759faa35. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 19:08:47 user nova-compute[75216]: DEBUG nova.network.neutron [req-4e030c06-254d-48b9-a82e-f3b44fc428fd req-071ecd25-35af-46a9-84a5-93abb75a402c service nova] [instance: fc2b6a17-b3bf-42da-ad68-2f125c952a31] Updating instance_info_cache with network_info: [{"id": "4621e43a-a523-4506-8520-bcca759faa35", "address": "fa:16:3e:58:6e:5f", "network": {"id": "8cbeb1cc-a067-4c8d-82d8-0dc5c2ac924c", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-742672345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a58d1e76a793406bbdd3821ff74abd92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap4621e43a-a5", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:08:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-44bd827d-fce8-493e-af80-62193e77be9e tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:08:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-44bd827d-fce8-493e-af80-62193e77be9e tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:08:47 user nova-compute[75216]: DEBUG nova.compute.manager [None req-444810bd-33b5-4b80-9033-55632be29fc1 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] [instance: 33d6832f-1d6a-4f64-9e1b-07078e7e84a5] Allocating IP information in the background. {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 19:08:47 user nova-compute[75216]: DEBUG nova.network.neutron [None req-444810bd-33b5-4b80-9033-55632be29fc1 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] [instance: 33d6832f-1d6a-4f64-9e1b-07078e7e84a5] allocate_for_instance() {{(pid=75216) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 19:08:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-4e030c06-254d-48b9-a82e-f3b44fc428fd req-071ecd25-35af-46a9-84a5-93abb75a402c service nova] Releasing lock "refresh_cache-fc2b6a17-b3bf-42da-ad68-2f125c952a31" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 19:08:47 user nova-compute[75216]: DEBUG nova.objects.instance [None req-44bd827d-fce8-493e-af80-62193e77be9e tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Lazy-loading 'numa_topology' on Instance uuid fc2b6a17-b3bf-42da-ad68-2f125c952a31 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:08:47 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-444810bd-33b5-4b80-9033-55632be29fc1 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] [instance: 33d6832f-1d6a-4f64-9e1b-07078e7e84a5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 19:08:47 user nova-compute[75216]: DEBUG nova.objects.base [None req-44bd827d-fce8-493e-af80-62193e77be9e tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Object Instance<fc2b6a17-b3bf-42da-ad68-2f125c952a31> lazy-loaded attributes: resources,numa_topology {{(pid=75216) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 19:08:47 user nova-compute[75216]: DEBUG nova.compute.manager [None req-444810bd-33b5-4b80-9033-55632be29fc1 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] [instance: 33d6832f-1d6a-4f64-9e1b-07078e7e84a5] Start building block device mappings for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 19:08:47 user nova-compute[75216]: DEBUG nova.policy [None req-444810bd-33b5-4b80-9033-55632be29fc1 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a34f9f7210f1453aba50463c8a4c3ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3ed74465c6499e9508724c439ddb0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75216) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 19:08:47 user nova-compute[75216]: DEBUG nova.compute.manager [None req-444810bd-33b5-4b80-9033-55632be29fc1 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] [instance: 33d6832f-1d6a-4f64-9e1b-07078e7e84a5] Start spawning the instance on the hypervisor. {{(pid=75216) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 19:08:47 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-444810bd-33b5-4b80-9033-55632be29fc1 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] [instance: 33d6832f-1d6a-4f64-9e1b-07078e7e84a5] Creating instance directory {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 19:08:47 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-444810bd-33b5-4b80-9033-55632be29fc1 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] [instance: 33d6832f-1d6a-4f64-9e1b-07078e7e84a5] Creating image(s)
Nov 13 19:08:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-444810bd-33b5-4b80-9033-55632be29fc1 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] Acquiring lock "/opt/stack/data/nova/instances/33d6832f-1d6a-4f64-9e1b-07078e7e84a5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:08:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-444810bd-33b5-4b80-9033-55632be29fc1 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] Lock "/opt/stack/data/nova/instances/33d6832f-1d6a-4f64-9e1b-07078e7e84a5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:08:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-444810bd-33b5-4b80-9033-55632be29fc1 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] Lock "/opt/stack/data/nova/instances/33d6832f-1d6a-4f64-9e1b-07078e7e84a5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:08:47 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-444810bd-33b5-4b80-9033-55632be29fc1 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:08:47 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-44bd827d-fce8-493e-af80-62193e77be9e tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 19:08:47 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-44bd827d-fce8-493e-af80-62193e77be9e tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 19:08:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-44bd827d-fce8-493e-af80-62193e77be9e tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.298s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:08:47 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-444810bd-33b5-4b80-9033-55632be29fc1 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json" returned: 0 in 0.186s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:08:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-444810bd-33b5-4b80-9033-55632be29fc1 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] Acquiring lock "88c50a45bec9d6b0427462b3242b9b8e5f49c2b6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:08:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-444810bd-33b5-4b80-9033-55632be29fc1 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] Lock "88c50a45bec9d6b0427462b3242b9b8e5f49c2b6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:08:47 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-444810bd-33b5-4b80-9033-55632be29fc1 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:08:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-44bd827d-fce8-493e-af80-62193e77be9e tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Lock "fc2b6a17-b3bf-42da-ad68-2f125c952a31" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.752s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:08:47 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-444810bd-33b5-4b80-9033-55632be29fc1 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json" returned: 0 in 0.179s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:08:47 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-444810bd-33b5-4b80-9033-55632be29fc1 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6,backing_fmt=raw /opt/stack/data/nova/instances/33d6832f-1d6a-4f64-9e1b-07078e7e84a5/disk 1073741824 {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:08:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-444810bd-33b5-4b80-9033-55632be29fc1 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6,backing_fmt=raw /opt/stack/data/nova/instances/33d6832f-1d6a-4f64-9e1b-07078e7e84a5/disk 1073741824" returned: 0 in 0.064s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:08:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-444810bd-33b5-4b80-9033-55632be29fc1 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] Lock "88c50a45bec9d6b0427462b3242b9b8e5f49c2b6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.248s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:08:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-444810bd-33b5-4b80-9033-55632be29fc1 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:08:48 user nova-compute[75216]: DEBUG nova.network.neutron [None req-444810bd-33b5-4b80-9033-55632be29fc1 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] [instance: 33d6832f-1d6a-4f64-9e1b-07078e7e84a5] Successfully created port: 0c5edcf5-88d0-44aa-977d-51faede9daeb {{(pid=75216) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 19:08:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-444810bd-33b5-4b80-9033-55632be29fc1 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json" returned: 0 in 0.190s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:08:48 user nova-compute[75216]: DEBUG nova.virt.disk.api [None req-444810bd-33b5-4b80-9033-55632be29fc1 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] Checking if we can resize image /opt/stack/data/nova/instances/33d6832f-1d6a-4f64-9e1b-07078e7e84a5/disk. size=1073741824 {{(pid=75216) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 19:08:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-444810bd-33b5-4b80-9033-55632be29fc1 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33d6832f-1d6a-4f64-9e1b-07078e7e84a5/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:08:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-444810bd-33b5-4b80-9033-55632be29fc1 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33d6832f-1d6a-4f64-9e1b-07078e7e84a5/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:08:48 user nova-compute[75216]: DEBUG nova.virt.disk.api [None req-444810bd-33b5-4b80-9033-55632be29fc1 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] Cannot resize image /opt/stack/data/nova/instances/33d6832f-1d6a-4f64-9e1b-07078e7e84a5/disk to a smaller size. {{(pid=75216) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 19:08:48 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-444810bd-33b5-4b80-9033-55632be29fc1 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] [instance: 33d6832f-1d6a-4f64-9e1b-07078e7e84a5] Created local disks {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 19:08:48 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-444810bd-33b5-4b80-9033-55632be29fc1 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] [instance: 33d6832f-1d6a-4f64-9e1b-07078e7e84a5] Ensure instance console log exists: /opt/stack/data/nova/instances/33d6832f-1d6a-4f64-9e1b-07078e7e84a5/console.log {{(pid=75216) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 19:08:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-444810bd-33b5-4b80-9033-55632be29fc1 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:08:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-444810bd-33b5-4b80-9033-55632be29fc1 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:08:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-444810bd-33b5-4b80-9033-55632be29fc1 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:08:48 user nova-compute[75216]: DEBUG nova.network.neutron [None req-444810bd-33b5-4b80-9033-55632be29fc1 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] [instance: 33d6832f-1d6a-4f64-9e1b-07078e7e84a5] Successfully updated port: 0c5edcf5-88d0-44aa-977d-51faede9daeb {{(pid=75216) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 19:08:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-444810bd-33b5-4b80-9033-55632be29fc1 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] Acquiring lock "refresh_cache-33d6832f-1d6a-4f64-9e1b-07078e7e84a5" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 19:08:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-444810bd-33b5-4b80-9033-55632be29fc1 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] Acquired lock "refresh_cache-33d6832f-1d6a-4f64-9e1b-07078e7e84a5" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 19:08:48 user nova-compute[75216]: DEBUG nova.network.neutron [None req-444810bd-33b5-4b80-9033-55632be29fc1 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] [instance: 33d6832f-1d6a-4f64-9e1b-07078e7e84a5] Building network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 19:08:48 user nova-compute[75216]: DEBUG nova.network.neutron [None req-444810bd-33b5-4b80-9033-55632be29fc1 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] [instance: 33d6832f-1d6a-4f64-9e1b-07078e7e84a5] Instance cache missing network info. {{(pid=75216) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 19:08:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:08:49 user nova-compute[75216]: DEBUG nova.compute.manager [req-019e6283-0235-47fe-9170-974485a0f081 req-281bc7b1-7e80-494a-bdfb-9f01d9466da7 service nova] [instance: 33d6832f-1d6a-4f64-9e1b-07078e7e84a5] Received event network-changed-0c5edcf5-88d0-44aa-977d-51faede9daeb {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:08:49 user nova-compute[75216]: DEBUG nova.compute.manager [req-019e6283-0235-47fe-9170-974485a0f081 req-281bc7b1-7e80-494a-bdfb-9f01d9466da7 service nova] [instance: 33d6832f-1d6a-4f64-9e1b-07078e7e84a5] Refreshing instance network info cache due to event network-changed-0c5edcf5-88d0-44aa-977d-51faede9daeb. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 19:08:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-019e6283-0235-47fe-9170-974485a0f081 req-281bc7b1-7e80-494a-bdfb-9f01d9466da7 service nova] Acquiring lock "refresh_cache-33d6832f-1d6a-4f64-9e1b-07078e7e84a5" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 19:08:49 user nova-compute[75216]: DEBUG nova.network.neutron [None req-444810bd-33b5-4b80-9033-55632be29fc1 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] [instance: 33d6832f-1d6a-4f64-9e1b-07078e7e84a5] Updating instance_info_cache with network_info: [{"id": "0c5edcf5-88d0-44aa-977d-51faede9daeb", "address": "fa:16:3e:5b:07:f6", "network": {"id": "dc5c76ee-b62d-4bd4-80f6-04d6fd6776e3", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1854861756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d3ed74465c6499e9508724c439ddb0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c5edcf5-88", "ovs_interfaceid": "0c5edcf5-88d0-44aa-977d-51faede9daeb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:08:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-444810bd-33b5-4b80-9033-55632be29fc1 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] Releasing lock "refresh_cache-33d6832f-1d6a-4f64-9e1b-07078e7e84a5" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 19:08:49 user nova-compute[75216]: DEBUG nova.compute.manager [None req-444810bd-33b5-4b80-9033-55632be29fc1 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] [instance: 33d6832f-1d6a-4f64-9e1b-07078e7e84a5] Instance network_info: |[{"id": "0c5edcf5-88d0-44aa-977d-51faede9daeb", "address": "fa:16:3e:5b:07:f6", "network": {"id": "dc5c76ee-b62d-4bd4-80f6-04d6fd6776e3", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1854861756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d3ed74465c6499e9508724c439ddb0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c5edcf5-88", "ovs_interfaceid": "0c5edcf5-88d0-44aa-977d-51faede9daeb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 19:08:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-019e6283-0235-47fe-9170-974485a0f081 req-281bc7b1-7e80-494a-bdfb-9f01d9466da7 service nova] Acquired lock "refresh_cache-33d6832f-1d6a-4f64-9e1b-07078e7e84a5" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 19:08:49 user nova-compute[75216]: DEBUG nova.network.neutron [req-019e6283-0235-47fe-9170-974485a0f081 req-281bc7b1-7e80-494a-bdfb-9f01d9466da7 service nova] [instance: 33d6832f-1d6a-4f64-9e1b-07078e7e84a5] Refreshing network info cache for port 0c5edcf5-88d0-44aa-977d-51faede9daeb {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 19:08:49 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-444810bd-33b5-4b80-9033-55632be29fc1 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] [instance: 33d6832f-1d6a-4f64-9e1b-07078e7e84a5] Start _get_guest_xml network_info=[{"id": "0c5edcf5-88d0-44aa-977d-51faede9daeb", "address": "fa:16:3e:5b:07:f6", "network": {"id": "dc5c76ee-b62d-4bd4-80f6-04d6fd6776e3", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1854861756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d3ed74465c6499e9508724c439ddb0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c5edcf5-88", "ovs_interfaceid": "0c5edcf5-88d0-44aa-977d-51faede9daeb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T18:41:06Z,direct_url=<?>,disk_format='qcow2',id=77bcb5ba-8510-41ec-a88d-96097bb431de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c465b7c26ec44582b6d1b7169536ecc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T18:41:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'guest_format': None, 'boot_index': 0, 'image_id': '77bcb5ba-8510-41ec-a88d-96097bb431de'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 19:08:49 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-444810bd-33b5-4b80-9033-55632be29fc1 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 19:08:49 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-444810bd-33b5-4b80-9033-55632be29fc1 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 19:08:49 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-444810bd-33b5-4b80-9033-55632be29fc1 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 19:08:49 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-444810bd-33b5-4b80-9033-55632be29fc1 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] CPU controller missing on host. {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 19:08:49 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-444810bd-33b5-4b80-9033-55632be29fc1 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 19:08:49 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-444810bd-33b5-4b80-9033-55632be29fc1 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] CPU controller found on host. {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 19:08:49 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-444810bd-33b5-4b80-9033-55632be29fc1 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75216) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 19:08:49 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-444810bd-33b5-4b80-9033-55632be29fc1 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T18:40:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T18:41:06Z,direct_url=<?>,disk_format='qcow2',id=77bcb5ba-8510-41ec-a88d-96097bb431de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c465b7c26ec44582b6d1b7169536ecc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T18:41:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 19:08:49 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-444810bd-33b5-4b80-9033-55632be29fc1 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] Flavor limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 19:08:49 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-444810bd-33b5-4b80-9033-55632be29fc1 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] Image limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 19:08:49 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-444810bd-33b5-4b80-9033-55632be29fc1 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] Flavor pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 19:08:49 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-444810bd-33b5-4b80-9033-55632be29fc1 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] Image pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 19:08:49 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-444810bd-33b5-4b80-9033-55632be29fc1 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 19:08:49 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-444810bd-33b5-4b80-9033-55632be29fc1 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 19:08:49 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-444810bd-33b5-4b80-9033-55632be29fc1 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 19:08:49 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-444810bd-33b5-4b80-9033-55632be29fc1 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] Got 1 possible topologies {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 19:08:49 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-444810bd-33b5-4b80-9033-55632be29fc1 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 19:08:49 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-444810bd-33b5-4b80-9033-55632be29fc1 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 19:08:49 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-444810bd-33b5-4b80-9033-55632be29fc1 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T19:08:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-708403076',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-708403076',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-7084030',id=35,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGDs3P3xWMW1mJDG4Tgx6gZz0hmOrm+Wf/4ur6V0pvSdZgzPoQ2dK3Uy8bf+hqQS8LYnB0m9Fz/QvXq70pNbhiVw1Gavlju+kYX858oLCJmYMXToZdA0UyfSV0l0P5dTsw==',key_name='tempest-keypair-579402465',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2d3ed74465c6499e9508724c439ddb0f',ramdisk_id='',reservation_id='r-qhwpiie8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1272110400',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T19:08:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a34f9f7210f1453aba50463c8a4c3ba7',uuid=33d6832f-1d6a-4f64-9e1b-07078e7e84a5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0c5edcf5-88d0-44aa-977d-51faede9daeb", "address": "fa:16:3e:5b:07:f6", "network": {"id": "dc5c76ee-b62d-4bd4-80f6-04d6fd6776e3", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1854861756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d3ed74465c6499e9508724c439ddb0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c5edcf5-88", "ovs_interfaceid": "0c5edcf5-88d0-44aa-977d-51faede9daeb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75216) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 19:08:49 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-444810bd-33b5-4b80-9033-55632be29fc1 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] Converting VIF {"id": "0c5edcf5-88d0-44aa-977d-51faede9daeb", "address": "fa:16:3e:5b:07:f6", "network": {"id": "dc5c76ee-b62d-4bd4-80f6-04d6fd6776e3", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1854861756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d3ed74465c6499e9508724c439ddb0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c5edcf5-88", "ovs_interfaceid": "0c5edcf5-88d0-44aa-977d-51faede9daeb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 19:08:49 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-444810bd-33b5-4b80-9033-55632be29fc1 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:07:f6,bridge_name='br-int',has_traffic_filtering=True,id=0c5edcf5-88d0-44aa-977d-51faede9daeb,network=Network(dc5c76ee-b62d-4bd4-80f6-04d6fd6776e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c5edcf5-88') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 19:08:49 user nova-compute[75216]: DEBUG nova.objects.instance [None req-444810bd-33b5-4b80-9033-55632be29fc1 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] Lazy-loading 'pci_devices' on Instance uuid 33d6832f-1d6a-4f64-9e1b-07078e7e84a5 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:08:49 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-444810bd-33b5-4b80-9033-55632be29fc1 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] [instance: 33d6832f-1d6a-4f64-9e1b-07078e7e84a5] End _get_guest_xml xml=<domain type="kvm">
Nov 13 19:08:49 user nova-compute[75216]:   <uuid>33d6832f-1d6a-4f64-9e1b-07078e7e84a5</uuid>
Nov 13 19:08:49 user nova-compute[75216]:   <name>instance-00000023</name>
Nov 13 19:08:49 user nova-compute[75216]:   <memory>524288</memory>
Nov 13 19:08:49 user nova-compute[75216]:   <vcpu>1</vcpu>
Nov 13 19:08:49 user nova-compute[75216]:   <metadata>
Nov 13 19:08:49 user nova-compute[75216]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 19:08:49 user nova-compute[75216]:       <nova:package version="0.0.0"/>
Nov 13 19:08:49 user nova-compute[75216]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-708403076</nova:name>
Nov 13 19:08:49 user nova-compute[75216]:       <nova:creationTime>2023-11-13 19:08:49</nova:creationTime>
Nov 13 19:08:49 user nova-compute[75216]:       <nova:flavor name="m1.tiny">
Nov 13 19:08:49 user nova-compute[75216]:         <nova:memory>512</nova:memory>
Nov 13 19:08:49 user nova-compute[75216]:         <nova:disk>1</nova:disk>
Nov 13 19:08:49 user nova-compute[75216]:         <nova:swap>0</nova:swap>
Nov 13 19:08:49 user nova-compute[75216]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 19:08:49 user nova-compute[75216]:         <nova:vcpus>1</nova:vcpus>
Nov 13 19:08:49 user nova-compute[75216]:       </nova:flavor>
Nov 13 19:08:49 user nova-compute[75216]:       <nova:owner>
Nov 13 19:08:49 user nova-compute[75216]:         <nova:user uuid="a34f9f7210f1453aba50463c8a4c3ba7">tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member</nova:user>
Nov 13 19:08:49 user nova-compute[75216]:         <nova:project uuid="2d3ed74465c6499e9508724c439ddb0f">tempest-TestServerVolumeAttachScenarioOldVersion-1272110400</nova:project>
Nov 13 19:08:49 user nova-compute[75216]:       </nova:owner>
Nov 13 19:08:49 user nova-compute[75216]:       <nova:root type="image" uuid="77bcb5ba-8510-41ec-a88d-96097bb431de"/>
Nov 13 19:08:49 user nova-compute[75216]:       <nova:ports>
Nov 13 19:08:49 user nova-compute[75216]:         <nova:port uuid="0c5edcf5-88d0-44aa-977d-51faede9daeb">
Nov 13 19:08:49 user nova-compute[75216]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 13 19:08:49 user nova-compute[75216]:         </nova:port>
Nov 13 19:08:49 user nova-compute[75216]:       </nova:ports>
Nov 13 19:08:49 user nova-compute[75216]:     </nova:instance>
Nov 13 19:08:49 user nova-compute[75216]:   </metadata>
Nov 13 19:08:49 user nova-compute[75216]:   <sysinfo type="smbios">
Nov 13 19:08:49 user nova-compute[75216]:     <system>
Nov 13 19:08:49 user nova-compute[75216]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 19:08:49 user nova-compute[75216]:       <entry name="product">OpenStack Nova</entry>
Nov 13 19:08:49 user nova-compute[75216]:       <entry name="version">0.0.0</entry>
Nov 13 19:08:49 user nova-compute[75216]:       <entry name="serial">33d6832f-1d6a-4f64-9e1b-07078e7e84a5</entry>
Nov 13 19:08:49 user nova-compute[75216]:       <entry name="uuid">33d6832f-1d6a-4f64-9e1b-07078e7e84a5</entry>
Nov 13 19:08:49 user nova-compute[75216]:       <entry name="family">Virtual Machine</entry>
Nov 13 19:08:49 user nova-compute[75216]:     </system>
Nov 13 19:08:49 user nova-compute[75216]:   </sysinfo>
Nov 13 19:08:49 user nova-compute[75216]:   <os>
Nov 13 19:08:49 user nova-compute[75216]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 19:08:49 user nova-compute[75216]:     <boot dev="hd"/>
Nov 13 19:08:49 user nova-compute[75216]:     <smbios mode="sysinfo"/>
Nov 13 19:08:49 user nova-compute[75216]:   </os>
Nov 13 19:08:49 user nova-compute[75216]:   <features>
Nov 13 19:08:49 user nova-compute[75216]:     <acpi/>
Nov 13 19:08:49 user nova-compute[75216]:     <apic/>
Nov 13 19:08:49 user nova-compute[75216]:     <vmcoreinfo/>
Nov 13 19:08:49 user nova-compute[75216]:   </features>
Nov 13 19:08:49 user nova-compute[75216]:   <clock offset="utc">
Nov 13 19:08:49 user nova-compute[75216]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 19:08:49 user nova-compute[75216]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 19:08:49 user nova-compute[75216]:     <timer name="hpet" present="no"/>
Nov 13 19:08:49 user nova-compute[75216]:   </clock>
Nov 13 19:08:49 user nova-compute[75216]:   <cpu mode="custom" match="exact">
Nov 13 19:08:49 user nova-compute[75216]:     <model>Nehalem</model>
Nov 13 19:08:49 user nova-compute[75216]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 19:08:49 user nova-compute[75216]:   </cpu>
Nov 13 19:08:49 user nova-compute[75216]:   <devices>
Nov 13 19:08:49 user nova-compute[75216]:     <disk type="file" device="disk">
Nov 13 19:08:49 user nova-compute[75216]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 19:08:49 user nova-compute[75216]:       <source file="/opt/stack/data/nova/instances/33d6832f-1d6a-4f64-9e1b-07078e7e84a5/disk"/>
Nov 13 19:08:49 user nova-compute[75216]:       <target dev="vda" bus="virtio"/>
Nov 13 19:08:49 user nova-compute[75216]:     </disk>
Nov 13 19:08:49 user nova-compute[75216]:     <interface type="ethernet">
Nov 13 19:08:49 user nova-compute[75216]:       <mac address="fa:16:3e:5b:07:f6"/>
Nov 13 19:08:49 user nova-compute[75216]:       <model type="virtio"/>
Nov 13 19:08:49 user nova-compute[75216]:       <mtu size="1442"/>
Nov 13 19:08:49 user nova-compute[75216]:       <target dev="tap0c5edcf5-88"/>
Nov 13 19:08:49 user nova-compute[75216]:     </interface>
Nov 13 19:08:49 user nova-compute[75216]:     <serial type="pty">
Nov 13 19:08:49 user nova-compute[75216]:       <log file="/opt/stack/data/nova/instances/33d6832f-1d6a-4f64-9e1b-07078e7e84a5/console.log" append="off"/>
Nov 13 19:08:49 user nova-compute[75216]:     </serial>
Nov 13 19:08:49 user nova-compute[75216]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 19:08:49 user nova-compute[75216]:     <video>
Nov 13 19:08:49 user nova-compute[75216]:       <model type="virtio"/>
Nov 13 19:08:49 user nova-compute[75216]:     </video>
Nov 13 19:08:49 user nova-compute[75216]:     <rng model="virtio">
Nov 13 19:08:49 user nova-compute[75216]:       <backend model="random">/dev/urandom</backend>
Nov 13 19:08:49 user nova-compute[75216]:     </rng>
Nov 13 19:08:49 user nova-compute[75216]:     <controller type="usb" index="0" model="none"/>
Nov 13 19:08:49 user nova-compute[75216]:     <memballoon model="virtio">
Nov 13 19:08:49 user nova-compute[75216]:       <stats period="10"/>
Nov 13 19:08:49 user nova-compute[75216]:     </memballoon>
Nov 13 19:08:49 user nova-compute[75216]:   </devices>
Nov 13 19:08:49 user nova-compute[75216]: </domain>
Nov 13 19:08:49 user nova-compute[75216]:  {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 19:08:49 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-444810bd-33b5-4b80-9033-55632be29fc1 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T19:08:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-708403076',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-708403076',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-7084030',id=35,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGDs3P3xWMW1mJDG4Tgx6gZz0hmOrm+Wf/4ur6V0pvSdZgzPoQ2dK3Uy8bf+hqQS8LYnB0m9Fz/QvXq70pNbhiVw1Gavlju+kYX858oLCJmYMXToZdA0UyfSV0l0P5dTsw==',key_name='tempest-keypair-579402465',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2d3ed74465c6499e9508724c439ddb0f',ramdisk_id='',reservation_id='r-qhwpiie8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1272110400',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T19:08:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a34f9f7210f1453aba50463c8a4c3ba7',uuid=33d6832f-1d6a-4f64-9e1b-07078e7e84a5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0c5edcf5-88d0-44aa-977d-51faede9daeb", "address": "fa:16:3e:5b:07:f6", "network": {"id": "dc5c76ee-b62d-4bd4-80f6-04d6fd6776e3", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1854861756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d3ed74465c6499e9508724c439ddb0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c5edcf5-88", "ovs_interfaceid": "0c5edcf5-88d0-44aa-977d-51faede9daeb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 19:08:49 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-444810bd-33b5-4b80-9033-55632be29fc1 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] Converting VIF {"id": "0c5edcf5-88d0-44aa-977d-51faede9daeb", "address": "fa:16:3e:5b:07:f6", "network": {"id": "dc5c76ee-b62d-4bd4-80f6-04d6fd6776e3", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1854861756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d3ed74465c6499e9508724c439ddb0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c5edcf5-88", "ovs_interfaceid": "0c5edcf5-88d0-44aa-977d-51faede9daeb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 19:08:49 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-444810bd-33b5-4b80-9033-55632be29fc1 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:07:f6,bridge_name='br-int',has_traffic_filtering=True,id=0c5edcf5-88d0-44aa-977d-51faede9daeb,network=Network(dc5c76ee-b62d-4bd4-80f6-04d6fd6776e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c5edcf5-88') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 19:08:49 user nova-compute[75216]: DEBUG os_vif [None req-444810bd-33b5-4b80-9033-55632be29fc1 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:07:f6,bridge_name='br-int',has_traffic_filtering=True,id=0c5edcf5-88d0-44aa-977d-51faede9daeb,network=Network(dc5c76ee-b62d-4bd4-80f6-04d6fd6776e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c5edcf5-88') {{(pid=75216) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 19:08:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:08:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:08:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 19:08:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:08:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8e51cb60-5949-5076-8691-640acb416561', '_type': 'linux-noop'}}, row=False) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:08:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:08:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:08:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:08:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:08:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0c5edcf5-88, may_exist=True, interface_attrs={}) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:08:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0c5edcf5-88, col_values=(('qos', UUID('8ad4bd62-3c14-4bcb-b3be-a4fd263a9ad7')),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:08:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0c5edcf5-88, col_values=(('external_ids', {'iface-id': '0c5edcf5-88d0-44aa-977d-51faede9daeb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5b:07:f6', 'vm-uuid': '33d6832f-1d6a-4f64-9e1b-07078e7e84a5'}),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:08:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:08:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:08:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:08:49 user nova-compute[75216]: INFO os_vif [None req-444810bd-33b5-4b80-9033-55632be29fc1 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:07:f6,bridge_name='br-int',has_traffic_filtering=True,id=0c5edcf5-88d0-44aa-977d-51faede9daeb,network=Network(dc5c76ee-b62d-4bd4-80f6-04d6fd6776e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c5edcf5-88')
Nov 13 19:08:49 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-444810bd-33b5-4b80-9033-55632be29fc1 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 19:08:49 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-444810bd-33b5-4b80-9033-55632be29fc1 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] No VIF found with MAC fa:16:3e:5b:07:f6, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 19:08:49 user nova-compute[75216]: DEBUG nova.network.neutron [req-019e6283-0235-47fe-9170-974485a0f081 req-281bc7b1-7e80-494a-bdfb-9f01d9466da7 service nova] [instance: 33d6832f-1d6a-4f64-9e1b-07078e7e84a5] Updated VIF entry in instance network info cache for port 0c5edcf5-88d0-44aa-977d-51faede9daeb. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 19:08:49 user nova-compute[75216]: DEBUG nova.network.neutron [req-019e6283-0235-47fe-9170-974485a0f081 req-281bc7b1-7e80-494a-bdfb-9f01d9466da7 service nova] [instance: 33d6832f-1d6a-4f64-9e1b-07078e7e84a5] Updating instance_info_cache with network_info: [{"id": "0c5edcf5-88d0-44aa-977d-51faede9daeb", "address": "fa:16:3e:5b:07:f6", "network": {"id": "dc5c76ee-b62d-4bd4-80f6-04d6fd6776e3", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1854861756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d3ed74465c6499e9508724c439ddb0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c5edcf5-88", "ovs_interfaceid": "0c5edcf5-88d0-44aa-977d-51faede9daeb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:08:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-019e6283-0235-47fe-9170-974485a0f081 req-281bc7b1-7e80-494a-bdfb-9f01d9466da7 service nova] Releasing lock "refresh_cache-33d6832f-1d6a-4f64-9e1b-07078e7e84a5" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 19:08:50 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:08:50 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:08:50 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:08:50 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:08:51 user nova-compute[75216]: DEBUG nova.compute.manager [req-f3b5b981-0c27-45d0-b668-8662038b814b req-418127c1-7e50-4389-9c0f-4604516567a8 service nova] [instance: 33d6832f-1d6a-4f64-9e1b-07078e7e84a5] Received event network-vif-plugged-0c5edcf5-88d0-44aa-977d-51faede9daeb {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:08:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-f3b5b981-0c27-45d0-b668-8662038b814b req-418127c1-7e50-4389-9c0f-4604516567a8 service nova] Acquiring lock "33d6832f-1d6a-4f64-9e1b-07078e7e84a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:08:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-f3b5b981-0c27-45d0-b668-8662038b814b req-418127c1-7e50-4389-9c0f-4604516567a8 service nova] Lock "33d6832f-1d6a-4f64-9e1b-07078e7e84a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:08:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-f3b5b981-0c27-45d0-b668-8662038b814b req-418127c1-7e50-4389-9c0f-4604516567a8 service nova] Lock "33d6832f-1d6a-4f64-9e1b-07078e7e84a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:08:51 user nova-compute[75216]: DEBUG nova.compute.manager [req-f3b5b981-0c27-45d0-b668-8662038b814b req-418127c1-7e50-4389-9c0f-4604516567a8 service nova] [instance: 33d6832f-1d6a-4f64-9e1b-07078e7e84a5] No waiting events found dispatching network-vif-plugged-0c5edcf5-88d0-44aa-977d-51faede9daeb {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 19:08:51 user nova-compute[75216]: WARNING nova.compute.manager [req-f3b5b981-0c27-45d0-b668-8662038b814b req-418127c1-7e50-4389-9c0f-4604516567a8 service nova] [instance: 33d6832f-1d6a-4f64-9e1b-07078e7e84a5] Received unexpected event network-vif-plugged-0c5edcf5-88d0-44aa-977d-51faede9daeb for instance with vm_state building and task_state spawning.
Nov 13 19:08:51 user nova-compute[75216]: DEBUG nova.compute.manager [req-f3b5b981-0c27-45d0-b668-8662038b814b req-418127c1-7e50-4389-9c0f-4604516567a8 service nova] [instance: 33d6832f-1d6a-4f64-9e1b-07078e7e84a5] Received event network-vif-plugged-0c5edcf5-88d0-44aa-977d-51faede9daeb {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:08:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-f3b5b981-0c27-45d0-b668-8662038b814b req-418127c1-7e50-4389-9c0f-4604516567a8 service nova] Acquiring lock "33d6832f-1d6a-4f64-9e1b-07078e7e84a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:08:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-f3b5b981-0c27-45d0-b668-8662038b814b req-418127c1-7e50-4389-9c0f-4604516567a8 service nova] Lock "33d6832f-1d6a-4f64-9e1b-07078e7e84a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:08:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-f3b5b981-0c27-45d0-b668-8662038b814b req-418127c1-7e50-4389-9c0f-4604516567a8 service nova] Lock "33d6832f-1d6a-4f64-9e1b-07078e7e84a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:08:51 user nova-compute[75216]: DEBUG nova.compute.manager [req-f3b5b981-0c27-45d0-b668-8662038b814b req-418127c1-7e50-4389-9c0f-4604516567a8 service nova] [instance: 33d6832f-1d6a-4f64-9e1b-07078e7e84a5] No waiting events found dispatching network-vif-plugged-0c5edcf5-88d0-44aa-977d-51faede9daeb {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 19:08:51 user nova-compute[75216]: WARNING nova.compute.manager [req-f3b5b981-0c27-45d0-b668-8662038b814b req-418127c1-7e50-4389-9c0f-4604516567a8 service nova] [instance: 33d6832f-1d6a-4f64-9e1b-07078e7e84a5] Received unexpected event network-vif-plugged-0c5edcf5-88d0-44aa-977d-51faede9daeb for instance with vm_state building and task_state spawning.
Nov 13 19:08:51 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:08:51 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:08:51 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:08:51 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:08:51 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:08:53 user nova-compute[75216]: DEBUG nova.compute.manager [None req-444810bd-33b5-4b80-9033-55632be29fc1 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] [instance: 33d6832f-1d6a-4f64-9e1b-07078e7e84a5] Instance event wait completed in 0 seconds for  {{(pid=75216) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 19:08:53 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-444810bd-33b5-4b80-9033-55632be29fc1 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] [instance: 33d6832f-1d6a-4f64-9e1b-07078e7e84a5] Guest created on hypervisor {{(pid=75216) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 19:08:53 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 33d6832f-1d6a-4f64-9e1b-07078e7e84a5] Instance spawned successfully.
Nov 13 19:08:53 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-444810bd-33b5-4b80-9033-55632be29fc1 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] [instance: 33d6832f-1d6a-4f64-9e1b-07078e7e84a5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 19:08:53 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-444810bd-33b5-4b80-9033-55632be29fc1 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] [instance: 33d6832f-1d6a-4f64-9e1b-07078e7e84a5] Found default for hw_cdrom_bus of ide {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 19:08:53 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-444810bd-33b5-4b80-9033-55632be29fc1 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] [instance: 33d6832f-1d6a-4f64-9e1b-07078e7e84a5] Found default for hw_disk_bus of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 19:08:53 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-444810bd-33b5-4b80-9033-55632be29fc1 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] [instance: 33d6832f-1d6a-4f64-9e1b-07078e7e84a5] Found default for hw_input_bus of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 19:08:53 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-444810bd-33b5-4b80-9033-55632be29fc1 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] [instance: 33d6832f-1d6a-4f64-9e1b-07078e7e84a5] Found default for hw_pointer_model of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 19:08:53 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-444810bd-33b5-4b80-9033-55632be29fc1 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] [instance: 33d6832f-1d6a-4f64-9e1b-07078e7e84a5] Found default for hw_video_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 19:08:53 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-444810bd-33b5-4b80-9033-55632be29fc1 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] [instance: 33d6832f-1d6a-4f64-9e1b-07078e7e84a5] Found default for hw_vif_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 19:08:53 user nova-compute[75216]: INFO nova.compute.manager [None req-444810bd-33b5-4b80-9033-55632be29fc1 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] [instance: 33d6832f-1d6a-4f64-9e1b-07078e7e84a5] Took 5.59 seconds to spawn the instance on the hypervisor.
Nov 13 19:08:53 user nova-compute[75216]: DEBUG nova.compute.manager [None req-444810bd-33b5-4b80-9033-55632be29fc1 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] [instance: 33d6832f-1d6a-4f64-9e1b-07078e7e84a5] Checking state {{(pid=75216) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 19:08:53 user nova-compute[75216]: INFO nova.compute.manager [None req-444810bd-33b5-4b80-9033-55632be29fc1 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] [instance: 33d6832f-1d6a-4f64-9e1b-07078e7e84a5] Took 6.43 seconds to build instance.
Nov 13 19:08:53 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-444810bd-33b5-4b80-9033-55632be29fc1 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] Lock "33d6832f-1d6a-4f64-9e1b-07078e7e84a5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.659s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:08:54 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:08:54 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:08:57 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:08:57 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:08:59 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:08:59 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:09:01 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:09:01 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:09:02 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:09:02 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75216) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 19:09:04 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:09:04 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:09:04 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:09:04 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75216) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 19:09:04 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 19:09:04 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 19:09:04 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:09:05 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:09:05 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:09:05 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:09:05 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:09:05 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Auditing locally available compute resources for user (node: user) {{(pid=75216) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 19:09:05 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 19:09:05 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 19:09:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b752173-e573-426e-b9f1-bff92a4c2b55/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:09:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b752173-e573-426e-b9f1-bff92a4c2b55/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:09:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b752173-e573-426e-b9f1-bff92a4c2b55/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:09:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b752173-e573-426e-b9f1-bff92a4c2b55/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:09:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:09:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:09:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:09:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:09:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c18c0ad-60e5-4ef2-97f2-b7008e89ac78/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:09:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c18c0ad-60e5-4ef2-97f2-b7008e89ac78/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:09:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c18c0ad-60e5-4ef2-97f2-b7008e89ac78/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:09:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c18c0ad-60e5-4ef2-97f2-b7008e89ac78/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:09:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33d6832f-1d6a-4f64-9e1b-07078e7e84a5/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:09:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33d6832f-1d6a-4f64-9e1b-07078e7e84a5/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:09:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33d6832f-1d6a-4f64-9e1b-07078e7e84a5/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:09:07 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33d6832f-1d6a-4f64-9e1b-07078e7e84a5/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:09:07 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 19:09:07 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 19:09:07 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Hypervisor/Node resource view: name=user free_ram=8582MB free_disk=25.150516510009766GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75216) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 19:09:07 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:09:07 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:09:07 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 19:09:07 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance 1e5f1164-a15e-40cf-b7bc-5aeb404a1216 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 19:09:07 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance 5c18c0ad-60e5-4ef2-97f2-b7008e89ac78 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 19:09:07 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance 7b752173-e573-426e-b9f1-bff92a4c2b55 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 19:09:07 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance 8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 19:09:07 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance 33d6832f-1d6a-4f64-9e1b-07078e7e84a5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 19:09:07 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 19:09:07 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 19:09:07 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 19:09:07 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 19:09:07 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Compute_service record updated for user:user {{(pid=75216) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 19:09:07 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.326s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:09:08 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:09:08 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:09:08 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Starting heal instance info cache {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 19:09:08 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Rebuilding the list of instances to heal {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 13 19:09:08 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "refresh_cache-f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 19:09:08 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquired lock "refresh_cache-f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 19:09:08 user nova-compute[75216]: DEBUG nova.network.neutron [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1] Forcefully refreshing network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 19:09:08 user nova-compute[75216]: DEBUG nova.objects.instance [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lazy-loading 'info_cache' on Instance uuid f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:09:09 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:09:09 user nova-compute[75216]: DEBUG nova.network.neutron [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1] Updating instance_info_cache with network_info: [{"id": "5419f8b4-31da-434a-b131-6476134a71bf", "address": "fa:16:3e:9a:08:ac", "network": {"id": "f8b821ef-8fae-42b9-9055-a9ea7be955ab", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-50594548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "903397a6c0474cfd8bd1a4fb338528aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5419f8b4-31", "ovs_interfaceid": "5419f8b4-31da-434a-b131-6476134a71bf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:09:09 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Releasing lock "refresh_cache-f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 19:09:09 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1] Updated the network info_cache for instance {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 19:09:09 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:09:09 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:09:14 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:09:14 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:09:19 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:09:19 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:09:24 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:09:24 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:09:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:09:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:09:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75216) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 19:09:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 19:09:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 19:09:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:09:31 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f06ec728-5089-40cd-9d60-8a0accc0ab83 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Acquiring lock "8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:09:31 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f06ec728-5089-40cd-9d60-8a0accc0ab83 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Lock "8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:09:31 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f06ec728-5089-40cd-9d60-8a0accc0ab83 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Acquiring lock "8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:09:31 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f06ec728-5089-40cd-9d60-8a0accc0ab83 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Lock "8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:09:31 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f06ec728-5089-40cd-9d60-8a0accc0ab83 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Lock "8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:09:31 user nova-compute[75216]: INFO nova.compute.manager [None req-f06ec728-5089-40cd-9d60-8a0accc0ab83 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: 8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa] Terminating instance
Nov 13 19:09:31 user nova-compute[75216]: DEBUG nova.compute.manager [None req-f06ec728-5089-40cd-9d60-8a0accc0ab83 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: 8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa] Start destroying the instance on the hypervisor. {{(pid=75216) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 19:09:31 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:09:31 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:09:31 user nova-compute[75216]: DEBUG nova.compute.manager [req-3c366b8e-37dd-4638-a7d1-59cced2d9125 req-e03316f6-e603-4bf3-9753-3d7785a71b7a service nova] [instance: 8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa] Received event network-vif-unplugged-0f86c64c-3da6-44d9-8c74-e276f2496f35 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:09:31 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-3c366b8e-37dd-4638-a7d1-59cced2d9125 req-e03316f6-e603-4bf3-9753-3d7785a71b7a service nova] Acquiring lock "8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:09:31 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-3c366b8e-37dd-4638-a7d1-59cced2d9125 req-e03316f6-e603-4bf3-9753-3d7785a71b7a service nova] Lock "8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:09:31 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-3c366b8e-37dd-4638-a7d1-59cced2d9125 req-e03316f6-e603-4bf3-9753-3d7785a71b7a service nova] Lock "8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:09:31 user nova-compute[75216]: DEBUG nova.compute.manager [req-3c366b8e-37dd-4638-a7d1-59cced2d9125 req-e03316f6-e603-4bf3-9753-3d7785a71b7a service nova] [instance: 8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa] No waiting events found dispatching network-vif-unplugged-0f86c64c-3da6-44d9-8c74-e276f2496f35 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 19:09:31 user nova-compute[75216]: DEBUG nova.compute.manager [req-3c366b8e-37dd-4638-a7d1-59cced2d9125 req-e03316f6-e603-4bf3-9753-3d7785a71b7a service nova] [instance: 8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa] Received event network-vif-unplugged-0f86c64c-3da6-44d9-8c74-e276f2496f35 for instance with task_state deleting. {{(pid=75216) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 19:09:31 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:09:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:09:32 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa] Instance destroyed successfully.
Nov 13 19:09:32 user nova-compute[75216]: DEBUG nova.objects.instance [None req-f06ec728-5089-40cd-9d60-8a0accc0ab83 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Lazy-loading 'resources' on Instance uuid 8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:09:32 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-f06ec728-5089-40cd-9d60-8a0accc0ab83 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T19:03:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1397198855',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1397198855',id=31,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-13T19:05:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='903397a6c0474cfd8bd1a4fb338528aa',ramdisk_id='',reservation_id='r-ytgh7qju',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-197527955',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T19:07:45Z,user_data=None,user_id='b381ea98871846b1bfb29a202a058208',uuid=8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0f86c64c-3da6-44d9-8c74-e276f2496f35", "address": "fa:16:3e:21:5b:c2", "network": {"id": "f8b821ef-8fae-42b9-9055-a9ea7be955ab", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-50594548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "903397a6c0474cfd8bd1a4fb338528aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f86c64c-3d", "ovs_interfaceid": "0f86c64c-3da6-44d9-8c74-e276f2496f35", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 19:09:32 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-f06ec728-5089-40cd-9d60-8a0accc0ab83 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Converting VIF {"id": "0f86c64c-3da6-44d9-8c74-e276f2496f35", "address": "fa:16:3e:21:5b:c2", "network": {"id": "f8b821ef-8fae-42b9-9055-a9ea7be955ab", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-50594548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "903397a6c0474cfd8bd1a4fb338528aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f86c64c-3d", "ovs_interfaceid": "0f86c64c-3da6-44d9-8c74-e276f2496f35", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 19:09:32 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-f06ec728-5089-40cd-9d60-8a0accc0ab83 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:21:5b:c2,bridge_name='br-int',has_traffic_filtering=True,id=0f86c64c-3da6-44d9-8c74-e276f2496f35,network=Network(f8b821ef-8fae-42b9-9055-a9ea7be955ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f86c64c-3d') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 19:09:32 user nova-compute[75216]: DEBUG os_vif [None req-f06ec728-5089-40cd-9d60-8a0accc0ab83 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:21:5b:c2,bridge_name='br-int',has_traffic_filtering=True,id=0f86c64c-3da6-44d9-8c74-e276f2496f35,network=Network(f8b821ef-8fae-42b9-9055-a9ea7be955ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f86c64c-3d') {{(pid=75216) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 19:09:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:09:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0f86c64c-3d, bridge=br-int, if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:09:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:09:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:09:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:09:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:09:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3725c799-2d54-4112-9eff-20782aba8622) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:09:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:09:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:09:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:09:32 user nova-compute[75216]: INFO os_vif [None req-f06ec728-5089-40cd-9d60-8a0accc0ab83 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:21:5b:c2,bridge_name='br-int',has_traffic_filtering=True,id=0f86c64c-3da6-44d9-8c74-e276f2496f35,network=Network(f8b821ef-8fae-42b9-9055-a9ea7be955ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f86c64c-3d')
Nov 13 19:09:32 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f06ec728-5089-40cd-9d60-8a0accc0ab83 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: 8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa] calling os-brick to detach iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 19:09:32 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f06ec728-5089-40cd-9d60-8a0accc0ab83 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3a8669e40>, {'target_iqn': 'iqn.2010-10.org.openstack:3bda4ab6-9834-40ad-b9fc-88186d2ffceb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hZOIpwel', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 19:09:32 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-f06ec728-5089-40cd-9d60-8a0accc0ab83 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 19:09:32 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-f06ec728-5089-40cd-9d60-8a0accc0ab83 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 19:09:32 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-f06ec728-5089-40cd-9d60-8a0accc0ab83 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 19:09:32 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:09:32 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:09:32 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[d097a1cb-ae2b-4061-ba05-5233cec28842]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3bda4ab6-9834-40ad-b9fc-88186d2ffceb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:09:32 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f06ec728-5089-40cd-9d60-8a0accc0ab83 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 19:09:32 user nova-compute[75216]: No targets found.
Nov 13 19:09:32 user nova-compute[75216]: iSNS:
Nov 13 19:09:32 user nova-compute[75216]: No targets found.
Nov 13 19:09:32 user nova-compute[75216]: STATIC:
Nov 13 19:09:32 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:3bda4ab6-9834-40ad-b9fc-88186d2ffceb
Nov 13 19:09:32 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 19:09:32 user nova-compute[75216]:                 Iface Name: default
Nov 13 19:09:32 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1
Nov 13 19:09:32 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 19:09:32 user nova-compute[75216]:                 Iface Name: default
Nov 13 19:09:32 user nova-compute[75216]: FIRMWARE:
Nov 13 19:09:32 user nova-compute[75216]: No targets found.
Nov 13 19:09:32 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 19:09:32 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f06ec728-5089-40cd-9d60-8a0accc0ab83 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 19:09:32 user nova-compute[75216]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 19:09:32 user nova-compute[75216]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75216) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 19:09:32 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f06ec728-5089-40cd-9d60-8a0accc0ab83 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3bda4ab6-9834-40ad-b9fc-88186d2ffceb', 0)] {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 19:09:32 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:09:32 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:09:32 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0cc6e2d-e780-45ff-9437-c76fce45b8da]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3bda4ab6-9834-40ad-b9fc-88186d2ffceb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:09:32 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:09:32 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:09:32 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a1acc53-8bbb-4277-a979-168121c93ddb]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bda4ab6-9834-40ad-b9fc-88186d2ffceb (non-flash)\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:09:32 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f06ec728-5089-40cd-9d60-8a0accc0ab83 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1 (non-flash)
Nov 13 19:09:32 user nova-compute[75216]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bda4ab6-9834-40ad-b9fc-88186d2ffceb (non-flash)
Nov 13 19:09:32 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 19:09:32 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f06ec728-5089-40cd-9d60-8a0accc0ab83 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1 (non-flash)
Nov 13 19:09:32 user nova-compute[75216]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bda4ab6-9834-40ad-b9fc-88186d2ffceb (non-flash)
Nov 13 19:09:32 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 19:09:32 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f06ec728-5089-40cd-9d60-8a0accc0ab83 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe3a834c1f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3bda4ab6-9834-40ad-b9fc-88186d2ffceb'): ({'sdc'}, set())}) {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 19:09:32 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-f06ec728-5089-40cd-9d60-8a0accc0ab83 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Removing single pathed devices sdc {{(pid=75216) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 19:09:32 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:09:32 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:09:32 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab3eecc0-53ba-4108-9767-a14816a19618]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:09:32 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:09:32 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:09:32 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4169aea-31a7-4b55-af99-72f51e1d1810]: (4, ('ok\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:09:32 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-f06ec728-5089-40cd-9d60-8a0accc0ab83 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Flushing IO for device /dev/sdc {{(pid=75216) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 19:09:32 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:09:32 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:09:32 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b57f68a-ac43-4750-aad2-48ce836681a3]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:09:32 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-f06ec728-5089-40cd-9d60-8a0accc0ab83 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75216) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 19:09:32 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:09:32 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.045s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:09:32 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b9b3ce7-75ee-45ba-82c1-e2486233284e]: (4, ('1', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:09:32 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-f06ec728-5089-40cd-9d60-8a0accc0ab83 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 19:09:32 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-f06ec728-5089-40cd-9d60-8a0accc0ab83 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] SCSI volumes sdc have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 19:09:32 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f06ec728-5089-40cd-9d60-8a0accc0ab83 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3bda4ab6-9834-40ad-b9fc-88186d2ffceb')] {{(pid=75216) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 19:09:32 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bda4ab6-9834-40ad-b9fc-88186d2ffceb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:09:32 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bda4ab6-9834-40ad-b9fc-88186d2ffceb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:09:32 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[53242ea9-5389-4fef-abde-76c3070b4050]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:09:32 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f06ec728-5089-40cd-9d60-8a0accc0ab83 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:09:32 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bda4ab6-9834-40ad-b9fc-88186d2ffceb -p 172.16.0.220:3260 --logout {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:09:32 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bda4ab6-9834-40ad-b9fc-88186d2ffceb -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:09:32 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[407fcafd-e8bb-4c98-8ddb-47112fd38d53]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:3bda4ab6-9834-40ad-b9fc-88186d2ffceb, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:3bda4ab6-9834-40ad-b9fc-88186d2ffceb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:09:32 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f06ec728-5089-40cd-9d60-8a0accc0ab83 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:3bda4ab6-9834-40ad-b9fc-88186d2ffceb, portal: 172.16.0.220,3260]
Nov 13 19:09:32 user nova-compute[75216]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:3bda4ab6-9834-40ad-b9fc-88186d2ffceb, portal: 172.16.0.220,3260] successful.
Nov 13 19:09:32 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:09:32 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bda4ab6-9834-40ad-b9fc-88186d2ffceb -p 172.16.0.220:3260 --op delete {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:09:32 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bda4ab6-9834-40ad-b9fc-88186d2ffceb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:09:32 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa456c5b-c191-4c5d-84aa-5d3322e58d18]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:09:32 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f06ec728-5089-40cd-9d60-8a0accc0ab83 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:09:32 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-f06ec728-5089-40cd-9d60-8a0accc0ab83 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.302s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 19:09:32 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f06ec728-5089-40cd-9d60-8a0accc0ab83 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] <== disconnect_volume: return (303ms) None {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 19:09:32 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f06ec728-5089-40cd-9d60-8a0accc0ab83 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: 8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa] Disconnected iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 19:09:32 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-f06ec728-5089-40cd-9d60-8a0accc0ab83 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: 8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa] Deleting instance files /opt/stack/data/nova/instances/8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa_del
Nov 13 19:09:32 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-f06ec728-5089-40cd-9d60-8a0accc0ab83 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: 8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa] Deletion of /opt/stack/data/nova/instances/8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa_del complete
Nov 13 19:09:32 user nova-compute[75216]: INFO nova.compute.manager [None req-f06ec728-5089-40cd-9d60-8a0accc0ab83 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: 8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa] Took 1.19 seconds to destroy the instance on the hypervisor.
Nov 13 19:09:32 user nova-compute[75216]: DEBUG oslo.service.loopingcall [None req-f06ec728-5089-40cd-9d60-8a0accc0ab83 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75216) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 19:09:32 user nova-compute[75216]: DEBUG nova.compute.manager [-] [instance: 8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa] Deallocating network for instance {{(pid=75216) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 19:09:32 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: 8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa] deallocate_for_instance() {{(pid=75216) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 19:09:33 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: 8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa] Updating instance_info_cache with network_info: [] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:09:33 user nova-compute[75216]: INFO nova.compute.manager [-] [instance: 8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa] Took 0.46 seconds to deallocate network for instance.
Nov 13 19:09:33 user nova-compute[75216]: DEBUG nova.compute.manager [req-d9370011-8289-483f-88fc-dd7baa5d561e req-5186f39b-cd09-47d3-8060-e5798d19f99a service nova] [instance: 8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa] Received event network-vif-plugged-0f86c64c-3da6-44d9-8c74-e276f2496f35 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:09:33 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-d9370011-8289-483f-88fc-dd7baa5d561e req-5186f39b-cd09-47d3-8060-e5798d19f99a service nova] Acquiring lock "8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:09:33 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-d9370011-8289-483f-88fc-dd7baa5d561e req-5186f39b-cd09-47d3-8060-e5798d19f99a service nova] Lock "8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:09:33 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-d9370011-8289-483f-88fc-dd7baa5d561e req-5186f39b-cd09-47d3-8060-e5798d19f99a service nova] Lock "8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:09:33 user nova-compute[75216]: DEBUG nova.compute.manager [req-d9370011-8289-483f-88fc-dd7baa5d561e req-5186f39b-cd09-47d3-8060-e5798d19f99a service nova] [instance: 8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa] No waiting events found dispatching network-vif-plugged-0f86c64c-3da6-44d9-8c74-e276f2496f35 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 19:09:33 user nova-compute[75216]: WARNING nova.compute.manager [req-d9370011-8289-483f-88fc-dd7baa5d561e req-5186f39b-cd09-47d3-8060-e5798d19f99a service nova] [instance: 8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa] Received unexpected event network-vif-plugged-0f86c64c-3da6-44d9-8c74-e276f2496f35 for instance with vm_state active and task_state deleting.
Nov 13 19:09:33 user nova-compute[75216]: DEBUG nova.compute.manager [req-d9370011-8289-483f-88fc-dd7baa5d561e req-5186f39b-cd09-47d3-8060-e5798d19f99a service nova] [instance: 8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa] Received event network-vif-deleted-0f86c64c-3da6-44d9-8c74-e276f2496f35 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:09:34 user nova-compute[75216]: INFO nova.compute.manager [None req-f06ec728-5089-40cd-9d60-8a0accc0ab83 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: 8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa] Took 0.75 seconds to detach 1 volumes for instance.
Nov 13 19:09:34 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f06ec728-5089-40cd-9d60-8a0accc0ab83 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:09:34 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f06ec728-5089-40cd-9d60-8a0accc0ab83 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:09:34 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-f06ec728-5089-40cd-9d60-8a0accc0ab83 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 19:09:34 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-f06ec728-5089-40cd-9d60-8a0accc0ab83 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 19:09:34 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f06ec728-5089-40cd-9d60-8a0accc0ab83 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.239s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:09:34 user nova-compute[75216]: INFO nova.scheduler.client.report [None req-f06ec728-5089-40cd-9d60-8a0accc0ab83 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Deleted allocations for instance 8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa
Nov 13 19:09:34 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f06ec728-5089-40cd-9d60-8a0accc0ab83 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Lock "8fed2b5c-3556-44ab-a5dd-fd3d7aac79aa" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.826s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:09:36 user nova-compute[75216]: DEBUG nova.objects.instance [None req-b7abb094-3ea0-4c9c-acf1-c3428aecebb3 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Lazy-loading 'flavor' on Instance uuid 7b752173-e573-426e-b9f1-bff92a4c2b55 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:09:36 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-b7abb094-3ea0-4c9c-acf1-c3428aecebb3 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Acquiring lock "refresh_cache-7b752173-e573-426e-b9f1-bff92a4c2b55" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 19:09:36 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-b7abb094-3ea0-4c9c-acf1-c3428aecebb3 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Acquired lock "refresh_cache-7b752173-e573-426e-b9f1-bff92a4c2b55" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 19:09:36 user nova-compute[75216]: DEBUG nova.network.neutron [None req-b7abb094-3ea0-4c9c-acf1-c3428aecebb3 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] [instance: 7b752173-e573-426e-b9f1-bff92a4c2b55] Building network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 19:09:36 user nova-compute[75216]: DEBUG nova.objects.instance [None req-b7abb094-3ea0-4c9c-acf1-c3428aecebb3 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Lazy-loading 'info_cache' on Instance uuid 7b752173-e573-426e-b9f1-bff92a4c2b55 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:09:36 user nova-compute[75216]: DEBUG nova.objects.base [None req-b7abb094-3ea0-4c9c-acf1-c3428aecebb3 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Object Instance<7b752173-e573-426e-b9f1-bff92a4c2b55> lazy-loaded attributes: flavor,info_cache {{(pid=75216) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 19:09:37 user nova-compute[75216]: DEBUG nova.network.neutron [None req-b7abb094-3ea0-4c9c-acf1-c3428aecebb3 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] [instance: 7b752173-e573-426e-b9f1-bff92a4c2b55] Updating instance_info_cache with network_info: [{"id": "60dd7b11-cfc3-4965-a429-8b2ac4cdfcf4", "address": "fa:16:3e:d6:af:c5", "network": {"id": "53bb01d5-31a4-47af-a931-ac12fe72b986", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-802892643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "095f5765865140d29b3ecf1ab3427037", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60dd7b11-cf", "ovs_interfaceid": "60dd7b11-cfc3-4965-a429-8b2ac4cdfcf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:09:37 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-b7abb094-3ea0-4c9c-acf1-c3428aecebb3 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Releasing lock "refresh_cache-7b752173-e573-426e-b9f1-bff92a4c2b55" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 19:09:37 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 7b752173-e573-426e-b9f1-bff92a4c2b55] Instance destroyed successfully.
Nov 13 19:09:37 user nova-compute[75216]: DEBUG nova.objects.instance [None req-b7abb094-3ea0-4c9c-acf1-c3428aecebb3 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Lazy-loading 'resources' on Instance uuid 7b752173-e573-426e-b9f1-bff92a4c2b55 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:09:37 user nova-compute[75216]: DEBUG nova.objects.base [None req-b7abb094-3ea0-4c9c-acf1-c3428aecebb3 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Object Instance<7b752173-e573-426e-b9f1-bff92a4c2b55> lazy-loaded attributes: flavor,info_cache,resources {{(pid=75216) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 19:09:37 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-b7abb094-3ea0-4c9c-acf1-c3428aecebb3 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T19:01:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1575865869',display_name='tempest-AttachVolumeTestJSON-server-1575865869',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1575865869',id=29,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGyAqjyHTP2pee8vnuPoZ/xrp7+kl5CQoOuvKblvMKUYsUK2V6arU3VG3TaEuVHw4+At5BuB9j/a8y246OC2wl7lhVwqAlIhS8np4Du9lzYGwetS0FdeZdBwrMXi36WP0A==',key_name='tempest-keypair-355509380',keypairs=<?>,launch_index=0,launched_at=2023-11-13T19:01:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='095f5765865140d29b3ecf1ab3427037',ramdisk_id='',reservation_id='r-0zzag7s9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-156429078',owner_user_name='tempest-AttachVolumeTestJSON-156429078-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T19:07:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a7501ee4141241f2abc4d6bfce2924d4',uuid=7b752173-e573-426e-b9f1-bff92a4c2b55,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "60dd7b11-cfc3-4965-a429-8b2ac4cdfcf4", "address": "fa:16:3e:d6:af:c5", "network": {"id": "53bb01d5-31a4-47af-a931-ac12fe72b986", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-802892643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "095f5765865140d29b3ecf1ab3427037", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60dd7b11-cf", "ovs_interfaceid": "60dd7b11-cfc3-4965-a429-8b2ac4cdfcf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 19:09:37 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-b7abb094-3ea0-4c9c-acf1-c3428aecebb3 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Converting VIF {"id": "60dd7b11-cfc3-4965-a429-8b2ac4cdfcf4", "address": "fa:16:3e:d6:af:c5", "network": {"id": "53bb01d5-31a4-47af-a931-ac12fe72b986", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-802892643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "095f5765865140d29b3ecf1ab3427037", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60dd7b11-cf", "ovs_interfaceid": "60dd7b11-cfc3-4965-a429-8b2ac4cdfcf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 19:09:37 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-b7abb094-3ea0-4c9c-acf1-c3428aecebb3 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:af:c5,bridge_name='br-int',has_traffic_filtering=True,id=60dd7b11-cfc3-4965-a429-8b2ac4cdfcf4,network=Network(53bb01d5-31a4-47af-a931-ac12fe72b986),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60dd7b11-cf') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 19:09:37 user nova-compute[75216]: DEBUG os_vif [None req-b7abb094-3ea0-4c9c-acf1-c3428aecebb3 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:af:c5,bridge_name='br-int',has_traffic_filtering=True,id=60dd7b11-cfc3-4965-a429-8b2ac4cdfcf4,network=Network(53bb01d5-31a4-47af-a931-ac12fe72b986),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60dd7b11-cf') {{(pid=75216) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 19:09:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:09:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap60dd7b11-cf, bridge=br-int, if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:09:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:09:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:09:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:09:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=835859ca-ed9d-44d7-a042-0543f1b3b67d) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:09:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:09:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:09:37 user nova-compute[75216]: INFO os_vif [None req-b7abb094-3ea0-4c9c-acf1-c3428aecebb3 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:af:c5,bridge_name='br-int',has_traffic_filtering=True,id=60dd7b11-cfc3-4965-a429-8b2ac4cdfcf4,network=Network(53bb01d5-31a4-47af-a931-ac12fe72b986),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60dd7b11-cf')
Nov 13 19:09:37 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-b7abb094-3ea0-4c9c-acf1-c3428aecebb3 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] [instance: 7b752173-e573-426e-b9f1-bff92a4c2b55] Start _get_guest_xml network_info=[{"id": "60dd7b11-cfc3-4965-a429-8b2ac4cdfcf4", "address": "fa:16:3e:d6:af:c5", "network": {"id": "53bb01d5-31a4-47af-a931-ac12fe72b986", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-802892643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "095f5765865140d29b3ecf1ab3427037", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60dd7b11-cf", "ovs_interfaceid": "60dd7b11-cfc3-4965-a429-8b2ac4cdfcf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=77bcb5ba-8510-41ec-a88d-96097bb431de,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'guest_format': None, 'boot_index': 0, 'image_id': '77bcb5ba-8510-41ec-a88d-96097bb431de'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 19:09:37 user nova-compute[75216]: DEBUG nova.objects.instance [None req-b7abb094-3ea0-4c9c-acf1-c3428aecebb3 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Lazy-loading 'numa_topology' on Instance uuid 7b752173-e573-426e-b9f1-bff92a4c2b55 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:09:37 user nova-compute[75216]: DEBUG nova.objects.base [None req-b7abb094-3ea0-4c9c-acf1-c3428aecebb3 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Object Instance<7b752173-e573-426e-b9f1-bff92a4c2b55> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=75216) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 19:09:37 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-b7abb094-3ea0-4c9c-acf1-c3428aecebb3 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 19:09:37 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-b7abb094-3ea0-4c9c-acf1-c3428aecebb3 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 19:09:37 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-b7abb094-3ea0-4c9c-acf1-c3428aecebb3 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 19:09:37 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-b7abb094-3ea0-4c9c-acf1-c3428aecebb3 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] CPU controller missing on host. {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 19:09:37 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-b7abb094-3ea0-4c9c-acf1-c3428aecebb3 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 19:09:37 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-b7abb094-3ea0-4c9c-acf1-c3428aecebb3 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] CPU controller found on host. {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 19:09:37 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-b7abb094-3ea0-4c9c-acf1-c3428aecebb3 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75216) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 19:09:37 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-b7abb094-3ea0-4c9c-acf1-c3428aecebb3 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T18:40:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=77bcb5ba-8510-41ec-a88d-96097bb431de,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 19:09:37 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-b7abb094-3ea0-4c9c-acf1-c3428aecebb3 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Flavor limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 19:09:37 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-b7abb094-3ea0-4c9c-acf1-c3428aecebb3 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Image limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 19:09:37 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-b7abb094-3ea0-4c9c-acf1-c3428aecebb3 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Flavor pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 19:09:37 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-b7abb094-3ea0-4c9c-acf1-c3428aecebb3 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Image pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 19:09:37 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-b7abb094-3ea0-4c9c-acf1-c3428aecebb3 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 19:09:37 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-b7abb094-3ea0-4c9c-acf1-c3428aecebb3 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 19:09:37 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-b7abb094-3ea0-4c9c-acf1-c3428aecebb3 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 19:09:37 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-b7abb094-3ea0-4c9c-acf1-c3428aecebb3 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Got 1 possible topologies {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 19:09:37 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-b7abb094-3ea0-4c9c-acf1-c3428aecebb3 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 19:09:37 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-b7abb094-3ea0-4c9c-acf1-c3428aecebb3 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 19:09:37 user nova-compute[75216]: DEBUG nova.objects.instance [None req-b7abb094-3ea0-4c9c-acf1-c3428aecebb3 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Lazy-loading 'vcpu_model' on Instance uuid 7b752173-e573-426e-b9f1-bff92a4c2b55 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:09:37 user nova-compute[75216]: DEBUG nova.objects.base [None req-b7abb094-3ea0-4c9c-acf1-c3428aecebb3 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Object Instance<7b752173-e573-426e-b9f1-bff92a4c2b55> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=75216) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 19:09:37 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-b7abb094-3ea0-4c9c-acf1-c3428aecebb3 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T19:01:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1575865869',display_name='tempest-AttachVolumeTestJSON-server-1575865869',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1575865869',id=29,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGyAqjyHTP2pee8vnuPoZ/xrp7+kl5CQoOuvKblvMKUYsUK2V6arU3VG3TaEuVHw4+At5BuB9j/a8y246OC2wl7lhVwqAlIhS8np4Du9lzYGwetS0FdeZdBwrMXi36WP0A==',key_name='tempest-keypair-355509380',keypairs=<?>,launch_index=0,launched_at=2023-11-13T19:01:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='095f5765865140d29b3ecf1ab3427037',ramdisk_id='',reservation_id='r-0zzag7s9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-156429078',owner_user_name='tempest-AttachVolumeTestJSON-156429078-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T19:07:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a7501ee4141241f2abc4d6bfce2924d4',uuid=7b752173-e573-426e-b9f1-bff92a4c2b55,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "60dd7b11-cfc3-4965-a429-8b2ac4cdfcf4", "address": "fa:16:3e:d6:af:c5", "network": {"id": "53bb01d5-31a4-47af-a931-ac12fe72b986", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-802892643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "095f5765865140d29b3ecf1ab3427037", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60dd7b11-cf", "ovs_interfaceid": "60dd7b11-cfc3-4965-a429-8b2ac4cdfcf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75216) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 19:09:37 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-b7abb094-3ea0-4c9c-acf1-c3428aecebb3 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Converting VIF {"id": "60dd7b11-cfc3-4965-a429-8b2ac4cdfcf4", "address": "fa:16:3e:d6:af:c5", "network": {"id": "53bb01d5-31a4-47af-a931-ac12fe72b986", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-802892643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "095f5765865140d29b3ecf1ab3427037", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60dd7b11-cf", "ovs_interfaceid": "60dd7b11-cfc3-4965-a429-8b2ac4cdfcf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 19:09:37 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-b7abb094-3ea0-4c9c-acf1-c3428aecebb3 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:af:c5,bridge_name='br-int',has_traffic_filtering=True,id=60dd7b11-cfc3-4965-a429-8b2ac4cdfcf4,network=Network(53bb01d5-31a4-47af-a931-ac12fe72b986),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60dd7b11-cf') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 19:09:37 user nova-compute[75216]: DEBUG nova.objects.instance [None req-b7abb094-3ea0-4c9c-acf1-c3428aecebb3 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Lazy-loading 'pci_devices' on Instance uuid 7b752173-e573-426e-b9f1-bff92a4c2b55 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:09:37 user nova-compute[75216]: DEBUG nova.objects.base [None req-b7abb094-3ea0-4c9c-acf1-c3428aecebb3 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Object Instance<7b752173-e573-426e-b9f1-bff92a4c2b55> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=75216) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 19:09:37 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-b7abb094-3ea0-4c9c-acf1-c3428aecebb3 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] [instance: 7b752173-e573-426e-b9f1-bff92a4c2b55] End _get_guest_xml xml=<domain type="kvm">
Nov 13 19:09:37 user nova-compute[75216]:   <uuid>7b752173-e573-426e-b9f1-bff92a4c2b55</uuid>
Nov 13 19:09:37 user nova-compute[75216]:   <name>instance-0000001d</name>
Nov 13 19:09:37 user nova-compute[75216]:   <memory>524288</memory>
Nov 13 19:09:37 user nova-compute[75216]:   <vcpu>1</vcpu>
Nov 13 19:09:37 user nova-compute[75216]:   <metadata>
Nov 13 19:09:37 user nova-compute[75216]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 19:09:37 user nova-compute[75216]:       <nova:package version="0.0.0"/>
Nov 13 19:09:37 user nova-compute[75216]:       <nova:name>tempest-AttachVolumeTestJSON-server-1575865869</nova:name>
Nov 13 19:09:37 user nova-compute[75216]:       <nova:creationTime>2023-11-13 19:09:37</nova:creationTime>
Nov 13 19:09:37 user nova-compute[75216]:       <nova:flavor name="m1.tiny">
Nov 13 19:09:37 user nova-compute[75216]:         <nova:memory>512</nova:memory>
Nov 13 19:09:37 user nova-compute[75216]:         <nova:disk>1</nova:disk>
Nov 13 19:09:37 user nova-compute[75216]:         <nova:swap>0</nova:swap>
Nov 13 19:09:37 user nova-compute[75216]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 19:09:37 user nova-compute[75216]:         <nova:vcpus>1</nova:vcpus>
Nov 13 19:09:37 user nova-compute[75216]:       </nova:flavor>
Nov 13 19:09:37 user nova-compute[75216]:       <nova:owner>
Nov 13 19:09:37 user nova-compute[75216]:         <nova:user uuid="a7501ee4141241f2abc4d6bfce2924d4">tempest-AttachVolumeTestJSON-156429078-project-member</nova:user>
Nov 13 19:09:37 user nova-compute[75216]:         <nova:project uuid="095f5765865140d29b3ecf1ab3427037">tempest-AttachVolumeTestJSON-156429078</nova:project>
Nov 13 19:09:37 user nova-compute[75216]:       </nova:owner>
Nov 13 19:09:37 user nova-compute[75216]:       <nova:root type="image" uuid="77bcb5ba-8510-41ec-a88d-96097bb431de"/>
Nov 13 19:09:37 user nova-compute[75216]:       <nova:ports>
Nov 13 19:09:37 user nova-compute[75216]:         <nova:port uuid="60dd7b11-cfc3-4965-a429-8b2ac4cdfcf4">
Nov 13 19:09:37 user nova-compute[75216]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 13 19:09:37 user nova-compute[75216]:         </nova:port>
Nov 13 19:09:37 user nova-compute[75216]:       </nova:ports>
Nov 13 19:09:37 user nova-compute[75216]:     </nova:instance>
Nov 13 19:09:37 user nova-compute[75216]:   </metadata>
Nov 13 19:09:37 user nova-compute[75216]:   <sysinfo type="smbios">
Nov 13 19:09:37 user nova-compute[75216]:     <system>
Nov 13 19:09:37 user nova-compute[75216]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 19:09:37 user nova-compute[75216]:       <entry name="product">OpenStack Nova</entry>
Nov 13 19:09:37 user nova-compute[75216]:       <entry name="version">0.0.0</entry>
Nov 13 19:09:37 user nova-compute[75216]:       <entry name="serial">7b752173-e573-426e-b9f1-bff92a4c2b55</entry>
Nov 13 19:09:37 user nova-compute[75216]:       <entry name="uuid">7b752173-e573-426e-b9f1-bff92a4c2b55</entry>
Nov 13 19:09:37 user nova-compute[75216]:       <entry name="family">Virtual Machine</entry>
Nov 13 19:09:37 user nova-compute[75216]:     </system>
Nov 13 19:09:37 user nova-compute[75216]:   </sysinfo>
Nov 13 19:09:37 user nova-compute[75216]:   <os>
Nov 13 19:09:37 user nova-compute[75216]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 19:09:37 user nova-compute[75216]:     <boot dev="hd"/>
Nov 13 19:09:37 user nova-compute[75216]:     <smbios mode="sysinfo"/>
Nov 13 19:09:37 user nova-compute[75216]:   </os>
Nov 13 19:09:37 user nova-compute[75216]:   <features>
Nov 13 19:09:37 user nova-compute[75216]:     <acpi/>
Nov 13 19:09:37 user nova-compute[75216]:     <apic/>
Nov 13 19:09:37 user nova-compute[75216]:     <vmcoreinfo/>
Nov 13 19:09:37 user nova-compute[75216]:   </features>
Nov 13 19:09:37 user nova-compute[75216]:   <clock offset="utc">
Nov 13 19:09:37 user nova-compute[75216]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 19:09:37 user nova-compute[75216]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 19:09:37 user nova-compute[75216]:     <timer name="hpet" present="no"/>
Nov 13 19:09:37 user nova-compute[75216]:   </clock>
Nov 13 19:09:37 user nova-compute[75216]:   <cpu mode="custom" match="exact">
Nov 13 19:09:37 user nova-compute[75216]:     <model>Nehalem</model>
Nov 13 19:09:37 user nova-compute[75216]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 19:09:37 user nova-compute[75216]:   </cpu>
Nov 13 19:09:37 user nova-compute[75216]:   <devices>
Nov 13 19:09:37 user nova-compute[75216]:     <disk type="file" device="disk">
Nov 13 19:09:37 user nova-compute[75216]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 19:09:37 user nova-compute[75216]:       <source file="/opt/stack/data/nova/instances/7b752173-e573-426e-b9f1-bff92a4c2b55/disk"/>
Nov 13 19:09:37 user nova-compute[75216]:       <target dev="vda" bus="virtio"/>
Nov 13 19:09:37 user nova-compute[75216]:     </disk>
Nov 13 19:09:37 user nova-compute[75216]:     <interface type="ethernet">
Nov 13 19:09:37 user nova-compute[75216]:       <mac address="fa:16:3e:d6:af:c5"/>
Nov 13 19:09:37 user nova-compute[75216]:       <model type="virtio"/>
Nov 13 19:09:37 user nova-compute[75216]:       <mtu size="1442"/>
Nov 13 19:09:37 user nova-compute[75216]:       <target dev="tap60dd7b11-cf"/>
Nov 13 19:09:37 user nova-compute[75216]:     </interface>
Nov 13 19:09:37 user nova-compute[75216]:     <serial type="pty">
Nov 13 19:09:37 user nova-compute[75216]:       <log file="/opt/stack/data/nova/instances/7b752173-e573-426e-b9f1-bff92a4c2b55/console.log" append="off"/>
Nov 13 19:09:37 user nova-compute[75216]:     </serial>
Nov 13 19:09:37 user nova-compute[75216]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 19:09:37 user nova-compute[75216]:     <video>
Nov 13 19:09:37 user nova-compute[75216]:       <model type="virtio"/>
Nov 13 19:09:37 user nova-compute[75216]:     </video>
Nov 13 19:09:37 user nova-compute[75216]:     <rng model="virtio">
Nov 13 19:09:37 user nova-compute[75216]:       <backend model="random">/dev/urandom</backend>
Nov 13 19:09:37 user nova-compute[75216]:     </rng>
Nov 13 19:09:37 user nova-compute[75216]:     <controller type="usb" index="0" model="none"/>
Nov 13 19:09:37 user nova-compute[75216]:     <memballoon model="virtio">
Nov 13 19:09:37 user nova-compute[75216]:       <stats period="10"/>
Nov 13 19:09:37 user nova-compute[75216]:     </memballoon>
Nov 13 19:09:37 user nova-compute[75216]:   </devices>
Nov 13 19:09:37 user nova-compute[75216]: </domain>
Nov 13 19:09:37 user nova-compute[75216]:  {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 19:09:37 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-b7abb094-3ea0-4c9c-acf1-c3428aecebb3 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b752173-e573-426e-b9f1-bff92a4c2b55/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:09:37 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-b7abb094-3ea0-4c9c-acf1-c3428aecebb3 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b752173-e573-426e-b9f1-bff92a4c2b55/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:09:37 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-b7abb094-3ea0-4c9c-acf1-c3428aecebb3 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b752173-e573-426e-b9f1-bff92a4c2b55/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:09:37 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-b7abb094-3ea0-4c9c-acf1-c3428aecebb3 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b752173-e573-426e-b9f1-bff92a4c2b55/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:09:37 user nova-compute[75216]: DEBUG nova.objects.instance [None req-b7abb094-3ea0-4c9c-acf1-c3428aecebb3 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Lazy-loading 'trusted_certs' on Instance uuid 7b752173-e573-426e-b9f1-bff92a4c2b55 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:09:37 user nova-compute[75216]: DEBUG nova.objects.base [None req-b7abb094-3ea0-4c9c-acf1-c3428aecebb3 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Object Instance<7b752173-e573-426e-b9f1-bff92a4c2b55> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=75216) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 19:09:37 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-b7abb094-3ea0-4c9c-acf1-c3428aecebb3 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:09:37 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-b7abb094-3ea0-4c9c-acf1-c3428aecebb3 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json" returned: 0 in 0.189s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:09:37 user nova-compute[75216]: DEBUG nova.virt.disk.api [None req-b7abb094-3ea0-4c9c-acf1-c3428aecebb3 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7b752173-e573-426e-b9f1-bff92a4c2b55/disk. size=1073741824 {{(pid=75216) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 19:09:37 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-b7abb094-3ea0-4c9c-acf1-c3428aecebb3 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b752173-e573-426e-b9f1-bff92a4c2b55/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:09:38 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-b7abb094-3ea0-4c9c-acf1-c3428aecebb3 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b752173-e573-426e-b9f1-bff92a4c2b55/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:09:38 user nova-compute[75216]: DEBUG nova.virt.disk.api [None req-b7abb094-3ea0-4c9c-acf1-c3428aecebb3 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Cannot resize image /opt/stack/data/nova/instances/7b752173-e573-426e-b9f1-bff92a4c2b55/disk to a smaller size. {{(pid=75216) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 19:09:38 user nova-compute[75216]: DEBUG nova.objects.instance [None req-b7abb094-3ea0-4c9c-acf1-c3428aecebb3 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Lazy-loading 'migration_context' on Instance uuid 7b752173-e573-426e-b9f1-bff92a4c2b55 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:09:38 user nova-compute[75216]: DEBUG nova.objects.base [None req-b7abb094-3ea0-4c9c-acf1-c3428aecebb3 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Object Instance<7b752173-e573-426e-b9f1-bff92a4c2b55> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75216) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 19:09:38 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-b7abb094-3ea0-4c9c-acf1-c3428aecebb3 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T19:01:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1575865869',display_name='tempest-AttachVolumeTestJSON-server-1575865869',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1575865869',id=29,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGyAqjyHTP2pee8vnuPoZ/xrp7+kl5CQoOuvKblvMKUYsUK2V6arU3VG3TaEuVHw4+At5BuB9j/a8y246OC2wl7lhVwqAlIhS8np4Du9lzYGwetS0FdeZdBwrMXi36WP0A==',key_name='tempest-keypair-355509380',keypairs=<?>,launch_index=0,launched_at=2023-11-13T19:01:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='095f5765865140d29b3ecf1ab3427037',ramdisk_id='',reservation_id='r-0zzag7s9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-156429078',owner_user_name='tempest-AttachVolumeTestJSON-156429078-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T19:07:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a7501ee4141241f2abc4d6bfce2924d4',uuid=7b752173-e573-426e-b9f1-bff92a4c2b55,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "60dd7b11-cfc3-4965-a429-8b2ac4cdfcf4", "address": "fa:16:3e:d6:af:c5", "network": {"id": "53bb01d5-31a4-47af-a931-ac12fe72b986", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-802892643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "095f5765865140d29b3ecf1ab3427037", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60dd7b11-cf", "ovs_interfaceid": "60dd7b11-cfc3-4965-a429-8b2ac4cdfcf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 19:09:38 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-b7abb094-3ea0-4c9c-acf1-c3428aecebb3 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Converting VIF {"id": "60dd7b11-cfc3-4965-a429-8b2ac4cdfcf4", "address": "fa:16:3e:d6:af:c5", "network": {"id": "53bb01d5-31a4-47af-a931-ac12fe72b986", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-802892643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "095f5765865140d29b3ecf1ab3427037", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60dd7b11-cf", "ovs_interfaceid": "60dd7b11-cfc3-4965-a429-8b2ac4cdfcf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 19:09:38 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-b7abb094-3ea0-4c9c-acf1-c3428aecebb3 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:af:c5,bridge_name='br-int',has_traffic_filtering=True,id=60dd7b11-cfc3-4965-a429-8b2ac4cdfcf4,network=Network(53bb01d5-31a4-47af-a931-ac12fe72b986),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60dd7b11-cf') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 19:09:38 user nova-compute[75216]: DEBUG os_vif [None req-b7abb094-3ea0-4c9c-acf1-c3428aecebb3 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:af:c5,bridge_name='br-int',has_traffic_filtering=True,id=60dd7b11-cfc3-4965-a429-8b2ac4cdfcf4,network=Network(53bb01d5-31a4-47af-a931-ac12fe72b986),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60dd7b11-cf') {{(pid=75216) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 19:09:38 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:09:38 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:09:38 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 19:09:38 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:09:38 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd3170150-d343-5a91-a21d-c456640494a4', '_type': 'linux-noop'}}, row=False) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:09:38 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:09:38 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:09:38 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:09:38 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap60dd7b11-cf, may_exist=True, interface_attrs={}) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:09:38 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap60dd7b11-cf, col_values=(('qos', UUID('067f4c5e-1ac9-46f2-82f8-17ac262b1c1d')),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:09:38 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap60dd7b11-cf, col_values=(('external_ids', {'iface-id': '60dd7b11-cfc3-4965-a429-8b2ac4cdfcf4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d6:af:c5', 'vm-uuid': '7b752173-e573-426e-b9f1-bff92a4c2b55'}),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:09:38 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:09:38 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:09:38 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:09:38 user nova-compute[75216]: INFO os_vif [None req-b7abb094-3ea0-4c9c-acf1-c3428aecebb3 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:af:c5,bridge_name='br-int',has_traffic_filtering=True,id=60dd7b11-cfc3-4965-a429-8b2ac4cdfcf4,network=Network(53bb01d5-31a4-47af-a931-ac12fe72b986),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60dd7b11-cf')
Nov 13 19:09:39 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:09:39 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:09:39 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:09:40 user nova-compute[75216]: DEBUG nova.compute.manager [req-c8e777d7-e7ba-477f-9db7-86a24b5867d4 req-553466be-e77a-4a6f-b8e3-e58c484ac079 service nova] [instance: 7b752173-e573-426e-b9f1-bff92a4c2b55] Received event network-vif-plugged-60dd7b11-cfc3-4965-a429-8b2ac4cdfcf4 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:09:40 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-c8e777d7-e7ba-477f-9db7-86a24b5867d4 req-553466be-e77a-4a6f-b8e3-e58c484ac079 service nova] Acquiring lock "7b752173-e573-426e-b9f1-bff92a4c2b55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:09:40 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-c8e777d7-e7ba-477f-9db7-86a24b5867d4 req-553466be-e77a-4a6f-b8e3-e58c484ac079 service nova] Lock "7b752173-e573-426e-b9f1-bff92a4c2b55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:09:40 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-c8e777d7-e7ba-477f-9db7-86a24b5867d4 req-553466be-e77a-4a6f-b8e3-e58c484ac079 service nova] Lock "7b752173-e573-426e-b9f1-bff92a4c2b55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:09:40 user nova-compute[75216]: DEBUG nova.compute.manager [req-c8e777d7-e7ba-477f-9db7-86a24b5867d4 req-553466be-e77a-4a6f-b8e3-e58c484ac079 service nova] [instance: 7b752173-e573-426e-b9f1-bff92a4c2b55] No waiting events found dispatching network-vif-plugged-60dd7b11-cfc3-4965-a429-8b2ac4cdfcf4 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 19:09:40 user nova-compute[75216]: WARNING nova.compute.manager [req-c8e777d7-e7ba-477f-9db7-86a24b5867d4 req-553466be-e77a-4a6f-b8e3-e58c484ac079 service nova] [instance: 7b752173-e573-426e-b9f1-bff92a4c2b55] Received unexpected event network-vif-plugged-60dd7b11-cfc3-4965-a429-8b2ac4cdfcf4 for instance with vm_state stopped and task_state powering-on.
Nov 13 19:09:40 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:09:40 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:09:40 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:09:40 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:09:40 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:09:41 user nova-compute[75216]: DEBUG nova.compute.manager [None req-b7abb094-3ea0-4c9c-acf1-c3428aecebb3 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] [instance: 7b752173-e573-426e-b9f1-bff92a4c2b55] Instance event wait completed in 0 seconds for  {{(pid=75216) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 19:09:41 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 7b752173-e573-426e-b9f1-bff92a4c2b55] Instance rebooted successfully.
Nov 13 19:09:41 user nova-compute[75216]: DEBUG nova.compute.manager [None req-b7abb094-3ea0-4c9c-acf1-c3428aecebb3 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] [instance: 7b752173-e573-426e-b9f1-bff92a4c2b55] Checking state {{(pid=75216) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 19:09:42 user nova-compute[75216]: DEBUG nova.compute.manager [req-7d3712f8-4676-457b-bf06-1b4b78c4a887 req-73a34999-e67d-4e89-9433-8b4ac2e580a3 service nova] [instance: 7b752173-e573-426e-b9f1-bff92a4c2b55] Received event network-vif-plugged-60dd7b11-cfc3-4965-a429-8b2ac4cdfcf4 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:09:42 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-7d3712f8-4676-457b-bf06-1b4b78c4a887 req-73a34999-e67d-4e89-9433-8b4ac2e580a3 service nova] Acquiring lock "7b752173-e573-426e-b9f1-bff92a4c2b55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:09:42 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-7d3712f8-4676-457b-bf06-1b4b78c4a887 req-73a34999-e67d-4e89-9433-8b4ac2e580a3 service nova] Lock "7b752173-e573-426e-b9f1-bff92a4c2b55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:09:42 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-7d3712f8-4676-457b-bf06-1b4b78c4a887 req-73a34999-e67d-4e89-9433-8b4ac2e580a3 service nova] Lock "7b752173-e573-426e-b9f1-bff92a4c2b55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:09:42 user nova-compute[75216]: DEBUG nova.compute.manager [req-7d3712f8-4676-457b-bf06-1b4b78c4a887 req-73a34999-e67d-4e89-9433-8b4ac2e580a3 service nova] [instance: 7b752173-e573-426e-b9f1-bff92a4c2b55] No waiting events found dispatching network-vif-plugged-60dd7b11-cfc3-4965-a429-8b2ac4cdfcf4 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 19:09:42 user nova-compute[75216]: WARNING nova.compute.manager [req-7d3712f8-4676-457b-bf06-1b4b78c4a887 req-73a34999-e67d-4e89-9433-8b4ac2e580a3 service nova] [instance: 7b752173-e573-426e-b9f1-bff92a4c2b55] Received unexpected event network-vif-plugged-60dd7b11-cfc3-4965-a429-8b2ac4cdfcf4 for instance with vm_state active and task_state None.
Nov 13 19:09:43 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:09:44 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:09:48 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:09:53 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:09:57 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:09:57 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:09:58 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:09:59 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:10:02 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:10:02 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:10:02 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75216) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 19:10:03 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:10:03 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:10:04 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:10:04 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:10:05 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:10:05 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:10:05 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:10:05 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:10:05 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Auditing locally available compute resources for user (node: user) {{(pid=75216) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 19:10:05 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 19:10:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b752173-e573-426e-b9f1-bff92a4c2b55/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:10:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b752173-e573-426e-b9f1-bff92a4c2b55/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:10:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b752173-e573-426e-b9f1-bff92a4c2b55/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:10:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b752173-e573-426e-b9f1-bff92a4c2b55/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:10:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:10:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:10:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:10:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:10:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c18c0ad-60e5-4ef2-97f2-b7008e89ac78/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:10:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c18c0ad-60e5-4ef2-97f2-b7008e89ac78/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:10:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c18c0ad-60e5-4ef2-97f2-b7008e89ac78/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:10:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c18c0ad-60e5-4ef2-97f2-b7008e89ac78/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:10:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33d6832f-1d6a-4f64-9e1b-07078e7e84a5/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:10:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33d6832f-1d6a-4f64-9e1b-07078e7e84a5/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:10:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33d6832f-1d6a-4f64-9e1b-07078e7e84a5/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:10:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33d6832f-1d6a-4f64-9e1b-07078e7e84a5/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:10:07 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 19:10:07 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 19:10:07 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Hypervisor/Node resource view: name=user free_ram=8463MB free_disk=25.1209716796875GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75216) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 19:10:07 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:10:07 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:10:07 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 19:10:07 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance 1e5f1164-a15e-40cf-b7bc-5aeb404a1216 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 19:10:07 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance 5c18c0ad-60e5-4ef2-97f2-b7008e89ac78 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 19:10:07 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance 7b752173-e573-426e-b9f1-bff92a4c2b55 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 19:10:07 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance 33d6832f-1d6a-4f64-9e1b-07078e7e84a5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 19:10:07 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 19:10:07 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 19:10:07 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 19:10:07 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 19:10:07 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Compute_service record updated for user:user {{(pid=75216) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 19:10:07 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.301s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:10:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:10:09 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:10:09 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:10:09 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Starting heal instance info cache {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 19:10:09 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "refresh_cache-1e5f1164-a15e-40cf-b7bc-5aeb404a1216" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 19:10:09 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquired lock "refresh_cache-1e5f1164-a15e-40cf-b7bc-5aeb404a1216" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 19:10:09 user nova-compute[75216]: DEBUG nova.network.neutron [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: 1e5f1164-a15e-40cf-b7bc-5aeb404a1216] Forcefully refreshing network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 19:10:10 user nova-compute[75216]: DEBUG nova.network.neutron [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: 1e5f1164-a15e-40cf-b7bc-5aeb404a1216] Updating instance_info_cache with network_info: [{"id": "96dfdc95-6a8e-43f3-8d7c-5b4f78a8f134", "address": "fa:16:3e:19:0b:3a", "network": {"id": "f8b821ef-8fae-42b9-9055-a9ea7be955ab", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-50594548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "903397a6c0474cfd8bd1a4fb338528aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96dfdc95-6a", "ovs_interfaceid": "96dfdc95-6a8e-43f3-8d7c-5b4f78a8f134", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:10:10 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Releasing lock "refresh_cache-1e5f1164-a15e-40cf-b7bc-5aeb404a1216" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 19:10:10 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: 1e5f1164-a15e-40cf-b7bc-5aeb404a1216] Updated the network info_cache for instance {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 19:10:10 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:10:13 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:10:18 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:10:22 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-22997c3a-ea16-47d2-94e4-d7232459977f tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Acquiring lock "5c18c0ad-60e5-4ef2-97f2-b7008e89ac78" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:10:22 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-22997c3a-ea16-47d2-94e4-d7232459977f tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Lock "5c18c0ad-60e5-4ef2-97f2-b7008e89ac78" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:10:22 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-22997c3a-ea16-47d2-94e4-d7232459977f tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Acquiring lock "5c18c0ad-60e5-4ef2-97f2-b7008e89ac78-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:10:22 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-22997c3a-ea16-47d2-94e4-d7232459977f tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Lock "5c18c0ad-60e5-4ef2-97f2-b7008e89ac78-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:10:22 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-22997c3a-ea16-47d2-94e4-d7232459977f tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Lock "5c18c0ad-60e5-4ef2-97f2-b7008e89ac78-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:10:22 user nova-compute[75216]: INFO nova.compute.manager [None req-22997c3a-ea16-47d2-94e4-d7232459977f tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: 5c18c0ad-60e5-4ef2-97f2-b7008e89ac78] Terminating instance
Nov 13 19:10:22 user nova-compute[75216]: DEBUG nova.compute.manager [None req-22997c3a-ea16-47d2-94e4-d7232459977f tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: 5c18c0ad-60e5-4ef2-97f2-b7008e89ac78] Start destroying the instance on the hypervisor. {{(pid=75216) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 19:10:22 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:10:22 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:10:22 user nova-compute[75216]: DEBUG nova.compute.manager [req-b331586c-ca18-4d59-862e-f03478d61936 req-aead8024-9667-4c0e-b216-c002334cddca service nova] [instance: 5c18c0ad-60e5-4ef2-97f2-b7008e89ac78] Received event network-vif-unplugged-d92289be-85e7-4781-8889-2d0c7c38a9fa {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:10:22 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-b331586c-ca18-4d59-862e-f03478d61936 req-aead8024-9667-4c0e-b216-c002334cddca service nova] Acquiring lock "5c18c0ad-60e5-4ef2-97f2-b7008e89ac78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:10:22 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-b331586c-ca18-4d59-862e-f03478d61936 req-aead8024-9667-4c0e-b216-c002334cddca service nova] Lock "5c18c0ad-60e5-4ef2-97f2-b7008e89ac78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:10:22 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-b331586c-ca18-4d59-862e-f03478d61936 req-aead8024-9667-4c0e-b216-c002334cddca service nova] Lock "5c18c0ad-60e5-4ef2-97f2-b7008e89ac78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:10:22 user nova-compute[75216]: DEBUG nova.compute.manager [req-b331586c-ca18-4d59-862e-f03478d61936 req-aead8024-9667-4c0e-b216-c002334cddca service nova] [instance: 5c18c0ad-60e5-4ef2-97f2-b7008e89ac78] No waiting events found dispatching network-vif-unplugged-d92289be-85e7-4781-8889-2d0c7c38a9fa {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 19:10:22 user nova-compute[75216]: DEBUG nova.compute.manager [req-b331586c-ca18-4d59-862e-f03478d61936 req-aead8024-9667-4c0e-b216-c002334cddca service nova] [instance: 5c18c0ad-60e5-4ef2-97f2-b7008e89ac78] Received event network-vif-unplugged-d92289be-85e7-4781-8889-2d0c7c38a9fa for instance with task_state deleting. {{(pid=75216) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 19:10:22 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:10:22 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:10:22 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:10:22 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:10:22 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:10:22 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:10:22 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 5c18c0ad-60e5-4ef2-97f2-b7008e89ac78] Instance destroyed successfully.
Nov 13 19:10:22 user nova-compute[75216]: DEBUG nova.objects.instance [None req-22997c3a-ea16-47d2-94e4-d7232459977f tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Lazy-loading 'resources' on Instance uuid 5c18c0ad-60e5-4ef2-97f2-b7008e89ac78 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:10:22 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-22997c3a-ea16-47d2-94e4-d7232459977f tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T19:01:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1664652434',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1664652434',id=28,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-13T19:01:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='903397a6c0474cfd8bd1a4fb338528aa',ramdisk_id='',reservation_id='r-0i5en3ub',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-197527955',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T19:02:57Z,user_data=None,user_id='b381ea98871846b1bfb29a202a058208',uuid=5c18c0ad-60e5-4ef2-97f2-b7008e89ac78,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d92289be-85e7-4781-8889-2d0c7c38a9fa", "address": "fa:16:3e:ec:0e:80", "network": {"id": "f8b821ef-8fae-42b9-9055-a9ea7be955ab", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-50594548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "903397a6c0474cfd8bd1a4fb338528aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd92289be-85", "ovs_interfaceid": "d92289be-85e7-4781-8889-2d0c7c38a9fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 19:10:22 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-22997c3a-ea16-47d2-94e4-d7232459977f tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Converting VIF {"id": "d92289be-85e7-4781-8889-2d0c7c38a9fa", "address": "fa:16:3e:ec:0e:80", "network": {"id": "f8b821ef-8fae-42b9-9055-a9ea7be955ab", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-50594548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "903397a6c0474cfd8bd1a4fb338528aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd92289be-85", "ovs_interfaceid": "d92289be-85e7-4781-8889-2d0c7c38a9fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 19:10:22 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-22997c3a-ea16-47d2-94e4-d7232459977f tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ec:0e:80,bridge_name='br-int',has_traffic_filtering=True,id=d92289be-85e7-4781-8889-2d0c7c38a9fa,network=Network(f8b821ef-8fae-42b9-9055-a9ea7be955ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd92289be-85') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 19:10:22 user nova-compute[75216]: DEBUG os_vif [None req-22997c3a-ea16-47d2-94e4-d7232459977f tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ec:0e:80,bridge_name='br-int',has_traffic_filtering=True,id=d92289be-85e7-4781-8889-2d0c7c38a9fa,network=Network(f8b821ef-8fae-42b9-9055-a9ea7be955ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd92289be-85') {{(pid=75216) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 19:10:22 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:10:22 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd92289be-85, bridge=br-int, if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:10:22 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:10:22 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:10:22 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1d85b86f-8214-4877-b0d1-05c181714527) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:10:22 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:10:22 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:10:22 user nova-compute[75216]: INFO os_vif [None req-22997c3a-ea16-47d2-94e4-d7232459977f tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ec:0e:80,bridge_name='br-int',has_traffic_filtering=True,id=d92289be-85e7-4781-8889-2d0c7c38a9fa,network=Network(f8b821ef-8fae-42b9-9055-a9ea7be955ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd92289be-85')
Nov 13 19:10:22 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-22997c3a-ea16-47d2-94e4-d7232459977f tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: 5c18c0ad-60e5-4ef2-97f2-b7008e89ac78] Deleting instance files /opt/stack/data/nova/instances/5c18c0ad-60e5-4ef2-97f2-b7008e89ac78_del
Nov 13 19:10:22 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-22997c3a-ea16-47d2-94e4-d7232459977f tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: 5c18c0ad-60e5-4ef2-97f2-b7008e89ac78] Deletion of /opt/stack/data/nova/instances/5c18c0ad-60e5-4ef2-97f2-b7008e89ac78_del complete
Nov 13 19:10:23 user nova-compute[75216]: INFO nova.compute.manager [None req-22997c3a-ea16-47d2-94e4-d7232459977f tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: 5c18c0ad-60e5-4ef2-97f2-b7008e89ac78] Took 0.68 seconds to destroy the instance on the hypervisor.
Nov 13 19:10:23 user nova-compute[75216]: DEBUG oslo.service.loopingcall [None req-22997c3a-ea16-47d2-94e4-d7232459977f tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75216) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 19:10:23 user nova-compute[75216]: DEBUG nova.compute.manager [-] [instance: 5c18c0ad-60e5-4ef2-97f2-b7008e89ac78] Deallocating network for instance {{(pid=75216) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 19:10:23 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: 5c18c0ad-60e5-4ef2-97f2-b7008e89ac78] deallocate_for_instance() {{(pid=75216) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 19:10:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:10:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:10:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:10:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:10:23 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: 5c18c0ad-60e5-4ef2-97f2-b7008e89ac78] Updating instance_info_cache with network_info: [] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:10:23 user nova-compute[75216]: INFO nova.compute.manager [-] [instance: 5c18c0ad-60e5-4ef2-97f2-b7008e89ac78] Took 0.82 seconds to deallocate network for instance.
Nov 13 19:10:23 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-22997c3a-ea16-47d2-94e4-d7232459977f tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:10:23 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-22997c3a-ea16-47d2-94e4-d7232459977f tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:10:24 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-22997c3a-ea16-47d2-94e4-d7232459977f tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 19:10:24 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-22997c3a-ea16-47d2-94e4-d7232459977f tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 19:10:24 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-22997c3a-ea16-47d2-94e4-d7232459977f tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.203s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:10:24 user nova-compute[75216]: INFO nova.scheduler.client.report [None req-22997c3a-ea16-47d2-94e4-d7232459977f tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Deleted allocations for instance 5c18c0ad-60e5-4ef2-97f2-b7008e89ac78
Nov 13 19:10:24 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-22997c3a-ea16-47d2-94e4-d7232459977f tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Lock "5c18c0ad-60e5-4ef2-97f2-b7008e89ac78" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.879s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:10:24 user nova-compute[75216]: DEBUG nova.compute.manager [req-e10547fb-c11a-4532-b80f-54e5b44bd952 req-0d5c43c8-8926-410e-b228-9442336c0504 service nova] [instance: 5c18c0ad-60e5-4ef2-97f2-b7008e89ac78] Received event network-vif-plugged-d92289be-85e7-4781-8889-2d0c7c38a9fa {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:10:24 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-e10547fb-c11a-4532-b80f-54e5b44bd952 req-0d5c43c8-8926-410e-b228-9442336c0504 service nova] Acquiring lock "5c18c0ad-60e5-4ef2-97f2-b7008e89ac78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:10:24 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-e10547fb-c11a-4532-b80f-54e5b44bd952 req-0d5c43c8-8926-410e-b228-9442336c0504 service nova] Lock "5c18c0ad-60e5-4ef2-97f2-b7008e89ac78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:10:24 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-e10547fb-c11a-4532-b80f-54e5b44bd952 req-0d5c43c8-8926-410e-b228-9442336c0504 service nova] Lock "5c18c0ad-60e5-4ef2-97f2-b7008e89ac78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:10:24 user nova-compute[75216]: DEBUG nova.compute.manager [req-e10547fb-c11a-4532-b80f-54e5b44bd952 req-0d5c43c8-8926-410e-b228-9442336c0504 service nova] [instance: 5c18c0ad-60e5-4ef2-97f2-b7008e89ac78] No waiting events found dispatching network-vif-plugged-d92289be-85e7-4781-8889-2d0c7c38a9fa {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 19:10:24 user nova-compute[75216]: WARNING nova.compute.manager [req-e10547fb-c11a-4532-b80f-54e5b44bd952 req-0d5c43c8-8926-410e-b228-9442336c0504 service nova] [instance: 5c18c0ad-60e5-4ef2-97f2-b7008e89ac78] Received unexpected event network-vif-plugged-d92289be-85e7-4781-8889-2d0c7c38a9fa for instance with vm_state deleted and task_state None.
Nov 13 19:10:24 user nova-compute[75216]: DEBUG nova.compute.manager [req-e10547fb-c11a-4532-b80f-54e5b44bd952 req-0d5c43c8-8926-410e-b228-9442336c0504 service nova] [instance: 5c18c0ad-60e5-4ef2-97f2-b7008e89ac78] Received event network-vif-plugged-d92289be-85e7-4781-8889-2d0c7c38a9fa {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:10:24 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-e10547fb-c11a-4532-b80f-54e5b44bd952 req-0d5c43c8-8926-410e-b228-9442336c0504 service nova] Acquiring lock "5c18c0ad-60e5-4ef2-97f2-b7008e89ac78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:10:24 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-e10547fb-c11a-4532-b80f-54e5b44bd952 req-0d5c43c8-8926-410e-b228-9442336c0504 service nova] Lock "5c18c0ad-60e5-4ef2-97f2-b7008e89ac78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:10:24 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-e10547fb-c11a-4532-b80f-54e5b44bd952 req-0d5c43c8-8926-410e-b228-9442336c0504 service nova] Lock "5c18c0ad-60e5-4ef2-97f2-b7008e89ac78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:10:24 user nova-compute[75216]: DEBUG nova.compute.manager [req-e10547fb-c11a-4532-b80f-54e5b44bd952 req-0d5c43c8-8926-410e-b228-9442336c0504 service nova] [instance: 5c18c0ad-60e5-4ef2-97f2-b7008e89ac78] No waiting events found dispatching network-vif-plugged-d92289be-85e7-4781-8889-2d0c7c38a9fa {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 19:10:24 user nova-compute[75216]: WARNING nova.compute.manager [req-e10547fb-c11a-4532-b80f-54e5b44bd952 req-0d5c43c8-8926-410e-b228-9442336c0504 service nova] [instance: 5c18c0ad-60e5-4ef2-97f2-b7008e89ac78] Received unexpected event network-vif-plugged-d92289be-85e7-4781-8889-2d0c7c38a9fa for instance with vm_state deleted and task_state None.
Nov 13 19:10:24 user nova-compute[75216]: DEBUG nova.compute.manager [req-e10547fb-c11a-4532-b80f-54e5b44bd952 req-0d5c43c8-8926-410e-b228-9442336c0504 service nova] [instance: 5c18c0ad-60e5-4ef2-97f2-b7008e89ac78] Received event network-vif-plugged-d92289be-85e7-4781-8889-2d0c7c38a9fa {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:10:24 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-e10547fb-c11a-4532-b80f-54e5b44bd952 req-0d5c43c8-8926-410e-b228-9442336c0504 service nova] Acquiring lock "5c18c0ad-60e5-4ef2-97f2-b7008e89ac78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:10:24 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-e10547fb-c11a-4532-b80f-54e5b44bd952 req-0d5c43c8-8926-410e-b228-9442336c0504 service nova] Lock "5c18c0ad-60e5-4ef2-97f2-b7008e89ac78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:10:24 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-e10547fb-c11a-4532-b80f-54e5b44bd952 req-0d5c43c8-8926-410e-b228-9442336c0504 service nova] Lock "5c18c0ad-60e5-4ef2-97f2-b7008e89ac78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:10:24 user nova-compute[75216]: DEBUG nova.compute.manager [req-e10547fb-c11a-4532-b80f-54e5b44bd952 req-0d5c43c8-8926-410e-b228-9442336c0504 service nova] [instance: 5c18c0ad-60e5-4ef2-97f2-b7008e89ac78] No waiting events found dispatching network-vif-plugged-d92289be-85e7-4781-8889-2d0c7c38a9fa {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 19:10:24 user nova-compute[75216]: WARNING nova.compute.manager [req-e10547fb-c11a-4532-b80f-54e5b44bd952 req-0d5c43c8-8926-410e-b228-9442336c0504 service nova] [instance: 5c18c0ad-60e5-4ef2-97f2-b7008e89ac78] Received unexpected event network-vif-plugged-d92289be-85e7-4781-8889-2d0c7c38a9fa for instance with vm_state deleted and task_state None.
Nov 13 19:10:24 user nova-compute[75216]: DEBUG nova.compute.manager [req-e10547fb-c11a-4532-b80f-54e5b44bd952 req-0d5c43c8-8926-410e-b228-9442336c0504 service nova] [instance: 5c18c0ad-60e5-4ef2-97f2-b7008e89ac78] Received event network-vif-plugged-d92289be-85e7-4781-8889-2d0c7c38a9fa {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:10:24 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-e10547fb-c11a-4532-b80f-54e5b44bd952 req-0d5c43c8-8926-410e-b228-9442336c0504 service nova] Acquiring lock "5c18c0ad-60e5-4ef2-97f2-b7008e89ac78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:10:24 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-e10547fb-c11a-4532-b80f-54e5b44bd952 req-0d5c43c8-8926-410e-b228-9442336c0504 service nova] Lock "5c18c0ad-60e5-4ef2-97f2-b7008e89ac78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:10:24 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-e10547fb-c11a-4532-b80f-54e5b44bd952 req-0d5c43c8-8926-410e-b228-9442336c0504 service nova] Lock "5c18c0ad-60e5-4ef2-97f2-b7008e89ac78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:10:24 user nova-compute[75216]: DEBUG nova.compute.manager [req-e10547fb-c11a-4532-b80f-54e5b44bd952 req-0d5c43c8-8926-410e-b228-9442336c0504 service nova] [instance: 5c18c0ad-60e5-4ef2-97f2-b7008e89ac78] No waiting events found dispatching network-vif-plugged-d92289be-85e7-4781-8889-2d0c7c38a9fa {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 19:10:24 user nova-compute[75216]: WARNING nova.compute.manager [req-e10547fb-c11a-4532-b80f-54e5b44bd952 req-0d5c43c8-8926-410e-b228-9442336c0504 service nova] [instance: 5c18c0ad-60e5-4ef2-97f2-b7008e89ac78] Received unexpected event network-vif-plugged-d92289be-85e7-4781-8889-2d0c7c38a9fa for instance with vm_state deleted and task_state None.
Nov 13 19:10:24 user nova-compute[75216]: DEBUG nova.compute.manager [req-e10547fb-c11a-4532-b80f-54e5b44bd952 req-0d5c43c8-8926-410e-b228-9442336c0504 service nova] [instance: 5c18c0ad-60e5-4ef2-97f2-b7008e89ac78] Received event network-vif-deleted-d92289be-85e7-4781-8889-2d0c7c38a9fa {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:10:27 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:10:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:10:33 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-5853db78-6679-4a1c-acb4-b97c4f2e85bf tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Acquiring lock "fc2b6a17-b3bf-42da-ad68-2f125c952a31" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:10:33 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-5853db78-6679-4a1c-acb4-b97c4f2e85bf tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Lock "fc2b6a17-b3bf-42da-ad68-2f125c952a31" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:10:33 user nova-compute[75216]: INFO nova.compute.manager [None req-5853db78-6679-4a1c-acb4-b97c4f2e85bf tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] [instance: fc2b6a17-b3bf-42da-ad68-2f125c952a31] Unshelving
Nov 13 19:10:33 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-5853db78-6679-4a1c-acb4-b97c4f2e85bf tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:10:33 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-5853db78-6679-4a1c-acb4-b97c4f2e85bf tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:10:33 user nova-compute[75216]: DEBUG nova.objects.instance [None req-5853db78-6679-4a1c-acb4-b97c4f2e85bf tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Lazy-loading 'pci_requests' on Instance uuid fc2b6a17-b3bf-42da-ad68-2f125c952a31 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:10:33 user nova-compute[75216]: DEBUG nova.objects.instance [None req-5853db78-6679-4a1c-acb4-b97c4f2e85bf tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Lazy-loading 'numa_topology' on Instance uuid fc2b6a17-b3bf-42da-ad68-2f125c952a31 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:10:33 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-5853db78-6679-4a1c-acb4-b97c4f2e85bf tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75216) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 19:10:33 user nova-compute[75216]: INFO nova.compute.claims [None req-5853db78-6679-4a1c-acb4-b97c4f2e85bf tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] [instance: fc2b6a17-b3bf-42da-ad68-2f125c952a31] Claim successful on node user
Nov 13 19:10:33 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-5853db78-6679-4a1c-acb4-b97c4f2e85bf tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 19:10:33 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-5853db78-6679-4a1c-acb4-b97c4f2e85bf tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 19:10:34 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-5853db78-6679-4a1c-acb4-b97c4f2e85bf tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.292s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:10:34 user nova-compute[75216]: INFO nova.network.neutron [None req-5853db78-6679-4a1c-acb4-b97c4f2e85bf tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] [instance: fc2b6a17-b3bf-42da-ad68-2f125c952a31] Updating port 4621e43a-a523-4506-8520-bcca759faa35 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 13 19:10:34 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-5853db78-6679-4a1c-acb4-b97c4f2e85bf tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Acquiring lock "refresh_cache-fc2b6a17-b3bf-42da-ad68-2f125c952a31" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 19:10:34 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-5853db78-6679-4a1c-acb4-b97c4f2e85bf tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Acquired lock "refresh_cache-fc2b6a17-b3bf-42da-ad68-2f125c952a31" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 19:10:34 user nova-compute[75216]: DEBUG nova.network.neutron [None req-5853db78-6679-4a1c-acb4-b97c4f2e85bf tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] [instance: fc2b6a17-b3bf-42da-ad68-2f125c952a31] Building network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 19:10:34 user nova-compute[75216]: DEBUG nova.compute.manager [req-38152574-d5ac-4c28-8cbf-22b7621d622d req-91e63580-586c-4d31-be1c-deca3fd036fd service nova] [instance: fc2b6a17-b3bf-42da-ad68-2f125c952a31] Received event network-changed-4621e43a-a523-4506-8520-bcca759faa35 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:10:34 user nova-compute[75216]: DEBUG nova.compute.manager [req-38152574-d5ac-4c28-8cbf-22b7621d622d req-91e63580-586c-4d31-be1c-deca3fd036fd service nova] [instance: fc2b6a17-b3bf-42da-ad68-2f125c952a31] Refreshing instance network info cache due to event network-changed-4621e43a-a523-4506-8520-bcca759faa35. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 19:10:34 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-38152574-d5ac-4c28-8cbf-22b7621d622d req-91e63580-586c-4d31-be1c-deca3fd036fd service nova] Acquiring lock "refresh_cache-fc2b6a17-b3bf-42da-ad68-2f125c952a31" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 19:10:35 user nova-compute[75216]: DEBUG nova.network.neutron [None req-5853db78-6679-4a1c-acb4-b97c4f2e85bf tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] [instance: fc2b6a17-b3bf-42da-ad68-2f125c952a31] Updating instance_info_cache with network_info: [{"id": "4621e43a-a523-4506-8520-bcca759faa35", "address": "fa:16:3e:58:6e:5f", "network": {"id": "8cbeb1cc-a067-4c8d-82d8-0dc5c2ac924c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-742672345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a58d1e76a793406bbdd3821ff74abd92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4621e43a-a5", "ovs_interfaceid": "4621e43a-a523-4506-8520-bcca759faa35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:10:35 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-5853db78-6679-4a1c-acb4-b97c4f2e85bf tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Releasing lock "refresh_cache-fc2b6a17-b3bf-42da-ad68-2f125c952a31" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 19:10:35 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-5853db78-6679-4a1c-acb4-b97c4f2e85bf tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] [instance: fc2b6a17-b3bf-42da-ad68-2f125c952a31] Creating instance directory {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 19:10:35 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-5853db78-6679-4a1c-acb4-b97c4f2e85bf tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] [instance: fc2b6a17-b3bf-42da-ad68-2f125c952a31] Creating image(s)
Nov 13 19:10:35 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-5853db78-6679-4a1c-acb4-b97c4f2e85bf tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Acquiring lock "/opt/stack/data/nova/instances/fc2b6a17-b3bf-42da-ad68-2f125c952a31/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:10:35 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-5853db78-6679-4a1c-acb4-b97c4f2e85bf tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Lock "/opt/stack/data/nova/instances/fc2b6a17-b3bf-42da-ad68-2f125c952a31/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:10:35 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-5853db78-6679-4a1c-acb4-b97c4f2e85bf tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Lock "/opt/stack/data/nova/instances/fc2b6a17-b3bf-42da-ad68-2f125c952a31/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:10:35 user nova-compute[75216]: DEBUG nova.objects.instance [None req-5853db78-6679-4a1c-acb4-b97c4f2e85bf tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Lazy-loading 'trusted_certs' on Instance uuid fc2b6a17-b3bf-42da-ad68-2f125c952a31 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:10:35 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-38152574-d5ac-4c28-8cbf-22b7621d622d req-91e63580-586c-4d31-be1c-deca3fd036fd service nova] Acquired lock "refresh_cache-fc2b6a17-b3bf-42da-ad68-2f125c952a31" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 19:10:35 user nova-compute[75216]: DEBUG nova.network.neutron [req-38152574-d5ac-4c28-8cbf-22b7621d622d req-91e63580-586c-4d31-be1c-deca3fd036fd service nova] [instance: fc2b6a17-b3bf-42da-ad68-2f125c952a31] Refreshing network info cache for port 4621e43a-a523-4506-8520-bcca759faa35 {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 19:10:35 user nova-compute[75216]: DEBUG nova.objects.base [None req-5853db78-6679-4a1c-acb4-b97c4f2e85bf tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Object Instance<fc2b6a17-b3bf-42da-ad68-2f125c952a31> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=75216) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 19:10:35 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-5853db78-6679-4a1c-acb4-b97c4f2e85bf tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Acquiring lock "ba27db4f713454211519af52282c99a80ac238f1" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:10:35 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-5853db78-6679-4a1c-acb4-b97c4f2e85bf tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Lock "ba27db4f713454211519af52282c99a80ac238f1" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:10:36 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-5853db78-6679-4a1c-acb4-b97c4f2e85bf tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ba27db4f713454211519af52282c99a80ac238f1.part --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:10:36 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-5853db78-6679-4a1c-acb4-b97c4f2e85bf tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ba27db4f713454211519af52282c99a80ac238f1.part --force-share --output=json" returned: 0 in 0.179s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:10:36 user nova-compute[75216]: DEBUG nova.virt.images [None req-5853db78-6679-4a1c-acb4-b97c4f2e85bf tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] 20909060-0bdd-4e57-a052-325c7f65d799 was qcow2, converting to raw {{(pid=75216) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 13 19:10:36 user nova-compute[75216]: DEBUG nova.privsep.utils [None req-5853db78-6679-4a1c-acb4-b97c4f2e85bf tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75216) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 13 19:10:36 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-5853db78-6679-4a1c-acb4-b97c4f2e85bf tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ba27db4f713454211519af52282c99a80ac238f1.part /opt/stack/data/nova/instances/_base/ba27db4f713454211519af52282c99a80ac238f1.converted {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:10:36 user nova-compute[75216]: DEBUG nova.network.neutron [req-38152574-d5ac-4c28-8cbf-22b7621d622d req-91e63580-586c-4d31-be1c-deca3fd036fd service nova] [instance: fc2b6a17-b3bf-42da-ad68-2f125c952a31] Updated VIF entry in instance network info cache for port 4621e43a-a523-4506-8520-bcca759faa35. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 19:10:36 user nova-compute[75216]: DEBUG nova.network.neutron [req-38152574-d5ac-4c28-8cbf-22b7621d622d req-91e63580-586c-4d31-be1c-deca3fd036fd service nova] [instance: fc2b6a17-b3bf-42da-ad68-2f125c952a31] Updating instance_info_cache with network_info: [{"id": "4621e43a-a523-4506-8520-bcca759faa35", "address": "fa:16:3e:58:6e:5f", "network": {"id": "8cbeb1cc-a067-4c8d-82d8-0dc5c2ac924c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-742672345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a58d1e76a793406bbdd3821ff74abd92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4621e43a-a5", "ovs_interfaceid": "4621e43a-a523-4506-8520-bcca759faa35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:10:36 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-38152574-d5ac-4c28-8cbf-22b7621d622d req-91e63580-586c-4d31-be1c-deca3fd036fd service nova] Releasing lock "refresh_cache-fc2b6a17-b3bf-42da-ad68-2f125c952a31" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 19:10:37 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-5853db78-6679-4a1c-acb4-b97c4f2e85bf tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ba27db4f713454211519af52282c99a80ac238f1.part /opt/stack/data/nova/instances/_base/ba27db4f713454211519af52282c99a80ac238f1.converted" returned: 0 in 0.795s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:10:37 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-5853db78-6679-4a1c-acb4-b97c4f2e85bf tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ba27db4f713454211519af52282c99a80ac238f1.converted --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:10:37 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-5853db78-6679-4a1c-acb4-b97c4f2e85bf tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ba27db4f713454211519af52282c99a80ac238f1.converted --force-share --output=json" returned: 0 in 0.178s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:10:37 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-5853db78-6679-4a1c-acb4-b97c4f2e85bf tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Lock "ba27db4f713454211519af52282c99a80ac238f1" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.240s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:10:37 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-5853db78-6679-4a1c-acb4-b97c4f2e85bf tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ba27db4f713454211519af52282c99a80ac238f1 --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:10:37 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-5853db78-6679-4a1c-acb4-b97c4f2e85bf tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ba27db4f713454211519af52282c99a80ac238f1 --force-share --output=json" returned: 0 in 0.250s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:10:37 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-5853db78-6679-4a1c-acb4-b97c4f2e85bf tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Acquiring lock "ba27db4f713454211519af52282c99a80ac238f1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:10:37 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-5853db78-6679-4a1c-acb4-b97c4f2e85bf tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Lock "ba27db4f713454211519af52282c99a80ac238f1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:10:37 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-5853db78-6679-4a1c-acb4-b97c4f2e85bf tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ba27db4f713454211519af52282c99a80ac238f1 --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:10:37 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-5853db78-6679-4a1c-acb4-b97c4f2e85bf tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ba27db4f713454211519af52282c99a80ac238f1 --force-share --output=json" returned: 0 in 0.171s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:10:37 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-5853db78-6679-4a1c-acb4-b97c4f2e85bf tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ba27db4f713454211519af52282c99a80ac238f1,backing_fmt=raw /opt/stack/data/nova/instances/fc2b6a17-b3bf-42da-ad68-2f125c952a31/disk 1073741824 {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:10:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:10:38 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-5853db78-6679-4a1c-acb4-b97c4f2e85bf tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ba27db4f713454211519af52282c99a80ac238f1,backing_fmt=raw /opt/stack/data/nova/instances/fc2b6a17-b3bf-42da-ad68-2f125c952a31/disk 1073741824" returned: 0 in 0.425s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:10:38 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-5853db78-6679-4a1c-acb4-b97c4f2e85bf tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Lock "ba27db4f713454211519af52282c99a80ac238f1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.602s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:10:38 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-5853db78-6679-4a1c-acb4-b97c4f2e85bf tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ba27db4f713454211519af52282c99a80ac238f1 --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:10:38 user nova-compute[75216]: DEBUG nova.compute.manager [req-bb0b1424-1739-4383-b0c5-589e464a43f7 req-d04333ef-40bd-48ae-ae89-f7cab4a8b52c service nova] [instance: 33d6832f-1d6a-4f64-9e1b-07078e7e84a5] Received event network-changed-0c5edcf5-88d0-44aa-977d-51faede9daeb {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:10:38 user nova-compute[75216]: DEBUG nova.compute.manager [req-bb0b1424-1739-4383-b0c5-589e464a43f7 req-d04333ef-40bd-48ae-ae89-f7cab4a8b52c service nova] [instance: 33d6832f-1d6a-4f64-9e1b-07078e7e84a5] Refreshing instance network info cache due to event network-changed-0c5edcf5-88d0-44aa-977d-51faede9daeb. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 19:10:38 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-bb0b1424-1739-4383-b0c5-589e464a43f7 req-d04333ef-40bd-48ae-ae89-f7cab4a8b52c service nova] Acquiring lock "refresh_cache-33d6832f-1d6a-4f64-9e1b-07078e7e84a5" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 19:10:38 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-bb0b1424-1739-4383-b0c5-589e464a43f7 req-d04333ef-40bd-48ae-ae89-f7cab4a8b52c service nova] Acquired lock "refresh_cache-33d6832f-1d6a-4f64-9e1b-07078e7e84a5" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 19:10:38 user nova-compute[75216]: DEBUG nova.network.neutron [req-bb0b1424-1739-4383-b0c5-589e464a43f7 req-d04333ef-40bd-48ae-ae89-f7cab4a8b52c service nova] [instance: 33d6832f-1d6a-4f64-9e1b-07078e7e84a5] Refreshing network info cache for port 0c5edcf5-88d0-44aa-977d-51faede9daeb {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 19:10:38 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-5853db78-6679-4a1c-acb4-b97c4f2e85bf tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ba27db4f713454211519af52282c99a80ac238f1 --force-share --output=json" returned: 0 in 0.177s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:10:38 user nova-compute[75216]: DEBUG nova.objects.instance [None req-5853db78-6679-4a1c-acb4-b97c4f2e85bf tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Lazy-loading 'migration_context' on Instance uuid fc2b6a17-b3bf-42da-ad68-2f125c952a31 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:10:38 user nova-compute[75216]: DEBUG nova.objects.base [None req-5853db78-6679-4a1c-acb4-b97c4f2e85bf tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Object Instance<fc2b6a17-b3bf-42da-ad68-2f125c952a31> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=75216) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 19:10:38 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-5853db78-6679-4a1c-acb4-b97c4f2e85bf tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] [instance: fc2b6a17-b3bf-42da-ad68-2f125c952a31] Rebasing disk image.
Nov 13 19:10:38 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-5853db78-6679-4a1c-acb4-b97c4f2e85bf tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:10:38 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-5853db78-6679-4a1c-acb4-b97c4f2e85bf tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json" returned: 0 in 0.178s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:10:38 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-5853db78-6679-4a1c-acb4-b97c4f2e85bf tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 -F raw /opt/stack/data/nova/instances/fc2b6a17-b3bf-42da-ad68-2f125c952a31/disk {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:10:38 user nova-compute[75216]: DEBUG nova.network.neutron [req-bb0b1424-1739-4383-b0c5-589e464a43f7 req-d04333ef-40bd-48ae-ae89-f7cab4a8b52c service nova] [instance: 33d6832f-1d6a-4f64-9e1b-07078e7e84a5] Updated VIF entry in instance network info cache for port 0c5edcf5-88d0-44aa-977d-51faede9daeb. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 19:10:38 user nova-compute[75216]: DEBUG nova.network.neutron [req-bb0b1424-1739-4383-b0c5-589e464a43f7 req-d04333ef-40bd-48ae-ae89-f7cab4a8b52c service nova] [instance: 33d6832f-1d6a-4f64-9e1b-07078e7e84a5] Updating instance_info_cache with network_info: [{"id": "0c5edcf5-88d0-44aa-977d-51faede9daeb", "address": "fa:16:3e:5b:07:f6", "network": {"id": "dc5c76ee-b62d-4bd4-80f6-04d6fd6776e3", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1854861756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d3ed74465c6499e9508724c439ddb0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c5edcf5-88", "ovs_interfaceid": "0c5edcf5-88d0-44aa-977d-51faede9daeb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:10:38 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-bb0b1424-1739-4383-b0c5-589e464a43f7 req-d04333ef-40bd-48ae-ae89-f7cab4a8b52c service nova] Releasing lock "refresh_cache-33d6832f-1d6a-4f64-9e1b-07078e7e84a5" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 19:10:39 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:10:40 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a0b24d7e-8f15-4be7-bb33-5fd4f45512a1 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] Acquiring lock "33d6832f-1d6a-4f64-9e1b-07078e7e84a5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:10:40 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a0b24d7e-8f15-4be7-bb33-5fd4f45512a1 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] Lock "33d6832f-1d6a-4f64-9e1b-07078e7e84a5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:10:40 user nova-compute[75216]: DEBUG nova.objects.instance [None req-a0b24d7e-8f15-4be7-bb33-5fd4f45512a1 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] Lazy-loading 'flavor' on Instance uuid 33d6832f-1d6a-4f64-9e1b-07078e7e84a5 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:10:40 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a0b24d7e-8f15-4be7-bb33-5fd4f45512a1 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] Lock "33d6832f-1d6a-4f64-9e1b-07078e7e84a5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:10:40 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a0b24d7e-8f15-4be7-bb33-5fd4f45512a1 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] Acquiring lock "33d6832f-1d6a-4f64-9e1b-07078e7e84a5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:10:40 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a0b24d7e-8f15-4be7-bb33-5fd4f45512a1 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] Lock "33d6832f-1d6a-4f64-9e1b-07078e7e84a5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:10:40 user nova-compute[75216]: INFO nova.compute.manager [None req-a0b24d7e-8f15-4be7-bb33-5fd4f45512a1 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] [instance: 33d6832f-1d6a-4f64-9e1b-07078e7e84a5] Attaching volume cc97625d-4cbe-4c94-ab68-7f836fa5f416 to /dev/vdb
Nov 13 19:10:40 user nova-compute[75216]: DEBUG os_brick.utils [None req-a0b24d7e-8f15-4be7-bb33-5fd4f45512a1 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 19:10:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:10:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.023s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:10:40 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[01f18a30-9ed5-4fac-8797-c6f21ab376ad]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aea6fcfe14b9\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:10:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:10:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:10:40 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[744f107f-ceb3-469a-822d-d7df3b3c645d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:10:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:10:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.040s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:10:40 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[46b85f32-f06a-48ed-9b31-72f6f10751ac]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:10:40 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee599120-99e8-43aa-8e7b-2946a0b44d64]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:10:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-a0b24d7e-8f15-4be7-bb33-5fd4f45512a1 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] Running cmd (subprocess): nvme version {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:10:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-a0b24d7e-8f15-4be7-bb33-5fd4f45512a1 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] 'nvme version' failed. Not Retrying. {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 19:10:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-5853db78-6679-4a1c-acb4-b97c4f2e85bf tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 -F raw /opt/stack/data/nova/instances/fc2b6a17-b3bf-42da-ad68-2f125c952a31/disk" returned: 0 in 2.177s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:10:40 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a0b24d7e-8f15-4be7-bb33-5fd4f45512a1 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] nvme not present on system {{(pid=75216) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 19:10:40 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-5853db78-6679-4a1c-acb4-b97c4f2e85bf tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] [instance: fc2b6a17-b3bf-42da-ad68-2f125c952a31] Created local disks {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 19:10:40 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-5853db78-6679-4a1c-acb4-b97c4f2e85bf tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] [instance: fc2b6a17-b3bf-42da-ad68-2f125c952a31] Ensure instance console log exists: /opt/stack/data/nova/instances/fc2b6a17-b3bf-42da-ad68-2f125c952a31/console.log {{(pid=75216) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 19:10:40 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-5853db78-6679-4a1c-acb4-b97c4f2e85bf tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:10:40 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-5853db78-6679-4a1c-acb4-b97c4f2e85bf tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:10:40 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-5853db78-6679-4a1c-acb4-b97c4f2e85bf tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:10:40 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-5853db78-6679-4a1c-acb4-b97c4f2e85bf tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] [instance: fc2b6a17-b3bf-42da-ad68-2f125c952a31] Start _get_guest_xml network_info=[{"id": "4621e43a-a523-4506-8520-bcca759faa35", "address": "fa:16:3e:58:6e:5f", "network": {"id": "8cbeb1cc-a067-4c8d-82d8-0dc5c2ac924c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-742672345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a58d1e76a793406bbdd3821ff74abd92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4621e43a-a5", "ovs_interfaceid": "4621e43a-a523-4506-8520-bcca759faa35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='8a64ed616930c4bf4432278440780d38',container_format='bare',created_at=2023-11-13T19:08:41Z,direct_url=<?>,disk_format='qcow2',id=20909060-0bdd-4e57-a052-325c7f65d799,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1100425294-shelved',owner='a58d1e76a793406bbdd3821ff74abd92',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-13T19:08:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'guest_format': None, 'boot_index': 0, 'image_id': '77bcb5ba-8510-41ec-a88d-96097bb431de'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 19:10:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:10:40 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 19:10:40 user nova-compute[75216]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 19:10:40 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[8abba772-bb28-4943-8d6d-065a958e810c]: (4, '') {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:10:40 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-a0b24d7e-8f15-4be7-bb33-5fd4f45512a1 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75216) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 19:10:40 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-a0b24d7e-8f15-4be7-bb33-5fd4f45512a1 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 19:10:40 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-a0b24d7e-8f15-4be7-bb33-5fd4f45512a1 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] LIGHTOS: no hostnqn found. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 19:10:40 user nova-compute[75216]: DEBUG os_brick.utils [None req-a0b24d7e-8f15-4be7-bb33-5fd4f45512a1 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] <== get_connector_properties: return (156ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aea6fcfe14b9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 19:10:40 user nova-compute[75216]: DEBUG nova.virt.block_device [None req-a0b24d7e-8f15-4be7-bb33-5fd4f45512a1 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] [instance: 33d6832f-1d6a-4f64-9e1b-07078e7e84a5] Updating existing volume attachment record: 96084f23-247e-4368-8541-f0c99a33eb71 {{(pid=75216) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 19:10:40 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-5853db78-6679-4a1c-acb4-b97c4f2e85bf tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 19:10:40 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-5853db78-6679-4a1c-acb4-b97c4f2e85bf tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 19:10:40 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-5853db78-6679-4a1c-acb4-b97c4f2e85bf tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 19:10:40 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-5853db78-6679-4a1c-acb4-b97c4f2e85bf tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] CPU controller missing on host. {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 19:10:40 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-5853db78-6679-4a1c-acb4-b97c4f2e85bf tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 19:10:40 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-5853db78-6679-4a1c-acb4-b97c4f2e85bf tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] CPU controller found on host. {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 19:10:40 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-5853db78-6679-4a1c-acb4-b97c4f2e85bf tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75216) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 19:10:40 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-5853db78-6679-4a1c-acb4-b97c4f2e85bf tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T18:40:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='8a64ed616930c4bf4432278440780d38',container_format='bare',created_at=2023-11-13T19:08:41Z,direct_url=<?>,disk_format='qcow2',id=20909060-0bdd-4e57-a052-325c7f65d799,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1100425294-shelved',owner='a58d1e76a793406bbdd3821ff74abd92',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-13T19:08:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 19:10:40 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-5853db78-6679-4a1c-acb4-b97c4f2e85bf tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Flavor limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 19:10:40 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-5853db78-6679-4a1c-acb4-b97c4f2e85bf tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Image limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 19:10:40 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-5853db78-6679-4a1c-acb4-b97c4f2e85bf tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Flavor pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 19:10:40 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-5853db78-6679-4a1c-acb4-b97c4f2e85bf tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Image pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 19:10:40 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-5853db78-6679-4a1c-acb4-b97c4f2e85bf tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 19:10:40 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-5853db78-6679-4a1c-acb4-b97c4f2e85bf tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 19:10:40 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-5853db78-6679-4a1c-acb4-b97c4f2e85bf tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 19:10:40 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-5853db78-6679-4a1c-acb4-b97c4f2e85bf tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Got 1 possible topologies {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 19:10:40 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-5853db78-6679-4a1c-acb4-b97c4f2e85bf tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 19:10:40 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-5853db78-6679-4a1c-acb4-b97c4f2e85bf tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 19:10:40 user nova-compute[75216]: DEBUG nova.objects.instance [None req-5853db78-6679-4a1c-acb4-b97c4f2e85bf tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Lazy-loading 'vcpu_model' on Instance uuid fc2b6a17-b3bf-42da-ad68-2f125c952a31 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:10:40 user nova-compute[75216]: DEBUG nova.objects.base [None req-5853db78-6679-4a1c-acb4-b97c4f2e85bf tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Object Instance<fc2b6a17-b3bf-42da-ad68-2f125c952a31> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=75216) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 19:10:40 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-5853db78-6679-4a1c-acb4-b97c4f2e85bf tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-13T19:06:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1100425294',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1100425294',id=34,image_ref='20909060-0bdd-4e57-a052-325c7f65d799',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-569881079',keypairs=<?>,launch_index=0,launched_at=2023-11-13T19:06:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='a58d1e76a793406bbdd3821ff74abd92',ramdisk_id='',reservation_id='r-ie2w7xdd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1861834155',owner_user_name='tempest-AttachVolumeShelveTestJSON-1861834155-project-member',shelved_at='2023-11-13T19:08:45.947141',shelved_host='user',shelved_image_id='20909060-0bdd-4e57-a052-325c7f65d799'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T19:10:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e59bd525db64698b8e3587734cde6b8',uuid=fc2b6a17-b3bf-42da-ad68-2f125c952a31,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "4621e43a-a523-4506-8520-bcca759faa35", "address": "fa:16:3e:58:6e:5f", "network": {"id": "8cbeb1cc-a067-4c8d-82d8-0dc5c2ac924c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-742672345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a58d1e76a793406bbdd3821ff74abd92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4621e43a-a5", "ovs_interfaceid": "4621e43a-a523-4506-8520-bcca759faa35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75216) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 19:10:40 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-5853db78-6679-4a1c-acb4-b97c4f2e85bf tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Converting VIF {"id": "4621e43a-a523-4506-8520-bcca759faa35", "address": "fa:16:3e:58:6e:5f", "network": {"id": "8cbeb1cc-a067-4c8d-82d8-0dc5c2ac924c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-742672345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a58d1e76a793406bbdd3821ff74abd92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4621e43a-a5", "ovs_interfaceid": "4621e43a-a523-4506-8520-bcca759faa35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 19:10:40 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-5853db78-6679-4a1c-acb4-b97c4f2e85bf tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:6e:5f,bridge_name='br-int',has_traffic_filtering=True,id=4621e43a-a523-4506-8520-bcca759faa35,network=Network(8cbeb1cc-a067-4c8d-82d8-0dc5c2ac924c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4621e43a-a5') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 19:10:40 user nova-compute[75216]: DEBUG nova.objects.instance [None req-5853db78-6679-4a1c-acb4-b97c4f2e85bf tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Lazy-loading 'pci_devices' on Instance uuid fc2b6a17-b3bf-42da-ad68-2f125c952a31 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:10:40 user nova-compute[75216]: DEBUG nova.objects.base [None req-5853db78-6679-4a1c-acb4-b97c4f2e85bf tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Object Instance<fc2b6a17-b3bf-42da-ad68-2f125c952a31> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=75216) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 19:10:40 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-5853db78-6679-4a1c-acb4-b97c4f2e85bf tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] [instance: fc2b6a17-b3bf-42da-ad68-2f125c952a31] End _get_guest_xml xml=<domain type="kvm">
Nov 13 19:10:40 user nova-compute[75216]:   <uuid>fc2b6a17-b3bf-42da-ad68-2f125c952a31</uuid>
Nov 13 19:10:40 user nova-compute[75216]:   <name>instance-00000022</name>
Nov 13 19:10:40 user nova-compute[75216]:   <memory>524288</memory>
Nov 13 19:10:40 user nova-compute[75216]:   <vcpu>1</vcpu>
Nov 13 19:10:40 user nova-compute[75216]:   <metadata>
Nov 13 19:10:40 user nova-compute[75216]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 19:10:40 user nova-compute[75216]:       <nova:package version="0.0.0"/>
Nov 13 19:10:40 user nova-compute[75216]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1100425294</nova:name>
Nov 13 19:10:40 user nova-compute[75216]:       <nova:creationTime>2023-11-13 19:10:40</nova:creationTime>
Nov 13 19:10:40 user nova-compute[75216]:       <nova:flavor name="m1.tiny">
Nov 13 19:10:40 user nova-compute[75216]:         <nova:memory>512</nova:memory>
Nov 13 19:10:40 user nova-compute[75216]:         <nova:disk>1</nova:disk>
Nov 13 19:10:40 user nova-compute[75216]:         <nova:swap>0</nova:swap>
Nov 13 19:10:40 user nova-compute[75216]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 19:10:40 user nova-compute[75216]:         <nova:vcpus>1</nova:vcpus>
Nov 13 19:10:40 user nova-compute[75216]:       </nova:flavor>
Nov 13 19:10:40 user nova-compute[75216]:       <nova:owner>
Nov 13 19:10:40 user nova-compute[75216]:         <nova:user uuid="7e59bd525db64698b8e3587734cde6b8">tempest-AttachVolumeShelveTestJSON-1861834155-project-member</nova:user>
Nov 13 19:10:40 user nova-compute[75216]:         <nova:project uuid="a58d1e76a793406bbdd3821ff74abd92">tempest-AttachVolumeShelveTestJSON-1861834155</nova:project>
Nov 13 19:10:40 user nova-compute[75216]:       </nova:owner>
Nov 13 19:10:40 user nova-compute[75216]:       <nova:root type="image" uuid="20909060-0bdd-4e57-a052-325c7f65d799"/>
Nov 13 19:10:40 user nova-compute[75216]:       <nova:ports>
Nov 13 19:10:40 user nova-compute[75216]:         <nova:port uuid="4621e43a-a523-4506-8520-bcca759faa35">
Nov 13 19:10:40 user nova-compute[75216]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 13 19:10:40 user nova-compute[75216]:         </nova:port>
Nov 13 19:10:40 user nova-compute[75216]:       </nova:ports>
Nov 13 19:10:40 user nova-compute[75216]:     </nova:instance>
Nov 13 19:10:40 user nova-compute[75216]:   </metadata>
Nov 13 19:10:40 user nova-compute[75216]:   <sysinfo type="smbios">
Nov 13 19:10:40 user nova-compute[75216]:     <system>
Nov 13 19:10:40 user nova-compute[75216]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 19:10:40 user nova-compute[75216]:       <entry name="product">OpenStack Nova</entry>
Nov 13 19:10:40 user nova-compute[75216]:       <entry name="version">0.0.0</entry>
Nov 13 19:10:40 user nova-compute[75216]:       <entry name="serial">fc2b6a17-b3bf-42da-ad68-2f125c952a31</entry>
Nov 13 19:10:40 user nova-compute[75216]:       <entry name="uuid">fc2b6a17-b3bf-42da-ad68-2f125c952a31</entry>
Nov 13 19:10:40 user nova-compute[75216]:       <entry name="family">Virtual Machine</entry>
Nov 13 19:10:40 user nova-compute[75216]:     </system>
Nov 13 19:10:40 user nova-compute[75216]:   </sysinfo>
Nov 13 19:10:40 user nova-compute[75216]:   <os>
Nov 13 19:10:40 user nova-compute[75216]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 19:10:40 user nova-compute[75216]:     <boot dev="hd"/>
Nov 13 19:10:40 user nova-compute[75216]:     <smbios mode="sysinfo"/>
Nov 13 19:10:40 user nova-compute[75216]:   </os>
Nov 13 19:10:40 user nova-compute[75216]:   <features>
Nov 13 19:10:40 user nova-compute[75216]:     <acpi/>
Nov 13 19:10:40 user nova-compute[75216]:     <apic/>
Nov 13 19:10:40 user nova-compute[75216]:     <vmcoreinfo/>
Nov 13 19:10:40 user nova-compute[75216]:   </features>
Nov 13 19:10:40 user nova-compute[75216]:   <clock offset="utc">
Nov 13 19:10:40 user nova-compute[75216]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 19:10:40 user nova-compute[75216]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 19:10:40 user nova-compute[75216]:     <timer name="hpet" present="no"/>
Nov 13 19:10:40 user nova-compute[75216]:   </clock>
Nov 13 19:10:40 user nova-compute[75216]:   <cpu mode="custom" match="exact">
Nov 13 19:10:40 user nova-compute[75216]:     <model>Nehalem</model>
Nov 13 19:10:40 user nova-compute[75216]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 19:10:40 user nova-compute[75216]:   </cpu>
Nov 13 19:10:40 user nova-compute[75216]:   <devices>
Nov 13 19:10:40 user nova-compute[75216]:     <disk type="file" device="disk">
Nov 13 19:10:40 user nova-compute[75216]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 19:10:40 user nova-compute[75216]:       <source file="/opt/stack/data/nova/instances/fc2b6a17-b3bf-42da-ad68-2f125c952a31/disk"/>
Nov 13 19:10:40 user nova-compute[75216]:       <target dev="vda" bus="virtio"/>
Nov 13 19:10:40 user nova-compute[75216]:     </disk>
Nov 13 19:10:40 user nova-compute[75216]:     <interface type="ethernet">
Nov 13 19:10:40 user nova-compute[75216]:       <mac address="fa:16:3e:58:6e:5f"/>
Nov 13 19:10:40 user nova-compute[75216]:       <model type="virtio"/>
Nov 13 19:10:40 user nova-compute[75216]:       <mtu size="1442"/>
Nov 13 19:10:40 user nova-compute[75216]:       <target dev="tap4621e43a-a5"/>
Nov 13 19:10:40 user nova-compute[75216]:     </interface>
Nov 13 19:10:40 user nova-compute[75216]:     <serial type="pty">
Nov 13 19:10:40 user nova-compute[75216]:       <log file="/opt/stack/data/nova/instances/fc2b6a17-b3bf-42da-ad68-2f125c952a31/console.log" append="off"/>
Nov 13 19:10:40 user nova-compute[75216]:     </serial>
Nov 13 19:10:40 user nova-compute[75216]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 19:10:40 user nova-compute[75216]:     <video>
Nov 13 19:10:40 user nova-compute[75216]:       <model type="virtio"/>
Nov 13 19:10:40 user nova-compute[75216]:     </video>
Nov 13 19:10:40 user nova-compute[75216]:     <rng model="virtio">
Nov 13 19:10:40 user nova-compute[75216]:       <backend model="random">/dev/urandom</backend>
Nov 13 19:10:40 user nova-compute[75216]:     </rng>
Nov 13 19:10:40 user nova-compute[75216]:     <controller type="usb" index="0" model="none"/>
Nov 13 19:10:40 user nova-compute[75216]:     <memballoon model="virtio">
Nov 13 19:10:40 user nova-compute[75216]:       <stats period="10"/>
Nov 13 19:10:40 user nova-compute[75216]:     </memballoon>
Nov 13 19:10:40 user nova-compute[75216]:   </devices>
Nov 13 19:10:40 user nova-compute[75216]: </domain>
Nov 13 19:10:40 user nova-compute[75216]:  {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 19:10:40 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-5853db78-6679-4a1c-acb4-b97c4f2e85bf tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-13T19:06:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1100425294',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1100425294',id=34,image_ref='20909060-0bdd-4e57-a052-325c7f65d799',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-569881079',keypairs=<?>,launch_index=0,launched_at=2023-11-13T19:06:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='a58d1e76a793406bbdd3821ff74abd92',ramdisk_id='',reservation_id='r-ie2w7xdd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1861834155',owner_user_name='tempest-AttachVolumeShelveTestJSON-1861834155-project-member',shelved_at='2023-11-13T19:08:45.947141',shelved_host='user',shelved_image_id='20909060-0bdd-4e57-a052-325c7f65d799'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T19:10:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e59bd525db64698b8e3587734cde6b8',uuid=fc2b6a17-b3bf-42da-ad68-2f125c952a31,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "4621e43a-a523-4506-8520-bcca759faa35", "address": "fa:16:3e:58:6e:5f", "network": {"id": "8cbeb1cc-a067-4c8d-82d8-0dc5c2ac924c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-742672345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a58d1e76a793406bbdd3821ff74abd92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4621e43a-a5", "ovs_interfaceid": "4621e43a-a523-4506-8520-bcca759faa35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 19:10:40 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-5853db78-6679-4a1c-acb4-b97c4f2e85bf tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Converting VIF {"id": "4621e43a-a523-4506-8520-bcca759faa35", "address": "fa:16:3e:58:6e:5f", "network": {"id": "8cbeb1cc-a067-4c8d-82d8-0dc5c2ac924c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-742672345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a58d1e76a793406bbdd3821ff74abd92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4621e43a-a5", "ovs_interfaceid": "4621e43a-a523-4506-8520-bcca759faa35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 19:10:40 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-5853db78-6679-4a1c-acb4-b97c4f2e85bf tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:6e:5f,bridge_name='br-int',has_traffic_filtering=True,id=4621e43a-a523-4506-8520-bcca759faa35,network=Network(8cbeb1cc-a067-4c8d-82d8-0dc5c2ac924c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4621e43a-a5') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 19:10:40 user nova-compute[75216]: DEBUG os_vif [None req-5853db78-6679-4a1c-acb4-b97c4f2e85bf tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:6e:5f,bridge_name='br-int',has_traffic_filtering=True,id=4621e43a-a523-4506-8520-bcca759faa35,network=Network(8cbeb1cc-a067-4c8d-82d8-0dc5c2ac924c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4621e43a-a5') {{(pid=75216) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 19:10:40 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:10:40 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:10:40 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 19:10:40 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:10:40 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ee114007-50e8-54f5-9905-a7d2a6373cd4', '_type': 'linux-noop'}}, row=False) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:10:40 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:10:40 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:10:40 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:10:40 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4621e43a-a5, may_exist=True, interface_attrs={}) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:10:40 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4621e43a-a5, col_values=(('qos', UUID('612b7580-86ce-41f3-a6e4-3219d1639db5')),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:10:40 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4621e43a-a5, col_values=(('external_ids', {'iface-id': '4621e43a-a523-4506-8520-bcca759faa35', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:58:6e:5f', 'vm-uuid': 'fc2b6a17-b3bf-42da-ad68-2f125c952a31'}),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:10:40 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:10:40 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:10:40 user nova-compute[75216]: INFO os_vif [None req-5853db78-6679-4a1c-acb4-b97c4f2e85bf tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:6e:5f,bridge_name='br-int',has_traffic_filtering=True,id=4621e43a-a523-4506-8520-bcca759faa35,network=Network(8cbeb1cc-a067-4c8d-82d8-0dc5c2ac924c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4621e43a-a5')
Nov 13 19:10:40 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-5853db78-6679-4a1c-acb4-b97c4f2e85bf tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 19:10:40 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-5853db78-6679-4a1c-acb4-b97c4f2e85bf tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] No VIF found with MAC fa:16:3e:58:6e:5f, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 19:10:42 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:10:42 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:10:42 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:10:42 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:10:42 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:10:42 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:10:42 user nova-compute[75216]: DEBUG nova.compute.manager [req-0e1cecb2-990a-4ef9-9ce5-cbe4623efaa6 req-1d0e2c04-f20c-418e-97f0-f78f5180bf35 service nova] [instance: fc2b6a17-b3bf-42da-ad68-2f125c952a31] Received event network-vif-plugged-4621e43a-a523-4506-8520-bcca759faa35 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:10:42 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-0e1cecb2-990a-4ef9-9ce5-cbe4623efaa6 req-1d0e2c04-f20c-418e-97f0-f78f5180bf35 service nova] Acquiring lock "fc2b6a17-b3bf-42da-ad68-2f125c952a31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:10:42 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-0e1cecb2-990a-4ef9-9ce5-cbe4623efaa6 req-1d0e2c04-f20c-418e-97f0-f78f5180bf35 service nova] Lock "fc2b6a17-b3bf-42da-ad68-2f125c952a31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:10:42 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-0e1cecb2-990a-4ef9-9ce5-cbe4623efaa6 req-1d0e2c04-f20c-418e-97f0-f78f5180bf35 service nova] Lock "fc2b6a17-b3bf-42da-ad68-2f125c952a31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:10:42 user nova-compute[75216]: DEBUG nova.compute.manager [req-0e1cecb2-990a-4ef9-9ce5-cbe4623efaa6 req-1d0e2c04-f20c-418e-97f0-f78f5180bf35 service nova] [instance: fc2b6a17-b3bf-42da-ad68-2f125c952a31] No waiting events found dispatching network-vif-plugged-4621e43a-a523-4506-8520-bcca759faa35 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 19:10:42 user nova-compute[75216]: WARNING nova.compute.manager [req-0e1cecb2-990a-4ef9-9ce5-cbe4623efaa6 req-1d0e2c04-f20c-418e-97f0-f78f5180bf35 service nova] [instance: fc2b6a17-b3bf-42da-ad68-2f125c952a31] Received unexpected event network-vif-plugged-4621e43a-a523-4506-8520-bcca759faa35 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 13 19:10:44 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:10:44 user nova-compute[75216]: DEBUG nova.compute.manager [None req-5853db78-6679-4a1c-acb4-b97c4f2e85bf tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] [instance: fc2b6a17-b3bf-42da-ad68-2f125c952a31] Instance event wait completed in 0 seconds for  {{(pid=75216) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 19:10:44 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-5853db78-6679-4a1c-acb4-b97c4f2e85bf tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] [instance: fc2b6a17-b3bf-42da-ad68-2f125c952a31] Guest created on hypervisor {{(pid=75216) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 19:10:44 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: fc2b6a17-b3bf-42da-ad68-2f125c952a31] Instance spawned successfully.
Nov 13 19:10:44 user nova-compute[75216]: DEBUG nova.compute.manager [None req-5853db78-6679-4a1c-acb4-b97c4f2e85bf tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] [instance: fc2b6a17-b3bf-42da-ad68-2f125c952a31] Checking state {{(pid=75216) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 19:10:44 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-5853db78-6679-4a1c-acb4-b97c4f2e85bf tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Lock "fc2b6a17-b3bf-42da-ad68-2f125c952a31" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 11.230s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:10:44 user nova-compute[75216]: DEBUG nova.compute.manager [req-cc2e4442-f12f-4051-909a-b17f330dd670 req-36af8788-85f2-4043-afb0-cfdb0a680fdc service nova] [instance: fc2b6a17-b3bf-42da-ad68-2f125c952a31] Received event network-vif-plugged-4621e43a-a523-4506-8520-bcca759faa35 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:10:44 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-cc2e4442-f12f-4051-909a-b17f330dd670 req-36af8788-85f2-4043-afb0-cfdb0a680fdc service nova] Acquiring lock "fc2b6a17-b3bf-42da-ad68-2f125c952a31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:10:44 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-cc2e4442-f12f-4051-909a-b17f330dd670 req-36af8788-85f2-4043-afb0-cfdb0a680fdc service nova] Lock "fc2b6a17-b3bf-42da-ad68-2f125c952a31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:10:44 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-cc2e4442-f12f-4051-909a-b17f330dd670 req-36af8788-85f2-4043-afb0-cfdb0a680fdc service nova] Lock "fc2b6a17-b3bf-42da-ad68-2f125c952a31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:10:44 user nova-compute[75216]: DEBUG nova.compute.manager [req-cc2e4442-f12f-4051-909a-b17f330dd670 req-36af8788-85f2-4043-afb0-cfdb0a680fdc service nova] [instance: fc2b6a17-b3bf-42da-ad68-2f125c952a31] No waiting events found dispatching network-vif-plugged-4621e43a-a523-4506-8520-bcca759faa35 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 19:10:44 user nova-compute[75216]: WARNING nova.compute.manager [req-cc2e4442-f12f-4051-909a-b17f330dd670 req-36af8788-85f2-4043-afb0-cfdb0a680fdc service nova] [instance: fc2b6a17-b3bf-42da-ad68-2f125c952a31] Received unexpected event network-vif-plugged-4621e43a-a523-4506-8520-bcca759faa35 for instance with vm_state active and task_state None.
Nov 13 19:10:44 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a0b24d7e-8f15-4be7-bb33-5fd4f45512a1 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] [instance: 33d6832f-1d6a-4f64-9e1b-07078e7e84a5] Calling os-brick to attach iSCSI Volume {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 19:10:44 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0b24d7e-8f15-4be7-bb33-5fd4f45512a1 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3a8669e40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cc97625d-4cbe-4c94-ab68-7f836fa5f416', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WGRiIXOb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 19:10:44 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-a0b24d7e-8f15-4be7-bb33-5fd4f45512a1 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 19:10:44 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-a0b24d7e-8f15-4be7-bb33-5fd4f45512a1 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 19:10:45 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-a0b24d7e-8f15-4be7-bb33-5fd4f45512a1 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 19:10:45 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-a0b24d7e-8f15-4be7-bb33-5fd4f45512a1 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 19:10:45 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-a0b24d7e-8f15-4be7-bb33-5fd4f45512a1 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cc97625d-4cbe-4c94-ab68-7f836fa5f416" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 19:10:45 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-a0b24d7e-8f15-4be7-bb33-5fd4f45512a1 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cc97625d-4cbe-4c94-ab68-7f836fa5f416" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 19:10:45 user nova-compute[75216]: INFO os_brick.initiator.connectors.iscsi [None req-a0b24d7e-8f15-4be7-bb33-5fd4f45512a1 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 19:10:45 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc97625d-4cbe-4c94-ab68-7f836fa5f416 -p 172.16.0.220:3260 {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:10:45 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc97625d-4cbe-4c94-ab68-7f836fa5f416 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:10:45 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcc9ffed-b0e5-44d8-8323-6871c2803c63]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:10:45 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0b24d7e-8f15-4be7-bb33-5fd4f45512a1 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 19:10:45 user nova-compute[75216]:  {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:10:45 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc97625d-4cbe-4c94-ab68-7f836fa5f416 -p 172.16.0.220:3260 --interface default --op new {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:10:45 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc97625d-4cbe-4c94-ab68-7f836fa5f416 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:10:45 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[00d0705c-a660-464d-b99c-817276058b21]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cc97625d-4cbe-4c94-ab68-7f836fa5f416] added\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:10:45 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0b24d7e-8f15-4be7-bb33-5fd4f45512a1 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cc97625d-4cbe-4c94-ab68-7f836fa5f416] added
Nov 13 19:10:45 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:10:45 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc97625d-4cbe-4c94-ab68-7f836fa5f416 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:10:45 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc97625d-4cbe-4c94-ab68-7f836fa5f416 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:10:45 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[0447fbbe-18e8-414a-b42d-4969ec35f70b]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:10:45 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0b24d7e-8f15-4be7-bb33-5fd4f45512a1 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:10:45 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc97625d-4cbe-4c94-ab68-7f836fa5f416 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:10:45 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc97625d-4cbe-4c94-ab68-7f836fa5f416 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:10:45 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[259bd211-6c4a-4019-9462-f530b034905b]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:10:45 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0b24d7e-8f15-4be7-bb33-5fd4f45512a1 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:10:45 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc97625d-4cbe-4c94-ab68-7f836fa5f416 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WGRiIXOb {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:10:45 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc97625d-4cbe-4c94-ab68-7f836fa5f416 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WGRiIXOb" returned: 0 in 0.024s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:10:45 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[11b32f5d-1c94-4fad-bbe6-da6bb26ebeec]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:10:45 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0b24d7e-8f15-4be7-bb33-5fd4f45512a1 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WGRiIXOb'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:10:45 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc97625d-4cbe-4c94-ab68-7f836fa5f416 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:10:45 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc97625d-4cbe-4c94-ab68-7f836fa5f416 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:10:45 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[53ad93bb-1e6d-47de-be6f-6f9857d6d1ae]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:10:45 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0b24d7e-8f15-4be7-bb33-5fd4f45512a1 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:10:45 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:10:45 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:10:45 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a04bcb1-2533-4ba0-beb0-f1a9ba681aa9]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1 (non-flash)\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:10:45 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0b24d7e-8f15-4be7-bb33-5fd4f45512a1 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1 (non-flash)
Nov 13 19:10:45 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 19:10:45 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0b24d7e-8f15-4be7-bb33-5fd4f45512a1 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1 (non-flash)
Nov 13 19:10:45 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 19:10:45 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc97625d-4cbe-4c94-ab68-7f836fa5f416 -p 172.16.0.220:3260 --login {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:10:45 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc97625d-4cbe-4c94-ab68-7f836fa5f416 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:10:45 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5dee6bf-8d0c-482b-bf33-78b000cec19e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cc97625d-4cbe-4c94-ab68-7f836fa5f416, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cc97625d-4cbe-4c94-ab68-7f836fa5f416, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:10:45 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0b24d7e-8f15-4be7-bb33-5fd4f45512a1 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cc97625d-4cbe-4c94-ab68-7f836fa5f416, portal: 172.16.0.220,3260]
Nov 13 19:10:45 user nova-compute[75216]: Login to [iface: default, target: iqn.2010-10.org.openstack:cc97625d-4cbe-4c94-ab68-7f836fa5f416, portal: 172.16.0.220,3260] successful.
Nov 13 19:10:45 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:10:45 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc97625d-4cbe-4c94-ab68-7f836fa5f416 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:10:45 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc97625d-4cbe-4c94-ab68-7f836fa5f416 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:10:45 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[719d4cb9-a1d3-4bc1-a942-a501e84ee3b9]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:10:45 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0b24d7e-8f15-4be7-bb33-5fd4f45512a1 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:10:45 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:10:45 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:10:45 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[98c74b2d-7253-431f-9d24-870aaedf50a8]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc97625d-4cbe-4c94-ab68-7f836fa5f416 (non-flash)\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:10:45 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0b24d7e-8f15-4be7-bb33-5fd4f45512a1 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1 (non-flash)
Nov 13 19:10:45 user nova-compute[75216]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc97625d-4cbe-4c94-ab68-7f836fa5f416 (non-flash)
Nov 13 19:10:45 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 19:10:45 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0b24d7e-8f15-4be7-bb33-5fd4f45512a1 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1 (non-flash)
Nov 13 19:10:45 user nova-compute[75216]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc97625d-4cbe-4c94-ab68-7f836fa5f416 (non-flash)
Nov 13 19:10:45 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 19:10:45 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-a0b24d7e-8f15-4be7-bb33-5fd4f45512a1 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cc97625d-4cbe-4c94-ab68-7f836fa5f416" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.268s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 19:10:45 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0b24d7e-8f15-4be7-bb33-5fd4f45512a1 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] Connected to 172.16.0.220:3260 {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 19:10:45 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-a0b24d7e-8f15-4be7-bb33-5fd4f45512a1 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] HCTL ('34', '-', '-', 0) found on session 42 with lun 0 {{(pid=75216) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 19:10:45 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-a0b24d7e-8f15-4be7-bb33-5fd4f45512a1 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75216) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 19:10:45 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:10:45 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:10:45 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6d2ffd9-70ac-4d64-a60c-35b35e2e595f]: (4, ('- - 0', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:10:45 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-a0b24d7e-8f15-4be7-bb33-5fd4f45512a1 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] Searching for a device in session 42 and hctl ['34', '*', '*', 0] yield: None {{(pid=75216) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 19:10:45 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:10:46 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-a0b24d7e-8f15-4be7-bb33-5fd4f45512a1 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] Searching for a device in session 42 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75216) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 19:10:46 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0b24d7e-8f15-4be7-bb33-5fd4f45512a1 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:cc97625d-4cbe-4c94-ab68-7f836fa5f416', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WGRiIXOb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 19:10:46 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-a0b24d7e-8f15-4be7-bb33-5fd4f45512a1 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.297s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 19:10:46 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0b24d7e-8f15-4be7-bb33-5fd4f45512a1 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] <== connect_volume: return (1298ms) {'type': 'block', 'scsi_wwn': '23330666433613031', 'path': '/dev/sdc'} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 19:10:46 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a0b24d7e-8f15-4be7-bb33-5fd4f45512a1 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] [instance: 33d6832f-1d6a-4f64-9e1b-07078e7e84a5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23330666433613031', 'path': '/dev/sdc'} {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 19:10:46 user nova-compute[75216]: DEBUG nova.objects.instance [None req-a0b24d7e-8f15-4be7-bb33-5fd4f45512a1 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] Lazy-loading 'flavor' on Instance uuid 33d6832f-1d6a-4f64-9e1b-07078e7e84a5 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:10:46 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-a0b24d7e-8f15-4be7-bb33-5fd4f45512a1 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] attach device xml: <disk type="block" device="disk">
Nov 13 19:10:46 user nova-compute[75216]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 19:10:46 user nova-compute[75216]:   <source dev="/dev/sdc"/>
Nov 13 19:10:46 user nova-compute[75216]:   <target dev="vdb" bus="virtio"/>
Nov 13 19:10:46 user nova-compute[75216]:   <serial>cc97625d-4cbe-4c94-ab68-7f836fa5f416</serial>
Nov 13 19:10:46 user nova-compute[75216]: </disk>
Nov 13 19:10:46 user nova-compute[75216]:  {{(pid=75216) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 13 19:10:46 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-a0b24d7e-8f15-4be7-bb33-5fd4f45512a1 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 19:10:46 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-a0b24d7e-8f15-4be7-bb33-5fd4f45512a1 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 19:10:46 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-a0b24d7e-8f15-4be7-bb33-5fd4f45512a1 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] No VIF found with MAC fa:16:3e:5b:07:f6, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 19:10:46 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a0b24d7e-8f15-4be7-bb33-5fd4f45512a1 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] Lock "33d6832f-1d6a-4f64-9e1b-07078e7e84a5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.386s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:10:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-2355ba41-98ca-4f64-a8cc-cf176b055432 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] Acquiring lock "33d6832f-1d6a-4f64-9e1b-07078e7e84a5" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:10:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-2355ba41-98ca-4f64-a8cc-cf176b055432 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] Lock "33d6832f-1d6a-4f64-9e1b-07078e7e84a5" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:10:48 user nova-compute[75216]: INFO nova.compute.manager [None req-2355ba41-98ca-4f64-a8cc-cf176b055432 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] [instance: 33d6832f-1d6a-4f64-9e1b-07078e7e84a5] Detaching volume cc97625d-4cbe-4c94-ab68-7f836fa5f416
Nov 13 19:10:48 user nova-compute[75216]: INFO nova.virt.block_device [None req-2355ba41-98ca-4f64-a8cc-cf176b055432 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] [instance: 33d6832f-1d6a-4f64-9e1b-07078e7e84a5] Attempting to driver detach volume cc97625d-4cbe-4c94-ab68-7f836fa5f416 from mountpoint /dev/vdb
Nov 13 19:10:48 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-2355ba41-98ca-4f64-a8cc-cf176b055432 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] Attempting to detach device vdb from instance 33d6832f-1d6a-4f64-9e1b-07078e7e84a5 from the persistent domain config. {{(pid=75216) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 13 19:10:48 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-2355ba41-98ca-4f64-a8cc-cf176b055432 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 19:10:48 user nova-compute[75216]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 19:10:48 user nova-compute[75216]:   <source dev="/dev/sdc"/>
Nov 13 19:10:48 user nova-compute[75216]:   <target dev="vdb" bus="virtio"/>
Nov 13 19:10:48 user nova-compute[75216]:   <serial>cc97625d-4cbe-4c94-ab68-7f836fa5f416</serial>
Nov 13 19:10:48 user nova-compute[75216]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 19:10:48 user nova-compute[75216]: </disk>
Nov 13 19:10:48 user nova-compute[75216]:  {{(pid=75216) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 19:10:48 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-2355ba41-98ca-4f64-a8cc-cf176b055432 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] Successfully detached device vdb from instance 33d6832f-1d6a-4f64-9e1b-07078e7e84a5 from the persistent domain config.
Nov 13 19:10:48 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-2355ba41-98ca-4f64-a8cc-cf176b055432 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 33d6832f-1d6a-4f64-9e1b-07078e7e84a5 from the live domain config. {{(pid=75216) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 13 19:10:48 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-2355ba41-98ca-4f64-a8cc-cf176b055432 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 19:10:48 user nova-compute[75216]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 19:10:48 user nova-compute[75216]:   <source dev="/dev/sdc"/>
Nov 13 19:10:48 user nova-compute[75216]:   <target dev="vdb" bus="virtio"/>
Nov 13 19:10:48 user nova-compute[75216]:   <serial>cc97625d-4cbe-4c94-ab68-7f836fa5f416</serial>
Nov 13 19:10:48 user nova-compute[75216]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 19:10:48 user nova-compute[75216]: </disk>
Nov 13 19:10:48 user nova-compute[75216]:  {{(pid=75216) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 19:10:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:10:49 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-2355ba41-98ca-4f64-a8cc-cf176b055432 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 33d6832f-1d6a-4f64-9e1b-07078e7e84a5 {{(pid=75216) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 13 19:10:50 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:10:54 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:10:55 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:10:57 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:10:57 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:10:58 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:10:59 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:11:00 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:11:01 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:11:01 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:11:01 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Triggering sync for uuid f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1 {{(pid=75216) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 13 19:11:01 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Triggering sync for uuid 1e5f1164-a15e-40cf-b7bc-5aeb404a1216 {{(pid=75216) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 13 19:11:01 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Triggering sync for uuid 7b752173-e573-426e-b9f1-bff92a4c2b55 {{(pid=75216) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 13 19:11:01 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Triggering sync for uuid 33d6832f-1d6a-4f64-9e1b-07078e7e84a5 {{(pid=75216) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 13 19:11:01 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Triggering sync for uuid fc2b6a17-b3bf-42da-ad68-2f125c952a31 {{(pid=75216) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 13 19:11:01 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:11:01 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:11:01 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "1e5f1164-a15e-40cf-b7bc-5aeb404a1216" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:11:01 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "1e5f1164-a15e-40cf-b7bc-5aeb404a1216" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:11:01 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "7b752173-e573-426e-b9f1-bff92a4c2b55" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:11:01 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "7b752173-e573-426e-b9f1-bff92a4c2b55" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:11:01 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "33d6832f-1d6a-4f64-9e1b-07078e7e84a5" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:11:01 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "fc2b6a17-b3bf-42da-ad68-2f125c952a31" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:11:01 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "fc2b6a17-b3bf-42da-ad68-2f125c952a31" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:11:02 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "1e5f1164-a15e-40cf-b7bc-5aeb404a1216" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.032s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:11:02 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "7b752173-e573-426e-b9f1-bff92a4c2b55" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.032s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:11:02 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.036s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:11:02 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "fc2b6a17-b3bf-42da-ad68-2f125c952a31" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.037s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:11:02 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:11:04 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:11:04 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:11:04 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:11:04 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:11:04 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75216) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 19:11:05 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:11:06 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:11:06 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:11:06 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:11:06 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:11:06 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Auditing locally available compute resources for user (node: user) {{(pid=75216) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 19:11:06 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 19:11:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc2b6a17-b3bf-42da-ad68-2f125c952a31/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:11:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc2b6a17-b3bf-42da-ad68-2f125c952a31/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:11:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc2b6a17-b3bf-42da-ad68-2f125c952a31/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:11:07 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc2b6a17-b3bf-42da-ad68-2f125c952a31/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:11:07 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b752173-e573-426e-b9f1-bff92a4c2b55/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:11:07 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b752173-e573-426e-b9f1-bff92a4c2b55/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:11:07 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b752173-e573-426e-b9f1-bff92a4c2b55/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:11:07 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b752173-e573-426e-b9f1-bff92a4c2b55/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:11:07 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:11:07 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:11:07 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:11:07 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:11:07 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33d6832f-1d6a-4f64-9e1b-07078e7e84a5/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:11:07 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33d6832f-1d6a-4f64-9e1b-07078e7e84a5/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:11:07 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33d6832f-1d6a-4f64-9e1b-07078e7e84a5/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:11:08 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33d6832f-1d6a-4f64-9e1b-07078e7e84a5/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:11:08 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 19:11:08 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 19:11:08 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Hypervisor/Node resource view: name=user free_ram=8451MB free_disk=25.219295501708984GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75216) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 19:11:08 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:11:08 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:11:08 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 19:11:08 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance 1e5f1164-a15e-40cf-b7bc-5aeb404a1216 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 19:11:08 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance 7b752173-e573-426e-b9f1-bff92a4c2b55 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 19:11:08 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance 33d6832f-1d6a-4f64-9e1b-07078e7e84a5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 19:11:08 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance fc2b6a17-b3bf-42da-ad68-2f125c952a31 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 19:11:08 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 19:11:08 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 19:11:08 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Refreshing inventories for resource provider d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 13 19:11:08 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Updating ProviderTree inventory for provider d927e00d-5a8b-43f7-ac04-6437958fac1f from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 13 19:11:08 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Updating inventory in ProviderTree for provider d927e00d-5a8b-43f7-ac04-6437958fac1f with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 13 19:11:08 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Refreshing aggregate associations for resource provider d927e00d-5a8b-43f7-ac04-6437958fac1f, aggregates: None {{(pid=75216) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 13 19:11:08 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Refreshing trait associations for resource provider d927e00d-5a8b-43f7-ac04-6437958fac1f, traits: COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_MMX {{(pid=75216) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 13 19:11:08 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 19:11:09 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 19:11:09 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Compute_service record updated for user:user {{(pid=75216) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 19:11:09 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.535s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:11:09 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:11:09 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-2355ba41-98ca-4f64-a8cc-cf176b055432 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 33d6832f-1d6a-4f64-9e1b-07078e7e84a5 is timed out.
Nov 13 19:11:09 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-2355ba41-98ca-4f64-a8cc-cf176b055432 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] Successfully detached device vdb from instance 33d6832f-1d6a-4f64-9e1b-07078e7e84a5 from the live domain config.
Nov 13 19:11:09 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2355ba41-98ca-4f64-a8cc-cf176b055432 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] [instance: 33d6832f-1d6a-4f64-9e1b-07078e7e84a5] calling os-brick to detach iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 19:11:09 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-2355ba41-98ca-4f64-a8cc-cf176b055432 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3a8669e40>, {'target_iqn': 'iqn.2010-10.org.openstack:cc97625d-4cbe-4c94-ab68-7f836fa5f416', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WGRiIXOb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 19:11:09 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-2355ba41-98ca-4f64-a8cc-cf176b055432 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 19:11:09 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-2355ba41-98ca-4f64-a8cc-cf176b055432 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 19:11:09 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-2355ba41-98ca-4f64-a8cc-cf176b055432 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 19:11:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:11:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:11:09 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[01f3c730-6178-4a51-9ffd-d80bb90b75cd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cc97625d-4cbe-4c94-ab68-7f836fa5f416\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:11:09 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-2355ba41-98ca-4f64-a8cc-cf176b055432 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 19:11:09 user nova-compute[75216]: No targets found.
Nov 13 19:11:09 user nova-compute[75216]: iSNS:
Nov 13 19:11:09 user nova-compute[75216]: No targets found.
Nov 13 19:11:09 user nova-compute[75216]: STATIC:
Nov 13 19:11:09 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:cc97625d-4cbe-4c94-ab68-7f836fa5f416
Nov 13 19:11:09 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 19:11:09 user nova-compute[75216]:                 Iface Name: default
Nov 13 19:11:09 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1
Nov 13 19:11:09 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 19:11:09 user nova-compute[75216]:                 Iface Name: default
Nov 13 19:11:09 user nova-compute[75216]: FIRMWARE:
Nov 13 19:11:09 user nova-compute[75216]: No targets found.
Nov 13 19:11:09 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 19:11:09 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-2355ba41-98ca-4f64-a8cc-cf176b055432 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 19:11:09 user nova-compute[75216]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 19:11:09 user nova-compute[75216]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75216) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 19:11:09 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-2355ba41-98ca-4f64-a8cc-cf176b055432 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cc97625d-4cbe-4c94-ab68-7f836fa5f416', 0)] {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 19:11:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:11:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:11:09 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[8892fe01-cb2f-4d0a-8df1-70f9fa493615]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc97625d-4cbe-4c94-ab68-7f836fa5f416\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:11:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:11:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:11:09 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[530ed260-d94a-4f70-a1a1-4f11bada2dc0]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc97625d-4cbe-4c94-ab68-7f836fa5f416 (non-flash)\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:11:09 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-2355ba41-98ca-4f64-a8cc-cf176b055432 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1 (non-flash)
Nov 13 19:11:09 user nova-compute[75216]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc97625d-4cbe-4c94-ab68-7f836fa5f416 (non-flash)
Nov 13 19:11:09 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 19:11:09 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-2355ba41-98ca-4f64-a8cc-cf176b055432 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1 (non-flash)
Nov 13 19:11:09 user nova-compute[75216]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc97625d-4cbe-4c94-ab68-7f836fa5f416 (non-flash)
Nov 13 19:11:09 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 19:11:09 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-2355ba41-98ca-4f64-a8cc-cf176b055432 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe3c8155120>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cc97625d-4cbe-4c94-ab68-7f836fa5f416'): ({'sdc'}, set())}) {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 19:11:09 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-2355ba41-98ca-4f64-a8cc-cf176b055432 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] Removing single pathed devices sdc {{(pid=75216) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 19:11:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:11:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:11:09 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca16b0e0-f32e-4eef-909b-0008a5ef92c7]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:11:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:11:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.017s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:11:09 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9c2edbc-0626-46f0-add1-0bb4803c97d6]: (4, ('ok\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:11:09 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-2355ba41-98ca-4f64-a8cc-cf176b055432 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] Flushing IO for device /dev/sdc {{(pid=75216) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 19:11:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:11:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:11:09 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[622ccd51-5c5f-437a-93b8-24e75db423fe]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:11:09 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-2355ba41-98ca-4f64-a8cc-cf176b055432 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75216) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 19:11:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:11:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:11:09 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a6424a5-a92e-4125-b18e-fec0643d70e0]: (4, ('1', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:11:09 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-2355ba41-98ca-4f64-a8cc-cf176b055432 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 19:11:09 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-2355ba41-98ca-4f64-a8cc-cf176b055432 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] SCSI volumes sdc have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 19:11:09 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-2355ba41-98ca-4f64-a8cc-cf176b055432 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cc97625d-4cbe-4c94-ab68-7f836fa5f416')] {{(pid=75216) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 19:11:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc97625d-4cbe-4c94-ab68-7f836fa5f416 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:11:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc97625d-4cbe-4c94-ab68-7f836fa5f416 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:11:09 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[78117b6f-acf7-4545-a456-6429c9fbff3c]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:11:09 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-2355ba41-98ca-4f64-a8cc-cf176b055432 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:11:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc97625d-4cbe-4c94-ab68-7f836fa5f416 -p 172.16.0.220:3260 --logout {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:11:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc97625d-4cbe-4c94-ab68-7f836fa5f416 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:11:09 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee3b6f7c-c299-41da-8ffb-87d2deafd5f0]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:cc97625d-4cbe-4c94-ab68-7f836fa5f416, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:cc97625d-4cbe-4c94-ab68-7f836fa5f416, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:11:09 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-2355ba41-98ca-4f64-a8cc-cf176b055432 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:cc97625d-4cbe-4c94-ab68-7f836fa5f416, portal: 172.16.0.220,3260]
Nov 13 19:11:09 user nova-compute[75216]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:cc97625d-4cbe-4c94-ab68-7f836fa5f416, portal: 172.16.0.220,3260] successful.
Nov 13 19:11:09 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:11:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc97625d-4cbe-4c94-ab68-7f836fa5f416 -p 172.16.0.220:3260 --op delete {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:11:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc97625d-4cbe-4c94-ab68-7f836fa5f416 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:11:09 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f866aa5-8b70-4ff6-afb4-93af7a2c1a63]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:11:09 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-2355ba41-98ca-4f64-a8cc-cf176b055432 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:11:09 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-2355ba41-98ca-4f64-a8cc-cf176b055432 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 19:11:09 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-2355ba41-98ca-4f64-a8cc-cf176b055432 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] <== disconnect_volume: return (314ms) None {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 19:11:09 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2355ba41-98ca-4f64-a8cc-cf176b055432 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] [instance: 33d6832f-1d6a-4f64-9e1b-07078e7e84a5] Disconnected iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 19:11:10 user nova-compute[75216]: DEBUG nova.objects.instance [None req-2355ba41-98ca-4f64-a8cc-cf176b055432 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] Lazy-loading 'flavor' on Instance uuid 33d6832f-1d6a-4f64-9e1b-07078e7e84a5 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:11:10 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-2355ba41-98ca-4f64-a8cc-cf176b055432 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] Lock "33d6832f-1d6a-4f64-9e1b-07078e7e84a5" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.616s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:11:10 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "33d6832f-1d6a-4f64-9e1b-07078e7e84a5" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 8.386s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:11:10 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "33d6832f-1d6a-4f64-9e1b-07078e7e84a5" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.023s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:11:10 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:11:12 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:11:12 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:11:12 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Starting heal instance info cache {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 19:11:12 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "refresh_cache-7b752173-e573-426e-b9f1-bff92a4c2b55" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 19:11:12 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquired lock "refresh_cache-7b752173-e573-426e-b9f1-bff92a4c2b55" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 19:11:12 user nova-compute[75216]: DEBUG nova.network.neutron [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: 7b752173-e573-426e-b9f1-bff92a4c2b55] Forcefully refreshing network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 19:11:12 user nova-compute[75216]: DEBUG nova.network.neutron [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: 7b752173-e573-426e-b9f1-bff92a4c2b55] Updating instance_info_cache with network_info: [{"id": "60dd7b11-cfc3-4965-a429-8b2ac4cdfcf4", "address": "fa:16:3e:d6:af:c5", "network": {"id": "53bb01d5-31a4-47af-a931-ac12fe72b986", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-802892643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "095f5765865140d29b3ecf1ab3427037", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60dd7b11-cf", "ovs_interfaceid": "60dd7b11-cfc3-4965-a429-8b2ac4cdfcf4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:11:12 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Releasing lock "refresh_cache-7b752173-e573-426e-b9f1-bff92a4c2b55" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 19:11:12 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: 7b752173-e573-426e-b9f1-bff92a4c2b55] Updated the network info_cache for instance {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 19:11:12 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:11:12 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-501d3136-89bf-42cc-b745-9076aedc60e3 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Acquiring lock "1e5f1164-a15e-40cf-b7bc-5aeb404a1216" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:11:12 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-501d3136-89bf-42cc-b745-9076aedc60e3 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Lock "1e5f1164-a15e-40cf-b7bc-5aeb404a1216" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:11:12 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-501d3136-89bf-42cc-b745-9076aedc60e3 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Acquiring lock "1e5f1164-a15e-40cf-b7bc-5aeb404a1216-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:11:12 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-501d3136-89bf-42cc-b745-9076aedc60e3 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Lock "1e5f1164-a15e-40cf-b7bc-5aeb404a1216-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:11:12 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-501d3136-89bf-42cc-b745-9076aedc60e3 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Lock "1e5f1164-a15e-40cf-b7bc-5aeb404a1216-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:11:12 user nova-compute[75216]: INFO nova.compute.manager [None req-501d3136-89bf-42cc-b745-9076aedc60e3 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: 1e5f1164-a15e-40cf-b7bc-5aeb404a1216] Terminating instance
Nov 13 19:11:12 user nova-compute[75216]: DEBUG nova.compute.manager [None req-501d3136-89bf-42cc-b745-9076aedc60e3 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: 1e5f1164-a15e-40cf-b7bc-5aeb404a1216] Start destroying the instance on the hypervisor. {{(pid=75216) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 19:11:12 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:11:12 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:11:13 user nova-compute[75216]: DEBUG nova.compute.manager [req-83cecc48-83ca-4122-b751-f774bddbcc78 req-608338d7-2f24-4bcd-9e61-36fc605b0c6b service nova] [instance: 1e5f1164-a15e-40cf-b7bc-5aeb404a1216] Received event network-vif-unplugged-96dfdc95-6a8e-43f3-8d7c-5b4f78a8f134 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:11:13 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-83cecc48-83ca-4122-b751-f774bddbcc78 req-608338d7-2f24-4bcd-9e61-36fc605b0c6b service nova] Acquiring lock "1e5f1164-a15e-40cf-b7bc-5aeb404a1216-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:11:13 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-83cecc48-83ca-4122-b751-f774bddbcc78 req-608338d7-2f24-4bcd-9e61-36fc605b0c6b service nova] Lock "1e5f1164-a15e-40cf-b7bc-5aeb404a1216-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:11:13 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-83cecc48-83ca-4122-b751-f774bddbcc78 req-608338d7-2f24-4bcd-9e61-36fc605b0c6b service nova] Lock "1e5f1164-a15e-40cf-b7bc-5aeb404a1216-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:11:13 user nova-compute[75216]: DEBUG nova.compute.manager [req-83cecc48-83ca-4122-b751-f774bddbcc78 req-608338d7-2f24-4bcd-9e61-36fc605b0c6b service nova] [instance: 1e5f1164-a15e-40cf-b7bc-5aeb404a1216] No waiting events found dispatching network-vif-unplugged-96dfdc95-6a8e-43f3-8d7c-5b4f78a8f134 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 19:11:13 user nova-compute[75216]: DEBUG nova.compute.manager [req-83cecc48-83ca-4122-b751-f774bddbcc78 req-608338d7-2f24-4bcd-9e61-36fc605b0c6b service nova] [instance: 1e5f1164-a15e-40cf-b7bc-5aeb404a1216] Received event network-vif-unplugged-96dfdc95-6a8e-43f3-8d7c-5b4f78a8f134 for instance with task_state deleting. {{(pid=75216) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 19:11:13 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:11:13 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:11:13 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 1e5f1164-a15e-40cf-b7bc-5aeb404a1216] Instance destroyed successfully.
Nov 13 19:11:13 user nova-compute[75216]: DEBUG nova.objects.instance [None req-501d3136-89bf-42cc-b745-9076aedc60e3 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Lazy-loading 'resources' on Instance uuid 1e5f1164-a15e-40cf-b7bc-5aeb404a1216 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:11:13 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-501d3136-89bf-42cc-b745-9076aedc60e3 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T18:55:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1805019771',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1805019771',id=24,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-13T18:57:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='903397a6c0474cfd8bd1a4fb338528aa',ramdisk_id='',reservation_id='r-0t4799bp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-197527955',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T18:59:14Z,user_data=None,user_id='b381ea98871846b1bfb29a202a058208',uuid=1e5f1164-a15e-40cf-b7bc-5aeb404a1216,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "96dfdc95-6a8e-43f3-8d7c-5b4f78a8f134", "address": "fa:16:3e:19:0b:3a", "network": {"id": "f8b821ef-8fae-42b9-9055-a9ea7be955ab", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-50594548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "903397a6c0474cfd8bd1a4fb338528aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96dfdc95-6a", "ovs_interfaceid": "96dfdc95-6a8e-43f3-8d7c-5b4f78a8f134", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 19:11:13 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-501d3136-89bf-42cc-b745-9076aedc60e3 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Converting VIF {"id": "96dfdc95-6a8e-43f3-8d7c-5b4f78a8f134", "address": "fa:16:3e:19:0b:3a", "network": {"id": "f8b821ef-8fae-42b9-9055-a9ea7be955ab", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-50594548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "903397a6c0474cfd8bd1a4fb338528aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96dfdc95-6a", "ovs_interfaceid": "96dfdc95-6a8e-43f3-8d7c-5b4f78a8f134", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 19:11:13 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-501d3136-89bf-42cc-b745-9076aedc60e3 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:19:0b:3a,bridge_name='br-int',has_traffic_filtering=True,id=96dfdc95-6a8e-43f3-8d7c-5b4f78a8f134,network=Network(f8b821ef-8fae-42b9-9055-a9ea7be955ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96dfdc95-6a') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 19:11:13 user nova-compute[75216]: DEBUG os_vif [None req-501d3136-89bf-42cc-b745-9076aedc60e3 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:19:0b:3a,bridge_name='br-int',has_traffic_filtering=True,id=96dfdc95-6a8e-43f3-8d7c-5b4f78a8f134,network=Network(f8b821ef-8fae-42b9-9055-a9ea7be955ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96dfdc95-6a') {{(pid=75216) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 19:11:13 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:11:13 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap96dfdc95-6a, bridge=br-int, if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:11:13 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:11:13 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:11:13 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=56f4cd45-4e17-4ba9-a580-27d2ea9e3b86) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:11:13 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:11:13 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:11:13 user nova-compute[75216]: INFO os_vif [None req-501d3136-89bf-42cc-b745-9076aedc60e3 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:19:0b:3a,bridge_name='br-int',has_traffic_filtering=True,id=96dfdc95-6a8e-43f3-8d7c-5b4f78a8f134,network=Network(f8b821ef-8fae-42b9-9055-a9ea7be955ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96dfdc95-6a')
Nov 13 19:11:13 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-501d3136-89bf-42cc-b745-9076aedc60e3 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: 1e5f1164-a15e-40cf-b7bc-5aeb404a1216] calling os-brick to detach iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 19:11:13 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-501d3136-89bf-42cc-b745-9076aedc60e3 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3a8669e40>, {'target_iqn': 'iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RAbjhwID', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 19:11:13 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-501d3136-89bf-42cc-b745-9076aedc60e3 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 19:11:13 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-501d3136-89bf-42cc-b745-9076aedc60e3 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 19:11:13 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-501d3136-89bf-42cc-b745-9076aedc60e3 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 19:11:13 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:11:13 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:11:13 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ab78178-1aaa-4176-8c13-d3e9c1e949c2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:11:13 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-501d3136-89bf-42cc-b745-9076aedc60e3 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 19:11:13 user nova-compute[75216]: No targets found.
Nov 13 19:11:13 user nova-compute[75216]: iSNS:
Nov 13 19:11:13 user nova-compute[75216]: No targets found.
Nov 13 19:11:13 user nova-compute[75216]: STATIC:
Nov 13 19:11:13 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1
Nov 13 19:11:13 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 19:11:13 user nova-compute[75216]:                 Iface Name: default
Nov 13 19:11:13 user nova-compute[75216]: FIRMWARE:
Nov 13 19:11:13 user nova-compute[75216]: No targets found.
Nov 13 19:11:13 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 19:11:13 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-501d3136-89bf-42cc-b745-9076aedc60e3 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 19:11:13 user nova-compute[75216]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 19:11:13 user nova-compute[75216]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75216) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 19:11:13 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-501d3136-89bf-42cc-b745-9076aedc60e3 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1', 0)] {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 19:11:13 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:11:13 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:11:13 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[d315a3cf-c7d4-4495-b1af-89e43e3a7031]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:11:13 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:11:13 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:11:13 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[84a2e76b-9f29-480f-ba24-cbe77b7f202c]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1 (non-flash)\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:11:13 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-501d3136-89bf-42cc-b745-9076aedc60e3 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1 (non-flash)
Nov 13 19:11:13 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 19:11:13 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-501d3136-89bf-42cc-b745-9076aedc60e3 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1 (non-flash)
Nov 13 19:11:13 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 19:11:13 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-501d3136-89bf-42cc-b745-9076aedc60e3 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe3a834c1f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1'): ({'sdb'}, set())}) {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 19:11:13 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-501d3136-89bf-42cc-b745-9076aedc60e3 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Removing single pathed devices sdb {{(pid=75216) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 19:11:13 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:11:13 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:11:13 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[232b530c-c27f-4379-a592-d729694cd9cb]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:11:13 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:11:13 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:11:13 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[24404735-ff0c-4e9d-bc17-b2cfe20579dc]: (4, ('ok\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:11:13 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-501d3136-89bf-42cc-b745-9076aedc60e3 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Flushing IO for device /dev/sdb {{(pid=75216) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 19:11:13 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:11:13 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:11:13 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[5af9f5f5-6755-4bd7-8ff9-4ff069c751ec]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:11:13 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-501d3136-89bf-42cc-b745-9076aedc60e3 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75216) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 19:11:13 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:11:13 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.036s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:11:13 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[e91467b5-45a8-4bcb-ac0f-29a0237f4918]: (4, ('1', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:11:13 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-501d3136-89bf-42cc-b745-9076aedc60e3 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 19:11:13 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-501d3136-89bf-42cc-b745-9076aedc60e3 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] SCSI volumes sdb have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 19:11:13 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-501d3136-89bf-42cc-b745-9076aedc60e3 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1')] {{(pid=75216) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 19:11:13 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:11:13 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.030s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:11:13 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[059d1cd6-017e-46ba-b44e-ffce99d6269e]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:11:13 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-501d3136-89bf-42cc-b745-9076aedc60e3 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:11:13 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1 -p 172.16.0.220:3260 --logout {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:11:13 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:11:13 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceeabbf2-89d5-4e16-a12c-6ca24e130066]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:11:13 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-501d3136-89bf-42cc-b745-9076aedc60e3 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1, portal: 172.16.0.220,3260]
Nov 13 19:11:13 user nova-compute[75216]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1, portal: 172.16.0.220,3260] successful.
Nov 13 19:11:13 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:11:13 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1 -p 172.16.0.220:3260 --op delete {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:11:13 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e02966c-e269-45a8-8773-1dba3abaf1a1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:11:13 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[73020ec7-4ebc-4e20-8da7-5e12fb911378]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:11:13 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-501d3136-89bf-42cc-b745-9076aedc60e3 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:11:13 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-501d3136-89bf-42cc-b745-9076aedc60e3 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.279s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 19:11:13 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-501d3136-89bf-42cc-b745-9076aedc60e3 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] <== disconnect_volume: return (280ms) None {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 19:11:13 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-501d3136-89bf-42cc-b745-9076aedc60e3 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: 1e5f1164-a15e-40cf-b7bc-5aeb404a1216] Disconnected iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 19:11:13 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-501d3136-89bf-42cc-b745-9076aedc60e3 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: 1e5f1164-a15e-40cf-b7bc-5aeb404a1216] Deleting instance files /opt/stack/data/nova/instances/1e5f1164-a15e-40cf-b7bc-5aeb404a1216_del
Nov 13 19:11:13 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-501d3136-89bf-42cc-b745-9076aedc60e3 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: 1e5f1164-a15e-40cf-b7bc-5aeb404a1216] Deletion of /opt/stack/data/nova/instances/1e5f1164-a15e-40cf-b7bc-5aeb404a1216_del complete
Nov 13 19:11:13 user nova-compute[75216]: INFO nova.compute.manager [None req-501d3136-89bf-42cc-b745-9076aedc60e3 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: 1e5f1164-a15e-40cf-b7bc-5aeb404a1216] Took 1.12 seconds to destroy the instance on the hypervisor.
Nov 13 19:11:13 user nova-compute[75216]: DEBUG oslo.service.loopingcall [None req-501d3136-89bf-42cc-b745-9076aedc60e3 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75216) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 19:11:13 user nova-compute[75216]: DEBUG nova.compute.manager [-] [instance: 1e5f1164-a15e-40cf-b7bc-5aeb404a1216] Deallocating network for instance {{(pid=75216) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 19:11:13 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: 1e5f1164-a15e-40cf-b7bc-5aeb404a1216] deallocate_for_instance() {{(pid=75216) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 19:11:14 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:11:14 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: 1e5f1164-a15e-40cf-b7bc-5aeb404a1216] Updating instance_info_cache with network_info: [] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:11:14 user nova-compute[75216]: INFO nova.compute.manager [-] [instance: 1e5f1164-a15e-40cf-b7bc-5aeb404a1216] Took 0.48 seconds to deallocate network for instance.
Nov 13 19:11:15 user nova-compute[75216]: DEBUG nova.compute.manager [req-b059b253-cb0d-41bb-8e74-5a1cc001e587 req-ce01ea55-9381-4858-9c58-c83d72f22949 service nova] [instance: 1e5f1164-a15e-40cf-b7bc-5aeb404a1216] Received event network-vif-plugged-96dfdc95-6a8e-43f3-8d7c-5b4f78a8f134 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:11:15 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-b059b253-cb0d-41bb-8e74-5a1cc001e587 req-ce01ea55-9381-4858-9c58-c83d72f22949 service nova] Acquiring lock "1e5f1164-a15e-40cf-b7bc-5aeb404a1216-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:11:15 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-b059b253-cb0d-41bb-8e74-5a1cc001e587 req-ce01ea55-9381-4858-9c58-c83d72f22949 service nova] Lock "1e5f1164-a15e-40cf-b7bc-5aeb404a1216-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:11:15 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-b059b253-cb0d-41bb-8e74-5a1cc001e587 req-ce01ea55-9381-4858-9c58-c83d72f22949 service nova] Lock "1e5f1164-a15e-40cf-b7bc-5aeb404a1216-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:11:15 user nova-compute[75216]: DEBUG nova.compute.manager [req-b059b253-cb0d-41bb-8e74-5a1cc001e587 req-ce01ea55-9381-4858-9c58-c83d72f22949 service nova] [instance: 1e5f1164-a15e-40cf-b7bc-5aeb404a1216] No waiting events found dispatching network-vif-plugged-96dfdc95-6a8e-43f3-8d7c-5b4f78a8f134 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 19:11:15 user nova-compute[75216]: WARNING nova.compute.manager [req-b059b253-cb0d-41bb-8e74-5a1cc001e587 req-ce01ea55-9381-4858-9c58-c83d72f22949 service nova] [instance: 1e5f1164-a15e-40cf-b7bc-5aeb404a1216] Received unexpected event network-vif-plugged-96dfdc95-6a8e-43f3-8d7c-5b4f78a8f134 for instance with vm_state active and task_state deleting.
Nov 13 19:11:15 user nova-compute[75216]: DEBUG nova.compute.manager [req-b059b253-cb0d-41bb-8e74-5a1cc001e587 req-ce01ea55-9381-4858-9c58-c83d72f22949 service nova] [instance: 1e5f1164-a15e-40cf-b7bc-5aeb404a1216] Received event network-vif-deleted-96dfdc95-6a8e-43f3-8d7c-5b4f78a8f134 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:11:15 user nova-compute[75216]: INFO nova.compute.manager [None req-501d3136-89bf-42cc-b745-9076aedc60e3 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: 1e5f1164-a15e-40cf-b7bc-5aeb404a1216] Took 0.72 seconds to detach 1 volumes for instance.
Nov 13 19:11:15 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-501d3136-89bf-42cc-b745-9076aedc60e3 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:11:15 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-501d3136-89bf-42cc-b745-9076aedc60e3 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:11:15 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-501d3136-89bf-42cc-b745-9076aedc60e3 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 19:11:15 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-501d3136-89bf-42cc-b745-9076aedc60e3 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 19:11:15 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-501d3136-89bf-42cc-b745-9076aedc60e3 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.197s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:11:15 user nova-compute[75216]: INFO nova.scheduler.client.report [None req-501d3136-89bf-42cc-b745-9076aedc60e3 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Deleted allocations for instance 1e5f1164-a15e-40cf-b7bc-5aeb404a1216
Nov 13 19:11:15 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-501d3136-89bf-42cc-b745-9076aedc60e3 tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Lock "1e5f1164-a15e-40cf-b7bc-5aeb404a1216" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.703s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:11:18 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:11:20 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:11:20 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Cleaning up deleted instances {{(pid=75216) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 13 19:11:20 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] There are 0 instances to clean {{(pid=75216) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 13 19:11:20 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:11:20 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75216) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 13 19:11:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:11:27 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-9203a910-1f69-4dba-851a-9135c718c437 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Acquiring lock "7b752173-e573-426e-b9f1-bff92a4c2b55" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:11:27 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-9203a910-1f69-4dba-851a-9135c718c437 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Lock "7b752173-e573-426e-b9f1-bff92a4c2b55" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:11:27 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-9203a910-1f69-4dba-851a-9135c718c437 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Acquiring lock "7b752173-e573-426e-b9f1-bff92a4c2b55-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:11:27 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-9203a910-1f69-4dba-851a-9135c718c437 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Lock "7b752173-e573-426e-b9f1-bff92a4c2b55-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:11:27 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-9203a910-1f69-4dba-851a-9135c718c437 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Lock "7b752173-e573-426e-b9f1-bff92a4c2b55-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:11:27 user nova-compute[75216]: INFO nova.compute.manager [None req-9203a910-1f69-4dba-851a-9135c718c437 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] [instance: 7b752173-e573-426e-b9f1-bff92a4c2b55] Terminating instance
Nov 13 19:11:27 user nova-compute[75216]: DEBUG nova.compute.manager [None req-9203a910-1f69-4dba-851a-9135c718c437 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] [instance: 7b752173-e573-426e-b9f1-bff92a4c2b55] Start destroying the instance on the hypervisor. {{(pid=75216) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 19:11:27 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:11:27 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:11:27 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:11:27 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:11:28 user nova-compute[75216]: DEBUG nova.compute.manager [req-3de8c9a8-ff8f-4ce3-a512-ec75cd059a68 req-6f91bdbd-44c4-46a6-a48a-71a1e72b8e2a service nova] [instance: 7b752173-e573-426e-b9f1-bff92a4c2b55] Received event network-vif-unplugged-60dd7b11-cfc3-4965-a429-8b2ac4cdfcf4 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:11:28 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-3de8c9a8-ff8f-4ce3-a512-ec75cd059a68 req-6f91bdbd-44c4-46a6-a48a-71a1e72b8e2a service nova] Acquiring lock "7b752173-e573-426e-b9f1-bff92a4c2b55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:11:28 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-3de8c9a8-ff8f-4ce3-a512-ec75cd059a68 req-6f91bdbd-44c4-46a6-a48a-71a1e72b8e2a service nova] Lock "7b752173-e573-426e-b9f1-bff92a4c2b55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:11:28 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-3de8c9a8-ff8f-4ce3-a512-ec75cd059a68 req-6f91bdbd-44c4-46a6-a48a-71a1e72b8e2a service nova] Lock "7b752173-e573-426e-b9f1-bff92a4c2b55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:11:28 user nova-compute[75216]: DEBUG nova.compute.manager [req-3de8c9a8-ff8f-4ce3-a512-ec75cd059a68 req-6f91bdbd-44c4-46a6-a48a-71a1e72b8e2a service nova] [instance: 7b752173-e573-426e-b9f1-bff92a4c2b55] No waiting events found dispatching network-vif-unplugged-60dd7b11-cfc3-4965-a429-8b2ac4cdfcf4 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 19:11:28 user nova-compute[75216]: DEBUG nova.compute.manager [req-3de8c9a8-ff8f-4ce3-a512-ec75cd059a68 req-6f91bdbd-44c4-46a6-a48a-71a1e72b8e2a service nova] [instance: 7b752173-e573-426e-b9f1-bff92a4c2b55] Received event network-vif-unplugged-60dd7b11-cfc3-4965-a429-8b2ac4cdfcf4 for instance with task_state deleting. {{(pid=75216) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 19:11:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:11:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:11:28 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 7b752173-e573-426e-b9f1-bff92a4c2b55] Instance destroyed successfully.
Nov 13 19:11:28 user nova-compute[75216]: DEBUG nova.objects.instance [None req-9203a910-1f69-4dba-851a-9135c718c437 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Lazy-loading 'resources' on Instance uuid 7b752173-e573-426e-b9f1-bff92a4c2b55 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:11:28 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-9203a910-1f69-4dba-851a-9135c718c437 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T19:01:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1575865869',display_name='tempest-AttachVolumeTestJSON-server-1575865869',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1575865869',id=29,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGyAqjyHTP2pee8vnuPoZ/xrp7+kl5CQoOuvKblvMKUYsUK2V6arU3VG3TaEuVHw4+At5BuB9j/a8y246OC2wl7lhVwqAlIhS8np4Du9lzYGwetS0FdeZdBwrMXi36WP0A==',key_name='tempest-keypair-355509380',keypairs=<?>,launch_index=0,launched_at=2023-11-13T19:01:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='095f5765865140d29b3ecf1ab3427037',ramdisk_id='',reservation_id='r-0zzag7s9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-156429078',owner_user_name='tempest-AttachVolumeTestJSON-156429078-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T19:09:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a7501ee4141241f2abc4d6bfce2924d4',uuid=7b752173-e573-426e-b9f1-bff92a4c2b55,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "60dd7b11-cfc3-4965-a429-8b2ac4cdfcf4", "address": "fa:16:3e:d6:af:c5", "network": {"id": "53bb01d5-31a4-47af-a931-ac12fe72b986", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-802892643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "095f5765865140d29b3ecf1ab3427037", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60dd7b11-cf", "ovs_interfaceid": "60dd7b11-cfc3-4965-a429-8b2ac4cdfcf4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 19:11:28 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-9203a910-1f69-4dba-851a-9135c718c437 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Converting VIF {"id": "60dd7b11-cfc3-4965-a429-8b2ac4cdfcf4", "address": "fa:16:3e:d6:af:c5", "network": {"id": "53bb01d5-31a4-47af-a931-ac12fe72b986", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-802892643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "095f5765865140d29b3ecf1ab3427037", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60dd7b11-cf", "ovs_interfaceid": "60dd7b11-cfc3-4965-a429-8b2ac4cdfcf4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 19:11:28 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-9203a910-1f69-4dba-851a-9135c718c437 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d6:af:c5,bridge_name='br-int',has_traffic_filtering=True,id=60dd7b11-cfc3-4965-a429-8b2ac4cdfcf4,network=Network(53bb01d5-31a4-47af-a931-ac12fe72b986),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60dd7b11-cf') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 19:11:28 user nova-compute[75216]: DEBUG os_vif [None req-9203a910-1f69-4dba-851a-9135c718c437 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d6:af:c5,bridge_name='br-int',has_traffic_filtering=True,id=60dd7b11-cfc3-4965-a429-8b2ac4cdfcf4,network=Network(53bb01d5-31a4-47af-a931-ac12fe72b986),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60dd7b11-cf') {{(pid=75216) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 19:11:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:11:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap60dd7b11-cf, bridge=br-int, if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:11:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:11:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:11:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:11:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=067f4c5e-1ac9-46f2-82f8-17ac262b1c1d) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:11:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:11:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:11:28 user nova-compute[75216]: INFO os_vif [None req-9203a910-1f69-4dba-851a-9135c718c437 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d6:af:c5,bridge_name='br-int',has_traffic_filtering=True,id=60dd7b11-cfc3-4965-a429-8b2ac4cdfcf4,network=Network(53bb01d5-31a4-47af-a931-ac12fe72b986),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60dd7b11-cf')
Nov 13 19:11:28 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-9203a910-1f69-4dba-851a-9135c718c437 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] [instance: 7b752173-e573-426e-b9f1-bff92a4c2b55] Deleting instance files /opt/stack/data/nova/instances/7b752173-e573-426e-b9f1-bff92a4c2b55_del
Nov 13 19:11:28 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-9203a910-1f69-4dba-851a-9135c718c437 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] [instance: 7b752173-e573-426e-b9f1-bff92a4c2b55] Deletion of /opt/stack/data/nova/instances/7b752173-e573-426e-b9f1-bff92a4c2b55_del complete
Nov 13 19:11:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:11:28 user nova-compute[75216]: INFO nova.compute.manager [None req-9203a910-1f69-4dba-851a-9135c718c437 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] [instance: 7b752173-e573-426e-b9f1-bff92a4c2b55] Took 0.73 seconds to destroy the instance on the hypervisor.
Nov 13 19:11:28 user nova-compute[75216]: DEBUG oslo.service.loopingcall [None req-9203a910-1f69-4dba-851a-9135c718c437 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75216) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 19:11:28 user nova-compute[75216]: DEBUG nova.compute.manager [-] [instance: 7b752173-e573-426e-b9f1-bff92a4c2b55] Deallocating network for instance {{(pid=75216) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 19:11:28 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: 7b752173-e573-426e-b9f1-bff92a4c2b55] deallocate_for_instance() {{(pid=75216) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 19:11:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:11:29 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: 7b752173-e573-426e-b9f1-bff92a4c2b55] Updating instance_info_cache with network_info: [] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:11:29 user nova-compute[75216]: INFO nova.compute.manager [-] [instance: 7b752173-e573-426e-b9f1-bff92a4c2b55] Took 0.81 seconds to deallocate network for instance.
Nov 13 19:11:29 user nova-compute[75216]: DEBUG nova.compute.manager [req-c54c623e-0c13-4a59-b59e-48844e26b866 req-674f1218-c3e6-4996-a9ed-b6e6c7159a13 service nova] [instance: 7b752173-e573-426e-b9f1-bff92a4c2b55] Received event network-vif-deleted-60dd7b11-cfc3-4965-a429-8b2ac4cdfcf4 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:11:29 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-9203a910-1f69-4dba-851a-9135c718c437 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:11:29 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-9203a910-1f69-4dba-851a-9135c718c437 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:11:29 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-9203a910-1f69-4dba-851a-9135c718c437 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 19:11:29 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-9203a910-1f69-4dba-851a-9135c718c437 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 19:11:29 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-9203a910-1f69-4dba-851a-9135c718c437 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.173s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:11:29 user nova-compute[75216]: INFO nova.scheduler.client.report [None req-9203a910-1f69-4dba-851a-9135c718c437 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Deleted allocations for instance 7b752173-e573-426e-b9f1-bff92a4c2b55
Nov 13 19:11:29 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-9203a910-1f69-4dba-851a-9135c718c437 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Lock "7b752173-e573-426e-b9f1-bff92a4c2b55" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.881s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:11:30 user nova-compute[75216]: DEBUG nova.compute.manager [req-41ef317b-1e4b-4512-9180-3d6060e3f7ee req-a16e5a58-e825-4bdc-9ecc-7e72c96b7017 service nova] [instance: 7b752173-e573-426e-b9f1-bff92a4c2b55] Received event network-vif-plugged-60dd7b11-cfc3-4965-a429-8b2ac4cdfcf4 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:11:30 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-41ef317b-1e4b-4512-9180-3d6060e3f7ee req-a16e5a58-e825-4bdc-9ecc-7e72c96b7017 service nova] Acquiring lock "7b752173-e573-426e-b9f1-bff92a4c2b55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:11:30 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-41ef317b-1e4b-4512-9180-3d6060e3f7ee req-a16e5a58-e825-4bdc-9ecc-7e72c96b7017 service nova] Lock "7b752173-e573-426e-b9f1-bff92a4c2b55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:11:30 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-41ef317b-1e4b-4512-9180-3d6060e3f7ee req-a16e5a58-e825-4bdc-9ecc-7e72c96b7017 service nova] Lock "7b752173-e573-426e-b9f1-bff92a4c2b55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:11:30 user nova-compute[75216]: DEBUG nova.compute.manager [req-41ef317b-1e4b-4512-9180-3d6060e3f7ee req-a16e5a58-e825-4bdc-9ecc-7e72c96b7017 service nova] [instance: 7b752173-e573-426e-b9f1-bff92a4c2b55] No waiting events found dispatching network-vif-plugged-60dd7b11-cfc3-4965-a429-8b2ac4cdfcf4 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 19:11:30 user nova-compute[75216]: WARNING nova.compute.manager [req-41ef317b-1e4b-4512-9180-3d6060e3f7ee req-a16e5a58-e825-4bdc-9ecc-7e72c96b7017 service nova] [instance: 7b752173-e573-426e-b9f1-bff92a4c2b55] Received unexpected event network-vif-plugged-60dd7b11-cfc3-4965-a429-8b2ac4cdfcf4 for instance with vm_state deleted and task_state None.
Nov 13 19:11:33 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:11:38 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:11:40 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-764a40f5-8df5-45f1-acfb-51810385711b tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] Acquiring lock "33d6832f-1d6a-4f64-9e1b-07078e7e84a5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:11:40 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-764a40f5-8df5-45f1-acfb-51810385711b tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] Lock "33d6832f-1d6a-4f64-9e1b-07078e7e84a5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:11:40 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-764a40f5-8df5-45f1-acfb-51810385711b tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] Acquiring lock "33d6832f-1d6a-4f64-9e1b-07078e7e84a5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:11:40 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-764a40f5-8df5-45f1-acfb-51810385711b tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] Lock "33d6832f-1d6a-4f64-9e1b-07078e7e84a5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:11:40 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-764a40f5-8df5-45f1-acfb-51810385711b tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] Lock "33d6832f-1d6a-4f64-9e1b-07078e7e84a5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:11:40 user nova-compute[75216]: INFO nova.compute.manager [None req-764a40f5-8df5-45f1-acfb-51810385711b tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] [instance: 33d6832f-1d6a-4f64-9e1b-07078e7e84a5] Terminating instance
Nov 13 19:11:40 user nova-compute[75216]: DEBUG nova.compute.manager [None req-764a40f5-8df5-45f1-acfb-51810385711b tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] [instance: 33d6832f-1d6a-4f64-9e1b-07078e7e84a5] Start destroying the instance on the hypervisor. {{(pid=75216) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 19:11:40 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:11:40 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:11:40 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:11:40 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:11:40 user nova-compute[75216]: DEBUG nova.compute.manager [req-aba23d5e-3684-432d-893c-f2336ba0e0bc req-661cf15b-0e0f-4ca7-b529-d7a6de517912 service nova] [instance: 33d6832f-1d6a-4f64-9e1b-07078e7e84a5] Received event network-vif-unplugged-0c5edcf5-88d0-44aa-977d-51faede9daeb {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:11:40 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-aba23d5e-3684-432d-893c-f2336ba0e0bc req-661cf15b-0e0f-4ca7-b529-d7a6de517912 service nova] Acquiring lock "33d6832f-1d6a-4f64-9e1b-07078e7e84a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:11:40 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-aba23d5e-3684-432d-893c-f2336ba0e0bc req-661cf15b-0e0f-4ca7-b529-d7a6de517912 service nova] Lock "33d6832f-1d6a-4f64-9e1b-07078e7e84a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:11:40 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-aba23d5e-3684-432d-893c-f2336ba0e0bc req-661cf15b-0e0f-4ca7-b529-d7a6de517912 service nova] Lock "33d6832f-1d6a-4f64-9e1b-07078e7e84a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:11:40 user nova-compute[75216]: DEBUG nova.compute.manager [req-aba23d5e-3684-432d-893c-f2336ba0e0bc req-661cf15b-0e0f-4ca7-b529-d7a6de517912 service nova] [instance: 33d6832f-1d6a-4f64-9e1b-07078e7e84a5] No waiting events found dispatching network-vif-unplugged-0c5edcf5-88d0-44aa-977d-51faede9daeb {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 19:11:40 user nova-compute[75216]: DEBUG nova.compute.manager [req-aba23d5e-3684-432d-893c-f2336ba0e0bc req-661cf15b-0e0f-4ca7-b529-d7a6de517912 service nova] [instance: 33d6832f-1d6a-4f64-9e1b-07078e7e84a5] Received event network-vif-unplugged-0c5edcf5-88d0-44aa-977d-51faede9daeb for instance with task_state deleting. {{(pid=75216) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 19:11:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:11:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:11:41 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 33d6832f-1d6a-4f64-9e1b-07078e7e84a5] Instance destroyed successfully.
Nov 13 19:11:41 user nova-compute[75216]: DEBUG nova.objects.instance [None req-764a40f5-8df5-45f1-acfb-51810385711b tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] Lazy-loading 'resources' on Instance uuid 33d6832f-1d6a-4f64-9e1b-07078e7e84a5 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:11:41 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-764a40f5-8df5-45f1-acfb-51810385711b tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T19:08:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-708403076',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-708403076',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-7084030',id=35,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGDs3P3xWMW1mJDG4Tgx6gZz0hmOrm+Wf/4ur6V0pvSdZgzPoQ2dK3Uy8bf+hqQS8LYnB0m9Fz/QvXq70pNbhiVw1Gavlju+kYX858oLCJmYMXToZdA0UyfSV0l0P5dTsw==',key_name='tempest-keypair-579402465',keypairs=<?>,launch_index=0,launched_at=2023-11-13T19:08:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2d3ed74465c6499e9508724c439ddb0f',ramdisk_id='',reservation_id='r-qhwpiie8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1272110400',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T19:08:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a34f9f7210f1453aba50463c8a4c3ba7',uuid=33d6832f-1d6a-4f64-9e1b-07078e7e84a5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0c5edcf5-88d0-44aa-977d-51faede9daeb", "address": "fa:16:3e:5b:07:f6", "network": {"id": "dc5c76ee-b62d-4bd4-80f6-04d6fd6776e3", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1854861756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d3ed74465c6499e9508724c439ddb0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c5edcf5-88", "ovs_interfaceid": "0c5edcf5-88d0-44aa-977d-51faede9daeb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 19:11:41 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-764a40f5-8df5-45f1-acfb-51810385711b tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] Converting VIF {"id": "0c5edcf5-88d0-44aa-977d-51faede9daeb", "address": "fa:16:3e:5b:07:f6", "network": {"id": "dc5c76ee-b62d-4bd4-80f6-04d6fd6776e3", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1854861756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d3ed74465c6499e9508724c439ddb0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c5edcf5-88", "ovs_interfaceid": "0c5edcf5-88d0-44aa-977d-51faede9daeb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 19:11:41 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-764a40f5-8df5-45f1-acfb-51810385711b tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5b:07:f6,bridge_name='br-int',has_traffic_filtering=True,id=0c5edcf5-88d0-44aa-977d-51faede9daeb,network=Network(dc5c76ee-b62d-4bd4-80f6-04d6fd6776e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c5edcf5-88') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 19:11:41 user nova-compute[75216]: DEBUG os_vif [None req-764a40f5-8df5-45f1-acfb-51810385711b tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5b:07:f6,bridge_name='br-int',has_traffic_filtering=True,id=0c5edcf5-88d0-44aa-977d-51faede9daeb,network=Network(dc5c76ee-b62d-4bd4-80f6-04d6fd6776e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c5edcf5-88') {{(pid=75216) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 19:11:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:11:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0c5edcf5-88, bridge=br-int, if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:11:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:11:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:11:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:11:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:11:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8ad4bd62-3c14-4bcb-b3be-a4fd263a9ad7) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:11:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:11:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:11:41 user nova-compute[75216]: INFO os_vif [None req-764a40f5-8df5-45f1-acfb-51810385711b tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5b:07:f6,bridge_name='br-int',has_traffic_filtering=True,id=0c5edcf5-88d0-44aa-977d-51faede9daeb,network=Network(dc5c76ee-b62d-4bd4-80f6-04d6fd6776e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c5edcf5-88')
Nov 13 19:11:41 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-764a40f5-8df5-45f1-acfb-51810385711b tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] [instance: 33d6832f-1d6a-4f64-9e1b-07078e7e84a5] Deleting instance files /opt/stack/data/nova/instances/33d6832f-1d6a-4f64-9e1b-07078e7e84a5_del
Nov 13 19:11:41 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-764a40f5-8df5-45f1-acfb-51810385711b tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] [instance: 33d6832f-1d6a-4f64-9e1b-07078e7e84a5] Deletion of /opt/stack/data/nova/instances/33d6832f-1d6a-4f64-9e1b-07078e7e84a5_del complete
Nov 13 19:11:41 user nova-compute[75216]: INFO nova.compute.manager [None req-764a40f5-8df5-45f1-acfb-51810385711b tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] [instance: 33d6832f-1d6a-4f64-9e1b-07078e7e84a5] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 13 19:11:41 user nova-compute[75216]: DEBUG oslo.service.loopingcall [None req-764a40f5-8df5-45f1-acfb-51810385711b tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75216) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 19:11:41 user nova-compute[75216]: DEBUG nova.compute.manager [-] [instance: 33d6832f-1d6a-4f64-9e1b-07078e7e84a5] Deallocating network for instance {{(pid=75216) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 19:11:41 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: 33d6832f-1d6a-4f64-9e1b-07078e7e84a5] deallocate_for_instance() {{(pid=75216) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 19:11:42 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: 33d6832f-1d6a-4f64-9e1b-07078e7e84a5] Updating instance_info_cache with network_info: [] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:11:42 user nova-compute[75216]: INFO nova.compute.manager [-] [instance: 33d6832f-1d6a-4f64-9e1b-07078e7e84a5] Took 0.81 seconds to deallocate network for instance.
Nov 13 19:11:42 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-764a40f5-8df5-45f1-acfb-51810385711b tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:11:42 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-764a40f5-8df5-45f1-acfb-51810385711b tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:11:42 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-764a40f5-8df5-45f1-acfb-51810385711b tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 19:11:42 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-764a40f5-8df5-45f1-acfb-51810385711b tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 19:11:42 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-764a40f5-8df5-45f1-acfb-51810385711b tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.298s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:11:42 user nova-compute[75216]: INFO nova.scheduler.client.report [None req-764a40f5-8df5-45f1-acfb-51810385711b tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] Deleted allocations for instance 33d6832f-1d6a-4f64-9e1b-07078e7e84a5
Nov 13 19:11:42 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-764a40f5-8df5-45f1-acfb-51810385711b tempest-TestServerVolumeAttachScenarioOldVersion-1272110400 tempest-TestServerVolumeAttachScenarioOldVersion-1272110400-project-member] Lock "33d6832f-1d6a-4f64-9e1b-07078e7e84a5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.135s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:11:42 user nova-compute[75216]: DEBUG nova.compute.manager [req-c0ad6ba5-9d2d-48b5-802d-85289cb1fb38 req-2092cb12-faa0-4bb4-b068-bec8360a0280 service nova] [instance: 33d6832f-1d6a-4f64-9e1b-07078e7e84a5] Received event network-vif-plugged-0c5edcf5-88d0-44aa-977d-51faede9daeb {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:11:42 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-c0ad6ba5-9d2d-48b5-802d-85289cb1fb38 req-2092cb12-faa0-4bb4-b068-bec8360a0280 service nova] Acquiring lock "33d6832f-1d6a-4f64-9e1b-07078e7e84a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:11:42 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-c0ad6ba5-9d2d-48b5-802d-85289cb1fb38 req-2092cb12-faa0-4bb4-b068-bec8360a0280 service nova] Lock "33d6832f-1d6a-4f64-9e1b-07078e7e84a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:11:42 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-c0ad6ba5-9d2d-48b5-802d-85289cb1fb38 req-2092cb12-faa0-4bb4-b068-bec8360a0280 service nova] Lock "33d6832f-1d6a-4f64-9e1b-07078e7e84a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:11:42 user nova-compute[75216]: DEBUG nova.compute.manager [req-c0ad6ba5-9d2d-48b5-802d-85289cb1fb38 req-2092cb12-faa0-4bb4-b068-bec8360a0280 service nova] [instance: 33d6832f-1d6a-4f64-9e1b-07078e7e84a5] No waiting events found dispatching network-vif-plugged-0c5edcf5-88d0-44aa-977d-51faede9daeb {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 19:11:42 user nova-compute[75216]: WARNING nova.compute.manager [req-c0ad6ba5-9d2d-48b5-802d-85289cb1fb38 req-2092cb12-faa0-4bb4-b068-bec8360a0280 service nova] [instance: 33d6832f-1d6a-4f64-9e1b-07078e7e84a5] Received unexpected event network-vif-plugged-0c5edcf5-88d0-44aa-977d-51faede9daeb for instance with vm_state deleted and task_state None.
Nov 13 19:11:42 user nova-compute[75216]: DEBUG nova.compute.manager [req-c0ad6ba5-9d2d-48b5-802d-85289cb1fb38 req-2092cb12-faa0-4bb4-b068-bec8360a0280 service nova] [instance: 33d6832f-1d6a-4f64-9e1b-07078e7e84a5] Received event network-vif-deleted-0c5edcf5-88d0-44aa-977d-51faede9daeb {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:11:46 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:11:51 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:11:56 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:11:59 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:11:59 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:12:01 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:12:01 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:12:01 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75216) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 19:12:01 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 19:12:01 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 19:12:01 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:12:03 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-677d0337-35ec-46f1-b922-249749508f7f tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Acquiring lock "f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:12:03 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-677d0337-35ec-46f1-b922-249749508f7f tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Lock "f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:12:03 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-677d0337-35ec-46f1-b922-249749508f7f tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Acquiring lock "f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:12:03 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-677d0337-35ec-46f1-b922-249749508f7f tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Lock "f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:12:03 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-677d0337-35ec-46f1-b922-249749508f7f tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Lock "f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:12:03 user nova-compute[75216]: INFO nova.compute.manager [None req-677d0337-35ec-46f1-b922-249749508f7f tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1] Terminating instance
Nov 13 19:12:03 user nova-compute[75216]: DEBUG nova.compute.manager [None req-677d0337-35ec-46f1-b922-249749508f7f tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1] Start destroying the instance on the hypervisor. {{(pid=75216) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 19:12:03 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:12:03 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:12:03 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:12:03 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:12:03 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:12:03 user nova-compute[75216]: DEBUG nova.compute.manager [req-0d55d143-3600-4cc5-8b0f-a0cc2316cd4c req-aca32f28-216b-4215-b2d6-1c3cbaa02b1d service nova] [instance: f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1] Received event network-vif-unplugged-5419f8b4-31da-434a-b131-6476134a71bf {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:12:03 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-0d55d143-3600-4cc5-8b0f-a0cc2316cd4c req-aca32f28-216b-4215-b2d6-1c3cbaa02b1d service nova] Acquiring lock "f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:12:03 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-0d55d143-3600-4cc5-8b0f-a0cc2316cd4c req-aca32f28-216b-4215-b2d6-1c3cbaa02b1d service nova] Lock "f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:12:03 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-0d55d143-3600-4cc5-8b0f-a0cc2316cd4c req-aca32f28-216b-4215-b2d6-1c3cbaa02b1d service nova] Lock "f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:12:03 user nova-compute[75216]: DEBUG nova.compute.manager [req-0d55d143-3600-4cc5-8b0f-a0cc2316cd4c req-aca32f28-216b-4215-b2d6-1c3cbaa02b1d service nova] [instance: f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1] No waiting events found dispatching network-vif-unplugged-5419f8b4-31da-434a-b131-6476134a71bf {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 19:12:03 user nova-compute[75216]: DEBUG nova.compute.manager [req-0d55d143-3600-4cc5-8b0f-a0cc2316cd4c req-aca32f28-216b-4215-b2d6-1c3cbaa02b1d service nova] [instance: f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1] Received event network-vif-unplugged-5419f8b4-31da-434a-b131-6476134a71bf for instance with task_state deleting. {{(pid=75216) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 19:12:04 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:12:04 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:12:04 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:12:04 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:12:04 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:12:04 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:12:04 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:12:04 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1] Instance destroyed successfully.
Nov 13 19:12:04 user nova-compute[75216]: DEBUG nova.objects.instance [None req-677d0337-35ec-46f1-b922-249749508f7f tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Lazy-loading 'resources' on Instance uuid f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:12:04 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-677d0337-35ec-46f1-b922-249749508f7f tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T18:52:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1341845563',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1341845563',id=20,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-13T18:52:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='903397a6c0474cfd8bd1a4fb338528aa',ramdisk_id='',reservation_id='r-e0igk0ig',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-197527955',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T18:54:25Z,user_data=None,user_id='b381ea98871846b1bfb29a202a058208',uuid=f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5419f8b4-31da-434a-b131-6476134a71bf", "address": "fa:16:3e:9a:08:ac", "network": {"id": "f8b821ef-8fae-42b9-9055-a9ea7be955ab", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-50594548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "903397a6c0474cfd8bd1a4fb338528aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5419f8b4-31", "ovs_interfaceid": "5419f8b4-31da-434a-b131-6476134a71bf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 19:12:04 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-677d0337-35ec-46f1-b922-249749508f7f tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Converting VIF {"id": "5419f8b4-31da-434a-b131-6476134a71bf", "address": "fa:16:3e:9a:08:ac", "network": {"id": "f8b821ef-8fae-42b9-9055-a9ea7be955ab", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-50594548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "903397a6c0474cfd8bd1a4fb338528aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5419f8b4-31", "ovs_interfaceid": "5419f8b4-31da-434a-b131-6476134a71bf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 19:12:04 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-677d0337-35ec-46f1-b922-249749508f7f tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9a:08:ac,bridge_name='br-int',has_traffic_filtering=True,id=5419f8b4-31da-434a-b131-6476134a71bf,network=Network(f8b821ef-8fae-42b9-9055-a9ea7be955ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5419f8b4-31') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 19:12:04 user nova-compute[75216]: DEBUG os_vif [None req-677d0337-35ec-46f1-b922-249749508f7f tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9a:08:ac,bridge_name='br-int',has_traffic_filtering=True,id=5419f8b4-31da-434a-b131-6476134a71bf,network=Network(f8b821ef-8fae-42b9-9055-a9ea7be955ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5419f8b4-31') {{(pid=75216) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 19:12:04 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:12:04 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5419f8b4-31, bridge=br-int, if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:12:04 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:12:04 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:12:04 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:12:04 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=05650d0d-ec7f-4f1f-a7ff-7a75ae31e11e) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:12:04 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:12:04 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:12:04 user nova-compute[75216]: INFO os_vif [None req-677d0337-35ec-46f1-b922-249749508f7f tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9a:08:ac,bridge_name='br-int',has_traffic_filtering=True,id=5419f8b4-31da-434a-b131-6476134a71bf,network=Network(f8b821ef-8fae-42b9-9055-a9ea7be955ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5419f8b4-31')
Nov 13 19:12:04 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-677d0337-35ec-46f1-b922-249749508f7f tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1] Deleting instance files /opt/stack/data/nova/instances/f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1_del
Nov 13 19:12:04 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-677d0337-35ec-46f1-b922-249749508f7f tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1] Deletion of /opt/stack/data/nova/instances/f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1_del complete
Nov 13 19:12:04 user nova-compute[75216]: INFO nova.compute.manager [None req-677d0337-35ec-46f1-b922-249749508f7f tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] [instance: f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1] Took 0.94 seconds to destroy the instance on the hypervisor.
Nov 13 19:12:04 user nova-compute[75216]: DEBUG oslo.service.loopingcall [None req-677d0337-35ec-46f1-b922-249749508f7f tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75216) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 19:12:04 user nova-compute[75216]: DEBUG nova.compute.manager [-] [instance: f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1] Deallocating network for instance {{(pid=75216) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 19:12:04 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1] deallocate_for_instance() {{(pid=75216) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 19:12:04 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:12:04 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:12:04 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:12:05 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:12:05 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:12:05 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1] Updating instance_info_cache with network_info: [] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:12:05 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:12:05 user nova-compute[75216]: INFO nova.compute.manager [-] [instance: f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1] Took 0.52 seconds to deallocate network for instance.
Nov 13 19:12:05 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:12:05 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-677d0337-35ec-46f1-b922-249749508f7f tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:12:05 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-677d0337-35ec-46f1-b922-249749508f7f tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:12:05 user nova-compute[75216]: DEBUG nova.compute.manager [req-2f8425a3-484f-4f35-89dc-46cadcb68c19 req-9b793fe4-2e2e-4a0e-a8b8-48bf1808a126 service nova] [instance: f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1] Received event network-vif-deleted-5419f8b4-31da-434a-b131-6476134a71bf {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:12:05 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-677d0337-35ec-46f1-b922-249749508f7f tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 19:12:05 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-677d0337-35ec-46f1-b922-249749508f7f tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 19:12:05 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-677d0337-35ec-46f1-b922-249749508f7f tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.138s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:12:05 user nova-compute[75216]: INFO nova.scheduler.client.report [None req-677d0337-35ec-46f1-b922-249749508f7f tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Deleted allocations for instance f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1
Nov 13 19:12:05 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-677d0337-35ec-46f1-b922-249749508f7f tempest-ServerBootFromVolumeStableRescueTest-197527955 tempest-ServerBootFromVolumeStableRescueTest-197527955-project-member] Lock "f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.778s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:12:05 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:12:05 user nova-compute[75216]: DEBUG nova.compute.manager [req-d72c474c-063d-46af-87cf-69600b8da910 req-57659da2-a709-4527-9ac2-7ee5af6ac870 service nova] [instance: f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1] Received event network-vif-plugged-5419f8b4-31da-434a-b131-6476134a71bf {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:12:05 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-d72c474c-063d-46af-87cf-69600b8da910 req-57659da2-a709-4527-9ac2-7ee5af6ac870 service nova] Acquiring lock "f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:12:05 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-d72c474c-063d-46af-87cf-69600b8da910 req-57659da2-a709-4527-9ac2-7ee5af6ac870 service nova] Lock "f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:12:05 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-d72c474c-063d-46af-87cf-69600b8da910 req-57659da2-a709-4527-9ac2-7ee5af6ac870 service nova] Lock "f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:12:05 user nova-compute[75216]: DEBUG nova.compute.manager [req-d72c474c-063d-46af-87cf-69600b8da910 req-57659da2-a709-4527-9ac2-7ee5af6ac870 service nova] [instance: f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1] No waiting events found dispatching network-vif-plugged-5419f8b4-31da-434a-b131-6476134a71bf {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 19:12:05 user nova-compute[75216]: WARNING nova.compute.manager [req-d72c474c-063d-46af-87cf-69600b8da910 req-57659da2-a709-4527-9ac2-7ee5af6ac870 service nova] [instance: f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1] Received unexpected event network-vif-plugged-5419f8b4-31da-434a-b131-6476134a71bf for instance with vm_state deleted and task_state None.
Nov 13 19:12:05 user nova-compute[75216]: DEBUG nova.compute.manager [req-d72c474c-063d-46af-87cf-69600b8da910 req-57659da2-a709-4527-9ac2-7ee5af6ac870 service nova] [instance: f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1] Received event network-vif-plugged-5419f8b4-31da-434a-b131-6476134a71bf {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:12:05 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-d72c474c-063d-46af-87cf-69600b8da910 req-57659da2-a709-4527-9ac2-7ee5af6ac870 service nova] Acquiring lock "f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:12:05 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-d72c474c-063d-46af-87cf-69600b8da910 req-57659da2-a709-4527-9ac2-7ee5af6ac870 service nova] Lock "f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:12:05 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-d72c474c-063d-46af-87cf-69600b8da910 req-57659da2-a709-4527-9ac2-7ee5af6ac870 service nova] Lock "f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:12:05 user nova-compute[75216]: DEBUG nova.compute.manager [req-d72c474c-063d-46af-87cf-69600b8da910 req-57659da2-a709-4527-9ac2-7ee5af6ac870 service nova] [instance: f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1] No waiting events found dispatching network-vif-plugged-5419f8b4-31da-434a-b131-6476134a71bf {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 19:12:05 user nova-compute[75216]: WARNING nova.compute.manager [req-d72c474c-063d-46af-87cf-69600b8da910 req-57659da2-a709-4527-9ac2-7ee5af6ac870 service nova] [instance: f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1] Received unexpected event network-vif-plugged-5419f8b4-31da-434a-b131-6476134a71bf for instance with vm_state deleted and task_state None.
Nov 13 19:12:05 user nova-compute[75216]: DEBUG nova.compute.manager [req-d72c474c-063d-46af-87cf-69600b8da910 req-57659da2-a709-4527-9ac2-7ee5af6ac870 service nova] [instance: f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1] Received event network-vif-plugged-5419f8b4-31da-434a-b131-6476134a71bf {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:12:05 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-d72c474c-063d-46af-87cf-69600b8da910 req-57659da2-a709-4527-9ac2-7ee5af6ac870 service nova] Acquiring lock "f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:12:05 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-d72c474c-063d-46af-87cf-69600b8da910 req-57659da2-a709-4527-9ac2-7ee5af6ac870 service nova] Lock "f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:12:05 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-d72c474c-063d-46af-87cf-69600b8da910 req-57659da2-a709-4527-9ac2-7ee5af6ac870 service nova] Lock "f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:12:05 user nova-compute[75216]: DEBUG nova.compute.manager [req-d72c474c-063d-46af-87cf-69600b8da910 req-57659da2-a709-4527-9ac2-7ee5af6ac870 service nova] [instance: f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1] No waiting events found dispatching network-vif-plugged-5419f8b4-31da-434a-b131-6476134a71bf {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 19:12:05 user nova-compute[75216]: WARNING nova.compute.manager [req-d72c474c-063d-46af-87cf-69600b8da910 req-57659da2-a709-4527-9ac2-7ee5af6ac870 service nova] [instance: f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1] Received unexpected event network-vif-plugged-5419f8b4-31da-434a-b131-6476134a71bf for instance with vm_state deleted and task_state None.
Nov 13 19:12:05 user nova-compute[75216]: DEBUG nova.compute.manager [req-d72c474c-063d-46af-87cf-69600b8da910 req-57659da2-a709-4527-9ac2-7ee5af6ac870 service nova] [instance: f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1] Received event network-vif-unplugged-5419f8b4-31da-434a-b131-6476134a71bf {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:12:05 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-d72c474c-063d-46af-87cf-69600b8da910 req-57659da2-a709-4527-9ac2-7ee5af6ac870 service nova] Acquiring lock "f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:12:05 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-d72c474c-063d-46af-87cf-69600b8da910 req-57659da2-a709-4527-9ac2-7ee5af6ac870 service nova] Lock "f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:12:05 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-d72c474c-063d-46af-87cf-69600b8da910 req-57659da2-a709-4527-9ac2-7ee5af6ac870 service nova] Lock "f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:12:05 user nova-compute[75216]: DEBUG nova.compute.manager [req-d72c474c-063d-46af-87cf-69600b8da910 req-57659da2-a709-4527-9ac2-7ee5af6ac870 service nova] [instance: f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1] No waiting events found dispatching network-vif-unplugged-5419f8b4-31da-434a-b131-6476134a71bf {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 19:12:05 user nova-compute[75216]: WARNING nova.compute.manager [req-d72c474c-063d-46af-87cf-69600b8da910 req-57659da2-a709-4527-9ac2-7ee5af6ac870 service nova] [instance: f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1] Received unexpected event network-vif-unplugged-5419f8b4-31da-434a-b131-6476134a71bf for instance with vm_state deleted and task_state None.
Nov 13 19:12:05 user nova-compute[75216]: DEBUG nova.compute.manager [req-d72c474c-063d-46af-87cf-69600b8da910 req-57659da2-a709-4527-9ac2-7ee5af6ac870 service nova] [instance: f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1] Received event network-vif-plugged-5419f8b4-31da-434a-b131-6476134a71bf {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:12:05 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-d72c474c-063d-46af-87cf-69600b8da910 req-57659da2-a709-4527-9ac2-7ee5af6ac870 service nova] Acquiring lock "f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:12:05 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-d72c474c-063d-46af-87cf-69600b8da910 req-57659da2-a709-4527-9ac2-7ee5af6ac870 service nova] Lock "f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:12:05 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-d72c474c-063d-46af-87cf-69600b8da910 req-57659da2-a709-4527-9ac2-7ee5af6ac870 service nova] Lock "f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:12:05 user nova-compute[75216]: DEBUG nova.compute.manager [req-d72c474c-063d-46af-87cf-69600b8da910 req-57659da2-a709-4527-9ac2-7ee5af6ac870 service nova] [instance: f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1] No waiting events found dispatching network-vif-plugged-5419f8b4-31da-434a-b131-6476134a71bf {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 19:12:05 user nova-compute[75216]: WARNING nova.compute.manager [req-d72c474c-063d-46af-87cf-69600b8da910 req-57659da2-a709-4527-9ac2-7ee5af6ac870 service nova] [instance: f8fe69ca-e6e4-49b6-ac90-e86fdda36cd1] Received unexpected event network-vif-plugged-5419f8b4-31da-434a-b131-6476134a71bf for instance with vm_state deleted and task_state None.
Nov 13 19:12:06 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:12:06 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75216) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 19:12:06 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:12:06 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:12:06 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:12:06 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:12:06 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Auditing locally available compute resources for user (node: user) {{(pid=75216) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 19:12:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc2b6a17-b3bf-42da-ad68-2f125c952a31/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:12:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc2b6a17-b3bf-42da-ad68-2f125c952a31/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:12:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc2b6a17-b3bf-42da-ad68-2f125c952a31/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:12:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc2b6a17-b3bf-42da-ad68-2f125c952a31/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:12:07 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 19:12:07 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 19:12:07 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Hypervisor/Node resource view: name=user free_ram=8774MB free_disk=25.39138412475586GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75216) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 19:12:07 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:12:07 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:12:07 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance fc2b6a17-b3bf-42da-ad68-2f125c952a31 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 19:12:07 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 19:12:07 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 19:12:07 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 19:12:07 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 19:12:07 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Compute_service record updated for user:user {{(pid=75216) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 19:12:07 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.217s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:12:09 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:12:11 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:12:11 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Starting heal instance info cache {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 19:12:11 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Didn't find any instances for network info cache update. {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 13 19:12:11 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:12:14 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:12:14 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:12:14 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75216) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 19:12:14 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 19:12:14 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 19:12:14 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:12:19 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:12:20 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:12:22 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-ae7b8f22-835f-4465-b361-47bad9a87a31 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Acquiring lock "9e47d802-efdb-4763-8594-1ad056dbf6cc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:12:22 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-ae7b8f22-835f-4465-b361-47bad9a87a31 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Lock "9e47d802-efdb-4763-8594-1ad056dbf6cc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:12:22 user nova-compute[75216]: DEBUG nova.compute.manager [None req-ae7b8f22-835f-4465-b361-47bad9a87a31 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] [instance: 9e47d802-efdb-4763-8594-1ad056dbf6cc] Starting instance... {{(pid=75216) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 19:12:22 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-ae7b8f22-835f-4465-b361-47bad9a87a31 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:12:22 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-ae7b8f22-835f-4465-b361-47bad9a87a31 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:12:22 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-ae7b8f22-835f-4465-b361-47bad9a87a31 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75216) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 19:12:22 user nova-compute[75216]: INFO nova.compute.claims [None req-ae7b8f22-835f-4465-b361-47bad9a87a31 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] [instance: 9e47d802-efdb-4763-8594-1ad056dbf6cc] Claim successful on node user
Nov 13 19:12:22 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-ae7b8f22-835f-4465-b361-47bad9a87a31 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 19:12:22 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-ae7b8f22-835f-4465-b361-47bad9a87a31 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 19:12:22 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-ae7b8f22-835f-4465-b361-47bad9a87a31 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.220s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:12:22 user nova-compute[75216]: DEBUG nova.compute.manager [None req-ae7b8f22-835f-4465-b361-47bad9a87a31 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] [instance: 9e47d802-efdb-4763-8594-1ad056dbf6cc] Start building networks asynchronously for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 19:12:22 user nova-compute[75216]: DEBUG nova.compute.manager [None req-ae7b8f22-835f-4465-b361-47bad9a87a31 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] [instance: 9e47d802-efdb-4763-8594-1ad056dbf6cc] Allocating IP information in the background. {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 19:12:22 user nova-compute[75216]: DEBUG nova.network.neutron [None req-ae7b8f22-835f-4465-b361-47bad9a87a31 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] [instance: 9e47d802-efdb-4763-8594-1ad056dbf6cc] allocate_for_instance() {{(pid=75216) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 19:12:22 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-ae7b8f22-835f-4465-b361-47bad9a87a31 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] [instance: 9e47d802-efdb-4763-8594-1ad056dbf6cc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 19:12:22 user nova-compute[75216]: DEBUG nova.compute.manager [None req-ae7b8f22-835f-4465-b361-47bad9a87a31 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] [instance: 9e47d802-efdb-4763-8594-1ad056dbf6cc] Start building block device mappings for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 19:12:22 user nova-compute[75216]: DEBUG nova.policy [None req-ae7b8f22-835f-4465-b361-47bad9a87a31 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a7501ee4141241f2abc4d6bfce2924d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095f5765865140d29b3ecf1ab3427037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75216) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 19:12:22 user nova-compute[75216]: DEBUG nova.compute.manager [None req-ae7b8f22-835f-4465-b361-47bad9a87a31 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] [instance: 9e47d802-efdb-4763-8594-1ad056dbf6cc] Start spawning the instance on the hypervisor. {{(pid=75216) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 19:12:22 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-ae7b8f22-835f-4465-b361-47bad9a87a31 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] [instance: 9e47d802-efdb-4763-8594-1ad056dbf6cc] Creating instance directory {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 19:12:22 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-ae7b8f22-835f-4465-b361-47bad9a87a31 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] [instance: 9e47d802-efdb-4763-8594-1ad056dbf6cc] Creating image(s)
Nov 13 19:12:22 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-ae7b8f22-835f-4465-b361-47bad9a87a31 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Acquiring lock "/opt/stack/data/nova/instances/9e47d802-efdb-4763-8594-1ad056dbf6cc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:12:22 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-ae7b8f22-835f-4465-b361-47bad9a87a31 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Lock "/opt/stack/data/nova/instances/9e47d802-efdb-4763-8594-1ad056dbf6cc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:12:22 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-ae7b8f22-835f-4465-b361-47bad9a87a31 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Lock "/opt/stack/data/nova/instances/9e47d802-efdb-4763-8594-1ad056dbf6cc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:12:22 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-ae7b8f22-835f-4465-b361-47bad9a87a31 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:12:22 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-ae7b8f22-835f-4465-b361-47bad9a87a31 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json" returned: 0 in 0.176s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:12:22 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-ae7b8f22-835f-4465-b361-47bad9a87a31 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Acquiring lock "88c50a45bec9d6b0427462b3242b9b8e5f49c2b6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:12:22 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-ae7b8f22-835f-4465-b361-47bad9a87a31 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Lock "88c50a45bec9d6b0427462b3242b9b8e5f49c2b6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:12:22 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-ae7b8f22-835f-4465-b361-47bad9a87a31 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:12:23 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-ae7b8f22-835f-4465-b361-47bad9a87a31 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json" returned: 0 in 0.173s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:12:23 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-ae7b8f22-835f-4465-b361-47bad9a87a31 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6,backing_fmt=raw /opt/stack/data/nova/instances/9e47d802-efdb-4763-8594-1ad056dbf6cc/disk 1073741824 {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:12:23 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-ae7b8f22-835f-4465-b361-47bad9a87a31 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6,backing_fmt=raw /opt/stack/data/nova/instances/9e47d802-efdb-4763-8594-1ad056dbf6cc/disk 1073741824" returned: 0 in 0.054s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:12:23 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-ae7b8f22-835f-4465-b361-47bad9a87a31 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Lock "88c50a45bec9d6b0427462b3242b9b8e5f49c2b6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.233s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:12:23 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-ae7b8f22-835f-4465-b361-47bad9a87a31 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:12:23 user nova-compute[75216]: DEBUG nova.network.neutron [None req-ae7b8f22-835f-4465-b361-47bad9a87a31 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] [instance: 9e47d802-efdb-4763-8594-1ad056dbf6cc] Successfully created port: 637bd8e9-478b-462f-bb28-a0a32f7bb6cb {{(pid=75216) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 19:12:23 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-ae7b8f22-835f-4465-b361-47bad9a87a31 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json" returned: 0 in 0.177s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:12:23 user nova-compute[75216]: DEBUG nova.virt.disk.api [None req-ae7b8f22-835f-4465-b361-47bad9a87a31 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9e47d802-efdb-4763-8594-1ad056dbf6cc/disk. size=1073741824 {{(pid=75216) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 19:12:23 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-ae7b8f22-835f-4465-b361-47bad9a87a31 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e47d802-efdb-4763-8594-1ad056dbf6cc/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:12:23 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-ae7b8f22-835f-4465-b361-47bad9a87a31 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e47d802-efdb-4763-8594-1ad056dbf6cc/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:12:23 user nova-compute[75216]: DEBUG nova.virt.disk.api [None req-ae7b8f22-835f-4465-b361-47bad9a87a31 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Cannot resize image /opt/stack/data/nova/instances/9e47d802-efdb-4763-8594-1ad056dbf6cc/disk to a smaller size. {{(pid=75216) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 19:12:23 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-ae7b8f22-835f-4465-b361-47bad9a87a31 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] [instance: 9e47d802-efdb-4763-8594-1ad056dbf6cc] Created local disks {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 19:12:23 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-ae7b8f22-835f-4465-b361-47bad9a87a31 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] [instance: 9e47d802-efdb-4763-8594-1ad056dbf6cc] Ensure instance console log exists: /opt/stack/data/nova/instances/9e47d802-efdb-4763-8594-1ad056dbf6cc/console.log {{(pid=75216) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 19:12:23 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-ae7b8f22-835f-4465-b361-47bad9a87a31 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:12:23 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-ae7b8f22-835f-4465-b361-47bad9a87a31 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:12:23 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-ae7b8f22-835f-4465-b361-47bad9a87a31 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:12:23 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f53a3730-c20b-4473-973d-fb6c78f50698 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Acquiring lock "fc2b6a17-b3bf-42da-ad68-2f125c952a31" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:12:23 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f53a3730-c20b-4473-973d-fb6c78f50698 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Lock "fc2b6a17-b3bf-42da-ad68-2f125c952a31" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:12:23 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f53a3730-c20b-4473-973d-fb6c78f50698 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Acquiring lock "fc2b6a17-b3bf-42da-ad68-2f125c952a31-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:12:23 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f53a3730-c20b-4473-973d-fb6c78f50698 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Lock "fc2b6a17-b3bf-42da-ad68-2f125c952a31-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:12:23 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f53a3730-c20b-4473-973d-fb6c78f50698 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Lock "fc2b6a17-b3bf-42da-ad68-2f125c952a31-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:12:23 user nova-compute[75216]: INFO nova.compute.manager [None req-f53a3730-c20b-4473-973d-fb6c78f50698 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] [instance: fc2b6a17-b3bf-42da-ad68-2f125c952a31] Terminating instance
Nov 13 19:12:23 user nova-compute[75216]: DEBUG nova.compute.manager [None req-f53a3730-c20b-4473-973d-fb6c78f50698 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] [instance: fc2b6a17-b3bf-42da-ad68-2f125c952a31] Start destroying the instance on the hypervisor. {{(pid=75216) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 19:12:23 user nova-compute[75216]: DEBUG nova.network.neutron [None req-ae7b8f22-835f-4465-b361-47bad9a87a31 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] [instance: 9e47d802-efdb-4763-8594-1ad056dbf6cc] Successfully updated port: 637bd8e9-478b-462f-bb28-a0a32f7bb6cb {{(pid=75216) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 19:12:23 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-ae7b8f22-835f-4465-b361-47bad9a87a31 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Acquiring lock "refresh_cache-9e47d802-efdb-4763-8594-1ad056dbf6cc" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 19:12:23 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-ae7b8f22-835f-4465-b361-47bad9a87a31 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Acquired lock "refresh_cache-9e47d802-efdb-4763-8594-1ad056dbf6cc" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 19:12:23 user nova-compute[75216]: DEBUG nova.network.neutron [None req-ae7b8f22-835f-4465-b361-47bad9a87a31 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] [instance: 9e47d802-efdb-4763-8594-1ad056dbf6cc] Building network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 19:12:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:12:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:12:23 user nova-compute[75216]: DEBUG nova.compute.manager [req-d4e8a124-a599-4eda-8ad2-e42cb798b9d2 req-59ed239d-06d9-40e3-baeb-2a5c13857c9d service nova] [instance: 9e47d802-efdb-4763-8594-1ad056dbf6cc] Received event network-changed-637bd8e9-478b-462f-bb28-a0a32f7bb6cb {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:12:23 user nova-compute[75216]: DEBUG nova.compute.manager [req-d4e8a124-a599-4eda-8ad2-e42cb798b9d2 req-59ed239d-06d9-40e3-baeb-2a5c13857c9d service nova] [instance: 9e47d802-efdb-4763-8594-1ad056dbf6cc] Refreshing instance network info cache due to event network-changed-637bd8e9-478b-462f-bb28-a0a32f7bb6cb. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 19:12:23 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-d4e8a124-a599-4eda-8ad2-e42cb798b9d2 req-59ed239d-06d9-40e3-baeb-2a5c13857c9d service nova] Acquiring lock "refresh_cache-9e47d802-efdb-4763-8594-1ad056dbf6cc" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 19:12:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:12:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:12:23 user nova-compute[75216]: DEBUG nova.network.neutron [None req-ae7b8f22-835f-4465-b361-47bad9a87a31 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] [instance: 9e47d802-efdb-4763-8594-1ad056dbf6cc] Instance cache missing network info. {{(pid=75216) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 19:12:24 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:12:24 user nova-compute[75216]: DEBUG nova.network.neutron [None req-ae7b8f22-835f-4465-b361-47bad9a87a31 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] [instance: 9e47d802-efdb-4763-8594-1ad056dbf6cc] Updating instance_info_cache with network_info: [{"id": "637bd8e9-478b-462f-bb28-a0a32f7bb6cb", "address": "fa:16:3e:ca:d7:9f", "network": {"id": "53bb01d5-31a4-47af-a931-ac12fe72b986", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-802892643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "095f5765865140d29b3ecf1ab3427037", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap637bd8e9-47", "ovs_interfaceid": "637bd8e9-478b-462f-bb28-a0a32f7bb6cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:12:24 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-ae7b8f22-835f-4465-b361-47bad9a87a31 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Releasing lock "refresh_cache-9e47d802-efdb-4763-8594-1ad056dbf6cc" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 19:12:24 user nova-compute[75216]: DEBUG nova.compute.manager [None req-ae7b8f22-835f-4465-b361-47bad9a87a31 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] [instance: 9e47d802-efdb-4763-8594-1ad056dbf6cc] Instance network_info: |[{"id": "637bd8e9-478b-462f-bb28-a0a32f7bb6cb", "address": "fa:16:3e:ca:d7:9f", "network": {"id": "53bb01d5-31a4-47af-a931-ac12fe72b986", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-802892643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "095f5765865140d29b3ecf1ab3427037", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap637bd8e9-47", "ovs_interfaceid": "637bd8e9-478b-462f-bb28-a0a32f7bb6cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 19:12:24 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-d4e8a124-a599-4eda-8ad2-e42cb798b9d2 req-59ed239d-06d9-40e3-baeb-2a5c13857c9d service nova] Acquired lock "refresh_cache-9e47d802-efdb-4763-8594-1ad056dbf6cc" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 19:12:24 user nova-compute[75216]: DEBUG nova.network.neutron [req-d4e8a124-a599-4eda-8ad2-e42cb798b9d2 req-59ed239d-06d9-40e3-baeb-2a5c13857c9d service nova] [instance: 9e47d802-efdb-4763-8594-1ad056dbf6cc] Refreshing network info cache for port 637bd8e9-478b-462f-bb28-a0a32f7bb6cb {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 19:12:24 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-ae7b8f22-835f-4465-b361-47bad9a87a31 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] [instance: 9e47d802-efdb-4763-8594-1ad056dbf6cc] Start _get_guest_xml network_info=[{"id": "637bd8e9-478b-462f-bb28-a0a32f7bb6cb", "address": "fa:16:3e:ca:d7:9f", "network": {"id": "53bb01d5-31a4-47af-a931-ac12fe72b986", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-802892643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "095f5765865140d29b3ecf1ab3427037", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap637bd8e9-47", "ovs_interfaceid": "637bd8e9-478b-462f-bb28-a0a32f7bb6cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T18:41:06Z,direct_url=<?>,disk_format='qcow2',id=77bcb5ba-8510-41ec-a88d-96097bb431de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c465b7c26ec44582b6d1b7169536ecc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T18:41:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'guest_format': None, 'boot_index': 0, 'image_id': '77bcb5ba-8510-41ec-a88d-96097bb431de'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 19:12:24 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: fc2b6a17-b3bf-42da-ad68-2f125c952a31] Instance destroyed successfully.
Nov 13 19:12:24 user nova-compute[75216]: DEBUG nova.objects.instance [None req-f53a3730-c20b-4473-973d-fb6c78f50698 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Lazy-loading 'resources' on Instance uuid fc2b6a17-b3bf-42da-ad68-2f125c952a31 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:12:24 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-ae7b8f22-835f-4465-b361-47bad9a87a31 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 19:12:24 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-ae7b8f22-835f-4465-b361-47bad9a87a31 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 19:12:24 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-f53a3730-c20b-4473-973d-fb6c78f50698 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-13T19:06:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1100425294',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1100425294',id=34,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLQQ4b0ZgFgW0WLUck0T8rTYpv9XskxQgqhkS9uzqraM7b70xziVxvyZlVKxIrkuAfXiPHYbxqzjoM3edHEog9CZ0MEhMfcDmXiqrq1oF6XaoxsWh3j2G+HncdUW44bIuw==',key_name='tempest-keypair-569881079',keypairs=<?>,launch_index=0,launched_at=2023-11-13T19:10:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a58d1e76a793406bbdd3821ff74abd92',ramdisk_id='',reservation_id='r-ie2w7xdd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1861834155',owner_user_name='tempest-AttachVolumeShelveTestJSON-1861834155-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T19:10:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e59bd525db64698b8e3587734cde6b8',uuid=fc2b6a17-b3bf-42da-ad68-2f125c952a31,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4621e43a-a523-4506-8520-bcca759faa35", "address": "fa:16:3e:58:6e:5f", "network": {"id": "8cbeb1cc-a067-4c8d-82d8-0dc5c2ac924c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-742672345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a58d1e76a793406bbdd3821ff74abd92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4621e43a-a5", "ovs_interfaceid": "4621e43a-a523-4506-8520-bcca759faa35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 19:12:24 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-f53a3730-c20b-4473-973d-fb6c78f50698 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Converting VIF {"id": "4621e43a-a523-4506-8520-bcca759faa35", "address": "fa:16:3e:58:6e:5f", "network": {"id": "8cbeb1cc-a067-4c8d-82d8-0dc5c2ac924c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-742672345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a58d1e76a793406bbdd3821ff74abd92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4621e43a-a5", "ovs_interfaceid": "4621e43a-a523-4506-8520-bcca759faa35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 19:12:24 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-f53a3730-c20b-4473-973d-fb6c78f50698 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:6e:5f,bridge_name='br-int',has_traffic_filtering=True,id=4621e43a-a523-4506-8520-bcca759faa35,network=Network(8cbeb1cc-a067-4c8d-82d8-0dc5c2ac924c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4621e43a-a5') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 19:12:24 user nova-compute[75216]: DEBUG os_vif [None req-f53a3730-c20b-4473-973d-fb6c78f50698 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:6e:5f,bridge_name='br-int',has_traffic_filtering=True,id=4621e43a-a523-4506-8520-bcca759faa35,network=Network(8cbeb1cc-a067-4c8d-82d8-0dc5c2ac924c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4621e43a-a5') {{(pid=75216) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 19:12:24 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-ae7b8f22-835f-4465-b361-47bad9a87a31 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 19:12:24 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-ae7b8f22-835f-4465-b361-47bad9a87a31 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] CPU controller missing on host. {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 19:12:24 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:12:24 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4621e43a-a5, bridge=br-int, if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:12:24 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:12:24 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:12:24 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:12:24 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=612b7580-86ce-41f3-a6e4-3219d1639db5) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:12:24 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:12:24 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-ae7b8f22-835f-4465-b361-47bad9a87a31 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 19:12:24 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-ae7b8f22-835f-4465-b361-47bad9a87a31 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] CPU controller found on host. {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 19:12:24 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-ae7b8f22-835f-4465-b361-47bad9a87a31 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75216) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 19:12:24 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-ae7b8f22-835f-4465-b361-47bad9a87a31 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T18:40:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T18:41:06Z,direct_url=<?>,disk_format='qcow2',id=77bcb5ba-8510-41ec-a88d-96097bb431de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c465b7c26ec44582b6d1b7169536ecc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T18:41:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 19:12:24 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-ae7b8f22-835f-4465-b361-47bad9a87a31 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Flavor limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 19:12:24 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-ae7b8f22-835f-4465-b361-47bad9a87a31 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Image limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 19:12:24 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-ae7b8f22-835f-4465-b361-47bad9a87a31 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Flavor pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 19:12:24 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-ae7b8f22-835f-4465-b361-47bad9a87a31 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Image pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 19:12:24 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-ae7b8f22-835f-4465-b361-47bad9a87a31 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 19:12:24 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-ae7b8f22-835f-4465-b361-47bad9a87a31 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 19:12:24 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-ae7b8f22-835f-4465-b361-47bad9a87a31 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 19:12:24 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-ae7b8f22-835f-4465-b361-47bad9a87a31 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Got 1 possible topologies {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 19:12:24 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-ae7b8f22-835f-4465-b361-47bad9a87a31 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 19:12:24 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-ae7b8f22-835f-4465-b361-47bad9a87a31 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 19:12:24 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-ae7b8f22-835f-4465-b361-47bad9a87a31 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T19:12:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1557089972',display_name='tempest-AttachVolumeTestJSON-server-1557089972',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1557089972',id=36,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNbWl+8qhnIKRIeXz4I/Q/qE/2kGUo5THWow9wnS+nJTRjHFzS4E0Zu5UKGIVTLYFykzZoZ1ujghv6D6EnbijAin6BMgn+7uQzLfHrznPwqbwDzZCCWXrjpWaLho+Z2BoQ==',key_name='tempest-keypair-286716216',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='095f5765865140d29b3ecf1ab3427037',ramdisk_id='',reservation_id='r-3e1wdhw7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-156429078',owner_user_name='tempest-AttachVolumeTestJSON-156429078-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T19:12:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a7501ee4141241f2abc4d6bfce2924d4',uuid=9e47d802-efdb-4763-8594-1ad056dbf6cc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "637bd8e9-478b-462f-bb28-a0a32f7bb6cb", "address": "fa:16:3e:ca:d7:9f", "network": {"id": "53bb01d5-31a4-47af-a931-ac12fe72b986", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-802892643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "095f5765865140d29b3ecf1ab3427037", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap637bd8e9-47", "ovs_interfaceid": "637bd8e9-478b-462f-bb28-a0a32f7bb6cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75216) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 19:12:24 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-ae7b8f22-835f-4465-b361-47bad9a87a31 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Converting VIF {"id": "637bd8e9-478b-462f-bb28-a0a32f7bb6cb", "address": "fa:16:3e:ca:d7:9f", "network": {"id": "53bb01d5-31a4-47af-a931-ac12fe72b986", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-802892643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "095f5765865140d29b3ecf1ab3427037", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap637bd8e9-47", "ovs_interfaceid": "637bd8e9-478b-462f-bb28-a0a32f7bb6cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 19:12:24 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-ae7b8f22-835f-4465-b361-47bad9a87a31 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:d7:9f,bridge_name='br-int',has_traffic_filtering=True,id=637bd8e9-478b-462f-bb28-a0a32f7bb6cb,network=Network(53bb01d5-31a4-47af-a931-ac12fe72b986),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap637bd8e9-47') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 19:12:24 user nova-compute[75216]: DEBUG nova.objects.instance [None req-ae7b8f22-835f-4465-b361-47bad9a87a31 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Lazy-loading 'pci_devices' on Instance uuid 9e47d802-efdb-4763-8594-1ad056dbf6cc {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:12:24 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:12:24 user nova-compute[75216]: INFO os_vif [None req-f53a3730-c20b-4473-973d-fb6c78f50698 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:6e:5f,bridge_name='br-int',has_traffic_filtering=True,id=4621e43a-a523-4506-8520-bcca759faa35,network=Network(8cbeb1cc-a067-4c8d-82d8-0dc5c2ac924c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4621e43a-a5')
Nov 13 19:12:24 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-f53a3730-c20b-4473-973d-fb6c78f50698 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] [instance: fc2b6a17-b3bf-42da-ad68-2f125c952a31] Deleting instance files /opt/stack/data/nova/instances/fc2b6a17-b3bf-42da-ad68-2f125c952a31_del
Nov 13 19:12:24 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-f53a3730-c20b-4473-973d-fb6c78f50698 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] [instance: fc2b6a17-b3bf-42da-ad68-2f125c952a31] Deletion of /opt/stack/data/nova/instances/fc2b6a17-b3bf-42da-ad68-2f125c952a31_del complete
Nov 13 19:12:24 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-ae7b8f22-835f-4465-b361-47bad9a87a31 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] [instance: 9e47d802-efdb-4763-8594-1ad056dbf6cc] End _get_guest_xml xml=<domain type="kvm">
Nov 13 19:12:24 user nova-compute[75216]:   <uuid>9e47d802-efdb-4763-8594-1ad056dbf6cc</uuid>
Nov 13 19:12:24 user nova-compute[75216]:   <name>instance-00000024</name>
Nov 13 19:12:24 user nova-compute[75216]:   <memory>524288</memory>
Nov 13 19:12:24 user nova-compute[75216]:   <vcpu>1</vcpu>
Nov 13 19:12:24 user nova-compute[75216]:   <metadata>
Nov 13 19:12:24 user nova-compute[75216]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 19:12:24 user nova-compute[75216]:       <nova:package version="0.0.0"/>
Nov 13 19:12:24 user nova-compute[75216]:       <nova:name>tempest-AttachVolumeTestJSON-server-1557089972</nova:name>
Nov 13 19:12:24 user nova-compute[75216]:       <nova:creationTime>2023-11-13 19:12:24</nova:creationTime>
Nov 13 19:12:24 user nova-compute[75216]:       <nova:flavor name="m1.tiny">
Nov 13 19:12:24 user nova-compute[75216]:         <nova:memory>512</nova:memory>
Nov 13 19:12:24 user nova-compute[75216]:         <nova:disk>1</nova:disk>
Nov 13 19:12:24 user nova-compute[75216]:         <nova:swap>0</nova:swap>
Nov 13 19:12:24 user nova-compute[75216]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 19:12:24 user nova-compute[75216]:         <nova:vcpus>1</nova:vcpus>
Nov 13 19:12:24 user nova-compute[75216]:       </nova:flavor>
Nov 13 19:12:24 user nova-compute[75216]:       <nova:owner>
Nov 13 19:12:24 user nova-compute[75216]:         <nova:user uuid="a7501ee4141241f2abc4d6bfce2924d4">tempest-AttachVolumeTestJSON-156429078-project-member</nova:user>
Nov 13 19:12:24 user nova-compute[75216]:         <nova:project uuid="095f5765865140d29b3ecf1ab3427037">tempest-AttachVolumeTestJSON-156429078</nova:project>
Nov 13 19:12:24 user nova-compute[75216]:       </nova:owner>
Nov 13 19:12:24 user nova-compute[75216]:       <nova:root type="image" uuid="77bcb5ba-8510-41ec-a88d-96097bb431de"/>
Nov 13 19:12:24 user nova-compute[75216]:       <nova:ports>
Nov 13 19:12:24 user nova-compute[75216]:         <nova:port uuid="637bd8e9-478b-462f-bb28-a0a32f7bb6cb">
Nov 13 19:12:24 user nova-compute[75216]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 13 19:12:24 user nova-compute[75216]:         </nova:port>
Nov 13 19:12:24 user nova-compute[75216]:       </nova:ports>
Nov 13 19:12:24 user nova-compute[75216]:     </nova:instance>
Nov 13 19:12:24 user nova-compute[75216]:   </metadata>
Nov 13 19:12:24 user nova-compute[75216]:   <sysinfo type="smbios">
Nov 13 19:12:24 user nova-compute[75216]:     <system>
Nov 13 19:12:24 user nova-compute[75216]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 19:12:24 user nova-compute[75216]:       <entry name="product">OpenStack Nova</entry>
Nov 13 19:12:24 user nova-compute[75216]:       <entry name="version">0.0.0</entry>
Nov 13 19:12:24 user nova-compute[75216]:       <entry name="serial">9e47d802-efdb-4763-8594-1ad056dbf6cc</entry>
Nov 13 19:12:24 user nova-compute[75216]:       <entry name="uuid">9e47d802-efdb-4763-8594-1ad056dbf6cc</entry>
Nov 13 19:12:24 user nova-compute[75216]:       <entry name="family">Virtual Machine</entry>
Nov 13 19:12:24 user nova-compute[75216]:     </system>
Nov 13 19:12:24 user nova-compute[75216]:   </sysinfo>
Nov 13 19:12:24 user nova-compute[75216]:   <os>
Nov 13 19:12:24 user nova-compute[75216]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 19:12:24 user nova-compute[75216]:     <boot dev="hd"/>
Nov 13 19:12:24 user nova-compute[75216]:     <smbios mode="sysinfo"/>
Nov 13 19:12:24 user nova-compute[75216]:   </os>
Nov 13 19:12:24 user nova-compute[75216]:   <features>
Nov 13 19:12:24 user nova-compute[75216]:     <acpi/>
Nov 13 19:12:24 user nova-compute[75216]:     <apic/>
Nov 13 19:12:24 user nova-compute[75216]:     <vmcoreinfo/>
Nov 13 19:12:24 user nova-compute[75216]:   </features>
Nov 13 19:12:24 user nova-compute[75216]:   <clock offset="utc">
Nov 13 19:12:24 user nova-compute[75216]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 19:12:24 user nova-compute[75216]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 19:12:24 user nova-compute[75216]:     <timer name="hpet" present="no"/>
Nov 13 19:12:24 user nova-compute[75216]:   </clock>
Nov 13 19:12:24 user nova-compute[75216]:   <cpu mode="custom" match="exact">
Nov 13 19:12:24 user nova-compute[75216]:     <model>Nehalem</model>
Nov 13 19:12:24 user nova-compute[75216]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 19:12:24 user nova-compute[75216]:   </cpu>
Nov 13 19:12:24 user nova-compute[75216]:   <devices>
Nov 13 19:12:24 user nova-compute[75216]:     <disk type="file" device="disk">
Nov 13 19:12:24 user nova-compute[75216]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 19:12:24 user nova-compute[75216]:       <source file="/opt/stack/data/nova/instances/9e47d802-efdb-4763-8594-1ad056dbf6cc/disk"/>
Nov 13 19:12:24 user nova-compute[75216]:       <target dev="vda" bus="virtio"/>
Nov 13 19:12:24 user nova-compute[75216]:     </disk>
Nov 13 19:12:24 user nova-compute[75216]:     <interface type="ethernet">
Nov 13 19:12:24 user nova-compute[75216]:       <mac address="fa:16:3e:ca:d7:9f"/>
Nov 13 19:12:24 user nova-compute[75216]:       <model type="virtio"/>
Nov 13 19:12:24 user nova-compute[75216]:       <mtu size="1442"/>
Nov 13 19:12:24 user nova-compute[75216]:       <target dev="tap637bd8e9-47"/>
Nov 13 19:12:24 user nova-compute[75216]:     </interface>
Nov 13 19:12:24 user nova-compute[75216]:     <serial type="pty">
Nov 13 19:12:24 user nova-compute[75216]:       <log file="/opt/stack/data/nova/instances/9e47d802-efdb-4763-8594-1ad056dbf6cc/console.log" append="off"/>
Nov 13 19:12:24 user nova-compute[75216]:     </serial>
Nov 13 19:12:24 user nova-compute[75216]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 19:12:24 user nova-compute[75216]:     <video>
Nov 13 19:12:24 user nova-compute[75216]:       <model type="virtio"/>
Nov 13 19:12:24 user nova-compute[75216]:     </video>
Nov 13 19:12:24 user nova-compute[75216]:     <rng model="virtio">
Nov 13 19:12:24 user nova-compute[75216]:       <backend model="random">/dev/urandom</backend>
Nov 13 19:12:24 user nova-compute[75216]:     </rng>
Nov 13 19:12:24 user nova-compute[75216]:     <controller type="usb" index="0" model="none"/>
Nov 13 19:12:24 user nova-compute[75216]:     <memballoon model="virtio">
Nov 13 19:12:24 user nova-compute[75216]:       <stats period="10"/>
Nov 13 19:12:24 user nova-compute[75216]:     </memballoon>
Nov 13 19:12:24 user nova-compute[75216]:   </devices>
Nov 13 19:12:24 user nova-compute[75216]: </domain>
Nov 13 19:12:24 user nova-compute[75216]:  {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 19:12:24 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-ae7b8f22-835f-4465-b361-47bad9a87a31 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T19:12:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1557089972',display_name='tempest-AttachVolumeTestJSON-server-1557089972',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1557089972',id=36,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNbWl+8qhnIKRIeXz4I/Q/qE/2kGUo5THWow9wnS+nJTRjHFzS4E0Zu5UKGIVTLYFykzZoZ1ujghv6D6EnbijAin6BMgn+7uQzLfHrznPwqbwDzZCCWXrjpWaLho+Z2BoQ==',key_name='tempest-keypair-286716216',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='095f5765865140d29b3ecf1ab3427037',ramdisk_id='',reservation_id='r-3e1wdhw7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-156429078',owner_user_name='tempest-AttachVolumeTestJSON-156429078-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T19:12:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a7501ee4141241f2abc4d6bfce2924d4',uuid=9e47d802-efdb-4763-8594-1ad056dbf6cc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "637bd8e9-478b-462f-bb28-a0a32f7bb6cb", "address": "fa:16:3e:ca:d7:9f", "network": {"id": "53bb01d5-31a4-47af-a931-ac12fe72b986", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-802892643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "095f5765865140d29b3ecf1ab3427037", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap637bd8e9-47", "ovs_interfaceid": "637bd8e9-478b-462f-bb28-a0a32f7bb6cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 19:12:24 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-ae7b8f22-835f-4465-b361-47bad9a87a31 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Converting VIF {"id": "637bd8e9-478b-462f-bb28-a0a32f7bb6cb", "address": "fa:16:3e:ca:d7:9f", "network": {"id": "53bb01d5-31a4-47af-a931-ac12fe72b986", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-802892643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "095f5765865140d29b3ecf1ab3427037", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap637bd8e9-47", "ovs_interfaceid": "637bd8e9-478b-462f-bb28-a0a32f7bb6cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 19:12:24 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-ae7b8f22-835f-4465-b361-47bad9a87a31 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:d7:9f,bridge_name='br-int',has_traffic_filtering=True,id=637bd8e9-478b-462f-bb28-a0a32f7bb6cb,network=Network(53bb01d5-31a4-47af-a931-ac12fe72b986),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap637bd8e9-47') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 19:12:24 user nova-compute[75216]: DEBUG os_vif [None req-ae7b8f22-835f-4465-b361-47bad9a87a31 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:d7:9f,bridge_name='br-int',has_traffic_filtering=True,id=637bd8e9-478b-462f-bb28-a0a32f7bb6cb,network=Network(53bb01d5-31a4-47af-a931-ac12fe72b986),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap637bd8e9-47') {{(pid=75216) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 19:12:24 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:12:24 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:12:24 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 19:12:24 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:12:24 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a4f735c3-2077-58f3-b2bf-5d35f6e7f521', '_type': 'linux-noop'}}, row=False) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:12:24 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:12:24 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:12:24 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:12:24 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap637bd8e9-47, may_exist=True, interface_attrs={}) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:12:24 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap637bd8e9-47, col_values=(('qos', UUID('0d305c1f-4846-4261-9604-25c951df04d3')),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:12:24 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap637bd8e9-47, col_values=(('external_ids', {'iface-id': '637bd8e9-478b-462f-bb28-a0a32f7bb6cb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ca:d7:9f', 'vm-uuid': '9e47d802-efdb-4763-8594-1ad056dbf6cc'}),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:12:24 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:12:24 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:12:24 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:12:24 user nova-compute[75216]: INFO os_vif [None req-ae7b8f22-835f-4465-b361-47bad9a87a31 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:d7:9f,bridge_name='br-int',has_traffic_filtering=True,id=637bd8e9-478b-462f-bb28-a0a32f7bb6cb,network=Network(53bb01d5-31a4-47af-a931-ac12fe72b986),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap637bd8e9-47')
Nov 13 19:12:24 user nova-compute[75216]: INFO nova.compute.manager [None req-f53a3730-c20b-4473-973d-fb6c78f50698 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] [instance: fc2b6a17-b3bf-42da-ad68-2f125c952a31] Took 0.73 seconds to destroy the instance on the hypervisor.
Nov 13 19:12:24 user nova-compute[75216]: DEBUG oslo.service.loopingcall [None req-f53a3730-c20b-4473-973d-fb6c78f50698 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75216) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 19:12:24 user nova-compute[75216]: DEBUG nova.compute.manager [-] [instance: fc2b6a17-b3bf-42da-ad68-2f125c952a31] Deallocating network for instance {{(pid=75216) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 19:12:24 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: fc2b6a17-b3bf-42da-ad68-2f125c952a31] deallocate_for_instance() {{(pid=75216) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 19:12:24 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-ae7b8f22-835f-4465-b361-47bad9a87a31 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 19:12:24 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-ae7b8f22-835f-4465-b361-47bad9a87a31 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] No VIF found with MAC fa:16:3e:ca:d7:9f, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 19:12:25 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: fc2b6a17-b3bf-42da-ad68-2f125c952a31] Updating instance_info_cache with network_info: [] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:12:25 user nova-compute[75216]: INFO nova.compute.manager [-] [instance: fc2b6a17-b3bf-42da-ad68-2f125c952a31] Took 0.62 seconds to deallocate network for instance.
Nov 13 19:12:25 user nova-compute[75216]: DEBUG nova.compute.manager [req-87104dfe-f14e-444a-a133-4f7a8d0f0e1b req-3a9917f6-5b39-4df8-b8f5-8d355ba8d927 service nova] [instance: fc2b6a17-b3bf-42da-ad68-2f125c952a31] Received event network-vif-deleted-4621e43a-a523-4506-8520-bcca759faa35 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:12:25 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f53a3730-c20b-4473-973d-fb6c78f50698 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:12:25 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f53a3730-c20b-4473-973d-fb6c78f50698 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:12:25 user nova-compute[75216]: DEBUG nova.network.neutron [req-d4e8a124-a599-4eda-8ad2-e42cb798b9d2 req-59ed239d-06d9-40e3-baeb-2a5c13857c9d service nova] [instance: 9e47d802-efdb-4763-8594-1ad056dbf6cc] Updated VIF entry in instance network info cache for port 637bd8e9-478b-462f-bb28-a0a32f7bb6cb. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 19:12:25 user nova-compute[75216]: DEBUG nova.network.neutron [req-d4e8a124-a599-4eda-8ad2-e42cb798b9d2 req-59ed239d-06d9-40e3-baeb-2a5c13857c9d service nova] [instance: 9e47d802-efdb-4763-8594-1ad056dbf6cc] Updating instance_info_cache with network_info: [{"id": "637bd8e9-478b-462f-bb28-a0a32f7bb6cb", "address": "fa:16:3e:ca:d7:9f", "network": {"id": "53bb01d5-31a4-47af-a931-ac12fe72b986", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-802892643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "095f5765865140d29b3ecf1ab3427037", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap637bd8e9-47", "ovs_interfaceid": "637bd8e9-478b-462f-bb28-a0a32f7bb6cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:12:25 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-d4e8a124-a599-4eda-8ad2-e42cb798b9d2 req-59ed239d-06d9-40e3-baeb-2a5c13857c9d service nova] Releasing lock "refresh_cache-9e47d802-efdb-4763-8594-1ad056dbf6cc" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 19:12:25 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-f53a3730-c20b-4473-973d-fb6c78f50698 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 19:12:25 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-f53a3730-c20b-4473-973d-fb6c78f50698 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 19:12:25 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f53a3730-c20b-4473-973d-fb6c78f50698 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.134s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:12:25 user nova-compute[75216]: INFO nova.scheduler.client.report [None req-f53a3730-c20b-4473-973d-fb6c78f50698 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Deleted allocations for instance fc2b6a17-b3bf-42da-ad68-2f125c952a31
Nov 13 19:12:25 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f53a3730-c20b-4473-973d-fb6c78f50698 tempest-AttachVolumeShelveTestJSON-1861834155 tempest-AttachVolumeShelveTestJSON-1861834155-project-member] Lock "fc2b6a17-b3bf-42da-ad68-2f125c952a31" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.662s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:12:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:12:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:12:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:12:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:12:25 user nova-compute[75216]: DEBUG nova.compute.manager [req-8fe6525e-0921-4c72-b007-ddba987215c4 req-85aeada4-c918-4a4a-9a1f-d5e21615c8da service nova] [instance: fc2b6a17-b3bf-42da-ad68-2f125c952a31] Received event network-vif-unplugged-4621e43a-a523-4506-8520-bcca759faa35 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:12:25 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-8fe6525e-0921-4c72-b007-ddba987215c4 req-85aeada4-c918-4a4a-9a1f-d5e21615c8da service nova] Acquiring lock "fc2b6a17-b3bf-42da-ad68-2f125c952a31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:12:25 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-8fe6525e-0921-4c72-b007-ddba987215c4 req-85aeada4-c918-4a4a-9a1f-d5e21615c8da service nova] Lock "fc2b6a17-b3bf-42da-ad68-2f125c952a31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:12:25 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-8fe6525e-0921-4c72-b007-ddba987215c4 req-85aeada4-c918-4a4a-9a1f-d5e21615c8da service nova] Lock "fc2b6a17-b3bf-42da-ad68-2f125c952a31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:12:25 user nova-compute[75216]: DEBUG nova.compute.manager [req-8fe6525e-0921-4c72-b007-ddba987215c4 req-85aeada4-c918-4a4a-9a1f-d5e21615c8da service nova] [instance: fc2b6a17-b3bf-42da-ad68-2f125c952a31] No waiting events found dispatching network-vif-unplugged-4621e43a-a523-4506-8520-bcca759faa35 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 19:12:25 user nova-compute[75216]: WARNING nova.compute.manager [req-8fe6525e-0921-4c72-b007-ddba987215c4 req-85aeada4-c918-4a4a-9a1f-d5e21615c8da service nova] [instance: fc2b6a17-b3bf-42da-ad68-2f125c952a31] Received unexpected event network-vif-unplugged-4621e43a-a523-4506-8520-bcca759faa35 for instance with vm_state deleted and task_state None.
Nov 13 19:12:25 user nova-compute[75216]: DEBUG nova.compute.manager [req-8fe6525e-0921-4c72-b007-ddba987215c4 req-85aeada4-c918-4a4a-9a1f-d5e21615c8da service nova] [instance: fc2b6a17-b3bf-42da-ad68-2f125c952a31] Received event network-vif-plugged-4621e43a-a523-4506-8520-bcca759faa35 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:12:25 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-8fe6525e-0921-4c72-b007-ddba987215c4 req-85aeada4-c918-4a4a-9a1f-d5e21615c8da service nova] Acquiring lock "fc2b6a17-b3bf-42da-ad68-2f125c952a31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:12:25 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-8fe6525e-0921-4c72-b007-ddba987215c4 req-85aeada4-c918-4a4a-9a1f-d5e21615c8da service nova] Lock "fc2b6a17-b3bf-42da-ad68-2f125c952a31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:12:25 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-8fe6525e-0921-4c72-b007-ddba987215c4 req-85aeada4-c918-4a4a-9a1f-d5e21615c8da service nova] Lock "fc2b6a17-b3bf-42da-ad68-2f125c952a31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:12:25 user nova-compute[75216]: DEBUG nova.compute.manager [req-8fe6525e-0921-4c72-b007-ddba987215c4 req-85aeada4-c918-4a4a-9a1f-d5e21615c8da service nova] [instance: fc2b6a17-b3bf-42da-ad68-2f125c952a31] No waiting events found dispatching network-vif-plugged-4621e43a-a523-4506-8520-bcca759faa35 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 19:12:25 user nova-compute[75216]: WARNING nova.compute.manager [req-8fe6525e-0921-4c72-b007-ddba987215c4 req-85aeada4-c918-4a4a-9a1f-d5e21615c8da service nova] [instance: fc2b6a17-b3bf-42da-ad68-2f125c952a31] Received unexpected event network-vif-plugged-4621e43a-a523-4506-8520-bcca759faa35 for instance with vm_state deleted and task_state None.
Nov 13 19:12:26 user nova-compute[75216]: DEBUG nova.compute.manager [req-6d1d64aa-12a7-4181-8327-13883d86ae1a req-3044e620-861c-45b1-90c6-306b0bcaa6b0 service nova] [instance: 9e47d802-efdb-4763-8594-1ad056dbf6cc] Received event network-vif-plugged-637bd8e9-478b-462f-bb28-a0a32f7bb6cb {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:12:26 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-6d1d64aa-12a7-4181-8327-13883d86ae1a req-3044e620-861c-45b1-90c6-306b0bcaa6b0 service nova] Acquiring lock "9e47d802-efdb-4763-8594-1ad056dbf6cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:12:26 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-6d1d64aa-12a7-4181-8327-13883d86ae1a req-3044e620-861c-45b1-90c6-306b0bcaa6b0 service nova] Lock "9e47d802-efdb-4763-8594-1ad056dbf6cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:12:26 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-6d1d64aa-12a7-4181-8327-13883d86ae1a req-3044e620-861c-45b1-90c6-306b0bcaa6b0 service nova] Lock "9e47d802-efdb-4763-8594-1ad056dbf6cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:12:26 user nova-compute[75216]: DEBUG nova.compute.manager [req-6d1d64aa-12a7-4181-8327-13883d86ae1a req-3044e620-861c-45b1-90c6-306b0bcaa6b0 service nova] [instance: 9e47d802-efdb-4763-8594-1ad056dbf6cc] No waiting events found dispatching network-vif-plugged-637bd8e9-478b-462f-bb28-a0a32f7bb6cb {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 19:12:26 user nova-compute[75216]: WARNING nova.compute.manager [req-6d1d64aa-12a7-4181-8327-13883d86ae1a req-3044e620-861c-45b1-90c6-306b0bcaa6b0 service nova] [instance: 9e47d802-efdb-4763-8594-1ad056dbf6cc] Received unexpected event network-vif-plugged-637bd8e9-478b-462f-bb28-a0a32f7bb6cb for instance with vm_state building and task_state spawning.
Nov 13 19:12:26 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:12:26 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:12:26 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:12:26 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:12:26 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:12:27 user nova-compute[75216]: DEBUG nova.compute.manager [None req-ae7b8f22-835f-4465-b361-47bad9a87a31 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] [instance: 9e47d802-efdb-4763-8594-1ad056dbf6cc] Instance event wait completed in 0 seconds for  {{(pid=75216) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 19:12:27 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-ae7b8f22-835f-4465-b361-47bad9a87a31 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] [instance: 9e47d802-efdb-4763-8594-1ad056dbf6cc] Guest created on hypervisor {{(pid=75216) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 19:12:27 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 9e47d802-efdb-4763-8594-1ad056dbf6cc] Instance spawned successfully.
Nov 13 19:12:27 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-ae7b8f22-835f-4465-b361-47bad9a87a31 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] [instance: 9e47d802-efdb-4763-8594-1ad056dbf6cc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 19:12:27 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-ae7b8f22-835f-4465-b361-47bad9a87a31 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] [instance: 9e47d802-efdb-4763-8594-1ad056dbf6cc] Found default for hw_cdrom_bus of ide {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 19:12:27 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-ae7b8f22-835f-4465-b361-47bad9a87a31 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] [instance: 9e47d802-efdb-4763-8594-1ad056dbf6cc] Found default for hw_disk_bus of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 19:12:27 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-ae7b8f22-835f-4465-b361-47bad9a87a31 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] [instance: 9e47d802-efdb-4763-8594-1ad056dbf6cc] Found default for hw_input_bus of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 19:12:27 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-ae7b8f22-835f-4465-b361-47bad9a87a31 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] [instance: 9e47d802-efdb-4763-8594-1ad056dbf6cc] Found default for hw_pointer_model of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 19:12:27 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-ae7b8f22-835f-4465-b361-47bad9a87a31 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] [instance: 9e47d802-efdb-4763-8594-1ad056dbf6cc] Found default for hw_video_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 19:12:27 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-ae7b8f22-835f-4465-b361-47bad9a87a31 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] [instance: 9e47d802-efdb-4763-8594-1ad056dbf6cc] Found default for hw_vif_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 19:12:28 user nova-compute[75216]: INFO nova.compute.manager [None req-ae7b8f22-835f-4465-b361-47bad9a87a31 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] [instance: 9e47d802-efdb-4763-8594-1ad056dbf6cc] Took 5.38 seconds to spawn the instance on the hypervisor.
Nov 13 19:12:28 user nova-compute[75216]: DEBUG nova.compute.manager [None req-ae7b8f22-835f-4465-b361-47bad9a87a31 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] [instance: 9e47d802-efdb-4763-8594-1ad056dbf6cc] Checking state {{(pid=75216) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 19:12:28 user nova-compute[75216]: DEBUG nova.compute.manager [req-ab0a7055-e7e7-4477-b014-acce97fa3ddb req-c0e9b14a-84a8-4615-b3bb-6d5483d3a421 service nova] [instance: 9e47d802-efdb-4763-8594-1ad056dbf6cc] Received event network-vif-plugged-637bd8e9-478b-462f-bb28-a0a32f7bb6cb {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:12:28 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-ab0a7055-e7e7-4477-b014-acce97fa3ddb req-c0e9b14a-84a8-4615-b3bb-6d5483d3a421 service nova] Acquiring lock "9e47d802-efdb-4763-8594-1ad056dbf6cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:12:28 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-ab0a7055-e7e7-4477-b014-acce97fa3ddb req-c0e9b14a-84a8-4615-b3bb-6d5483d3a421 service nova] Lock "9e47d802-efdb-4763-8594-1ad056dbf6cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:12:28 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-ab0a7055-e7e7-4477-b014-acce97fa3ddb req-c0e9b14a-84a8-4615-b3bb-6d5483d3a421 service nova] Lock "9e47d802-efdb-4763-8594-1ad056dbf6cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:12:28 user nova-compute[75216]: DEBUG nova.compute.manager [req-ab0a7055-e7e7-4477-b014-acce97fa3ddb req-c0e9b14a-84a8-4615-b3bb-6d5483d3a421 service nova] [instance: 9e47d802-efdb-4763-8594-1ad056dbf6cc] No waiting events found dispatching network-vif-plugged-637bd8e9-478b-462f-bb28-a0a32f7bb6cb {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 19:12:28 user nova-compute[75216]: WARNING nova.compute.manager [req-ab0a7055-e7e7-4477-b014-acce97fa3ddb req-c0e9b14a-84a8-4615-b3bb-6d5483d3a421 service nova] [instance: 9e47d802-efdb-4763-8594-1ad056dbf6cc] Received unexpected event network-vif-plugged-637bd8e9-478b-462f-bb28-a0a32f7bb6cb for instance with vm_state building and task_state spawning.
Nov 13 19:12:28 user nova-compute[75216]: INFO nova.compute.manager [None req-ae7b8f22-835f-4465-b361-47bad9a87a31 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] [instance: 9e47d802-efdb-4763-8594-1ad056dbf6cc] Took 5.93 seconds to build instance.
Nov 13 19:12:28 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-ae7b8f22-835f-4465-b361-47bad9a87a31 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Lock "9e47d802-efdb-4763-8594-1ad056dbf6cc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.066s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:12:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:12:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:12:33 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:12:34 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:12:36 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:12:39 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:12:42 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:12:43 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:12:44 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:12:44 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:12:47 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:12:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:12:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:12:50 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:12:53 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-6427eb46-39c3-452d-ac0c-9c07c462409a tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] Acquiring lock "55b7031b-4fd6-4ecb-9130-68110677c7cf" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:12:53 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-6427eb46-39c3-452d-ac0c-9c07c462409a tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] Lock "55b7031b-4fd6-4ecb-9130-68110677c7cf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:12:53 user nova-compute[75216]: DEBUG nova.compute.manager [None req-6427eb46-39c3-452d-ac0c-9c07c462409a tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] [instance: 55b7031b-4fd6-4ecb-9130-68110677c7cf] Starting instance... {{(pid=75216) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 19:12:53 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-6427eb46-39c3-452d-ac0c-9c07c462409a tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:12:53 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-6427eb46-39c3-452d-ac0c-9c07c462409a tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:12:53 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-6427eb46-39c3-452d-ac0c-9c07c462409a tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75216) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 19:12:53 user nova-compute[75216]: INFO nova.compute.claims [None req-6427eb46-39c3-452d-ac0c-9c07c462409a tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] [instance: 55b7031b-4fd6-4ecb-9130-68110677c7cf] Claim successful on node user
Nov 13 19:12:53 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-6427eb46-39c3-452d-ac0c-9c07c462409a tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 19:12:53 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-6427eb46-39c3-452d-ac0c-9c07c462409a tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 19:12:53 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-6427eb46-39c3-452d-ac0c-9c07c462409a tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.202s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:12:53 user nova-compute[75216]: DEBUG nova.compute.manager [None req-6427eb46-39c3-452d-ac0c-9c07c462409a tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] [instance: 55b7031b-4fd6-4ecb-9130-68110677c7cf] Start building networks asynchronously for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 19:12:53 user nova-compute[75216]: DEBUG nova.compute.manager [None req-6427eb46-39c3-452d-ac0c-9c07c462409a tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] [instance: 55b7031b-4fd6-4ecb-9130-68110677c7cf] Allocating IP information in the background. {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 19:12:53 user nova-compute[75216]: DEBUG nova.network.neutron [None req-6427eb46-39c3-452d-ac0c-9c07c462409a tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] [instance: 55b7031b-4fd6-4ecb-9130-68110677c7cf] allocate_for_instance() {{(pid=75216) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 19:12:53 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-6427eb46-39c3-452d-ac0c-9c07c462409a tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] [instance: 55b7031b-4fd6-4ecb-9130-68110677c7cf] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 19:12:53 user nova-compute[75216]: DEBUG nova.compute.manager [None req-6427eb46-39c3-452d-ac0c-9c07c462409a tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] [instance: 55b7031b-4fd6-4ecb-9130-68110677c7cf] Start building block device mappings for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 19:12:53 user nova-compute[75216]: DEBUG nova.policy [None req-6427eb46-39c3-452d-ac0c-9c07c462409a tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0601f6da2e0842f0a373998d62dfbd60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4172655ed9de4ceb84d79d785f3b3377', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75216) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 19:12:53 user nova-compute[75216]: DEBUG nova.compute.manager [None req-6427eb46-39c3-452d-ac0c-9c07c462409a tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] [instance: 55b7031b-4fd6-4ecb-9130-68110677c7cf] Start spawning the instance on the hypervisor. {{(pid=75216) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 19:12:53 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-6427eb46-39c3-452d-ac0c-9c07c462409a tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] [instance: 55b7031b-4fd6-4ecb-9130-68110677c7cf] Creating instance directory {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 19:12:53 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-6427eb46-39c3-452d-ac0c-9c07c462409a tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] [instance: 55b7031b-4fd6-4ecb-9130-68110677c7cf] Creating image(s)
Nov 13 19:12:53 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-6427eb46-39c3-452d-ac0c-9c07c462409a tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] Acquiring lock "/opt/stack/data/nova/instances/55b7031b-4fd6-4ecb-9130-68110677c7cf/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:12:53 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-6427eb46-39c3-452d-ac0c-9c07c462409a tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] Lock "/opt/stack/data/nova/instances/55b7031b-4fd6-4ecb-9130-68110677c7cf/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:12:53 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-6427eb46-39c3-452d-ac0c-9c07c462409a tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] Lock "/opt/stack/data/nova/instances/55b7031b-4fd6-4ecb-9130-68110677c7cf/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:12:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-6427eb46-39c3-452d-ac0c-9c07c462409a tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:12:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-6427eb46-39c3-452d-ac0c-9c07c462409a tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json" returned: 0 in 0.175s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:12:53 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-6427eb46-39c3-452d-ac0c-9c07c462409a tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] Acquiring lock "88c50a45bec9d6b0427462b3242b9b8e5f49c2b6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:12:53 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-6427eb46-39c3-452d-ac0c-9c07c462409a tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] Lock "88c50a45bec9d6b0427462b3242b9b8e5f49c2b6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:12:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-6427eb46-39c3-452d-ac0c-9c07c462409a tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:12:54 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-6427eb46-39c3-452d-ac0c-9c07c462409a tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json" returned: 0 in 0.179s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:12:54 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-6427eb46-39c3-452d-ac0c-9c07c462409a tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6,backing_fmt=raw /opt/stack/data/nova/instances/55b7031b-4fd6-4ecb-9130-68110677c7cf/disk 1073741824 {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:12:54 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:12:54 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-6427eb46-39c3-452d-ac0c-9c07c462409a tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6,backing_fmt=raw /opt/stack/data/nova/instances/55b7031b-4fd6-4ecb-9130-68110677c7cf/disk 1073741824" returned: 0 in 0.047s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:12:54 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-6427eb46-39c3-452d-ac0c-9c07c462409a tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] Lock "88c50a45bec9d6b0427462b3242b9b8e5f49c2b6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.232s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:12:54 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-6427eb46-39c3-452d-ac0c-9c07c462409a tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:12:54 user nova-compute[75216]: DEBUG nova.network.neutron [None req-6427eb46-39c3-452d-ac0c-9c07c462409a tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] [instance: 55b7031b-4fd6-4ecb-9130-68110677c7cf] Successfully created port: bc9be0fb-9e21-4ad1-ae37-a1da3dbc5e5e {{(pid=75216) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 19:12:54 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-6427eb46-39c3-452d-ac0c-9c07c462409a tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json" returned: 0 in 0.186s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:12:54 user nova-compute[75216]: DEBUG nova.virt.disk.api [None req-6427eb46-39c3-452d-ac0c-9c07c462409a tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] Checking if we can resize image /opt/stack/data/nova/instances/55b7031b-4fd6-4ecb-9130-68110677c7cf/disk. size=1073741824 {{(pid=75216) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 19:12:54 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-6427eb46-39c3-452d-ac0c-9c07c462409a tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55b7031b-4fd6-4ecb-9130-68110677c7cf/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:12:54 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:12:54 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-6427eb46-39c3-452d-ac0c-9c07c462409a tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55b7031b-4fd6-4ecb-9130-68110677c7cf/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:12:54 user nova-compute[75216]: DEBUG nova.virt.disk.api [None req-6427eb46-39c3-452d-ac0c-9c07c462409a tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] Cannot resize image /opt/stack/data/nova/instances/55b7031b-4fd6-4ecb-9130-68110677c7cf/disk to a smaller size. {{(pid=75216) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 19:12:54 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-6427eb46-39c3-452d-ac0c-9c07c462409a tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] [instance: 55b7031b-4fd6-4ecb-9130-68110677c7cf] Created local disks {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 19:12:54 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-6427eb46-39c3-452d-ac0c-9c07c462409a tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] [instance: 55b7031b-4fd6-4ecb-9130-68110677c7cf] Ensure instance console log exists: /opt/stack/data/nova/instances/55b7031b-4fd6-4ecb-9130-68110677c7cf/console.log {{(pid=75216) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 19:12:54 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-6427eb46-39c3-452d-ac0c-9c07c462409a tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:12:54 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-6427eb46-39c3-452d-ac0c-9c07c462409a tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:12:54 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-6427eb46-39c3-452d-ac0c-9c07c462409a tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:12:54 user nova-compute[75216]: DEBUG nova.network.neutron [None req-6427eb46-39c3-452d-ac0c-9c07c462409a tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] [instance: 55b7031b-4fd6-4ecb-9130-68110677c7cf] Successfully updated port: bc9be0fb-9e21-4ad1-ae37-a1da3dbc5e5e {{(pid=75216) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 19:12:54 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-6427eb46-39c3-452d-ac0c-9c07c462409a tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] Acquiring lock "refresh_cache-55b7031b-4fd6-4ecb-9130-68110677c7cf" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 19:12:54 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-6427eb46-39c3-452d-ac0c-9c07c462409a tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] Acquired lock "refresh_cache-55b7031b-4fd6-4ecb-9130-68110677c7cf" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 19:12:54 user nova-compute[75216]: DEBUG nova.network.neutron [None req-6427eb46-39c3-452d-ac0c-9c07c462409a tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] [instance: 55b7031b-4fd6-4ecb-9130-68110677c7cf] Building network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 19:12:54 user nova-compute[75216]: DEBUG nova.compute.manager [req-59415deb-742f-48b0-810a-397ea5bd1aad req-b46c9de5-9c80-41b9-9451-3c881412c4d9 service nova] [instance: 55b7031b-4fd6-4ecb-9130-68110677c7cf] Received event network-changed-bc9be0fb-9e21-4ad1-ae37-a1da3dbc5e5e {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:12:54 user nova-compute[75216]: DEBUG nova.compute.manager [req-59415deb-742f-48b0-810a-397ea5bd1aad req-b46c9de5-9c80-41b9-9451-3c881412c4d9 service nova] [instance: 55b7031b-4fd6-4ecb-9130-68110677c7cf] Refreshing instance network info cache due to event network-changed-bc9be0fb-9e21-4ad1-ae37-a1da3dbc5e5e. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 19:12:54 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-59415deb-742f-48b0-810a-397ea5bd1aad req-b46c9de5-9c80-41b9-9451-3c881412c4d9 service nova] Acquiring lock "refresh_cache-55b7031b-4fd6-4ecb-9130-68110677c7cf" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 19:12:54 user nova-compute[75216]: DEBUG nova.network.neutron [None req-6427eb46-39c3-452d-ac0c-9c07c462409a tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] [instance: 55b7031b-4fd6-4ecb-9130-68110677c7cf] Instance cache missing network info. {{(pid=75216) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 19:12:55 user nova-compute[75216]: DEBUG nova.network.neutron [None req-6427eb46-39c3-452d-ac0c-9c07c462409a tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] [instance: 55b7031b-4fd6-4ecb-9130-68110677c7cf] Updating instance_info_cache with network_info: [{"id": "bc9be0fb-9e21-4ad1-ae37-a1da3dbc5e5e", "address": "fa:16:3e:92:1e:27", "network": {"id": "988045b3-1899-40e5-93a6-56fc3b6bb766", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-280689078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4172655ed9de4ceb84d79d785f3b3377", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc9be0fb-9e", "ovs_interfaceid": "bc9be0fb-9e21-4ad1-ae37-a1da3dbc5e5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:12:55 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-6427eb46-39c3-452d-ac0c-9c07c462409a tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] Releasing lock "refresh_cache-55b7031b-4fd6-4ecb-9130-68110677c7cf" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 19:12:55 user nova-compute[75216]: DEBUG nova.compute.manager [None req-6427eb46-39c3-452d-ac0c-9c07c462409a tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] [instance: 55b7031b-4fd6-4ecb-9130-68110677c7cf] Instance network_info: |[{"id": "bc9be0fb-9e21-4ad1-ae37-a1da3dbc5e5e", "address": "fa:16:3e:92:1e:27", "network": {"id": "988045b3-1899-40e5-93a6-56fc3b6bb766", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-280689078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4172655ed9de4ceb84d79d785f3b3377", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc9be0fb-9e", "ovs_interfaceid": "bc9be0fb-9e21-4ad1-ae37-a1da3dbc5e5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 19:12:55 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-59415deb-742f-48b0-810a-397ea5bd1aad req-b46c9de5-9c80-41b9-9451-3c881412c4d9 service nova] Acquired lock "refresh_cache-55b7031b-4fd6-4ecb-9130-68110677c7cf" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 19:12:55 user nova-compute[75216]: DEBUG nova.network.neutron [req-59415deb-742f-48b0-810a-397ea5bd1aad req-b46c9de5-9c80-41b9-9451-3c881412c4d9 service nova] [instance: 55b7031b-4fd6-4ecb-9130-68110677c7cf] Refreshing network info cache for port bc9be0fb-9e21-4ad1-ae37-a1da3dbc5e5e {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 19:12:55 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-6427eb46-39c3-452d-ac0c-9c07c462409a tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] [instance: 55b7031b-4fd6-4ecb-9130-68110677c7cf] Start _get_guest_xml network_info=[{"id": "bc9be0fb-9e21-4ad1-ae37-a1da3dbc5e5e", "address": "fa:16:3e:92:1e:27", "network": {"id": "988045b3-1899-40e5-93a6-56fc3b6bb766", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-280689078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4172655ed9de4ceb84d79d785f3b3377", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc9be0fb-9e", "ovs_interfaceid": "bc9be0fb-9e21-4ad1-ae37-a1da3dbc5e5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T18:41:06Z,direct_url=<?>,disk_format='qcow2',id=77bcb5ba-8510-41ec-a88d-96097bb431de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c465b7c26ec44582b6d1b7169536ecc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T18:41:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'guest_format': None, 'boot_index': 0, 'image_id': '77bcb5ba-8510-41ec-a88d-96097bb431de'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 19:12:55 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-6427eb46-39c3-452d-ac0c-9c07c462409a tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 19:12:55 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-6427eb46-39c3-452d-ac0c-9c07c462409a tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 19:12:55 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-6427eb46-39c3-452d-ac0c-9c07c462409a tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 19:12:55 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-6427eb46-39c3-452d-ac0c-9c07c462409a tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] CPU controller missing on host. {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 19:12:55 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-6427eb46-39c3-452d-ac0c-9c07c462409a tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 19:12:55 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-6427eb46-39c3-452d-ac0c-9c07c462409a tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] CPU controller found on host. {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 19:12:55 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-6427eb46-39c3-452d-ac0c-9c07c462409a tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75216) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 19:12:55 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-6427eb46-39c3-452d-ac0c-9c07c462409a tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T18:40:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T18:41:06Z,direct_url=<?>,disk_format='qcow2',id=77bcb5ba-8510-41ec-a88d-96097bb431de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c465b7c26ec44582b6d1b7169536ecc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T18:41:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 19:12:55 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-6427eb46-39c3-452d-ac0c-9c07c462409a tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] Flavor limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 19:12:55 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-6427eb46-39c3-452d-ac0c-9c07c462409a tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] Image limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 19:12:55 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-6427eb46-39c3-452d-ac0c-9c07c462409a tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] Flavor pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 19:12:55 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-6427eb46-39c3-452d-ac0c-9c07c462409a tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] Image pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 19:12:55 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-6427eb46-39c3-452d-ac0c-9c07c462409a tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 19:12:55 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-6427eb46-39c3-452d-ac0c-9c07c462409a tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 19:12:55 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-6427eb46-39c3-452d-ac0c-9c07c462409a tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 19:12:55 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-6427eb46-39c3-452d-ac0c-9c07c462409a tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] Got 1 possible topologies {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 19:12:55 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-6427eb46-39c3-452d-ac0c-9c07c462409a tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 19:12:55 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-6427eb46-39c3-452d-ac0c-9c07c462409a tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 19:12:55 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-6427eb46-39c3-452d-ac0c-9c07c462409a tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T19:12:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-489647674',display_name='tempest-TestServerVolumeAttachmentScenario-server-489647674',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-489647674',id=37,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEzJ93ZYc/hw6plBkPM4noL/je3iA1G0jCim4AwpiavgsN/1T0G8YEMh+wVd+tMlte8a2rLFSp4S/Q0KO7BJmEQAR7k+85+m2qWyIYyPsy+MtRWy31nHQGSoAIwBdMq+yw==',key_name='tempest-keypair-707241514',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4172655ed9de4ceb84d79d785f3b3377',ramdisk_id='',reservation_id='r-q3qg2s0i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1442727498',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1442727498-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T19:12:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0601f6da2e0842f0a373998d62dfbd60',uuid=55b7031b-4fd6-4ecb-9130-68110677c7cf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bc9be0fb-9e21-4ad1-ae37-a1da3dbc5e5e", "address": "fa:16:3e:92:1e:27", "network": {"id": "988045b3-1899-40e5-93a6-56fc3b6bb766", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-280689078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4172655ed9de4ceb84d79d785f3b3377", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc9be0fb-9e", "ovs_interfaceid": "bc9be0fb-9e21-4ad1-ae37-a1da3dbc5e5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75216) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 19:12:55 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-6427eb46-39c3-452d-ac0c-9c07c462409a tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] Converting VIF {"id": "bc9be0fb-9e21-4ad1-ae37-a1da3dbc5e5e", "address": "fa:16:3e:92:1e:27", "network": {"id": "988045b3-1899-40e5-93a6-56fc3b6bb766", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-280689078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4172655ed9de4ceb84d79d785f3b3377", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc9be0fb-9e", "ovs_interfaceid": "bc9be0fb-9e21-4ad1-ae37-a1da3dbc5e5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 19:12:55 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-6427eb46-39c3-452d-ac0c-9c07c462409a tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:1e:27,bridge_name='br-int',has_traffic_filtering=True,id=bc9be0fb-9e21-4ad1-ae37-a1da3dbc5e5e,network=Network(988045b3-1899-40e5-93a6-56fc3b6bb766),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc9be0fb-9e') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 19:12:55 user nova-compute[75216]: DEBUG nova.objects.instance [None req-6427eb46-39c3-452d-ac0c-9c07c462409a tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] Lazy-loading 'pci_devices' on Instance uuid 55b7031b-4fd6-4ecb-9130-68110677c7cf {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:12:55 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-6427eb46-39c3-452d-ac0c-9c07c462409a tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] [instance: 55b7031b-4fd6-4ecb-9130-68110677c7cf] End _get_guest_xml xml=<domain type="kvm">
Nov 13 19:12:55 user nova-compute[75216]:   <uuid>55b7031b-4fd6-4ecb-9130-68110677c7cf</uuid>
Nov 13 19:12:55 user nova-compute[75216]:   <name>instance-00000025</name>
Nov 13 19:12:55 user nova-compute[75216]:   <memory>524288</memory>
Nov 13 19:12:55 user nova-compute[75216]:   <vcpu>1</vcpu>
Nov 13 19:12:55 user nova-compute[75216]:   <metadata>
Nov 13 19:12:55 user nova-compute[75216]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 19:12:55 user nova-compute[75216]:       <nova:package version="0.0.0"/>
Nov 13 19:12:55 user nova-compute[75216]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-489647674</nova:name>
Nov 13 19:12:55 user nova-compute[75216]:       <nova:creationTime>2023-11-13 19:12:55</nova:creationTime>
Nov 13 19:12:55 user nova-compute[75216]:       <nova:flavor name="m1.tiny">
Nov 13 19:12:55 user nova-compute[75216]:         <nova:memory>512</nova:memory>
Nov 13 19:12:55 user nova-compute[75216]:         <nova:disk>1</nova:disk>
Nov 13 19:12:55 user nova-compute[75216]:         <nova:swap>0</nova:swap>
Nov 13 19:12:55 user nova-compute[75216]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 19:12:55 user nova-compute[75216]:         <nova:vcpus>1</nova:vcpus>
Nov 13 19:12:55 user nova-compute[75216]:       </nova:flavor>
Nov 13 19:12:55 user nova-compute[75216]:       <nova:owner>
Nov 13 19:12:55 user nova-compute[75216]:         <nova:user uuid="0601f6da2e0842f0a373998d62dfbd60">tempest-TestServerVolumeAttachmentScenario-1442727498-project-member</nova:user>
Nov 13 19:12:55 user nova-compute[75216]:         <nova:project uuid="4172655ed9de4ceb84d79d785f3b3377">tempest-TestServerVolumeAttachmentScenario-1442727498</nova:project>
Nov 13 19:12:55 user nova-compute[75216]:       </nova:owner>
Nov 13 19:12:55 user nova-compute[75216]:       <nova:root type="image" uuid="77bcb5ba-8510-41ec-a88d-96097bb431de"/>
Nov 13 19:12:55 user nova-compute[75216]:       <nova:ports>
Nov 13 19:12:55 user nova-compute[75216]:         <nova:port uuid="bc9be0fb-9e21-4ad1-ae37-a1da3dbc5e5e">
Nov 13 19:12:55 user nova-compute[75216]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 13 19:12:55 user nova-compute[75216]:         </nova:port>
Nov 13 19:12:55 user nova-compute[75216]:       </nova:ports>
Nov 13 19:12:55 user nova-compute[75216]:     </nova:instance>
Nov 13 19:12:55 user nova-compute[75216]:   </metadata>
Nov 13 19:12:55 user nova-compute[75216]:   <sysinfo type="smbios">
Nov 13 19:12:55 user nova-compute[75216]:     <system>
Nov 13 19:12:55 user nova-compute[75216]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 19:12:55 user nova-compute[75216]:       <entry name="product">OpenStack Nova</entry>
Nov 13 19:12:55 user nova-compute[75216]:       <entry name="version">0.0.0</entry>
Nov 13 19:12:55 user nova-compute[75216]:       <entry name="serial">55b7031b-4fd6-4ecb-9130-68110677c7cf</entry>
Nov 13 19:12:55 user nova-compute[75216]:       <entry name="uuid">55b7031b-4fd6-4ecb-9130-68110677c7cf</entry>
Nov 13 19:12:55 user nova-compute[75216]:       <entry name="family">Virtual Machine</entry>
Nov 13 19:12:55 user nova-compute[75216]:     </system>
Nov 13 19:12:55 user nova-compute[75216]:   </sysinfo>
Nov 13 19:12:55 user nova-compute[75216]:   <os>
Nov 13 19:12:55 user nova-compute[75216]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 19:12:55 user nova-compute[75216]:     <boot dev="hd"/>
Nov 13 19:12:55 user nova-compute[75216]:     <smbios mode="sysinfo"/>
Nov 13 19:12:55 user nova-compute[75216]:   </os>
Nov 13 19:12:55 user nova-compute[75216]:   <features>
Nov 13 19:12:55 user nova-compute[75216]:     <acpi/>
Nov 13 19:12:55 user nova-compute[75216]:     <apic/>
Nov 13 19:12:55 user nova-compute[75216]:     <vmcoreinfo/>
Nov 13 19:12:55 user nova-compute[75216]:   </features>
Nov 13 19:12:55 user nova-compute[75216]:   <clock offset="utc">
Nov 13 19:12:55 user nova-compute[75216]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 19:12:55 user nova-compute[75216]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 19:12:55 user nova-compute[75216]:     <timer name="hpet" present="no"/>
Nov 13 19:12:55 user nova-compute[75216]:   </clock>
Nov 13 19:12:55 user nova-compute[75216]:   <cpu mode="custom" match="exact">
Nov 13 19:12:55 user nova-compute[75216]:     <model>Nehalem</model>
Nov 13 19:12:55 user nova-compute[75216]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 19:12:55 user nova-compute[75216]:   </cpu>
Nov 13 19:12:55 user nova-compute[75216]:   <devices>
Nov 13 19:12:55 user nova-compute[75216]:     <disk type="file" device="disk">
Nov 13 19:12:55 user nova-compute[75216]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 19:12:55 user nova-compute[75216]:       <source file="/opt/stack/data/nova/instances/55b7031b-4fd6-4ecb-9130-68110677c7cf/disk"/>
Nov 13 19:12:55 user nova-compute[75216]:       <target dev="vda" bus="virtio"/>
Nov 13 19:12:55 user nova-compute[75216]:     </disk>
Nov 13 19:12:55 user nova-compute[75216]:     <interface type="ethernet">
Nov 13 19:12:55 user nova-compute[75216]:       <mac address="fa:16:3e:92:1e:27"/>
Nov 13 19:12:55 user nova-compute[75216]:       <model type="virtio"/>
Nov 13 19:12:55 user nova-compute[75216]:       <mtu size="1442"/>
Nov 13 19:12:55 user nova-compute[75216]:       <target dev="tapbc9be0fb-9e"/>
Nov 13 19:12:55 user nova-compute[75216]:     </interface>
Nov 13 19:12:55 user nova-compute[75216]:     <serial type="pty">
Nov 13 19:12:55 user nova-compute[75216]:       <log file="/opt/stack/data/nova/instances/55b7031b-4fd6-4ecb-9130-68110677c7cf/console.log" append="off"/>
Nov 13 19:12:55 user nova-compute[75216]:     </serial>
Nov 13 19:12:55 user nova-compute[75216]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 19:12:55 user nova-compute[75216]:     <video>
Nov 13 19:12:55 user nova-compute[75216]:       <model type="virtio"/>
Nov 13 19:12:55 user nova-compute[75216]:     </video>
Nov 13 19:12:55 user nova-compute[75216]:     <rng model="virtio">
Nov 13 19:12:55 user nova-compute[75216]:       <backend model="random">/dev/urandom</backend>
Nov 13 19:12:55 user nova-compute[75216]:     </rng>
Nov 13 19:12:55 user nova-compute[75216]:     <controller type="usb" index="0" model="none"/>
Nov 13 19:12:55 user nova-compute[75216]:     <memballoon model="virtio">
Nov 13 19:12:55 user nova-compute[75216]:       <stats period="10"/>
Nov 13 19:12:55 user nova-compute[75216]:     </memballoon>
Nov 13 19:12:55 user nova-compute[75216]:   </devices>
Nov 13 19:12:55 user nova-compute[75216]: </domain>
Nov 13 19:12:55 user nova-compute[75216]:  {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 19:12:55 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-6427eb46-39c3-452d-ac0c-9c07c462409a tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T19:12:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-489647674',display_name='tempest-TestServerVolumeAttachmentScenario-server-489647674',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-489647674',id=37,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEzJ93ZYc/hw6plBkPM4noL/je3iA1G0jCim4AwpiavgsN/1T0G8YEMh+wVd+tMlte8a2rLFSp4S/Q0KO7BJmEQAR7k+85+m2qWyIYyPsy+MtRWy31nHQGSoAIwBdMq+yw==',key_name='tempest-keypair-707241514',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4172655ed9de4ceb84d79d785f3b3377',ramdisk_id='',reservation_id='r-q3qg2s0i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1442727498',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1442727498-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T19:12:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0601f6da2e0842f0a373998d62dfbd60',uuid=55b7031b-4fd6-4ecb-9130-68110677c7cf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bc9be0fb-9e21-4ad1-ae37-a1da3dbc5e5e", "address": "fa:16:3e:92:1e:27", "network": {"id": "988045b3-1899-40e5-93a6-56fc3b6bb766", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-280689078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4172655ed9de4ceb84d79d785f3b3377", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc9be0fb-9e", "ovs_interfaceid": "bc9be0fb-9e21-4ad1-ae37-a1da3dbc5e5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 19:12:55 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-6427eb46-39c3-452d-ac0c-9c07c462409a tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] Converting VIF {"id": "bc9be0fb-9e21-4ad1-ae37-a1da3dbc5e5e", "address": "fa:16:3e:92:1e:27", "network": {"id": "988045b3-1899-40e5-93a6-56fc3b6bb766", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-280689078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4172655ed9de4ceb84d79d785f3b3377", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc9be0fb-9e", "ovs_interfaceid": "bc9be0fb-9e21-4ad1-ae37-a1da3dbc5e5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 19:12:55 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-6427eb46-39c3-452d-ac0c-9c07c462409a tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:1e:27,bridge_name='br-int',has_traffic_filtering=True,id=bc9be0fb-9e21-4ad1-ae37-a1da3dbc5e5e,network=Network(988045b3-1899-40e5-93a6-56fc3b6bb766),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc9be0fb-9e') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 19:12:55 user nova-compute[75216]: DEBUG os_vif [None req-6427eb46-39c3-452d-ac0c-9c07c462409a tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:1e:27,bridge_name='br-int',has_traffic_filtering=True,id=bc9be0fb-9e21-4ad1-ae37-a1da3dbc5e5e,network=Network(988045b3-1899-40e5-93a6-56fc3b6bb766),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc9be0fb-9e') {{(pid=75216) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 19:12:55 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:12:55 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:12:55 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 19:12:55 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:12:55 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2b07c8dc-f9c7-5d67-a9aa-96704e0e4e2c', '_type': 'linux-noop'}}, row=False) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:12:55 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:12:55 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:12:55 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:12:55 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbc9be0fb-9e, may_exist=True, interface_attrs={}) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:12:55 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbc9be0fb-9e, col_values=(('qos', UUID('995357bc-2e5e-4cdc-bd28-9859dd4c9143')),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:12:55 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbc9be0fb-9e, col_values=(('external_ids', {'iface-id': 'bc9be0fb-9e21-4ad1-ae37-a1da3dbc5e5e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:92:1e:27', 'vm-uuid': '55b7031b-4fd6-4ecb-9130-68110677c7cf'}),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:12:55 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:12:55 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:12:55 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:12:55 user nova-compute[75216]: INFO os_vif [None req-6427eb46-39c3-452d-ac0c-9c07c462409a tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:1e:27,bridge_name='br-int',has_traffic_filtering=True,id=bc9be0fb-9e21-4ad1-ae37-a1da3dbc5e5e,network=Network(988045b3-1899-40e5-93a6-56fc3b6bb766),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc9be0fb-9e')
Nov 13 19:12:55 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-6427eb46-39c3-452d-ac0c-9c07c462409a tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 19:12:55 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-6427eb46-39c3-452d-ac0c-9c07c462409a tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] No VIF found with MAC fa:16:3e:92:1e:27, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 19:12:55 user nova-compute[75216]: DEBUG nova.network.neutron [req-59415deb-742f-48b0-810a-397ea5bd1aad req-b46c9de5-9c80-41b9-9451-3c881412c4d9 service nova] [instance: 55b7031b-4fd6-4ecb-9130-68110677c7cf] Updated VIF entry in instance network info cache for port bc9be0fb-9e21-4ad1-ae37-a1da3dbc5e5e. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 19:12:55 user nova-compute[75216]: DEBUG nova.network.neutron [req-59415deb-742f-48b0-810a-397ea5bd1aad req-b46c9de5-9c80-41b9-9451-3c881412c4d9 service nova] [instance: 55b7031b-4fd6-4ecb-9130-68110677c7cf] Updating instance_info_cache with network_info: [{"id": "bc9be0fb-9e21-4ad1-ae37-a1da3dbc5e5e", "address": "fa:16:3e:92:1e:27", "network": {"id": "988045b3-1899-40e5-93a6-56fc3b6bb766", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-280689078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4172655ed9de4ceb84d79d785f3b3377", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc9be0fb-9e", "ovs_interfaceid": "bc9be0fb-9e21-4ad1-ae37-a1da3dbc5e5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:12:55 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-59415deb-742f-48b0-810a-397ea5bd1aad req-b46c9de5-9c80-41b9-9451-3c881412c4d9 service nova] Releasing lock "refresh_cache-55b7031b-4fd6-4ecb-9130-68110677c7cf" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 19:12:56 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:12:56 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:12:56 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:12:56 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:12:56 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:12:57 user nova-compute[75216]: DEBUG nova.compute.manager [req-b15022c4-4e1c-4810-bf5a-8bd46168219f req-e6d3466d-d3db-472e-8914-1b36f278be1d service nova] [instance: 55b7031b-4fd6-4ecb-9130-68110677c7cf] Received event network-vif-plugged-bc9be0fb-9e21-4ad1-ae37-a1da3dbc5e5e {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:12:57 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-b15022c4-4e1c-4810-bf5a-8bd46168219f req-e6d3466d-d3db-472e-8914-1b36f278be1d service nova] Acquiring lock "55b7031b-4fd6-4ecb-9130-68110677c7cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:12:57 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-b15022c4-4e1c-4810-bf5a-8bd46168219f req-e6d3466d-d3db-472e-8914-1b36f278be1d service nova] Lock "55b7031b-4fd6-4ecb-9130-68110677c7cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:12:57 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-b15022c4-4e1c-4810-bf5a-8bd46168219f req-e6d3466d-d3db-472e-8914-1b36f278be1d service nova] Lock "55b7031b-4fd6-4ecb-9130-68110677c7cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:12:57 user nova-compute[75216]: DEBUG nova.compute.manager [req-b15022c4-4e1c-4810-bf5a-8bd46168219f req-e6d3466d-d3db-472e-8914-1b36f278be1d service nova] [instance: 55b7031b-4fd6-4ecb-9130-68110677c7cf] No waiting events found dispatching network-vif-plugged-bc9be0fb-9e21-4ad1-ae37-a1da3dbc5e5e {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 19:12:57 user nova-compute[75216]: WARNING nova.compute.manager [req-b15022c4-4e1c-4810-bf5a-8bd46168219f req-e6d3466d-d3db-472e-8914-1b36f278be1d service nova] [instance: 55b7031b-4fd6-4ecb-9130-68110677c7cf] Received unexpected event network-vif-plugged-bc9be0fb-9e21-4ad1-ae37-a1da3dbc5e5e for instance with vm_state building and task_state spawning.
Nov 13 19:12:57 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:12:57 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:12:57 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:12:57 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:12:58 user nova-compute[75216]: DEBUG nova.compute.manager [None req-6427eb46-39c3-452d-ac0c-9c07c462409a tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] [instance: 55b7031b-4fd6-4ecb-9130-68110677c7cf] Instance event wait completed in 0 seconds for  {{(pid=75216) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 19:12:58 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-6427eb46-39c3-452d-ac0c-9c07c462409a tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] [instance: 55b7031b-4fd6-4ecb-9130-68110677c7cf] Guest created on hypervisor {{(pid=75216) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 19:12:59 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 55b7031b-4fd6-4ecb-9130-68110677c7cf] Instance spawned successfully.
Nov 13 19:12:59 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-6427eb46-39c3-452d-ac0c-9c07c462409a tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] [instance: 55b7031b-4fd6-4ecb-9130-68110677c7cf] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 19:12:59 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-6427eb46-39c3-452d-ac0c-9c07c462409a tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] [instance: 55b7031b-4fd6-4ecb-9130-68110677c7cf] Found default for hw_cdrom_bus of ide {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 19:12:59 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-6427eb46-39c3-452d-ac0c-9c07c462409a tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] [instance: 55b7031b-4fd6-4ecb-9130-68110677c7cf] Found default for hw_disk_bus of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 19:12:59 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-6427eb46-39c3-452d-ac0c-9c07c462409a tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] [instance: 55b7031b-4fd6-4ecb-9130-68110677c7cf] Found default for hw_input_bus of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 19:12:59 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-6427eb46-39c3-452d-ac0c-9c07c462409a tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] [instance: 55b7031b-4fd6-4ecb-9130-68110677c7cf] Found default for hw_pointer_model of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 19:12:59 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-6427eb46-39c3-452d-ac0c-9c07c462409a tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] [instance: 55b7031b-4fd6-4ecb-9130-68110677c7cf] Found default for hw_video_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 19:12:59 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-6427eb46-39c3-452d-ac0c-9c07c462409a tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] [instance: 55b7031b-4fd6-4ecb-9130-68110677c7cf] Found default for hw_vif_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 19:12:59 user nova-compute[75216]: DEBUG nova.compute.manager [req-1cd1fc3b-d6ac-4ee5-ac63-dbe3f5686f6a req-da573dfa-097f-4930-bb7f-cfa587e1c992 service nova] [instance: 55b7031b-4fd6-4ecb-9130-68110677c7cf] Received event network-vif-plugged-bc9be0fb-9e21-4ad1-ae37-a1da3dbc5e5e {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:12:59 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-1cd1fc3b-d6ac-4ee5-ac63-dbe3f5686f6a req-da573dfa-097f-4930-bb7f-cfa587e1c992 service nova] Acquiring lock "55b7031b-4fd6-4ecb-9130-68110677c7cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:12:59 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-1cd1fc3b-d6ac-4ee5-ac63-dbe3f5686f6a req-da573dfa-097f-4930-bb7f-cfa587e1c992 service nova] Lock "55b7031b-4fd6-4ecb-9130-68110677c7cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:12:59 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-1cd1fc3b-d6ac-4ee5-ac63-dbe3f5686f6a req-da573dfa-097f-4930-bb7f-cfa587e1c992 service nova] Lock "55b7031b-4fd6-4ecb-9130-68110677c7cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:12:59 user nova-compute[75216]: DEBUG nova.compute.manager [req-1cd1fc3b-d6ac-4ee5-ac63-dbe3f5686f6a req-da573dfa-097f-4930-bb7f-cfa587e1c992 service nova] [instance: 55b7031b-4fd6-4ecb-9130-68110677c7cf] No waiting events found dispatching network-vif-plugged-bc9be0fb-9e21-4ad1-ae37-a1da3dbc5e5e {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 19:12:59 user nova-compute[75216]: WARNING nova.compute.manager [req-1cd1fc3b-d6ac-4ee5-ac63-dbe3f5686f6a req-da573dfa-097f-4930-bb7f-cfa587e1c992 service nova] [instance: 55b7031b-4fd6-4ecb-9130-68110677c7cf] Received unexpected event network-vif-plugged-bc9be0fb-9e21-4ad1-ae37-a1da3dbc5e5e for instance with vm_state building and task_state spawning.
Nov 13 19:12:59 user nova-compute[75216]: INFO nova.compute.manager [None req-6427eb46-39c3-452d-ac0c-9c07c462409a tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] [instance: 55b7031b-4fd6-4ecb-9130-68110677c7cf] Took 5.33 seconds to spawn the instance on the hypervisor.
Nov 13 19:12:59 user nova-compute[75216]: DEBUG nova.compute.manager [None req-6427eb46-39c3-452d-ac0c-9c07c462409a tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] [instance: 55b7031b-4fd6-4ecb-9130-68110677c7cf] Checking state {{(pid=75216) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 19:12:59 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:12:59 user nova-compute[75216]: INFO nova.compute.manager [None req-6427eb46-39c3-452d-ac0c-9c07c462409a tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] [instance: 55b7031b-4fd6-4ecb-9130-68110677c7cf] Took 5.85 seconds to build instance.
Nov 13 19:12:59 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-6427eb46-39c3-452d-ac0c-9c07c462409a tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] Lock "55b7031b-4fd6-4ecb-9130-68110677c7cf" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.936s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:12:59 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:13:00 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:13:00 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:13:01 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:13:03 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:13:04 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:13:04 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:13:04 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:13:05 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:13:06 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-0cc95907-16c7-4a04-bb0c-a6ca059029af tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Acquiring lock "b048c677-85bf-4a93-88eb-c71bde27bf5b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:13:06 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-0cc95907-16c7-4a04-bb0c-a6ca059029af tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Lock "b048c677-85bf-4a93-88eb-c71bde27bf5b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:13:06 user nova-compute[75216]: DEBUG nova.compute.manager [None req-0cc95907-16c7-4a04-bb0c-a6ca059029af tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] [instance: b048c677-85bf-4a93-88eb-c71bde27bf5b] Starting instance... {{(pid=75216) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 19:13:06 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:13:06 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75216) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 19:13:06 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-0cc95907-16c7-4a04-bb0c-a6ca059029af tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:13:06 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-0cc95907-16c7-4a04-bb0c-a6ca059029af tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:13:06 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-0cc95907-16c7-4a04-bb0c-a6ca059029af tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75216) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 19:13:06 user nova-compute[75216]: INFO nova.compute.claims [None req-0cc95907-16c7-4a04-bb0c-a6ca059029af tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] [instance: b048c677-85bf-4a93-88eb-c71bde27bf5b] Claim successful on node user
Nov 13 19:13:06 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-0cc95907-16c7-4a04-bb0c-a6ca059029af tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 19:13:06 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-0cc95907-16c7-4a04-bb0c-a6ca059029af tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 19:13:06 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-0cc95907-16c7-4a04-bb0c-a6ca059029af tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.236s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:13:06 user nova-compute[75216]: DEBUG nova.compute.manager [None req-0cc95907-16c7-4a04-bb0c-a6ca059029af tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] [instance: b048c677-85bf-4a93-88eb-c71bde27bf5b] Start building networks asynchronously for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 19:13:06 user nova-compute[75216]: DEBUG nova.compute.manager [None req-0cc95907-16c7-4a04-bb0c-a6ca059029af tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] [instance: b048c677-85bf-4a93-88eb-c71bde27bf5b] Allocating IP information in the background. {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 19:13:06 user nova-compute[75216]: DEBUG nova.network.neutron [None req-0cc95907-16c7-4a04-bb0c-a6ca059029af tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] [instance: b048c677-85bf-4a93-88eb-c71bde27bf5b] allocate_for_instance() {{(pid=75216) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 19:13:06 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-0cc95907-16c7-4a04-bb0c-a6ca059029af tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] [instance: b048c677-85bf-4a93-88eb-c71bde27bf5b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 19:13:06 user nova-compute[75216]: DEBUG nova.compute.manager [None req-0cc95907-16c7-4a04-bb0c-a6ca059029af tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] [instance: b048c677-85bf-4a93-88eb-c71bde27bf5b] Start building block device mappings for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 19:13:06 user nova-compute[75216]: DEBUG nova.policy [None req-0cc95907-16c7-4a04-bb0c-a6ca059029af tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1ca750d884c3403394b46f53fbd633a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06cae29094846f1817036dc761a565d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75216) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 19:13:06 user nova-compute[75216]: DEBUG nova.compute.manager [None req-0cc95907-16c7-4a04-bb0c-a6ca059029af tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] [instance: b048c677-85bf-4a93-88eb-c71bde27bf5b] Start spawning the instance on the hypervisor. {{(pid=75216) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 19:13:06 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-0cc95907-16c7-4a04-bb0c-a6ca059029af tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] [instance: b048c677-85bf-4a93-88eb-c71bde27bf5b] Creating instance directory {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 19:13:06 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-0cc95907-16c7-4a04-bb0c-a6ca059029af tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] [instance: b048c677-85bf-4a93-88eb-c71bde27bf5b] Creating image(s)
Nov 13 19:13:06 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-0cc95907-16c7-4a04-bb0c-a6ca059029af tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Acquiring lock "/opt/stack/data/nova/instances/b048c677-85bf-4a93-88eb-c71bde27bf5b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:13:06 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-0cc95907-16c7-4a04-bb0c-a6ca059029af tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Lock "/opt/stack/data/nova/instances/b048c677-85bf-4a93-88eb-c71bde27bf5b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:13:06 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-0cc95907-16c7-4a04-bb0c-a6ca059029af tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Lock "/opt/stack/data/nova/instances/b048c677-85bf-4a93-88eb-c71bde27bf5b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:13:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-0cc95907-16c7-4a04-bb0c-a6ca059029af tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:13:07 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-0cc95907-16c7-4a04-bb0c-a6ca059029af tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json" returned: 0 in 0.175s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:13:07 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-0cc95907-16c7-4a04-bb0c-a6ca059029af tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Acquiring lock "88c50a45bec9d6b0427462b3242b9b8e5f49c2b6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:13:07 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-0cc95907-16c7-4a04-bb0c-a6ca059029af tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Lock "88c50a45bec9d6b0427462b3242b9b8e5f49c2b6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:13:07 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-0cc95907-16c7-4a04-bb0c-a6ca059029af tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:13:07 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-0cc95907-16c7-4a04-bb0c-a6ca059029af tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json" returned: 0 in 0.171s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:13:07 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-0cc95907-16c7-4a04-bb0c-a6ca059029af tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6,backing_fmt=raw /opt/stack/data/nova/instances/b048c677-85bf-4a93-88eb-c71bde27bf5b/disk 1073741824 {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:13:07 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-0cc95907-16c7-4a04-bb0c-a6ca059029af tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6,backing_fmt=raw /opt/stack/data/nova/instances/b048c677-85bf-4a93-88eb-c71bde27bf5b/disk 1073741824" returned: 0 in 0.048s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:13:07 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-0cc95907-16c7-4a04-bb0c-a6ca059029af tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Lock "88c50a45bec9d6b0427462b3242b9b8e5f49c2b6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.228s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:13:07 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-0cc95907-16c7-4a04-bb0c-a6ca059029af tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:13:07 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:13:07 user nova-compute[75216]: DEBUG nova.network.neutron [None req-0cc95907-16c7-4a04-bb0c-a6ca059029af tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] [instance: b048c677-85bf-4a93-88eb-c71bde27bf5b] Successfully created port: 4ae536b2-7829-45c2-8739-a3f838008e74 {{(pid=75216) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 19:13:07 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-0cc95907-16c7-4a04-bb0c-a6ca059029af tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json" returned: 0 in 0.179s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:13:07 user nova-compute[75216]: DEBUG nova.virt.disk.api [None req-0cc95907-16c7-4a04-bb0c-a6ca059029af tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b048c677-85bf-4a93-88eb-c71bde27bf5b/disk. size=1073741824 {{(pid=75216) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 19:13:07 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-0cc95907-16c7-4a04-bb0c-a6ca059029af tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b048c677-85bf-4a93-88eb-c71bde27bf5b/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:13:07 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-0cc95907-16c7-4a04-bb0c-a6ca059029af tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b048c677-85bf-4a93-88eb-c71bde27bf5b/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:13:07 user nova-compute[75216]: DEBUG nova.virt.disk.api [None req-0cc95907-16c7-4a04-bb0c-a6ca059029af tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Cannot resize image /opt/stack/data/nova/instances/b048c677-85bf-4a93-88eb-c71bde27bf5b/disk to a smaller size. {{(pid=75216) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 19:13:07 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-0cc95907-16c7-4a04-bb0c-a6ca059029af tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] [instance: b048c677-85bf-4a93-88eb-c71bde27bf5b] Created local disks {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 19:13:07 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-0cc95907-16c7-4a04-bb0c-a6ca059029af tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] [instance: b048c677-85bf-4a93-88eb-c71bde27bf5b] Ensure instance console log exists: /opt/stack/data/nova/instances/b048c677-85bf-4a93-88eb-c71bde27bf5b/console.log {{(pid=75216) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 19:13:07 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-0cc95907-16c7-4a04-bb0c-a6ca059029af tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:13:07 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-0cc95907-16c7-4a04-bb0c-a6ca059029af tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:13:07 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-0cc95907-16c7-4a04-bb0c-a6ca059029af tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:13:08 user nova-compute[75216]: DEBUG nova.network.neutron [None req-0cc95907-16c7-4a04-bb0c-a6ca059029af tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] [instance: b048c677-85bf-4a93-88eb-c71bde27bf5b] Successfully updated port: 4ae536b2-7829-45c2-8739-a3f838008e74 {{(pid=75216) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 19:13:08 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-0cc95907-16c7-4a04-bb0c-a6ca059029af tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Acquiring lock "refresh_cache-b048c677-85bf-4a93-88eb-c71bde27bf5b" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 19:13:08 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-0cc95907-16c7-4a04-bb0c-a6ca059029af tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Acquired lock "refresh_cache-b048c677-85bf-4a93-88eb-c71bde27bf5b" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 19:13:08 user nova-compute[75216]: DEBUG nova.network.neutron [None req-0cc95907-16c7-4a04-bb0c-a6ca059029af tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] [instance: b048c677-85bf-4a93-88eb-c71bde27bf5b] Building network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 19:13:08 user nova-compute[75216]: DEBUG nova.compute.manager [req-0bc6da4d-5497-4aa1-bc39-570dd7015c3a req-221e5125-a6a8-4fe1-9b3b-cd597eca6d30 service nova] [instance: b048c677-85bf-4a93-88eb-c71bde27bf5b] Received event network-changed-4ae536b2-7829-45c2-8739-a3f838008e74 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:13:08 user nova-compute[75216]: DEBUG nova.compute.manager [req-0bc6da4d-5497-4aa1-bc39-570dd7015c3a req-221e5125-a6a8-4fe1-9b3b-cd597eca6d30 service nova] [instance: b048c677-85bf-4a93-88eb-c71bde27bf5b] Refreshing instance network info cache due to event network-changed-4ae536b2-7829-45c2-8739-a3f838008e74. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 19:13:08 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-0bc6da4d-5497-4aa1-bc39-570dd7015c3a req-221e5125-a6a8-4fe1-9b3b-cd597eca6d30 service nova] Acquiring lock "refresh_cache-b048c677-85bf-4a93-88eb-c71bde27bf5b" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 19:13:08 user nova-compute[75216]: DEBUG nova.network.neutron [None req-0cc95907-16c7-4a04-bb0c-a6ca059029af tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] [instance: b048c677-85bf-4a93-88eb-c71bde27bf5b] Instance cache missing network info. {{(pid=75216) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 19:13:08 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:13:08 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:13:08 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:13:08 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:13:08 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Auditing locally available compute resources for user (node: user) {{(pid=75216) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 19:13:08 user nova-compute[75216]: DEBUG nova.network.neutron [None req-0cc95907-16c7-4a04-bb0c-a6ca059029af tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] [instance: b048c677-85bf-4a93-88eb-c71bde27bf5b] Updating instance_info_cache with network_info: [{"id": "4ae536b2-7829-45c2-8739-a3f838008e74", "address": "fa:16:3e:1a:59:bc", "network": {"id": "9dcbadf2-6b5e-41f1-88a3-17a579ad1bad", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-926239573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d06cae29094846f1817036dc761a565d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ae536b2-78", "ovs_interfaceid": "4ae536b2-7829-45c2-8739-a3f838008e74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:13:08 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-0cc95907-16c7-4a04-bb0c-a6ca059029af tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Releasing lock "refresh_cache-b048c677-85bf-4a93-88eb-c71bde27bf5b" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 19:13:08 user nova-compute[75216]: DEBUG nova.compute.manager [None req-0cc95907-16c7-4a04-bb0c-a6ca059029af tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] [instance: b048c677-85bf-4a93-88eb-c71bde27bf5b] Instance network_info: |[{"id": "4ae536b2-7829-45c2-8739-a3f838008e74", "address": "fa:16:3e:1a:59:bc", "network": {"id": "9dcbadf2-6b5e-41f1-88a3-17a579ad1bad", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-926239573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d06cae29094846f1817036dc761a565d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ae536b2-78", "ovs_interfaceid": "4ae536b2-7829-45c2-8739-a3f838008e74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 19:13:08 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-0bc6da4d-5497-4aa1-bc39-570dd7015c3a req-221e5125-a6a8-4fe1-9b3b-cd597eca6d30 service nova] Acquired lock "refresh_cache-b048c677-85bf-4a93-88eb-c71bde27bf5b" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 19:13:08 user nova-compute[75216]: DEBUG nova.network.neutron [req-0bc6da4d-5497-4aa1-bc39-570dd7015c3a req-221e5125-a6a8-4fe1-9b3b-cd597eca6d30 service nova] [instance: b048c677-85bf-4a93-88eb-c71bde27bf5b] Refreshing network info cache for port 4ae536b2-7829-45c2-8739-a3f838008e74 {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 19:13:08 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-0cc95907-16c7-4a04-bb0c-a6ca059029af tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] [instance: b048c677-85bf-4a93-88eb-c71bde27bf5b] Start _get_guest_xml network_info=[{"id": "4ae536b2-7829-45c2-8739-a3f838008e74", "address": "fa:16:3e:1a:59:bc", "network": {"id": "9dcbadf2-6b5e-41f1-88a3-17a579ad1bad", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-926239573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d06cae29094846f1817036dc761a565d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ae536b2-78", "ovs_interfaceid": "4ae536b2-7829-45c2-8739-a3f838008e74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T18:41:06Z,direct_url=<?>,disk_format='qcow2',id=77bcb5ba-8510-41ec-a88d-96097bb431de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c465b7c26ec44582b6d1b7169536ecc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T18:41:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'guest_format': None, 'boot_index': 0, 'image_id': '77bcb5ba-8510-41ec-a88d-96097bb431de'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 19:13:08 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e47d802-efdb-4763-8594-1ad056dbf6cc/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:13:08 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-0cc95907-16c7-4a04-bb0c-a6ca059029af tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 19:13:08 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-0cc95907-16c7-4a04-bb0c-a6ca059029af tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 19:13:08 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-0cc95907-16c7-4a04-bb0c-a6ca059029af tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 19:13:08 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-0cc95907-16c7-4a04-bb0c-a6ca059029af tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] CPU controller missing on host. {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 19:13:08 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-0cc95907-16c7-4a04-bb0c-a6ca059029af tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 19:13:08 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-0cc95907-16c7-4a04-bb0c-a6ca059029af tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] CPU controller found on host. {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 19:13:08 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-0cc95907-16c7-4a04-bb0c-a6ca059029af tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75216) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 19:13:08 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-0cc95907-16c7-4a04-bb0c-a6ca059029af tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T18:40:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T18:41:06Z,direct_url=<?>,disk_format='qcow2',id=77bcb5ba-8510-41ec-a88d-96097bb431de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c465b7c26ec44582b6d1b7169536ecc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T18:41:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 19:13:08 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-0cc95907-16c7-4a04-bb0c-a6ca059029af tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Flavor limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 19:13:08 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-0cc95907-16c7-4a04-bb0c-a6ca059029af tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Image limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 19:13:08 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-0cc95907-16c7-4a04-bb0c-a6ca059029af tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Flavor pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 19:13:08 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-0cc95907-16c7-4a04-bb0c-a6ca059029af tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Image pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 19:13:08 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-0cc95907-16c7-4a04-bb0c-a6ca059029af tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 19:13:08 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-0cc95907-16c7-4a04-bb0c-a6ca059029af tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 19:13:08 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-0cc95907-16c7-4a04-bb0c-a6ca059029af tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 19:13:08 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-0cc95907-16c7-4a04-bb0c-a6ca059029af tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Got 1 possible topologies {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 19:13:08 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-0cc95907-16c7-4a04-bb0c-a6ca059029af tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 19:13:08 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-0cc95907-16c7-4a04-bb0c-a6ca059029af tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 19:13:08 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-0cc95907-16c7-4a04-bb0c-a6ca059029af tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T19:13:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-468850457',display_name='tempest-AttachVolumeNegativeTest-server-468850457',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-468850457',id=38,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDkUOT/eEl0CMzN6y5KbV1T7tunzDOcX+OPMxhf7vC2+WQ9qJ1tjsn+PvxT+kq137f9ZmBxQOGjOyeJcsojdcHHl4sAA+puCY/iMnU3j7/ICJOJdrnt5+GE7rNuv+7+OMA==',key_name='tempest-keypair-1054757735',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d06cae29094846f1817036dc761a565d',ramdisk_id='',reservation_id='r-kv50en0j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1187420962',owner_user_name='tempest-AttachVolumeNegativeTest-1187420962-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T19:13:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1ca750d884c3403394b46f53fbd633a1',uuid=b048c677-85bf-4a93-88eb-c71bde27bf5b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4ae536b2-7829-45c2-8739-a3f838008e74", "address": "fa:16:3e:1a:59:bc", "network": {"id": "9dcbadf2-6b5e-41f1-88a3-17a579ad1bad", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-926239573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d06cae29094846f1817036dc761a565d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ae536b2-78", "ovs_interfaceid": "4ae536b2-7829-45c2-8739-a3f838008e74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75216) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 19:13:08 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-0cc95907-16c7-4a04-bb0c-a6ca059029af tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Converting VIF {"id": "4ae536b2-7829-45c2-8739-a3f838008e74", "address": "fa:16:3e:1a:59:bc", "network": {"id": "9dcbadf2-6b5e-41f1-88a3-17a579ad1bad", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-926239573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d06cae29094846f1817036dc761a565d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ae536b2-78", "ovs_interfaceid": "4ae536b2-7829-45c2-8739-a3f838008e74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 19:13:08 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-0cc95907-16c7-4a04-bb0c-a6ca059029af tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:59:bc,bridge_name='br-int',has_traffic_filtering=True,id=4ae536b2-7829-45c2-8739-a3f838008e74,network=Network(9dcbadf2-6b5e-41f1-88a3-17a579ad1bad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ae536b2-78') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 19:13:08 user nova-compute[75216]: DEBUG nova.objects.instance [None req-0cc95907-16c7-4a04-bb0c-a6ca059029af tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Lazy-loading 'pci_devices' on Instance uuid b048c677-85bf-4a93-88eb-c71bde27bf5b {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:13:08 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-0cc95907-16c7-4a04-bb0c-a6ca059029af tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] [instance: b048c677-85bf-4a93-88eb-c71bde27bf5b] End _get_guest_xml xml=<domain type="kvm">
Nov 13 19:13:08 user nova-compute[75216]:   <uuid>b048c677-85bf-4a93-88eb-c71bde27bf5b</uuid>
Nov 13 19:13:08 user nova-compute[75216]:   <name>instance-00000026</name>
Nov 13 19:13:08 user nova-compute[75216]:   <memory>524288</memory>
Nov 13 19:13:08 user nova-compute[75216]:   <vcpu>1</vcpu>
Nov 13 19:13:08 user nova-compute[75216]:   <metadata>
Nov 13 19:13:08 user nova-compute[75216]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 19:13:08 user nova-compute[75216]:       <nova:package version="0.0.0"/>
Nov 13 19:13:08 user nova-compute[75216]:       <nova:name>tempest-AttachVolumeNegativeTest-server-468850457</nova:name>
Nov 13 19:13:08 user nova-compute[75216]:       <nova:creationTime>2023-11-13 19:13:08</nova:creationTime>
Nov 13 19:13:08 user nova-compute[75216]:       <nova:flavor name="m1.tiny">
Nov 13 19:13:08 user nova-compute[75216]:         <nova:memory>512</nova:memory>
Nov 13 19:13:08 user nova-compute[75216]:         <nova:disk>1</nova:disk>
Nov 13 19:13:08 user nova-compute[75216]:         <nova:swap>0</nova:swap>
Nov 13 19:13:08 user nova-compute[75216]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 19:13:08 user nova-compute[75216]:         <nova:vcpus>1</nova:vcpus>
Nov 13 19:13:08 user nova-compute[75216]:       </nova:flavor>
Nov 13 19:13:08 user nova-compute[75216]:       <nova:owner>
Nov 13 19:13:08 user nova-compute[75216]:         <nova:user uuid="1ca750d884c3403394b46f53fbd633a1">tempest-AttachVolumeNegativeTest-1187420962-project-member</nova:user>
Nov 13 19:13:08 user nova-compute[75216]:         <nova:project uuid="d06cae29094846f1817036dc761a565d">tempest-AttachVolumeNegativeTest-1187420962</nova:project>
Nov 13 19:13:08 user nova-compute[75216]:       </nova:owner>
Nov 13 19:13:08 user nova-compute[75216]:       <nova:root type="image" uuid="77bcb5ba-8510-41ec-a88d-96097bb431de"/>
Nov 13 19:13:08 user nova-compute[75216]:       <nova:ports>
Nov 13 19:13:08 user nova-compute[75216]:         <nova:port uuid="4ae536b2-7829-45c2-8739-a3f838008e74">
Nov 13 19:13:08 user nova-compute[75216]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 13 19:13:08 user nova-compute[75216]:         </nova:port>
Nov 13 19:13:08 user nova-compute[75216]:       </nova:ports>
Nov 13 19:13:08 user nova-compute[75216]:     </nova:instance>
Nov 13 19:13:08 user nova-compute[75216]:   </metadata>
Nov 13 19:13:08 user nova-compute[75216]:   <sysinfo type="smbios">
Nov 13 19:13:08 user nova-compute[75216]:     <system>
Nov 13 19:13:08 user nova-compute[75216]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 19:13:08 user nova-compute[75216]:       <entry name="product">OpenStack Nova</entry>
Nov 13 19:13:08 user nova-compute[75216]:       <entry name="version">0.0.0</entry>
Nov 13 19:13:08 user nova-compute[75216]:       <entry name="serial">b048c677-85bf-4a93-88eb-c71bde27bf5b</entry>
Nov 13 19:13:08 user nova-compute[75216]:       <entry name="uuid">b048c677-85bf-4a93-88eb-c71bde27bf5b</entry>
Nov 13 19:13:08 user nova-compute[75216]:       <entry name="family">Virtual Machine</entry>
Nov 13 19:13:08 user nova-compute[75216]:     </system>
Nov 13 19:13:08 user nova-compute[75216]:   </sysinfo>
Nov 13 19:13:08 user nova-compute[75216]:   <os>
Nov 13 19:13:08 user nova-compute[75216]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 19:13:08 user nova-compute[75216]:     <boot dev="hd"/>
Nov 13 19:13:08 user nova-compute[75216]:     <smbios mode="sysinfo"/>
Nov 13 19:13:08 user nova-compute[75216]:   </os>
Nov 13 19:13:08 user nova-compute[75216]:   <features>
Nov 13 19:13:08 user nova-compute[75216]:     <acpi/>
Nov 13 19:13:08 user nova-compute[75216]:     <apic/>
Nov 13 19:13:08 user nova-compute[75216]:     <vmcoreinfo/>
Nov 13 19:13:08 user nova-compute[75216]:   </features>
Nov 13 19:13:08 user nova-compute[75216]:   <clock offset="utc">
Nov 13 19:13:08 user nova-compute[75216]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 19:13:08 user nova-compute[75216]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 19:13:08 user nova-compute[75216]:     <timer name="hpet" present="no"/>
Nov 13 19:13:08 user nova-compute[75216]:   </clock>
Nov 13 19:13:08 user nova-compute[75216]:   <cpu mode="custom" match="exact">
Nov 13 19:13:08 user nova-compute[75216]:     <model>Nehalem</model>
Nov 13 19:13:08 user nova-compute[75216]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 19:13:08 user nova-compute[75216]:   </cpu>
Nov 13 19:13:08 user nova-compute[75216]:   <devices>
Nov 13 19:13:08 user nova-compute[75216]:     <disk type="file" device="disk">
Nov 13 19:13:08 user nova-compute[75216]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 19:13:08 user nova-compute[75216]:       <source file="/opt/stack/data/nova/instances/b048c677-85bf-4a93-88eb-c71bde27bf5b/disk"/>
Nov 13 19:13:08 user nova-compute[75216]:       <target dev="vda" bus="virtio"/>
Nov 13 19:13:08 user nova-compute[75216]:     </disk>
Nov 13 19:13:08 user nova-compute[75216]:     <interface type="ethernet">
Nov 13 19:13:08 user nova-compute[75216]:       <mac address="fa:16:3e:1a:59:bc"/>
Nov 13 19:13:08 user nova-compute[75216]:       <model type="virtio"/>
Nov 13 19:13:08 user nova-compute[75216]:       <mtu size="1442"/>
Nov 13 19:13:08 user nova-compute[75216]:       <target dev="tap4ae536b2-78"/>
Nov 13 19:13:08 user nova-compute[75216]:     </interface>
Nov 13 19:13:08 user nova-compute[75216]:     <serial type="pty">
Nov 13 19:13:08 user nova-compute[75216]:       <log file="/opt/stack/data/nova/instances/b048c677-85bf-4a93-88eb-c71bde27bf5b/console.log" append="off"/>
Nov 13 19:13:08 user nova-compute[75216]:     </serial>
Nov 13 19:13:08 user nova-compute[75216]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 19:13:08 user nova-compute[75216]:     <video>
Nov 13 19:13:08 user nova-compute[75216]:       <model type="virtio"/>
Nov 13 19:13:08 user nova-compute[75216]:     </video>
Nov 13 19:13:08 user nova-compute[75216]:     <rng model="virtio">
Nov 13 19:13:08 user nova-compute[75216]:       <backend model="random">/dev/urandom</backend>
Nov 13 19:13:08 user nova-compute[75216]:     </rng>
Nov 13 19:13:08 user nova-compute[75216]:     <controller type="usb" index="0" model="none"/>
Nov 13 19:13:08 user nova-compute[75216]:     <memballoon model="virtio">
Nov 13 19:13:08 user nova-compute[75216]:       <stats period="10"/>
Nov 13 19:13:08 user nova-compute[75216]:     </memballoon>
Nov 13 19:13:08 user nova-compute[75216]:   </devices>
Nov 13 19:13:08 user nova-compute[75216]: </domain>
Nov 13 19:13:08 user nova-compute[75216]:  {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 19:13:08 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-0cc95907-16c7-4a04-bb0c-a6ca059029af tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T19:13:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-468850457',display_name='tempest-AttachVolumeNegativeTest-server-468850457',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-468850457',id=38,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDkUOT/eEl0CMzN6y5KbV1T7tunzDOcX+OPMxhf7vC2+WQ9qJ1tjsn+PvxT+kq137f9ZmBxQOGjOyeJcsojdcHHl4sAA+puCY/iMnU3j7/ICJOJdrnt5+GE7rNuv+7+OMA==',key_name='tempest-keypair-1054757735',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d06cae29094846f1817036dc761a565d',ramdisk_id='',reservation_id='r-kv50en0j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1187420962',owner_user_name='tempest-AttachVolumeNegativeTest-1187420962-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T19:13:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1ca750d884c3403394b46f53fbd633a1',uuid=b048c677-85bf-4a93-88eb-c71bde27bf5b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4ae536b2-7829-45c2-8739-a3f838008e74", "address": "fa:16:3e:1a:59:bc", "network": {"id": "9dcbadf2-6b5e-41f1-88a3-17a579ad1bad", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-926239573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d06cae29094846f1817036dc761a565d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ae536b2-78", "ovs_interfaceid": "4ae536b2-7829-45c2-8739-a3f838008e74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 19:13:08 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-0cc95907-16c7-4a04-bb0c-a6ca059029af tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Converting VIF {"id": "4ae536b2-7829-45c2-8739-a3f838008e74", "address": "fa:16:3e:1a:59:bc", "network": {"id": "9dcbadf2-6b5e-41f1-88a3-17a579ad1bad", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-926239573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d06cae29094846f1817036dc761a565d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ae536b2-78", "ovs_interfaceid": "4ae536b2-7829-45c2-8739-a3f838008e74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 19:13:08 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-0cc95907-16c7-4a04-bb0c-a6ca059029af tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:59:bc,bridge_name='br-int',has_traffic_filtering=True,id=4ae536b2-7829-45c2-8739-a3f838008e74,network=Network(9dcbadf2-6b5e-41f1-88a3-17a579ad1bad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ae536b2-78') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 19:13:08 user nova-compute[75216]: DEBUG os_vif [None req-0cc95907-16c7-4a04-bb0c-a6ca059029af tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:59:bc,bridge_name='br-int',has_traffic_filtering=True,id=4ae536b2-7829-45c2-8739-a3f838008e74,network=Network(9dcbadf2-6b5e-41f1-88a3-17a579ad1bad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ae536b2-78') {{(pid=75216) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 19:13:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:13:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:13:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 19:13:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:13:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8447b97f-fe57-5a2c-bbbb-9cc728f539f9', '_type': 'linux-noop'}}, row=False) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:13:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:13:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:13:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:13:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4ae536b2-78, may_exist=True, interface_attrs={}) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:13:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4ae536b2-78, col_values=(('qos', UUID('e8b82dd3-5088-469f-9724-5256b70659ae')),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:13:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4ae536b2-78, col_values=(('external_ids', {'iface-id': '4ae536b2-7829-45c2-8739-a3f838008e74', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1a:59:bc', 'vm-uuid': 'b048c677-85bf-4a93-88eb-c71bde27bf5b'}),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:13:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:13:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:13:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:13:08 user nova-compute[75216]: INFO os_vif [None req-0cc95907-16c7-4a04-bb0c-a6ca059029af tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:59:bc,bridge_name='br-int',has_traffic_filtering=True,id=4ae536b2-7829-45c2-8739-a3f838008e74,network=Network(9dcbadf2-6b5e-41f1-88a3-17a579ad1bad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ae536b2-78')
Nov 13 19:13:08 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e47d802-efdb-4763-8594-1ad056dbf6cc/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:13:08 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e47d802-efdb-4763-8594-1ad056dbf6cc/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:13:08 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-0cc95907-16c7-4a04-bb0c-a6ca059029af tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 19:13:08 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-0cc95907-16c7-4a04-bb0c-a6ca059029af tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] No VIF found with MAC fa:16:3e:1a:59:bc, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 19:13:08 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e47d802-efdb-4763-8594-1ad056dbf6cc/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:13:08 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55b7031b-4fd6-4ecb-9130-68110677c7cf/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:13:09 user nova-compute[75216]: DEBUG nova.network.neutron [req-0bc6da4d-5497-4aa1-bc39-570dd7015c3a req-221e5125-a6a8-4fe1-9b3b-cd597eca6d30 service nova] [instance: b048c677-85bf-4a93-88eb-c71bde27bf5b] Updated VIF entry in instance network info cache for port 4ae536b2-7829-45c2-8739-a3f838008e74. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 19:13:09 user nova-compute[75216]: DEBUG nova.network.neutron [req-0bc6da4d-5497-4aa1-bc39-570dd7015c3a req-221e5125-a6a8-4fe1-9b3b-cd597eca6d30 service nova] [instance: b048c677-85bf-4a93-88eb-c71bde27bf5b] Updating instance_info_cache with network_info: [{"id": "4ae536b2-7829-45c2-8739-a3f838008e74", "address": "fa:16:3e:1a:59:bc", "network": {"id": "9dcbadf2-6b5e-41f1-88a3-17a579ad1bad", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-926239573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d06cae29094846f1817036dc761a565d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ae536b2-78", "ovs_interfaceid": "4ae536b2-7829-45c2-8739-a3f838008e74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:13:09 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-0bc6da4d-5497-4aa1-bc39-570dd7015c3a req-221e5125-a6a8-4fe1-9b3b-cd597eca6d30 service nova] Releasing lock "refresh_cache-b048c677-85bf-4a93-88eb-c71bde27bf5b" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 19:13:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55b7031b-4fd6-4ecb-9130-68110677c7cf/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:13:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55b7031b-4fd6-4ecb-9130-68110677c7cf/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:13:09 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:13:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55b7031b-4fd6-4ecb-9130-68110677c7cf/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:13:09 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 19:13:09 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 19:13:09 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Hypervisor/Node resource view: name=user free_ram=8753MB free_disk=25.385757446289062GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75216) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 19:13:09 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:13:09 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:13:09 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance 9e47d802-efdb-4763-8594-1ad056dbf6cc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 19:13:09 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance 55b7031b-4fd6-4ecb-9130-68110677c7cf actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 19:13:09 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance b048c677-85bf-4a93-88eb-c71bde27bf5b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 19:13:09 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 19:13:09 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 19:13:09 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 19:13:09 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 19:13:09 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Compute_service record updated for user:user {{(pid=75216) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 19:13:09 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.270s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:13:10 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:13:10 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:13:10 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:13:10 user nova-compute[75216]: DEBUG nova.compute.manager [req-825eec6f-77f4-4389-837b-331702547a0a req-0f7f8b9f-9c8b-45e9-b29f-c53f065e1882 service nova] [instance: b048c677-85bf-4a93-88eb-c71bde27bf5b] Received event network-vif-plugged-4ae536b2-7829-45c2-8739-a3f838008e74 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:13:10 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-825eec6f-77f4-4389-837b-331702547a0a req-0f7f8b9f-9c8b-45e9-b29f-c53f065e1882 service nova] Acquiring lock "b048c677-85bf-4a93-88eb-c71bde27bf5b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:13:10 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-825eec6f-77f4-4389-837b-331702547a0a req-0f7f8b9f-9c8b-45e9-b29f-c53f065e1882 service nova] Lock "b048c677-85bf-4a93-88eb-c71bde27bf5b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:13:10 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-825eec6f-77f4-4389-837b-331702547a0a req-0f7f8b9f-9c8b-45e9-b29f-c53f065e1882 service nova] Lock "b048c677-85bf-4a93-88eb-c71bde27bf5b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:13:10 user nova-compute[75216]: DEBUG nova.compute.manager [req-825eec6f-77f4-4389-837b-331702547a0a req-0f7f8b9f-9c8b-45e9-b29f-c53f065e1882 service nova] [instance: b048c677-85bf-4a93-88eb-c71bde27bf5b] No waiting events found dispatching network-vif-plugged-4ae536b2-7829-45c2-8739-a3f838008e74 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 19:13:10 user nova-compute[75216]: WARNING nova.compute.manager [req-825eec6f-77f4-4389-837b-331702547a0a req-0f7f8b9f-9c8b-45e9-b29f-c53f065e1882 service nova] [instance: b048c677-85bf-4a93-88eb-c71bde27bf5b] Received unexpected event network-vif-plugged-4ae536b2-7829-45c2-8739-a3f838008e74 for instance with vm_state building and task_state spawning.
Nov 13 19:13:10 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:13:10 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:13:10 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:13:10 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:13:12 user nova-compute[75216]: DEBUG nova.compute.manager [None req-0cc95907-16c7-4a04-bb0c-a6ca059029af tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] [instance: b048c677-85bf-4a93-88eb-c71bde27bf5b] Instance event wait completed in 0 seconds for  {{(pid=75216) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 19:13:12 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-0cc95907-16c7-4a04-bb0c-a6ca059029af tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] [instance: b048c677-85bf-4a93-88eb-c71bde27bf5b] Guest created on hypervisor {{(pid=75216) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 19:13:12 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: b048c677-85bf-4a93-88eb-c71bde27bf5b] Instance spawned successfully.
Nov 13 19:13:12 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-0cc95907-16c7-4a04-bb0c-a6ca059029af tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] [instance: b048c677-85bf-4a93-88eb-c71bde27bf5b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 19:13:12 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-0cc95907-16c7-4a04-bb0c-a6ca059029af tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] [instance: b048c677-85bf-4a93-88eb-c71bde27bf5b] Found default for hw_cdrom_bus of ide {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 19:13:12 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-0cc95907-16c7-4a04-bb0c-a6ca059029af tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] [instance: b048c677-85bf-4a93-88eb-c71bde27bf5b] Found default for hw_disk_bus of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 19:13:12 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-0cc95907-16c7-4a04-bb0c-a6ca059029af tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] [instance: b048c677-85bf-4a93-88eb-c71bde27bf5b] Found default for hw_input_bus of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 19:13:12 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-0cc95907-16c7-4a04-bb0c-a6ca059029af tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] [instance: b048c677-85bf-4a93-88eb-c71bde27bf5b] Found default for hw_pointer_model of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 19:13:12 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-0cc95907-16c7-4a04-bb0c-a6ca059029af tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] [instance: b048c677-85bf-4a93-88eb-c71bde27bf5b] Found default for hw_video_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 19:13:12 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-0cc95907-16c7-4a04-bb0c-a6ca059029af tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] [instance: b048c677-85bf-4a93-88eb-c71bde27bf5b] Found default for hw_vif_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 19:13:12 user nova-compute[75216]: DEBUG nova.compute.manager [req-693a8596-4946-4c19-8246-7edaf4180119 req-996723bb-9916-401a-8548-1496d99605ff service nova] [instance: b048c677-85bf-4a93-88eb-c71bde27bf5b] Received event network-vif-plugged-4ae536b2-7829-45c2-8739-a3f838008e74 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:13:12 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-693a8596-4946-4c19-8246-7edaf4180119 req-996723bb-9916-401a-8548-1496d99605ff service nova] Acquiring lock "b048c677-85bf-4a93-88eb-c71bde27bf5b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:13:12 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-693a8596-4946-4c19-8246-7edaf4180119 req-996723bb-9916-401a-8548-1496d99605ff service nova] Lock "b048c677-85bf-4a93-88eb-c71bde27bf5b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:13:12 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-693a8596-4946-4c19-8246-7edaf4180119 req-996723bb-9916-401a-8548-1496d99605ff service nova] Lock "b048c677-85bf-4a93-88eb-c71bde27bf5b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:13:12 user nova-compute[75216]: DEBUG nova.compute.manager [req-693a8596-4946-4c19-8246-7edaf4180119 req-996723bb-9916-401a-8548-1496d99605ff service nova] [instance: b048c677-85bf-4a93-88eb-c71bde27bf5b] No waiting events found dispatching network-vif-plugged-4ae536b2-7829-45c2-8739-a3f838008e74 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 19:13:12 user nova-compute[75216]: WARNING nova.compute.manager [req-693a8596-4946-4c19-8246-7edaf4180119 req-996723bb-9916-401a-8548-1496d99605ff service nova] [instance: b048c677-85bf-4a93-88eb-c71bde27bf5b] Received unexpected event network-vif-plugged-4ae536b2-7829-45c2-8739-a3f838008e74 for instance with vm_state building and task_state spawning.
Nov 13 19:13:12 user nova-compute[75216]: INFO nova.compute.manager [None req-0cc95907-16c7-4a04-bb0c-a6ca059029af tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] [instance: b048c677-85bf-4a93-88eb-c71bde27bf5b] Took 5.45 seconds to spawn the instance on the hypervisor.
Nov 13 19:13:12 user nova-compute[75216]: DEBUG nova.compute.manager [None req-0cc95907-16c7-4a04-bb0c-a6ca059029af tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] [instance: b048c677-85bf-4a93-88eb-c71bde27bf5b] Checking state {{(pid=75216) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 19:13:12 user nova-compute[75216]: INFO nova.compute.manager [None req-0cc95907-16c7-4a04-bb0c-a6ca059029af tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] [instance: b048c677-85bf-4a93-88eb-c71bde27bf5b] Took 6.01 seconds to build instance.
Nov 13 19:13:12 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-0cc95907-16c7-4a04-bb0c-a6ca059029af tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Lock "b048c677-85bf-4a93-88eb-c71bde27bf5b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.139s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:13:12 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:13:12 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Starting heal instance info cache {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 19:13:12 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Rebuilding the list of instances to heal {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 13 19:13:13 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "refresh_cache-9e47d802-efdb-4763-8594-1ad056dbf6cc" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 19:13:13 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquired lock "refresh_cache-9e47d802-efdb-4763-8594-1ad056dbf6cc" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 19:13:13 user nova-compute[75216]: DEBUG nova.network.neutron [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: 9e47d802-efdb-4763-8594-1ad056dbf6cc] Forcefully refreshing network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 19:13:13 user nova-compute[75216]: DEBUG nova.objects.instance [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lazy-loading 'info_cache' on Instance uuid 9e47d802-efdb-4763-8594-1ad056dbf6cc {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:13:13 user nova-compute[75216]: DEBUG nova.network.neutron [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: 9e47d802-efdb-4763-8594-1ad056dbf6cc] Updating instance_info_cache with network_info: [{"id": "637bd8e9-478b-462f-bb28-a0a32f7bb6cb", "address": "fa:16:3e:ca:d7:9f", "network": {"id": "53bb01d5-31a4-47af-a931-ac12fe72b986", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-802892643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "095f5765865140d29b3ecf1ab3427037", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap637bd8e9-47", "ovs_interfaceid": "637bd8e9-478b-462f-bb28-a0a32f7bb6cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:13:13 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Releasing lock "refresh_cache-9e47d802-efdb-4763-8594-1ad056dbf6cc" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 19:13:13 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: 9e47d802-efdb-4763-8594-1ad056dbf6cc] Updated the network info_cache for instance {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 19:13:13 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:13:13 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:13:14 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:13:15 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:13:18 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:13:19 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:13:19 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:13:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:13:24 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:13:24 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:13:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:13:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:13:33 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:13:34 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:13:35 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:13:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:13:38 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:13:39 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:13:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c6e5bc69-a056-4a68-b0e0-3e79d15f7869 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Acquiring lock "aca6edce-d579-4375-9bcd-2ba4d645b894" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:13:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c6e5bc69-a056-4a68-b0e0-3e79d15f7869 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Lock "aca6edce-d579-4375-9bcd-2ba4d645b894" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:13:43 user nova-compute[75216]: DEBUG nova.compute.manager [None req-c6e5bc69-a056-4a68-b0e0-3e79d15f7869 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] [instance: aca6edce-d579-4375-9bcd-2ba4d645b894] Starting instance... {{(pid=75216) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 19:13:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c6e5bc69-a056-4a68-b0e0-3e79d15f7869 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:13:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c6e5bc69-a056-4a68-b0e0-3e79d15f7869 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:13:43 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-c6e5bc69-a056-4a68-b0e0-3e79d15f7869 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75216) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 19:13:43 user nova-compute[75216]: INFO nova.compute.claims [None req-c6e5bc69-a056-4a68-b0e0-3e79d15f7869 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] [instance: aca6edce-d579-4375-9bcd-2ba4d645b894] Claim successful on node user
Nov 13 19:13:43 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-c6e5bc69-a056-4a68-b0e0-3e79d15f7869 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 19:13:43 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-c6e5bc69-a056-4a68-b0e0-3e79d15f7869 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 19:13:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c6e5bc69-a056-4a68-b0e0-3e79d15f7869 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.247s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:13:43 user nova-compute[75216]: DEBUG nova.compute.manager [None req-c6e5bc69-a056-4a68-b0e0-3e79d15f7869 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] [instance: aca6edce-d579-4375-9bcd-2ba4d645b894] Start building networks asynchronously for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 19:13:43 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:13:43 user nova-compute[75216]: DEBUG nova.compute.manager [None req-c6e5bc69-a056-4a68-b0e0-3e79d15f7869 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] [instance: aca6edce-d579-4375-9bcd-2ba4d645b894] Allocating IP information in the background. {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 19:13:43 user nova-compute[75216]: DEBUG nova.network.neutron [None req-c6e5bc69-a056-4a68-b0e0-3e79d15f7869 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] [instance: aca6edce-d579-4375-9bcd-2ba4d645b894] allocate_for_instance() {{(pid=75216) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 19:13:43 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-c6e5bc69-a056-4a68-b0e0-3e79d15f7869 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] [instance: aca6edce-d579-4375-9bcd-2ba4d645b894] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 19:13:43 user nova-compute[75216]: DEBUG nova.compute.manager [None req-c6e5bc69-a056-4a68-b0e0-3e79d15f7869 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] [instance: aca6edce-d579-4375-9bcd-2ba4d645b894] Start building block device mappings for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 19:13:43 user nova-compute[75216]: DEBUG nova.policy [None req-c6e5bc69-a056-4a68-b0e0-3e79d15f7869 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '75359f2870344d9d83ce124a7a990aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8c5d1e9e06c4202b31637288388048a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75216) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 19:13:43 user nova-compute[75216]: DEBUG nova.compute.manager [None req-c6e5bc69-a056-4a68-b0e0-3e79d15f7869 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] [instance: aca6edce-d579-4375-9bcd-2ba4d645b894] Start spawning the instance on the hypervisor. {{(pid=75216) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 19:13:43 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-c6e5bc69-a056-4a68-b0e0-3e79d15f7869 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] [instance: aca6edce-d579-4375-9bcd-2ba4d645b894] Creating instance directory {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 19:13:43 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-c6e5bc69-a056-4a68-b0e0-3e79d15f7869 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] [instance: aca6edce-d579-4375-9bcd-2ba4d645b894] Creating image(s)
Nov 13 19:13:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c6e5bc69-a056-4a68-b0e0-3e79d15f7869 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Acquiring lock "/opt/stack/data/nova/instances/aca6edce-d579-4375-9bcd-2ba4d645b894/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:13:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c6e5bc69-a056-4a68-b0e0-3e79d15f7869 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Lock "/opt/stack/data/nova/instances/aca6edce-d579-4375-9bcd-2ba4d645b894/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:13:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c6e5bc69-a056-4a68-b0e0-3e79d15f7869 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Lock "/opt/stack/data/nova/instances/aca6edce-d579-4375-9bcd-2ba4d645b894/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:13:43 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-c6e5bc69-a056-4a68-b0e0-3e79d15f7869 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:13:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-c6e5bc69-a056-4a68-b0e0-3e79d15f7869 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json" returned: 0 in 0.249s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:13:44 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c6e5bc69-a056-4a68-b0e0-3e79d15f7869 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Acquiring lock "88c50a45bec9d6b0427462b3242b9b8e5f49c2b6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:13:44 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c6e5bc69-a056-4a68-b0e0-3e79d15f7869 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Lock "88c50a45bec9d6b0427462b3242b9b8e5f49c2b6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:13:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-c6e5bc69-a056-4a68-b0e0-3e79d15f7869 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:13:44 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:13:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-c6e5bc69-a056-4a68-b0e0-3e79d15f7869 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json" returned: 0 in 0.170s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:13:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-c6e5bc69-a056-4a68-b0e0-3e79d15f7869 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6,backing_fmt=raw /opt/stack/data/nova/instances/aca6edce-d579-4375-9bcd-2ba4d645b894/disk 1073741824 {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:13:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-c6e5bc69-a056-4a68-b0e0-3e79d15f7869 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6,backing_fmt=raw /opt/stack/data/nova/instances/aca6edce-d579-4375-9bcd-2ba4d645b894/disk 1073741824" returned: 0 in 0.055s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:13:44 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c6e5bc69-a056-4a68-b0e0-3e79d15f7869 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Lock "88c50a45bec9d6b0427462b3242b9b8e5f49c2b6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.230s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:13:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-c6e5bc69-a056-4a68-b0e0-3e79d15f7869 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:13:44 user nova-compute[75216]: DEBUG nova.network.neutron [None req-c6e5bc69-a056-4a68-b0e0-3e79d15f7869 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] [instance: aca6edce-d579-4375-9bcd-2ba4d645b894] Successfully created port: 121d7d67-75ec-46ed-ae33-5c08519acf09 {{(pid=75216) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 19:13:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-c6e5bc69-a056-4a68-b0e0-3e79d15f7869 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json" returned: 0 in 0.169s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:13:44 user nova-compute[75216]: DEBUG nova.virt.disk.api [None req-c6e5bc69-a056-4a68-b0e0-3e79d15f7869 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Checking if we can resize image /opt/stack/data/nova/instances/aca6edce-d579-4375-9bcd-2ba4d645b894/disk. size=1073741824 {{(pid=75216) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 19:13:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-c6e5bc69-a056-4a68-b0e0-3e79d15f7869 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aca6edce-d579-4375-9bcd-2ba4d645b894/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:13:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-c6e5bc69-a056-4a68-b0e0-3e79d15f7869 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aca6edce-d579-4375-9bcd-2ba4d645b894/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:13:44 user nova-compute[75216]: DEBUG nova.virt.disk.api [None req-c6e5bc69-a056-4a68-b0e0-3e79d15f7869 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Cannot resize image /opt/stack/data/nova/instances/aca6edce-d579-4375-9bcd-2ba4d645b894/disk to a smaller size. {{(pid=75216) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 19:13:44 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-c6e5bc69-a056-4a68-b0e0-3e79d15f7869 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] [instance: aca6edce-d579-4375-9bcd-2ba4d645b894] Created local disks {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 19:13:44 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-c6e5bc69-a056-4a68-b0e0-3e79d15f7869 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] [instance: aca6edce-d579-4375-9bcd-2ba4d645b894] Ensure instance console log exists: /opt/stack/data/nova/instances/aca6edce-d579-4375-9bcd-2ba4d645b894/console.log {{(pid=75216) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 19:13:44 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c6e5bc69-a056-4a68-b0e0-3e79d15f7869 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:13:44 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c6e5bc69-a056-4a68-b0e0-3e79d15f7869 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:13:44 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c6e5bc69-a056-4a68-b0e0-3e79d15f7869 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:13:45 user nova-compute[75216]: DEBUG nova.network.neutron [None req-c6e5bc69-a056-4a68-b0e0-3e79d15f7869 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] [instance: aca6edce-d579-4375-9bcd-2ba4d645b894] Successfully updated port: 121d7d67-75ec-46ed-ae33-5c08519acf09 {{(pid=75216) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 19:13:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c6e5bc69-a056-4a68-b0e0-3e79d15f7869 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Acquiring lock "refresh_cache-aca6edce-d579-4375-9bcd-2ba4d645b894" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 19:13:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c6e5bc69-a056-4a68-b0e0-3e79d15f7869 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Acquired lock "refresh_cache-aca6edce-d579-4375-9bcd-2ba4d645b894" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 19:13:45 user nova-compute[75216]: DEBUG nova.network.neutron [None req-c6e5bc69-a056-4a68-b0e0-3e79d15f7869 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] [instance: aca6edce-d579-4375-9bcd-2ba4d645b894] Building network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 19:13:45 user nova-compute[75216]: DEBUG nova.compute.manager [req-64b27aa6-dbaa-4415-989f-70b20aeca1b6 req-975955af-dd72-4d25-9496-90807457a0e4 service nova] [instance: aca6edce-d579-4375-9bcd-2ba4d645b894] Received event network-changed-121d7d67-75ec-46ed-ae33-5c08519acf09 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:13:45 user nova-compute[75216]: DEBUG nova.compute.manager [req-64b27aa6-dbaa-4415-989f-70b20aeca1b6 req-975955af-dd72-4d25-9496-90807457a0e4 service nova] [instance: aca6edce-d579-4375-9bcd-2ba4d645b894] Refreshing instance network info cache due to event network-changed-121d7d67-75ec-46ed-ae33-5c08519acf09. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 19:13:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-64b27aa6-dbaa-4415-989f-70b20aeca1b6 req-975955af-dd72-4d25-9496-90807457a0e4 service nova] Acquiring lock "refresh_cache-aca6edce-d579-4375-9bcd-2ba4d645b894" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 19:13:45 user nova-compute[75216]: DEBUG nova.network.neutron [None req-c6e5bc69-a056-4a68-b0e0-3e79d15f7869 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] [instance: aca6edce-d579-4375-9bcd-2ba4d645b894] Instance cache missing network info. {{(pid=75216) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 19:13:45 user nova-compute[75216]: DEBUG nova.network.neutron [None req-c6e5bc69-a056-4a68-b0e0-3e79d15f7869 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] [instance: aca6edce-d579-4375-9bcd-2ba4d645b894] Updating instance_info_cache with network_info: [{"id": "121d7d67-75ec-46ed-ae33-5c08519acf09", "address": "fa:16:3e:58:78:ca", "network": {"id": "5c3296e5-d81b-4378-9108-bcc3ced5458a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-381226649-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e8c5d1e9e06c4202b31637288388048a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap121d7d67-75", "ovs_interfaceid": "121d7d67-75ec-46ed-ae33-5c08519acf09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:13:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c6e5bc69-a056-4a68-b0e0-3e79d15f7869 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Releasing lock "refresh_cache-aca6edce-d579-4375-9bcd-2ba4d645b894" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 19:13:45 user nova-compute[75216]: DEBUG nova.compute.manager [None req-c6e5bc69-a056-4a68-b0e0-3e79d15f7869 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] [instance: aca6edce-d579-4375-9bcd-2ba4d645b894] Instance network_info: |[{"id": "121d7d67-75ec-46ed-ae33-5c08519acf09", "address": "fa:16:3e:58:78:ca", "network": {"id": "5c3296e5-d81b-4378-9108-bcc3ced5458a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-381226649-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e8c5d1e9e06c4202b31637288388048a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap121d7d67-75", "ovs_interfaceid": "121d7d67-75ec-46ed-ae33-5c08519acf09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 19:13:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-64b27aa6-dbaa-4415-989f-70b20aeca1b6 req-975955af-dd72-4d25-9496-90807457a0e4 service nova] Acquired lock "refresh_cache-aca6edce-d579-4375-9bcd-2ba4d645b894" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 19:13:45 user nova-compute[75216]: DEBUG nova.network.neutron [req-64b27aa6-dbaa-4415-989f-70b20aeca1b6 req-975955af-dd72-4d25-9496-90807457a0e4 service nova] [instance: aca6edce-d579-4375-9bcd-2ba4d645b894] Refreshing network info cache for port 121d7d67-75ec-46ed-ae33-5c08519acf09 {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 19:13:45 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-c6e5bc69-a056-4a68-b0e0-3e79d15f7869 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] [instance: aca6edce-d579-4375-9bcd-2ba4d645b894] Start _get_guest_xml network_info=[{"id": "121d7d67-75ec-46ed-ae33-5c08519acf09", "address": "fa:16:3e:58:78:ca", "network": {"id": "5c3296e5-d81b-4378-9108-bcc3ced5458a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-381226649-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e8c5d1e9e06c4202b31637288388048a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap121d7d67-75", "ovs_interfaceid": "121d7d67-75ec-46ed-ae33-5c08519acf09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T18:41:06Z,direct_url=<?>,disk_format='qcow2',id=77bcb5ba-8510-41ec-a88d-96097bb431de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c465b7c26ec44582b6d1b7169536ecc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T18:41:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'guest_format': None, 'boot_index': 0, 'image_id': '77bcb5ba-8510-41ec-a88d-96097bb431de'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 19:13:45 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-c6e5bc69-a056-4a68-b0e0-3e79d15f7869 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 19:13:45 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-c6e5bc69-a056-4a68-b0e0-3e79d15f7869 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 19:13:45 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-c6e5bc69-a056-4a68-b0e0-3e79d15f7869 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 19:13:45 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-c6e5bc69-a056-4a68-b0e0-3e79d15f7869 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] CPU controller missing on host. {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 19:13:45 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-c6e5bc69-a056-4a68-b0e0-3e79d15f7869 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 19:13:45 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-c6e5bc69-a056-4a68-b0e0-3e79d15f7869 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] CPU controller found on host. {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 19:13:45 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-c6e5bc69-a056-4a68-b0e0-3e79d15f7869 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75216) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 19:13:45 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-c6e5bc69-a056-4a68-b0e0-3e79d15f7869 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T18:40:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T18:41:06Z,direct_url=<?>,disk_format='qcow2',id=77bcb5ba-8510-41ec-a88d-96097bb431de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c465b7c26ec44582b6d1b7169536ecc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T18:41:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 19:13:45 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-c6e5bc69-a056-4a68-b0e0-3e79d15f7869 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Flavor limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 19:13:45 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-c6e5bc69-a056-4a68-b0e0-3e79d15f7869 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Image limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 19:13:45 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-c6e5bc69-a056-4a68-b0e0-3e79d15f7869 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Flavor pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 19:13:45 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-c6e5bc69-a056-4a68-b0e0-3e79d15f7869 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Image pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 19:13:45 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-c6e5bc69-a056-4a68-b0e0-3e79d15f7869 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 19:13:45 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-c6e5bc69-a056-4a68-b0e0-3e79d15f7869 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 19:13:45 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-c6e5bc69-a056-4a68-b0e0-3e79d15f7869 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 19:13:45 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-c6e5bc69-a056-4a68-b0e0-3e79d15f7869 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Got 1 possible topologies {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 19:13:45 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-c6e5bc69-a056-4a68-b0e0-3e79d15f7869 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 19:13:45 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-c6e5bc69-a056-4a68-b0e0-3e79d15f7869 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 19:13:45 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-c6e5bc69-a056-4a68-b0e0-3e79d15f7869 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T19:13:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-2000423057',display_name='tempest-VolumesSnapshotTestJSON-instance-2000423057',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-2000423057',id=39,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDGLsND18O94+mQSzcCmTR/MV5GFz19xbqbjRC4/YPE6qgz5iFB6XD8HeK5fi5xjxjof5tKbhMBIHfE9LDJaG5AIXYoWXufNRGdLp6TXAk//FqzjpGAtQgZvniJ/d6MJ4g==',key_name='tempest-keypair-1748710875',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e8c5d1e9e06c4202b31637288388048a',ramdisk_id='',reservation_id='r-exa53f6m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1725517259',owner_user_name='tempest-VolumesSnapshotTestJSON-1725517259-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T19:13:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='75359f2870344d9d83ce124a7a990aaf',uuid=aca6edce-d579-4375-9bcd-2ba4d645b894,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "121d7d67-75ec-46ed-ae33-5c08519acf09", "address": "fa:16:3e:58:78:ca", "network": {"id": "5c3296e5-d81b-4378-9108-bcc3ced5458a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-381226649-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e8c5d1e9e06c4202b31637288388048a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap121d7d67-75", "ovs_interfaceid": "121d7d67-75ec-46ed-ae33-5c08519acf09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75216) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 19:13:45 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-c6e5bc69-a056-4a68-b0e0-3e79d15f7869 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Converting VIF {"id": "121d7d67-75ec-46ed-ae33-5c08519acf09", "address": "fa:16:3e:58:78:ca", "network": {"id": "5c3296e5-d81b-4378-9108-bcc3ced5458a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-381226649-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e8c5d1e9e06c4202b31637288388048a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap121d7d67-75", "ovs_interfaceid": "121d7d67-75ec-46ed-ae33-5c08519acf09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 19:13:45 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-c6e5bc69-a056-4a68-b0e0-3e79d15f7869 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:78:ca,bridge_name='br-int',has_traffic_filtering=True,id=121d7d67-75ec-46ed-ae33-5c08519acf09,network=Network(5c3296e5-d81b-4378-9108-bcc3ced5458a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap121d7d67-75') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 19:13:45 user nova-compute[75216]: DEBUG nova.objects.instance [None req-c6e5bc69-a056-4a68-b0e0-3e79d15f7869 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Lazy-loading 'pci_devices' on Instance uuid aca6edce-d579-4375-9bcd-2ba4d645b894 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:13:45 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-c6e5bc69-a056-4a68-b0e0-3e79d15f7869 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] [instance: aca6edce-d579-4375-9bcd-2ba4d645b894] End _get_guest_xml xml=<domain type="kvm">
Nov 13 19:13:45 user nova-compute[75216]:   <uuid>aca6edce-d579-4375-9bcd-2ba4d645b894</uuid>
Nov 13 19:13:45 user nova-compute[75216]:   <name>instance-00000027</name>
Nov 13 19:13:45 user nova-compute[75216]:   <memory>524288</memory>
Nov 13 19:13:45 user nova-compute[75216]:   <vcpu>1</vcpu>
Nov 13 19:13:45 user nova-compute[75216]:   <metadata>
Nov 13 19:13:45 user nova-compute[75216]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 19:13:45 user nova-compute[75216]:       <nova:package version="0.0.0"/>
Nov 13 19:13:45 user nova-compute[75216]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-2000423057</nova:name>
Nov 13 19:13:45 user nova-compute[75216]:       <nova:creationTime>2023-11-13 19:13:45</nova:creationTime>
Nov 13 19:13:45 user nova-compute[75216]:       <nova:flavor name="m1.tiny">
Nov 13 19:13:45 user nova-compute[75216]:         <nova:memory>512</nova:memory>
Nov 13 19:13:45 user nova-compute[75216]:         <nova:disk>1</nova:disk>
Nov 13 19:13:45 user nova-compute[75216]:         <nova:swap>0</nova:swap>
Nov 13 19:13:45 user nova-compute[75216]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 19:13:45 user nova-compute[75216]:         <nova:vcpus>1</nova:vcpus>
Nov 13 19:13:45 user nova-compute[75216]:       </nova:flavor>
Nov 13 19:13:45 user nova-compute[75216]:       <nova:owner>
Nov 13 19:13:45 user nova-compute[75216]:         <nova:user uuid="75359f2870344d9d83ce124a7a990aaf">tempest-VolumesSnapshotTestJSON-1725517259-project-member</nova:user>
Nov 13 19:13:45 user nova-compute[75216]:         <nova:project uuid="e8c5d1e9e06c4202b31637288388048a">tempest-VolumesSnapshotTestJSON-1725517259</nova:project>
Nov 13 19:13:45 user nova-compute[75216]:       </nova:owner>
Nov 13 19:13:45 user nova-compute[75216]:       <nova:root type="image" uuid="77bcb5ba-8510-41ec-a88d-96097bb431de"/>
Nov 13 19:13:45 user nova-compute[75216]:       <nova:ports>
Nov 13 19:13:45 user nova-compute[75216]:         <nova:port uuid="121d7d67-75ec-46ed-ae33-5c08519acf09">
Nov 13 19:13:45 user nova-compute[75216]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 13 19:13:45 user nova-compute[75216]:         </nova:port>
Nov 13 19:13:45 user nova-compute[75216]:       </nova:ports>
Nov 13 19:13:45 user nova-compute[75216]:     </nova:instance>
Nov 13 19:13:45 user nova-compute[75216]:   </metadata>
Nov 13 19:13:45 user nova-compute[75216]:   <sysinfo type="smbios">
Nov 13 19:13:45 user nova-compute[75216]:     <system>
Nov 13 19:13:45 user nova-compute[75216]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 19:13:45 user nova-compute[75216]:       <entry name="product">OpenStack Nova</entry>
Nov 13 19:13:45 user nova-compute[75216]:       <entry name="version">0.0.0</entry>
Nov 13 19:13:45 user nova-compute[75216]:       <entry name="serial">aca6edce-d579-4375-9bcd-2ba4d645b894</entry>
Nov 13 19:13:45 user nova-compute[75216]:       <entry name="uuid">aca6edce-d579-4375-9bcd-2ba4d645b894</entry>
Nov 13 19:13:45 user nova-compute[75216]:       <entry name="family">Virtual Machine</entry>
Nov 13 19:13:45 user nova-compute[75216]:     </system>
Nov 13 19:13:45 user nova-compute[75216]:   </sysinfo>
Nov 13 19:13:45 user nova-compute[75216]:   <os>
Nov 13 19:13:45 user nova-compute[75216]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 19:13:45 user nova-compute[75216]:     <boot dev="hd"/>
Nov 13 19:13:45 user nova-compute[75216]:     <smbios mode="sysinfo"/>
Nov 13 19:13:45 user nova-compute[75216]:   </os>
Nov 13 19:13:45 user nova-compute[75216]:   <features>
Nov 13 19:13:45 user nova-compute[75216]:     <acpi/>
Nov 13 19:13:45 user nova-compute[75216]:     <apic/>
Nov 13 19:13:45 user nova-compute[75216]:     <vmcoreinfo/>
Nov 13 19:13:45 user nova-compute[75216]:   </features>
Nov 13 19:13:45 user nova-compute[75216]:   <clock offset="utc">
Nov 13 19:13:45 user nova-compute[75216]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 19:13:45 user nova-compute[75216]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 19:13:45 user nova-compute[75216]:     <timer name="hpet" present="no"/>
Nov 13 19:13:45 user nova-compute[75216]:   </clock>
Nov 13 19:13:45 user nova-compute[75216]:   <cpu mode="custom" match="exact">
Nov 13 19:13:45 user nova-compute[75216]:     <model>Nehalem</model>
Nov 13 19:13:45 user nova-compute[75216]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 19:13:45 user nova-compute[75216]:   </cpu>
Nov 13 19:13:45 user nova-compute[75216]:   <devices>
Nov 13 19:13:45 user nova-compute[75216]:     <disk type="file" device="disk">
Nov 13 19:13:45 user nova-compute[75216]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 19:13:45 user nova-compute[75216]:       <source file="/opt/stack/data/nova/instances/aca6edce-d579-4375-9bcd-2ba4d645b894/disk"/>
Nov 13 19:13:45 user nova-compute[75216]:       <target dev="vda" bus="virtio"/>
Nov 13 19:13:45 user nova-compute[75216]:     </disk>
Nov 13 19:13:45 user nova-compute[75216]:     <interface type="ethernet">
Nov 13 19:13:45 user nova-compute[75216]:       <mac address="fa:16:3e:58:78:ca"/>
Nov 13 19:13:45 user nova-compute[75216]:       <model type="virtio"/>
Nov 13 19:13:45 user nova-compute[75216]:       <mtu size="1442"/>
Nov 13 19:13:45 user nova-compute[75216]:       <target dev="tap121d7d67-75"/>
Nov 13 19:13:45 user nova-compute[75216]:     </interface>
Nov 13 19:13:45 user nova-compute[75216]:     <serial type="pty">
Nov 13 19:13:45 user nova-compute[75216]:       <log file="/opt/stack/data/nova/instances/aca6edce-d579-4375-9bcd-2ba4d645b894/console.log" append="off"/>
Nov 13 19:13:45 user nova-compute[75216]:     </serial>
Nov 13 19:13:45 user nova-compute[75216]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 19:13:45 user nova-compute[75216]:     <video>
Nov 13 19:13:45 user nova-compute[75216]:       <model type="virtio"/>
Nov 13 19:13:45 user nova-compute[75216]:     </video>
Nov 13 19:13:45 user nova-compute[75216]:     <rng model="virtio">
Nov 13 19:13:45 user nova-compute[75216]:       <backend model="random">/dev/urandom</backend>
Nov 13 19:13:45 user nova-compute[75216]:     </rng>
Nov 13 19:13:45 user nova-compute[75216]:     <controller type="usb" index="0" model="none"/>
Nov 13 19:13:45 user nova-compute[75216]:     <memballoon model="virtio">
Nov 13 19:13:45 user nova-compute[75216]:       <stats period="10"/>
Nov 13 19:13:45 user nova-compute[75216]:     </memballoon>
Nov 13 19:13:45 user nova-compute[75216]:   </devices>
Nov 13 19:13:45 user nova-compute[75216]: </domain>
Nov 13 19:13:45 user nova-compute[75216]:  {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 19:13:45 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-c6e5bc69-a056-4a68-b0e0-3e79d15f7869 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T19:13:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-2000423057',display_name='tempest-VolumesSnapshotTestJSON-instance-2000423057',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-2000423057',id=39,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDGLsND18O94+mQSzcCmTR/MV5GFz19xbqbjRC4/YPE6qgz5iFB6XD8HeK5fi5xjxjof5tKbhMBIHfE9LDJaG5AIXYoWXufNRGdLp6TXAk//FqzjpGAtQgZvniJ/d6MJ4g==',key_name='tempest-keypair-1748710875',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e8c5d1e9e06c4202b31637288388048a',ramdisk_id='',reservation_id='r-exa53f6m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1725517259',owner_user_name='tempest-VolumesSnapshotTestJSON-1725517259-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T19:13:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='75359f2870344d9d83ce124a7a990aaf',uuid=aca6edce-d579-4375-9bcd-2ba4d645b894,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "121d7d67-75ec-46ed-ae33-5c08519acf09", "address": "fa:16:3e:58:78:ca", "network": {"id": "5c3296e5-d81b-4378-9108-bcc3ced5458a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-381226649-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e8c5d1e9e06c4202b31637288388048a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap121d7d67-75", "ovs_interfaceid": "121d7d67-75ec-46ed-ae33-5c08519acf09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 19:13:45 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-c6e5bc69-a056-4a68-b0e0-3e79d15f7869 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Converting VIF {"id": "121d7d67-75ec-46ed-ae33-5c08519acf09", "address": "fa:16:3e:58:78:ca", "network": {"id": "5c3296e5-d81b-4378-9108-bcc3ced5458a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-381226649-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e8c5d1e9e06c4202b31637288388048a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap121d7d67-75", "ovs_interfaceid": "121d7d67-75ec-46ed-ae33-5c08519acf09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 19:13:45 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-c6e5bc69-a056-4a68-b0e0-3e79d15f7869 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:78:ca,bridge_name='br-int',has_traffic_filtering=True,id=121d7d67-75ec-46ed-ae33-5c08519acf09,network=Network(5c3296e5-d81b-4378-9108-bcc3ced5458a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap121d7d67-75') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 19:13:45 user nova-compute[75216]: DEBUG os_vif [None req-c6e5bc69-a056-4a68-b0e0-3e79d15f7869 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:78:ca,bridge_name='br-int',has_traffic_filtering=True,id=121d7d67-75ec-46ed-ae33-5c08519acf09,network=Network(5c3296e5-d81b-4378-9108-bcc3ced5458a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap121d7d67-75') {{(pid=75216) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 19:13:45 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:13:45 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:13:45 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 19:13:45 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:13:45 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd905ebaa-b8d8-5d3f-bba9-a2e2360c4e76', '_type': 'linux-noop'}}, row=False) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:13:45 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:13:45 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:13:45 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap121d7d67-75, may_exist=True, interface_attrs={}) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:13:45 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap121d7d67-75, col_values=(('qos', UUID('556d3697-9092-4a3e-b150-ec71429fed5e')),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:13:45 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap121d7d67-75, col_values=(('external_ids', {'iface-id': '121d7d67-75ec-46ed-ae33-5c08519acf09', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:58:78:ca', 'vm-uuid': 'aca6edce-d579-4375-9bcd-2ba4d645b894'}),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:13:45 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:13:45 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:13:45 user nova-compute[75216]: INFO os_vif [None req-c6e5bc69-a056-4a68-b0e0-3e79d15f7869 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:78:ca,bridge_name='br-int',has_traffic_filtering=True,id=121d7d67-75ec-46ed-ae33-5c08519acf09,network=Network(5c3296e5-d81b-4378-9108-bcc3ced5458a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap121d7d67-75')
Nov 13 19:13:45 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-c6e5bc69-a056-4a68-b0e0-3e79d15f7869 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 19:13:45 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-c6e5bc69-a056-4a68-b0e0-3e79d15f7869 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] No VIF found with MAC fa:16:3e:58:78:ca, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 19:13:45 user nova-compute[75216]: DEBUG nova.network.neutron [req-64b27aa6-dbaa-4415-989f-70b20aeca1b6 req-975955af-dd72-4d25-9496-90807457a0e4 service nova] [instance: aca6edce-d579-4375-9bcd-2ba4d645b894] Updated VIF entry in instance network info cache for port 121d7d67-75ec-46ed-ae33-5c08519acf09. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 19:13:45 user nova-compute[75216]: DEBUG nova.network.neutron [req-64b27aa6-dbaa-4415-989f-70b20aeca1b6 req-975955af-dd72-4d25-9496-90807457a0e4 service nova] [instance: aca6edce-d579-4375-9bcd-2ba4d645b894] Updating instance_info_cache with network_info: [{"id": "121d7d67-75ec-46ed-ae33-5c08519acf09", "address": "fa:16:3e:58:78:ca", "network": {"id": "5c3296e5-d81b-4378-9108-bcc3ced5458a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-381226649-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e8c5d1e9e06c4202b31637288388048a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap121d7d67-75", "ovs_interfaceid": "121d7d67-75ec-46ed-ae33-5c08519acf09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:13:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-64b27aa6-dbaa-4415-989f-70b20aeca1b6 req-975955af-dd72-4d25-9496-90807457a0e4 service nova] Releasing lock "refresh_cache-aca6edce-d579-4375-9bcd-2ba4d645b894" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 19:13:46 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:13:46 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:13:46 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:13:47 user nova-compute[75216]: DEBUG nova.compute.manager [req-7020b13b-4a07-42be-9fe0-8016275da90a req-5d8f5354-6dcc-4003-a56c-6a34d16a7d1d service nova] [instance: aca6edce-d579-4375-9bcd-2ba4d645b894] Received event network-vif-plugged-121d7d67-75ec-46ed-ae33-5c08519acf09 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:13:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-7020b13b-4a07-42be-9fe0-8016275da90a req-5d8f5354-6dcc-4003-a56c-6a34d16a7d1d service nova] Acquiring lock "aca6edce-d579-4375-9bcd-2ba4d645b894-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:13:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-7020b13b-4a07-42be-9fe0-8016275da90a req-5d8f5354-6dcc-4003-a56c-6a34d16a7d1d service nova] Lock "aca6edce-d579-4375-9bcd-2ba4d645b894-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:13:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-7020b13b-4a07-42be-9fe0-8016275da90a req-5d8f5354-6dcc-4003-a56c-6a34d16a7d1d service nova] Lock "aca6edce-d579-4375-9bcd-2ba4d645b894-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:13:47 user nova-compute[75216]: DEBUG nova.compute.manager [req-7020b13b-4a07-42be-9fe0-8016275da90a req-5d8f5354-6dcc-4003-a56c-6a34d16a7d1d service nova] [instance: aca6edce-d579-4375-9bcd-2ba4d645b894] No waiting events found dispatching network-vif-plugged-121d7d67-75ec-46ed-ae33-5c08519acf09 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 19:13:47 user nova-compute[75216]: WARNING nova.compute.manager [req-7020b13b-4a07-42be-9fe0-8016275da90a req-5d8f5354-6dcc-4003-a56c-6a34d16a7d1d service nova] [instance: aca6edce-d579-4375-9bcd-2ba4d645b894] Received unexpected event network-vif-plugged-121d7d67-75ec-46ed-ae33-5c08519acf09 for instance with vm_state building and task_state spawning.
Nov 13 19:13:47 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:13:47 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:13:47 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:13:48 user nova-compute[75216]: DEBUG nova.compute.manager [None req-c6e5bc69-a056-4a68-b0e0-3e79d15f7869 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] [instance: aca6edce-d579-4375-9bcd-2ba4d645b894] Instance event wait completed in 0 seconds for  {{(pid=75216) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 19:13:48 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-c6e5bc69-a056-4a68-b0e0-3e79d15f7869 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] [instance: aca6edce-d579-4375-9bcd-2ba4d645b894] Guest created on hypervisor {{(pid=75216) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 19:13:48 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: aca6edce-d579-4375-9bcd-2ba4d645b894] Instance spawned successfully.
Nov 13 19:13:48 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-c6e5bc69-a056-4a68-b0e0-3e79d15f7869 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] [instance: aca6edce-d579-4375-9bcd-2ba4d645b894] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 19:13:48 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-c6e5bc69-a056-4a68-b0e0-3e79d15f7869 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] [instance: aca6edce-d579-4375-9bcd-2ba4d645b894] Found default for hw_cdrom_bus of ide {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 19:13:48 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-c6e5bc69-a056-4a68-b0e0-3e79d15f7869 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] [instance: aca6edce-d579-4375-9bcd-2ba4d645b894] Found default for hw_disk_bus of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 19:13:48 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-c6e5bc69-a056-4a68-b0e0-3e79d15f7869 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] [instance: aca6edce-d579-4375-9bcd-2ba4d645b894] Found default for hw_input_bus of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 19:13:48 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-c6e5bc69-a056-4a68-b0e0-3e79d15f7869 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] [instance: aca6edce-d579-4375-9bcd-2ba4d645b894] Found default for hw_pointer_model of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 19:13:48 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-c6e5bc69-a056-4a68-b0e0-3e79d15f7869 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] [instance: aca6edce-d579-4375-9bcd-2ba4d645b894] Found default for hw_video_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 19:13:48 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-c6e5bc69-a056-4a68-b0e0-3e79d15f7869 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] [instance: aca6edce-d579-4375-9bcd-2ba4d645b894] Found default for hw_vif_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 19:13:49 user nova-compute[75216]: DEBUG nova.compute.manager [req-06e78e7d-4e27-45ef-a445-9b839bf4cc8a req-3645edfb-2e49-4df1-ab3b-5ff2dac43a30 service nova] [instance: aca6edce-d579-4375-9bcd-2ba4d645b894] Received event network-vif-plugged-121d7d67-75ec-46ed-ae33-5c08519acf09 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:13:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-06e78e7d-4e27-45ef-a445-9b839bf4cc8a req-3645edfb-2e49-4df1-ab3b-5ff2dac43a30 service nova] Acquiring lock "aca6edce-d579-4375-9bcd-2ba4d645b894-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:13:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-06e78e7d-4e27-45ef-a445-9b839bf4cc8a req-3645edfb-2e49-4df1-ab3b-5ff2dac43a30 service nova] Lock "aca6edce-d579-4375-9bcd-2ba4d645b894-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:13:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-06e78e7d-4e27-45ef-a445-9b839bf4cc8a req-3645edfb-2e49-4df1-ab3b-5ff2dac43a30 service nova] Lock "aca6edce-d579-4375-9bcd-2ba4d645b894-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:13:49 user nova-compute[75216]: DEBUG nova.compute.manager [req-06e78e7d-4e27-45ef-a445-9b839bf4cc8a req-3645edfb-2e49-4df1-ab3b-5ff2dac43a30 service nova] [instance: aca6edce-d579-4375-9bcd-2ba4d645b894] No waiting events found dispatching network-vif-plugged-121d7d67-75ec-46ed-ae33-5c08519acf09 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 19:13:49 user nova-compute[75216]: WARNING nova.compute.manager [req-06e78e7d-4e27-45ef-a445-9b839bf4cc8a req-3645edfb-2e49-4df1-ab3b-5ff2dac43a30 service nova] [instance: aca6edce-d579-4375-9bcd-2ba4d645b894] Received unexpected event network-vif-plugged-121d7d67-75ec-46ed-ae33-5c08519acf09 for instance with vm_state building and task_state spawning.
Nov 13 19:13:49 user nova-compute[75216]: INFO nova.compute.manager [None req-c6e5bc69-a056-4a68-b0e0-3e79d15f7869 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] [instance: aca6edce-d579-4375-9bcd-2ba4d645b894] Took 5.13 seconds to spawn the instance on the hypervisor.
Nov 13 19:13:49 user nova-compute[75216]: DEBUG nova.compute.manager [None req-c6e5bc69-a056-4a68-b0e0-3e79d15f7869 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] [instance: aca6edce-d579-4375-9bcd-2ba4d645b894] Checking state {{(pid=75216) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 19:13:49 user nova-compute[75216]: INFO nova.compute.manager [None req-c6e5bc69-a056-4a68-b0e0-3e79d15f7869 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] [instance: aca6edce-d579-4375-9bcd-2ba4d645b894] Took 5.69 seconds to build instance.
Nov 13 19:13:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c6e5bc69-a056-4a68-b0e0-3e79d15f7869 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Lock "aca6edce-d579-4375-9bcd-2ba4d645b894" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.788s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:13:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:13:50 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:13:54 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:13:55 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:14:00 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:14:00 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:14:01 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:14:04 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:14:04 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:14:05 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:14:06 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:14:06 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:14:06 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75216) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 19:14:07 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:14:08 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:14:08 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:14:08 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:14:08 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:14:08 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Auditing locally available compute resources for user (node: user) {{(pid=75216) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 19:14:08 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aca6edce-d579-4375-9bcd-2ba4d645b894/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:14:08 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aca6edce-d579-4375-9bcd-2ba4d645b894/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:14:08 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aca6edce-d579-4375-9bcd-2ba4d645b894/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:14:08 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aca6edce-d579-4375-9bcd-2ba4d645b894/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:14:08 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b048c677-85bf-4a93-88eb-c71bde27bf5b/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:14:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b048c677-85bf-4a93-88eb-c71bde27bf5b/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:14:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b048c677-85bf-4a93-88eb-c71bde27bf5b/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:14:09 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:14:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b048c677-85bf-4a93-88eb-c71bde27bf5b/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:14:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e47d802-efdb-4763-8594-1ad056dbf6cc/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:14:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e47d802-efdb-4763-8594-1ad056dbf6cc/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:14:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e47d802-efdb-4763-8594-1ad056dbf6cc/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:14:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e47d802-efdb-4763-8594-1ad056dbf6cc/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:14:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55b7031b-4fd6-4ecb-9130-68110677c7cf/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:14:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55b7031b-4fd6-4ecb-9130-68110677c7cf/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:14:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55b7031b-4fd6-4ecb-9130-68110677c7cf/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:14:10 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55b7031b-4fd6-4ecb-9130-68110677c7cf/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:14:10 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 19:14:10 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 19:14:10 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Hypervisor/Node resource view: name=user free_ram=8441MB free_disk=25.291767120361328GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75216) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 19:14:10 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:14:10 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:14:10 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:14:10 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance 9e47d802-efdb-4763-8594-1ad056dbf6cc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 19:14:10 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance 55b7031b-4fd6-4ecb-9130-68110677c7cf actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 19:14:10 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance b048c677-85bf-4a93-88eb-c71bde27bf5b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 19:14:10 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance aca6edce-d579-4375-9bcd-2ba4d645b894 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 19:14:10 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 19:14:10 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 19:14:10 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 19:14:10 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 19:14:10 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Compute_service record updated for user:user {{(pid=75216) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 19:14:10 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.288s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:14:13 user nova-compute[75216]: DEBUG nova.compute.manager [req-d57cbdbe-9430-4510-888a-135cc9303d5c req-9cef6952-23a1-46fe-9ed8-18a0a6877f56 service nova] [instance: 9e47d802-efdb-4763-8594-1ad056dbf6cc] Received event network-changed-637bd8e9-478b-462f-bb28-a0a32f7bb6cb {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:14:13 user nova-compute[75216]: DEBUG nova.compute.manager [req-d57cbdbe-9430-4510-888a-135cc9303d5c req-9cef6952-23a1-46fe-9ed8-18a0a6877f56 service nova] [instance: 9e47d802-efdb-4763-8594-1ad056dbf6cc] Refreshing instance network info cache due to event network-changed-637bd8e9-478b-462f-bb28-a0a32f7bb6cb. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 19:14:13 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-d57cbdbe-9430-4510-888a-135cc9303d5c req-9cef6952-23a1-46fe-9ed8-18a0a6877f56 service nova] Acquiring lock "refresh_cache-9e47d802-efdb-4763-8594-1ad056dbf6cc" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 19:14:13 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-d57cbdbe-9430-4510-888a-135cc9303d5c req-9cef6952-23a1-46fe-9ed8-18a0a6877f56 service nova] Acquired lock "refresh_cache-9e47d802-efdb-4763-8594-1ad056dbf6cc" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 19:14:13 user nova-compute[75216]: DEBUG nova.network.neutron [req-d57cbdbe-9430-4510-888a-135cc9303d5c req-9cef6952-23a1-46fe-9ed8-18a0a6877f56 service nova] [instance: 9e47d802-efdb-4763-8594-1ad056dbf6cc] Refreshing network info cache for port 637bd8e9-478b-462f-bb28-a0a32f7bb6cb {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 19:14:13 user nova-compute[75216]: DEBUG nova.network.neutron [req-d57cbdbe-9430-4510-888a-135cc9303d5c req-9cef6952-23a1-46fe-9ed8-18a0a6877f56 service nova] [instance: 9e47d802-efdb-4763-8594-1ad056dbf6cc] Updated VIF entry in instance network info cache for port 637bd8e9-478b-462f-bb28-a0a32f7bb6cb. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 19:14:13 user nova-compute[75216]: DEBUG nova.network.neutron [req-d57cbdbe-9430-4510-888a-135cc9303d5c req-9cef6952-23a1-46fe-9ed8-18a0a6877f56 service nova] [instance: 9e47d802-efdb-4763-8594-1ad056dbf6cc] Updating instance_info_cache with network_info: [{"id": "637bd8e9-478b-462f-bb28-a0a32f7bb6cb", "address": "fa:16:3e:ca:d7:9f", "network": {"id": "53bb01d5-31a4-47af-a931-ac12fe72b986", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-802892643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "095f5765865140d29b3ecf1ab3427037", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap637bd8e9-47", "ovs_interfaceid": "637bd8e9-478b-462f-bb28-a0a32f7bb6cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:14:13 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-d57cbdbe-9430-4510-888a-135cc9303d5c req-9cef6952-23a1-46fe-9ed8-18a0a6877f56 service nova] Releasing lock "refresh_cache-9e47d802-efdb-4763-8594-1ad056dbf6cc" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 19:14:14 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:14:14 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-cf43fce0-fff5-4f7e-b106-cc3358bcd17a tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Acquiring lock "9e47d802-efdb-4763-8594-1ad056dbf6cc" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:14:14 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-cf43fce0-fff5-4f7e-b106-cc3358bcd17a tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Lock "9e47d802-efdb-4763-8594-1ad056dbf6cc" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:14:14 user nova-compute[75216]: DEBUG nova.objects.instance [None req-cf43fce0-fff5-4f7e-b106-cc3358bcd17a tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Lazy-loading 'flavor' on Instance uuid 9e47d802-efdb-4763-8594-1ad056dbf6cc {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:14:14 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-cf43fce0-fff5-4f7e-b106-cc3358bcd17a tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Lock "9e47d802-efdb-4763-8594-1ad056dbf6cc" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.047s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:14:15 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-cf43fce0-fff5-4f7e-b106-cc3358bcd17a tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Acquiring lock "9e47d802-efdb-4763-8594-1ad056dbf6cc" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:14:15 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-cf43fce0-fff5-4f7e-b106-cc3358bcd17a tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Lock "9e47d802-efdb-4763-8594-1ad056dbf6cc" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:14:15 user nova-compute[75216]: INFO nova.compute.manager [None req-cf43fce0-fff5-4f7e-b106-cc3358bcd17a tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] [instance: 9e47d802-efdb-4763-8594-1ad056dbf6cc] Attaching volume a54a88cc-f930-40ef-92d9-2417e46197e4 to /dev/vdb
Nov 13 19:14:15 user nova-compute[75216]: DEBUG os_brick.utils [None req-cf43fce0-fff5-4f7e-b106-cc3358bcd17a tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 19:14:15 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:14:15 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:14:15 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[57f75389-b85b-4561-8e03-126681943410]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aea6fcfe14b9\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:14:15 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:14:15 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:14:15 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[644bb8da-a62c-4370-adc0-9eac688f07d2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:14:15 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:14:15 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:14:15 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3c4f99a-3d1e-489c-bf8b-1c1f3181501b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:14:15 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[edbd4f1c-7bdf-4fc7-9145-1937269cfe27]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:14:15 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-cf43fce0-fff5-4f7e-b106-cc3358bcd17a tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Running cmd (subprocess): nvme version {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:14:15 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-cf43fce0-fff5-4f7e-b106-cc3358bcd17a tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] 'nvme version' failed. Not Retrying. {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 19:14:15 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cf43fce0-fff5-4f7e-b106-cc3358bcd17a tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] nvme not present on system {{(pid=75216) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 19:14:15 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:14:15 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 19:14:15 user nova-compute[75216]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 19:14:15 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[8371b90b-8f7f-4c03-8a4f-5de4b67e0858]: (4, '') {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:14:15 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-cf43fce0-fff5-4f7e-b106-cc3358bcd17a tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75216) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 19:14:15 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-cf43fce0-fff5-4f7e-b106-cc3358bcd17a tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 19:14:15 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-cf43fce0-fff5-4f7e-b106-cc3358bcd17a tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] LIGHTOS: no hostnqn found. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 19:14:15 user nova-compute[75216]: DEBUG os_brick.utils [None req-cf43fce0-fff5-4f7e-b106-cc3358bcd17a tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aea6fcfe14b9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 19:14:15 user nova-compute[75216]: DEBUG nova.virt.block_device [None req-cf43fce0-fff5-4f7e-b106-cc3358bcd17a tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] [instance: 9e47d802-efdb-4763-8594-1ad056dbf6cc] Updating existing volume attachment record: e5ffba9f-0a01-4382-aeca-0cdfe602c11f {{(pid=75216) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 19:14:15 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:14:15 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:14:15 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Starting heal instance info cache {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 19:14:15 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "refresh_cache-55b7031b-4fd6-4ecb-9130-68110677c7cf" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 19:14:15 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquired lock "refresh_cache-55b7031b-4fd6-4ecb-9130-68110677c7cf" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 19:14:15 user nova-compute[75216]: DEBUG nova.network.neutron [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: 55b7031b-4fd6-4ecb-9130-68110677c7cf] Forcefully refreshing network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 19:14:16 user nova-compute[75216]: DEBUG nova.network.neutron [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: 55b7031b-4fd6-4ecb-9130-68110677c7cf] Updating instance_info_cache with network_info: [{"id": "bc9be0fb-9e21-4ad1-ae37-a1da3dbc5e5e", "address": "fa:16:3e:92:1e:27", "network": {"id": "988045b3-1899-40e5-93a6-56fc3b6bb766", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-280689078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4172655ed9de4ceb84d79d785f3b3377", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc9be0fb-9e", "ovs_interfaceid": "bc9be0fb-9e21-4ad1-ae37-a1da3dbc5e5e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:14:16 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Releasing lock "refresh_cache-55b7031b-4fd6-4ecb-9130-68110677c7cf" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 19:14:16 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: 55b7031b-4fd6-4ecb-9130-68110677c7cf] Updated the network info_cache for instance {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 19:14:16 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:14:19 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cf43fce0-fff5-4f7e-b106-cc3358bcd17a tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] [instance: 9e47d802-efdb-4763-8594-1ad056dbf6cc] Calling os-brick to attach iSCSI Volume {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 19:14:19 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf43fce0-fff5-4f7e-b106-cc3358bcd17a tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3a8669e40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a54a88cc-f930-40ef-92d9-2417e46197e4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jnGiVBFY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 19:14:19 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-cf43fce0-fff5-4f7e-b106-cc3358bcd17a tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 19:14:19 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-cf43fce0-fff5-4f7e-b106-cc3358bcd17a tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 19:14:19 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-cf43fce0-fff5-4f7e-b106-cc3358bcd17a tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 19:14:19 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-cf43fce0-fff5-4f7e-b106-cc3358bcd17a tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 19:14:19 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-cf43fce0-fff5-4f7e-b106-cc3358bcd17a tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a54a88cc-f930-40ef-92d9-2417e46197e4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 19:14:19 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-cf43fce0-fff5-4f7e-b106-cc3358bcd17a tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a54a88cc-f930-40ef-92d9-2417e46197e4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 19:14:19 user nova-compute[75216]: INFO os_brick.initiator.connectors.iscsi [None req-cf43fce0-fff5-4f7e-b106-cc3358bcd17a tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 19:14:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a54a88cc-f930-40ef-92d9-2417e46197e4 -p 172.16.0.220:3260 {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:14:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a54a88cc-f930-40ef-92d9-2417e46197e4 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:14:19 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c824f54-7527-436a-8a62-b25af290259a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:14:19 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf43fce0-fff5-4f7e-b106-cc3358bcd17a tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 19:14:19 user nova-compute[75216]:  {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:14:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a54a88cc-f930-40ef-92d9-2417e46197e4 -p 172.16.0.220:3260 --interface default --op new {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:14:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a54a88cc-f930-40ef-92d9-2417e46197e4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:14:19 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[18e043e8-d973-4ca7-8e12-408cc09b2e76]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a54a88cc-f930-40ef-92d9-2417e46197e4] added\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:14:19 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf43fce0-fff5-4f7e-b106-cc3358bcd17a tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a54a88cc-f930-40ef-92d9-2417e46197e4] added
Nov 13 19:14:19 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:14:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a54a88cc-f930-40ef-92d9-2417e46197e4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:14:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a54a88cc-f930-40ef-92d9-2417e46197e4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:14:19 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4b80cf5-127d-4b33-9cef-23c4259dfb51]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:14:19 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf43fce0-fff5-4f7e-b106-cc3358bcd17a tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:14:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a54a88cc-f930-40ef-92d9-2417e46197e4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:14:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a54a88cc-f930-40ef-92d9-2417e46197e4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:14:19 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d764f0f-fb8f-43e5-97f5-9838a4bc925f]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:14:19 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf43fce0-fff5-4f7e-b106-cc3358bcd17a tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:14:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a54a88cc-f930-40ef-92d9-2417e46197e4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jnGiVBFY {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:14:19 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:14:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a54a88cc-f930-40ef-92d9-2417e46197e4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jnGiVBFY" returned: 0 in 0.021s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:14:19 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[58174ff0-8fa9-4399-a61e-6384ed1d0b94]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:14:19 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf43fce0-fff5-4f7e-b106-cc3358bcd17a tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jnGiVBFY'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:14:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a54a88cc-f930-40ef-92d9-2417e46197e4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:14:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a54a88cc-f930-40ef-92d9-2417e46197e4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:14:19 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1b59c32-3c40-437f-b620-d55640b6289e]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:14:19 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf43fce0-fff5-4f7e-b106-cc3358bcd17a tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:14:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:14:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:14:19 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[12ac958e-626f-4864-8fed-dddbcfc6b164]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:14:19 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf43fce0-fff5-4f7e-b106-cc3358bcd17a tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 13 19:14:19 user nova-compute[75216]:  {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 19:14:19 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf43fce0-fff5-4f7e-b106-cc3358bcd17a tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 13 19:14:19 user nova-compute[75216]:  {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 19:14:19 user nova-compute[75216]: WARNING os_brick.initiator.connectors.iscsi [None req-cf43fce0-fff5-4f7e-b106-cc3358bcd17a tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 13 19:14:19 user nova-compute[75216]: 
Nov 13 19:14:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a54a88cc-f930-40ef-92d9-2417e46197e4 -p 172.16.0.220:3260 --login {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:14:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a54a88cc-f930-40ef-92d9-2417e46197e4 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:14:19 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[179d1cc5-144a-464c-8410-31aec81f2e5d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a54a88cc-f930-40ef-92d9-2417e46197e4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a54a88cc-f930-40ef-92d9-2417e46197e4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:14:19 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf43fce0-fff5-4f7e-b106-cc3358bcd17a tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a54a88cc-f930-40ef-92d9-2417e46197e4, portal: 172.16.0.220,3260]
Nov 13 19:14:19 user nova-compute[75216]: Login to [iface: default, target: iqn.2010-10.org.openstack:a54a88cc-f930-40ef-92d9-2417e46197e4, portal: 172.16.0.220,3260] successful.
Nov 13 19:14:19 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:14:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a54a88cc-f930-40ef-92d9-2417e46197e4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:14:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a54a88cc-f930-40ef-92d9-2417e46197e4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:14:19 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e9eabd5-88d9-45d6-8601-b6cdaf69c5ef]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:14:19 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf43fce0-fff5-4f7e-b106-cc3358bcd17a tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:14:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:14:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:14:19 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[9642e981-559b-43c6-8046-99b6c034742c]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a54a88cc-f930-40ef-92d9-2417e46197e4 (non-flash)\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:14:19 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf43fce0-fff5-4f7e-b106-cc3358bcd17a tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a54a88cc-f930-40ef-92d9-2417e46197e4 (non-flash)
Nov 13 19:14:19 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 19:14:19 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf43fce0-fff5-4f7e-b106-cc3358bcd17a tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a54a88cc-f930-40ef-92d9-2417e46197e4 (non-flash)
Nov 13 19:14:19 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 19:14:19 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-cf43fce0-fff5-4f7e-b106-cc3358bcd17a tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a54a88cc-f930-40ef-92d9-2417e46197e4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.243s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 19:14:19 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf43fce0-fff5-4f7e-b106-cc3358bcd17a tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Connected to 172.16.0.220:3260 {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 19:14:19 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-cf43fce0-fff5-4f7e-b106-cc3358bcd17a tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] HCTL ('33', '-', '-', 0) found on session 43 with lun 0 {{(pid=75216) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 19:14:19 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-cf43fce0-fff5-4f7e-b106-cc3358bcd17a tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75216) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 19:14:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:14:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:14:19 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[a811c556-435c-4c3d-a41b-cbf8d2d56845]: (4, ('- - 0', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:14:19 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-cf43fce0-fff5-4f7e-b106-cc3358bcd17a tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Searching for a device in session 43 and hctl ['33', '*', '*', 0] yield: None {{(pid=75216) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 19:14:20 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-cf43fce0-fff5-4f7e-b106-cc3358bcd17a tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Searching for a device in session 43 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75216) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 19:14:20 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf43fce0-fff5-4f7e-b106-cc3358bcd17a tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:a54a88cc-f930-40ef-92d9-2417e46197e4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jnGiVBFY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 19:14:20 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-cf43fce0-fff5-4f7e-b106-cc3358bcd17a tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.272s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 19:14:20 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf43fce0-fff5-4f7e-b106-cc3358bcd17a tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] <== connect_volume: return (1274ms) {'type': 'block', 'scsi_wwn': '23465313832336234', 'path': '/dev/sdb'} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 19:14:20 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cf43fce0-fff5-4f7e-b106-cc3358bcd17a tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] [instance: 9e47d802-efdb-4763-8594-1ad056dbf6cc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23465313832336234', 'path': '/dev/sdb'} {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 19:14:20 user nova-compute[75216]: DEBUG nova.objects.instance [None req-cf43fce0-fff5-4f7e-b106-cc3358bcd17a tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Lazy-loading 'flavor' on Instance uuid 9e47d802-efdb-4763-8594-1ad056dbf6cc {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:14:20 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-cf43fce0-fff5-4f7e-b106-cc3358bcd17a tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] attach device xml: <disk type="block" device="disk">
Nov 13 19:14:20 user nova-compute[75216]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 19:14:20 user nova-compute[75216]:   <source dev="/dev/sdb"/>
Nov 13 19:14:20 user nova-compute[75216]:   <target dev="vdb" bus="virtio"/>
Nov 13 19:14:20 user nova-compute[75216]:   <serial>a54a88cc-f930-40ef-92d9-2417e46197e4</serial>
Nov 13 19:14:20 user nova-compute[75216]: </disk>
Nov 13 19:14:20 user nova-compute[75216]:  {{(pid=75216) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 13 19:14:20 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:14:20 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-cf43fce0-fff5-4f7e-b106-cc3358bcd17a tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 19:14:20 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-cf43fce0-fff5-4f7e-b106-cc3358bcd17a tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 19:14:20 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-cf43fce0-fff5-4f7e-b106-cc3358bcd17a tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] No VIF found with MAC fa:16:3e:ca:d7:9f, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 19:14:21 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-cf43fce0-fff5-4f7e-b106-cc3358bcd17a tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Lock "9e47d802-efdb-4763-8594-1ad056dbf6cc" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 5.922s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:14:23 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1f53ef04-5c23-4f5c-8ad6-b952ea0180e6 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Acquiring lock "9e47d802-efdb-4763-8594-1ad056dbf6cc" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:14:23 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1f53ef04-5c23-4f5c-8ad6-b952ea0180e6 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Lock "9e47d802-efdb-4763-8594-1ad056dbf6cc" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:14:23 user nova-compute[75216]: DEBUG nova.objects.instance [None req-1f53ef04-5c23-4f5c-8ad6-b952ea0180e6 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Lazy-loading 'flavor' on Instance uuid 9e47d802-efdb-4763-8594-1ad056dbf6cc {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:14:23 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1f53ef04-5c23-4f5c-8ad6-b952ea0180e6 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Lock "9e47d802-efdb-4763-8594-1ad056dbf6cc" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:14:23 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1f53ef04-5c23-4f5c-8ad6-b952ea0180e6 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Acquiring lock "9e47d802-efdb-4763-8594-1ad056dbf6cc" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:14:23 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1f53ef04-5c23-4f5c-8ad6-b952ea0180e6 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Lock "9e47d802-efdb-4763-8594-1ad056dbf6cc" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:14:23 user nova-compute[75216]: INFO nova.compute.manager [None req-1f53ef04-5c23-4f5c-8ad6-b952ea0180e6 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] [instance: 9e47d802-efdb-4763-8594-1ad056dbf6cc] Attaching volume d08b68b4-6f2a-4b70-a1fb-b49c3052b0f5 to /dev/vdc
Nov 13 19:14:23 user nova-compute[75216]: DEBUG os_brick.utils [None req-1f53ef04-5c23-4f5c-8ad6-b952ea0180e6 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 19:14:23 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:14:23 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:14:23 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[54ccaed0-368b-4777-8f35-0f052d282013]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aea6fcfe14b9\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:14:23 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:14:23 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:14:23 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b1fad48-ecf6-49df-b573-4a8d6de0219f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:14:23 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:14:23 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:14:23 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e671498-a02c-4f6c-9263-f18d74a09593]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:14:23 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[5451bfdb-9f50-4b67-b3dc-b5228bd15766]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:14:23 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-1f53ef04-5c23-4f5c-8ad6-b952ea0180e6 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Running cmd (subprocess): nvme version {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:14:23 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-1f53ef04-5c23-4f5c-8ad6-b952ea0180e6 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] 'nvme version' failed. Not Retrying. {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 19:14:23 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1f53ef04-5c23-4f5c-8ad6-b952ea0180e6 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] nvme not present on system {{(pid=75216) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 19:14:23 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:14:23 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 19:14:23 user nova-compute[75216]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 19:14:23 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[22ad5464-1e9b-48f2-98c8-1fc15a24eaa2]: (4, '') {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:14:23 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-1f53ef04-5c23-4f5c-8ad6-b952ea0180e6 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75216) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 19:14:23 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-1f53ef04-5c23-4f5c-8ad6-b952ea0180e6 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 19:14:23 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-1f53ef04-5c23-4f5c-8ad6-b952ea0180e6 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] LIGHTOS: no hostnqn found. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 19:14:23 user nova-compute[75216]: DEBUG os_brick.utils [None req-1f53ef04-5c23-4f5c-8ad6-b952ea0180e6 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aea6fcfe14b9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 19:14:23 user nova-compute[75216]: DEBUG nova.virt.block_device [None req-1f53ef04-5c23-4f5c-8ad6-b952ea0180e6 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] [instance: 9e47d802-efdb-4763-8594-1ad056dbf6cc] Updating existing volume attachment record: cd44fe94-cc59-47bb-8d1b-d3c41322c84f {{(pid=75216) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 19:14:24 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:14:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:14:27 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1f53ef04-5c23-4f5c-8ad6-b952ea0180e6 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] [instance: 9e47d802-efdb-4763-8594-1ad056dbf6cc] Calling os-brick to attach iSCSI Volume {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 19:14:27 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f53ef04-5c23-4f5c-8ad6-b952ea0180e6 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3a8669e40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d08b68b4-6f2a-4b70-a1fb-b49c3052b0f5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TqlahwMW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 19:14:27 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-1f53ef04-5c23-4f5c-8ad6-b952ea0180e6 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 19:14:27 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-1f53ef04-5c23-4f5c-8ad6-b952ea0180e6 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 19:14:27 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-1f53ef04-5c23-4f5c-8ad6-b952ea0180e6 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 19:14:27 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-1f53ef04-5c23-4f5c-8ad6-b952ea0180e6 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 19:14:27 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-1f53ef04-5c23-4f5c-8ad6-b952ea0180e6 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d08b68b4-6f2a-4b70-a1fb-b49c3052b0f5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 19:14:27 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-1f53ef04-5c23-4f5c-8ad6-b952ea0180e6 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d08b68b4-6f2a-4b70-a1fb-b49c3052b0f5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 19:14:27 user nova-compute[75216]: INFO os_brick.initiator.connectors.iscsi [None req-1f53ef04-5c23-4f5c-8ad6-b952ea0180e6 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 19:14:27 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d08b68b4-6f2a-4b70-a1fb-b49c3052b0f5 -p 172.16.0.220:3260 {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:14:27 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d08b68b4-6f2a-4b70-a1fb-b49c3052b0f5 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:14:27 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab7c900f-dd16-4713-a4fe-a5602144151e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:14:27 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f53ef04-5c23-4f5c-8ad6-b952ea0180e6 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 19:14:27 user nova-compute[75216]:  {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:14:27 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d08b68b4-6f2a-4b70-a1fb-b49c3052b0f5 -p 172.16.0.220:3260 --interface default --op new {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:14:27 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d08b68b4-6f2a-4b70-a1fb-b49c3052b0f5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:14:27 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b51be48-0885-4c59-838f-d3062ddc2949]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d08b68b4-6f2a-4b70-a1fb-b49c3052b0f5] added\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:14:27 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f53ef04-5c23-4f5c-8ad6-b952ea0180e6 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d08b68b4-6f2a-4b70-a1fb-b49c3052b0f5] added
Nov 13 19:14:27 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:14:27 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d08b68b4-6f2a-4b70-a1fb-b49c3052b0f5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:14:27 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d08b68b4-6f2a-4b70-a1fb-b49c3052b0f5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:14:27 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[6901d3fa-7f70-441d-b50d-9ea0b831cbee]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:14:27 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f53ef04-5c23-4f5c-8ad6-b952ea0180e6 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:14:27 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d08b68b4-6f2a-4b70-a1fb-b49c3052b0f5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:14:27 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d08b68b4-6f2a-4b70-a1fb-b49c3052b0f5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:14:27 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[42225556-e187-4dba-9987-c523b2520fb2]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:14:27 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f53ef04-5c23-4f5c-8ad6-b952ea0180e6 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:14:27 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d08b68b4-6f2a-4b70-a1fb-b49c3052b0f5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TqlahwMW {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:14:27 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d08b68b4-6f2a-4b70-a1fb-b49c3052b0f5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TqlahwMW" returned: 0 in 0.021s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:14:27 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[c34767c1-22ca-43af-aa01-158d39b12897]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:14:27 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f53ef04-5c23-4f5c-8ad6-b952ea0180e6 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TqlahwMW'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:14:27 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d08b68b4-6f2a-4b70-a1fb-b49c3052b0f5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:14:27 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d08b68b4-6f2a-4b70-a1fb-b49c3052b0f5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:14:27 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfe4db4f-4211-46db-b352-328ff053d8b6]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:14:27 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f53ef04-5c23-4f5c-8ad6-b952ea0180e6 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:14:27 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:14:27 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:14:27 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[69a869cd-9c9d-46e7-a7c5-819e5e462f51]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a54a88cc-f930-40ef-92d9-2417e46197e4 (non-flash)\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:14:27 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f53ef04-5c23-4f5c-8ad6-b952ea0180e6 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a54a88cc-f930-40ef-92d9-2417e46197e4 (non-flash)
Nov 13 19:14:27 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 19:14:27 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f53ef04-5c23-4f5c-8ad6-b952ea0180e6 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a54a88cc-f930-40ef-92d9-2417e46197e4 (non-flash)
Nov 13 19:14:27 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 19:14:27 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d08b68b4-6f2a-4b70-a1fb-b49c3052b0f5 -p 172.16.0.220:3260 --login {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:14:27 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d08b68b4-6f2a-4b70-a1fb-b49c3052b0f5 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:14:27 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[beeeead6-7e66-40d8-91b3-25a4a1891434]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d08b68b4-6f2a-4b70-a1fb-b49c3052b0f5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d08b68b4-6f2a-4b70-a1fb-b49c3052b0f5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:14:27 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f53ef04-5c23-4f5c-8ad6-b952ea0180e6 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d08b68b4-6f2a-4b70-a1fb-b49c3052b0f5, portal: 172.16.0.220,3260]
Nov 13 19:14:27 user nova-compute[75216]: Login to [iface: default, target: iqn.2010-10.org.openstack:d08b68b4-6f2a-4b70-a1fb-b49c3052b0f5, portal: 172.16.0.220,3260] successful.
Nov 13 19:14:27 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:14:27 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d08b68b4-6f2a-4b70-a1fb-b49c3052b0f5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:14:27 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d08b68b4-6f2a-4b70-a1fb-b49c3052b0f5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:14:27 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[f42e3173-1ec4-4bb7-becb-9d41ed7999b8]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:14:27 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f53ef04-5c23-4f5c-8ad6-b952ea0180e6 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:14:27 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:14:27 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:14:27 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[505a9b9c-4510-4912-aea5-5b11db524af3]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a54a88cc-f930-40ef-92d9-2417e46197e4 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d08b68b4-6f2a-4b70-a1fb-b49c3052b0f5 (non-flash)\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:14:27 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f53ef04-5c23-4f5c-8ad6-b952ea0180e6 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a54a88cc-f930-40ef-92d9-2417e46197e4 (non-flash)
Nov 13 19:14:27 user nova-compute[75216]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d08b68b4-6f2a-4b70-a1fb-b49c3052b0f5 (non-flash)
Nov 13 19:14:27 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 19:14:27 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f53ef04-5c23-4f5c-8ad6-b952ea0180e6 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a54a88cc-f930-40ef-92d9-2417e46197e4 (non-flash)
Nov 13 19:14:27 user nova-compute[75216]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d08b68b4-6f2a-4b70-a1fb-b49c3052b0f5 (non-flash)
Nov 13 19:14:27 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 19:14:27 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-1f53ef04-5c23-4f5c-8ad6-b952ea0180e6 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d08b68b4-6f2a-4b70-a1fb-b49c3052b0f5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.280s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 19:14:27 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f53ef04-5c23-4f5c-8ad6-b952ea0180e6 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Connected to 172.16.0.220:3260 {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 19:14:27 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-1f53ef04-5c23-4f5c-8ad6-b952ea0180e6 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] HCTL ('34', '-', '-', 0) found on session 44 with lun 0 {{(pid=75216) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 19:14:27 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-1f53ef04-5c23-4f5c-8ad6-b952ea0180e6 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75216) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 19:14:27 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:14:27 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:14:27 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[4602f434-4c6d-4e25-ada2-9bc9f7f66067]: (4, ('- - 0', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:14:27 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-1f53ef04-5c23-4f5c-8ad6-b952ea0180e6 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Searching for a device in session 44 and hctl ['34', '*', '*', 0] yield: None {{(pid=75216) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 19:14:28 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-1f53ef04-5c23-4f5c-8ad6-b952ea0180e6 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Searching for a device in session 44 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75216) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 19:14:28 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f53ef04-5c23-4f5c-8ad6-b952ea0180e6 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:d08b68b4-6f2a-4b70-a1fb-b49c3052b0f5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TqlahwMW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 19:14:28 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-1f53ef04-5c23-4f5c-8ad6-b952ea0180e6 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.313s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 19:14:28 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f53ef04-5c23-4f5c-8ad6-b952ea0180e6 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] <== connect_volume: return (1314ms) {'type': 'block', 'scsi_wwn': '23865353637633835', 'path': '/dev/sdc'} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 19:14:28 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1f53ef04-5c23-4f5c-8ad6-b952ea0180e6 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] [instance: 9e47d802-efdb-4763-8594-1ad056dbf6cc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23865353637633835', 'path': '/dev/sdc'} {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 19:14:28 user nova-compute[75216]: DEBUG nova.objects.instance [None req-1f53ef04-5c23-4f5c-8ad6-b952ea0180e6 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Lazy-loading 'flavor' on Instance uuid 9e47d802-efdb-4763-8594-1ad056dbf6cc {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:14:28 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-1f53ef04-5c23-4f5c-8ad6-b952ea0180e6 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] attach device xml: <disk type="block" device="disk">
Nov 13 19:14:28 user nova-compute[75216]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 19:14:28 user nova-compute[75216]:   <source dev="/dev/sdc"/>
Nov 13 19:14:28 user nova-compute[75216]:   <target dev="vdc" bus="virtio"/>
Nov 13 19:14:28 user nova-compute[75216]:   <serial>d08b68b4-6f2a-4b70-a1fb-b49c3052b0f5</serial>
Nov 13 19:14:28 user nova-compute[75216]: </disk>
Nov 13 19:14:28 user nova-compute[75216]:  {{(pid=75216) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 13 19:14:29 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-1f53ef04-5c23-4f5c-8ad6-b952ea0180e6 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 19:14:29 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-1f53ef04-5c23-4f5c-8ad6-b952ea0180e6 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 19:14:29 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-1f53ef04-5c23-4f5c-8ad6-b952ea0180e6 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 19:14:29 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-1f53ef04-5c23-4f5c-8ad6-b952ea0180e6 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] No VIF found with MAC fa:16:3e:ca:d7:9f, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 19:14:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:14:29 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1f53ef04-5c23-4f5c-8ad6-b952ea0180e6 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Lock "9e47d802-efdb-4763-8594-1ad056dbf6cc" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 5.896s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:14:30 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-fd2e7314-81c5-4e1a-b359-43410d8a8dbf tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Acquiring lock "9e47d802-efdb-4763-8594-1ad056dbf6cc" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:14:30 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-fd2e7314-81c5-4e1a-b359-43410d8a8dbf tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Lock "9e47d802-efdb-4763-8594-1ad056dbf6cc" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:14:30 user nova-compute[75216]: INFO nova.compute.manager [None req-fd2e7314-81c5-4e1a-b359-43410d8a8dbf tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] [instance: 9e47d802-efdb-4763-8594-1ad056dbf6cc] Detaching volume a54a88cc-f930-40ef-92d9-2417e46197e4
Nov 13 19:14:30 user nova-compute[75216]: INFO nova.virt.block_device [None req-fd2e7314-81c5-4e1a-b359-43410d8a8dbf tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] [instance: 9e47d802-efdb-4763-8594-1ad056dbf6cc] Attempting to driver detach volume a54a88cc-f930-40ef-92d9-2417e46197e4 from mountpoint /dev/vdb
Nov 13 19:14:30 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-fd2e7314-81c5-4e1a-b359-43410d8a8dbf tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Attempting to detach device vdb from instance 9e47d802-efdb-4763-8594-1ad056dbf6cc from the persistent domain config. {{(pid=75216) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 13 19:14:30 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-fd2e7314-81c5-4e1a-b359-43410d8a8dbf tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 19:14:30 user nova-compute[75216]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 19:14:30 user nova-compute[75216]:   <source dev="/dev/sdb"/>
Nov 13 19:14:30 user nova-compute[75216]:   <target dev="vdb" bus="virtio"/>
Nov 13 19:14:30 user nova-compute[75216]:   <serial>a54a88cc-f930-40ef-92d9-2417e46197e4</serial>
Nov 13 19:14:30 user nova-compute[75216]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 19:14:30 user nova-compute[75216]: </disk>
Nov 13 19:14:30 user nova-compute[75216]:  {{(pid=75216) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 19:14:30 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-fd2e7314-81c5-4e1a-b359-43410d8a8dbf tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Successfully detached device vdb from instance 9e47d802-efdb-4763-8594-1ad056dbf6cc from the persistent domain config.
Nov 13 19:14:30 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-fd2e7314-81c5-4e1a-b359-43410d8a8dbf tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9e47d802-efdb-4763-8594-1ad056dbf6cc from the live domain config. {{(pid=75216) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 13 19:14:30 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-fd2e7314-81c5-4e1a-b359-43410d8a8dbf tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 19:14:30 user nova-compute[75216]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 19:14:30 user nova-compute[75216]:   <source dev="/dev/sdb"/>
Nov 13 19:14:30 user nova-compute[75216]:   <target dev="vdb" bus="virtio"/>
Nov 13 19:14:30 user nova-compute[75216]:   <serial>a54a88cc-f930-40ef-92d9-2417e46197e4</serial>
Nov 13 19:14:30 user nova-compute[75216]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 19:14:30 user nova-compute[75216]: </disk>
Nov 13 19:14:30 user nova-compute[75216]:  {{(pid=75216) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 19:14:30 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:14:30 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-fd2e7314-81c5-4e1a-b359-43410d8a8dbf tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9e47d802-efdb-4763-8594-1ad056dbf6cc {{(pid=75216) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 13 19:14:34 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:14:35 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:14:39 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:14:40 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:14:44 user nova-compute[75216]: DEBUG nova.compute.manager [req-d2e32421-174f-4550-b6e6-8182e1d85065 req-ee286e29-70d7-4369-a966-52699ab57142 service nova] [instance: 55b7031b-4fd6-4ecb-9130-68110677c7cf] Received event network-changed-bc9be0fb-9e21-4ad1-ae37-a1da3dbc5e5e {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:14:44 user nova-compute[75216]: DEBUG nova.compute.manager [req-d2e32421-174f-4550-b6e6-8182e1d85065 req-ee286e29-70d7-4369-a966-52699ab57142 service nova] [instance: 55b7031b-4fd6-4ecb-9130-68110677c7cf] Refreshing instance network info cache due to event network-changed-bc9be0fb-9e21-4ad1-ae37-a1da3dbc5e5e. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 19:14:44 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-d2e32421-174f-4550-b6e6-8182e1d85065 req-ee286e29-70d7-4369-a966-52699ab57142 service nova] Acquiring lock "refresh_cache-55b7031b-4fd6-4ecb-9130-68110677c7cf" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 19:14:44 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-d2e32421-174f-4550-b6e6-8182e1d85065 req-ee286e29-70d7-4369-a966-52699ab57142 service nova] Acquired lock "refresh_cache-55b7031b-4fd6-4ecb-9130-68110677c7cf" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 19:14:44 user nova-compute[75216]: DEBUG nova.network.neutron [req-d2e32421-174f-4550-b6e6-8182e1d85065 req-ee286e29-70d7-4369-a966-52699ab57142 service nova] [instance: 55b7031b-4fd6-4ecb-9130-68110677c7cf] Refreshing network info cache for port bc9be0fb-9e21-4ad1-ae37-a1da3dbc5e5e {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 19:14:44 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:14:44 user nova-compute[75216]: DEBUG nova.network.neutron [req-d2e32421-174f-4550-b6e6-8182e1d85065 req-ee286e29-70d7-4369-a966-52699ab57142 service nova] [instance: 55b7031b-4fd6-4ecb-9130-68110677c7cf] Updated VIF entry in instance network info cache for port bc9be0fb-9e21-4ad1-ae37-a1da3dbc5e5e. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 19:14:44 user nova-compute[75216]: DEBUG nova.network.neutron [req-d2e32421-174f-4550-b6e6-8182e1d85065 req-ee286e29-70d7-4369-a966-52699ab57142 service nova] [instance: 55b7031b-4fd6-4ecb-9130-68110677c7cf] Updating instance_info_cache with network_info: [{"id": "bc9be0fb-9e21-4ad1-ae37-a1da3dbc5e5e", "address": "fa:16:3e:92:1e:27", "network": {"id": "988045b3-1899-40e5-93a6-56fc3b6bb766", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-280689078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4172655ed9de4ceb84d79d785f3b3377", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc9be0fb-9e", "ovs_interfaceid": "bc9be0fb-9e21-4ad1-ae37-a1da3dbc5e5e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:14:44 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-d2e32421-174f-4550-b6e6-8182e1d85065 req-ee286e29-70d7-4369-a966-52699ab57142 service nova] Releasing lock "refresh_cache-55b7031b-4fd6-4ecb-9130-68110677c7cf" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 19:14:44 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e3a4f7d6-4e1b-409c-a815-17b0eb101923 tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] Acquiring lock "55b7031b-4fd6-4ecb-9130-68110677c7cf" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:14:44 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e3a4f7d6-4e1b-409c-a815-17b0eb101923 tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] Lock "55b7031b-4fd6-4ecb-9130-68110677c7cf" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:14:44 user nova-compute[75216]: DEBUG nova.objects.instance [None req-e3a4f7d6-4e1b-409c-a815-17b0eb101923 tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] Lazy-loading 'flavor' on Instance uuid 55b7031b-4fd6-4ecb-9130-68110677c7cf {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:14:44 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e3a4f7d6-4e1b-409c-a815-17b0eb101923 tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] Lock "55b7031b-4fd6-4ecb-9130-68110677c7cf" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:14:44 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e3a4f7d6-4e1b-409c-a815-17b0eb101923 tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] Acquiring lock "55b7031b-4fd6-4ecb-9130-68110677c7cf" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:14:44 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e3a4f7d6-4e1b-409c-a815-17b0eb101923 tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] Lock "55b7031b-4fd6-4ecb-9130-68110677c7cf" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:14:44 user nova-compute[75216]: INFO nova.compute.manager [None req-e3a4f7d6-4e1b-409c-a815-17b0eb101923 tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] [instance: 55b7031b-4fd6-4ecb-9130-68110677c7cf] Attaching volume 87436fbf-6473-4126-b388-247a56d3df9e to /dev/vdb
Nov 13 19:14:45 user nova-compute[75216]: DEBUG os_brick.utils [None req-e3a4f7d6-4e1b-409c-a815-17b0eb101923 tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 19:14:45 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:14:45 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:14:45 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[3272723f-2bb2-4e64-8d34-ef31ac316885]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aea6fcfe14b9\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:14:45 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:14:45 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:14:45 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb91a6ed-46a2-4faf-ae4d-b8f8214041dd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:14:45 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:14:45 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:14:45 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[789f0c14-299d-485b-ad6f-34fb9fda5d9d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:14:45 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a329685-c900-4755-9607-4925a1bcaf27]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:14:45 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-e3a4f7d6-4e1b-409c-a815-17b0eb101923 tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] Running cmd (subprocess): nvme version {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:14:45 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-e3a4f7d6-4e1b-409c-a815-17b0eb101923 tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] 'nvme version' failed. Not Retrying. {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 19:14:45 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e3a4f7d6-4e1b-409c-a815-17b0eb101923 tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] nvme not present on system {{(pid=75216) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 19:14:45 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:14:45 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 19:14:45 user nova-compute[75216]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 19:14:45 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9dcd927-2266-4115-a7c4-e947aedecdbc]: (4, '') {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:14:45 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-e3a4f7d6-4e1b-409c-a815-17b0eb101923 tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75216) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 19:14:45 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-e3a4f7d6-4e1b-409c-a815-17b0eb101923 tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 19:14:45 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-e3a4f7d6-4e1b-409c-a815-17b0eb101923 tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] LIGHTOS: no hostnqn found. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 19:14:45 user nova-compute[75216]: DEBUG os_brick.utils [None req-e3a4f7d6-4e1b-409c-a815-17b0eb101923 tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] <== get_connector_properties: return (111ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aea6fcfe14b9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 19:14:45 user nova-compute[75216]: DEBUG nova.virt.block_device [None req-e3a4f7d6-4e1b-409c-a815-17b0eb101923 tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] [instance: 55b7031b-4fd6-4ecb-9130-68110677c7cf] Updating existing volume attachment record: 07c18a9b-dd8e-4e04-893e-5ada29b51911 {{(pid=75216) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 19:14:45 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:14:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:14:49 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e3a4f7d6-4e1b-409c-a815-17b0eb101923 tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] [instance: 55b7031b-4fd6-4ecb-9130-68110677c7cf] Calling os-brick to attach iSCSI Volume {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 19:14:49 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3a4f7d6-4e1b-409c-a815-17b0eb101923 tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3a8669e40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:87436fbf-6473-4126-b388-247a56d3df9e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bJztckes', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 19:14:49 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-e3a4f7d6-4e1b-409c-a815-17b0eb101923 tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 19:14:49 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-e3a4f7d6-4e1b-409c-a815-17b0eb101923 tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 19:14:49 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-e3a4f7d6-4e1b-409c-a815-17b0eb101923 tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 19:14:49 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-e3a4f7d6-4e1b-409c-a815-17b0eb101923 tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 19:14:49 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-e3a4f7d6-4e1b-409c-a815-17b0eb101923 tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:87436fbf-6473-4126-b388-247a56d3df9e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 19:14:49 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-e3a4f7d6-4e1b-409c-a815-17b0eb101923 tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:87436fbf-6473-4126-b388-247a56d3df9e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 19:14:49 user nova-compute[75216]: INFO os_brick.initiator.connectors.iscsi [None req-e3a4f7d6-4e1b-409c-a815-17b0eb101923 tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 19:14:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87436fbf-6473-4126-b388-247a56d3df9e -p 172.16.0.220:3260 {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:14:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87436fbf-6473-4126-b388-247a56d3df9e -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:14:49 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[e74e7a9f-4ca1-49b3-a757-999d7da090da]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:14:49 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3a4f7d6-4e1b-409c-a815-17b0eb101923 tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 19:14:49 user nova-compute[75216]:  {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:14:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87436fbf-6473-4126-b388-247a56d3df9e -p 172.16.0.220:3260 --interface default --op new {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:14:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87436fbf-6473-4126-b388-247a56d3df9e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:14:49 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[355f21e5-4020-493b-9dec-35e9b940ee35]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:87436fbf-6473-4126-b388-247a56d3df9e] added\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:14:49 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3a4f7d6-4e1b-409c-a815-17b0eb101923 tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:87436fbf-6473-4126-b388-247a56d3df9e] added
Nov 13 19:14:49 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:14:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87436fbf-6473-4126-b388-247a56d3df9e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:14:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87436fbf-6473-4126-b388-247a56d3df9e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:14:49 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[117f1a93-fb0e-4801-a508-dd19639c0644]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:14:49 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3a4f7d6-4e1b-409c-a815-17b0eb101923 tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:14:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87436fbf-6473-4126-b388-247a56d3df9e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:14:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87436fbf-6473-4126-b388-247a56d3df9e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:14:49 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[96c27f39-58a4-47d9-abbf-06da8f129d66]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:14:49 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3a4f7d6-4e1b-409c-a815-17b0eb101923 tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:14:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87436fbf-6473-4126-b388-247a56d3df9e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bJztckes {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:14:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87436fbf-6473-4126-b388-247a56d3df9e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bJztckes" returned: 0 in 0.017s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:14:49 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[fff7399c-3e06-41c9-9527-ba8360881cc0]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:14:49 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3a4f7d6-4e1b-409c-a815-17b0eb101923 tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bJztckes'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:14:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87436fbf-6473-4126-b388-247a56d3df9e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:14:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87436fbf-6473-4126-b388-247a56d3df9e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:14:49 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[32ae5bb8-53e1-47eb-8e9b-4cb6c9ce8759]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:14:49 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3a4f7d6-4e1b-409c-a815-17b0eb101923 tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:14:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:14:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:14:49 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[33c79b8d-ea5b-4565-9861-884eb95cdeb2]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a54a88cc-f930-40ef-92d9-2417e46197e4 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d08b68b4-6f2a-4b70-a1fb-b49c3052b0f5 (non-flash)\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:14:49 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3a4f7d6-4e1b-409c-a815-17b0eb101923 tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a54a88cc-f930-40ef-92d9-2417e46197e4 (non-flash)
Nov 13 19:14:49 user nova-compute[75216]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d08b68b4-6f2a-4b70-a1fb-b49c3052b0f5 (non-flash)
Nov 13 19:14:49 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 19:14:49 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3a4f7d6-4e1b-409c-a815-17b0eb101923 tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a54a88cc-f930-40ef-92d9-2417e46197e4 (non-flash)
Nov 13 19:14:49 user nova-compute[75216]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d08b68b4-6f2a-4b70-a1fb-b49c3052b0f5 (non-flash)
Nov 13 19:14:49 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 19:14:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87436fbf-6473-4126-b388-247a56d3df9e -p 172.16.0.220:3260 --login {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:14:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87436fbf-6473-4126-b388-247a56d3df9e -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:14:49 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[82319e05-a886-4576-89e9-481f57e8c2a4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:87436fbf-6473-4126-b388-247a56d3df9e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:87436fbf-6473-4126-b388-247a56d3df9e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:14:49 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3a4f7d6-4e1b-409c-a815-17b0eb101923 tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:87436fbf-6473-4126-b388-247a56d3df9e, portal: 172.16.0.220,3260]
Nov 13 19:14:49 user nova-compute[75216]: Login to [iface: default, target: iqn.2010-10.org.openstack:87436fbf-6473-4126-b388-247a56d3df9e, portal: 172.16.0.220,3260] successful.
Nov 13 19:14:49 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:14:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87436fbf-6473-4126-b388-247a56d3df9e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:14:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87436fbf-6473-4126-b388-247a56d3df9e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:14:49 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f2bc300-afe8-4f98-bb8a-0d9f07c8d94a]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:14:49 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3a4f7d6-4e1b-409c-a815-17b0eb101923 tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:14:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:14:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:14:49 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ca92259-6ba4-4500-b41b-5fe158449d9e]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a54a88cc-f930-40ef-92d9-2417e46197e4 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d08b68b4-6f2a-4b70-a1fb-b49c3052b0f5 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87436fbf-6473-4126-b388-247a56d3df9e (non-flash)\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:14:49 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3a4f7d6-4e1b-409c-a815-17b0eb101923 tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a54a88cc-f930-40ef-92d9-2417e46197e4 (non-flash)
Nov 13 19:14:49 user nova-compute[75216]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d08b68b4-6f2a-4b70-a1fb-b49c3052b0f5 (non-flash)
Nov 13 19:14:49 user nova-compute[75216]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87436fbf-6473-4126-b388-247a56d3df9e (non-flash)
Nov 13 19:14:49 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 19:14:49 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3a4f7d6-4e1b-409c-a815-17b0eb101923 tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a54a88cc-f930-40ef-92d9-2417e46197e4 (non-flash)
Nov 13 19:14:49 user nova-compute[75216]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d08b68b4-6f2a-4b70-a1fb-b49c3052b0f5 (non-flash)
Nov 13 19:14:49 user nova-compute[75216]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87436fbf-6473-4126-b388-247a56d3df9e (non-flash)
Nov 13 19:14:49 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 19:14:49 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-e3a4f7d6-4e1b-409c-a815-17b0eb101923 tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:87436fbf-6473-4126-b388-247a56d3df9e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.256s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 19:14:49 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3a4f7d6-4e1b-409c-a815-17b0eb101923 tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] Connected to 172.16.0.220:3260 {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 19:14:49 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-e3a4f7d6-4e1b-409c-a815-17b0eb101923 tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] HCTL ('35', '-', '-', 0) found on session 45 with lun 0 {{(pid=75216) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 19:14:49 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-e3a4f7d6-4e1b-409c-a815-17b0eb101923 tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75216) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 19:14:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:14:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.015s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:14:49 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbeb4041-3032-40bd-b32c-60c55fcd372f]: (4, ('- - 0', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:14:49 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-e3a4f7d6-4e1b-409c-a815-17b0eb101923 tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] Searching for a device in session 45 and hctl ['35', '*', '*', 0] yield: None {{(pid=75216) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 19:14:50 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:14:50 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-e3a4f7d6-4e1b-409c-a815-17b0eb101923 tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] Searching for a device in session 45 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75216) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 19:14:50 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3a4f7d6-4e1b-409c-a815-17b0eb101923 tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:87436fbf-6473-4126-b388-247a56d3df9e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bJztckes', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 19:14:50 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-e3a4f7d6-4e1b-409c-a815-17b0eb101923 tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.283s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 19:14:50 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3a4f7d6-4e1b-409c-a815-17b0eb101923 tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] <== connect_volume: return (1284ms) {'type': 'block', 'scsi_wwn': '23033616639383531', 'path': '/dev/sdd'} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 19:14:50 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e3a4f7d6-4e1b-409c-a815-17b0eb101923 tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] [instance: 55b7031b-4fd6-4ecb-9130-68110677c7cf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23033616639383531', 'path': '/dev/sdd'} {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 19:14:50 user nova-compute[75216]: DEBUG nova.objects.instance [None req-e3a4f7d6-4e1b-409c-a815-17b0eb101923 tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] Lazy-loading 'flavor' on Instance uuid 55b7031b-4fd6-4ecb-9130-68110677c7cf {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:14:50 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-e3a4f7d6-4e1b-409c-a815-17b0eb101923 tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] attach device xml: <disk type="block" device="disk">
Nov 13 19:14:50 user nova-compute[75216]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 19:14:50 user nova-compute[75216]:   <source dev="/dev/sdd"/>
Nov 13 19:14:50 user nova-compute[75216]:   <target dev="vdb" bus="virtio"/>
Nov 13 19:14:50 user nova-compute[75216]:   <serial>87436fbf-6473-4126-b388-247a56d3df9e</serial>
Nov 13 19:14:50 user nova-compute[75216]: </disk>
Nov 13 19:14:50 user nova-compute[75216]:  {{(pid=75216) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 13 19:14:50 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-fd2e7314-81c5-4e1a-b359-43410d8a8dbf tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 9e47d802-efdb-4763-8594-1ad056dbf6cc is timed out.
Nov 13 19:14:50 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-fd2e7314-81c5-4e1a-b359-43410d8a8dbf tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Successfully detached device vdb from instance 9e47d802-efdb-4763-8594-1ad056dbf6cc from the live domain config.
Nov 13 19:14:50 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd2e7314-81c5-4e1a-b359-43410d8a8dbf tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] [instance: 9e47d802-efdb-4763-8594-1ad056dbf6cc] calling os-brick to detach iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 19:14:50 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd2e7314-81c5-4e1a-b359-43410d8a8dbf tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3a8669e40>, {'target_iqn': 'iqn.2010-10.org.openstack:a54a88cc-f930-40ef-92d9-2417e46197e4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jnGiVBFY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 19:14:50 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-fd2e7314-81c5-4e1a-b359-43410d8a8dbf tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 19:14:50 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-fd2e7314-81c5-4e1a-b359-43410d8a8dbf tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 19:14:50 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-fd2e7314-81c5-4e1a-b359-43410d8a8dbf tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 19:14:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:14:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:14:50 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[f559fe8a-4247-49e1-afc7-6d2be9919332]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:87436fbf-6473-4126-b388-247a56d3df9e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d08b68b4-6f2a-4b70-a1fb-b49c3052b0f5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a54a88cc-f930-40ef-92d9-2417e46197e4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:14:50 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd2e7314-81c5-4e1a-b359-43410d8a8dbf tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 19:14:50 user nova-compute[75216]: No targets found.
Nov 13 19:14:50 user nova-compute[75216]: iSNS:
Nov 13 19:14:50 user nova-compute[75216]: No targets found.
Nov 13 19:14:50 user nova-compute[75216]: STATIC:
Nov 13 19:14:50 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:87436fbf-6473-4126-b388-247a56d3df9e
Nov 13 19:14:50 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 19:14:50 user nova-compute[75216]:                 Iface Name: default
Nov 13 19:14:50 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:d08b68b4-6f2a-4b70-a1fb-b49c3052b0f5
Nov 13 19:14:50 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 19:14:50 user nova-compute[75216]:                 Iface Name: default
Nov 13 19:14:50 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:a54a88cc-f930-40ef-92d9-2417e46197e4
Nov 13 19:14:50 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 19:14:50 user nova-compute[75216]:                 Iface Name: default
Nov 13 19:14:50 user nova-compute[75216]: FIRMWARE:
Nov 13 19:14:50 user nova-compute[75216]: No targets found.
Nov 13 19:14:50 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 19:14:50 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd2e7314-81c5-4e1a-b359-43410d8a8dbf tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 19:14:50 user nova-compute[75216]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 19:14:50 user nova-compute[75216]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75216) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 19:14:50 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd2e7314-81c5-4e1a-b359-43410d8a8dbf tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a54a88cc-f930-40ef-92d9-2417e46197e4', 0)] {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 19:14:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:14:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:14:50 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ee5f83b-2809-414a-bd70-6a5091829a29]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:87436fbf-6473-4126-b388-247a56d3df9e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a54a88cc-f930-40ef-92d9-2417e46197e4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d08b68b4-6f2a-4b70-a1fb-b49c3052b0f5\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:14:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:14:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:14:50 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdbe904f-95b6-4c0f-a327-0f5f5f11c5cf]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a54a88cc-f930-40ef-92d9-2417e46197e4 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d08b68b4-6f2a-4b70-a1fb-b49c3052b0f5 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87436fbf-6473-4126-b388-247a56d3df9e (non-flash)\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:14:50 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd2e7314-81c5-4e1a-b359-43410d8a8dbf tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a54a88cc-f930-40ef-92d9-2417e46197e4 (non-flash)
Nov 13 19:14:50 user nova-compute[75216]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d08b68b4-6f2a-4b70-a1fb-b49c3052b0f5 (non-flash)
Nov 13 19:14:50 user nova-compute[75216]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87436fbf-6473-4126-b388-247a56d3df9e (non-flash)
Nov 13 19:14:50 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 19:14:50 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd2e7314-81c5-4e1a-b359-43410d8a8dbf tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a54a88cc-f930-40ef-92d9-2417e46197e4 (non-flash)
Nov 13 19:14:50 user nova-compute[75216]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d08b68b4-6f2a-4b70-a1fb-b49c3052b0f5 (non-flash)
Nov 13 19:14:50 user nova-compute[75216]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87436fbf-6473-4126-b388-247a56d3df9e (non-flash)
Nov 13 19:14:50 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 19:14:50 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd2e7314-81c5-4e1a-b359-43410d8a8dbf tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe3a81df910>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a54a88cc-f930-40ef-92d9-2417e46197e4'): ({'sdb'}, set())}) {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 19:14:50 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-fd2e7314-81c5-4e1a-b359-43410d8a8dbf tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Removing single pathed devices sdb {{(pid=75216) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 19:14:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:14:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:14:50 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[375d3504-c041-4173-8ab2-c643e77e6781]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:14:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:14:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:14:51 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[07d573ae-a4b5-42ed-a817-a3ed26fd0b0b]: (4, ('ok\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:14:51 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-fd2e7314-81c5-4e1a-b359-43410d8a8dbf tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Flushing IO for device /dev/sdb {{(pid=75216) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 19:14:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:14:51 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-e3a4f7d6-4e1b-409c-a815-17b0eb101923 tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 19:14:51 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-e3a4f7d6-4e1b-409c-a815-17b0eb101923 tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 19:14:51 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-e3a4f7d6-4e1b-409c-a815-17b0eb101923 tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] No VIF found with MAC fa:16:3e:92:1e:27, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 19:14:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:14:51 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5fbb4a0-aef6-4825-ac28-710fb7cfce58]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:14:51 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-fd2e7314-81c5-4e1a-b359-43410d8a8dbf tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75216) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 19:14:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:14:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.049s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:14:51 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[2980a625-6dc0-470f-b6c6-65a29126fab8]: (4, ('1', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:14:51 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-fd2e7314-81c5-4e1a-b359-43410d8a8dbf tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 19:14:51 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-fd2e7314-81c5-4e1a-b359-43410d8a8dbf tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] SCSI volumes sdb have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 19:14:51 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd2e7314-81c5-4e1a-b359-43410d8a8dbf tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a54a88cc-f930-40ef-92d9-2417e46197e4')] {{(pid=75216) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 19:14:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a54a88cc-f930-40ef-92d9-2417e46197e4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:14:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a54a88cc-f930-40ef-92d9-2417e46197e4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:14:51 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[f872ffe3-b76e-44f8-a7e9-a04909609ccb]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:14:51 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd2e7314-81c5-4e1a-b359-43410d8a8dbf tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:14:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a54a88cc-f930-40ef-92d9-2417e46197e4 -p 172.16.0.220:3260 --logout {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:14:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e3a4f7d6-4e1b-409c-a815-17b0eb101923 tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] Lock "55b7031b-4fd6-4ecb-9130-68110677c7cf" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.188s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:14:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a54a88cc-f930-40ef-92d9-2417e46197e4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:14:51 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[659032bb-d574-499f-9b1b-de2073f5b628]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:a54a88cc-f930-40ef-92d9-2417e46197e4, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:a54a88cc-f930-40ef-92d9-2417e46197e4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:14:51 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd2e7314-81c5-4e1a-b359-43410d8a8dbf tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:a54a88cc-f930-40ef-92d9-2417e46197e4, portal: 172.16.0.220,3260]
Nov 13 19:14:51 user nova-compute[75216]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:a54a88cc-f930-40ef-92d9-2417e46197e4, portal: 172.16.0.220,3260] successful.
Nov 13 19:14:51 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:14:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a54a88cc-f930-40ef-92d9-2417e46197e4 -p 172.16.0.220:3260 --op delete {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:14:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a54a88cc-f930-40ef-92d9-2417e46197e4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:14:51 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eea2684-e3cc-411d-a032-da788973dcc9]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:14:51 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd2e7314-81c5-4e1a-b359-43410d8a8dbf tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:14:51 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-fd2e7314-81c5-4e1a-b359-43410d8a8dbf tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.319s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 19:14:51 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd2e7314-81c5-4e1a-b359-43410d8a8dbf tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] <== disconnect_volume: return (321ms) None {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 19:14:51 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd2e7314-81c5-4e1a-b359-43410d8a8dbf tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] [instance: 9e47d802-efdb-4763-8594-1ad056dbf6cc] Disconnected iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 19:14:51 user nova-compute[75216]: DEBUG nova.objects.instance [None req-fd2e7314-81c5-4e1a-b359-43410d8a8dbf tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Lazy-loading 'flavor' on Instance uuid 9e47d802-efdb-4763-8594-1ad056dbf6cc {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:14:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-fd2e7314-81c5-4e1a-b359-43410d8a8dbf tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Lock "9e47d802-efdb-4763-8594-1ad056dbf6cc" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.646s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:14:53 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-2d0a9708-cdb9-4a6b-94b4-e4c14f2b2611 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Acquiring lock "9e47d802-efdb-4763-8594-1ad056dbf6cc" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:14:53 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-2d0a9708-cdb9-4a6b-94b4-e4c14f2b2611 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Lock "9e47d802-efdb-4763-8594-1ad056dbf6cc" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:14:53 user nova-compute[75216]: INFO nova.compute.manager [None req-2d0a9708-cdb9-4a6b-94b4-e4c14f2b2611 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] [instance: 9e47d802-efdb-4763-8594-1ad056dbf6cc] Detaching volume d08b68b4-6f2a-4b70-a1fb-b49c3052b0f5
Nov 13 19:14:53 user nova-compute[75216]: INFO nova.virt.block_device [None req-2d0a9708-cdb9-4a6b-94b4-e4c14f2b2611 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] [instance: 9e47d802-efdb-4763-8594-1ad056dbf6cc] Attempting to driver detach volume d08b68b4-6f2a-4b70-a1fb-b49c3052b0f5 from mountpoint /dev/vdc
Nov 13 19:14:53 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-2d0a9708-cdb9-4a6b-94b4-e4c14f2b2611 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Attempting to detach device vdc from instance 9e47d802-efdb-4763-8594-1ad056dbf6cc from the persistent domain config. {{(pid=75216) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 13 19:14:53 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-2d0a9708-cdb9-4a6b-94b4-e4c14f2b2611 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 19:14:53 user nova-compute[75216]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 19:14:53 user nova-compute[75216]:   <source dev="/dev/sdc"/>
Nov 13 19:14:53 user nova-compute[75216]:   <target dev="vdc" bus="virtio"/>
Nov 13 19:14:53 user nova-compute[75216]:   <serial>d08b68b4-6f2a-4b70-a1fb-b49c3052b0f5</serial>
Nov 13 19:14:53 user nova-compute[75216]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 13 19:14:53 user nova-compute[75216]: </disk>
Nov 13 19:14:53 user nova-compute[75216]:  {{(pid=75216) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 19:14:53 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-2d0a9708-cdb9-4a6b-94b4-e4c14f2b2611 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Successfully detached device vdc from instance 9e47d802-efdb-4763-8594-1ad056dbf6cc from the persistent domain config.
Nov 13 19:14:53 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-2d0a9708-cdb9-4a6b-94b4-e4c14f2b2611 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 9e47d802-efdb-4763-8594-1ad056dbf6cc from the live domain config. {{(pid=75216) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 13 19:14:53 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-2d0a9708-cdb9-4a6b-94b4-e4c14f2b2611 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 19:14:53 user nova-compute[75216]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 19:14:53 user nova-compute[75216]:   <source dev="/dev/sdc"/>
Nov 13 19:14:53 user nova-compute[75216]:   <target dev="vdc" bus="virtio"/>
Nov 13 19:14:53 user nova-compute[75216]:   <serial>d08b68b4-6f2a-4b70-a1fb-b49c3052b0f5</serial>
Nov 13 19:14:53 user nova-compute[75216]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 13 19:14:53 user nova-compute[75216]: </disk>
Nov 13 19:14:53 user nova-compute[75216]:  {{(pid=75216) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 19:14:53 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-2d0a9708-cdb9-4a6b-94b4-e4c14f2b2611 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 9e47d802-efdb-4763-8594-1ad056dbf6cc {{(pid=75216) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 13 19:14:53 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-20cc1317-29cc-45c9-bede-2a37b06896f5 tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] Acquiring lock "55b7031b-4fd6-4ecb-9130-68110677c7cf" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:14:53 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-20cc1317-29cc-45c9-bede-2a37b06896f5 tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] Lock "55b7031b-4fd6-4ecb-9130-68110677c7cf" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:14:53 user nova-compute[75216]: DEBUG nova.objects.instance [None req-20cc1317-29cc-45c9-bede-2a37b06896f5 tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] Lazy-loading 'flavor' on Instance uuid 55b7031b-4fd6-4ecb-9130-68110677c7cf {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:14:53 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-20cc1317-29cc-45c9-bede-2a37b06896f5 tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] Lock "55b7031b-4fd6-4ecb-9130-68110677c7cf" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.100s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:14:54 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-20cc1317-29cc-45c9-bede-2a37b06896f5 tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] Acquiring lock "55b7031b-4fd6-4ecb-9130-68110677c7cf" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:14:54 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-20cc1317-29cc-45c9-bede-2a37b06896f5 tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] Lock "55b7031b-4fd6-4ecb-9130-68110677c7cf" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:14:54 user nova-compute[75216]: INFO nova.compute.manager [None req-20cc1317-29cc-45c9-bede-2a37b06896f5 tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] [instance: 55b7031b-4fd6-4ecb-9130-68110677c7cf] Attaching volume 9e9fc1b9-d7ca-437d-a0db-f2e0884c3328 to /dev/vdc
Nov 13 19:14:54 user nova-compute[75216]: DEBUG os_brick.utils [None req-20cc1317-29cc-45c9-bede-2a37b06896f5 tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 19:14:54 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:14:54 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:14:54 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[db3fbcdc-5c9b-453d-8a04-2a462ea7e8af]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aea6fcfe14b9\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:14:54 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:14:54 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:14:54 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfe04771-3bb9-423e-b54c-6786a7d647f0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:14:54 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:14:54 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:14:54 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:14:54 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[d44db6c2-ef45-4ce4-b8dd-bb80edfe37a8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:14:54 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8db0b52-63d5-4752-a630-39e61b6b3ef5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:14:54 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-20cc1317-29cc-45c9-bede-2a37b06896f5 tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] Running cmd (subprocess): nvme version {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:14:54 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-20cc1317-29cc-45c9-bede-2a37b06896f5 tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] 'nvme version' failed. Not Retrying. {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 19:14:54 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.nvmeof [None req-20cc1317-29cc-45c9-bede-2a37b06896f5 tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] nvme not present on system {{(pid=75216) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 19:14:54 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:14:54 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 19:14:54 user nova-compute[75216]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 19:14:54 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[cefbfb70-3b4e-45bb-8633-090684bd896d]: (4, '') {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:14:54 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-20cc1317-29cc-45c9-bede-2a37b06896f5 tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75216) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 19:14:54 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-20cc1317-29cc-45c9-bede-2a37b06896f5 tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 19:14:54 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-20cc1317-29cc-45c9-bede-2a37b06896f5 tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] LIGHTOS: no hostnqn found. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 19:14:54 user nova-compute[75216]: DEBUG os_brick.utils [None req-20cc1317-29cc-45c9-bede-2a37b06896f5 tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aea6fcfe14b9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 19:14:54 user nova-compute[75216]: DEBUG nova.virt.block_device [None req-20cc1317-29cc-45c9-bede-2a37b06896f5 tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] [instance: 55b7031b-4fd6-4ecb-9130-68110677c7cf] Updating existing volume attachment record: 10fb5ff4-cf0b-4d4a-b326-22c0e1171b73 {{(pid=75216) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 19:14:55 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:14:57 user nova-compute[75216]: DEBUG nova.compute.manager [req-73db3e10-fbe2-4fff-b3f1-ddc710b4f0ff req-4b9c5a1a-9f8a-47b2-bb4e-299c88f8b478 service nova] [instance: b048c677-85bf-4a93-88eb-c71bde27bf5b] Received event network-changed-4ae536b2-7829-45c2-8739-a3f838008e74 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:14:57 user nova-compute[75216]: DEBUG nova.compute.manager [req-73db3e10-fbe2-4fff-b3f1-ddc710b4f0ff req-4b9c5a1a-9f8a-47b2-bb4e-299c88f8b478 service nova] [instance: b048c677-85bf-4a93-88eb-c71bde27bf5b] Refreshing instance network info cache due to event network-changed-4ae536b2-7829-45c2-8739-a3f838008e74. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 19:14:57 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-73db3e10-fbe2-4fff-b3f1-ddc710b4f0ff req-4b9c5a1a-9f8a-47b2-bb4e-299c88f8b478 service nova] Acquiring lock "refresh_cache-b048c677-85bf-4a93-88eb-c71bde27bf5b" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 19:14:57 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-73db3e10-fbe2-4fff-b3f1-ddc710b4f0ff req-4b9c5a1a-9f8a-47b2-bb4e-299c88f8b478 service nova] Acquired lock "refresh_cache-b048c677-85bf-4a93-88eb-c71bde27bf5b" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 19:14:57 user nova-compute[75216]: DEBUG nova.network.neutron [req-73db3e10-fbe2-4fff-b3f1-ddc710b4f0ff req-4b9c5a1a-9f8a-47b2-bb4e-299c88f8b478 service nova] [instance: b048c677-85bf-4a93-88eb-c71bde27bf5b] Refreshing network info cache for port 4ae536b2-7829-45c2-8739-a3f838008e74 {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 19:14:57 user nova-compute[75216]: DEBUG nova.network.neutron [req-73db3e10-fbe2-4fff-b3f1-ddc710b4f0ff req-4b9c5a1a-9f8a-47b2-bb4e-299c88f8b478 service nova] [instance: b048c677-85bf-4a93-88eb-c71bde27bf5b] Updated VIF entry in instance network info cache for port 4ae536b2-7829-45c2-8739-a3f838008e74. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 19:14:57 user nova-compute[75216]: DEBUG nova.network.neutron [req-73db3e10-fbe2-4fff-b3f1-ddc710b4f0ff req-4b9c5a1a-9f8a-47b2-bb4e-299c88f8b478 service nova] [instance: b048c677-85bf-4a93-88eb-c71bde27bf5b] Updating instance_info_cache with network_info: [{"id": "4ae536b2-7829-45c2-8739-a3f838008e74", "address": "fa:16:3e:1a:59:bc", "network": {"id": "9dcbadf2-6b5e-41f1-88a3-17a579ad1bad", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-926239573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d06cae29094846f1817036dc761a565d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ae536b2-78", "ovs_interfaceid": "4ae536b2-7829-45c2-8739-a3f838008e74", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:14:57 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-73db3e10-fbe2-4fff-b3f1-ddc710b4f0ff req-4b9c5a1a-9f8a-47b2-bb4e-299c88f8b478 service nova] Releasing lock "refresh_cache-b048c677-85bf-4a93-88eb-c71bde27bf5b" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 19:14:58 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-20cc1317-29cc-45c9-bede-2a37b06896f5 tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] [instance: 55b7031b-4fd6-4ecb-9130-68110677c7cf] Calling os-brick to attach iSCSI Volume {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 19:14:58 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-20cc1317-29cc-45c9-bede-2a37b06896f5 tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3a8669e40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9e9fc1b9-d7ca-437d-a0db-f2e0884c3328', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZTcltRko', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 19:14:58 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-20cc1317-29cc-45c9-bede-2a37b06896f5 tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 19:14:58 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-20cc1317-29cc-45c9-bede-2a37b06896f5 tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 19:14:58 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-20cc1317-29cc-45c9-bede-2a37b06896f5 tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 19:14:58 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-20cc1317-29cc-45c9-bede-2a37b06896f5 tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 19:14:58 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-20cc1317-29cc-45c9-bede-2a37b06896f5 tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9e9fc1b9-d7ca-437d-a0db-f2e0884c3328" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 19:14:58 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-20cc1317-29cc-45c9-bede-2a37b06896f5 tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9e9fc1b9-d7ca-437d-a0db-f2e0884c3328" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 19:14:58 user nova-compute[75216]: INFO os_brick.initiator.connectors.iscsi [None req-20cc1317-29cc-45c9-bede-2a37b06896f5 tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 19:14:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e9fc1b9-d7ca-437d-a0db-f2e0884c3328 -p 172.16.0.220:3260 {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:14:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e9fc1b9-d7ca-437d-a0db-f2e0884c3328 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:14:58 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[27d3b96c-95e2-4275-a8d7-92902a9e0320]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:14:58 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-20cc1317-29cc-45c9-bede-2a37b06896f5 tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 19:14:58 user nova-compute[75216]:  {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:14:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e9fc1b9-d7ca-437d-a0db-f2e0884c3328 -p 172.16.0.220:3260 --interface default --op new {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:14:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e9fc1b9-d7ca-437d-a0db-f2e0884c3328 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:14:58 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d946016-8e1f-4a12-adda-a558f9675877]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9e9fc1b9-d7ca-437d-a0db-f2e0884c3328] added\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:14:58 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-20cc1317-29cc-45c9-bede-2a37b06896f5 tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9e9fc1b9-d7ca-437d-a0db-f2e0884c3328] added
Nov 13 19:14:58 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:14:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e9fc1b9-d7ca-437d-a0db-f2e0884c3328 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:14:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e9fc1b9-d7ca-437d-a0db-f2e0884c3328 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:14:58 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7ab2fdb-8f9f-4dc8-812c-ece2cf921fb5]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:14:58 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-20cc1317-29cc-45c9-bede-2a37b06896f5 tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:14:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e9fc1b9-d7ca-437d-a0db-f2e0884c3328 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:14:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e9fc1b9-d7ca-437d-a0db-f2e0884c3328 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:14:58 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aaa8e5c-8ebf-4f31-be58-c0571d21db90]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:14:58 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-20cc1317-29cc-45c9-bede-2a37b06896f5 tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:14:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e9fc1b9-d7ca-437d-a0db-f2e0884c3328 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZTcltRko {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:14:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e9fc1b9-d7ca-437d-a0db-f2e0884c3328 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZTcltRko" returned: 0 in 0.017s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:14:58 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ac69b5f-1574-4f21-9abd-24091fdec537]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:14:58 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-20cc1317-29cc-45c9-bede-2a37b06896f5 tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZTcltRko'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:14:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e9fc1b9-d7ca-437d-a0db-f2e0884c3328 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:14:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e9fc1b9-d7ca-437d-a0db-f2e0884c3328 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:14:58 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[08c92ff9-c5de-4ba8-87a7-c2aa52a78401]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:14:58 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-20cc1317-29cc-45c9-bede-2a37b06896f5 tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:14:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:14:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:14:58 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[167ac1b7-dfd8-49bc-bcf0-2d514d967931]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d08b68b4-6f2a-4b70-a1fb-b49c3052b0f5 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87436fbf-6473-4126-b388-247a56d3df9e (non-flash)\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:14:58 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-20cc1317-29cc-45c9-bede-2a37b06896f5 tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d08b68b4-6f2a-4b70-a1fb-b49c3052b0f5 (non-flash)
Nov 13 19:14:58 user nova-compute[75216]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87436fbf-6473-4126-b388-247a56d3df9e (non-flash)
Nov 13 19:14:58 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 19:14:58 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-20cc1317-29cc-45c9-bede-2a37b06896f5 tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d08b68b4-6f2a-4b70-a1fb-b49c3052b0f5 (non-flash)
Nov 13 19:14:58 user nova-compute[75216]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87436fbf-6473-4126-b388-247a56d3df9e (non-flash)
Nov 13 19:14:58 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 19:14:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e9fc1b9-d7ca-437d-a0db-f2e0884c3328 -p 172.16.0.220:3260 --login {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:14:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e9fc1b9-d7ca-437d-a0db-f2e0884c3328 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:14:58 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[a359ebc7-f069-432b-8b15-a4896980f9f8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9e9fc1b9-d7ca-437d-a0db-f2e0884c3328, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9e9fc1b9-d7ca-437d-a0db-f2e0884c3328, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:14:58 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-20cc1317-29cc-45c9-bede-2a37b06896f5 tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9e9fc1b9-d7ca-437d-a0db-f2e0884c3328, portal: 172.16.0.220,3260]
Nov 13 19:14:58 user nova-compute[75216]: Login to [iface: default, target: iqn.2010-10.org.openstack:9e9fc1b9-d7ca-437d-a0db-f2e0884c3328, portal: 172.16.0.220,3260] successful.
Nov 13 19:14:58 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:14:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e9fc1b9-d7ca-437d-a0db-f2e0884c3328 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:14:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e9fc1b9-d7ca-437d-a0db-f2e0884c3328 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:14:58 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[10eb0bd5-65fc-4bf5-9e70-666ec909a5a6]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:14:58 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-20cc1317-29cc-45c9-bede-2a37b06896f5 tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:14:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:14:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:14:58 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcd91458-e51e-409f-8fdb-94b8e8c205d1]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d08b68b4-6f2a-4b70-a1fb-b49c3052b0f5 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87436fbf-6473-4126-b388-247a56d3df9e (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9fc1b9-d7ca-437d-a0db-f2e0884c3328 (non-flash)\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:14:58 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-20cc1317-29cc-45c9-bede-2a37b06896f5 tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d08b68b4-6f2a-4b70-a1fb-b49c3052b0f5 (non-flash)
Nov 13 19:14:58 user nova-compute[75216]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87436fbf-6473-4126-b388-247a56d3df9e (non-flash)
Nov 13 19:14:58 user nova-compute[75216]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9fc1b9-d7ca-437d-a0db-f2e0884c3328 (non-flash)
Nov 13 19:14:58 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 19:14:58 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-20cc1317-29cc-45c9-bede-2a37b06896f5 tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d08b68b4-6f2a-4b70-a1fb-b49c3052b0f5 (non-flash)
Nov 13 19:14:58 user nova-compute[75216]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87436fbf-6473-4126-b388-247a56d3df9e (non-flash)
Nov 13 19:14:58 user nova-compute[75216]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9fc1b9-d7ca-437d-a0db-f2e0884c3328 (non-flash)
Nov 13 19:14:58 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 19:14:58 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-20cc1317-29cc-45c9-bede-2a37b06896f5 tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9e9fc1b9-d7ca-437d-a0db-f2e0884c3328" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.273s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 19:14:58 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-20cc1317-29cc-45c9-bede-2a37b06896f5 tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] Connected to 172.16.0.220:3260 {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 19:14:58 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-20cc1317-29cc-45c9-bede-2a37b06896f5 tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] HCTL ('33', '-', '-', 0) found on session 46 with lun 0 {{(pid=75216) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 19:14:58 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-20cc1317-29cc-45c9-bede-2a37b06896f5 tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75216) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 19:14:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:14:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.027s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:14:58 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ab8849c-c873-4140-8521-ac3c786055b9]: (4, ('- - 0', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:14:58 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-20cc1317-29cc-45c9-bede-2a37b06896f5 tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] Searching for a device in session 46 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75216) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 19:14:58 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-20cc1317-29cc-45c9-bede-2a37b06896f5 tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:9e9fc1b9-d7ca-437d-a0db-f2e0884c3328', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZTcltRko', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 19:14:59 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:14:59 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-20cc1317-29cc-45c9-bede-2a37b06896f5 tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.315s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 19:14:59 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-20cc1317-29cc-45c9-bede-2a37b06896f5 tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] <== connect_volume: return (1318ms) {'type': 'block', 'scsi_wwn': '26561646135666631', 'path': '/dev/sdb'} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 19:14:59 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-20cc1317-29cc-45c9-bede-2a37b06896f5 tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] [instance: 55b7031b-4fd6-4ecb-9130-68110677c7cf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26561646135666631', 'path': '/dev/sdb'} {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 19:14:59 user nova-compute[75216]: DEBUG nova.objects.instance [None req-20cc1317-29cc-45c9-bede-2a37b06896f5 tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] Lazy-loading 'flavor' on Instance uuid 55b7031b-4fd6-4ecb-9130-68110677c7cf {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:14:59 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-20cc1317-29cc-45c9-bede-2a37b06896f5 tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] attach device xml: <disk type="block" device="disk">
Nov 13 19:14:59 user nova-compute[75216]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 19:14:59 user nova-compute[75216]:   <source dev="/dev/sdb"/>
Nov 13 19:14:59 user nova-compute[75216]:   <target dev="vdc" bus="virtio"/>
Nov 13 19:14:59 user nova-compute[75216]:   <serial>9e9fc1b9-d7ca-437d-a0db-f2e0884c3328</serial>
Nov 13 19:14:59 user nova-compute[75216]: </disk>
Nov 13 19:14:59 user nova-compute[75216]:  {{(pid=75216) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 13 19:14:59 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-353c4c12-aad4-4825-a479-baeb816bb040 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Acquiring lock "b048c677-85bf-4a93-88eb-c71bde27bf5b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:14:59 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-353c4c12-aad4-4825-a479-baeb816bb040 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Lock "b048c677-85bf-4a93-88eb-c71bde27bf5b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:14:59 user nova-compute[75216]: DEBUG nova.objects.instance [None req-353c4c12-aad4-4825-a479-baeb816bb040 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Lazy-loading 'flavor' on Instance uuid b048c677-85bf-4a93-88eb-c71bde27bf5b {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:15:00 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-353c4c12-aad4-4825-a479-baeb816bb040 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Lock "b048c677-85bf-4a93-88eb-c71bde27bf5b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.047s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:15:00 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-20cc1317-29cc-45c9-bede-2a37b06896f5 tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 19:15:00 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-20cc1317-29cc-45c9-bede-2a37b06896f5 tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 19:15:00 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-20cc1317-29cc-45c9-bede-2a37b06896f5 tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 19:15:00 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-20cc1317-29cc-45c9-bede-2a37b06896f5 tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] No VIF found with MAC fa:16:3e:92:1e:27, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 19:15:00 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-353c4c12-aad4-4825-a479-baeb816bb040 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Acquiring lock "b048c677-85bf-4a93-88eb-c71bde27bf5b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:15:00 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-353c4c12-aad4-4825-a479-baeb816bb040 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Lock "b048c677-85bf-4a93-88eb-c71bde27bf5b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:15:00 user nova-compute[75216]: INFO nova.compute.manager [None req-353c4c12-aad4-4825-a479-baeb816bb040 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] [instance: b048c677-85bf-4a93-88eb-c71bde27bf5b] Attaching volume 8ce26031-aafa-4026-8ea9-3de9e9c348ec to /dev/vdb
Nov 13 19:15:00 user nova-compute[75216]: DEBUG os_brick.utils [None req-353c4c12-aad4-4825-a479-baeb816bb040 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 19:15:00 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:15:00 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:15:00 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[48cd225e-3a39-4e15-bb30-03aa076dd8df]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aea6fcfe14b9\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:15:00 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-20cc1317-29cc-45c9-bede-2a37b06896f5 tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] Lock "55b7031b-4fd6-4ecb-9130-68110677c7cf" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.279s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:15:00 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:15:00 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:15:00 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ef9c434-1aec-42d5-9c1a-4f0a4f6f6931]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:15:00 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:15:00 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:15:00 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c4c5c1e-a87c-4f0f-b45d-00d810c8d451]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:15:00 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce7c1036-194f-4d6c-87ca-e81f044d0cad]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:15:00 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-353c4c12-aad4-4825-a479-baeb816bb040 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Running cmd (subprocess): nvme version {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:15:00 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-353c4c12-aad4-4825-a479-baeb816bb040 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] 'nvme version' failed. Not Retrying. {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 19:15:00 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.nvmeof [None req-353c4c12-aad4-4825-a479-baeb816bb040 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] nvme not present on system {{(pid=75216) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 19:15:00 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:15:00 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 19:15:00 user nova-compute[75216]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 19:15:00 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b61bd5a-4718-41e0-a19f-e8549723e28f]: (4, '') {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:15:00 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-353c4c12-aad4-4825-a479-baeb816bb040 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75216) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 19:15:00 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-353c4c12-aad4-4825-a479-baeb816bb040 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 19:15:00 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-353c4c12-aad4-4825-a479-baeb816bb040 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] LIGHTOS: no hostnqn found. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 19:15:00 user nova-compute[75216]: DEBUG os_brick.utils [None req-353c4c12-aad4-4825-a479-baeb816bb040 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aea6fcfe14b9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 19:15:00 user nova-compute[75216]: DEBUG nova.virt.block_device [None req-353c4c12-aad4-4825-a479-baeb816bb040 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] [instance: b048c677-85bf-4a93-88eb-c71bde27bf5b] Updating existing volume attachment record: afb5f7e6-d282-4bec-b6fd-6be75831549d {{(pid=75216) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 19:15:00 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:15:00 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-dd6a79f7-667d-4f30-a4cf-cf27ced21cd9 tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] Acquiring lock "55b7031b-4fd6-4ecb-9130-68110677c7cf" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:15:00 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-dd6a79f7-667d-4f30-a4cf-cf27ced21cd9 tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] Lock "55b7031b-4fd6-4ecb-9130-68110677c7cf" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:15:00 user nova-compute[75216]: INFO nova.compute.manager [None req-dd6a79f7-667d-4f30-a4cf-cf27ced21cd9 tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] [instance: 55b7031b-4fd6-4ecb-9130-68110677c7cf] Detaching volume 9e9fc1b9-d7ca-437d-a0db-f2e0884c3328
Nov 13 19:15:00 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:15:01 user nova-compute[75216]: INFO nova.virt.block_device [None req-dd6a79f7-667d-4f30-a4cf-cf27ced21cd9 tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] [instance: 55b7031b-4fd6-4ecb-9130-68110677c7cf] Attempting to driver detach volume 9e9fc1b9-d7ca-437d-a0db-f2e0884c3328 from mountpoint /dev/vdc
Nov 13 19:15:01 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-dd6a79f7-667d-4f30-a4cf-cf27ced21cd9 tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] Attempting to detach device vdc from instance 55b7031b-4fd6-4ecb-9130-68110677c7cf from the persistent domain config. {{(pid=75216) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 13 19:15:01 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-dd6a79f7-667d-4f30-a4cf-cf27ced21cd9 tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 19:15:01 user nova-compute[75216]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 19:15:01 user nova-compute[75216]:   <source dev="/dev/sdb"/>
Nov 13 19:15:01 user nova-compute[75216]:   <target dev="vdc" bus="virtio"/>
Nov 13 19:15:01 user nova-compute[75216]:   <serial>9e9fc1b9-d7ca-437d-a0db-f2e0884c3328</serial>
Nov 13 19:15:01 user nova-compute[75216]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 13 19:15:01 user nova-compute[75216]: </disk>
Nov 13 19:15:01 user nova-compute[75216]:  {{(pid=75216) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 19:15:01 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-dd6a79f7-667d-4f30-a4cf-cf27ced21cd9 tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] Successfully detached device vdc from instance 55b7031b-4fd6-4ecb-9130-68110677c7cf from the persistent domain config.
Nov 13 19:15:01 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-dd6a79f7-667d-4f30-a4cf-cf27ced21cd9 tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 55b7031b-4fd6-4ecb-9130-68110677c7cf from the live domain config. {{(pid=75216) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 13 19:15:01 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-dd6a79f7-667d-4f30-a4cf-cf27ced21cd9 tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 19:15:01 user nova-compute[75216]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 19:15:01 user nova-compute[75216]:   <source dev="/dev/sdb"/>
Nov 13 19:15:01 user nova-compute[75216]:   <target dev="vdc" bus="virtio"/>
Nov 13 19:15:01 user nova-compute[75216]:   <serial>9e9fc1b9-d7ca-437d-a0db-f2e0884c3328</serial>
Nov 13 19:15:01 user nova-compute[75216]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 13 19:15:01 user nova-compute[75216]: </disk>
Nov 13 19:15:01 user nova-compute[75216]:  {{(pid=75216) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 19:15:01 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-dd6a79f7-667d-4f30-a4cf-cf27ced21cd9 tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 55b7031b-4fd6-4ecb-9130-68110677c7cf {{(pid=75216) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 13 19:15:02 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:15:04 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:15:04 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-353c4c12-aad4-4825-a479-baeb816bb040 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] [instance: b048c677-85bf-4a93-88eb-c71bde27bf5b] Calling os-brick to attach iSCSI Volume {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 19:15:04 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-353c4c12-aad4-4825-a479-baeb816bb040 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3a8669e40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8ce26031-aafa-4026-8ea9-3de9e9c348ec', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'srHqJFku', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 19:15:04 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-353c4c12-aad4-4825-a479-baeb816bb040 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 19:15:04 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-353c4c12-aad4-4825-a479-baeb816bb040 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 19:15:04 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-353c4c12-aad4-4825-a479-baeb816bb040 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 19:15:04 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-353c4c12-aad4-4825-a479-baeb816bb040 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 19:15:04 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-353c4c12-aad4-4825-a479-baeb816bb040 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8ce26031-aafa-4026-8ea9-3de9e9c348ec" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 19:15:04 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-353c4c12-aad4-4825-a479-baeb816bb040 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8ce26031-aafa-4026-8ea9-3de9e9c348ec" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 19:15:04 user nova-compute[75216]: INFO os_brick.initiator.connectors.iscsi [None req-353c4c12-aad4-4825-a479-baeb816bb040 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 19:15:04 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ce26031-aafa-4026-8ea9-3de9e9c348ec -p 172.16.0.220:3260 {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:15:04 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ce26031-aafa-4026-8ea9-3de9e9c348ec -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:15:04 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2aa483f-855b-4e3b-9266-d52b2819d63f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:15:04 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-353c4c12-aad4-4825-a479-baeb816bb040 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 19:15:04 user nova-compute[75216]:  {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:15:04 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ce26031-aafa-4026-8ea9-3de9e9c348ec -p 172.16.0.220:3260 --interface default --op new {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:15:04 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ce26031-aafa-4026-8ea9-3de9e9c348ec -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:15:04 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[75d23c33-2752-4d32-aa13-45c1aeaaf27a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8ce26031-aafa-4026-8ea9-3de9e9c348ec] added\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:15:04 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-353c4c12-aad4-4825-a479-baeb816bb040 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8ce26031-aafa-4026-8ea9-3de9e9c348ec] added
Nov 13 19:15:04 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:15:04 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ce26031-aafa-4026-8ea9-3de9e9c348ec -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:15:04 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ce26031-aafa-4026-8ea9-3de9e9c348ec -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:15:04 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d6b2554-8dae-4d74-84ed-d70d9c02fe55]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:15:04 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-353c4c12-aad4-4825-a479-baeb816bb040 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:15:04 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ce26031-aafa-4026-8ea9-3de9e9c348ec -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:15:04 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ce26031-aafa-4026-8ea9-3de9e9c348ec -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:15:04 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[27c23f1d-6ee0-4e46-bf30-054b686639eb]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:15:04 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-353c4c12-aad4-4825-a479-baeb816bb040 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:15:04 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ce26031-aafa-4026-8ea9-3de9e9c348ec -p 172.16.0.220:3260 --op update -n node.session.auth.username -v srHqJFku {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:15:04 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ce26031-aafa-4026-8ea9-3de9e9c348ec -p 172.16.0.220:3260 --op update -n node.session.auth.username -v srHqJFku" returned: 0 in 0.019s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:15:04 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[10d6fdea-1e8d-4673-a308-7ca7e89f6f53]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:15:04 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-353c4c12-aad4-4825-a479-baeb816bb040 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'srHqJFku'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:15:04 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ce26031-aafa-4026-8ea9-3de9e9c348ec -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:15:04 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ce26031-aafa-4026-8ea9-3de9e9c348ec -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:15:04 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[a723c809-2337-463d-a7b4-f5c150928cff]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:15:04 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-353c4c12-aad4-4825-a479-baeb816bb040 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:15:04 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:15:04 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:15:04 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[d057d014-7a43-4c99-8023-b5f6406e3423]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d08b68b4-6f2a-4b70-a1fb-b49c3052b0f5 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87436fbf-6473-4126-b388-247a56d3df9e (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9fc1b9-d7ca-437d-a0db-f2e0884c3328 (non-flash)\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:15:04 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-353c4c12-aad4-4825-a479-baeb816bb040 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d08b68b4-6f2a-4b70-a1fb-b49c3052b0f5 (non-flash)
Nov 13 19:15:04 user nova-compute[75216]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87436fbf-6473-4126-b388-247a56d3df9e (non-flash)
Nov 13 19:15:04 user nova-compute[75216]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9fc1b9-d7ca-437d-a0db-f2e0884c3328 (non-flash)
Nov 13 19:15:04 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 19:15:04 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-353c4c12-aad4-4825-a479-baeb816bb040 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d08b68b4-6f2a-4b70-a1fb-b49c3052b0f5 (non-flash)
Nov 13 19:15:04 user nova-compute[75216]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87436fbf-6473-4126-b388-247a56d3df9e (non-flash)
Nov 13 19:15:04 user nova-compute[75216]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9fc1b9-d7ca-437d-a0db-f2e0884c3328 (non-flash)
Nov 13 19:15:04 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 19:15:04 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ce26031-aafa-4026-8ea9-3de9e9c348ec -p 172.16.0.220:3260 --login {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:15:04 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ce26031-aafa-4026-8ea9-3de9e9c348ec -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:15:04 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[49a03e71-9d14-4c9e-b475-04a7fdc21614]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8ce26031-aafa-4026-8ea9-3de9e9c348ec, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8ce26031-aafa-4026-8ea9-3de9e9c348ec, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:15:04 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-353c4c12-aad4-4825-a479-baeb816bb040 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8ce26031-aafa-4026-8ea9-3de9e9c348ec, portal: 172.16.0.220,3260]
Nov 13 19:15:04 user nova-compute[75216]: Login to [iface: default, target: iqn.2010-10.org.openstack:8ce26031-aafa-4026-8ea9-3de9e9c348ec, portal: 172.16.0.220,3260] successful.
Nov 13 19:15:04 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:15:04 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ce26031-aafa-4026-8ea9-3de9e9c348ec -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:15:04 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ce26031-aafa-4026-8ea9-3de9e9c348ec -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:15:04 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[51942af1-2e9c-47f7-aaf8-de62e090b2f1]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:15:04 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-353c4c12-aad4-4825-a479-baeb816bb040 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:15:04 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:15:04 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:15:04 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1b6eea4-354f-40ab-987d-577e8499ed3d]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d08b68b4-6f2a-4b70-a1fb-b49c3052b0f5 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87436fbf-6473-4126-b388-247a56d3df9e (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9fc1b9-d7ca-437d-a0db-f2e0884c3328 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ce26031-aafa-4026-8ea9-3de9e9c348ec (non-flash)\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:15:04 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-353c4c12-aad4-4825-a479-baeb816bb040 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d08b68b4-6f2a-4b70-a1fb-b49c3052b0f5 (non-flash)
Nov 13 19:15:04 user nova-compute[75216]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87436fbf-6473-4126-b388-247a56d3df9e (non-flash)
Nov 13 19:15:04 user nova-compute[75216]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9fc1b9-d7ca-437d-a0db-f2e0884c3328 (non-flash)
Nov 13 19:15:04 user nova-compute[75216]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ce26031-aafa-4026-8ea9-3de9e9c348ec (non-flash)
Nov 13 19:15:04 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 19:15:04 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-353c4c12-aad4-4825-a479-baeb816bb040 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d08b68b4-6f2a-4b70-a1fb-b49c3052b0f5 (non-flash)
Nov 13 19:15:04 user nova-compute[75216]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87436fbf-6473-4126-b388-247a56d3df9e (non-flash)
Nov 13 19:15:04 user nova-compute[75216]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9fc1b9-d7ca-437d-a0db-f2e0884c3328 (non-flash)
Nov 13 19:15:04 user nova-compute[75216]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ce26031-aafa-4026-8ea9-3de9e9c348ec (non-flash)
Nov 13 19:15:04 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 19:15:04 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-353c4c12-aad4-4825-a479-baeb816bb040 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8ce26031-aafa-4026-8ea9-3de9e9c348ec" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.275s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 19:15:04 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-353c4c12-aad4-4825-a479-baeb816bb040 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Connected to 172.16.0.220:3260 {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 19:15:04 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-353c4c12-aad4-4825-a479-baeb816bb040 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] HCTL ('36', '-', '-', 0) found on session 47 with lun 0 {{(pid=75216) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 19:15:04 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-353c4c12-aad4-4825-a479-baeb816bb040 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75216) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 19:15:04 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:15:04 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:15:04 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[d482cdf3-afcb-45b2-9f53-e14c2bda3f13]: (4, ('- - 0', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:15:04 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-353c4c12-aad4-4825-a479-baeb816bb040 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Searching for a device in session 47 and hctl ['36', '*', '*', 0] yield: None {{(pid=75216) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 19:15:05 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:15:05 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-353c4c12-aad4-4825-a479-baeb816bb040 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Searching for a device in session 47 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75216) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 19:15:05 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-353c4c12-aad4-4825-a479-baeb816bb040 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:8ce26031-aafa-4026-8ea9-3de9e9c348ec', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'srHqJFku', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 19:15:05 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-353c4c12-aad4-4825-a479-baeb816bb040 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.306s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 19:15:05 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-353c4c12-aad4-4825-a479-baeb816bb040 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] <== connect_volume: return (1307ms) {'type': 'block', 'scsi_wwn': '23164653465376662', 'path': '/dev/sde'} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 19:15:05 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-353c4c12-aad4-4825-a479-baeb816bb040 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] [instance: b048c677-85bf-4a93-88eb-c71bde27bf5b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23164653465376662', 'path': '/dev/sde'} {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 19:15:05 user nova-compute[75216]: DEBUG nova.objects.instance [None req-353c4c12-aad4-4825-a479-baeb816bb040 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Lazy-loading 'flavor' on Instance uuid b048c677-85bf-4a93-88eb-c71bde27bf5b {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:15:05 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-353c4c12-aad4-4825-a479-baeb816bb040 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] attach device xml: <disk type="block" device="disk">
Nov 13 19:15:05 user nova-compute[75216]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 19:15:05 user nova-compute[75216]:   <source dev="/dev/sde"/>
Nov 13 19:15:05 user nova-compute[75216]:   <target dev="vdb" bus="virtio"/>
Nov 13 19:15:05 user nova-compute[75216]:   <serial>8ce26031-aafa-4026-8ea9-3de9e9c348ec</serial>
Nov 13 19:15:05 user nova-compute[75216]: </disk>
Nov 13 19:15:05 user nova-compute[75216]:  {{(pid=75216) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 13 19:15:06 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-353c4c12-aad4-4825-a479-baeb816bb040 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 19:15:06 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-353c4c12-aad4-4825-a479-baeb816bb040 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 19:15:06 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-353c4c12-aad4-4825-a479-baeb816bb040 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] No VIF found with MAC fa:16:3e:1a:59:bc, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 19:15:06 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-353c4c12-aad4-4825-a479-baeb816bb040 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Lock "b048c677-85bf-4a93-88eb-c71bde27bf5b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 5.990s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:15:06 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:15:07 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:15:07 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:15:08 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:15:08 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:15:08 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75216) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 19:15:09 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c3da6eeb-703c-4bfb-a509-c2308e7de896 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Acquiring lock "faa24a4e-f363-4649-a846-7e215ad027f0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:15:09 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c3da6eeb-703c-4bfb-a509-c2308e7de896 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Lock "faa24a4e-f363-4649-a846-7e215ad027f0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:15:09 user nova-compute[75216]: DEBUG nova.compute.manager [None req-c3da6eeb-703c-4bfb-a509-c2308e7de896 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] [instance: faa24a4e-f363-4649-a846-7e215ad027f0] Starting instance... {{(pid=75216) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 19:15:09 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c3da6eeb-703c-4bfb-a509-c2308e7de896 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:15:09 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c3da6eeb-703c-4bfb-a509-c2308e7de896 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:15:09 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-c3da6eeb-703c-4bfb-a509-c2308e7de896 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75216) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 19:15:09 user nova-compute[75216]: INFO nova.compute.claims [None req-c3da6eeb-703c-4bfb-a509-c2308e7de896 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] [instance: faa24a4e-f363-4649-a846-7e215ad027f0] Claim successful on node user
Nov 13 19:15:09 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:15:09 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:15:09 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-c3da6eeb-703c-4bfb-a509-c2308e7de896 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 19:15:09 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-c3da6eeb-703c-4bfb-a509-c2308e7de896 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 19:15:09 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c3da6eeb-703c-4bfb-a509-c2308e7de896 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.327s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:15:09 user nova-compute[75216]: DEBUG nova.compute.manager [None req-c3da6eeb-703c-4bfb-a509-c2308e7de896 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] [instance: faa24a4e-f363-4649-a846-7e215ad027f0] Start building networks asynchronously for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 19:15:09 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.263s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:15:09 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:15:09 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Auditing locally available compute resources for user (node: user) {{(pid=75216) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 19:15:09 user nova-compute[75216]: DEBUG nova.compute.manager [None req-c3da6eeb-703c-4bfb-a509-c2308e7de896 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] [instance: faa24a4e-f363-4649-a846-7e215ad027f0] Allocating IP information in the background. {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 19:15:09 user nova-compute[75216]: DEBUG nova.network.neutron [None req-c3da6eeb-703c-4bfb-a509-c2308e7de896 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] [instance: faa24a4e-f363-4649-a846-7e215ad027f0] allocate_for_instance() {{(pid=75216) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 19:15:09 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-c3da6eeb-703c-4bfb-a509-c2308e7de896 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] [instance: faa24a4e-f363-4649-a846-7e215ad027f0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 19:15:09 user nova-compute[75216]: DEBUG nova.compute.manager [None req-c3da6eeb-703c-4bfb-a509-c2308e7de896 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] [instance: faa24a4e-f363-4649-a846-7e215ad027f0] Start building block device mappings for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 19:15:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aca6edce-d579-4375-9bcd-2ba4d645b894/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:15:09 user nova-compute[75216]: DEBUG nova.policy [None req-c3da6eeb-703c-4bfb-a509-c2308e7de896 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1ca750d884c3403394b46f53fbd633a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06cae29094846f1817036dc761a565d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75216) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 19:15:09 user nova-compute[75216]: DEBUG nova.compute.manager [None req-c3da6eeb-703c-4bfb-a509-c2308e7de896 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] [instance: faa24a4e-f363-4649-a846-7e215ad027f0] Start spawning the instance on the hypervisor. {{(pid=75216) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 19:15:09 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-c3da6eeb-703c-4bfb-a509-c2308e7de896 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] [instance: faa24a4e-f363-4649-a846-7e215ad027f0] Creating instance directory {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 19:15:09 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-c3da6eeb-703c-4bfb-a509-c2308e7de896 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] [instance: faa24a4e-f363-4649-a846-7e215ad027f0] Creating image(s)
Nov 13 19:15:09 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c3da6eeb-703c-4bfb-a509-c2308e7de896 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Acquiring lock "/opt/stack/data/nova/instances/faa24a4e-f363-4649-a846-7e215ad027f0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:15:09 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c3da6eeb-703c-4bfb-a509-c2308e7de896 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Lock "/opt/stack/data/nova/instances/faa24a4e-f363-4649-a846-7e215ad027f0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:15:09 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c3da6eeb-703c-4bfb-a509-c2308e7de896 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Lock "/opt/stack/data/nova/instances/faa24a4e-f363-4649-a846-7e215ad027f0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:15:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-c3da6eeb-703c-4bfb-a509-c2308e7de896 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:15:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aca6edce-d579-4375-9bcd-2ba4d645b894/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:15:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aca6edce-d579-4375-9bcd-2ba4d645b894/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:15:10 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-c3da6eeb-703c-4bfb-a509-c2308e7de896 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json" returned: 0 in 0.186s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:15:10 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c3da6eeb-703c-4bfb-a509-c2308e7de896 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Acquiring lock "88c50a45bec9d6b0427462b3242b9b8e5f49c2b6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:15:10 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c3da6eeb-703c-4bfb-a509-c2308e7de896 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Lock "88c50a45bec9d6b0427462b3242b9b8e5f49c2b6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:15:10 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-c3da6eeb-703c-4bfb-a509-c2308e7de896 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:15:10 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aca6edce-d579-4375-9bcd-2ba4d645b894/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:15:10 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b048c677-85bf-4a93-88eb-c71bde27bf5b/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:15:10 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-c3da6eeb-703c-4bfb-a509-c2308e7de896 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json" returned: 0 in 0.183s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:15:10 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-c3da6eeb-703c-4bfb-a509-c2308e7de896 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6,backing_fmt=raw /opt/stack/data/nova/instances/faa24a4e-f363-4649-a846-7e215ad027f0/disk 1073741824 {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:15:10 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-c3da6eeb-703c-4bfb-a509-c2308e7de896 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6,backing_fmt=raw /opt/stack/data/nova/instances/faa24a4e-f363-4649-a846-7e215ad027f0/disk 1073741824" returned: 0 in 0.047s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:15:10 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c3da6eeb-703c-4bfb-a509-c2308e7de896 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Lock "88c50a45bec9d6b0427462b3242b9b8e5f49c2b6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.237s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:15:10 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-c3da6eeb-703c-4bfb-a509-c2308e7de896 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:15:10 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b048c677-85bf-4a93-88eb-c71bde27bf5b/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:15:10 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b048c677-85bf-4a93-88eb-c71bde27bf5b/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:15:10 user nova-compute[75216]: DEBUG nova.network.neutron [None req-c3da6eeb-703c-4bfb-a509-c2308e7de896 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] [instance: faa24a4e-f363-4649-a846-7e215ad027f0] Successfully created port: 721b085e-01c3-449a-b794-6251a01b4af2 {{(pid=75216) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 19:15:10 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-c3da6eeb-703c-4bfb-a509-c2308e7de896 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json" returned: 0 in 0.195s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:15:10 user nova-compute[75216]: DEBUG nova.virt.disk.api [None req-c3da6eeb-703c-4bfb-a509-c2308e7de896 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Checking if we can resize image /opt/stack/data/nova/instances/faa24a4e-f363-4649-a846-7e215ad027f0/disk. size=1073741824 {{(pid=75216) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 19:15:10 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-c3da6eeb-703c-4bfb-a509-c2308e7de896 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faa24a4e-f363-4649-a846-7e215ad027f0/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:15:10 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:15:10 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b048c677-85bf-4a93-88eb-c71bde27bf5b/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:15:10 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 19:15:10 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e47d802-efdb-4763-8594-1ad056dbf6cc/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:15:10 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-c3da6eeb-703c-4bfb-a509-c2308e7de896 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faa24a4e-f363-4649-a846-7e215ad027f0/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:15:10 user nova-compute[75216]: DEBUG nova.virt.disk.api [None req-c3da6eeb-703c-4bfb-a509-c2308e7de896 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Cannot resize image /opt/stack/data/nova/instances/faa24a4e-f363-4649-a846-7e215ad027f0/disk to a smaller size. {{(pid=75216) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 19:15:10 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-c3da6eeb-703c-4bfb-a509-c2308e7de896 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] [instance: faa24a4e-f363-4649-a846-7e215ad027f0] Created local disks {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 19:15:10 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-c3da6eeb-703c-4bfb-a509-c2308e7de896 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] [instance: faa24a4e-f363-4649-a846-7e215ad027f0] Ensure instance console log exists: /opt/stack/data/nova/instances/faa24a4e-f363-4649-a846-7e215ad027f0/console.log {{(pid=75216) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 19:15:10 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c3da6eeb-703c-4bfb-a509-c2308e7de896 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:15:10 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c3da6eeb-703c-4bfb-a509-c2308e7de896 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:15:10 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c3da6eeb-703c-4bfb-a509-c2308e7de896 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:15:10 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e47d802-efdb-4763-8594-1ad056dbf6cc/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:15:10 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e47d802-efdb-4763-8594-1ad056dbf6cc/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:15:10 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e47d802-efdb-4763-8594-1ad056dbf6cc/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:15:10 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55b7031b-4fd6-4ecb-9130-68110677c7cf/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:15:11 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55b7031b-4fd6-4ecb-9130-68110677c7cf/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:15:11 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55b7031b-4fd6-4ecb-9130-68110677c7cf/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:15:11 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55b7031b-4fd6-4ecb-9130-68110677c7cf/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:15:11 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 19:15:11 user nova-compute[75216]: DEBUG nova.network.neutron [None req-c3da6eeb-703c-4bfb-a509-c2308e7de896 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] [instance: faa24a4e-f363-4649-a846-7e215ad027f0] Successfully updated port: 721b085e-01c3-449a-b794-6251a01b4af2 {{(pid=75216) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 19:15:11 user nova-compute[75216]: DEBUG nova.compute.manager [req-94873867-b445-4893-9038-6e785bb717ad req-e05a1226-d144-4a5c-b612-148529192f67 service nova] [instance: faa24a4e-f363-4649-a846-7e215ad027f0] Received event network-changed-721b085e-01c3-449a-b794-6251a01b4af2 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:15:11 user nova-compute[75216]: DEBUG nova.compute.manager [req-94873867-b445-4893-9038-6e785bb717ad req-e05a1226-d144-4a5c-b612-148529192f67 service nova] [instance: faa24a4e-f363-4649-a846-7e215ad027f0] Refreshing instance network info cache due to event network-changed-721b085e-01c3-449a-b794-6251a01b4af2. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 19:15:11 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-94873867-b445-4893-9038-6e785bb717ad req-e05a1226-d144-4a5c-b612-148529192f67 service nova] Acquiring lock "refresh_cache-faa24a4e-f363-4649-a846-7e215ad027f0" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 19:15:11 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-94873867-b445-4893-9038-6e785bb717ad req-e05a1226-d144-4a5c-b612-148529192f67 service nova] Acquired lock "refresh_cache-faa24a4e-f363-4649-a846-7e215ad027f0" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 19:15:11 user nova-compute[75216]: DEBUG nova.network.neutron [req-94873867-b445-4893-9038-6e785bb717ad req-e05a1226-d144-4a5c-b612-148529192f67 service nova] [instance: faa24a4e-f363-4649-a846-7e215ad027f0] Refreshing network info cache for port 721b085e-01c3-449a-b794-6251a01b4af2 {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 19:15:11 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 19:15:11 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 19:15:11 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Hypervisor/Node resource view: name=user free_ram=8565MB free_disk=25.28707504272461GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75216) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 19:15:11 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:15:11 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:15:11 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c3da6eeb-703c-4bfb-a509-c2308e7de896 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Acquiring lock "refresh_cache-faa24a4e-f363-4649-a846-7e215ad027f0" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 19:15:11 user nova-compute[75216]: DEBUG nova.network.neutron [req-94873867-b445-4893-9038-6e785bb717ad req-e05a1226-d144-4a5c-b612-148529192f67 service nova] [instance: faa24a4e-f363-4649-a846-7e215ad027f0] Instance cache missing network info. {{(pid=75216) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 19:15:11 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance 9e47d802-efdb-4763-8594-1ad056dbf6cc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 19:15:11 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance 55b7031b-4fd6-4ecb-9130-68110677c7cf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 19:15:11 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance b048c677-85bf-4a93-88eb-c71bde27bf5b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 19:15:11 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance aca6edce-d579-4375-9bcd-2ba4d645b894 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 19:15:11 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance faa24a4e-f363-4649-a846-7e215ad027f0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 19:15:11 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 19:15:11 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 19:15:11 user nova-compute[75216]: DEBUG nova.network.neutron [req-94873867-b445-4893-9038-6e785bb717ad req-e05a1226-d144-4a5c-b612-148529192f67 service nova] [instance: faa24a4e-f363-4649-a846-7e215ad027f0] Updating instance_info_cache with network_info: [] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:15:11 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-94873867-b445-4893-9038-6e785bb717ad req-e05a1226-d144-4a5c-b612-148529192f67 service nova] Releasing lock "refresh_cache-faa24a4e-f363-4649-a846-7e215ad027f0" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 19:15:11 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c3da6eeb-703c-4bfb-a509-c2308e7de896 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Acquired lock "refresh_cache-faa24a4e-f363-4649-a846-7e215ad027f0" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 19:15:11 user nova-compute[75216]: DEBUG nova.network.neutron [None req-c3da6eeb-703c-4bfb-a509-c2308e7de896 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] [instance: faa24a4e-f363-4649-a846-7e215ad027f0] Building network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 19:15:11 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 19:15:11 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 19:15:11 user nova-compute[75216]: DEBUG nova.network.neutron [None req-c3da6eeb-703c-4bfb-a509-c2308e7de896 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] [instance: faa24a4e-f363-4649-a846-7e215ad027f0] Instance cache missing network info. {{(pid=75216) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 19:15:11 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Compute_service record updated for user:user {{(pid=75216) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 19:15:11 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.303s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:15:12 user nova-compute[75216]: DEBUG nova.network.neutron [None req-c3da6eeb-703c-4bfb-a509-c2308e7de896 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] [instance: faa24a4e-f363-4649-a846-7e215ad027f0] Updating instance_info_cache with network_info: [{"id": "721b085e-01c3-449a-b794-6251a01b4af2", "address": "fa:16:3e:86:0a:5f", "network": {"id": "9dcbadf2-6b5e-41f1-88a3-17a579ad1bad", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-926239573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d06cae29094846f1817036dc761a565d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap721b085e-01", "ovs_interfaceid": "721b085e-01c3-449a-b794-6251a01b4af2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:15:12 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c3da6eeb-703c-4bfb-a509-c2308e7de896 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Releasing lock "refresh_cache-faa24a4e-f363-4649-a846-7e215ad027f0" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 19:15:12 user nova-compute[75216]: DEBUG nova.compute.manager [None req-c3da6eeb-703c-4bfb-a509-c2308e7de896 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] [instance: faa24a4e-f363-4649-a846-7e215ad027f0] Instance network_info: |[{"id": "721b085e-01c3-449a-b794-6251a01b4af2", "address": "fa:16:3e:86:0a:5f", "network": {"id": "9dcbadf2-6b5e-41f1-88a3-17a579ad1bad", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-926239573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d06cae29094846f1817036dc761a565d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap721b085e-01", "ovs_interfaceid": "721b085e-01c3-449a-b794-6251a01b4af2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 19:15:12 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-c3da6eeb-703c-4bfb-a509-c2308e7de896 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] [instance: faa24a4e-f363-4649-a846-7e215ad027f0] Start _get_guest_xml network_info=[{"id": "721b085e-01c3-449a-b794-6251a01b4af2", "address": "fa:16:3e:86:0a:5f", "network": {"id": "9dcbadf2-6b5e-41f1-88a3-17a579ad1bad", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-926239573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d06cae29094846f1817036dc761a565d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap721b085e-01", "ovs_interfaceid": "721b085e-01c3-449a-b794-6251a01b4af2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T18:41:06Z,direct_url=<?>,disk_format='qcow2',id=77bcb5ba-8510-41ec-a88d-96097bb431de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c465b7c26ec44582b6d1b7169536ecc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T18:41:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'guest_format': None, 'boot_index': 0, 'image_id': '77bcb5ba-8510-41ec-a88d-96097bb431de'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 19:15:12 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-c3da6eeb-703c-4bfb-a509-c2308e7de896 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 19:15:12 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-c3da6eeb-703c-4bfb-a509-c2308e7de896 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 19:15:12 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-c3da6eeb-703c-4bfb-a509-c2308e7de896 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 19:15:12 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-c3da6eeb-703c-4bfb-a509-c2308e7de896 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] CPU controller missing on host. {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 19:15:12 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-c3da6eeb-703c-4bfb-a509-c2308e7de896 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 19:15:12 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-c3da6eeb-703c-4bfb-a509-c2308e7de896 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] CPU controller found on host. {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 19:15:12 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-c3da6eeb-703c-4bfb-a509-c2308e7de896 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75216) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 19:15:12 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-c3da6eeb-703c-4bfb-a509-c2308e7de896 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T18:40:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T18:41:06Z,direct_url=<?>,disk_format='qcow2',id=77bcb5ba-8510-41ec-a88d-96097bb431de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c465b7c26ec44582b6d1b7169536ecc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T18:41:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 19:15:12 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-c3da6eeb-703c-4bfb-a509-c2308e7de896 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Flavor limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 19:15:12 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-c3da6eeb-703c-4bfb-a509-c2308e7de896 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Image limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 19:15:12 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-c3da6eeb-703c-4bfb-a509-c2308e7de896 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Flavor pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 19:15:12 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-c3da6eeb-703c-4bfb-a509-c2308e7de896 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Image pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 19:15:12 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-c3da6eeb-703c-4bfb-a509-c2308e7de896 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 19:15:12 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-c3da6eeb-703c-4bfb-a509-c2308e7de896 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 19:15:12 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-c3da6eeb-703c-4bfb-a509-c2308e7de896 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 19:15:12 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-c3da6eeb-703c-4bfb-a509-c2308e7de896 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Got 1 possible topologies {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 19:15:12 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-c3da6eeb-703c-4bfb-a509-c2308e7de896 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 19:15:12 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-c3da6eeb-703c-4bfb-a509-c2308e7de896 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 19:15:12 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-c3da6eeb-703c-4bfb-a509-c2308e7de896 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T19:15:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1406812321',display_name='tempest-AttachVolumeNegativeTest-server-1406812321',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1406812321',id=40,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBFeoj4ppip0XK8hMdi32G4V8fWtEi9UQvRrb2Rl3NUpfxFyDIcc2cJMQtCigGOaLZHexbyefrnjhU00kGTyX73AjIUdbzBZXHLIe2VvnVosV31eYF0isGj640gDDy+NcA==',key_name='tempest-keypair-1691670434',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d06cae29094846f1817036dc761a565d',ramdisk_id='',reservation_id='r-0i72oyl5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1187420962',owner_user_name='tempest-AttachVolumeNegativeTest-1187420962-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T19:15:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1ca750d884c3403394b46f53fbd633a1',uuid=faa24a4e-f363-4649-a846-7e215ad027f0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "721b085e-01c3-449a-b794-6251a01b4af2", "address": "fa:16:3e:86:0a:5f", "network": {"id": "9dcbadf2-6b5e-41f1-88a3-17a579ad1bad", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-926239573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d06cae29094846f1817036dc761a565d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap721b085e-01", "ovs_interfaceid": "721b085e-01c3-449a-b794-6251a01b4af2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75216) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 19:15:12 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-c3da6eeb-703c-4bfb-a509-c2308e7de896 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Converting VIF {"id": "721b085e-01c3-449a-b794-6251a01b4af2", "address": "fa:16:3e:86:0a:5f", "network": {"id": "9dcbadf2-6b5e-41f1-88a3-17a579ad1bad", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-926239573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d06cae29094846f1817036dc761a565d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap721b085e-01", "ovs_interfaceid": "721b085e-01c3-449a-b794-6251a01b4af2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 19:15:12 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-c3da6eeb-703c-4bfb-a509-c2308e7de896 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:0a:5f,bridge_name='br-int',has_traffic_filtering=True,id=721b085e-01c3-449a-b794-6251a01b4af2,network=Network(9dcbadf2-6b5e-41f1-88a3-17a579ad1bad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap721b085e-01') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 19:15:12 user nova-compute[75216]: DEBUG nova.objects.instance [None req-c3da6eeb-703c-4bfb-a509-c2308e7de896 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Lazy-loading 'pci_devices' on Instance uuid faa24a4e-f363-4649-a846-7e215ad027f0 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:15:12 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-c3da6eeb-703c-4bfb-a509-c2308e7de896 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] [instance: faa24a4e-f363-4649-a846-7e215ad027f0] End _get_guest_xml xml=<domain type="kvm">
Nov 13 19:15:12 user nova-compute[75216]:   <uuid>faa24a4e-f363-4649-a846-7e215ad027f0</uuid>
Nov 13 19:15:12 user nova-compute[75216]:   <name>instance-00000028</name>
Nov 13 19:15:12 user nova-compute[75216]:   <memory>524288</memory>
Nov 13 19:15:12 user nova-compute[75216]:   <vcpu>1</vcpu>
Nov 13 19:15:12 user nova-compute[75216]:   <metadata>
Nov 13 19:15:12 user nova-compute[75216]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 19:15:12 user nova-compute[75216]:       <nova:package version="0.0.0"/>
Nov 13 19:15:12 user nova-compute[75216]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1406812321</nova:name>
Nov 13 19:15:12 user nova-compute[75216]:       <nova:creationTime>2023-11-13 19:15:12</nova:creationTime>
Nov 13 19:15:12 user nova-compute[75216]:       <nova:flavor name="m1.tiny">
Nov 13 19:15:12 user nova-compute[75216]:         <nova:memory>512</nova:memory>
Nov 13 19:15:12 user nova-compute[75216]:         <nova:disk>1</nova:disk>
Nov 13 19:15:12 user nova-compute[75216]:         <nova:swap>0</nova:swap>
Nov 13 19:15:12 user nova-compute[75216]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 19:15:12 user nova-compute[75216]:         <nova:vcpus>1</nova:vcpus>
Nov 13 19:15:12 user nova-compute[75216]:       </nova:flavor>
Nov 13 19:15:12 user nova-compute[75216]:       <nova:owner>
Nov 13 19:15:12 user nova-compute[75216]:         <nova:user uuid="1ca750d884c3403394b46f53fbd633a1">tempest-AttachVolumeNegativeTest-1187420962-project-member</nova:user>
Nov 13 19:15:12 user nova-compute[75216]:         <nova:project uuid="d06cae29094846f1817036dc761a565d">tempest-AttachVolumeNegativeTest-1187420962</nova:project>
Nov 13 19:15:12 user nova-compute[75216]:       </nova:owner>
Nov 13 19:15:12 user nova-compute[75216]:       <nova:root type="image" uuid="77bcb5ba-8510-41ec-a88d-96097bb431de"/>
Nov 13 19:15:12 user nova-compute[75216]:       <nova:ports>
Nov 13 19:15:12 user nova-compute[75216]:         <nova:port uuid="721b085e-01c3-449a-b794-6251a01b4af2">
Nov 13 19:15:12 user nova-compute[75216]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 13 19:15:12 user nova-compute[75216]:         </nova:port>
Nov 13 19:15:12 user nova-compute[75216]:       </nova:ports>
Nov 13 19:15:12 user nova-compute[75216]:     </nova:instance>
Nov 13 19:15:12 user nova-compute[75216]:   </metadata>
Nov 13 19:15:12 user nova-compute[75216]:   <sysinfo type="smbios">
Nov 13 19:15:12 user nova-compute[75216]:     <system>
Nov 13 19:15:12 user nova-compute[75216]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 19:15:12 user nova-compute[75216]:       <entry name="product">OpenStack Nova</entry>
Nov 13 19:15:12 user nova-compute[75216]:       <entry name="version">0.0.0</entry>
Nov 13 19:15:12 user nova-compute[75216]:       <entry name="serial">faa24a4e-f363-4649-a846-7e215ad027f0</entry>
Nov 13 19:15:12 user nova-compute[75216]:       <entry name="uuid">faa24a4e-f363-4649-a846-7e215ad027f0</entry>
Nov 13 19:15:12 user nova-compute[75216]:       <entry name="family">Virtual Machine</entry>
Nov 13 19:15:12 user nova-compute[75216]:     </system>
Nov 13 19:15:12 user nova-compute[75216]:   </sysinfo>
Nov 13 19:15:12 user nova-compute[75216]:   <os>
Nov 13 19:15:12 user nova-compute[75216]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 19:15:12 user nova-compute[75216]:     <boot dev="hd"/>
Nov 13 19:15:12 user nova-compute[75216]:     <smbios mode="sysinfo"/>
Nov 13 19:15:12 user nova-compute[75216]:   </os>
Nov 13 19:15:12 user nova-compute[75216]:   <features>
Nov 13 19:15:12 user nova-compute[75216]:     <acpi/>
Nov 13 19:15:12 user nova-compute[75216]:     <apic/>
Nov 13 19:15:12 user nova-compute[75216]:     <vmcoreinfo/>
Nov 13 19:15:12 user nova-compute[75216]:   </features>
Nov 13 19:15:12 user nova-compute[75216]:   <clock offset="utc">
Nov 13 19:15:12 user nova-compute[75216]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 19:15:12 user nova-compute[75216]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 19:15:12 user nova-compute[75216]:     <timer name="hpet" present="no"/>
Nov 13 19:15:12 user nova-compute[75216]:   </clock>
Nov 13 19:15:12 user nova-compute[75216]:   <cpu mode="custom" match="exact">
Nov 13 19:15:12 user nova-compute[75216]:     <model>Nehalem</model>
Nov 13 19:15:12 user nova-compute[75216]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 19:15:12 user nova-compute[75216]:   </cpu>
Nov 13 19:15:12 user nova-compute[75216]:   <devices>
Nov 13 19:15:12 user nova-compute[75216]:     <disk type="file" device="disk">
Nov 13 19:15:12 user nova-compute[75216]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 19:15:12 user nova-compute[75216]:       <source file="/opt/stack/data/nova/instances/faa24a4e-f363-4649-a846-7e215ad027f0/disk"/>
Nov 13 19:15:12 user nova-compute[75216]:       <target dev="vda" bus="virtio"/>
Nov 13 19:15:12 user nova-compute[75216]:     </disk>
Nov 13 19:15:12 user nova-compute[75216]:     <interface type="ethernet">
Nov 13 19:15:12 user nova-compute[75216]:       <mac address="fa:16:3e:86:0a:5f"/>
Nov 13 19:15:12 user nova-compute[75216]:       <model type="virtio"/>
Nov 13 19:15:12 user nova-compute[75216]:       <mtu size="1442"/>
Nov 13 19:15:12 user nova-compute[75216]:       <target dev="tap721b085e-01"/>
Nov 13 19:15:12 user nova-compute[75216]:     </interface>
Nov 13 19:15:12 user nova-compute[75216]:     <serial type="pty">
Nov 13 19:15:12 user nova-compute[75216]:       <log file="/opt/stack/data/nova/instances/faa24a4e-f363-4649-a846-7e215ad027f0/console.log" append="off"/>
Nov 13 19:15:12 user nova-compute[75216]:     </serial>
Nov 13 19:15:12 user nova-compute[75216]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 19:15:12 user nova-compute[75216]:     <video>
Nov 13 19:15:12 user nova-compute[75216]:       <model type="virtio"/>
Nov 13 19:15:12 user nova-compute[75216]:     </video>
Nov 13 19:15:12 user nova-compute[75216]:     <rng model="virtio">
Nov 13 19:15:12 user nova-compute[75216]:       <backend model="random">/dev/urandom</backend>
Nov 13 19:15:12 user nova-compute[75216]:     </rng>
Nov 13 19:15:12 user nova-compute[75216]:     <controller type="usb" index="0" model="none"/>
Nov 13 19:15:12 user nova-compute[75216]:     <memballoon model="virtio">
Nov 13 19:15:12 user nova-compute[75216]:       <stats period="10"/>
Nov 13 19:15:12 user nova-compute[75216]:     </memballoon>
Nov 13 19:15:12 user nova-compute[75216]:   </devices>
Nov 13 19:15:12 user nova-compute[75216]: </domain>
Nov 13 19:15:12 user nova-compute[75216]:  {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 19:15:12 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-c3da6eeb-703c-4bfb-a509-c2308e7de896 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T19:15:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1406812321',display_name='tempest-AttachVolumeNegativeTest-server-1406812321',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1406812321',id=40,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBFeoj4ppip0XK8hMdi32G4V8fWtEi9UQvRrb2Rl3NUpfxFyDIcc2cJMQtCigGOaLZHexbyefrnjhU00kGTyX73AjIUdbzBZXHLIe2VvnVosV31eYF0isGj640gDDy+NcA==',key_name='tempest-keypair-1691670434',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d06cae29094846f1817036dc761a565d',ramdisk_id='',reservation_id='r-0i72oyl5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1187420962',owner_user_name='tempest-AttachVolumeNegativeTest-1187420962-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T19:15:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1ca750d884c3403394b46f53fbd633a1',uuid=faa24a4e-f363-4649-a846-7e215ad027f0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "721b085e-01c3-449a-b794-6251a01b4af2", "address": "fa:16:3e:86:0a:5f", "network": {"id": "9dcbadf2-6b5e-41f1-88a3-17a579ad1bad", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-926239573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d06cae29094846f1817036dc761a565d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap721b085e-01", "ovs_interfaceid": "721b085e-01c3-449a-b794-6251a01b4af2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 19:15:12 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-c3da6eeb-703c-4bfb-a509-c2308e7de896 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Converting VIF {"id": "721b085e-01c3-449a-b794-6251a01b4af2", "address": "fa:16:3e:86:0a:5f", "network": {"id": "9dcbadf2-6b5e-41f1-88a3-17a579ad1bad", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-926239573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d06cae29094846f1817036dc761a565d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap721b085e-01", "ovs_interfaceid": "721b085e-01c3-449a-b794-6251a01b4af2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 19:15:12 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-c3da6eeb-703c-4bfb-a509-c2308e7de896 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:0a:5f,bridge_name='br-int',has_traffic_filtering=True,id=721b085e-01c3-449a-b794-6251a01b4af2,network=Network(9dcbadf2-6b5e-41f1-88a3-17a579ad1bad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap721b085e-01') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 19:15:12 user nova-compute[75216]: DEBUG os_vif [None req-c3da6eeb-703c-4bfb-a509-c2308e7de896 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:0a:5f,bridge_name='br-int',has_traffic_filtering=True,id=721b085e-01c3-449a-b794-6251a01b4af2,network=Network(9dcbadf2-6b5e-41f1-88a3-17a579ad1bad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap721b085e-01') {{(pid=75216) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 19:15:12 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:15:12 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:15:12 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 19:15:12 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:15:12 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '758e17dc-ec43-5ec0-a8fa-4e355e889059', '_type': 'linux-noop'}}, row=False) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:15:12 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:15:12 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:15:12 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:15:12 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap721b085e-01, may_exist=True, interface_attrs={}) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:15:12 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap721b085e-01, col_values=(('qos', UUID('d84736cb-301d-42bd-9ca7-d789d6112ef9')),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:15:12 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap721b085e-01, col_values=(('external_ids', {'iface-id': '721b085e-01c3-449a-b794-6251a01b4af2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:86:0a:5f', 'vm-uuid': 'faa24a4e-f363-4649-a846-7e215ad027f0'}),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:15:12 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:15:12 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:15:12 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:15:12 user nova-compute[75216]: INFO os_vif [None req-c3da6eeb-703c-4bfb-a509-c2308e7de896 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:0a:5f,bridge_name='br-int',has_traffic_filtering=True,id=721b085e-01c3-449a-b794-6251a01b4af2,network=Network(9dcbadf2-6b5e-41f1-88a3-17a579ad1bad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap721b085e-01')
Nov 13 19:15:12 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-c3da6eeb-703c-4bfb-a509-c2308e7de896 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 19:15:12 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-c3da6eeb-703c-4bfb-a509-c2308e7de896 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] No VIF found with MAC fa:16:3e:86:0a:5f, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 19:15:13 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-2d0a9708-cdb9-4a6b-94b4-e4c14f2b2611 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 9e47d802-efdb-4763-8594-1ad056dbf6cc is timed out.
Nov 13 19:15:13 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-2d0a9708-cdb9-4a6b-94b4-e4c14f2b2611 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Successfully detached device vdc from instance 9e47d802-efdb-4763-8594-1ad056dbf6cc from the live domain config.
Nov 13 19:15:13 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d0a9708-cdb9-4a6b-94b4-e4c14f2b2611 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] [instance: 9e47d802-efdb-4763-8594-1ad056dbf6cc] calling os-brick to detach iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 19:15:13 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d0a9708-cdb9-4a6b-94b4-e4c14f2b2611 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3a8669e40>, {'target_iqn': 'iqn.2010-10.org.openstack:d08b68b4-6f2a-4b70-a1fb-b49c3052b0f5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TqlahwMW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 19:15:13 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-2d0a9708-cdb9-4a6b-94b4-e4c14f2b2611 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 19:15:13 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-2d0a9708-cdb9-4a6b-94b4-e4c14f2b2611 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 19:15:13 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-2d0a9708-cdb9-4a6b-94b4-e4c14f2b2611 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 19:15:13 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:15:13 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:15:13 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:15:13 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[94a50fe2-c44c-483e-b2b9-d0f0df2976a4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8ce26031-aafa-4026-8ea9-3de9e9c348ec\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:87436fbf-6473-4126-b388-247a56d3df9e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9e9fc1b9-d7ca-437d-a0db-f2e0884c3328\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d08b68b4-6f2a-4b70-a1fb-b49c3052b0f5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:15:13 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d0a9708-cdb9-4a6b-94b4-e4c14f2b2611 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 19:15:13 user nova-compute[75216]: No targets found.
Nov 13 19:15:13 user nova-compute[75216]: iSNS:
Nov 13 19:15:13 user nova-compute[75216]: No targets found.
Nov 13 19:15:13 user nova-compute[75216]: STATIC:
Nov 13 19:15:13 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:8ce26031-aafa-4026-8ea9-3de9e9c348ec
Nov 13 19:15:13 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 19:15:13 user nova-compute[75216]:                 Iface Name: default
Nov 13 19:15:13 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:87436fbf-6473-4126-b388-247a56d3df9e
Nov 13 19:15:13 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 19:15:13 user nova-compute[75216]:                 Iface Name: default
Nov 13 19:15:13 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:9e9fc1b9-d7ca-437d-a0db-f2e0884c3328
Nov 13 19:15:13 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 19:15:13 user nova-compute[75216]:                 Iface Name: default
Nov 13 19:15:13 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:d08b68b4-6f2a-4b70-a1fb-b49c3052b0f5
Nov 13 19:15:13 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 19:15:13 user nova-compute[75216]:                 Iface Name: default
Nov 13 19:15:13 user nova-compute[75216]: FIRMWARE:
Nov 13 19:15:13 user nova-compute[75216]: No targets found.
Nov 13 19:15:13 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 19:15:13 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d0a9708-cdb9-4a6b-94b4-e4c14f2b2611 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 19:15:13 user nova-compute[75216]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 19:15:13 user nova-compute[75216]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75216) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 19:15:13 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d0a9708-cdb9-4a6b-94b4-e4c14f2b2611 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d08b68b4-6f2a-4b70-a1fb-b49c3052b0f5', 0)] {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 19:15:13 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:15:13 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:15:13 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:15:13 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:15:13 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba7739ea-190e-4aac-8a32-891f34676669]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:87436fbf-6473-4126-b388-247a56d3df9e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8ce26031-aafa-4026-8ea9-3de9e9c348ec\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e9fc1b9-d7ca-437d-a0db-f2e0884c3328\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d08b68b4-6f2a-4b70-a1fb-b49c3052b0f5\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:15:13 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:15:13 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:15:13 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[b48523ce-8d50-49da-97dc-b9a5fbd37248]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d08b68b4-6f2a-4b70-a1fb-b49c3052b0f5 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87436fbf-6473-4126-b388-247a56d3df9e (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9fc1b9-d7ca-437d-a0db-f2e0884c3328 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ce26031-aafa-4026-8ea9-3de9e9c348ec (non-flash)\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:15:13 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d0a9708-cdb9-4a6b-94b4-e4c14f2b2611 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d08b68b4-6f2a-4b70-a1fb-b49c3052b0f5 (non-flash)
Nov 13 19:15:13 user nova-compute[75216]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87436fbf-6473-4126-b388-247a56d3df9e (non-flash)
Nov 13 19:15:13 user nova-compute[75216]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9fc1b9-d7ca-437d-a0db-f2e0884c3328 (non-flash)
Nov 13 19:15:13 user nova-compute[75216]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ce26031-aafa-4026-8ea9-3de9e9c348ec (non-flash)
Nov 13 19:15:13 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 19:15:13 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d0a9708-cdb9-4a6b-94b4-e4c14f2b2611 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d08b68b4-6f2a-4b70-a1fb-b49c3052b0f5 (non-flash)
Nov 13 19:15:13 user nova-compute[75216]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87436fbf-6473-4126-b388-247a56d3df9e (non-flash)
Nov 13 19:15:13 user nova-compute[75216]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9fc1b9-d7ca-437d-a0db-f2e0884c3328 (non-flash)
Nov 13 19:15:13 user nova-compute[75216]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ce26031-aafa-4026-8ea9-3de9e9c348ec (non-flash)
Nov 13 19:15:13 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 19:15:13 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d0a9708-cdb9-4a6b-94b4-e4c14f2b2611 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe3cb5ec670>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d08b68b4-6f2a-4b70-a1fb-b49c3052b0f5'): ({'sdc'}, set())}) {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 19:15:13 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-2d0a9708-cdb9-4a6b-94b4-e4c14f2b2611 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Removing single pathed devices sdc {{(pid=75216) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 19:15:13 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:15:13 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:15:13 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a44d0d5-f182-4d0c-ae81-ece3c3e79467]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:15:13 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:15:13 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:15:13 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[32ccf250-3108-4eed-9dac-febe9382e18d]: (4, ('ok\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:15:13 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-2d0a9708-cdb9-4a6b-94b4-e4c14f2b2611 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Flushing IO for device /dev/sdc {{(pid=75216) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 19:15:13 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:15:13 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:15:13 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[4755175b-ed60-432d-a654-f4da97108c4c]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:15:13 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-2d0a9708-cdb9-4a6b-94b4-e4c14f2b2611 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75216) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 19:15:13 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:15:13 user nova-compute[75216]: DEBUG nova.compute.manager [req-7029a3e0-f14c-4afc-b4e2-cf4d306b7a5a req-8a6dd8fd-164f-480b-8ce8-cd00e18348e7 service nova] [instance: faa24a4e-f363-4649-a846-7e215ad027f0] Received event network-vif-plugged-721b085e-01c3-449a-b794-6251a01b4af2 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:15:13 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-7029a3e0-f14c-4afc-b4e2-cf4d306b7a5a req-8a6dd8fd-164f-480b-8ce8-cd00e18348e7 service nova] Acquiring lock "faa24a4e-f363-4649-a846-7e215ad027f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:15:13 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-7029a3e0-f14c-4afc-b4e2-cf4d306b7a5a req-8a6dd8fd-164f-480b-8ce8-cd00e18348e7 service nova] Lock "faa24a4e-f363-4649-a846-7e215ad027f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:15:13 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-7029a3e0-f14c-4afc-b4e2-cf4d306b7a5a req-8a6dd8fd-164f-480b-8ce8-cd00e18348e7 service nova] Lock "faa24a4e-f363-4649-a846-7e215ad027f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:15:13 user nova-compute[75216]: DEBUG nova.compute.manager [req-7029a3e0-f14c-4afc-b4e2-cf4d306b7a5a req-8a6dd8fd-164f-480b-8ce8-cd00e18348e7 service nova] [instance: faa24a4e-f363-4649-a846-7e215ad027f0] No waiting events found dispatching network-vif-plugged-721b085e-01c3-449a-b794-6251a01b4af2 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 19:15:13 user nova-compute[75216]: WARNING nova.compute.manager [req-7029a3e0-f14c-4afc-b4e2-cf4d306b7a5a req-8a6dd8fd-164f-480b-8ce8-cd00e18348e7 service nova] [instance: faa24a4e-f363-4649-a846-7e215ad027f0] Received unexpected event network-vif-plugged-721b085e-01c3-449a-b794-6251a01b4af2 for instance with vm_state building and task_state spawning.
Nov 13 19:15:13 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.050s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:15:13 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[328ff283-9d4c-495f-8ad2-1e4e7b45c83a]: (4, ('1', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:15:13 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-2d0a9708-cdb9-4a6b-94b4-e4c14f2b2611 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 19:15:13 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-2d0a9708-cdb9-4a6b-94b4-e4c14f2b2611 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] SCSI volumes sdc have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 19:15:13 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d0a9708-cdb9-4a6b-94b4-e4c14f2b2611 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d08b68b4-6f2a-4b70-a1fb-b49c3052b0f5')] {{(pid=75216) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 19:15:13 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d08b68b4-6f2a-4b70-a1fb-b49c3052b0f5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:15:13 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d08b68b4-6f2a-4b70-a1fb-b49c3052b0f5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.030s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:15:13 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[4760653e-3658-4f0f-b5d1-b740c5d1c955]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:15:13 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d0a9708-cdb9-4a6b-94b4-e4c14f2b2611 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:15:13 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d08b68b4-6f2a-4b70-a1fb-b49c3052b0f5 -p 172.16.0.220:3260 --logout {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:15:13 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:15:13 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d08b68b4-6f2a-4b70-a1fb-b49c3052b0f5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.083s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:15:13 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[64711069-15ee-4abe-a1d7-558f189edcd0]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:d08b68b4-6f2a-4b70-a1fb-b49c3052b0f5, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:d08b68b4-6f2a-4b70-a1fb-b49c3052b0f5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:15:13 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d0a9708-cdb9-4a6b-94b4-e4c14f2b2611 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:d08b68b4-6f2a-4b70-a1fb-b49c3052b0f5, portal: 172.16.0.220,3260]
Nov 13 19:15:13 user nova-compute[75216]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:d08b68b4-6f2a-4b70-a1fb-b49c3052b0f5, portal: 172.16.0.220,3260] successful.
Nov 13 19:15:13 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:15:13 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d08b68b4-6f2a-4b70-a1fb-b49c3052b0f5 -p 172.16.0.220:3260 --op delete {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:15:13 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d08b68b4-6f2a-4b70-a1fb-b49c3052b0f5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:15:13 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[ada3b13a-3f73-4c58-afcb-fd5ea37cb59c]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:15:13 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d0a9708-cdb9-4a6b-94b4-e4c14f2b2611 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:15:13 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-2d0a9708-cdb9-4a6b-94b4-e4c14f2b2611 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.375s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 19:15:13 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d0a9708-cdb9-4a6b-94b4-e4c14f2b2611 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] <== disconnect_volume: return (375ms) None {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 19:15:13 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d0a9708-cdb9-4a6b-94b4-e4c14f2b2611 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] [instance: 9e47d802-efdb-4763-8594-1ad056dbf6cc] Disconnected iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 19:15:14 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:15:14 user nova-compute[75216]: DEBUG nova.objects.instance [None req-2d0a9708-cdb9-4a6b-94b4-e4c14f2b2611 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Lazy-loading 'flavor' on Instance uuid 9e47d802-efdb-4763-8594-1ad056dbf6cc {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:15:14 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-2d0a9708-cdb9-4a6b-94b4-e4c14f2b2611 tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Lock "9e47d802-efdb-4763-8594-1ad056dbf6cc" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.739s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:15:15 user nova-compute[75216]: DEBUG nova.compute.manager [None req-c3da6eeb-703c-4bfb-a509-c2308e7de896 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] [instance: faa24a4e-f363-4649-a846-7e215ad027f0] Instance event wait completed in 0 seconds for  {{(pid=75216) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 19:15:15 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-c3da6eeb-703c-4bfb-a509-c2308e7de896 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] [instance: faa24a4e-f363-4649-a846-7e215ad027f0] Guest created on hypervisor {{(pid=75216) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 19:15:15 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: faa24a4e-f363-4649-a846-7e215ad027f0] Instance spawned successfully.
Nov 13 19:15:15 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-c3da6eeb-703c-4bfb-a509-c2308e7de896 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] [instance: faa24a4e-f363-4649-a846-7e215ad027f0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 19:15:15 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-c3da6eeb-703c-4bfb-a509-c2308e7de896 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] [instance: faa24a4e-f363-4649-a846-7e215ad027f0] Found default for hw_cdrom_bus of ide {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 19:15:15 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-c3da6eeb-703c-4bfb-a509-c2308e7de896 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] [instance: faa24a4e-f363-4649-a846-7e215ad027f0] Found default for hw_disk_bus of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 19:15:15 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-c3da6eeb-703c-4bfb-a509-c2308e7de896 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] [instance: faa24a4e-f363-4649-a846-7e215ad027f0] Found default for hw_input_bus of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 19:15:15 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-c3da6eeb-703c-4bfb-a509-c2308e7de896 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] [instance: faa24a4e-f363-4649-a846-7e215ad027f0] Found default for hw_pointer_model of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 19:15:15 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-c3da6eeb-703c-4bfb-a509-c2308e7de896 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] [instance: faa24a4e-f363-4649-a846-7e215ad027f0] Found default for hw_video_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 19:15:15 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-c3da6eeb-703c-4bfb-a509-c2308e7de896 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] [instance: faa24a4e-f363-4649-a846-7e215ad027f0] Found default for hw_vif_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 19:15:15 user nova-compute[75216]: DEBUG nova.compute.manager [req-1168cd55-1aee-4ed7-b274-0f4f0d444c57 req-cfe7af33-971a-46d5-9c22-df11c5a7c794 service nova] [instance: faa24a4e-f363-4649-a846-7e215ad027f0] Received event network-vif-plugged-721b085e-01c3-449a-b794-6251a01b4af2 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:15:15 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-1168cd55-1aee-4ed7-b274-0f4f0d444c57 req-cfe7af33-971a-46d5-9c22-df11c5a7c794 service nova] Acquiring lock "faa24a4e-f363-4649-a846-7e215ad027f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:15:15 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-1168cd55-1aee-4ed7-b274-0f4f0d444c57 req-cfe7af33-971a-46d5-9c22-df11c5a7c794 service nova] Lock "faa24a4e-f363-4649-a846-7e215ad027f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:15:15 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-1168cd55-1aee-4ed7-b274-0f4f0d444c57 req-cfe7af33-971a-46d5-9c22-df11c5a7c794 service nova] Lock "faa24a4e-f363-4649-a846-7e215ad027f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:15:15 user nova-compute[75216]: DEBUG nova.compute.manager [req-1168cd55-1aee-4ed7-b274-0f4f0d444c57 req-cfe7af33-971a-46d5-9c22-df11c5a7c794 service nova] [instance: faa24a4e-f363-4649-a846-7e215ad027f0] No waiting events found dispatching network-vif-plugged-721b085e-01c3-449a-b794-6251a01b4af2 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 19:15:15 user nova-compute[75216]: WARNING nova.compute.manager [req-1168cd55-1aee-4ed7-b274-0f4f0d444c57 req-cfe7af33-971a-46d5-9c22-df11c5a7c794 service nova] [instance: faa24a4e-f363-4649-a846-7e215ad027f0] Received unexpected event network-vif-plugged-721b085e-01c3-449a-b794-6251a01b4af2 for instance with vm_state building and task_state spawning.
Nov 13 19:15:15 user nova-compute[75216]: INFO nova.compute.manager [None req-c3da6eeb-703c-4bfb-a509-c2308e7de896 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] [instance: faa24a4e-f363-4649-a846-7e215ad027f0] Took 5.98 seconds to spawn the instance on the hypervisor.
Nov 13 19:15:15 user nova-compute[75216]: DEBUG nova.compute.manager [None req-c3da6eeb-703c-4bfb-a509-c2308e7de896 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] [instance: faa24a4e-f363-4649-a846-7e215ad027f0] Checking state {{(pid=75216) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 19:15:15 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-b816de5d-b710-4dfc-8cee-40f7dabb53ed tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Acquiring lock "9e47d802-efdb-4763-8594-1ad056dbf6cc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:15:15 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-b816de5d-b710-4dfc-8cee-40f7dabb53ed tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Lock "9e47d802-efdb-4763-8594-1ad056dbf6cc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:15:15 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-b816de5d-b710-4dfc-8cee-40f7dabb53ed tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Acquiring lock "9e47d802-efdb-4763-8594-1ad056dbf6cc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:15:15 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-b816de5d-b710-4dfc-8cee-40f7dabb53ed tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Lock "9e47d802-efdb-4763-8594-1ad056dbf6cc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:15:15 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-b816de5d-b710-4dfc-8cee-40f7dabb53ed tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Lock "9e47d802-efdb-4763-8594-1ad056dbf6cc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:15:15 user nova-compute[75216]: INFO nova.compute.manager [None req-b816de5d-b710-4dfc-8cee-40f7dabb53ed tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] [instance: 9e47d802-efdb-4763-8594-1ad056dbf6cc] Terminating instance
Nov 13 19:15:15 user nova-compute[75216]: DEBUG nova.compute.manager [None req-b816de5d-b710-4dfc-8cee-40f7dabb53ed tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] [instance: 9e47d802-efdb-4763-8594-1ad056dbf6cc] Start destroying the instance on the hypervisor. {{(pid=75216) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 19:15:15 user nova-compute[75216]: INFO nova.compute.manager [None req-c3da6eeb-703c-4bfb-a509-c2308e7de896 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] [instance: faa24a4e-f363-4649-a846-7e215ad027f0] Took 6.64 seconds to build instance.
Nov 13 19:15:15 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:15:15 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c3da6eeb-703c-4bfb-a509-c2308e7de896 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Lock "faa24a4e-f363-4649-a846-7e215ad027f0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.744s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:15:15 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:15:16 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:15:16 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:15:16 user nova-compute[75216]: DEBUG nova.compute.manager [req-ac729aa6-023c-4139-98eb-61dfb7c68008 req-e279a0ef-6f99-486d-ae21-66447299664e service nova] [instance: 9e47d802-efdb-4763-8594-1ad056dbf6cc] Received event network-vif-unplugged-637bd8e9-478b-462f-bb28-a0a32f7bb6cb {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:15:16 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-ac729aa6-023c-4139-98eb-61dfb7c68008 req-e279a0ef-6f99-486d-ae21-66447299664e service nova] Acquiring lock "9e47d802-efdb-4763-8594-1ad056dbf6cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:15:16 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-ac729aa6-023c-4139-98eb-61dfb7c68008 req-e279a0ef-6f99-486d-ae21-66447299664e service nova] Lock "9e47d802-efdb-4763-8594-1ad056dbf6cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:15:16 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-ac729aa6-023c-4139-98eb-61dfb7c68008 req-e279a0ef-6f99-486d-ae21-66447299664e service nova] Lock "9e47d802-efdb-4763-8594-1ad056dbf6cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:15:16 user nova-compute[75216]: DEBUG nova.compute.manager [req-ac729aa6-023c-4139-98eb-61dfb7c68008 req-e279a0ef-6f99-486d-ae21-66447299664e service nova] [instance: 9e47d802-efdb-4763-8594-1ad056dbf6cc] No waiting events found dispatching network-vif-unplugged-637bd8e9-478b-462f-bb28-a0a32f7bb6cb {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 19:15:16 user nova-compute[75216]: DEBUG nova.compute.manager [req-ac729aa6-023c-4139-98eb-61dfb7c68008 req-e279a0ef-6f99-486d-ae21-66447299664e service nova] [instance: 9e47d802-efdb-4763-8594-1ad056dbf6cc] Received event network-vif-unplugged-637bd8e9-478b-462f-bb28-a0a32f7bb6cb for instance with task_state deleting. {{(pid=75216) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 19:15:16 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 9e47d802-efdb-4763-8594-1ad056dbf6cc] Instance destroyed successfully.
Nov 13 19:15:16 user nova-compute[75216]: DEBUG nova.objects.instance [None req-b816de5d-b710-4dfc-8cee-40f7dabb53ed tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Lazy-loading 'resources' on Instance uuid 9e47d802-efdb-4763-8594-1ad056dbf6cc {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:15:16 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-b816de5d-b710-4dfc-8cee-40f7dabb53ed tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T19:12:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1557089972',display_name='tempest-AttachVolumeTestJSON-server-1557089972',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1557089972',id=36,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNbWl+8qhnIKRIeXz4I/Q/qE/2kGUo5THWow9wnS+nJTRjHFzS4E0Zu5UKGIVTLYFykzZoZ1ujghv6D6EnbijAin6BMgn+7uQzLfHrznPwqbwDzZCCWXrjpWaLho+Z2BoQ==',key_name='tempest-keypair-286716216',keypairs=<?>,launch_index=0,launched_at=2023-11-13T19:12:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='095f5765865140d29b3ecf1ab3427037',ramdisk_id='',reservation_id='r-3e1wdhw7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-156429078',owner_user_name='tempest-AttachVolumeTestJSON-156429078-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T19:12:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a7501ee4141241f2abc4d6bfce2924d4',uuid=9e47d802-efdb-4763-8594-1ad056dbf6cc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "637bd8e9-478b-462f-bb28-a0a32f7bb6cb", "address": "fa:16:3e:ca:d7:9f", "network": {"id": "53bb01d5-31a4-47af-a931-ac12fe72b986", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-802892643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "095f5765865140d29b3ecf1ab3427037", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap637bd8e9-47", "ovs_interfaceid": "637bd8e9-478b-462f-bb28-a0a32f7bb6cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 19:15:16 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-b816de5d-b710-4dfc-8cee-40f7dabb53ed tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Converting VIF {"id": "637bd8e9-478b-462f-bb28-a0a32f7bb6cb", "address": "fa:16:3e:ca:d7:9f", "network": {"id": "53bb01d5-31a4-47af-a931-ac12fe72b986", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-802892643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "095f5765865140d29b3ecf1ab3427037", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap637bd8e9-47", "ovs_interfaceid": "637bd8e9-478b-462f-bb28-a0a32f7bb6cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 19:15:16 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-b816de5d-b710-4dfc-8cee-40f7dabb53ed tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ca:d7:9f,bridge_name='br-int',has_traffic_filtering=True,id=637bd8e9-478b-462f-bb28-a0a32f7bb6cb,network=Network(53bb01d5-31a4-47af-a931-ac12fe72b986),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap637bd8e9-47') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 19:15:16 user nova-compute[75216]: DEBUG os_vif [None req-b816de5d-b710-4dfc-8cee-40f7dabb53ed tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ca:d7:9f,bridge_name='br-int',has_traffic_filtering=True,id=637bd8e9-478b-462f-bb28-a0a32f7bb6cb,network=Network(53bb01d5-31a4-47af-a931-ac12fe72b986),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap637bd8e9-47') {{(pid=75216) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 19:15:16 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:15:16 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap637bd8e9-47, bridge=br-int, if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:15:16 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:15:16 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:15:16 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:15:16 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0d305c1f-4846-4261-9604-25c951df04d3) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:15:16 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:15:16 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:15:16 user nova-compute[75216]: INFO os_vif [None req-b816de5d-b710-4dfc-8cee-40f7dabb53ed tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ca:d7:9f,bridge_name='br-int',has_traffic_filtering=True,id=637bd8e9-478b-462f-bb28-a0a32f7bb6cb,network=Network(53bb01d5-31a4-47af-a931-ac12fe72b986),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap637bd8e9-47')
Nov 13 19:15:16 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-b816de5d-b710-4dfc-8cee-40f7dabb53ed tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] [instance: 9e47d802-efdb-4763-8594-1ad056dbf6cc] Deleting instance files /opt/stack/data/nova/instances/9e47d802-efdb-4763-8594-1ad056dbf6cc_del
Nov 13 19:15:16 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-b816de5d-b710-4dfc-8cee-40f7dabb53ed tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] [instance: 9e47d802-efdb-4763-8594-1ad056dbf6cc] Deletion of /opt/stack/data/nova/instances/9e47d802-efdb-4763-8594-1ad056dbf6cc_del complete
Nov 13 19:15:16 user nova-compute[75216]: INFO nova.compute.manager [None req-b816de5d-b710-4dfc-8cee-40f7dabb53ed tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] [instance: 9e47d802-efdb-4763-8594-1ad056dbf6cc] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 13 19:15:16 user nova-compute[75216]: DEBUG oslo.service.loopingcall [None req-b816de5d-b710-4dfc-8cee-40f7dabb53ed tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75216) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 19:15:16 user nova-compute[75216]: DEBUG nova.compute.manager [-] [instance: 9e47d802-efdb-4763-8594-1ad056dbf6cc] Deallocating network for instance {{(pid=75216) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 19:15:16 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: 9e47d802-efdb-4763-8594-1ad056dbf6cc] deallocate_for_instance() {{(pid=75216) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 19:15:16 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:15:16 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Starting heal instance info cache {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 19:15:17 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "refresh_cache-b048c677-85bf-4a93-88eb-c71bde27bf5b" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 19:15:17 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquired lock "refresh_cache-b048c677-85bf-4a93-88eb-c71bde27bf5b" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 19:15:17 user nova-compute[75216]: DEBUG nova.network.neutron [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: b048c677-85bf-4a93-88eb-c71bde27bf5b] Forcefully refreshing network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 19:15:17 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: 9e47d802-efdb-4763-8594-1ad056dbf6cc] Updating instance_info_cache with network_info: [] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:15:17 user nova-compute[75216]: INFO nova.compute.manager [-] [instance: 9e47d802-efdb-4763-8594-1ad056dbf6cc] Took 0.69 seconds to deallocate network for instance.
Nov 13 19:15:17 user nova-compute[75216]: DEBUG nova.network.neutron [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: b048c677-85bf-4a93-88eb-c71bde27bf5b] Updating instance_info_cache with network_info: [{"id": "4ae536b2-7829-45c2-8739-a3f838008e74", "address": "fa:16:3e:1a:59:bc", "network": {"id": "9dcbadf2-6b5e-41f1-88a3-17a579ad1bad", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-926239573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d06cae29094846f1817036dc761a565d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ae536b2-78", "ovs_interfaceid": "4ae536b2-7829-45c2-8739-a3f838008e74", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:15:17 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Releasing lock "refresh_cache-b048c677-85bf-4a93-88eb-c71bde27bf5b" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 19:15:17 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: b048c677-85bf-4a93-88eb-c71bde27bf5b] Updated the network info_cache for instance {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 19:15:17 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:15:17 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-b816de5d-b710-4dfc-8cee-40f7dabb53ed tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:15:17 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-b816de5d-b710-4dfc-8cee-40f7dabb53ed tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:15:17 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-b816de5d-b710-4dfc-8cee-40f7dabb53ed tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 19:15:17 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-b816de5d-b710-4dfc-8cee-40f7dabb53ed tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 19:15:17 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-b816de5d-b710-4dfc-8cee-40f7dabb53ed tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.198s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:15:17 user nova-compute[75216]: INFO nova.scheduler.client.report [None req-b816de5d-b710-4dfc-8cee-40f7dabb53ed tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Deleted allocations for instance 9e47d802-efdb-4763-8594-1ad056dbf6cc
Nov 13 19:15:17 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-b816de5d-b710-4dfc-8cee-40f7dabb53ed tempest-AttachVolumeTestJSON-156429078 tempest-AttachVolumeTestJSON-156429078-project-member] Lock "9e47d802-efdb-4763-8594-1ad056dbf6cc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.932s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:15:17 user nova-compute[75216]: DEBUG nova.compute.manager [req-30df960e-6dae-49bc-b7d2-7849991eb387 req-c754c4df-ce5a-4b5b-808b-881008d679a8 service nova] [instance: 9e47d802-efdb-4763-8594-1ad056dbf6cc] Received event network-vif-deleted-637bd8e9-478b-462f-bb28-a0a32f7bb6cb {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:15:18 user nova-compute[75216]: DEBUG nova.compute.manager [req-950b360f-9f30-471d-bf34-2f5be1daae9c req-9fbdda23-045c-4a7d-9e25-d63b532b854b service nova] [instance: 9e47d802-efdb-4763-8594-1ad056dbf6cc] Received event network-vif-plugged-637bd8e9-478b-462f-bb28-a0a32f7bb6cb {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:15:18 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-950b360f-9f30-471d-bf34-2f5be1daae9c req-9fbdda23-045c-4a7d-9e25-d63b532b854b service nova] Acquiring lock "9e47d802-efdb-4763-8594-1ad056dbf6cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:15:18 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-950b360f-9f30-471d-bf34-2f5be1daae9c req-9fbdda23-045c-4a7d-9e25-d63b532b854b service nova] Lock "9e47d802-efdb-4763-8594-1ad056dbf6cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:15:18 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-950b360f-9f30-471d-bf34-2f5be1daae9c req-9fbdda23-045c-4a7d-9e25-d63b532b854b service nova] Lock "9e47d802-efdb-4763-8594-1ad056dbf6cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:15:18 user nova-compute[75216]: DEBUG nova.compute.manager [req-950b360f-9f30-471d-bf34-2f5be1daae9c req-9fbdda23-045c-4a7d-9e25-d63b532b854b service nova] [instance: 9e47d802-efdb-4763-8594-1ad056dbf6cc] No waiting events found dispatching network-vif-plugged-637bd8e9-478b-462f-bb28-a0a32f7bb6cb {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 19:15:18 user nova-compute[75216]: WARNING nova.compute.manager [req-950b360f-9f30-471d-bf34-2f5be1daae9c req-9fbdda23-045c-4a7d-9e25-d63b532b854b service nova] [instance: 9e47d802-efdb-4763-8594-1ad056dbf6cc] Received unexpected event network-vif-plugged-637bd8e9-478b-462f-bb28-a0a32f7bb6cb for instance with vm_state deleted and task_state None.
Nov 13 19:15:19 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:15:19 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:15:21 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-dd6a79f7-667d-4f30-a4cf-cf27ced21cd9 tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 55b7031b-4fd6-4ecb-9130-68110677c7cf is timed out.
Nov 13 19:15:21 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-dd6a79f7-667d-4f30-a4cf-cf27ced21cd9 tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] Successfully detached device vdc from instance 55b7031b-4fd6-4ecb-9130-68110677c7cf from the live domain config.
Nov 13 19:15:21 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dd6a79f7-667d-4f30-a4cf-cf27ced21cd9 tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] [instance: 55b7031b-4fd6-4ecb-9130-68110677c7cf] calling os-brick to detach iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 19:15:21 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd6a79f7-667d-4f30-a4cf-cf27ced21cd9 tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3a8669e40>, {'target_iqn': 'iqn.2010-10.org.openstack:9e9fc1b9-d7ca-437d-a0db-f2e0884c3328', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZTcltRko', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 19:15:21 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-dd6a79f7-667d-4f30-a4cf-cf27ced21cd9 tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 19:15:21 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-dd6a79f7-667d-4f30-a4cf-cf27ced21cd9 tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 19:15:21 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-dd6a79f7-667d-4f30-a4cf-cf27ced21cd9 tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 19:15:21 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:15:21 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:15:21 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[32c446de-df7b-4ced-9c11-ca223b48ec8e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8ce26031-aafa-4026-8ea9-3de9e9c348ec\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:87436fbf-6473-4126-b388-247a56d3df9e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9e9fc1b9-d7ca-437d-a0db-f2e0884c3328\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:15:21 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd6a79f7-667d-4f30-a4cf-cf27ced21cd9 tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 19:15:21 user nova-compute[75216]: No targets found.
Nov 13 19:15:21 user nova-compute[75216]: iSNS:
Nov 13 19:15:21 user nova-compute[75216]: No targets found.
Nov 13 19:15:21 user nova-compute[75216]: STATIC:
Nov 13 19:15:21 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:8ce26031-aafa-4026-8ea9-3de9e9c348ec
Nov 13 19:15:21 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 19:15:21 user nova-compute[75216]:                 Iface Name: default
Nov 13 19:15:21 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:87436fbf-6473-4126-b388-247a56d3df9e
Nov 13 19:15:21 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 19:15:21 user nova-compute[75216]:                 Iface Name: default
Nov 13 19:15:21 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:9e9fc1b9-d7ca-437d-a0db-f2e0884c3328
Nov 13 19:15:21 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 19:15:21 user nova-compute[75216]:                 Iface Name: default
Nov 13 19:15:21 user nova-compute[75216]: FIRMWARE:
Nov 13 19:15:21 user nova-compute[75216]: No targets found.
Nov 13 19:15:21 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 19:15:21 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd6a79f7-667d-4f30-a4cf-cf27ced21cd9 tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 19:15:21 user nova-compute[75216]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 19:15:21 user nova-compute[75216]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75216) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 19:15:21 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd6a79f7-667d-4f30-a4cf-cf27ced21cd9 tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9e9fc1b9-d7ca-437d-a0db-f2e0884c3328', 0)] {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 19:15:21 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:15:21 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:15:21 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce8c2804-5401-4ee5-adc8-a461d29efc08]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:87436fbf-6473-4126-b388-247a56d3df9e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8ce26031-aafa-4026-8ea9-3de9e9c348ec\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e9fc1b9-d7ca-437d-a0db-f2e0884c3328\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:15:21 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:15:21 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:15:21 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[efdda22f-d761-4a8a-9fc3-398b40b73df6]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87436fbf-6473-4126-b388-247a56d3df9e (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9fc1b9-d7ca-437d-a0db-f2e0884c3328 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ce26031-aafa-4026-8ea9-3de9e9c348ec (non-flash)\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:15:21 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd6a79f7-667d-4f30-a4cf-cf27ced21cd9 tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87436fbf-6473-4126-b388-247a56d3df9e (non-flash)
Nov 13 19:15:21 user nova-compute[75216]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9fc1b9-d7ca-437d-a0db-f2e0884c3328 (non-flash)
Nov 13 19:15:21 user nova-compute[75216]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ce26031-aafa-4026-8ea9-3de9e9c348ec (non-flash)
Nov 13 19:15:21 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 19:15:21 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd6a79f7-667d-4f30-a4cf-cf27ced21cd9 tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87436fbf-6473-4126-b388-247a56d3df9e (non-flash)
Nov 13 19:15:21 user nova-compute[75216]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9fc1b9-d7ca-437d-a0db-f2e0884c3328 (non-flash)
Nov 13 19:15:21 user nova-compute[75216]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ce26031-aafa-4026-8ea9-3de9e9c348ec (non-flash)
Nov 13 19:15:21 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 19:15:21 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd6a79f7-667d-4f30-a4cf-cf27ced21cd9 tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe3a82ca710>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9e9fc1b9-d7ca-437d-a0db-f2e0884c3328'): ({'sdb'}, set())}) {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 19:15:21 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-dd6a79f7-667d-4f30-a4cf-cf27ced21cd9 tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] Removing single pathed devices sdb {{(pid=75216) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 19:15:21 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:15:21 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:15:21 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[312ecf5d-9f03-4781-a1ba-95fe92ef8ead]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:15:21 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:15:21 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:15:21 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[5589bffd-df62-412d-b6bc-6b299aa39782]: (4, ('ok\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:15:21 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-dd6a79f7-667d-4f30-a4cf-cf27ced21cd9 tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] Flushing IO for device /dev/sdb {{(pid=75216) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 19:15:21 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:15:21 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:15:21 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[938fbc2d-63fb-4e34-a89f-ff3a2803cd90]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:15:21 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-dd6a79f7-667d-4f30-a4cf-cf27ced21cd9 tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75216) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 19:15:21 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:15:21 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:15:21 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bb3a750-fe87-4f31-8d1d-60457c5d018e]: (4, ('1', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:15:21 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-dd6a79f7-667d-4f30-a4cf-cf27ced21cd9 tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 19:15:21 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-dd6a79f7-667d-4f30-a4cf-cf27ced21cd9 tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] SCSI volumes sdb have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 19:15:21 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd6a79f7-667d-4f30-a4cf-cf27ced21cd9 tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9e9fc1b9-d7ca-437d-a0db-f2e0884c3328')] {{(pid=75216) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 19:15:21 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e9fc1b9-d7ca-437d-a0db-f2e0884c3328 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:15:21 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e9fc1b9-d7ca-437d-a0db-f2e0884c3328 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:15:21 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[a95d1366-5f80-4e9a-9010-0e8f843f3429]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:15:21 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd6a79f7-667d-4f30-a4cf-cf27ced21cd9 tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:15:21 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e9fc1b9-d7ca-437d-a0db-f2e0884c3328 -p 172.16.0.220:3260 --logout {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:15:21 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:15:21 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e9fc1b9-d7ca-437d-a0db-f2e0884c3328 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:15:21 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[91eed777-ccf1-4c5b-9aa6-cfd2a40df942]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:9e9fc1b9-d7ca-437d-a0db-f2e0884c3328, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:9e9fc1b9-d7ca-437d-a0db-f2e0884c3328, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:15:21 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd6a79f7-667d-4f30-a4cf-cf27ced21cd9 tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:9e9fc1b9-d7ca-437d-a0db-f2e0884c3328, portal: 172.16.0.220,3260]
Nov 13 19:15:21 user nova-compute[75216]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:9e9fc1b9-d7ca-437d-a0db-f2e0884c3328, portal: 172.16.0.220,3260] successful.
Nov 13 19:15:21 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:15:21 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e9fc1b9-d7ca-437d-a0db-f2e0884c3328 -p 172.16.0.220:3260 --op delete {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:15:21 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e9fc1b9-d7ca-437d-a0db-f2e0884c3328 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:15:21 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef5c9eeb-4882-45b2-bf8c-b044a642c4eb]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:15:21 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd6a79f7-667d-4f30-a4cf-cf27ced21cd9 tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:15:21 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-dd6a79f7-667d-4f30-a4cf-cf27ced21cd9 tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.289s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 19:15:21 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd6a79f7-667d-4f30-a4cf-cf27ced21cd9 tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] <== disconnect_volume: return (290ms) None {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 19:15:21 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dd6a79f7-667d-4f30-a4cf-cf27ced21cd9 tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] [instance: 55b7031b-4fd6-4ecb-9130-68110677c7cf] Disconnected iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 19:15:22 user nova-compute[75216]: DEBUG nova.objects.instance [None req-dd6a79f7-667d-4f30-a4cf-cf27ced21cd9 tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] Lazy-loading 'flavor' on Instance uuid 55b7031b-4fd6-4ecb-9130-68110677c7cf {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:15:22 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-dd6a79f7-667d-4f30-a4cf-cf27ced21cd9 tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] Lock "55b7031b-4fd6-4ecb-9130-68110677c7cf" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.704s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:15:26 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:15:26 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:15:26 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75216) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 19:15:26 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 19:15:26 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 19:15:26 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:15:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:15:31 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:15:34 user nova-compute[75216]: DEBUG nova.compute.manager [req-9e3c0575-44f8-4b10-8e64-f02cdbdea7e8 req-79c81d50-0246-4329-b445-f44dac7de38e service nova] [instance: aca6edce-d579-4375-9bcd-2ba4d645b894] Received event network-changed-121d7d67-75ec-46ed-ae33-5c08519acf09 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:15:34 user nova-compute[75216]: DEBUG nova.compute.manager [req-9e3c0575-44f8-4b10-8e64-f02cdbdea7e8 req-79c81d50-0246-4329-b445-f44dac7de38e service nova] [instance: aca6edce-d579-4375-9bcd-2ba4d645b894] Refreshing instance network info cache due to event network-changed-121d7d67-75ec-46ed-ae33-5c08519acf09. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 19:15:34 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-9e3c0575-44f8-4b10-8e64-f02cdbdea7e8 req-79c81d50-0246-4329-b445-f44dac7de38e service nova] Acquiring lock "refresh_cache-aca6edce-d579-4375-9bcd-2ba4d645b894" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 19:15:34 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-9e3c0575-44f8-4b10-8e64-f02cdbdea7e8 req-79c81d50-0246-4329-b445-f44dac7de38e service nova] Acquired lock "refresh_cache-aca6edce-d579-4375-9bcd-2ba4d645b894" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 19:15:34 user nova-compute[75216]: DEBUG nova.network.neutron [req-9e3c0575-44f8-4b10-8e64-f02cdbdea7e8 req-79c81d50-0246-4329-b445-f44dac7de38e service nova] [instance: aca6edce-d579-4375-9bcd-2ba4d645b894] Refreshing network info cache for port 121d7d67-75ec-46ed-ae33-5c08519acf09 {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 19:15:34 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:15:34 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-3798475b-dfcc-4e8a-9033-22c8d2a7b590 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Acquiring lock "aca6edce-d579-4375-9bcd-2ba4d645b894" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:15:34 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-3798475b-dfcc-4e8a-9033-22c8d2a7b590 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Lock "aca6edce-d579-4375-9bcd-2ba4d645b894" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:15:34 user nova-compute[75216]: DEBUG nova.objects.instance [None req-3798475b-dfcc-4e8a-9033-22c8d2a7b590 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Lazy-loading 'flavor' on Instance uuid aca6edce-d579-4375-9bcd-2ba4d645b894 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:15:34 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-3798475b-dfcc-4e8a-9033-22c8d2a7b590 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] [instance: aca6edce-d579-4375-9bcd-2ba4d645b894] Ignoring supplied device name: /dev/vdb
Nov 13 19:15:34 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-3798475b-dfcc-4e8a-9033-22c8d2a7b590 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Lock "aca6edce-d579-4375-9bcd-2ba4d645b894" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:15:34 user nova-compute[75216]: DEBUG nova.network.neutron [req-9e3c0575-44f8-4b10-8e64-f02cdbdea7e8 req-79c81d50-0246-4329-b445-f44dac7de38e service nova] [instance: aca6edce-d579-4375-9bcd-2ba4d645b894] Updated VIF entry in instance network info cache for port 121d7d67-75ec-46ed-ae33-5c08519acf09. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 19:15:34 user nova-compute[75216]: DEBUG nova.network.neutron [req-9e3c0575-44f8-4b10-8e64-f02cdbdea7e8 req-79c81d50-0246-4329-b445-f44dac7de38e service nova] [instance: aca6edce-d579-4375-9bcd-2ba4d645b894] Updating instance_info_cache with network_info: [{"id": "121d7d67-75ec-46ed-ae33-5c08519acf09", "address": "fa:16:3e:58:78:ca", "network": {"id": "5c3296e5-d81b-4378-9108-bcc3ced5458a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-381226649-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e8c5d1e9e06c4202b31637288388048a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap121d7d67-75", "ovs_interfaceid": "121d7d67-75ec-46ed-ae33-5c08519acf09", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:15:34 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-9e3c0575-44f8-4b10-8e64-f02cdbdea7e8 req-79c81d50-0246-4329-b445-f44dac7de38e service nova] Releasing lock "refresh_cache-aca6edce-d579-4375-9bcd-2ba4d645b894" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 19:15:34 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-3798475b-dfcc-4e8a-9033-22c8d2a7b590 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Acquiring lock "aca6edce-d579-4375-9bcd-2ba4d645b894" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:15:34 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-3798475b-dfcc-4e8a-9033-22c8d2a7b590 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Lock "aca6edce-d579-4375-9bcd-2ba4d645b894" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:15:34 user nova-compute[75216]: INFO nova.compute.manager [None req-3798475b-dfcc-4e8a-9033-22c8d2a7b590 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] [instance: aca6edce-d579-4375-9bcd-2ba4d645b894] Attaching volume 97c06110-a599-47a3-9d96-02f9cb65beac to /dev/vdb
Nov 13 19:15:34 user nova-compute[75216]: DEBUG os_brick.utils [None req-3798475b-dfcc-4e8a-9033-22c8d2a7b590 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 19:15:34 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:15:34 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:15:34 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[38190d28-81dd-40dd-8caa-e822a014847f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aea6fcfe14b9\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:15:34 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:15:34 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:15:34 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[a78235b8-8f02-4231-af06-8031ec761bd0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:15:34 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:15:34 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:15:34 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f3a8921-2cbe-4aaf-8385-a41eaf988f8e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:15:34 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[da4e8ef7-097e-4120-a9fc-37b9972f2004]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:15:34 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-3798475b-dfcc-4e8a-9033-22c8d2a7b590 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Running cmd (subprocess): nvme version {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:15:34 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-3798475b-dfcc-4e8a-9033-22c8d2a7b590 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] 'nvme version' failed. Not Retrying. {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 19:15:34 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3798475b-dfcc-4e8a-9033-22c8d2a7b590 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] nvme not present on system {{(pid=75216) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 19:15:34 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:15:34 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 19:15:34 user nova-compute[75216]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 19:15:34 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[f020fdf0-3f2e-4aa6-91da-fbc60ed41db4]: (4, '') {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:15:34 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-3798475b-dfcc-4e8a-9033-22c8d2a7b590 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75216) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 19:15:34 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-3798475b-dfcc-4e8a-9033-22c8d2a7b590 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 19:15:34 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-3798475b-dfcc-4e8a-9033-22c8d2a7b590 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] LIGHTOS: no hostnqn found. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 19:15:34 user nova-compute[75216]: DEBUG os_brick.utils [None req-3798475b-dfcc-4e8a-9033-22c8d2a7b590 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aea6fcfe14b9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 19:15:34 user nova-compute[75216]: DEBUG nova.virt.block_device [None req-3798475b-dfcc-4e8a-9033-22c8d2a7b590 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] [instance: aca6edce-d579-4375-9bcd-2ba4d645b894] Updating existing volume attachment record: fac3f7c5-bc7e-482a-b1a8-483670ed49ec {{(pid=75216) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 19:15:36 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:15:39 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3798475b-dfcc-4e8a-9033-22c8d2a7b590 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] [instance: aca6edce-d579-4375-9bcd-2ba4d645b894] Calling os-brick to attach iSCSI Volume {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 19:15:39 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-3798475b-dfcc-4e8a-9033-22c8d2a7b590 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3a8669e40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:97c06110-a599-47a3-9d96-02f9cb65beac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IkevCEAw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 19:15:39 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-3798475b-dfcc-4e8a-9033-22c8d2a7b590 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 19:15:39 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-3798475b-dfcc-4e8a-9033-22c8d2a7b590 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 19:15:39 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-3798475b-dfcc-4e8a-9033-22c8d2a7b590 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 19:15:39 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-3798475b-dfcc-4e8a-9033-22c8d2a7b590 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 19:15:39 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-3798475b-dfcc-4e8a-9033-22c8d2a7b590 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:97c06110-a599-47a3-9d96-02f9cb65beac" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 19:15:39 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-3798475b-dfcc-4e8a-9033-22c8d2a7b590 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:97c06110-a599-47a3-9d96-02f9cb65beac" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 19:15:39 user nova-compute[75216]: INFO os_brick.initiator.connectors.iscsi [None req-3798475b-dfcc-4e8a-9033-22c8d2a7b590 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 19:15:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97c06110-a599-47a3-9d96-02f9cb65beac -p 172.16.0.220:3260 {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:15:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97c06110-a599-47a3-9d96-02f9cb65beac -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:15:39 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[988a1085-26c7-4575-a6ec-723381672788]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:15:39 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-3798475b-dfcc-4e8a-9033-22c8d2a7b590 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 19:15:39 user nova-compute[75216]:  {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:15:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97c06110-a599-47a3-9d96-02f9cb65beac -p 172.16.0.220:3260 --interface default --op new {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:15:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97c06110-a599-47a3-9d96-02f9cb65beac -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:15:39 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[d818c522-baea-4ca8-843c-5f4c5c6c2842]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:97c06110-a599-47a3-9d96-02f9cb65beac] added\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:15:39 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-3798475b-dfcc-4e8a-9033-22c8d2a7b590 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:97c06110-a599-47a3-9d96-02f9cb65beac] added
Nov 13 19:15:39 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:15:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97c06110-a599-47a3-9d96-02f9cb65beac -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:15:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97c06110-a599-47a3-9d96-02f9cb65beac -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:15:39 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fc73713-2752-47a8-9b7c-c885fbe19b13]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:15:39 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-3798475b-dfcc-4e8a-9033-22c8d2a7b590 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:15:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97c06110-a599-47a3-9d96-02f9cb65beac -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:15:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97c06110-a599-47a3-9d96-02f9cb65beac -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:15:39 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f5b7bd2-587a-416f-9940-3436cc4071b2]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:15:39 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-3798475b-dfcc-4e8a-9033-22c8d2a7b590 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:15:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97c06110-a599-47a3-9d96-02f9cb65beac -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IkevCEAw {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:15:39 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:15:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97c06110-a599-47a3-9d96-02f9cb65beac -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IkevCEAw" returned: 0 in 0.022s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:15:39 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2d08b3f-b0d5-40ad-988c-427573221c58]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:15:39 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-3798475b-dfcc-4e8a-9033-22c8d2a7b590 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IkevCEAw'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:15:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97c06110-a599-47a3-9d96-02f9cb65beac -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:15:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97c06110-a599-47a3-9d96-02f9cb65beac -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:15:39 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[22c81956-6a2d-4df7-8343-3e2331b6dafa]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:15:39 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-3798475b-dfcc-4e8a-9033-22c8d2a7b590 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:15:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:15:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:15:39 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7eba671-8baa-4ba0-8ebe-a1f40be65f06]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87436fbf-6473-4126-b388-247a56d3df9e (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ce26031-aafa-4026-8ea9-3de9e9c348ec (non-flash)\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:15:39 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-3798475b-dfcc-4e8a-9033-22c8d2a7b590 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87436fbf-6473-4126-b388-247a56d3df9e (non-flash)
Nov 13 19:15:39 user nova-compute[75216]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ce26031-aafa-4026-8ea9-3de9e9c348ec (non-flash)
Nov 13 19:15:39 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 19:15:39 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-3798475b-dfcc-4e8a-9033-22c8d2a7b590 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87436fbf-6473-4126-b388-247a56d3df9e (non-flash)
Nov 13 19:15:39 user nova-compute[75216]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ce26031-aafa-4026-8ea9-3de9e9c348ec (non-flash)
Nov 13 19:15:39 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 19:15:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97c06110-a599-47a3-9d96-02f9cb65beac -p 172.16.0.220:3260 --login {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:15:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97c06110-a599-47a3-9d96-02f9cb65beac -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:15:39 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd5b0b16-c028-4d58-98df-70e2f9b12240]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:97c06110-a599-47a3-9d96-02f9cb65beac, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:97c06110-a599-47a3-9d96-02f9cb65beac, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:15:39 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-3798475b-dfcc-4e8a-9033-22c8d2a7b590 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:97c06110-a599-47a3-9d96-02f9cb65beac, portal: 172.16.0.220,3260]
Nov 13 19:15:39 user nova-compute[75216]: Login to [iface: default, target: iqn.2010-10.org.openstack:97c06110-a599-47a3-9d96-02f9cb65beac, portal: 172.16.0.220,3260] successful.
Nov 13 19:15:39 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:15:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97c06110-a599-47a3-9d96-02f9cb65beac -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:15:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97c06110-a599-47a3-9d96-02f9cb65beac -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:15:39 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f504ae3-70c5-40ec-83b1-7cc8bd4e45e5]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:15:39 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-3798475b-dfcc-4e8a-9033-22c8d2a7b590 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:15:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:15:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:15:39 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[88e56920-6d17-473d-98a1-d47517adb0ec]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87436fbf-6473-4126-b388-247a56d3df9e (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ce26031-aafa-4026-8ea9-3de9e9c348ec (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97c06110-a599-47a3-9d96-02f9cb65beac (non-flash)\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:15:39 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-3798475b-dfcc-4e8a-9033-22c8d2a7b590 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87436fbf-6473-4126-b388-247a56d3df9e (non-flash)
Nov 13 19:15:39 user nova-compute[75216]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ce26031-aafa-4026-8ea9-3de9e9c348ec (non-flash)
Nov 13 19:15:39 user nova-compute[75216]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97c06110-a599-47a3-9d96-02f9cb65beac (non-flash)
Nov 13 19:15:39 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 19:15:39 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-3798475b-dfcc-4e8a-9033-22c8d2a7b590 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87436fbf-6473-4126-b388-247a56d3df9e (non-flash)
Nov 13 19:15:39 user nova-compute[75216]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ce26031-aafa-4026-8ea9-3de9e9c348ec (non-flash)
Nov 13 19:15:39 user nova-compute[75216]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97c06110-a599-47a3-9d96-02f9cb65beac (non-flash)
Nov 13 19:15:39 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 19:15:39 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-3798475b-dfcc-4e8a-9033-22c8d2a7b590 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:97c06110-a599-47a3-9d96-02f9cb65beac" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.283s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 19:15:39 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-3798475b-dfcc-4e8a-9033-22c8d2a7b590 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Connected to 172.16.0.220:3260 {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 19:15:39 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-3798475b-dfcc-4e8a-9033-22c8d2a7b590 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] HCTL ('33', '-', '-', 0) found on session 48 with lun 0 {{(pid=75216) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 19:15:39 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-3798475b-dfcc-4e8a-9033-22c8d2a7b590 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75216) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 19:15:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:15:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:15:39 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3ce7420-053d-490f-8cb5-ae492e923870]: (4, ('- - 0', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:15:39 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-3798475b-dfcc-4e8a-9033-22c8d2a7b590 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Searching for a device in session 48 and hctl ['33', '*', '*', 0] yield: None {{(pid=75216) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 19:15:40 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-3798475b-dfcc-4e8a-9033-22c8d2a7b590 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Searching for a device in session 48 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75216) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 19:15:40 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-3798475b-dfcc-4e8a-9033-22c8d2a7b590 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:97c06110-a599-47a3-9d96-02f9cb65beac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IkevCEAw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 19:15:40 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-3798475b-dfcc-4e8a-9033-22c8d2a7b590 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.318s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 19:15:40 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-3798475b-dfcc-4e8a-9033-22c8d2a7b590 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] <== connect_volume: return (1321ms) {'type': 'block', 'scsi_wwn': '26362313161316534', 'path': '/dev/sdb'} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 19:15:40 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3798475b-dfcc-4e8a-9033-22c8d2a7b590 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] [instance: aca6edce-d579-4375-9bcd-2ba4d645b894] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26362313161316534', 'path': '/dev/sdb'} {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 19:15:40 user nova-compute[75216]: DEBUG nova.objects.instance [None req-3798475b-dfcc-4e8a-9033-22c8d2a7b590 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Lazy-loading 'flavor' on Instance uuid aca6edce-d579-4375-9bcd-2ba4d645b894 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:15:40 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-3798475b-dfcc-4e8a-9033-22c8d2a7b590 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] attach device xml: <disk type="block" device="disk">
Nov 13 19:15:40 user nova-compute[75216]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 19:15:40 user nova-compute[75216]:   <source dev="/dev/sdb"/>
Nov 13 19:15:40 user nova-compute[75216]:   <target dev="vdb" bus="virtio"/>
Nov 13 19:15:40 user nova-compute[75216]:   <serial>97c06110-a599-47a3-9d96-02f9cb65beac</serial>
Nov 13 19:15:40 user nova-compute[75216]: </disk>
Nov 13 19:15:40 user nova-compute[75216]:  {{(pid=75216) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 13 19:15:40 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-3798475b-dfcc-4e8a-9033-22c8d2a7b590 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 19:15:40 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-3798475b-dfcc-4e8a-9033-22c8d2a7b590 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 19:15:40 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-3798475b-dfcc-4e8a-9033-22c8d2a7b590 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] No VIF found with MAC fa:16:3e:58:78:ca, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 19:15:41 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-3798475b-dfcc-4e8a-9033-22c8d2a7b590 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Lock "aca6edce-d579-4375-9bcd-2ba4d645b894" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.466s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:15:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:15:44 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:15:46 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:15:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:15:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-235e6ba3-1314-4f95-94f0-65e7d8625d4e tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Acquiring lock "aca6edce-d579-4375-9bcd-2ba4d645b894" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:15:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-235e6ba3-1314-4f95-94f0-65e7d8625d4e tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Lock "aca6edce-d579-4375-9bcd-2ba4d645b894" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:15:49 user nova-compute[75216]: INFO nova.compute.manager [None req-235e6ba3-1314-4f95-94f0-65e7d8625d4e tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] [instance: aca6edce-d579-4375-9bcd-2ba4d645b894] Detaching volume 97c06110-a599-47a3-9d96-02f9cb65beac
Nov 13 19:15:49 user nova-compute[75216]: INFO nova.virt.block_device [None req-235e6ba3-1314-4f95-94f0-65e7d8625d4e tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] [instance: aca6edce-d579-4375-9bcd-2ba4d645b894] Attempting to driver detach volume 97c06110-a599-47a3-9d96-02f9cb65beac from mountpoint /dev/vdb
Nov 13 19:15:49 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-235e6ba3-1314-4f95-94f0-65e7d8625d4e tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Attempting to detach device vdb from instance aca6edce-d579-4375-9bcd-2ba4d645b894 from the persistent domain config. {{(pid=75216) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 13 19:15:49 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-235e6ba3-1314-4f95-94f0-65e7d8625d4e tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 19:15:49 user nova-compute[75216]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 19:15:49 user nova-compute[75216]:   <source dev="/dev/sdb"/>
Nov 13 19:15:49 user nova-compute[75216]:   <target dev="vdb" bus="virtio"/>
Nov 13 19:15:49 user nova-compute[75216]:   <serial>97c06110-a599-47a3-9d96-02f9cb65beac</serial>
Nov 13 19:15:49 user nova-compute[75216]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 19:15:49 user nova-compute[75216]: </disk>
Nov 13 19:15:49 user nova-compute[75216]:  {{(pid=75216) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 19:15:49 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-235e6ba3-1314-4f95-94f0-65e7d8625d4e tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Successfully detached device vdb from instance aca6edce-d579-4375-9bcd-2ba4d645b894 from the persistent domain config.
Nov 13 19:15:49 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-235e6ba3-1314-4f95-94f0-65e7d8625d4e tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance aca6edce-d579-4375-9bcd-2ba4d645b894 from the live domain config. {{(pid=75216) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 13 19:15:49 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-235e6ba3-1314-4f95-94f0-65e7d8625d4e tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 19:15:49 user nova-compute[75216]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 19:15:49 user nova-compute[75216]:   <source dev="/dev/sdb"/>
Nov 13 19:15:49 user nova-compute[75216]:   <target dev="vdb" bus="virtio"/>
Nov 13 19:15:49 user nova-compute[75216]:   <serial>97c06110-a599-47a3-9d96-02f9cb65beac</serial>
Nov 13 19:15:49 user nova-compute[75216]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 19:15:49 user nova-compute[75216]: </disk>
Nov 13 19:15:49 user nova-compute[75216]:  {{(pid=75216) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 19:15:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-ca98122e-a656-4b11-9c8f-5caf13d1ad69 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Acquiring lock "aca6edce-d579-4375-9bcd-2ba4d645b894" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:15:50 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-235e6ba3-1314-4f95-94f0-65e7d8625d4e tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance aca6edce-d579-4375-9bcd-2ba4d645b894 {{(pid=75216) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 13 19:15:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f0993dc2-30ba-4b9d-b5af-4561bb17a91a tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] Acquiring lock "55b7031b-4fd6-4ecb-9130-68110677c7cf" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:15:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f0993dc2-30ba-4b9d-b5af-4561bb17a91a tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] Lock "55b7031b-4fd6-4ecb-9130-68110677c7cf" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:15:51 user nova-compute[75216]: INFO nova.compute.manager [None req-f0993dc2-30ba-4b9d-b5af-4561bb17a91a tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] [instance: 55b7031b-4fd6-4ecb-9130-68110677c7cf] Detaching volume 87436fbf-6473-4126-b388-247a56d3df9e
Nov 13 19:15:51 user nova-compute[75216]: INFO nova.virt.block_device [None req-f0993dc2-30ba-4b9d-b5af-4561bb17a91a tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] [instance: 55b7031b-4fd6-4ecb-9130-68110677c7cf] Attempting to driver detach volume 87436fbf-6473-4126-b388-247a56d3df9e from mountpoint /dev/vdb
Nov 13 19:15:51 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-f0993dc2-30ba-4b9d-b5af-4561bb17a91a tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] Attempting to detach device vdb from instance 55b7031b-4fd6-4ecb-9130-68110677c7cf from the persistent domain config. {{(pid=75216) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 13 19:15:51 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-f0993dc2-30ba-4b9d-b5af-4561bb17a91a tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 19:15:51 user nova-compute[75216]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 19:15:51 user nova-compute[75216]:   <source dev="/dev/sdd"/>
Nov 13 19:15:51 user nova-compute[75216]:   <target dev="vdb" bus="virtio"/>
Nov 13 19:15:51 user nova-compute[75216]:   <serial>87436fbf-6473-4126-b388-247a56d3df9e</serial>
Nov 13 19:15:51 user nova-compute[75216]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 19:15:51 user nova-compute[75216]: </disk>
Nov 13 19:15:51 user nova-compute[75216]:  {{(pid=75216) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 19:15:51 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-f0993dc2-30ba-4b9d-b5af-4561bb17a91a tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] Successfully detached device vdb from instance 55b7031b-4fd6-4ecb-9130-68110677c7cf from the persistent domain config.
Nov 13 19:15:51 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-f0993dc2-30ba-4b9d-b5af-4561bb17a91a tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 55b7031b-4fd6-4ecb-9130-68110677c7cf from the live domain config. {{(pid=75216) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 13 19:15:51 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-f0993dc2-30ba-4b9d-b5af-4561bb17a91a tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 19:15:51 user nova-compute[75216]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 19:15:51 user nova-compute[75216]:   <source dev="/dev/sdd"/>
Nov 13 19:15:51 user nova-compute[75216]:   <target dev="vdb" bus="virtio"/>
Nov 13 19:15:51 user nova-compute[75216]:   <serial>87436fbf-6473-4126-b388-247a56d3df9e</serial>
Nov 13 19:15:51 user nova-compute[75216]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 19:15:51 user nova-compute[75216]: </disk>
Nov 13 19:15:51 user nova-compute[75216]:  {{(pid=75216) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 19:15:51 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:15:51 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-f0993dc2-30ba-4b9d-b5af-4561bb17a91a tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 55b7031b-4fd6-4ecb-9130-68110677c7cf {{(pid=75216) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 13 19:15:56 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:16:00 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:16:01 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:16:02 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:16:06 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:16:08 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:16:08 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:16:08 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:16:09 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:16:09 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:16:09 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:16:09 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75216) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 19:16:10 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-235e6ba3-1314-4f95-94f0-65e7d8625d4e tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance aca6edce-d579-4375-9bcd-2ba4d645b894 is timed out.
Nov 13 19:16:10 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-235e6ba3-1314-4f95-94f0-65e7d8625d4e tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Successfully detached device vdb from instance aca6edce-d579-4375-9bcd-2ba4d645b894 from the live domain config.
Nov 13 19:16:10 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-235e6ba3-1314-4f95-94f0-65e7d8625d4e tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] [instance: aca6edce-d579-4375-9bcd-2ba4d645b894] calling os-brick to detach iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 19:16:10 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-235e6ba3-1314-4f95-94f0-65e7d8625d4e tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3a8669e40>, {'target_iqn': 'iqn.2010-10.org.openstack:97c06110-a599-47a3-9d96-02f9cb65beac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IkevCEAw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 19:16:10 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-235e6ba3-1314-4f95-94f0-65e7d8625d4e tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 19:16:10 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-235e6ba3-1314-4f95-94f0-65e7d8625d4e tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 19:16:10 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-235e6ba3-1314-4f95-94f0-65e7d8625d4e tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 19:16:10 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:16:10 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:16:10 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[b43ff2e1-908e-471d-afaf-247f89a25039]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8ce26031-aafa-4026-8ea9-3de9e9c348ec\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:87436fbf-6473-4126-b388-247a56d3df9e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:97c06110-a599-47a3-9d96-02f9cb65beac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:16:10 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-235e6ba3-1314-4f95-94f0-65e7d8625d4e tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 19:16:10 user nova-compute[75216]: No targets found.
Nov 13 19:16:10 user nova-compute[75216]: iSNS:
Nov 13 19:16:10 user nova-compute[75216]: No targets found.
Nov 13 19:16:10 user nova-compute[75216]: STATIC:
Nov 13 19:16:10 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:8ce26031-aafa-4026-8ea9-3de9e9c348ec
Nov 13 19:16:10 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 19:16:10 user nova-compute[75216]:                 Iface Name: default
Nov 13 19:16:10 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:87436fbf-6473-4126-b388-247a56d3df9e
Nov 13 19:16:10 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 19:16:10 user nova-compute[75216]:                 Iface Name: default
Nov 13 19:16:10 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:97c06110-a599-47a3-9d96-02f9cb65beac
Nov 13 19:16:10 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 19:16:10 user nova-compute[75216]:                 Iface Name: default
Nov 13 19:16:10 user nova-compute[75216]: FIRMWARE:
Nov 13 19:16:10 user nova-compute[75216]: No targets found.
Nov 13 19:16:10 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 19:16:10 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-235e6ba3-1314-4f95-94f0-65e7d8625d4e tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 19:16:10 user nova-compute[75216]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 19:16:10 user nova-compute[75216]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75216) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 19:16:10 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-235e6ba3-1314-4f95-94f0-65e7d8625d4e tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:97c06110-a599-47a3-9d96-02f9cb65beac', 0)] {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 19:16:10 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:16:10 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:16:10 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[427ecc40-3293-43e2-9967-e7467e8cd2eb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:87436fbf-6473-4126-b388-247a56d3df9e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8ce26031-aafa-4026-8ea9-3de9e9c348ec\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:97c06110-a599-47a3-9d96-02f9cb65beac\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:16:10 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:16:10 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:16:10 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[45853289-d2c8-49b7-9ac3-45c24dc24fba]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87436fbf-6473-4126-b388-247a56d3df9e (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ce26031-aafa-4026-8ea9-3de9e9c348ec (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97c06110-a599-47a3-9d96-02f9cb65beac (non-flash)\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:16:10 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-235e6ba3-1314-4f95-94f0-65e7d8625d4e tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87436fbf-6473-4126-b388-247a56d3df9e (non-flash)
Nov 13 19:16:10 user nova-compute[75216]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ce26031-aafa-4026-8ea9-3de9e9c348ec (non-flash)
Nov 13 19:16:10 user nova-compute[75216]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97c06110-a599-47a3-9d96-02f9cb65beac (non-flash)
Nov 13 19:16:10 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 19:16:10 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-235e6ba3-1314-4f95-94f0-65e7d8625d4e tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87436fbf-6473-4126-b388-247a56d3df9e (non-flash)
Nov 13 19:16:10 user nova-compute[75216]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ce26031-aafa-4026-8ea9-3de9e9c348ec (non-flash)
Nov 13 19:16:10 user nova-compute[75216]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97c06110-a599-47a3-9d96-02f9cb65beac (non-flash)
Nov 13 19:16:10 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 19:16:10 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-235e6ba3-1314-4f95-94f0-65e7d8625d4e tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe3a82dd990>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:97c06110-a599-47a3-9d96-02f9cb65beac'): ({'sdb'}, set())}) {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 19:16:10 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-235e6ba3-1314-4f95-94f0-65e7d8625d4e tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Removing single pathed devices sdb {{(pid=75216) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 19:16:10 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:16:10 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:16:10 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8d1d7b9-2fa8-4fe7-af3e-ab74982520f1]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:16:10 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:16:10 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:16:10 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbdf701b-9645-4974-a382-26f696af6df7]: (4, ('ok\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:16:10 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-235e6ba3-1314-4f95-94f0-65e7d8625d4e tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Flushing IO for device /dev/sdb {{(pid=75216) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 19:16:10 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:16:10 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:16:10 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[2da99041-7c76-4686-81ae-3ea05917e78a]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:16:10 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-235e6ba3-1314-4f95-94f0-65e7d8625d4e tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75216) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 19:16:10 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:16:10 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.034s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:16:10 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[db1dc87b-2968-434a-a912-d126ffc38626]: (4, ('1', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:16:10 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-235e6ba3-1314-4f95-94f0-65e7d8625d4e tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 19:16:10 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-235e6ba3-1314-4f95-94f0-65e7d8625d4e tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] SCSI volumes sdb have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 19:16:10 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-235e6ba3-1314-4f95-94f0-65e7d8625d4e tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:97c06110-a599-47a3-9d96-02f9cb65beac')] {{(pid=75216) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 19:16:10 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97c06110-a599-47a3-9d96-02f9cb65beac -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:16:10 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97c06110-a599-47a3-9d96-02f9cb65beac -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:16:10 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdf662ca-17c7-4090-a0a5-d718d0006e98]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:16:10 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-235e6ba3-1314-4f95-94f0-65e7d8625d4e tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:16:10 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97c06110-a599-47a3-9d96-02f9cb65beac -p 172.16.0.220:3260 --logout {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:16:10 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97c06110-a599-47a3-9d96-02f9cb65beac -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:16:10 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[4812ad0a-2e63-4068-9a6b-e98db16697e4]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:97c06110-a599-47a3-9d96-02f9cb65beac, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:97c06110-a599-47a3-9d96-02f9cb65beac, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:16:10 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-235e6ba3-1314-4f95-94f0-65e7d8625d4e tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:97c06110-a599-47a3-9d96-02f9cb65beac, portal: 172.16.0.220,3260]
Nov 13 19:16:10 user nova-compute[75216]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:97c06110-a599-47a3-9d96-02f9cb65beac, portal: 172.16.0.220,3260] successful.
Nov 13 19:16:10 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:16:10 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97c06110-a599-47a3-9d96-02f9cb65beac -p 172.16.0.220:3260 --op delete {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:16:10 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97c06110-a599-47a3-9d96-02f9cb65beac -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:16:10 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[642f7637-c5a4-48dc-8528-986747c325e6]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:16:10 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-235e6ba3-1314-4f95-94f0-65e7d8625d4e tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:16:10 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-235e6ba3-1314-4f95-94f0-65e7d8625d4e tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 19:16:10 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-235e6ba3-1314-4f95-94f0-65e7d8625d4e tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] <== disconnect_volume: return (310ms) None {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 19:16:10 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-235e6ba3-1314-4f95-94f0-65e7d8625d4e tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] [instance: aca6edce-d579-4375-9bcd-2ba4d645b894] Disconnected iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 19:16:11 user nova-compute[75216]: DEBUG nova.objects.instance [None req-235e6ba3-1314-4f95-94f0-65e7d8625d4e tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Lazy-loading 'flavor' on Instance uuid aca6edce-d579-4375-9bcd-2ba4d645b894 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:16:11 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-235e6ba3-1314-4f95-94f0-65e7d8625d4e tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Lock "aca6edce-d579-4375-9bcd-2ba4d645b894" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.653s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:16:11 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-ca98122e-a656-4b11-9c8f-5caf13d1ad69 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Lock "aca6edce-d579-4375-9bcd-2ba4d645b894" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.533s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:16:11 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-ca98122e-a656-4b11-9c8f-5caf13d1ad69 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Acquiring lock "aca6edce-d579-4375-9bcd-2ba4d645b894-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:16:11 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-ca98122e-a656-4b11-9c8f-5caf13d1ad69 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Lock "aca6edce-d579-4375-9bcd-2ba4d645b894-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:16:11 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-ca98122e-a656-4b11-9c8f-5caf13d1ad69 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Lock "aca6edce-d579-4375-9bcd-2ba4d645b894-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:16:11 user nova-compute[75216]: INFO nova.compute.manager [None req-ca98122e-a656-4b11-9c8f-5caf13d1ad69 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] [instance: aca6edce-d579-4375-9bcd-2ba4d645b894] Terminating instance
Nov 13 19:16:11 user nova-compute[75216]: DEBUG nova.compute.manager [None req-ca98122e-a656-4b11-9c8f-5caf13d1ad69 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] [instance: aca6edce-d579-4375-9bcd-2ba4d645b894] Start destroying the instance on the hypervisor. {{(pid=75216) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 19:16:11 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:16:11 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:16:11 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:16:11 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:16:11 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:16:11 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:16:11 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:16:11 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:16:11 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Auditing locally available compute resources for user (node: user) {{(pid=75216) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 19:16:11 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:16:11 user nova-compute[75216]: DEBUG nova.compute.manager [req-14678355-c5b2-44b1-9501-f8f0280ffc1b req-5914f12a-9056-484e-9a0e-33481bb1d75e service nova] [instance: aca6edce-d579-4375-9bcd-2ba4d645b894] Received event network-vif-unplugged-121d7d67-75ec-46ed-ae33-5c08519acf09 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:16:11 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-14678355-c5b2-44b1-9501-f8f0280ffc1b req-5914f12a-9056-484e-9a0e-33481bb1d75e service nova] Acquiring lock "aca6edce-d579-4375-9bcd-2ba4d645b894-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:16:11 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-14678355-c5b2-44b1-9501-f8f0280ffc1b req-5914f12a-9056-484e-9a0e-33481bb1d75e service nova] Lock "aca6edce-d579-4375-9bcd-2ba4d645b894-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:16:11 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-14678355-c5b2-44b1-9501-f8f0280ffc1b req-5914f12a-9056-484e-9a0e-33481bb1d75e service nova] Lock "aca6edce-d579-4375-9bcd-2ba4d645b894-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:16:11 user nova-compute[75216]: DEBUG nova.compute.manager [req-14678355-c5b2-44b1-9501-f8f0280ffc1b req-5914f12a-9056-484e-9a0e-33481bb1d75e service nova] [instance: aca6edce-d579-4375-9bcd-2ba4d645b894] No waiting events found dispatching network-vif-unplugged-121d7d67-75ec-46ed-ae33-5c08519acf09 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 19:16:11 user nova-compute[75216]: DEBUG nova.compute.manager [req-14678355-c5b2-44b1-9501-f8f0280ffc1b req-5914f12a-9056-484e-9a0e-33481bb1d75e service nova] [instance: aca6edce-d579-4375-9bcd-2ba4d645b894] Received event network-vif-unplugged-121d7d67-75ec-46ed-ae33-5c08519acf09 for instance with task_state deleting. {{(pid=75216) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 19:16:11 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:16:11 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-f0993dc2-30ba-4b9d-b5af-4561bb17a91a tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 55b7031b-4fd6-4ecb-9130-68110677c7cf is timed out.
Nov 13 19:16:11 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-f0993dc2-30ba-4b9d-b5af-4561bb17a91a tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] Successfully detached device vdb from instance 55b7031b-4fd6-4ecb-9130-68110677c7cf from the live domain config.
Nov 13 19:16:12 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f0993dc2-30ba-4b9d-b5af-4561bb17a91a tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] [instance: 55b7031b-4fd6-4ecb-9130-68110677c7cf] calling os-brick to detach iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 19:16:12 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0993dc2-30ba-4b9d-b5af-4561bb17a91a tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3a8669e40>, {'target_iqn': 'iqn.2010-10.org.openstack:87436fbf-6473-4126-b388-247a56d3df9e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bJztckes', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 19:16:12 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-f0993dc2-30ba-4b9d-b5af-4561bb17a91a tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 19:16:12 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-f0993dc2-30ba-4b9d-b5af-4561bb17a91a tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 19:16:12 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-f0993dc2-30ba-4b9d-b5af-4561bb17a91a tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 19:16:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:16:12 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: aca6edce-d579-4375-9bcd-2ba4d645b894] Instance destroyed successfully.
Nov 13 19:16:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:16:12 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[f085ad38-210f-47d9-92a5-b7aa38f8a13b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8ce26031-aafa-4026-8ea9-3de9e9c348ec\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:87436fbf-6473-4126-b388-247a56d3df9e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:16:12 user nova-compute[75216]: DEBUG nova.objects.instance [None req-ca98122e-a656-4b11-9c8f-5caf13d1ad69 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Lazy-loading 'resources' on Instance uuid aca6edce-d579-4375-9bcd-2ba4d645b894 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:16:12 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0993dc2-30ba-4b9d-b5af-4561bb17a91a tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 19:16:12 user nova-compute[75216]: No targets found.
Nov 13 19:16:12 user nova-compute[75216]: iSNS:
Nov 13 19:16:12 user nova-compute[75216]: No targets found.
Nov 13 19:16:12 user nova-compute[75216]: STATIC:
Nov 13 19:16:12 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:8ce26031-aafa-4026-8ea9-3de9e9c348ec
Nov 13 19:16:12 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 19:16:12 user nova-compute[75216]:                 Iface Name: default
Nov 13 19:16:12 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:87436fbf-6473-4126-b388-247a56d3df9e
Nov 13 19:16:12 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 19:16:12 user nova-compute[75216]:                 Iface Name: default
Nov 13 19:16:12 user nova-compute[75216]: FIRMWARE:
Nov 13 19:16:12 user nova-compute[75216]: No targets found.
Nov 13 19:16:12 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 19:16:12 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0993dc2-30ba-4b9d-b5af-4561bb17a91a tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 19:16:12 user nova-compute[75216]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 19:16:12 user nova-compute[75216]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75216) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 19:16:12 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0993dc2-30ba-4b9d-b5af-4561bb17a91a tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:87436fbf-6473-4126-b388-247a56d3df9e', 0)] {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 19:16:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:16:12 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-ca98122e-a656-4b11-9c8f-5caf13d1ad69 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T19:13:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-2000423057',display_name='tempest-VolumesSnapshotTestJSON-instance-2000423057',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-2000423057',id=39,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDGLsND18O94+mQSzcCmTR/MV5GFz19xbqbjRC4/YPE6qgz5iFB6XD8HeK5fi5xjxjof5tKbhMBIHfE9LDJaG5AIXYoWXufNRGdLp6TXAk//FqzjpGAtQgZvniJ/d6MJ4g==',key_name='tempest-keypair-1748710875',keypairs=<?>,launch_index=0,launched_at=2023-11-13T19:13:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e8c5d1e9e06c4202b31637288388048a',ramdisk_id='',reservation_id='r-exa53f6m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1725517259',owner_user_name='tempest-VolumesSnapshotTestJSON-1725517259-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T19:13:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='75359f2870344d9d83ce124a7a990aaf',uuid=aca6edce-d579-4375-9bcd-2ba4d645b894,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "121d7d67-75ec-46ed-ae33-5c08519acf09", "address": "fa:16:3e:58:78:ca", "network": {"id": "5c3296e5-d81b-4378-9108-bcc3ced5458a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-381226649-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e8c5d1e9e06c4202b31637288388048a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap121d7d67-75", "ovs_interfaceid": "121d7d67-75ec-46ed-ae33-5c08519acf09", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 19:16:12 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-ca98122e-a656-4b11-9c8f-5caf13d1ad69 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Converting VIF {"id": "121d7d67-75ec-46ed-ae33-5c08519acf09", "address": "fa:16:3e:58:78:ca", "network": {"id": "5c3296e5-d81b-4378-9108-bcc3ced5458a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-381226649-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e8c5d1e9e06c4202b31637288388048a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap121d7d67-75", "ovs_interfaceid": "121d7d67-75ec-46ed-ae33-5c08519acf09", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 19:16:12 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-ca98122e-a656-4b11-9c8f-5caf13d1ad69 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:58:78:ca,bridge_name='br-int',has_traffic_filtering=True,id=121d7d67-75ec-46ed-ae33-5c08519acf09,network=Network(5c3296e5-d81b-4378-9108-bcc3ced5458a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap121d7d67-75') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 19:16:12 user nova-compute[75216]: DEBUG os_vif [None req-ca98122e-a656-4b11-9c8f-5caf13d1ad69 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:58:78:ca,bridge_name='br-int',has_traffic_filtering=True,id=121d7d67-75ec-46ed-ae33-5c08519acf09,network=Network(5c3296e5-d81b-4378-9108-bcc3ced5458a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap121d7d67-75') {{(pid=75216) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 19:16:12 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:16:12 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap121d7d67-75, bridge=br-int, if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:16:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:16:12 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[c81f31ea-972e-4528-901a-1a283ae241df]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:87436fbf-6473-4126-b388-247a56d3df9e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8ce26031-aafa-4026-8ea9-3de9e9c348ec\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:16:12 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:16:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:16:12 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:16:12 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=556d3697-9092-4a3e-b150-ec71429fed5e) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:16:12 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:16:12 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:16:12 user nova-compute[75216]: INFO os_vif [None req-ca98122e-a656-4b11-9c8f-5caf13d1ad69 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:58:78:ca,bridge_name='br-int',has_traffic_filtering=True,id=121d7d67-75ec-46ed-ae33-5c08519acf09,network=Network(5c3296e5-d81b-4378-9108-bcc3ced5458a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap121d7d67-75')
Nov 13 19:16:12 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca98122e-a656-4b11-9c8f-5caf13d1ad69 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] [instance: aca6edce-d579-4375-9bcd-2ba4d645b894] calling os-brick to detach iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 19:16:12 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca98122e-a656-4b11-9c8f-5caf13d1ad69 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3a8669e40>, {'target_iqn': 'iqn.2010-10.org.openstack:97c06110-a599-47a3-9d96-02f9cb65beac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IkevCEAw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 19:16:12 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-ca98122e-a656-4b11-9c8f-5caf13d1ad69 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 19:16:12 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-ca98122e-a656-4b11-9c8f-5caf13d1ad69 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 19:16:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:16:12 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfa9baea-89ac-475b-a78e-f1a64fef6030]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87436fbf-6473-4126-b388-247a56d3df9e (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ce26031-aafa-4026-8ea9-3de9e9c348ec (non-flash)\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:16:12 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0993dc2-30ba-4b9d-b5af-4561bb17a91a tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87436fbf-6473-4126-b388-247a56d3df9e (non-flash)
Nov 13 19:16:12 user nova-compute[75216]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ce26031-aafa-4026-8ea9-3de9e9c348ec (non-flash)
Nov 13 19:16:12 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 19:16:12 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0993dc2-30ba-4b9d-b5af-4561bb17a91a tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87436fbf-6473-4126-b388-247a56d3df9e (non-flash)
Nov 13 19:16:12 user nova-compute[75216]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ce26031-aafa-4026-8ea9-3de9e9c348ec (non-flash)
Nov 13 19:16:12 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 19:16:12 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0993dc2-30ba-4b9d-b5af-4561bb17a91a tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe3c03c3d00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:87436fbf-6473-4126-b388-247a56d3df9e'): ({'sdd'}, set())}) {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 19:16:12 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-f0993dc2-30ba-4b9d-b5af-4561bb17a91a tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] Removing single pathed devices sdd {{(pid=75216) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 19:16:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:16:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:16:12 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[573cfe30-2132-4a42-aba2-1f54073216a6]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:16:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:16:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.017s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:16:12 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c7d9c2a-3309-40cd-8209-ee1fa8ea1b1b]: (4, ('ok\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:16:12 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-f0993dc2-30ba-4b9d-b5af-4561bb17a91a tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] Flushing IO for device /dev/sdd {{(pid=75216) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 19:16:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:16:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:16:12 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[182e8ef5-d88b-44c5-a856-aba3616e9e6f]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:16:12 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-f0993dc2-30ba-4b9d-b5af-4561bb17a91a tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75216) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 19:16:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:16:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.045s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:16:12 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[14e6d3c1-8835-47b1-9cb3-6ea7ac9da4db]: (4, ('1', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:16:12 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-f0993dc2-30ba-4b9d-b5af-4561bb17a91a tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 19:16:12 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-f0993dc2-30ba-4b9d-b5af-4561bb17a91a tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] SCSI volumes sdd have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 19:16:12 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0993dc2-30ba-4b9d-b5af-4561bb17a91a tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:87436fbf-6473-4126-b388-247a56d3df9e')] {{(pid=75216) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 19:16:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87436fbf-6473-4126-b388-247a56d3df9e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:16:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87436fbf-6473-4126-b388-247a56d3df9e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:16:12 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[e203d7dc-80ee-42d7-8229-b9aada079d8b]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:16:12 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0993dc2-30ba-4b9d-b5af-4561bb17a91a tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:16:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87436fbf-6473-4126-b388-247a56d3df9e -p 172.16.0.220:3260 --logout {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:16:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aca6edce-d579-4375-9bcd-2ba4d645b894/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:16:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87436fbf-6473-4126-b388-247a56d3df9e -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:16:12 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[e972904a-966c-40b9-b31b-837a4ba0bae9]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:87436fbf-6473-4126-b388-247a56d3df9e, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:87436fbf-6473-4126-b388-247a56d3df9e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:16:12 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0993dc2-30ba-4b9d-b5af-4561bb17a91a tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:87436fbf-6473-4126-b388-247a56d3df9e, portal: 172.16.0.220,3260]
Nov 13 19:16:12 user nova-compute[75216]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:87436fbf-6473-4126-b388-247a56d3df9e, portal: 172.16.0.220,3260] successful.
Nov 13 19:16:12 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:16:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87436fbf-6473-4126-b388-247a56d3df9e -p 172.16.0.220:3260 --op delete {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:16:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87436fbf-6473-4126-b388-247a56d3df9e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:16:12 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6d9722a-fd52-4e3e-9a1d-98fac2cc17f0]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:16:12 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0993dc2-30ba-4b9d-b5af-4561bb17a91a tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:16:12 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-f0993dc2-30ba-4b9d-b5af-4561bb17a91a tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.301s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 19:16:12 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0993dc2-30ba-4b9d-b5af-4561bb17a91a tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] <== disconnect_volume: return (302ms) None {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 19:16:12 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f0993dc2-30ba-4b9d-b5af-4561bb17a91a tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] [instance: 55b7031b-4fd6-4ecb-9130-68110677c7cf] Disconnected iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 19:16:12 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-ca98122e-a656-4b11-9c8f-5caf13d1ad69 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.239s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 19:16:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:16:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:16:12 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[bda4d9e5-4eea-41c8-a670-54ca6781d195]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8ce26031-aafa-4026-8ea9-3de9e9c348ec\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:16:12 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca98122e-a656-4b11-9c8f-5caf13d1ad69 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 19:16:12 user nova-compute[75216]: No targets found.
Nov 13 19:16:12 user nova-compute[75216]: iSNS:
Nov 13 19:16:12 user nova-compute[75216]: No targets found.
Nov 13 19:16:12 user nova-compute[75216]: STATIC:
Nov 13 19:16:12 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:8ce26031-aafa-4026-8ea9-3de9e9c348ec
Nov 13 19:16:12 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 19:16:12 user nova-compute[75216]:                 Iface Name: default
Nov 13 19:16:12 user nova-compute[75216]: FIRMWARE:
Nov 13 19:16:12 user nova-compute[75216]: No targets found.
Nov 13 19:16:12 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 19:16:12 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca98122e-a656-4b11-9c8f-5caf13d1ad69 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 19:16:12 user nova-compute[75216]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 19:16:12 user nova-compute[75216]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75216) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 19:16:12 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca98122e-a656-4b11-9c8f-5caf13d1ad69 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:97c06110-a599-47a3-9d96-02f9cb65beac', 0)] {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 19:16:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:16:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:16:12 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc940be1-f367-49ad-888b-976fb5834f98]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8ce26031-aafa-4026-8ea9-3de9e9c348ec\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:16:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:16:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:16:12 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f028b24-1a74-4b38-ac30-61b096b079eb]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ce26031-aafa-4026-8ea9-3de9e9c348ec (non-flash)\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:16:12 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca98122e-a656-4b11-9c8f-5caf13d1ad69 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ce26031-aafa-4026-8ea9-3de9e9c348ec (non-flash)
Nov 13 19:16:12 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 19:16:12 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca98122e-a656-4b11-9c8f-5caf13d1ad69 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ce26031-aafa-4026-8ea9-3de9e9c348ec (non-flash)
Nov 13 19:16:12 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 19:16:12 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca98122e-a656-4b11-9c8f-5caf13d1ad69 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe3a8178310>, {}) {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 19:16:12 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca98122e-a656-4b11-9c8f-5caf13d1ad69 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Disconnecting from: [] {{(pid=75216) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 19:16:12 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-ca98122e-a656-4b11-9c8f-5caf13d1ad69 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.070s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 19:16:12 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca98122e-a656-4b11-9c8f-5caf13d1ad69 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] <== disconnect_volume: return (308ms) None {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 19:16:12 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca98122e-a656-4b11-9c8f-5caf13d1ad69 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] [instance: aca6edce-d579-4375-9bcd-2ba4d645b894] Disconnected iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 19:16:12 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-ca98122e-a656-4b11-9c8f-5caf13d1ad69 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] [instance: aca6edce-d579-4375-9bcd-2ba4d645b894] Deleting instance files /opt/stack/data/nova/instances/aca6edce-d579-4375-9bcd-2ba4d645b894_del
Nov 13 19:16:12 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-ca98122e-a656-4b11-9c8f-5caf13d1ad69 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] [instance: aca6edce-d579-4375-9bcd-2ba4d645b894] Deletion of /opt/stack/data/nova/instances/aca6edce-d579-4375-9bcd-2ba4d645b894_del complete
Nov 13 19:16:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aca6edce-d579-4375-9bcd-2ba4d645b894/disk --force-share --output=json" returned: 1 in 0.173s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:16:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aca6edce-d579-4375-9bcd-2ba4d645b894/disk --force-share --output=json' failed. Not Retrying. {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 19:16:12 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Periodic task is updating the host stats, it is trying to get disk info for instance-00000027, but the backing disk storage was removed by a concurrent operation such as resize. Error: No disk at /opt/stack/data/nova/instances/aca6edce-d579-4375-9bcd-2ba4d645b894/disk: nova.exception.DiskNotFound: No disk at /opt/stack/data/nova/instances/aca6edce-d579-4375-9bcd-2ba4d645b894/disk
Nov 13 19:16:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b048c677-85bf-4a93-88eb-c71bde27bf5b/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:16:12 user nova-compute[75216]: INFO nova.compute.manager [None req-ca98122e-a656-4b11-9c8f-5caf13d1ad69 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] [instance: aca6edce-d579-4375-9bcd-2ba4d645b894] Took 1.28 seconds to destroy the instance on the hypervisor.
Nov 13 19:16:12 user nova-compute[75216]: DEBUG oslo.service.loopingcall [None req-ca98122e-a656-4b11-9c8f-5caf13d1ad69 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75216) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 19:16:12 user nova-compute[75216]: DEBUG nova.compute.manager [-] [instance: aca6edce-d579-4375-9bcd-2ba4d645b894] Deallocating network for instance {{(pid=75216) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 19:16:12 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: aca6edce-d579-4375-9bcd-2ba4d645b894] deallocate_for_instance() {{(pid=75216) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 19:16:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b048c677-85bf-4a93-88eb-c71bde27bf5b/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:16:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b048c677-85bf-4a93-88eb-c71bde27bf5b/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:16:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b048c677-85bf-4a93-88eb-c71bde27bf5b/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:16:12 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 19:16:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faa24a4e-f363-4649-a846-7e215ad027f0/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:16:13 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faa24a4e-f363-4649-a846-7e215ad027f0/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:16:13 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faa24a4e-f363-4649-a846-7e215ad027f0/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:16:13 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:16:13 user nova-compute[75216]: DEBUG nova.objects.instance [None req-f0993dc2-30ba-4b9d-b5af-4561bb17a91a tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] Lazy-loading 'flavor' on Instance uuid 55b7031b-4fd6-4ecb-9130-68110677c7cf {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:16:13 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faa24a4e-f363-4649-a846-7e215ad027f0/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:16:13 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55b7031b-4fd6-4ecb-9130-68110677c7cf/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:16:13 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: aca6edce-d579-4375-9bcd-2ba4d645b894] Updating instance_info_cache with network_info: [] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:16:13 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f0993dc2-30ba-4b9d-b5af-4561bb17a91a tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] Lock "55b7031b-4fd6-4ecb-9130-68110677c7cf" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.847s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:16:13 user nova-compute[75216]: INFO nova.compute.manager [-] [instance: aca6edce-d579-4375-9bcd-2ba4d645b894] Took 0.80 seconds to deallocate network for instance.
Nov 13 19:16:13 user nova-compute[75216]: WARNING nova.volume.cinder [None req-ca98122e-a656-4b11-9c8f-5caf13d1ad69 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Attachment fac3f7c5-bc7e-482a-b1a8-483670ed49ec does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = fac3f7c5-bc7e-482a-b1a8-483670ed49ec. (HTTP 404) (Request-ID: req-7a879866-8ca7-4fb4-8680-6ce6e4b6bd21)
Nov 13 19:16:13 user nova-compute[75216]: INFO nova.compute.manager [None req-ca98122e-a656-4b11-9c8f-5caf13d1ad69 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] [instance: aca6edce-d579-4375-9bcd-2ba4d645b894] Took 0.03 seconds to detach 1 volumes for instance.
Nov 13 19:16:13 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-ca98122e-a656-4b11-9c8f-5caf13d1ad69 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:16:13 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-ca98122e-a656-4b11-9c8f-5caf13d1ad69 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:16:13 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55b7031b-4fd6-4ecb-9130-68110677c7cf/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:16:13 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55b7031b-4fd6-4ecb-9130-68110677c7cf/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:16:13 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-ca98122e-a656-4b11-9c8f-5caf13d1ad69 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Refreshing inventories for resource provider d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 13 19:16:13 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-ca98122e-a656-4b11-9c8f-5caf13d1ad69 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Updating ProviderTree inventory for provider d927e00d-5a8b-43f7-ac04-6437958fac1f from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 13 19:16:13 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-ca98122e-a656-4b11-9c8f-5caf13d1ad69 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Updating inventory in ProviderTree for provider d927e00d-5a8b-43f7-ac04-6437958fac1f with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 13 19:16:13 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55b7031b-4fd6-4ecb-9130-68110677c7cf/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:16:13 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-ca98122e-a656-4b11-9c8f-5caf13d1ad69 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Refreshing aggregate associations for resource provider d927e00d-5a8b-43f7-ac04-6437958fac1f, aggregates: None {{(pid=75216) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 13 19:16:14 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-ca98122e-a656-4b11-9c8f-5caf13d1ad69 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Refreshing trait associations for resource provider d927e00d-5a8b-43f7-ac04-6437958fac1f, traits: COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_MMX {{(pid=75216) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 13 19:16:14 user nova-compute[75216]: DEBUG nova.compute.manager [req-e3a9bc44-5fd6-426d-8134-67927022ffad req-50f8863f-cc9d-46b0-8497-12f1715cbcf1 service nova] [instance: aca6edce-d579-4375-9bcd-2ba4d645b894] Received event network-vif-plugged-121d7d67-75ec-46ed-ae33-5c08519acf09 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:16:14 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-e3a9bc44-5fd6-426d-8134-67927022ffad req-50f8863f-cc9d-46b0-8497-12f1715cbcf1 service nova] Acquiring lock "aca6edce-d579-4375-9bcd-2ba4d645b894-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:16:14 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-e3a9bc44-5fd6-426d-8134-67927022ffad req-50f8863f-cc9d-46b0-8497-12f1715cbcf1 service nova] Lock "aca6edce-d579-4375-9bcd-2ba4d645b894-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:16:14 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-e3a9bc44-5fd6-426d-8134-67927022ffad req-50f8863f-cc9d-46b0-8497-12f1715cbcf1 service nova] Lock "aca6edce-d579-4375-9bcd-2ba4d645b894-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:16:14 user nova-compute[75216]: DEBUG nova.compute.manager [req-e3a9bc44-5fd6-426d-8134-67927022ffad req-50f8863f-cc9d-46b0-8497-12f1715cbcf1 service nova] [instance: aca6edce-d579-4375-9bcd-2ba4d645b894] No waiting events found dispatching network-vif-plugged-121d7d67-75ec-46ed-ae33-5c08519acf09 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 19:16:14 user nova-compute[75216]: WARNING nova.compute.manager [req-e3a9bc44-5fd6-426d-8134-67927022ffad req-50f8863f-cc9d-46b0-8497-12f1715cbcf1 service nova] [instance: aca6edce-d579-4375-9bcd-2ba4d645b894] Received unexpected event network-vif-plugged-121d7d67-75ec-46ed-ae33-5c08519acf09 for instance with vm_state deleted and task_state None.
Nov 13 19:16:14 user nova-compute[75216]: DEBUG nova.compute.manager [req-e3a9bc44-5fd6-426d-8134-67927022ffad req-50f8863f-cc9d-46b0-8497-12f1715cbcf1 service nova] [instance: aca6edce-d579-4375-9bcd-2ba4d645b894] Received event network-vif-deleted-121d7d67-75ec-46ed-ae33-5c08519acf09 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:16:14 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 19:16:14 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 19:16:14 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Hypervisor/Node resource view: name=user free_ram=8613MB free_disk=25.276348114013672GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75216) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 19:16:14 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:16:14 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-ca98122e-a656-4b11-9c8f-5caf13d1ad69 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 19:16:14 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-ca98122e-a656-4b11-9c8f-5caf13d1ad69 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 19:16:14 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-ca98122e-a656-4b11-9c8f-5caf13d1ad69 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.857s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:16:14 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.210s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:16:14 user nova-compute[75216]: INFO nova.scheduler.client.report [None req-ca98122e-a656-4b11-9c8f-5caf13d1ad69 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Deleted allocations for instance aca6edce-d579-4375-9bcd-2ba4d645b894
Nov 13 19:16:14 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance 55b7031b-4fd6-4ecb-9130-68110677c7cf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 19:16:14 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance b048c677-85bf-4a93-88eb-c71bde27bf5b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 19:16:14 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance faa24a4e-f363-4649-a846-7e215ad027f0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 19:16:14 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 19:16:14 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 19:16:14 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-ca98122e-a656-4b11-9c8f-5caf13d1ad69 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Lock "aca6edce-d579-4375-9bcd-2ba4d645b894" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.167s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:16:14 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 19:16:14 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 19:16:14 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Compute_service record updated for user:user {{(pid=75216) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 19:16:14 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.265s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:16:17 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:16:17 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:16:17 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Starting heal instance info cache {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 19:16:17 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Rebuilding the list of instances to heal {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 13 19:16:17 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "refresh_cache-55b7031b-4fd6-4ecb-9130-68110677c7cf" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 19:16:17 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquired lock "refresh_cache-55b7031b-4fd6-4ecb-9130-68110677c7cf" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 19:16:17 user nova-compute[75216]: DEBUG nova.network.neutron [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: 55b7031b-4fd6-4ecb-9130-68110677c7cf] Forcefully refreshing network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 19:16:17 user nova-compute[75216]: DEBUG nova.objects.instance [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lazy-loading 'info_cache' on Instance uuid 55b7031b-4fd6-4ecb-9130-68110677c7cf {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:16:18 user nova-compute[75216]: DEBUG nova.network.neutron [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: 55b7031b-4fd6-4ecb-9130-68110677c7cf] Updating instance_info_cache with network_info: [{"id": "bc9be0fb-9e21-4ad1-ae37-a1da3dbc5e5e", "address": "fa:16:3e:92:1e:27", "network": {"id": "988045b3-1899-40e5-93a6-56fc3b6bb766", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-280689078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4172655ed9de4ceb84d79d785f3b3377", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc9be0fb-9e", "ovs_interfaceid": "bc9be0fb-9e21-4ad1-ae37-a1da3dbc5e5e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:16:18 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Releasing lock "refresh_cache-55b7031b-4fd6-4ecb-9130-68110677c7cf" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 19:16:18 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: 55b7031b-4fd6-4ecb-9130-68110677c7cf] Updated the network info_cache for instance {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 19:16:18 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:16:22 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:16:27 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:16:29 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:16:29 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75216) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 13 19:16:30 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:16:30 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Cleaning up deleted instances {{(pid=75216) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 13 19:16:30 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] There are 0 instances to clean {{(pid=75216) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 13 19:16:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:16:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:16:41 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1190a54d-6141-425c-bbb0-863d535989d8 tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] Acquiring lock "55b7031b-4fd6-4ecb-9130-68110677c7cf" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:16:41 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1190a54d-6141-425c-bbb0-863d535989d8 tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] Lock "55b7031b-4fd6-4ecb-9130-68110677c7cf" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:16:41 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1190a54d-6141-425c-bbb0-863d535989d8 tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] Acquiring lock "55b7031b-4fd6-4ecb-9130-68110677c7cf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:16:41 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1190a54d-6141-425c-bbb0-863d535989d8 tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] Lock "55b7031b-4fd6-4ecb-9130-68110677c7cf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:16:41 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1190a54d-6141-425c-bbb0-863d535989d8 tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] Lock "55b7031b-4fd6-4ecb-9130-68110677c7cf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:16:41 user nova-compute[75216]: INFO nova.compute.manager [None req-1190a54d-6141-425c-bbb0-863d535989d8 tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] [instance: 55b7031b-4fd6-4ecb-9130-68110677c7cf] Terminating instance
Nov 13 19:16:41 user nova-compute[75216]: DEBUG nova.compute.manager [None req-1190a54d-6141-425c-bbb0-863d535989d8 tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] [instance: 55b7031b-4fd6-4ecb-9130-68110677c7cf] Start destroying the instance on the hypervisor. {{(pid=75216) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 19:16:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:16:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:16:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:16:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:16:42 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:16:42 user nova-compute[75216]: DEBUG nova.compute.manager [req-b0a44921-cbbe-4f32-8f80-6bb055e09054 req-7cf7905b-45d7-40ff-9f67-0a4eb13fd242 service nova] [instance: 55b7031b-4fd6-4ecb-9130-68110677c7cf] Received event network-vif-unplugged-bc9be0fb-9e21-4ad1-ae37-a1da3dbc5e5e {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:16:42 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-b0a44921-cbbe-4f32-8f80-6bb055e09054 req-7cf7905b-45d7-40ff-9f67-0a4eb13fd242 service nova] Acquiring lock "55b7031b-4fd6-4ecb-9130-68110677c7cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:16:42 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-b0a44921-cbbe-4f32-8f80-6bb055e09054 req-7cf7905b-45d7-40ff-9f67-0a4eb13fd242 service nova] Lock "55b7031b-4fd6-4ecb-9130-68110677c7cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:16:42 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-b0a44921-cbbe-4f32-8f80-6bb055e09054 req-7cf7905b-45d7-40ff-9f67-0a4eb13fd242 service nova] Lock "55b7031b-4fd6-4ecb-9130-68110677c7cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:16:42 user nova-compute[75216]: DEBUG nova.compute.manager [req-b0a44921-cbbe-4f32-8f80-6bb055e09054 req-7cf7905b-45d7-40ff-9f67-0a4eb13fd242 service nova] [instance: 55b7031b-4fd6-4ecb-9130-68110677c7cf] No waiting events found dispatching network-vif-unplugged-bc9be0fb-9e21-4ad1-ae37-a1da3dbc5e5e {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 19:16:42 user nova-compute[75216]: DEBUG nova.compute.manager [req-b0a44921-cbbe-4f32-8f80-6bb055e09054 req-7cf7905b-45d7-40ff-9f67-0a4eb13fd242 service nova] [instance: 55b7031b-4fd6-4ecb-9130-68110677c7cf] Received event network-vif-unplugged-bc9be0fb-9e21-4ad1-ae37-a1da3dbc5e5e for instance with task_state deleting. {{(pid=75216) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 19:16:42 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:16:42 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:16:42 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 55b7031b-4fd6-4ecb-9130-68110677c7cf] Instance destroyed successfully.
Nov 13 19:16:42 user nova-compute[75216]: DEBUG nova.objects.instance [None req-1190a54d-6141-425c-bbb0-863d535989d8 tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] Lazy-loading 'resources' on Instance uuid 55b7031b-4fd6-4ecb-9130-68110677c7cf {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:16:42 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-1190a54d-6141-425c-bbb0-863d535989d8 tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T19:12:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-489647674',display_name='tempest-TestServerVolumeAttachmentScenario-server-489647674',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-489647674',id=37,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEzJ93ZYc/hw6plBkPM4noL/je3iA1G0jCim4AwpiavgsN/1T0G8YEMh+wVd+tMlte8a2rLFSp4S/Q0KO7BJmEQAR7k+85+m2qWyIYyPsy+MtRWy31nHQGSoAIwBdMq+yw==',key_name='tempest-keypair-707241514',keypairs=<?>,launch_index=0,launched_at=2023-11-13T19:12:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4172655ed9de4ceb84d79d785f3b3377',ramdisk_id='',reservation_id='r-q3qg2s0i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1442727498',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1442727498-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T19:12:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0601f6da2e0842f0a373998d62dfbd60',uuid=55b7031b-4fd6-4ecb-9130-68110677c7cf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bc9be0fb-9e21-4ad1-ae37-a1da3dbc5e5e", "address": "fa:16:3e:92:1e:27", "network": {"id": "988045b3-1899-40e5-93a6-56fc3b6bb766", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-280689078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4172655ed9de4ceb84d79d785f3b3377", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc9be0fb-9e", "ovs_interfaceid": "bc9be0fb-9e21-4ad1-ae37-a1da3dbc5e5e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 19:16:42 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-1190a54d-6141-425c-bbb0-863d535989d8 tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] Converting VIF {"id": "bc9be0fb-9e21-4ad1-ae37-a1da3dbc5e5e", "address": "fa:16:3e:92:1e:27", "network": {"id": "988045b3-1899-40e5-93a6-56fc3b6bb766", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-280689078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4172655ed9de4ceb84d79d785f3b3377", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc9be0fb-9e", "ovs_interfaceid": "bc9be0fb-9e21-4ad1-ae37-a1da3dbc5e5e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 19:16:42 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-1190a54d-6141-425c-bbb0-863d535989d8 tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:92:1e:27,bridge_name='br-int',has_traffic_filtering=True,id=bc9be0fb-9e21-4ad1-ae37-a1da3dbc5e5e,network=Network(988045b3-1899-40e5-93a6-56fc3b6bb766),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc9be0fb-9e') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 19:16:42 user nova-compute[75216]: DEBUG os_vif [None req-1190a54d-6141-425c-bbb0-863d535989d8 tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:92:1e:27,bridge_name='br-int',has_traffic_filtering=True,id=bc9be0fb-9e21-4ad1-ae37-a1da3dbc5e5e,network=Network(988045b3-1899-40e5-93a6-56fc3b6bb766),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc9be0fb-9e') {{(pid=75216) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 19:16:42 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:16:42 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbc9be0fb-9e, bridge=br-int, if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:16:42 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:16:42 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:16:42 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:16:42 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=995357bc-2e5e-4cdc-bd28-9859dd4c9143) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:16:42 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:16:42 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:16:42 user nova-compute[75216]: INFO os_vif [None req-1190a54d-6141-425c-bbb0-863d535989d8 tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:92:1e:27,bridge_name='br-int',has_traffic_filtering=True,id=bc9be0fb-9e21-4ad1-ae37-a1da3dbc5e5e,network=Network(988045b3-1899-40e5-93a6-56fc3b6bb766),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc9be0fb-9e')
Nov 13 19:16:42 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-1190a54d-6141-425c-bbb0-863d535989d8 tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] [instance: 55b7031b-4fd6-4ecb-9130-68110677c7cf] Deleting instance files /opt/stack/data/nova/instances/55b7031b-4fd6-4ecb-9130-68110677c7cf_del
Nov 13 19:16:42 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-1190a54d-6141-425c-bbb0-863d535989d8 tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] [instance: 55b7031b-4fd6-4ecb-9130-68110677c7cf] Deletion of /opt/stack/data/nova/instances/55b7031b-4fd6-4ecb-9130-68110677c7cf_del complete
Nov 13 19:16:42 user nova-compute[75216]: INFO nova.compute.manager [None req-1190a54d-6141-425c-bbb0-863d535989d8 tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] [instance: 55b7031b-4fd6-4ecb-9130-68110677c7cf] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 13 19:16:42 user nova-compute[75216]: DEBUG oslo.service.loopingcall [None req-1190a54d-6141-425c-bbb0-863d535989d8 tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75216) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 19:16:42 user nova-compute[75216]: DEBUG nova.compute.manager [-] [instance: 55b7031b-4fd6-4ecb-9130-68110677c7cf] Deallocating network for instance {{(pid=75216) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 19:16:42 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: 55b7031b-4fd6-4ecb-9130-68110677c7cf] deallocate_for_instance() {{(pid=75216) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 19:16:43 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: 55b7031b-4fd6-4ecb-9130-68110677c7cf] Updating instance_info_cache with network_info: [] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:16:43 user nova-compute[75216]: INFO nova.compute.manager [-] [instance: 55b7031b-4fd6-4ecb-9130-68110677c7cf] Took 0.66 seconds to deallocate network for instance.
Nov 13 19:16:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1190a54d-6141-425c-bbb0-863d535989d8 tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:16:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1190a54d-6141-425c-bbb0-863d535989d8 tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:16:43 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-1190a54d-6141-425c-bbb0-863d535989d8 tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 19:16:43 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-1190a54d-6141-425c-bbb0-863d535989d8 tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 19:16:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1190a54d-6141-425c-bbb0-863d535989d8 tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.159s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:16:43 user nova-compute[75216]: INFO nova.scheduler.client.report [None req-1190a54d-6141-425c-bbb0-863d535989d8 tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] Deleted allocations for instance 55b7031b-4fd6-4ecb-9130-68110677c7cf
Nov 13 19:16:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-1190a54d-6141-425c-bbb0-863d535989d8 tempest-TestServerVolumeAttachmentScenario-1442727498 tempest-TestServerVolumeAttachmentScenario-1442727498-project-member] Lock "55b7031b-4fd6-4ecb-9130-68110677c7cf" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.839s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:16:44 user nova-compute[75216]: DEBUG nova.compute.manager [req-7611870a-fa0f-4234-9488-cb068be996e2 req-a1b81f13-158b-4844-8d2a-81fcd1524885 service nova] [instance: 55b7031b-4fd6-4ecb-9130-68110677c7cf] Received event network-vif-plugged-bc9be0fb-9e21-4ad1-ae37-a1da3dbc5e5e {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:16:44 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-7611870a-fa0f-4234-9488-cb068be996e2 req-a1b81f13-158b-4844-8d2a-81fcd1524885 service nova] Acquiring lock "55b7031b-4fd6-4ecb-9130-68110677c7cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:16:44 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-7611870a-fa0f-4234-9488-cb068be996e2 req-a1b81f13-158b-4844-8d2a-81fcd1524885 service nova] Lock "55b7031b-4fd6-4ecb-9130-68110677c7cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:16:44 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-7611870a-fa0f-4234-9488-cb068be996e2 req-a1b81f13-158b-4844-8d2a-81fcd1524885 service nova] Lock "55b7031b-4fd6-4ecb-9130-68110677c7cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:16:44 user nova-compute[75216]: DEBUG nova.compute.manager [req-7611870a-fa0f-4234-9488-cb068be996e2 req-a1b81f13-158b-4844-8d2a-81fcd1524885 service nova] [instance: 55b7031b-4fd6-4ecb-9130-68110677c7cf] No waiting events found dispatching network-vif-plugged-bc9be0fb-9e21-4ad1-ae37-a1da3dbc5e5e {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 19:16:44 user nova-compute[75216]: WARNING nova.compute.manager [req-7611870a-fa0f-4234-9488-cb068be996e2 req-a1b81f13-158b-4844-8d2a-81fcd1524885 service nova] [instance: 55b7031b-4fd6-4ecb-9130-68110677c7cf] Received unexpected event network-vif-plugged-bc9be0fb-9e21-4ad1-ae37-a1da3dbc5e5e for instance with vm_state deleted and task_state None.
Nov 13 19:16:44 user nova-compute[75216]: DEBUG nova.compute.manager [req-7611870a-fa0f-4234-9488-cb068be996e2 req-a1b81f13-158b-4844-8d2a-81fcd1524885 service nova] [instance: 55b7031b-4fd6-4ecb-9130-68110677c7cf] Received event network-vif-deleted-bc9be0fb-9e21-4ad1-ae37-a1da3dbc5e5e {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:16:47 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:16:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-d6500d2b-df0d-4091-986b-c79cfbc3b943 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Acquiring lock "138c85af-655a-4a5c-ade7-daa7d7b58456" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:16:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-d6500d2b-df0d-4091-986b-c79cfbc3b943 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Lock "138c85af-655a-4a5c-ade7-daa7d7b58456" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:16:47 user nova-compute[75216]: DEBUG nova.compute.manager [None req-d6500d2b-df0d-4091-986b-c79cfbc3b943 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] [instance: 138c85af-655a-4a5c-ade7-daa7d7b58456] Starting instance... {{(pid=75216) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 19:16:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-d6500d2b-df0d-4091-986b-c79cfbc3b943 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:16:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-d6500d2b-df0d-4091-986b-c79cfbc3b943 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:16:47 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-d6500d2b-df0d-4091-986b-c79cfbc3b943 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75216) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 19:16:47 user nova-compute[75216]: INFO nova.compute.claims [None req-d6500d2b-df0d-4091-986b-c79cfbc3b943 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] [instance: 138c85af-655a-4a5c-ade7-daa7d7b58456] Claim successful on node user
Nov 13 19:16:48 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-d6500d2b-df0d-4091-986b-c79cfbc3b943 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 19:16:48 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-d6500d2b-df0d-4091-986b-c79cfbc3b943 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 19:16:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-d6500d2b-df0d-4091-986b-c79cfbc3b943 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.256s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:16:48 user nova-compute[75216]: DEBUG nova.compute.manager [None req-d6500d2b-df0d-4091-986b-c79cfbc3b943 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] [instance: 138c85af-655a-4a5c-ade7-daa7d7b58456] Start building networks asynchronously for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 19:16:48 user nova-compute[75216]: DEBUG nova.compute.manager [None req-d6500d2b-df0d-4091-986b-c79cfbc3b943 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] [instance: 138c85af-655a-4a5c-ade7-daa7d7b58456] Allocating IP information in the background. {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 19:16:48 user nova-compute[75216]: DEBUG nova.network.neutron [None req-d6500d2b-df0d-4091-986b-c79cfbc3b943 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] [instance: 138c85af-655a-4a5c-ade7-daa7d7b58456] allocate_for_instance() {{(pid=75216) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 19:16:48 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-d6500d2b-df0d-4091-986b-c79cfbc3b943 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] [instance: 138c85af-655a-4a5c-ade7-daa7d7b58456] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 19:16:48 user nova-compute[75216]: DEBUG nova.compute.manager [None req-d6500d2b-df0d-4091-986b-c79cfbc3b943 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] [instance: 138c85af-655a-4a5c-ade7-daa7d7b58456] Start building block device mappings for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 19:16:48 user nova-compute[75216]: DEBUG nova.policy [None req-d6500d2b-df0d-4091-986b-c79cfbc3b943 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '75359f2870344d9d83ce124a7a990aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8c5d1e9e06c4202b31637288388048a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75216) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 19:16:48 user nova-compute[75216]: DEBUG nova.compute.manager [None req-d6500d2b-df0d-4091-986b-c79cfbc3b943 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] [instance: 138c85af-655a-4a5c-ade7-daa7d7b58456] Start spawning the instance on the hypervisor. {{(pid=75216) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 19:16:48 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-d6500d2b-df0d-4091-986b-c79cfbc3b943 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] [instance: 138c85af-655a-4a5c-ade7-daa7d7b58456] Creating instance directory {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 19:16:48 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-d6500d2b-df0d-4091-986b-c79cfbc3b943 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] [instance: 138c85af-655a-4a5c-ade7-daa7d7b58456] Creating image(s)
Nov 13 19:16:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-d6500d2b-df0d-4091-986b-c79cfbc3b943 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Acquiring lock "/opt/stack/data/nova/instances/138c85af-655a-4a5c-ade7-daa7d7b58456/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:16:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-d6500d2b-df0d-4091-986b-c79cfbc3b943 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Lock "/opt/stack/data/nova/instances/138c85af-655a-4a5c-ade7-daa7d7b58456/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:16:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-d6500d2b-df0d-4091-986b-c79cfbc3b943 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Lock "/opt/stack/data/nova/instances/138c85af-655a-4a5c-ade7-daa7d7b58456/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:16:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-d6500d2b-df0d-4091-986b-c79cfbc3b943 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:16:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-d6500d2b-df0d-4091-986b-c79cfbc3b943 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json" returned: 0 in 0.177s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:16:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-d6500d2b-df0d-4091-986b-c79cfbc3b943 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Acquiring lock "88c50a45bec9d6b0427462b3242b9b8e5f49c2b6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:16:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-d6500d2b-df0d-4091-986b-c79cfbc3b943 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Lock "88c50a45bec9d6b0427462b3242b9b8e5f49c2b6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:16:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-d6500d2b-df0d-4091-986b-c79cfbc3b943 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:16:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-d6500d2b-df0d-4091-986b-c79cfbc3b943 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json" returned: 0 in 0.178s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:16:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-d6500d2b-df0d-4091-986b-c79cfbc3b943 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6,backing_fmt=raw /opt/stack/data/nova/instances/138c85af-655a-4a5c-ade7-daa7d7b58456/disk 1073741824 {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:16:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-d6500d2b-df0d-4091-986b-c79cfbc3b943 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6,backing_fmt=raw /opt/stack/data/nova/instances/138c85af-655a-4a5c-ade7-daa7d7b58456/disk 1073741824" returned: 0 in 0.052s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:16:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-d6500d2b-df0d-4091-986b-c79cfbc3b943 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Lock "88c50a45bec9d6b0427462b3242b9b8e5f49c2b6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.238s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:16:48 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-d6500d2b-df0d-4091-986b-c79cfbc3b943 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:16:48 user nova-compute[75216]: DEBUG nova.network.neutron [None req-d6500d2b-df0d-4091-986b-c79cfbc3b943 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] [instance: 138c85af-655a-4a5c-ade7-daa7d7b58456] Successfully created port: 0d05704a-f922-44ef-984d-7c1d9e8546e5 {{(pid=75216) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 19:16:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-d6500d2b-df0d-4091-986b-c79cfbc3b943 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json" returned: 0 in 0.177s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:16:49 user nova-compute[75216]: DEBUG nova.virt.disk.api [None req-d6500d2b-df0d-4091-986b-c79cfbc3b943 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Checking if we can resize image /opt/stack/data/nova/instances/138c85af-655a-4a5c-ade7-daa7d7b58456/disk. size=1073741824 {{(pid=75216) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 19:16:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-d6500d2b-df0d-4091-986b-c79cfbc3b943 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/138c85af-655a-4a5c-ade7-daa7d7b58456/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:16:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-d6500d2b-df0d-4091-986b-c79cfbc3b943 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/138c85af-655a-4a5c-ade7-daa7d7b58456/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:16:49 user nova-compute[75216]: DEBUG nova.virt.disk.api [None req-d6500d2b-df0d-4091-986b-c79cfbc3b943 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Cannot resize image /opt/stack/data/nova/instances/138c85af-655a-4a5c-ade7-daa7d7b58456/disk to a smaller size. {{(pid=75216) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 19:16:49 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-d6500d2b-df0d-4091-986b-c79cfbc3b943 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] [instance: 138c85af-655a-4a5c-ade7-daa7d7b58456] Created local disks {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 19:16:49 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-d6500d2b-df0d-4091-986b-c79cfbc3b943 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] [instance: 138c85af-655a-4a5c-ade7-daa7d7b58456] Ensure instance console log exists: /opt/stack/data/nova/instances/138c85af-655a-4a5c-ade7-daa7d7b58456/console.log {{(pid=75216) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 19:16:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-d6500d2b-df0d-4091-986b-c79cfbc3b943 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:16:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-d6500d2b-df0d-4091-986b-c79cfbc3b943 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:16:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-d6500d2b-df0d-4091-986b-c79cfbc3b943 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:16:49 user nova-compute[75216]: DEBUG nova.network.neutron [None req-d6500d2b-df0d-4091-986b-c79cfbc3b943 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] [instance: 138c85af-655a-4a5c-ade7-daa7d7b58456] Successfully updated port: 0d05704a-f922-44ef-984d-7c1d9e8546e5 {{(pid=75216) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 19:16:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-d6500d2b-df0d-4091-986b-c79cfbc3b943 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Acquiring lock "refresh_cache-138c85af-655a-4a5c-ade7-daa7d7b58456" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 19:16:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-d6500d2b-df0d-4091-986b-c79cfbc3b943 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Acquired lock "refresh_cache-138c85af-655a-4a5c-ade7-daa7d7b58456" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 19:16:49 user nova-compute[75216]: DEBUG nova.network.neutron [None req-d6500d2b-df0d-4091-986b-c79cfbc3b943 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] [instance: 138c85af-655a-4a5c-ade7-daa7d7b58456] Building network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 19:16:49 user nova-compute[75216]: DEBUG nova.compute.manager [req-4e83c5ba-52a3-46e0-8e8e-6e8af6a45e70 req-1292b454-76ce-4926-b7ca-40f8b5c23949 service nova] [instance: 138c85af-655a-4a5c-ade7-daa7d7b58456] Received event network-changed-0d05704a-f922-44ef-984d-7c1d9e8546e5 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:16:49 user nova-compute[75216]: DEBUG nova.compute.manager [req-4e83c5ba-52a3-46e0-8e8e-6e8af6a45e70 req-1292b454-76ce-4926-b7ca-40f8b5c23949 service nova] [instance: 138c85af-655a-4a5c-ade7-daa7d7b58456] Refreshing instance network info cache due to event network-changed-0d05704a-f922-44ef-984d-7c1d9e8546e5. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 19:16:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-4e83c5ba-52a3-46e0-8e8e-6e8af6a45e70 req-1292b454-76ce-4926-b7ca-40f8b5c23949 service nova] Acquiring lock "refresh_cache-138c85af-655a-4a5c-ade7-daa7d7b58456" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 19:16:49 user nova-compute[75216]: DEBUG nova.network.neutron [None req-d6500d2b-df0d-4091-986b-c79cfbc3b943 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] [instance: 138c85af-655a-4a5c-ade7-daa7d7b58456] Instance cache missing network info. {{(pid=75216) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 19:16:49 user nova-compute[75216]: DEBUG nova.network.neutron [None req-d6500d2b-df0d-4091-986b-c79cfbc3b943 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] [instance: 138c85af-655a-4a5c-ade7-daa7d7b58456] Updating instance_info_cache with network_info: [{"id": "0d05704a-f922-44ef-984d-7c1d9e8546e5", "address": "fa:16:3e:0d:29:74", "network": {"id": "5c3296e5-d81b-4378-9108-bcc3ced5458a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-381226649-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e8c5d1e9e06c4202b31637288388048a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d05704a-f9", "ovs_interfaceid": "0d05704a-f922-44ef-984d-7c1d9e8546e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:16:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-d6500d2b-df0d-4091-986b-c79cfbc3b943 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Releasing lock "refresh_cache-138c85af-655a-4a5c-ade7-daa7d7b58456" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 19:16:49 user nova-compute[75216]: DEBUG nova.compute.manager [None req-d6500d2b-df0d-4091-986b-c79cfbc3b943 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] [instance: 138c85af-655a-4a5c-ade7-daa7d7b58456] Instance network_info: |[{"id": "0d05704a-f922-44ef-984d-7c1d9e8546e5", "address": "fa:16:3e:0d:29:74", "network": {"id": "5c3296e5-d81b-4378-9108-bcc3ced5458a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-381226649-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e8c5d1e9e06c4202b31637288388048a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d05704a-f9", "ovs_interfaceid": "0d05704a-f922-44ef-984d-7c1d9e8546e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 19:16:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-4e83c5ba-52a3-46e0-8e8e-6e8af6a45e70 req-1292b454-76ce-4926-b7ca-40f8b5c23949 service nova] Acquired lock "refresh_cache-138c85af-655a-4a5c-ade7-daa7d7b58456" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 19:16:49 user nova-compute[75216]: DEBUG nova.network.neutron [req-4e83c5ba-52a3-46e0-8e8e-6e8af6a45e70 req-1292b454-76ce-4926-b7ca-40f8b5c23949 service nova] [instance: 138c85af-655a-4a5c-ade7-daa7d7b58456] Refreshing network info cache for port 0d05704a-f922-44ef-984d-7c1d9e8546e5 {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 19:16:49 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-d6500d2b-df0d-4091-986b-c79cfbc3b943 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] [instance: 138c85af-655a-4a5c-ade7-daa7d7b58456] Start _get_guest_xml network_info=[{"id": "0d05704a-f922-44ef-984d-7c1d9e8546e5", "address": "fa:16:3e:0d:29:74", "network": {"id": "5c3296e5-d81b-4378-9108-bcc3ced5458a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-381226649-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e8c5d1e9e06c4202b31637288388048a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d05704a-f9", "ovs_interfaceid": "0d05704a-f922-44ef-984d-7c1d9e8546e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T18:41:06Z,direct_url=<?>,disk_format='qcow2',id=77bcb5ba-8510-41ec-a88d-96097bb431de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c465b7c26ec44582b6d1b7169536ecc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T18:41:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'guest_format': None, 'boot_index': 0, 'image_id': '77bcb5ba-8510-41ec-a88d-96097bb431de'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 19:16:49 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-d6500d2b-df0d-4091-986b-c79cfbc3b943 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 19:16:49 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-d6500d2b-df0d-4091-986b-c79cfbc3b943 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 19:16:49 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-d6500d2b-df0d-4091-986b-c79cfbc3b943 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 19:16:49 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-d6500d2b-df0d-4091-986b-c79cfbc3b943 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] CPU controller missing on host. {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 19:16:49 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-d6500d2b-df0d-4091-986b-c79cfbc3b943 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 19:16:49 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-d6500d2b-df0d-4091-986b-c79cfbc3b943 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] CPU controller found on host. {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 19:16:49 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-d6500d2b-df0d-4091-986b-c79cfbc3b943 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75216) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 19:16:49 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-d6500d2b-df0d-4091-986b-c79cfbc3b943 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T18:40:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T18:41:06Z,direct_url=<?>,disk_format='qcow2',id=77bcb5ba-8510-41ec-a88d-96097bb431de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c465b7c26ec44582b6d1b7169536ecc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T18:41:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 19:16:49 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-d6500d2b-df0d-4091-986b-c79cfbc3b943 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Flavor limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 19:16:49 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-d6500d2b-df0d-4091-986b-c79cfbc3b943 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Image limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 19:16:49 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-d6500d2b-df0d-4091-986b-c79cfbc3b943 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Flavor pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 19:16:49 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-d6500d2b-df0d-4091-986b-c79cfbc3b943 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Image pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 19:16:49 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-d6500d2b-df0d-4091-986b-c79cfbc3b943 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 19:16:49 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-d6500d2b-df0d-4091-986b-c79cfbc3b943 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 19:16:49 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-d6500d2b-df0d-4091-986b-c79cfbc3b943 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 19:16:49 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-d6500d2b-df0d-4091-986b-c79cfbc3b943 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Got 1 possible topologies {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 19:16:49 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-d6500d2b-df0d-4091-986b-c79cfbc3b943 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 19:16:49 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-d6500d2b-df0d-4091-986b-c79cfbc3b943 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 19:16:49 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-d6500d2b-df0d-4091-986b-c79cfbc3b943 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T19:16:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-969172510',display_name='tempest-VolumesSnapshotTestJSON-instance-969172510',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-969172510',id=41,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDgzuYicWKfx8qQkUR4zZOJZFbX73zKCl1HJ6Hc5Y2oVfgdyB37L5V3oSNSqhbA+60Ya0uDClcogBt45XeMg0/RZE9Y10xquuh8OXOkjq41hwoahXtq1seJ5MlnOAzPWWg==',key_name='tempest-keypair-1095906425',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e8c5d1e9e06c4202b31637288388048a',ramdisk_id='',reservation_id='r-0tdoy5xf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1725517259',owner_user_name='tempest-VolumesSnapshotTestJSON-1725517259-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T19:16:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='75359f2870344d9d83ce124a7a990aaf',uuid=138c85af-655a-4a5c-ade7-daa7d7b58456,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0d05704a-f922-44ef-984d-7c1d9e8546e5", "address": "fa:16:3e:0d:29:74", "network": {"id": "5c3296e5-d81b-4378-9108-bcc3ced5458a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-381226649-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e8c5d1e9e06c4202b31637288388048a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d05704a-f9", "ovs_interfaceid": "0d05704a-f922-44ef-984d-7c1d9e8546e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75216) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 19:16:49 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-d6500d2b-df0d-4091-986b-c79cfbc3b943 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Converting VIF {"id": "0d05704a-f922-44ef-984d-7c1d9e8546e5", "address": "fa:16:3e:0d:29:74", "network": {"id": "5c3296e5-d81b-4378-9108-bcc3ced5458a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-381226649-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e8c5d1e9e06c4202b31637288388048a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d05704a-f9", "ovs_interfaceid": "0d05704a-f922-44ef-984d-7c1d9e8546e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 19:16:49 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-d6500d2b-df0d-4091-986b-c79cfbc3b943 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:29:74,bridge_name='br-int',has_traffic_filtering=True,id=0d05704a-f922-44ef-984d-7c1d9e8546e5,network=Network(5c3296e5-d81b-4378-9108-bcc3ced5458a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d05704a-f9') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 19:16:49 user nova-compute[75216]: DEBUG nova.objects.instance [None req-d6500d2b-df0d-4091-986b-c79cfbc3b943 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Lazy-loading 'pci_devices' on Instance uuid 138c85af-655a-4a5c-ade7-daa7d7b58456 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:16:49 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-d6500d2b-df0d-4091-986b-c79cfbc3b943 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] [instance: 138c85af-655a-4a5c-ade7-daa7d7b58456] End _get_guest_xml xml=<domain type="kvm">
Nov 13 19:16:49 user nova-compute[75216]:   <uuid>138c85af-655a-4a5c-ade7-daa7d7b58456</uuid>
Nov 13 19:16:49 user nova-compute[75216]:   <name>instance-00000029</name>
Nov 13 19:16:49 user nova-compute[75216]:   <memory>524288</memory>
Nov 13 19:16:49 user nova-compute[75216]:   <vcpu>1</vcpu>
Nov 13 19:16:49 user nova-compute[75216]:   <metadata>
Nov 13 19:16:49 user nova-compute[75216]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 19:16:49 user nova-compute[75216]:       <nova:package version="0.0.0"/>
Nov 13 19:16:49 user nova-compute[75216]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-969172510</nova:name>
Nov 13 19:16:49 user nova-compute[75216]:       <nova:creationTime>2023-11-13 19:16:49</nova:creationTime>
Nov 13 19:16:49 user nova-compute[75216]:       <nova:flavor name="m1.tiny">
Nov 13 19:16:49 user nova-compute[75216]:         <nova:memory>512</nova:memory>
Nov 13 19:16:49 user nova-compute[75216]:         <nova:disk>1</nova:disk>
Nov 13 19:16:49 user nova-compute[75216]:         <nova:swap>0</nova:swap>
Nov 13 19:16:49 user nova-compute[75216]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 19:16:49 user nova-compute[75216]:         <nova:vcpus>1</nova:vcpus>
Nov 13 19:16:49 user nova-compute[75216]:       </nova:flavor>
Nov 13 19:16:49 user nova-compute[75216]:       <nova:owner>
Nov 13 19:16:49 user nova-compute[75216]:         <nova:user uuid="75359f2870344d9d83ce124a7a990aaf">tempest-VolumesSnapshotTestJSON-1725517259-project-member</nova:user>
Nov 13 19:16:49 user nova-compute[75216]:         <nova:project uuid="e8c5d1e9e06c4202b31637288388048a">tempest-VolumesSnapshotTestJSON-1725517259</nova:project>
Nov 13 19:16:49 user nova-compute[75216]:       </nova:owner>
Nov 13 19:16:49 user nova-compute[75216]:       <nova:root type="image" uuid="77bcb5ba-8510-41ec-a88d-96097bb431de"/>
Nov 13 19:16:49 user nova-compute[75216]:       <nova:ports>
Nov 13 19:16:49 user nova-compute[75216]:         <nova:port uuid="0d05704a-f922-44ef-984d-7c1d9e8546e5">
Nov 13 19:16:49 user nova-compute[75216]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 13 19:16:49 user nova-compute[75216]:         </nova:port>
Nov 13 19:16:49 user nova-compute[75216]:       </nova:ports>
Nov 13 19:16:49 user nova-compute[75216]:     </nova:instance>
Nov 13 19:16:49 user nova-compute[75216]:   </metadata>
Nov 13 19:16:49 user nova-compute[75216]:   <sysinfo type="smbios">
Nov 13 19:16:49 user nova-compute[75216]:     <system>
Nov 13 19:16:49 user nova-compute[75216]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 19:16:49 user nova-compute[75216]:       <entry name="product">OpenStack Nova</entry>
Nov 13 19:16:49 user nova-compute[75216]:       <entry name="version">0.0.0</entry>
Nov 13 19:16:49 user nova-compute[75216]:       <entry name="serial">138c85af-655a-4a5c-ade7-daa7d7b58456</entry>
Nov 13 19:16:49 user nova-compute[75216]:       <entry name="uuid">138c85af-655a-4a5c-ade7-daa7d7b58456</entry>
Nov 13 19:16:49 user nova-compute[75216]:       <entry name="family">Virtual Machine</entry>
Nov 13 19:16:49 user nova-compute[75216]:     </system>
Nov 13 19:16:49 user nova-compute[75216]:   </sysinfo>
Nov 13 19:16:49 user nova-compute[75216]:   <os>
Nov 13 19:16:49 user nova-compute[75216]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 19:16:49 user nova-compute[75216]:     <boot dev="hd"/>
Nov 13 19:16:49 user nova-compute[75216]:     <smbios mode="sysinfo"/>
Nov 13 19:16:49 user nova-compute[75216]:   </os>
Nov 13 19:16:49 user nova-compute[75216]:   <features>
Nov 13 19:16:49 user nova-compute[75216]:     <acpi/>
Nov 13 19:16:49 user nova-compute[75216]:     <apic/>
Nov 13 19:16:49 user nova-compute[75216]:     <vmcoreinfo/>
Nov 13 19:16:49 user nova-compute[75216]:   </features>
Nov 13 19:16:49 user nova-compute[75216]:   <clock offset="utc">
Nov 13 19:16:49 user nova-compute[75216]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 19:16:49 user nova-compute[75216]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 19:16:49 user nova-compute[75216]:     <timer name="hpet" present="no"/>
Nov 13 19:16:49 user nova-compute[75216]:   </clock>
Nov 13 19:16:49 user nova-compute[75216]:   <cpu mode="custom" match="exact">
Nov 13 19:16:49 user nova-compute[75216]:     <model>Nehalem</model>
Nov 13 19:16:49 user nova-compute[75216]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 19:16:49 user nova-compute[75216]:   </cpu>
Nov 13 19:16:49 user nova-compute[75216]:   <devices>
Nov 13 19:16:49 user nova-compute[75216]:     <disk type="file" device="disk">
Nov 13 19:16:49 user nova-compute[75216]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 19:16:49 user nova-compute[75216]:       <source file="/opt/stack/data/nova/instances/138c85af-655a-4a5c-ade7-daa7d7b58456/disk"/>
Nov 13 19:16:49 user nova-compute[75216]:       <target dev="vda" bus="virtio"/>
Nov 13 19:16:49 user nova-compute[75216]:     </disk>
Nov 13 19:16:49 user nova-compute[75216]:     <interface type="ethernet">
Nov 13 19:16:49 user nova-compute[75216]:       <mac address="fa:16:3e:0d:29:74"/>
Nov 13 19:16:49 user nova-compute[75216]:       <model type="virtio"/>
Nov 13 19:16:49 user nova-compute[75216]:       <mtu size="1442"/>
Nov 13 19:16:49 user nova-compute[75216]:       <target dev="tap0d05704a-f9"/>
Nov 13 19:16:49 user nova-compute[75216]:     </interface>
Nov 13 19:16:49 user nova-compute[75216]:     <serial type="pty">
Nov 13 19:16:49 user nova-compute[75216]:       <log file="/opt/stack/data/nova/instances/138c85af-655a-4a5c-ade7-daa7d7b58456/console.log" append="off"/>
Nov 13 19:16:49 user nova-compute[75216]:     </serial>
Nov 13 19:16:49 user nova-compute[75216]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 19:16:49 user nova-compute[75216]:     <video>
Nov 13 19:16:49 user nova-compute[75216]:       <model type="virtio"/>
Nov 13 19:16:49 user nova-compute[75216]:     </video>
Nov 13 19:16:49 user nova-compute[75216]:     <rng model="virtio">
Nov 13 19:16:49 user nova-compute[75216]:       <backend model="random">/dev/urandom</backend>
Nov 13 19:16:49 user nova-compute[75216]:     </rng>
Nov 13 19:16:49 user nova-compute[75216]:     <controller type="usb" index="0" model="none"/>
Nov 13 19:16:49 user nova-compute[75216]:     <memballoon model="virtio">
Nov 13 19:16:49 user nova-compute[75216]:       <stats period="10"/>
Nov 13 19:16:49 user nova-compute[75216]:     </memballoon>
Nov 13 19:16:49 user nova-compute[75216]:   </devices>
Nov 13 19:16:49 user nova-compute[75216]: </domain>
Nov 13 19:16:49 user nova-compute[75216]:  {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 19:16:49 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-d6500d2b-df0d-4091-986b-c79cfbc3b943 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T19:16:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-969172510',display_name='tempest-VolumesSnapshotTestJSON-instance-969172510',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-969172510',id=41,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDgzuYicWKfx8qQkUR4zZOJZFbX73zKCl1HJ6Hc5Y2oVfgdyB37L5V3oSNSqhbA+60Ya0uDClcogBt45XeMg0/RZE9Y10xquuh8OXOkjq41hwoahXtq1seJ5MlnOAzPWWg==',key_name='tempest-keypair-1095906425',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e8c5d1e9e06c4202b31637288388048a',ramdisk_id='',reservation_id='r-0tdoy5xf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1725517259',owner_user_name='tempest-VolumesSnapshotTestJSON-1725517259-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T19:16:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='75359f2870344d9d83ce124a7a990aaf',uuid=138c85af-655a-4a5c-ade7-daa7d7b58456,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0d05704a-f922-44ef-984d-7c1d9e8546e5", "address": "fa:16:3e:0d:29:74", "network": {"id": "5c3296e5-d81b-4378-9108-bcc3ced5458a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-381226649-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e8c5d1e9e06c4202b31637288388048a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d05704a-f9", "ovs_interfaceid": "0d05704a-f922-44ef-984d-7c1d9e8546e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 19:16:49 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-d6500d2b-df0d-4091-986b-c79cfbc3b943 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Converting VIF {"id": "0d05704a-f922-44ef-984d-7c1d9e8546e5", "address": "fa:16:3e:0d:29:74", "network": {"id": "5c3296e5-d81b-4378-9108-bcc3ced5458a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-381226649-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e8c5d1e9e06c4202b31637288388048a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d05704a-f9", "ovs_interfaceid": "0d05704a-f922-44ef-984d-7c1d9e8546e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 19:16:49 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-d6500d2b-df0d-4091-986b-c79cfbc3b943 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:29:74,bridge_name='br-int',has_traffic_filtering=True,id=0d05704a-f922-44ef-984d-7c1d9e8546e5,network=Network(5c3296e5-d81b-4378-9108-bcc3ced5458a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d05704a-f9') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 19:16:49 user nova-compute[75216]: DEBUG os_vif [None req-d6500d2b-df0d-4091-986b-c79cfbc3b943 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:29:74,bridge_name='br-int',has_traffic_filtering=True,id=0d05704a-f922-44ef-984d-7c1d9e8546e5,network=Network(5c3296e5-d81b-4378-9108-bcc3ced5458a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d05704a-f9') {{(pid=75216) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 19:16:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:16:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:16:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 19:16:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:16:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd9f73d53-baa3-50ea-8d3d-4bd6fb403cf8', '_type': 'linux-noop'}}, row=False) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:16:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:16:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:16:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:16:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0d05704a-f9, may_exist=True, interface_attrs={}) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:16:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0d05704a-f9, col_values=(('qos', UUID('2ea30a50-797b-4ae2-a1e1-32a3e88fb983')),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:16:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0d05704a-f9, col_values=(('external_ids', {'iface-id': '0d05704a-f922-44ef-984d-7c1d9e8546e5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0d:29:74', 'vm-uuid': '138c85af-655a-4a5c-ade7-daa7d7b58456'}),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:16:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:16:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:16:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:16:49 user nova-compute[75216]: INFO os_vif [None req-d6500d2b-df0d-4091-986b-c79cfbc3b943 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:29:74,bridge_name='br-int',has_traffic_filtering=True,id=0d05704a-f922-44ef-984d-7c1d9e8546e5,network=Network(5c3296e5-d81b-4378-9108-bcc3ced5458a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d05704a-f9')
Nov 13 19:16:50 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-d6500d2b-df0d-4091-986b-c79cfbc3b943 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 19:16:50 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-d6500d2b-df0d-4091-986b-c79cfbc3b943 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] No VIF found with MAC fa:16:3e:0d:29:74, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 19:16:50 user nova-compute[75216]: DEBUG nova.network.neutron [req-4e83c5ba-52a3-46e0-8e8e-6e8af6a45e70 req-1292b454-76ce-4926-b7ca-40f8b5c23949 service nova] [instance: 138c85af-655a-4a5c-ade7-daa7d7b58456] Updated VIF entry in instance network info cache for port 0d05704a-f922-44ef-984d-7c1d9e8546e5. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 19:16:50 user nova-compute[75216]: DEBUG nova.network.neutron [req-4e83c5ba-52a3-46e0-8e8e-6e8af6a45e70 req-1292b454-76ce-4926-b7ca-40f8b5c23949 service nova] [instance: 138c85af-655a-4a5c-ade7-daa7d7b58456] Updating instance_info_cache with network_info: [{"id": "0d05704a-f922-44ef-984d-7c1d9e8546e5", "address": "fa:16:3e:0d:29:74", "network": {"id": "5c3296e5-d81b-4378-9108-bcc3ced5458a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-381226649-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e8c5d1e9e06c4202b31637288388048a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d05704a-f9", "ovs_interfaceid": "0d05704a-f922-44ef-984d-7c1d9e8546e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:16:50 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-4e83c5ba-52a3-46e0-8e8e-6e8af6a45e70 req-1292b454-76ce-4926-b7ca-40f8b5c23949 service nova] Releasing lock "refresh_cache-138c85af-655a-4a5c-ade7-daa7d7b58456" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 19:16:51 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:16:51 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:16:51 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:16:51 user nova-compute[75216]: DEBUG nova.compute.manager [req-938956ea-c542-47ae-92de-9d0e1bbc28b1 req-8499fdb4-29cb-49a6-a8a3-406a292f0d62 service nova] [instance: 138c85af-655a-4a5c-ade7-daa7d7b58456] Received event network-vif-plugged-0d05704a-f922-44ef-984d-7c1d9e8546e5 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:16:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-938956ea-c542-47ae-92de-9d0e1bbc28b1 req-8499fdb4-29cb-49a6-a8a3-406a292f0d62 service nova] Acquiring lock "138c85af-655a-4a5c-ade7-daa7d7b58456-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:16:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-938956ea-c542-47ae-92de-9d0e1bbc28b1 req-8499fdb4-29cb-49a6-a8a3-406a292f0d62 service nova] Lock "138c85af-655a-4a5c-ade7-daa7d7b58456-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:16:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-938956ea-c542-47ae-92de-9d0e1bbc28b1 req-8499fdb4-29cb-49a6-a8a3-406a292f0d62 service nova] Lock "138c85af-655a-4a5c-ade7-daa7d7b58456-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:16:51 user nova-compute[75216]: DEBUG nova.compute.manager [req-938956ea-c542-47ae-92de-9d0e1bbc28b1 req-8499fdb4-29cb-49a6-a8a3-406a292f0d62 service nova] [instance: 138c85af-655a-4a5c-ade7-daa7d7b58456] No waiting events found dispatching network-vif-plugged-0d05704a-f922-44ef-984d-7c1d9e8546e5 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 19:16:51 user nova-compute[75216]: WARNING nova.compute.manager [req-938956ea-c542-47ae-92de-9d0e1bbc28b1 req-8499fdb4-29cb-49a6-a8a3-406a292f0d62 service nova] [instance: 138c85af-655a-4a5c-ade7-daa7d7b58456] Received unexpected event network-vif-plugged-0d05704a-f922-44ef-984d-7c1d9e8546e5 for instance with vm_state building and task_state spawning.
Nov 13 19:16:51 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:16:51 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:16:51 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:16:51 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:16:51 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:16:53 user nova-compute[75216]: DEBUG nova.compute.manager [None req-d6500d2b-df0d-4091-986b-c79cfbc3b943 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] [instance: 138c85af-655a-4a5c-ade7-daa7d7b58456] Instance event wait completed in 0 seconds for  {{(pid=75216) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 19:16:53 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-d6500d2b-df0d-4091-986b-c79cfbc3b943 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] [instance: 138c85af-655a-4a5c-ade7-daa7d7b58456] Guest created on hypervisor {{(pid=75216) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 19:16:53 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 138c85af-655a-4a5c-ade7-daa7d7b58456] Instance spawned successfully.
Nov 13 19:16:53 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-d6500d2b-df0d-4091-986b-c79cfbc3b943 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] [instance: 138c85af-655a-4a5c-ade7-daa7d7b58456] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 19:16:53 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-d6500d2b-df0d-4091-986b-c79cfbc3b943 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] [instance: 138c85af-655a-4a5c-ade7-daa7d7b58456] Found default for hw_cdrom_bus of ide {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 19:16:53 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-d6500d2b-df0d-4091-986b-c79cfbc3b943 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] [instance: 138c85af-655a-4a5c-ade7-daa7d7b58456] Found default for hw_disk_bus of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 19:16:53 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-d6500d2b-df0d-4091-986b-c79cfbc3b943 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] [instance: 138c85af-655a-4a5c-ade7-daa7d7b58456] Found default for hw_input_bus of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 19:16:53 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-d6500d2b-df0d-4091-986b-c79cfbc3b943 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] [instance: 138c85af-655a-4a5c-ade7-daa7d7b58456] Found default for hw_pointer_model of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 19:16:53 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-d6500d2b-df0d-4091-986b-c79cfbc3b943 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] [instance: 138c85af-655a-4a5c-ade7-daa7d7b58456] Found default for hw_video_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 19:16:53 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-d6500d2b-df0d-4091-986b-c79cfbc3b943 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] [instance: 138c85af-655a-4a5c-ade7-daa7d7b58456] Found default for hw_vif_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 19:16:53 user nova-compute[75216]: INFO nova.compute.manager [None req-d6500d2b-df0d-4091-986b-c79cfbc3b943 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] [instance: 138c85af-655a-4a5c-ade7-daa7d7b58456] Took 5.07 seconds to spawn the instance on the hypervisor.
Nov 13 19:16:53 user nova-compute[75216]: DEBUG nova.compute.manager [None req-d6500d2b-df0d-4091-986b-c79cfbc3b943 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] [instance: 138c85af-655a-4a5c-ade7-daa7d7b58456] Checking state {{(pid=75216) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 19:16:53 user nova-compute[75216]: INFO nova.compute.manager [None req-d6500d2b-df0d-4091-986b-c79cfbc3b943 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] [instance: 138c85af-655a-4a5c-ade7-daa7d7b58456] Took 5.63 seconds to build instance.
Nov 13 19:16:53 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-d6500d2b-df0d-4091-986b-c79cfbc3b943 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Lock "138c85af-655a-4a5c-ade7-daa7d7b58456" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.721s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:16:53 user nova-compute[75216]: DEBUG nova.compute.manager [req-325af22f-ba66-477c-88a3-8a819985d52d req-5f4b2a89-1d5e-401a-a733-1974004b8135 service nova] [instance: 138c85af-655a-4a5c-ade7-daa7d7b58456] Received event network-vif-plugged-0d05704a-f922-44ef-984d-7c1d9e8546e5 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:16:53 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-325af22f-ba66-477c-88a3-8a819985d52d req-5f4b2a89-1d5e-401a-a733-1974004b8135 service nova] Acquiring lock "138c85af-655a-4a5c-ade7-daa7d7b58456-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:16:53 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-325af22f-ba66-477c-88a3-8a819985d52d req-5f4b2a89-1d5e-401a-a733-1974004b8135 service nova] Lock "138c85af-655a-4a5c-ade7-daa7d7b58456-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:16:53 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-325af22f-ba66-477c-88a3-8a819985d52d req-5f4b2a89-1d5e-401a-a733-1974004b8135 service nova] Lock "138c85af-655a-4a5c-ade7-daa7d7b58456-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:16:53 user nova-compute[75216]: DEBUG nova.compute.manager [req-325af22f-ba66-477c-88a3-8a819985d52d req-5f4b2a89-1d5e-401a-a733-1974004b8135 service nova] [instance: 138c85af-655a-4a5c-ade7-daa7d7b58456] No waiting events found dispatching network-vif-plugged-0d05704a-f922-44ef-984d-7c1d9e8546e5 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 19:16:53 user nova-compute[75216]: WARNING nova.compute.manager [req-325af22f-ba66-477c-88a3-8a819985d52d req-5f4b2a89-1d5e-401a-a733-1974004b8135 service nova] [instance: 138c85af-655a-4a5c-ade7-daa7d7b58456] Received unexpected event network-vif-plugged-0d05704a-f922-44ef-984d-7c1d9e8546e5 for instance with vm_state active and task_state None.
Nov 13 19:16:54 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:16:54 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:16:59 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:17:00 user nova-compute[75216]: DEBUG nova.compute.manager [req-0990bfa1-9f55-4160-9d17-614d005145ca req-a730ff44-6ba5-4d48-93bf-afd7b7a758fb service nova] [instance: faa24a4e-f363-4649-a846-7e215ad027f0] Received event network-changed-721b085e-01c3-449a-b794-6251a01b4af2 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:17:00 user nova-compute[75216]: DEBUG nova.compute.manager [req-0990bfa1-9f55-4160-9d17-614d005145ca req-a730ff44-6ba5-4d48-93bf-afd7b7a758fb service nova] [instance: faa24a4e-f363-4649-a846-7e215ad027f0] Refreshing instance network info cache due to event network-changed-721b085e-01c3-449a-b794-6251a01b4af2. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 19:17:00 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-0990bfa1-9f55-4160-9d17-614d005145ca req-a730ff44-6ba5-4d48-93bf-afd7b7a758fb service nova] Acquiring lock "refresh_cache-faa24a4e-f363-4649-a846-7e215ad027f0" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 19:17:00 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-0990bfa1-9f55-4160-9d17-614d005145ca req-a730ff44-6ba5-4d48-93bf-afd7b7a758fb service nova] Acquired lock "refresh_cache-faa24a4e-f363-4649-a846-7e215ad027f0" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 19:17:00 user nova-compute[75216]: DEBUG nova.network.neutron [req-0990bfa1-9f55-4160-9d17-614d005145ca req-a730ff44-6ba5-4d48-93bf-afd7b7a758fb service nova] [instance: faa24a4e-f363-4649-a846-7e215ad027f0] Refreshing network info cache for port 721b085e-01c3-449a-b794-6251a01b4af2 {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 19:17:00 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:17:00 user nova-compute[75216]: DEBUG nova.network.neutron [req-0990bfa1-9f55-4160-9d17-614d005145ca req-a730ff44-6ba5-4d48-93bf-afd7b7a758fb service nova] [instance: faa24a4e-f363-4649-a846-7e215ad027f0] Updated VIF entry in instance network info cache for port 721b085e-01c3-449a-b794-6251a01b4af2. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 19:17:00 user nova-compute[75216]: DEBUG nova.network.neutron [req-0990bfa1-9f55-4160-9d17-614d005145ca req-a730ff44-6ba5-4d48-93bf-afd7b7a758fb service nova] [instance: faa24a4e-f363-4649-a846-7e215ad027f0] Updating instance_info_cache with network_info: [{"id": "721b085e-01c3-449a-b794-6251a01b4af2", "address": "fa:16:3e:86:0a:5f", "network": {"id": "9dcbadf2-6b5e-41f1-88a3-17a579ad1bad", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-926239573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d06cae29094846f1817036dc761a565d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap721b085e-01", "ovs_interfaceid": "721b085e-01c3-449a-b794-6251a01b4af2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:17:00 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-0990bfa1-9f55-4160-9d17-614d005145ca req-a730ff44-6ba5-4d48-93bf-afd7b7a758fb service nova] Releasing lock "refresh_cache-faa24a4e-f363-4649-a846-7e215ad027f0" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 19:17:01 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-ab47b64e-dd27-4a0a-8876-d7a328bcb823 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Acquiring lock "faa24a4e-f363-4649-a846-7e215ad027f0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:17:01 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-ab47b64e-dd27-4a0a-8876-d7a328bcb823 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Lock "faa24a4e-f363-4649-a846-7e215ad027f0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:17:01 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-ab47b64e-dd27-4a0a-8876-d7a328bcb823 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Acquiring lock "faa24a4e-f363-4649-a846-7e215ad027f0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:17:01 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-ab47b64e-dd27-4a0a-8876-d7a328bcb823 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Lock "faa24a4e-f363-4649-a846-7e215ad027f0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:17:01 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-ab47b64e-dd27-4a0a-8876-d7a328bcb823 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Lock "faa24a4e-f363-4649-a846-7e215ad027f0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:17:01 user nova-compute[75216]: INFO nova.compute.manager [None req-ab47b64e-dd27-4a0a-8876-d7a328bcb823 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] [instance: faa24a4e-f363-4649-a846-7e215ad027f0] Terminating instance
Nov 13 19:17:01 user nova-compute[75216]: DEBUG nova.compute.manager [None req-ab47b64e-dd27-4a0a-8876-d7a328bcb823 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] [instance: faa24a4e-f363-4649-a846-7e215ad027f0] Start destroying the instance on the hypervisor. {{(pid=75216) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 19:17:01 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:17:01 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:17:01 user nova-compute[75216]: DEBUG nova.compute.manager [req-34a472b0-7582-4236-9cfb-ce7faee5d1de req-e0701e9e-da10-436a-97c4-26665a9d47b1 service nova] [instance: faa24a4e-f363-4649-a846-7e215ad027f0] Received event network-vif-unplugged-721b085e-01c3-449a-b794-6251a01b4af2 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:17:01 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-34a472b0-7582-4236-9cfb-ce7faee5d1de req-e0701e9e-da10-436a-97c4-26665a9d47b1 service nova] Acquiring lock "faa24a4e-f363-4649-a846-7e215ad027f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:17:01 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-34a472b0-7582-4236-9cfb-ce7faee5d1de req-e0701e9e-da10-436a-97c4-26665a9d47b1 service nova] Lock "faa24a4e-f363-4649-a846-7e215ad027f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:17:01 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-34a472b0-7582-4236-9cfb-ce7faee5d1de req-e0701e9e-da10-436a-97c4-26665a9d47b1 service nova] Lock "faa24a4e-f363-4649-a846-7e215ad027f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:17:01 user nova-compute[75216]: DEBUG nova.compute.manager [req-34a472b0-7582-4236-9cfb-ce7faee5d1de req-e0701e9e-da10-436a-97c4-26665a9d47b1 service nova] [instance: faa24a4e-f363-4649-a846-7e215ad027f0] No waiting events found dispatching network-vif-unplugged-721b085e-01c3-449a-b794-6251a01b4af2 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 19:17:01 user nova-compute[75216]: DEBUG nova.compute.manager [req-34a472b0-7582-4236-9cfb-ce7faee5d1de req-e0701e9e-da10-436a-97c4-26665a9d47b1 service nova] [instance: faa24a4e-f363-4649-a846-7e215ad027f0] Received event network-vif-unplugged-721b085e-01c3-449a-b794-6251a01b4af2 for instance with task_state deleting. {{(pid=75216) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 19:17:02 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:17:02 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:17:02 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: faa24a4e-f363-4649-a846-7e215ad027f0] Instance destroyed successfully.
Nov 13 19:17:02 user nova-compute[75216]: DEBUG nova.objects.instance [None req-ab47b64e-dd27-4a0a-8876-d7a328bcb823 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Lazy-loading 'resources' on Instance uuid faa24a4e-f363-4649-a846-7e215ad027f0 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:17:02 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-ab47b64e-dd27-4a0a-8876-d7a328bcb823 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T19:15:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1406812321',display_name='tempest-AttachVolumeNegativeTest-server-1406812321',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1406812321',id=40,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBFeoj4ppip0XK8hMdi32G4V8fWtEi9UQvRrb2Rl3NUpfxFyDIcc2cJMQtCigGOaLZHexbyefrnjhU00kGTyX73AjIUdbzBZXHLIe2VvnVosV31eYF0isGj640gDDy+NcA==',key_name='tempest-keypair-1691670434',keypairs=<?>,launch_index=0,launched_at=2023-11-13T19:15:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d06cae29094846f1817036dc761a565d',ramdisk_id='',reservation_id='r-0i72oyl5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1187420962',owner_user_name='tempest-AttachVolumeNegativeTest-1187420962-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T19:15:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1ca750d884c3403394b46f53fbd633a1',uuid=faa24a4e-f363-4649-a846-7e215ad027f0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "721b085e-01c3-449a-b794-6251a01b4af2", "address": "fa:16:3e:86:0a:5f", "network": {"id": "9dcbadf2-6b5e-41f1-88a3-17a579ad1bad", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-926239573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d06cae29094846f1817036dc761a565d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap721b085e-01", "ovs_interfaceid": "721b085e-01c3-449a-b794-6251a01b4af2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 19:17:02 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-ab47b64e-dd27-4a0a-8876-d7a328bcb823 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Converting VIF {"id": "721b085e-01c3-449a-b794-6251a01b4af2", "address": "fa:16:3e:86:0a:5f", "network": {"id": "9dcbadf2-6b5e-41f1-88a3-17a579ad1bad", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-926239573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d06cae29094846f1817036dc761a565d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap721b085e-01", "ovs_interfaceid": "721b085e-01c3-449a-b794-6251a01b4af2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 19:17:02 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-ab47b64e-dd27-4a0a-8876-d7a328bcb823 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:86:0a:5f,bridge_name='br-int',has_traffic_filtering=True,id=721b085e-01c3-449a-b794-6251a01b4af2,network=Network(9dcbadf2-6b5e-41f1-88a3-17a579ad1bad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap721b085e-01') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 19:17:02 user nova-compute[75216]: DEBUG os_vif [None req-ab47b64e-dd27-4a0a-8876-d7a328bcb823 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:86:0a:5f,bridge_name='br-int',has_traffic_filtering=True,id=721b085e-01c3-449a-b794-6251a01b4af2,network=Network(9dcbadf2-6b5e-41f1-88a3-17a579ad1bad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap721b085e-01') {{(pid=75216) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 19:17:02 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:17:02 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap721b085e-01, bridge=br-int, if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:17:02 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:17:02 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:17:02 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:17:02 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d84736cb-301d-42bd-9ca7-d789d6112ef9) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:17:02 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:17:02 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:17:02 user nova-compute[75216]: INFO os_vif [None req-ab47b64e-dd27-4a0a-8876-d7a328bcb823 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:86:0a:5f,bridge_name='br-int',has_traffic_filtering=True,id=721b085e-01c3-449a-b794-6251a01b4af2,network=Network(9dcbadf2-6b5e-41f1-88a3-17a579ad1bad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap721b085e-01')
Nov 13 19:17:02 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-ab47b64e-dd27-4a0a-8876-d7a328bcb823 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] [instance: faa24a4e-f363-4649-a846-7e215ad027f0] Deleting instance files /opt/stack/data/nova/instances/faa24a4e-f363-4649-a846-7e215ad027f0_del
Nov 13 19:17:02 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-ab47b64e-dd27-4a0a-8876-d7a328bcb823 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] [instance: faa24a4e-f363-4649-a846-7e215ad027f0] Deletion of /opt/stack/data/nova/instances/faa24a4e-f363-4649-a846-7e215ad027f0_del complete
Nov 13 19:17:02 user nova-compute[75216]: INFO nova.compute.manager [None req-ab47b64e-dd27-4a0a-8876-d7a328bcb823 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] [instance: faa24a4e-f363-4649-a846-7e215ad027f0] Took 0.66 seconds to destroy the instance on the hypervisor.
Nov 13 19:17:02 user nova-compute[75216]: DEBUG oslo.service.loopingcall [None req-ab47b64e-dd27-4a0a-8876-d7a328bcb823 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75216) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 19:17:02 user nova-compute[75216]: DEBUG nova.compute.manager [-] [instance: faa24a4e-f363-4649-a846-7e215ad027f0] Deallocating network for instance {{(pid=75216) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 19:17:02 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: faa24a4e-f363-4649-a846-7e215ad027f0] deallocate_for_instance() {{(pid=75216) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 19:17:02 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: faa24a4e-f363-4649-a846-7e215ad027f0] Updating instance_info_cache with network_info: [] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:17:02 user nova-compute[75216]: INFO nova.compute.manager [-] [instance: faa24a4e-f363-4649-a846-7e215ad027f0] Took 0.60 seconds to deallocate network for instance.
Nov 13 19:17:02 user nova-compute[75216]: DEBUG nova.compute.manager [req-b40b29ef-f506-4d3a-897a-49e071f55e6a req-3c3e1ad8-db31-4b8d-b2b5-d8c324fe3d08 service nova] [instance: faa24a4e-f363-4649-a846-7e215ad027f0] Received event network-vif-deleted-721b085e-01c3-449a-b794-6251a01b4af2 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:17:03 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-ab47b64e-dd27-4a0a-8876-d7a328bcb823 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:17:03 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-ab47b64e-dd27-4a0a-8876-d7a328bcb823 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:17:03 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-ab47b64e-dd27-4a0a-8876-d7a328bcb823 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 19:17:03 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-ab47b64e-dd27-4a0a-8876-d7a328bcb823 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 19:17:03 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-ab47b64e-dd27-4a0a-8876-d7a328bcb823 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.157s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:17:03 user nova-compute[75216]: INFO nova.scheduler.client.report [None req-ab47b64e-dd27-4a0a-8876-d7a328bcb823 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Deleted allocations for instance faa24a4e-f363-4649-a846-7e215ad027f0
Nov 13 19:17:03 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-ab47b64e-dd27-4a0a-8876-d7a328bcb823 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Lock "faa24a4e-f363-4649-a846-7e215ad027f0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.596s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:17:04 user nova-compute[75216]: DEBUG nova.compute.manager [req-02601764-9e24-46fb-8a82-c08ef3dcd8d5 req-eff0c916-3a8c-4fa9-8b22-4f150c3660a2 service nova] [instance: faa24a4e-f363-4649-a846-7e215ad027f0] Received event network-vif-plugged-721b085e-01c3-449a-b794-6251a01b4af2 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:17:04 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-02601764-9e24-46fb-8a82-c08ef3dcd8d5 req-eff0c916-3a8c-4fa9-8b22-4f150c3660a2 service nova] Acquiring lock "faa24a4e-f363-4649-a846-7e215ad027f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:17:04 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-02601764-9e24-46fb-8a82-c08ef3dcd8d5 req-eff0c916-3a8c-4fa9-8b22-4f150c3660a2 service nova] Lock "faa24a4e-f363-4649-a846-7e215ad027f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:17:04 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-02601764-9e24-46fb-8a82-c08ef3dcd8d5 req-eff0c916-3a8c-4fa9-8b22-4f150c3660a2 service nova] Lock "faa24a4e-f363-4649-a846-7e215ad027f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:17:04 user nova-compute[75216]: DEBUG nova.compute.manager [req-02601764-9e24-46fb-8a82-c08ef3dcd8d5 req-eff0c916-3a8c-4fa9-8b22-4f150c3660a2 service nova] [instance: faa24a4e-f363-4649-a846-7e215ad027f0] No waiting events found dispatching network-vif-plugged-721b085e-01c3-449a-b794-6251a01b4af2 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 19:17:04 user nova-compute[75216]: WARNING nova.compute.manager [req-02601764-9e24-46fb-8a82-c08ef3dcd8d5 req-eff0c916-3a8c-4fa9-8b22-4f150c3660a2 service nova] [instance: faa24a4e-f363-4649-a846-7e215ad027f0] Received unexpected event network-vif-plugged-721b085e-01c3-449a-b794-6251a01b4af2 for instance with vm_state deleted and task_state None.
Nov 13 19:17:04 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:17:04 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:17:07 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:17:09 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:17:09 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:17:10 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:17:10 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:17:10 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75216) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 19:17:11 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:17:11 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:17:11 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:17:11 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:17:11 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:17:11 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Auditing locally available compute resources for user (node: user) {{(pid=75216) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 19:17:11 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b048c677-85bf-4a93-88eb-c71bde27bf5b/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:17:11 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b048c677-85bf-4a93-88eb-c71bde27bf5b/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:17:11 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b048c677-85bf-4a93-88eb-c71bde27bf5b/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:17:11 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b048c677-85bf-4a93-88eb-c71bde27bf5b/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:17:11 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 19:17:11 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/138c85af-655a-4a5c-ade7-daa7d7b58456/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:17:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/138c85af-655a-4a5c-ade7-daa7d7b58456/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:17:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/138c85af-655a-4a5c-ade7-daa7d7b58456/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:17:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/138c85af-655a-4a5c-ade7-daa7d7b58456/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:17:12 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:17:12 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 19:17:12 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 19:17:12 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Hypervisor/Node resource view: name=user free_ram=8785MB free_disk=25.329586029052734GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75216) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 19:17:12 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:17:12 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:17:12 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance b048c677-85bf-4a93-88eb-c71bde27bf5b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 19:17:12 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance 138c85af-655a-4a5c-ade7-daa7d7b58456 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 19:17:12 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 19:17:12 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 19:17:12 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 19:17:12 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 19:17:12 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Compute_service record updated for user:user {{(pid=75216) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 19:17:12 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.236s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:17:14 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:17:16 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:17:16 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Starting heal instance info cache {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 19:17:16 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "refresh_cache-b048c677-85bf-4a93-88eb-c71bde27bf5b" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 19:17:16 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquired lock "refresh_cache-b048c677-85bf-4a93-88eb-c71bde27bf5b" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 19:17:16 user nova-compute[75216]: DEBUG nova.network.neutron [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: b048c677-85bf-4a93-88eb-c71bde27bf5b] Forcefully refreshing network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 19:17:17 user nova-compute[75216]: DEBUG nova.network.neutron [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: b048c677-85bf-4a93-88eb-c71bde27bf5b] Updating instance_info_cache with network_info: [{"id": "4ae536b2-7829-45c2-8739-a3f838008e74", "address": "fa:16:3e:1a:59:bc", "network": {"id": "9dcbadf2-6b5e-41f1-88a3-17a579ad1bad", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-926239573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d06cae29094846f1817036dc761a565d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ae536b2-78", "ovs_interfaceid": "4ae536b2-7829-45c2-8739-a3f838008e74", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:17:17 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Releasing lock "refresh_cache-b048c677-85bf-4a93-88eb-c71bde27bf5b" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 19:17:17 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: b048c677-85bf-4a93-88eb-c71bde27bf5b] Updated the network info_cache for instance {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 19:17:17 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:17:17 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:17:19 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:17:22 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:17:24 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:17:24 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:17:27 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:17:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:17:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:17:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:17:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:17:40 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:17:42 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:17:46 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:17:47 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:17:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:17:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:17:52 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:17:52 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:17:52 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-b60a9d5a-d441-4341-983b-971b2d3b9960 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Acquiring lock "b048c677-85bf-4a93-88eb-c71bde27bf5b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:17:52 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-b60a9d5a-d441-4341-983b-971b2d3b9960 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Lock "b048c677-85bf-4a93-88eb-c71bde27bf5b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:17:52 user nova-compute[75216]: INFO nova.compute.manager [None req-b60a9d5a-d441-4341-983b-971b2d3b9960 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] [instance: b048c677-85bf-4a93-88eb-c71bde27bf5b] Detaching volume 8ce26031-aafa-4026-8ea9-3de9e9c348ec
Nov 13 19:17:52 user nova-compute[75216]: INFO nova.virt.block_device [None req-b60a9d5a-d441-4341-983b-971b2d3b9960 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] [instance: b048c677-85bf-4a93-88eb-c71bde27bf5b] Attempting to driver detach volume 8ce26031-aafa-4026-8ea9-3de9e9c348ec from mountpoint /dev/vdb
Nov 13 19:17:52 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-b60a9d5a-d441-4341-983b-971b2d3b9960 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Attempting to detach device vdb from instance b048c677-85bf-4a93-88eb-c71bde27bf5b from the persistent domain config. {{(pid=75216) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 13 19:17:52 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-b60a9d5a-d441-4341-983b-971b2d3b9960 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 19:17:52 user nova-compute[75216]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 19:17:52 user nova-compute[75216]:   <source dev="/dev/sde"/>
Nov 13 19:17:52 user nova-compute[75216]:   <target dev="vdb" bus="virtio"/>
Nov 13 19:17:52 user nova-compute[75216]:   <serial>8ce26031-aafa-4026-8ea9-3de9e9c348ec</serial>
Nov 13 19:17:52 user nova-compute[75216]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 19:17:52 user nova-compute[75216]: </disk>
Nov 13 19:17:52 user nova-compute[75216]:  {{(pid=75216) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 19:17:52 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-b60a9d5a-d441-4341-983b-971b2d3b9960 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Successfully detached device vdb from instance b048c677-85bf-4a93-88eb-c71bde27bf5b from the persistent domain config.
Nov 13 19:17:52 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-b60a9d5a-d441-4341-983b-971b2d3b9960 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b048c677-85bf-4a93-88eb-c71bde27bf5b from the live domain config. {{(pid=75216) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 13 19:17:52 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-b60a9d5a-d441-4341-983b-971b2d3b9960 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 19:17:52 user nova-compute[75216]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 19:17:52 user nova-compute[75216]:   <source dev="/dev/sde"/>
Nov 13 19:17:52 user nova-compute[75216]:   <target dev="vdb" bus="virtio"/>
Nov 13 19:17:52 user nova-compute[75216]:   <serial>8ce26031-aafa-4026-8ea9-3de9e9c348ec</serial>
Nov 13 19:17:52 user nova-compute[75216]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 19:17:52 user nova-compute[75216]: </disk>
Nov 13 19:17:52 user nova-compute[75216]:  {{(pid=75216) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 19:17:53 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-b60a9d5a-d441-4341-983b-971b2d3b9960 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b048c677-85bf-4a93-88eb-c71bde27bf5b {{(pid=75216) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 13 19:17:54 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:17:54 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:17:57 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-59335715-85bd-4e10-ad56-46a2c6bd9625 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Acquiring lock "de2e9a72-2d63-4de6-8d18-a9d7490579a9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:17:57 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-59335715-85bd-4e10-ad56-46a2c6bd9625 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Lock "de2e9a72-2d63-4de6-8d18-a9d7490579a9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:17:57 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:17:57 user nova-compute[75216]: DEBUG nova.compute.manager [None req-59335715-85bd-4e10-ad56-46a2c6bd9625 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] [instance: de2e9a72-2d63-4de6-8d18-a9d7490579a9] Starting instance... {{(pid=75216) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 19:17:57 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-59335715-85bd-4e10-ad56-46a2c6bd9625 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:17:57 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-59335715-85bd-4e10-ad56-46a2c6bd9625 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:17:57 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-59335715-85bd-4e10-ad56-46a2c6bd9625 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75216) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 19:17:57 user nova-compute[75216]: INFO nova.compute.claims [None req-59335715-85bd-4e10-ad56-46a2c6bd9625 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] [instance: de2e9a72-2d63-4de6-8d18-a9d7490579a9] Claim successful on node user
Nov 13 19:17:57 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-59335715-85bd-4e10-ad56-46a2c6bd9625 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 19:17:58 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-59335715-85bd-4e10-ad56-46a2c6bd9625 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 19:17:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-59335715-85bd-4e10-ad56-46a2c6bd9625 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.243s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:17:58 user nova-compute[75216]: DEBUG nova.compute.manager [None req-59335715-85bd-4e10-ad56-46a2c6bd9625 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] [instance: de2e9a72-2d63-4de6-8d18-a9d7490579a9] Start building networks asynchronously for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 19:17:58 user nova-compute[75216]: DEBUG nova.compute.manager [None req-59335715-85bd-4e10-ad56-46a2c6bd9625 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] [instance: de2e9a72-2d63-4de6-8d18-a9d7490579a9] Allocating IP information in the background. {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 19:17:58 user nova-compute[75216]: DEBUG nova.network.neutron [None req-59335715-85bd-4e10-ad56-46a2c6bd9625 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] [instance: de2e9a72-2d63-4de6-8d18-a9d7490579a9] allocate_for_instance() {{(pid=75216) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 19:17:58 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-59335715-85bd-4e10-ad56-46a2c6bd9625 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] [instance: de2e9a72-2d63-4de6-8d18-a9d7490579a9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 19:17:58 user nova-compute[75216]: DEBUG nova.compute.manager [None req-59335715-85bd-4e10-ad56-46a2c6bd9625 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] [instance: de2e9a72-2d63-4de6-8d18-a9d7490579a9] Start building block device mappings for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 19:17:58 user nova-compute[75216]: DEBUG nova.compute.manager [None req-59335715-85bd-4e10-ad56-46a2c6bd9625 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] [instance: de2e9a72-2d63-4de6-8d18-a9d7490579a9] Start spawning the instance on the hypervisor. {{(pid=75216) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 19:17:58 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-59335715-85bd-4e10-ad56-46a2c6bd9625 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] [instance: de2e9a72-2d63-4de6-8d18-a9d7490579a9] Creating instance directory {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 19:17:58 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-59335715-85bd-4e10-ad56-46a2c6bd9625 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] [instance: de2e9a72-2d63-4de6-8d18-a9d7490579a9] Creating image(s)
Nov 13 19:17:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-59335715-85bd-4e10-ad56-46a2c6bd9625 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Acquiring lock "/opt/stack/data/nova/instances/de2e9a72-2d63-4de6-8d18-a9d7490579a9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:17:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-59335715-85bd-4e10-ad56-46a2c6bd9625 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Lock "/opt/stack/data/nova/instances/de2e9a72-2d63-4de6-8d18-a9d7490579a9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:17:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-59335715-85bd-4e10-ad56-46a2c6bd9625 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Lock "/opt/stack/data/nova/instances/de2e9a72-2d63-4de6-8d18-a9d7490579a9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:17:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-59335715-85bd-4e10-ad56-46a2c6bd9625 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:17:58 user nova-compute[75216]: DEBUG nova.policy [None req-59335715-85bd-4e10-ad56-46a2c6bd9625 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c2bef5032a924d99b8ab2a1677998111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7034cfcc8457eb80e8f1875cd39f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75216) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 19:17:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-59335715-85bd-4e10-ad56-46a2c6bd9625 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json" returned: 0 in 0.173s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:17:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-59335715-85bd-4e10-ad56-46a2c6bd9625 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Acquiring lock "88c50a45bec9d6b0427462b3242b9b8e5f49c2b6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:17:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-59335715-85bd-4e10-ad56-46a2c6bd9625 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Lock "88c50a45bec9d6b0427462b3242b9b8e5f49c2b6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:17:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-59335715-85bd-4e10-ad56-46a2c6bd9625 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:17:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-59335715-85bd-4e10-ad56-46a2c6bd9625 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json" returned: 0 in 0.180s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:17:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-59335715-85bd-4e10-ad56-46a2c6bd9625 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6,backing_fmt=raw /opt/stack/data/nova/instances/de2e9a72-2d63-4de6-8d18-a9d7490579a9/disk 1073741824 {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:17:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-59335715-85bd-4e10-ad56-46a2c6bd9625 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6,backing_fmt=raw /opt/stack/data/nova/instances/de2e9a72-2d63-4de6-8d18-a9d7490579a9/disk 1073741824" returned: 0 in 0.062s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:17:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-59335715-85bd-4e10-ad56-46a2c6bd9625 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Lock "88c50a45bec9d6b0427462b3242b9b8e5f49c2b6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.248s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:17:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-59335715-85bd-4e10-ad56-46a2c6bd9625 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:17:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-59335715-85bd-4e10-ad56-46a2c6bd9625 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json" returned: 0 in 0.176s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:17:58 user nova-compute[75216]: DEBUG nova.virt.disk.api [None req-59335715-85bd-4e10-ad56-46a2c6bd9625 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Checking if we can resize image /opt/stack/data/nova/instances/de2e9a72-2d63-4de6-8d18-a9d7490579a9/disk. size=1073741824 {{(pid=75216) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 19:17:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-59335715-85bd-4e10-ad56-46a2c6bd9625 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de2e9a72-2d63-4de6-8d18-a9d7490579a9/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:17:58 user nova-compute[75216]: DEBUG nova.network.neutron [None req-59335715-85bd-4e10-ad56-46a2c6bd9625 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] [instance: de2e9a72-2d63-4de6-8d18-a9d7490579a9] Successfully created port: 1a0628c1-10a7-478a-a86e-0479da381b11 {{(pid=75216) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 19:17:59 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-59335715-85bd-4e10-ad56-46a2c6bd9625 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de2e9a72-2d63-4de6-8d18-a9d7490579a9/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:17:59 user nova-compute[75216]: DEBUG nova.virt.disk.api [None req-59335715-85bd-4e10-ad56-46a2c6bd9625 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Cannot resize image /opt/stack/data/nova/instances/de2e9a72-2d63-4de6-8d18-a9d7490579a9/disk to a smaller size. {{(pid=75216) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 19:17:59 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-59335715-85bd-4e10-ad56-46a2c6bd9625 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] [instance: de2e9a72-2d63-4de6-8d18-a9d7490579a9] Created local disks {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 19:17:59 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-59335715-85bd-4e10-ad56-46a2c6bd9625 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] [instance: de2e9a72-2d63-4de6-8d18-a9d7490579a9] Ensure instance console log exists: /opt/stack/data/nova/instances/de2e9a72-2d63-4de6-8d18-a9d7490579a9/console.log {{(pid=75216) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 19:17:59 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-59335715-85bd-4e10-ad56-46a2c6bd9625 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:17:59 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-59335715-85bd-4e10-ad56-46a2c6bd9625 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:17:59 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-59335715-85bd-4e10-ad56-46a2c6bd9625 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:17:59 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:17:59 user nova-compute[75216]: DEBUG nova.network.neutron [None req-59335715-85bd-4e10-ad56-46a2c6bd9625 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] [instance: de2e9a72-2d63-4de6-8d18-a9d7490579a9] Successfully updated port: 1a0628c1-10a7-478a-a86e-0479da381b11 {{(pid=75216) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 19:17:59 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-59335715-85bd-4e10-ad56-46a2c6bd9625 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Acquiring lock "refresh_cache-de2e9a72-2d63-4de6-8d18-a9d7490579a9" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 19:17:59 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-59335715-85bd-4e10-ad56-46a2c6bd9625 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Acquired lock "refresh_cache-de2e9a72-2d63-4de6-8d18-a9d7490579a9" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 19:17:59 user nova-compute[75216]: DEBUG nova.network.neutron [None req-59335715-85bd-4e10-ad56-46a2c6bd9625 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] [instance: de2e9a72-2d63-4de6-8d18-a9d7490579a9] Building network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 19:17:59 user nova-compute[75216]: DEBUG nova.compute.manager [req-dbc31257-69f8-417a-b858-dcbc489a5a5a req-d9377fc6-7bfd-485a-b14e-a13c913ee427 service nova] [instance: de2e9a72-2d63-4de6-8d18-a9d7490579a9] Received event network-changed-1a0628c1-10a7-478a-a86e-0479da381b11 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:17:59 user nova-compute[75216]: DEBUG nova.compute.manager [req-dbc31257-69f8-417a-b858-dcbc489a5a5a req-d9377fc6-7bfd-485a-b14e-a13c913ee427 service nova] [instance: de2e9a72-2d63-4de6-8d18-a9d7490579a9] Refreshing instance network info cache due to event network-changed-1a0628c1-10a7-478a-a86e-0479da381b11. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 19:17:59 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-dbc31257-69f8-417a-b858-dcbc489a5a5a req-d9377fc6-7bfd-485a-b14e-a13c913ee427 service nova] Acquiring lock "refresh_cache-de2e9a72-2d63-4de6-8d18-a9d7490579a9" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 19:17:59 user nova-compute[75216]: DEBUG nova.network.neutron [None req-59335715-85bd-4e10-ad56-46a2c6bd9625 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] [instance: de2e9a72-2d63-4de6-8d18-a9d7490579a9] Instance cache missing network info. {{(pid=75216) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 19:17:59 user nova-compute[75216]: DEBUG nova.network.neutron [None req-59335715-85bd-4e10-ad56-46a2c6bd9625 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] [instance: de2e9a72-2d63-4de6-8d18-a9d7490579a9] Updating instance_info_cache with network_info: [{"id": "1a0628c1-10a7-478a-a86e-0479da381b11", "address": "fa:16:3e:89:5b:db", "network": {"id": "913673cd-fbe9-48f6-b922-0fd6cf3b52e2", "bridge": "br-int", "label": "tempest-TestStampPattern-134235743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5c7034cfcc8457eb80e8f1875cd39f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a0628c1-10", "ovs_interfaceid": "1a0628c1-10a7-478a-a86e-0479da381b11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:17:59 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-59335715-85bd-4e10-ad56-46a2c6bd9625 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Releasing lock "refresh_cache-de2e9a72-2d63-4de6-8d18-a9d7490579a9" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 19:17:59 user nova-compute[75216]: DEBUG nova.compute.manager [None req-59335715-85bd-4e10-ad56-46a2c6bd9625 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] [instance: de2e9a72-2d63-4de6-8d18-a9d7490579a9] Instance network_info: |[{"id": "1a0628c1-10a7-478a-a86e-0479da381b11", "address": "fa:16:3e:89:5b:db", "network": {"id": "913673cd-fbe9-48f6-b922-0fd6cf3b52e2", "bridge": "br-int", "label": "tempest-TestStampPattern-134235743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5c7034cfcc8457eb80e8f1875cd39f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a0628c1-10", "ovs_interfaceid": "1a0628c1-10a7-478a-a86e-0479da381b11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 19:17:59 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-dbc31257-69f8-417a-b858-dcbc489a5a5a req-d9377fc6-7bfd-485a-b14e-a13c913ee427 service nova] Acquired lock "refresh_cache-de2e9a72-2d63-4de6-8d18-a9d7490579a9" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 19:17:59 user nova-compute[75216]: DEBUG nova.network.neutron [req-dbc31257-69f8-417a-b858-dcbc489a5a5a req-d9377fc6-7bfd-485a-b14e-a13c913ee427 service nova] [instance: de2e9a72-2d63-4de6-8d18-a9d7490579a9] Refreshing network info cache for port 1a0628c1-10a7-478a-a86e-0479da381b11 {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 19:17:59 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-59335715-85bd-4e10-ad56-46a2c6bd9625 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] [instance: de2e9a72-2d63-4de6-8d18-a9d7490579a9] Start _get_guest_xml network_info=[{"id": "1a0628c1-10a7-478a-a86e-0479da381b11", "address": "fa:16:3e:89:5b:db", "network": {"id": "913673cd-fbe9-48f6-b922-0fd6cf3b52e2", "bridge": "br-int", "label": "tempest-TestStampPattern-134235743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5c7034cfcc8457eb80e8f1875cd39f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a0628c1-10", "ovs_interfaceid": "1a0628c1-10a7-478a-a86e-0479da381b11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T18:41:06Z,direct_url=<?>,disk_format='qcow2',id=77bcb5ba-8510-41ec-a88d-96097bb431de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c465b7c26ec44582b6d1b7169536ecc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T18:41:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'guest_format': None, 'boot_index': 0, 'image_id': '77bcb5ba-8510-41ec-a88d-96097bb431de'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 19:17:59 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-59335715-85bd-4e10-ad56-46a2c6bd9625 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 19:17:59 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-59335715-85bd-4e10-ad56-46a2c6bd9625 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 19:17:59 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-59335715-85bd-4e10-ad56-46a2c6bd9625 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 19:17:59 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-59335715-85bd-4e10-ad56-46a2c6bd9625 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] CPU controller missing on host. {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 19:17:59 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-59335715-85bd-4e10-ad56-46a2c6bd9625 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 19:17:59 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-59335715-85bd-4e10-ad56-46a2c6bd9625 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] CPU controller found on host. {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 19:17:59 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-59335715-85bd-4e10-ad56-46a2c6bd9625 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75216) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 19:17:59 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-59335715-85bd-4e10-ad56-46a2c6bd9625 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T18:40:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T18:41:06Z,direct_url=<?>,disk_format='qcow2',id=77bcb5ba-8510-41ec-a88d-96097bb431de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c465b7c26ec44582b6d1b7169536ecc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T18:41:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 19:17:59 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-59335715-85bd-4e10-ad56-46a2c6bd9625 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Flavor limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 19:17:59 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-59335715-85bd-4e10-ad56-46a2c6bd9625 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Image limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 19:17:59 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-59335715-85bd-4e10-ad56-46a2c6bd9625 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Flavor pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 19:17:59 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-59335715-85bd-4e10-ad56-46a2c6bd9625 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Image pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 19:17:59 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-59335715-85bd-4e10-ad56-46a2c6bd9625 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 19:17:59 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-59335715-85bd-4e10-ad56-46a2c6bd9625 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 19:17:59 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-59335715-85bd-4e10-ad56-46a2c6bd9625 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 19:17:59 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-59335715-85bd-4e10-ad56-46a2c6bd9625 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Got 1 possible topologies {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 19:17:59 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-59335715-85bd-4e10-ad56-46a2c6bd9625 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 19:17:59 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-59335715-85bd-4e10-ad56-46a2c6bd9625 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 19:17:59 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-59335715-85bd-4e10-ad56-46a2c6bd9625 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T19:17:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-744381031',display_name='tempest-TestStampPattern-server-744381031',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-744381031',id=42,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHapKYnJox8DhCyPix19DTcs5oKU+V19VrNIaR46tufXvIA+F2UnG19Dx1NagebwmDrx5mO4JLdGpW9E+B7Ex0fbatUl+nUSHveU/X/HEvANxarEVUlRKv5XNJ7vjTh5Qg==',key_name='tempest-TestStampPattern-1280105983',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f5c7034cfcc8457eb80e8f1875cd39f5',ramdisk_id='',reservation_id='r-dd5tfr15',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-851121657',owner_user_name='tempest-TestStampPattern-851121657-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T19:17:58Z,user_data=None,user_id='c2bef5032a924d99b8ab2a1677998111',uuid=de2e9a72-2d63-4de6-8d18-a9d7490579a9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1a0628c1-10a7-478a-a86e-0479da381b11", "address": "fa:16:3e:89:5b:db", "network": {"id": "913673cd-fbe9-48f6-b922-0fd6cf3b52e2", "bridge": "br-int", "label": "tempest-TestStampPattern-134235743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5c7034cfcc8457eb80e8f1875cd39f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a0628c1-10", "ovs_interfaceid": "1a0628c1-10a7-478a-a86e-0479da381b11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75216) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 19:17:59 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-59335715-85bd-4e10-ad56-46a2c6bd9625 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Converting VIF {"id": "1a0628c1-10a7-478a-a86e-0479da381b11", "address": "fa:16:3e:89:5b:db", "network": {"id": "913673cd-fbe9-48f6-b922-0fd6cf3b52e2", "bridge": "br-int", "label": "tempest-TestStampPattern-134235743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5c7034cfcc8457eb80e8f1875cd39f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a0628c1-10", "ovs_interfaceid": "1a0628c1-10a7-478a-a86e-0479da381b11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 19:17:59 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-59335715-85bd-4e10-ad56-46a2c6bd9625 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:5b:db,bridge_name='br-int',has_traffic_filtering=True,id=1a0628c1-10a7-478a-a86e-0479da381b11,network=Network(913673cd-fbe9-48f6-b922-0fd6cf3b52e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a0628c1-10') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 19:17:59 user nova-compute[75216]: DEBUG nova.objects.instance [None req-59335715-85bd-4e10-ad56-46a2c6bd9625 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Lazy-loading 'pci_devices' on Instance uuid de2e9a72-2d63-4de6-8d18-a9d7490579a9 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:17:59 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-59335715-85bd-4e10-ad56-46a2c6bd9625 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] [instance: de2e9a72-2d63-4de6-8d18-a9d7490579a9] End _get_guest_xml xml=<domain type="kvm">
Nov 13 19:17:59 user nova-compute[75216]:   <uuid>de2e9a72-2d63-4de6-8d18-a9d7490579a9</uuid>
Nov 13 19:17:59 user nova-compute[75216]:   <name>instance-0000002a</name>
Nov 13 19:17:59 user nova-compute[75216]:   <memory>524288</memory>
Nov 13 19:17:59 user nova-compute[75216]:   <vcpu>1</vcpu>
Nov 13 19:17:59 user nova-compute[75216]:   <metadata>
Nov 13 19:17:59 user nova-compute[75216]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 19:17:59 user nova-compute[75216]:       <nova:package version="0.0.0"/>
Nov 13 19:17:59 user nova-compute[75216]:       <nova:name>tempest-TestStampPattern-server-744381031</nova:name>
Nov 13 19:17:59 user nova-compute[75216]:       <nova:creationTime>2023-11-13 19:17:59</nova:creationTime>
Nov 13 19:17:59 user nova-compute[75216]:       <nova:flavor name="m1.tiny">
Nov 13 19:17:59 user nova-compute[75216]:         <nova:memory>512</nova:memory>
Nov 13 19:17:59 user nova-compute[75216]:         <nova:disk>1</nova:disk>
Nov 13 19:17:59 user nova-compute[75216]:         <nova:swap>0</nova:swap>
Nov 13 19:17:59 user nova-compute[75216]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 19:17:59 user nova-compute[75216]:         <nova:vcpus>1</nova:vcpus>
Nov 13 19:17:59 user nova-compute[75216]:       </nova:flavor>
Nov 13 19:17:59 user nova-compute[75216]:       <nova:owner>
Nov 13 19:17:59 user nova-compute[75216]:         <nova:user uuid="c2bef5032a924d99b8ab2a1677998111">tempest-TestStampPattern-851121657-project-member</nova:user>
Nov 13 19:17:59 user nova-compute[75216]:         <nova:project uuid="f5c7034cfcc8457eb80e8f1875cd39f5">tempest-TestStampPattern-851121657</nova:project>
Nov 13 19:17:59 user nova-compute[75216]:       </nova:owner>
Nov 13 19:17:59 user nova-compute[75216]:       <nova:root type="image" uuid="77bcb5ba-8510-41ec-a88d-96097bb431de"/>
Nov 13 19:17:59 user nova-compute[75216]:       <nova:ports>
Nov 13 19:17:59 user nova-compute[75216]:         <nova:port uuid="1a0628c1-10a7-478a-a86e-0479da381b11">
Nov 13 19:17:59 user nova-compute[75216]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 13 19:17:59 user nova-compute[75216]:         </nova:port>
Nov 13 19:17:59 user nova-compute[75216]:       </nova:ports>
Nov 13 19:17:59 user nova-compute[75216]:     </nova:instance>
Nov 13 19:17:59 user nova-compute[75216]:   </metadata>
Nov 13 19:17:59 user nova-compute[75216]:   <sysinfo type="smbios">
Nov 13 19:17:59 user nova-compute[75216]:     <system>
Nov 13 19:17:59 user nova-compute[75216]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 19:17:59 user nova-compute[75216]:       <entry name="product">OpenStack Nova</entry>
Nov 13 19:17:59 user nova-compute[75216]:       <entry name="version">0.0.0</entry>
Nov 13 19:17:59 user nova-compute[75216]:       <entry name="serial">de2e9a72-2d63-4de6-8d18-a9d7490579a9</entry>
Nov 13 19:17:59 user nova-compute[75216]:       <entry name="uuid">de2e9a72-2d63-4de6-8d18-a9d7490579a9</entry>
Nov 13 19:17:59 user nova-compute[75216]:       <entry name="family">Virtual Machine</entry>
Nov 13 19:17:59 user nova-compute[75216]:     </system>
Nov 13 19:17:59 user nova-compute[75216]:   </sysinfo>
Nov 13 19:17:59 user nova-compute[75216]:   <os>
Nov 13 19:17:59 user nova-compute[75216]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 19:17:59 user nova-compute[75216]:     <boot dev="hd"/>
Nov 13 19:17:59 user nova-compute[75216]:     <smbios mode="sysinfo"/>
Nov 13 19:17:59 user nova-compute[75216]:   </os>
Nov 13 19:17:59 user nova-compute[75216]:   <features>
Nov 13 19:17:59 user nova-compute[75216]:     <acpi/>
Nov 13 19:17:59 user nova-compute[75216]:     <apic/>
Nov 13 19:17:59 user nova-compute[75216]:     <vmcoreinfo/>
Nov 13 19:17:59 user nova-compute[75216]:   </features>
Nov 13 19:17:59 user nova-compute[75216]:   <clock offset="utc">
Nov 13 19:17:59 user nova-compute[75216]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 19:17:59 user nova-compute[75216]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 19:17:59 user nova-compute[75216]:     <timer name="hpet" present="no"/>
Nov 13 19:17:59 user nova-compute[75216]:   </clock>
Nov 13 19:17:59 user nova-compute[75216]:   <cpu mode="custom" match="exact">
Nov 13 19:17:59 user nova-compute[75216]:     <model>Nehalem</model>
Nov 13 19:17:59 user nova-compute[75216]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 19:17:59 user nova-compute[75216]:   </cpu>
Nov 13 19:17:59 user nova-compute[75216]:   <devices>
Nov 13 19:17:59 user nova-compute[75216]:     <disk type="file" device="disk">
Nov 13 19:17:59 user nova-compute[75216]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 19:17:59 user nova-compute[75216]:       <source file="/opt/stack/data/nova/instances/de2e9a72-2d63-4de6-8d18-a9d7490579a9/disk"/>
Nov 13 19:17:59 user nova-compute[75216]:       <target dev="vda" bus="virtio"/>
Nov 13 19:17:59 user nova-compute[75216]:     </disk>
Nov 13 19:17:59 user nova-compute[75216]:     <interface type="ethernet">
Nov 13 19:17:59 user nova-compute[75216]:       <mac address="fa:16:3e:89:5b:db"/>
Nov 13 19:17:59 user nova-compute[75216]:       <model type="virtio"/>
Nov 13 19:17:59 user nova-compute[75216]:       <mtu size="1442"/>
Nov 13 19:17:59 user nova-compute[75216]:       <target dev="tap1a0628c1-10"/>
Nov 13 19:17:59 user nova-compute[75216]:     </interface>
Nov 13 19:17:59 user nova-compute[75216]:     <serial type="pty">
Nov 13 19:17:59 user nova-compute[75216]:       <log file="/opt/stack/data/nova/instances/de2e9a72-2d63-4de6-8d18-a9d7490579a9/console.log" append="off"/>
Nov 13 19:17:59 user nova-compute[75216]:     </serial>
Nov 13 19:17:59 user nova-compute[75216]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 19:17:59 user nova-compute[75216]:     <video>
Nov 13 19:17:59 user nova-compute[75216]:       <model type="virtio"/>
Nov 13 19:17:59 user nova-compute[75216]:     </video>
Nov 13 19:17:59 user nova-compute[75216]:     <rng model="virtio">
Nov 13 19:17:59 user nova-compute[75216]:       <backend model="random">/dev/urandom</backend>
Nov 13 19:17:59 user nova-compute[75216]:     </rng>
Nov 13 19:17:59 user nova-compute[75216]:     <controller type="usb" index="0" model="none"/>
Nov 13 19:17:59 user nova-compute[75216]:     <memballoon model="virtio">
Nov 13 19:17:59 user nova-compute[75216]:       <stats period="10"/>
Nov 13 19:17:59 user nova-compute[75216]:     </memballoon>
Nov 13 19:17:59 user nova-compute[75216]:   </devices>
Nov 13 19:17:59 user nova-compute[75216]: </domain>
Nov 13 19:17:59 user nova-compute[75216]:  {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 19:17:59 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-59335715-85bd-4e10-ad56-46a2c6bd9625 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T19:17:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-744381031',display_name='tempest-TestStampPattern-server-744381031',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-744381031',id=42,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHapKYnJox8DhCyPix19DTcs5oKU+V19VrNIaR46tufXvIA+F2UnG19Dx1NagebwmDrx5mO4JLdGpW9E+B7Ex0fbatUl+nUSHveU/X/HEvANxarEVUlRKv5XNJ7vjTh5Qg==',key_name='tempest-TestStampPattern-1280105983',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f5c7034cfcc8457eb80e8f1875cd39f5',ramdisk_id='',reservation_id='r-dd5tfr15',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-851121657',owner_user_name='tempest-TestStampPattern-851121657-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T19:17:58Z,user_data=None,user_id='c2bef5032a924d99b8ab2a1677998111',uuid=de2e9a72-2d63-4de6-8d18-a9d7490579a9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1a0628c1-10a7-478a-a86e-0479da381b11", "address": "fa:16:3e:89:5b:db", "network": {"id": "913673cd-fbe9-48f6-b922-0fd6cf3b52e2", "bridge": "br-int", "label": "tempest-TestStampPattern-134235743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5c7034cfcc8457eb80e8f1875cd39f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a0628c1-10", "ovs_interfaceid": "1a0628c1-10a7-478a-a86e-0479da381b11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 19:17:59 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-59335715-85bd-4e10-ad56-46a2c6bd9625 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Converting VIF {"id": "1a0628c1-10a7-478a-a86e-0479da381b11", "address": "fa:16:3e:89:5b:db", "network": {"id": "913673cd-fbe9-48f6-b922-0fd6cf3b52e2", "bridge": "br-int", "label": "tempest-TestStampPattern-134235743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5c7034cfcc8457eb80e8f1875cd39f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a0628c1-10", "ovs_interfaceid": "1a0628c1-10a7-478a-a86e-0479da381b11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 19:17:59 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-59335715-85bd-4e10-ad56-46a2c6bd9625 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:5b:db,bridge_name='br-int',has_traffic_filtering=True,id=1a0628c1-10a7-478a-a86e-0479da381b11,network=Network(913673cd-fbe9-48f6-b922-0fd6cf3b52e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a0628c1-10') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 19:17:59 user nova-compute[75216]: DEBUG os_vif [None req-59335715-85bd-4e10-ad56-46a2c6bd9625 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:5b:db,bridge_name='br-int',has_traffic_filtering=True,id=1a0628c1-10a7-478a-a86e-0479da381b11,network=Network(913673cd-fbe9-48f6-b922-0fd6cf3b52e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a0628c1-10') {{(pid=75216) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 19:17:59 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:17:59 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:17:59 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 19:17:59 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:17:59 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'acfbbb3d-e1f6-5189-9e90-1014cc1b88a4', '_type': 'linux-noop'}}, row=False) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:17:59 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:17:59 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:17:59 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:17:59 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1a0628c1-10, may_exist=True, interface_attrs={}) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:17:59 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1a0628c1-10, col_values=(('qos', UUID('b93497fd-5da5-47d3-9280-32dda2703100')),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:17:59 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1a0628c1-10, col_values=(('external_ids', {'iface-id': '1a0628c1-10a7-478a-a86e-0479da381b11', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:89:5b:db', 'vm-uuid': 'de2e9a72-2d63-4de6-8d18-a9d7490579a9'}),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:17:59 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:17:59 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:17:59 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:17:59 user nova-compute[75216]: INFO os_vif [None req-59335715-85bd-4e10-ad56-46a2c6bd9625 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:5b:db,bridge_name='br-int',has_traffic_filtering=True,id=1a0628c1-10a7-478a-a86e-0479da381b11,network=Network(913673cd-fbe9-48f6-b922-0fd6cf3b52e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a0628c1-10')
Nov 13 19:18:00 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-59335715-85bd-4e10-ad56-46a2c6bd9625 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 19:18:00 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-59335715-85bd-4e10-ad56-46a2c6bd9625 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] No VIF found with MAC fa:16:3e:89:5b:db, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 19:18:00 user nova-compute[75216]: DEBUG nova.network.neutron [req-dbc31257-69f8-417a-b858-dcbc489a5a5a req-d9377fc6-7bfd-485a-b14e-a13c913ee427 service nova] [instance: de2e9a72-2d63-4de6-8d18-a9d7490579a9] Updated VIF entry in instance network info cache for port 1a0628c1-10a7-478a-a86e-0479da381b11. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 19:18:00 user nova-compute[75216]: DEBUG nova.network.neutron [req-dbc31257-69f8-417a-b858-dcbc489a5a5a req-d9377fc6-7bfd-485a-b14e-a13c913ee427 service nova] [instance: de2e9a72-2d63-4de6-8d18-a9d7490579a9] Updating instance_info_cache with network_info: [{"id": "1a0628c1-10a7-478a-a86e-0479da381b11", "address": "fa:16:3e:89:5b:db", "network": {"id": "913673cd-fbe9-48f6-b922-0fd6cf3b52e2", "bridge": "br-int", "label": "tempest-TestStampPattern-134235743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5c7034cfcc8457eb80e8f1875cd39f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a0628c1-10", "ovs_interfaceid": "1a0628c1-10a7-478a-a86e-0479da381b11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:18:00 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-dbc31257-69f8-417a-b858-dcbc489a5a5a req-d9377fc6-7bfd-485a-b14e-a13c913ee427 service nova] Releasing lock "refresh_cache-de2e9a72-2d63-4de6-8d18-a9d7490579a9" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 19:18:01 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:18:01 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:18:01 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:18:01 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:18:01 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:18:01 user nova-compute[75216]: DEBUG nova.compute.manager [req-f8ac5deb-5645-42f2-9e6c-28b46e223b6c req-59886260-309d-4317-8c2b-1b5c7fe492da service nova] [instance: de2e9a72-2d63-4de6-8d18-a9d7490579a9] Received event network-vif-plugged-1a0628c1-10a7-478a-a86e-0479da381b11 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:18:01 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-f8ac5deb-5645-42f2-9e6c-28b46e223b6c req-59886260-309d-4317-8c2b-1b5c7fe492da service nova] Acquiring lock "de2e9a72-2d63-4de6-8d18-a9d7490579a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:18:01 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-f8ac5deb-5645-42f2-9e6c-28b46e223b6c req-59886260-309d-4317-8c2b-1b5c7fe492da service nova] Lock "de2e9a72-2d63-4de6-8d18-a9d7490579a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:18:01 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-f8ac5deb-5645-42f2-9e6c-28b46e223b6c req-59886260-309d-4317-8c2b-1b5c7fe492da service nova] Lock "de2e9a72-2d63-4de6-8d18-a9d7490579a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:18:01 user nova-compute[75216]: DEBUG nova.compute.manager [req-f8ac5deb-5645-42f2-9e6c-28b46e223b6c req-59886260-309d-4317-8c2b-1b5c7fe492da service nova] [instance: de2e9a72-2d63-4de6-8d18-a9d7490579a9] No waiting events found dispatching network-vif-plugged-1a0628c1-10a7-478a-a86e-0479da381b11 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 19:18:01 user nova-compute[75216]: WARNING nova.compute.manager [req-f8ac5deb-5645-42f2-9e6c-28b46e223b6c req-59886260-309d-4317-8c2b-1b5c7fe492da service nova] [instance: de2e9a72-2d63-4de6-8d18-a9d7490579a9] Received unexpected event network-vif-plugged-1a0628c1-10a7-478a-a86e-0479da381b11 for instance with vm_state building and task_state spawning.
Nov 13 19:18:01 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:18:01 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:18:01 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:18:01 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:18:03 user nova-compute[75216]: DEBUG nova.compute.manager [None req-59335715-85bd-4e10-ad56-46a2c6bd9625 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] [instance: de2e9a72-2d63-4de6-8d18-a9d7490579a9] Instance event wait completed in 0 seconds for  {{(pid=75216) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 19:18:03 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-59335715-85bd-4e10-ad56-46a2c6bd9625 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] [instance: de2e9a72-2d63-4de6-8d18-a9d7490579a9] Guest created on hypervisor {{(pid=75216) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 19:18:03 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: de2e9a72-2d63-4de6-8d18-a9d7490579a9] Instance spawned successfully.
Nov 13 19:18:03 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-59335715-85bd-4e10-ad56-46a2c6bd9625 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] [instance: de2e9a72-2d63-4de6-8d18-a9d7490579a9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 19:18:03 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-59335715-85bd-4e10-ad56-46a2c6bd9625 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] [instance: de2e9a72-2d63-4de6-8d18-a9d7490579a9] Found default for hw_cdrom_bus of ide {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 19:18:03 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-59335715-85bd-4e10-ad56-46a2c6bd9625 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] [instance: de2e9a72-2d63-4de6-8d18-a9d7490579a9] Found default for hw_disk_bus of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 19:18:03 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-59335715-85bd-4e10-ad56-46a2c6bd9625 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] [instance: de2e9a72-2d63-4de6-8d18-a9d7490579a9] Found default for hw_input_bus of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 19:18:03 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-59335715-85bd-4e10-ad56-46a2c6bd9625 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] [instance: de2e9a72-2d63-4de6-8d18-a9d7490579a9] Found default for hw_pointer_model of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 19:18:03 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-59335715-85bd-4e10-ad56-46a2c6bd9625 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] [instance: de2e9a72-2d63-4de6-8d18-a9d7490579a9] Found default for hw_video_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 19:18:03 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-59335715-85bd-4e10-ad56-46a2c6bd9625 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] [instance: de2e9a72-2d63-4de6-8d18-a9d7490579a9] Found default for hw_vif_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 19:18:03 user nova-compute[75216]: INFO nova.compute.manager [None req-59335715-85bd-4e10-ad56-46a2c6bd9625 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] [instance: de2e9a72-2d63-4de6-8d18-a9d7490579a9] Took 5.24 seconds to spawn the instance on the hypervisor.
Nov 13 19:18:03 user nova-compute[75216]: DEBUG nova.compute.manager [None req-59335715-85bd-4e10-ad56-46a2c6bd9625 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] [instance: de2e9a72-2d63-4de6-8d18-a9d7490579a9] Checking state {{(pid=75216) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 19:18:03 user nova-compute[75216]: INFO nova.compute.manager [None req-59335715-85bd-4e10-ad56-46a2c6bd9625 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] [instance: de2e9a72-2d63-4de6-8d18-a9d7490579a9] Took 5.84 seconds to build instance.
Nov 13 19:18:03 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-59335715-85bd-4e10-ad56-46a2c6bd9625 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Lock "de2e9a72-2d63-4de6-8d18-a9d7490579a9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.960s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:18:03 user nova-compute[75216]: DEBUG nova.compute.manager [req-04567691-8918-427c-8b41-30792917099f req-4273713e-5dc3-4a47-a5d2-23f72f2030b4 service nova] [instance: de2e9a72-2d63-4de6-8d18-a9d7490579a9] Received event network-vif-plugged-1a0628c1-10a7-478a-a86e-0479da381b11 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:18:03 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-04567691-8918-427c-8b41-30792917099f req-4273713e-5dc3-4a47-a5d2-23f72f2030b4 service nova] Acquiring lock "de2e9a72-2d63-4de6-8d18-a9d7490579a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:18:03 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-04567691-8918-427c-8b41-30792917099f req-4273713e-5dc3-4a47-a5d2-23f72f2030b4 service nova] Lock "de2e9a72-2d63-4de6-8d18-a9d7490579a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:18:03 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-04567691-8918-427c-8b41-30792917099f req-4273713e-5dc3-4a47-a5d2-23f72f2030b4 service nova] Lock "de2e9a72-2d63-4de6-8d18-a9d7490579a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:18:03 user nova-compute[75216]: DEBUG nova.compute.manager [req-04567691-8918-427c-8b41-30792917099f req-4273713e-5dc3-4a47-a5d2-23f72f2030b4 service nova] [instance: de2e9a72-2d63-4de6-8d18-a9d7490579a9] No waiting events found dispatching network-vif-plugged-1a0628c1-10a7-478a-a86e-0479da381b11 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 19:18:03 user nova-compute[75216]: WARNING nova.compute.manager [req-04567691-8918-427c-8b41-30792917099f req-4273713e-5dc3-4a47-a5d2-23f72f2030b4 service nova] [instance: de2e9a72-2d63-4de6-8d18-a9d7490579a9] Received unexpected event network-vif-plugged-1a0628c1-10a7-478a-a86e-0479da381b11 for instance with vm_state active and task_state None.
Nov 13 19:18:04 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:18:04 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:18:06 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:18:09 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:18:09 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:18:10 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:18:11 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:18:11 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:18:11 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:18:11 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75216) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 19:18:11 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:18:11 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:18:11 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:18:11 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:18:11 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Auditing locally available compute resources for user (node: user) {{(pid=75216) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 19:18:11 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b048c677-85bf-4a93-88eb-c71bde27bf5b/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:18:11 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b048c677-85bf-4a93-88eb-c71bde27bf5b/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:18:11 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b048c677-85bf-4a93-88eb-c71bde27bf5b/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:18:11 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b048c677-85bf-4a93-88eb-c71bde27bf5b/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:18:11 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/138c85af-655a-4a5c-ade7-daa7d7b58456/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:18:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/138c85af-655a-4a5c-ade7-daa7d7b58456/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:18:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/138c85af-655a-4a5c-ade7-daa7d7b58456/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:18:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/138c85af-655a-4a5c-ade7-daa7d7b58456/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:18:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de2e9a72-2d63-4de6-8d18-a9d7490579a9/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:18:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de2e9a72-2d63-4de6-8d18-a9d7490579a9/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:18:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de2e9a72-2d63-4de6-8d18-a9d7490579a9/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:18:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de2e9a72-2d63-4de6-8d18-a9d7490579a9/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:18:12 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 19:18:12 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 19:18:12 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Hypervisor/Node resource view: name=user free_ram=8623MB free_disk=25.324443817138672GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75216) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 19:18:12 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:18:12 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:18:13 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance b048c677-85bf-4a93-88eb-c71bde27bf5b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 19:18:13 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance 138c85af-655a-4a5c-ade7-daa7d7b58456 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 19:18:13 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance de2e9a72-2d63-4de6-8d18-a9d7490579a9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 19:18:13 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 19:18:13 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 19:18:13 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 19:18:13 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 19:18:13 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-b60a9d5a-d441-4341-983b-971b2d3b9960 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance b048c677-85bf-4a93-88eb-c71bde27bf5b is timed out.
Nov 13 19:18:13 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-b60a9d5a-d441-4341-983b-971b2d3b9960 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Successfully detached device vdb from instance b048c677-85bf-4a93-88eb-c71bde27bf5b from the live domain config.
Nov 13 19:18:13 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b60a9d5a-d441-4341-983b-971b2d3b9960 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] [instance: b048c677-85bf-4a93-88eb-c71bde27bf5b] calling os-brick to detach iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 19:18:13 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-b60a9d5a-d441-4341-983b-971b2d3b9960 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3a8669e40>, {'target_iqn': 'iqn.2010-10.org.openstack:8ce26031-aafa-4026-8ea9-3de9e9c348ec', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'srHqJFku', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 19:18:13 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-b60a9d5a-d441-4341-983b-971b2d3b9960 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 19:18:13 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-b60a9d5a-d441-4341-983b-971b2d3b9960 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 19:18:13 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-b60a9d5a-d441-4341-983b-971b2d3b9960 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 19:18:13 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:18:13 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Compute_service record updated for user:user {{(pid=75216) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 19:18:13 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.536s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:18:13 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.032s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:18:13 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[b62719c0-9163-4f30-ba85-83ccb8ae4579]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8ce26031-aafa-4026-8ea9-3de9e9c348ec\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:18:13 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-b60a9d5a-d441-4341-983b-971b2d3b9960 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 19:18:13 user nova-compute[75216]: No targets found.
Nov 13 19:18:13 user nova-compute[75216]: iSNS:
Nov 13 19:18:13 user nova-compute[75216]: No targets found.
Nov 13 19:18:13 user nova-compute[75216]: STATIC:
Nov 13 19:18:13 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:8ce26031-aafa-4026-8ea9-3de9e9c348ec
Nov 13 19:18:13 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 19:18:13 user nova-compute[75216]:                 Iface Name: default
Nov 13 19:18:13 user nova-compute[75216]: FIRMWARE:
Nov 13 19:18:13 user nova-compute[75216]: No targets found.
Nov 13 19:18:13 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 19:18:13 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-b60a9d5a-d441-4341-983b-971b2d3b9960 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 19:18:13 user nova-compute[75216]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 19:18:13 user nova-compute[75216]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75216) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 19:18:13 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-b60a9d5a-d441-4341-983b-971b2d3b9960 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8ce26031-aafa-4026-8ea9-3de9e9c348ec', 0)] {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 19:18:13 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:18:13 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:18:13 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4703d4e-8e4f-45ab-ab27-4ce95a41cae8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8ce26031-aafa-4026-8ea9-3de9e9c348ec\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:18:13 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:18:13 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:18:13 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[c793f47d-4632-466c-a990-378e5c99705f]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ce26031-aafa-4026-8ea9-3de9e9c348ec (non-flash)\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:18:13 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-b60a9d5a-d441-4341-983b-971b2d3b9960 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ce26031-aafa-4026-8ea9-3de9e9c348ec (non-flash)
Nov 13 19:18:13 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 19:18:13 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-b60a9d5a-d441-4341-983b-971b2d3b9960 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ce26031-aafa-4026-8ea9-3de9e9c348ec (non-flash)
Nov 13 19:18:13 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 19:18:13 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-b60a9d5a-d441-4341-983b-971b2d3b9960 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe3a817bf40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8ce26031-aafa-4026-8ea9-3de9e9c348ec'): ({'sde'}, set())}) {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 19:18:13 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-b60a9d5a-d441-4341-983b-971b2d3b9960 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Removing single pathed devices sde {{(pid=75216) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 19:18:13 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:18:13 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:18:13 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[b58d3089-c542-430b-88ff-c6c43daed9b7]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:18:13 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:18:13 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:18:13 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[09aac31e-30cb-4fd9-ac20-2277118ff7c9]: (4, ('ok\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:18:13 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-b60a9d5a-d441-4341-983b-971b2d3b9960 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Flushing IO for device /dev/sde {{(pid=75216) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 19:18:13 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:18:13 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:18:13 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ef9c772-d77a-4295-b0f0-76b5f1715fce]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:18:13 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-b60a9d5a-d441-4341-983b-971b2d3b9960 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75216) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 19:18:13 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:18:13 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.045s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:18:13 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[63e24de9-cfde-440c-8787-a412c2133fca]: (4, ('1', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:18:13 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-b60a9d5a-d441-4341-983b-971b2d3b9960 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 19:18:13 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-b60a9d5a-d441-4341-983b-971b2d3b9960 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] SCSI volumes sde have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 19:18:13 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-b60a9d5a-d441-4341-983b-971b2d3b9960 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8ce26031-aafa-4026-8ea9-3de9e9c348ec')] {{(pid=75216) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 19:18:13 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ce26031-aafa-4026-8ea9-3de9e9c348ec -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:18:13 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ce26031-aafa-4026-8ea9-3de9e9c348ec -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:18:13 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[797a227f-88d9-455e-aad2-cba7815ded38]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:18:13 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-b60a9d5a-d441-4341-983b-971b2d3b9960 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:18:13 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ce26031-aafa-4026-8ea9-3de9e9c348ec -p 172.16.0.220:3260 --logout {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:18:13 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ce26031-aafa-4026-8ea9-3de9e9c348ec -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:18:13 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[35b62ff2-26f4-4d16-9769-7a251490a239]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:8ce26031-aafa-4026-8ea9-3de9e9c348ec, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:8ce26031-aafa-4026-8ea9-3de9e9c348ec, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:18:13 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-b60a9d5a-d441-4341-983b-971b2d3b9960 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:8ce26031-aafa-4026-8ea9-3de9e9c348ec, portal: 172.16.0.220,3260]
Nov 13 19:18:13 user nova-compute[75216]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:8ce26031-aafa-4026-8ea9-3de9e9c348ec, portal: 172.16.0.220,3260] successful.
Nov 13 19:18:13 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:18:13 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ce26031-aafa-4026-8ea9-3de9e9c348ec -p 172.16.0.220:3260 --op delete {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:18:13 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ce26031-aafa-4026-8ea9-3de9e9c348ec -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:18:13 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[8081a593-67a7-4de6-9952-2a99a0aa654a]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:18:13 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-b60a9d5a-d441-4341-983b-971b2d3b9960 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:18:13 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-b60a9d5a-d441-4341-983b-971b2d3b9960 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.283s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 19:18:13 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-b60a9d5a-d441-4341-983b-971b2d3b9960 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] <== disconnect_volume: return (284ms) None {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 19:18:13 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b60a9d5a-d441-4341-983b-971b2d3b9960 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] [instance: b048c677-85bf-4a93-88eb-c71bde27bf5b] Disconnected iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 19:18:14 user nova-compute[75216]: DEBUG nova.objects.instance [None req-b60a9d5a-d441-4341-983b-971b2d3b9960 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Lazy-loading 'flavor' on Instance uuid b048c677-85bf-4a93-88eb-c71bde27bf5b {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:18:14 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-b60a9d5a-d441-4341-983b-971b2d3b9960 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Lock "b048c677-85bf-4a93-88eb-c71bde27bf5b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.842s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:18:14 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:18:18 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:18:18 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Starting heal instance info cache {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 19:18:18 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Didn't find any instances for network info cache update. {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 13 19:18:18 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:18:19 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:18:19 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:18:24 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:18:24 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:18:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:18:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:18:34 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:18:34 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:18:39 user nova-compute[75216]: DEBUG nova.compute.manager [req-7c1123c7-0fe6-4c92-88c5-463e1e5a82fb req-49fe8b0a-47c3-4747-b296-e48aba2a8a2b service nova] [instance: 138c85af-655a-4a5c-ade7-daa7d7b58456] Received event network-changed-0d05704a-f922-44ef-984d-7c1d9e8546e5 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:18:39 user nova-compute[75216]: DEBUG nova.compute.manager [req-7c1123c7-0fe6-4c92-88c5-463e1e5a82fb req-49fe8b0a-47c3-4747-b296-e48aba2a8a2b service nova] [instance: 138c85af-655a-4a5c-ade7-daa7d7b58456] Refreshing instance network info cache due to event network-changed-0d05704a-f922-44ef-984d-7c1d9e8546e5. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 19:18:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-7c1123c7-0fe6-4c92-88c5-463e1e5a82fb req-49fe8b0a-47c3-4747-b296-e48aba2a8a2b service nova] Acquiring lock "refresh_cache-138c85af-655a-4a5c-ade7-daa7d7b58456" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 19:18:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-7c1123c7-0fe6-4c92-88c5-463e1e5a82fb req-49fe8b0a-47c3-4747-b296-e48aba2a8a2b service nova] Acquired lock "refresh_cache-138c85af-655a-4a5c-ade7-daa7d7b58456" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 19:18:39 user nova-compute[75216]: DEBUG nova.network.neutron [req-7c1123c7-0fe6-4c92-88c5-463e1e5a82fb req-49fe8b0a-47c3-4747-b296-e48aba2a8a2b service nova] [instance: 138c85af-655a-4a5c-ade7-daa7d7b58456] Refreshing network info cache for port 0d05704a-f922-44ef-984d-7c1d9e8546e5 {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 19:18:39 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:18:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c89ba358-faca-4239-8a4e-af96ff42c4c3 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Acquiring lock "138c85af-655a-4a5c-ade7-daa7d7b58456" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:18:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c89ba358-faca-4239-8a4e-af96ff42c4c3 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Lock "138c85af-655a-4a5c-ade7-daa7d7b58456" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:18:39 user nova-compute[75216]: DEBUG nova.objects.instance [None req-c89ba358-faca-4239-8a4e-af96ff42c4c3 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Lazy-loading 'flavor' on Instance uuid 138c85af-655a-4a5c-ade7-daa7d7b58456 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:18:39 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-c89ba358-faca-4239-8a4e-af96ff42c4c3 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] [instance: 138c85af-655a-4a5c-ade7-daa7d7b58456] Ignoring supplied device name: /dev/vdb
Nov 13 19:18:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c89ba358-faca-4239-8a4e-af96ff42c4c3 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Lock "138c85af-655a-4a5c-ade7-daa7d7b58456" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:18:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c89ba358-faca-4239-8a4e-af96ff42c4c3 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Acquiring lock "138c85af-655a-4a5c-ade7-daa7d7b58456" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:18:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c89ba358-faca-4239-8a4e-af96ff42c4c3 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Lock "138c85af-655a-4a5c-ade7-daa7d7b58456" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:18:39 user nova-compute[75216]: INFO nova.compute.manager [None req-c89ba358-faca-4239-8a4e-af96ff42c4c3 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] [instance: 138c85af-655a-4a5c-ade7-daa7d7b58456] Attaching volume d45727bc-d46f-45a0-8dd3-5687aaf2543f to /dev/vdb
Nov 13 19:18:39 user nova-compute[75216]: DEBUG os_brick.utils [None req-c89ba358-faca-4239-8a4e-af96ff42c4c3 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 19:18:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:18:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:18:39 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddc521b7-40c3-41d3-a8c7-2d285fb89b11]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aea6fcfe14b9\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:18:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:18:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:18:39 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[00142c4b-8b34-44a2-9abf-9a7e50890e25]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:18:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:18:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:18:39 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2b3b2a2-05b8-4e73-8538-d251b3809a86]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:18:39 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e8b6c5b-3e0a-4680-89f2-34e9db319a8c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:18:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-c89ba358-faca-4239-8a4e-af96ff42c4c3 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Running cmd (subprocess): nvme version {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:18:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-c89ba358-faca-4239-8a4e-af96ff42c4c3 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] 'nvme version' failed. Not Retrying. {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 19:18:39 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c89ba358-faca-4239-8a4e-af96ff42c4c3 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] nvme not present on system {{(pid=75216) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 19:18:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:18:39 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 19:18:39 user nova-compute[75216]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 19:18:39 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[65a48194-158f-4e40-8e0d-586be235c787]: (4, '') {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:18:39 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-c89ba358-faca-4239-8a4e-af96ff42c4c3 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75216) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 19:18:39 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-c89ba358-faca-4239-8a4e-af96ff42c4c3 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 19:18:39 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-c89ba358-faca-4239-8a4e-af96ff42c4c3 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] LIGHTOS: no hostnqn found. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 19:18:39 user nova-compute[75216]: DEBUG os_brick.utils [None req-c89ba358-faca-4239-8a4e-af96ff42c4c3 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aea6fcfe14b9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 19:18:39 user nova-compute[75216]: DEBUG nova.virt.block_device [None req-c89ba358-faca-4239-8a4e-af96ff42c4c3 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] [instance: 138c85af-655a-4a5c-ade7-daa7d7b58456] Updating existing volume attachment record: 853062c8-7772-488f-a451-617b95350a81 {{(pid=75216) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 19:18:39 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:18:40 user nova-compute[75216]: DEBUG nova.network.neutron [req-7c1123c7-0fe6-4c92-88c5-463e1e5a82fb req-49fe8b0a-47c3-4747-b296-e48aba2a8a2b service nova] [instance: 138c85af-655a-4a5c-ade7-daa7d7b58456] Updated VIF entry in instance network info cache for port 0d05704a-f922-44ef-984d-7c1d9e8546e5. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 19:18:40 user nova-compute[75216]: DEBUG nova.network.neutron [req-7c1123c7-0fe6-4c92-88c5-463e1e5a82fb req-49fe8b0a-47c3-4747-b296-e48aba2a8a2b service nova] [instance: 138c85af-655a-4a5c-ade7-daa7d7b58456] Updating instance_info_cache with network_info: [{"id": "0d05704a-f922-44ef-984d-7c1d9e8546e5", "address": "fa:16:3e:0d:29:74", "network": {"id": "5c3296e5-d81b-4378-9108-bcc3ced5458a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-381226649-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e8c5d1e9e06c4202b31637288388048a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d05704a-f9", "ovs_interfaceid": "0d05704a-f922-44ef-984d-7c1d9e8546e5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:18:40 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-7c1123c7-0fe6-4c92-88c5-463e1e5a82fb req-49fe8b0a-47c3-4747-b296-e48aba2a8a2b service nova] Releasing lock "refresh_cache-138c85af-655a-4a5c-ade7-daa7d7b58456" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 19:18:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f3d216ed-0293-465a-bc2d-30c6add9a862 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Acquiring lock "b048c677-85bf-4a93-88eb-c71bde27bf5b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:18:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f3d216ed-0293-465a-bc2d-30c6add9a862 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Lock "b048c677-85bf-4a93-88eb-c71bde27bf5b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:18:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f3d216ed-0293-465a-bc2d-30c6add9a862 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Acquiring lock "b048c677-85bf-4a93-88eb-c71bde27bf5b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:18:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f3d216ed-0293-465a-bc2d-30c6add9a862 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Lock "b048c677-85bf-4a93-88eb-c71bde27bf5b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:18:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f3d216ed-0293-465a-bc2d-30c6add9a862 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Lock "b048c677-85bf-4a93-88eb-c71bde27bf5b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:18:43 user nova-compute[75216]: INFO nova.compute.manager [None req-f3d216ed-0293-465a-bc2d-30c6add9a862 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] [instance: b048c677-85bf-4a93-88eb-c71bde27bf5b] Terminating instance
Nov 13 19:18:43 user nova-compute[75216]: DEBUG nova.compute.manager [None req-f3d216ed-0293-465a-bc2d-30c6add9a862 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] [instance: b048c677-85bf-4a93-88eb-c71bde27bf5b] Start destroying the instance on the hypervisor. {{(pid=75216) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 19:18:43 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:18:43 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:18:43 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:18:43 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:18:43 user nova-compute[75216]: DEBUG nova.compute.manager [req-03fafd5c-8461-4c21-a2d5-4ee0817403df req-44e2152a-d393-4683-be6f-852bdae7b435 service nova] [instance: b048c677-85bf-4a93-88eb-c71bde27bf5b] Received event network-vif-unplugged-4ae536b2-7829-45c2-8739-a3f838008e74 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:18:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-03fafd5c-8461-4c21-a2d5-4ee0817403df req-44e2152a-d393-4683-be6f-852bdae7b435 service nova] Acquiring lock "b048c677-85bf-4a93-88eb-c71bde27bf5b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:18:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-03fafd5c-8461-4c21-a2d5-4ee0817403df req-44e2152a-d393-4683-be6f-852bdae7b435 service nova] Lock "b048c677-85bf-4a93-88eb-c71bde27bf5b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:18:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-03fafd5c-8461-4c21-a2d5-4ee0817403df req-44e2152a-d393-4683-be6f-852bdae7b435 service nova] Lock "b048c677-85bf-4a93-88eb-c71bde27bf5b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:18:43 user nova-compute[75216]: DEBUG nova.compute.manager [req-03fafd5c-8461-4c21-a2d5-4ee0817403df req-44e2152a-d393-4683-be6f-852bdae7b435 service nova] [instance: b048c677-85bf-4a93-88eb-c71bde27bf5b] No waiting events found dispatching network-vif-unplugged-4ae536b2-7829-45c2-8739-a3f838008e74 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 19:18:43 user nova-compute[75216]: DEBUG nova.compute.manager [req-03fafd5c-8461-4c21-a2d5-4ee0817403df req-44e2152a-d393-4683-be6f-852bdae7b435 service nova] [instance: b048c677-85bf-4a93-88eb-c71bde27bf5b] Received event network-vif-unplugged-4ae536b2-7829-45c2-8739-a3f838008e74 for instance with task_state deleting. {{(pid=75216) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 19:18:43 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c89ba358-faca-4239-8a4e-af96ff42c4c3 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] [instance: 138c85af-655a-4a5c-ade7-daa7d7b58456] Calling os-brick to attach iSCSI Volume {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 19:18:43 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-c89ba358-faca-4239-8a4e-af96ff42c4c3 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3a8669e40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d45727bc-d46f-45a0-8dd3-5687aaf2543f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aHjAMBKi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 19:18:43 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-c89ba358-faca-4239-8a4e-af96ff42c4c3 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 19:18:43 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-c89ba358-faca-4239-8a4e-af96ff42c4c3 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 19:18:43 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-c89ba358-faca-4239-8a4e-af96ff42c4c3 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 19:18:43 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-c89ba358-faca-4239-8a4e-af96ff42c4c3 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 19:18:43 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-c89ba358-faca-4239-8a4e-af96ff42c4c3 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d45727bc-d46f-45a0-8dd3-5687aaf2543f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 19:18:43 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-c89ba358-faca-4239-8a4e-af96ff42c4c3 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d45727bc-d46f-45a0-8dd3-5687aaf2543f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 19:18:43 user nova-compute[75216]: INFO os_brick.initiator.connectors.iscsi [None req-c89ba358-faca-4239-8a4e-af96ff42c4c3 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 19:18:43 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d45727bc-d46f-45a0-8dd3-5687aaf2543f -p 172.16.0.220:3260 {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:18:43 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d45727bc-d46f-45a0-8dd3-5687aaf2543f -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:18:43 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[100c21e7-c69b-430e-89fe-8f0ae9185149]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:18:43 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-c89ba358-faca-4239-8a4e-af96ff42c4c3 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 19:18:43 user nova-compute[75216]:  {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:18:43 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d45727bc-d46f-45a0-8dd3-5687aaf2543f -p 172.16.0.220:3260 --interface default --op new {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:18:43 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:18:43 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d45727bc-d46f-45a0-8dd3-5687aaf2543f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:18:43 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c424199-eef2-459f-bc26-ac39b39fa744]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d45727bc-d46f-45a0-8dd3-5687aaf2543f] added\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:18:43 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-c89ba358-faca-4239-8a4e-af96ff42c4c3 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d45727bc-d46f-45a0-8dd3-5687aaf2543f] added
Nov 13 19:18:43 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:18:43 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d45727bc-d46f-45a0-8dd3-5687aaf2543f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:18:43 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d45727bc-d46f-45a0-8dd3-5687aaf2543f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:18:43 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9c75cc3-6d9d-4953-a298-8ebb71d8e3c5]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:18:43 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-c89ba358-faca-4239-8a4e-af96ff42c4c3 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:18:43 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d45727bc-d46f-45a0-8dd3-5687aaf2543f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:18:43 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d45727bc-d46f-45a0-8dd3-5687aaf2543f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:18:43 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[d88ac4b3-bdd3-4926-94b9-7042f3435ae7]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:18:43 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-c89ba358-faca-4239-8a4e-af96ff42c4c3 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:18:43 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d45727bc-d46f-45a0-8dd3-5687aaf2543f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aHjAMBKi {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:18:43 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d45727bc-d46f-45a0-8dd3-5687aaf2543f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aHjAMBKi" returned: 0 in 0.017s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:18:43 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[aea68418-7b48-4b66-97e7-8d626220723c]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:18:43 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-c89ba358-faca-4239-8a4e-af96ff42c4c3 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'aHjAMBKi'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:18:43 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d45727bc-d46f-45a0-8dd3-5687aaf2543f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:18:43 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d45727bc-d46f-45a0-8dd3-5687aaf2543f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:18:43 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d003af0-97ed-4601-ad4b-13b34d4beeb1]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:18:43 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-c89ba358-faca-4239-8a4e-af96ff42c4c3 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:18:43 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:18:43 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:18:43 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[436a5e32-375d-42a4-ba7e-1577ea570436]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:18:43 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-c89ba358-faca-4239-8a4e-af96ff42c4c3 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 13 19:18:43 user nova-compute[75216]:  {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 19:18:43 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-c89ba358-faca-4239-8a4e-af96ff42c4c3 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 13 19:18:43 user nova-compute[75216]:  {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 19:18:43 user nova-compute[75216]: WARNING os_brick.initiator.connectors.iscsi [None req-c89ba358-faca-4239-8a4e-af96ff42c4c3 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 13 19:18:43 user nova-compute[75216]: 
Nov 13 19:18:43 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d45727bc-d46f-45a0-8dd3-5687aaf2543f -p 172.16.0.220:3260 --login {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:18:43 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d45727bc-d46f-45a0-8dd3-5687aaf2543f -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:18:43 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a8ff72f-4774-4762-8e8b-7ff28cc001c9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d45727bc-d46f-45a0-8dd3-5687aaf2543f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d45727bc-d46f-45a0-8dd3-5687aaf2543f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:18:43 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-c89ba358-faca-4239-8a4e-af96ff42c4c3 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d45727bc-d46f-45a0-8dd3-5687aaf2543f, portal: 172.16.0.220,3260]
Nov 13 19:18:43 user nova-compute[75216]: Login to [iface: default, target: iqn.2010-10.org.openstack:d45727bc-d46f-45a0-8dd3-5687aaf2543f, portal: 172.16.0.220,3260] successful.
Nov 13 19:18:43 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:18:43 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d45727bc-d46f-45a0-8dd3-5687aaf2543f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:18:43 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d45727bc-d46f-45a0-8dd3-5687aaf2543f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:18:43 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[72129e3c-3c4e-4fab-bb75-921e755c998d]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:18:43 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-c89ba358-faca-4239-8a4e-af96ff42c4c3 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:18:43 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:18:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:18:44 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[04b84997-4ea7-4d44-887c-11aab8470c3c]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d45727bc-d46f-45a0-8dd3-5687aaf2543f (non-flash)\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:18:44 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-c89ba358-faca-4239-8a4e-af96ff42c4c3 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d45727bc-d46f-45a0-8dd3-5687aaf2543f (non-flash)
Nov 13 19:18:44 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 19:18:44 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-c89ba358-faca-4239-8a4e-af96ff42c4c3 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d45727bc-d46f-45a0-8dd3-5687aaf2543f (non-flash)
Nov 13 19:18:44 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 19:18:44 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-c89ba358-faca-4239-8a4e-af96ff42c4c3 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d45727bc-d46f-45a0-8dd3-5687aaf2543f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.259s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 19:18:44 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-c89ba358-faca-4239-8a4e-af96ff42c4c3 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Connected to 172.16.0.220:3260 {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 19:18:44 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-c89ba358-faca-4239-8a4e-af96ff42c4c3 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] HCTL ('33', '-', '-', 0) found on session 49 with lun 0 {{(pid=75216) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 19:18:44 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-c89ba358-faca-4239-8a4e-af96ff42c4c3 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75216) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 19:18:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:18:44 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:18:44 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[20f5d455-ae01-43a6-a902-5976d18159ed]: (4, ('- - 0', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:18:44 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-c89ba358-faca-4239-8a4e-af96ff42c4c3 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Searching for a device in session 49 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75216) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 19:18:44 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-c89ba358-faca-4239-8a4e-af96ff42c4c3 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:d45727bc-d46f-45a0-8dd3-5687aaf2543f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aHjAMBKi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 19:18:44 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: b048c677-85bf-4a93-88eb-c71bde27bf5b] Instance destroyed successfully.
Nov 13 19:18:44 user nova-compute[75216]: DEBUG nova.objects.instance [None req-f3d216ed-0293-465a-bc2d-30c6add9a862 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Lazy-loading 'resources' on Instance uuid b048c677-85bf-4a93-88eb-c71bde27bf5b {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:18:44 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-f3d216ed-0293-465a-bc2d-30c6add9a862 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T19:13:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-468850457',display_name='tempest-AttachVolumeNegativeTest-server-468850457',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-468850457',id=38,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDkUOT/eEl0CMzN6y5KbV1T7tunzDOcX+OPMxhf7vC2+WQ9qJ1tjsn+PvxT+kq137f9ZmBxQOGjOyeJcsojdcHHl4sAA+puCY/iMnU3j7/ICJOJdrnt5+GE7rNuv+7+OMA==',key_name='tempest-keypair-1054757735',keypairs=<?>,launch_index=0,launched_at=2023-11-13T19:13:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d06cae29094846f1817036dc761a565d',ramdisk_id='',reservation_id='r-kv50en0j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1187420962',owner_user_name='tempest-AttachVolumeNegativeTest-1187420962-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T19:13:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1ca750d884c3403394b46f53fbd633a1',uuid=b048c677-85bf-4a93-88eb-c71bde27bf5b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4ae536b2-7829-45c2-8739-a3f838008e74", "address": "fa:16:3e:1a:59:bc", "network": {"id": "9dcbadf2-6b5e-41f1-88a3-17a579ad1bad", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-926239573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d06cae29094846f1817036dc761a565d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ae536b2-78", "ovs_interfaceid": "4ae536b2-7829-45c2-8739-a3f838008e74", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 19:18:44 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-f3d216ed-0293-465a-bc2d-30c6add9a862 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Converting VIF {"id": "4ae536b2-7829-45c2-8739-a3f838008e74", "address": "fa:16:3e:1a:59:bc", "network": {"id": "9dcbadf2-6b5e-41f1-88a3-17a579ad1bad", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-926239573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d06cae29094846f1817036dc761a565d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ae536b2-78", "ovs_interfaceid": "4ae536b2-7829-45c2-8739-a3f838008e74", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 19:18:44 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-f3d216ed-0293-465a-bc2d-30c6add9a862 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1a:59:bc,bridge_name='br-int',has_traffic_filtering=True,id=4ae536b2-7829-45c2-8739-a3f838008e74,network=Network(9dcbadf2-6b5e-41f1-88a3-17a579ad1bad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ae536b2-78') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 19:18:44 user nova-compute[75216]: DEBUG os_vif [None req-f3d216ed-0293-465a-bc2d-30c6add9a862 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1a:59:bc,bridge_name='br-int',has_traffic_filtering=True,id=4ae536b2-7829-45c2-8739-a3f838008e74,network=Network(9dcbadf2-6b5e-41f1-88a3-17a579ad1bad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ae536b2-78') {{(pid=75216) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 19:18:44 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:18:44 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4ae536b2-78, bridge=br-int, if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:18:44 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:18:44 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:18:44 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:18:44 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e8b82dd3-5088-469f-9724-5256b70659ae) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:18:44 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:18:44 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:18:44 user nova-compute[75216]: INFO os_vif [None req-f3d216ed-0293-465a-bc2d-30c6add9a862 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1a:59:bc,bridge_name='br-int',has_traffic_filtering=True,id=4ae536b2-7829-45c2-8739-a3f838008e74,network=Network(9dcbadf2-6b5e-41f1-88a3-17a579ad1bad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ae536b2-78')
Nov 13 19:18:44 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-f3d216ed-0293-465a-bc2d-30c6add9a862 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] [instance: b048c677-85bf-4a93-88eb-c71bde27bf5b] Deleting instance files /opt/stack/data/nova/instances/b048c677-85bf-4a93-88eb-c71bde27bf5b_del
Nov 13 19:18:44 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-f3d216ed-0293-465a-bc2d-30c6add9a862 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] [instance: b048c677-85bf-4a93-88eb-c71bde27bf5b] Deletion of /opt/stack/data/nova/instances/b048c677-85bf-4a93-88eb-c71bde27bf5b_del complete
Nov 13 19:18:44 user nova-compute[75216]: INFO nova.compute.manager [None req-f3d216ed-0293-465a-bc2d-30c6add9a862 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] [instance: b048c677-85bf-4a93-88eb-c71bde27bf5b] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 13 19:18:44 user nova-compute[75216]: DEBUG oslo.service.loopingcall [None req-f3d216ed-0293-465a-bc2d-30c6add9a862 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75216) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 19:18:44 user nova-compute[75216]: DEBUG nova.compute.manager [-] [instance: b048c677-85bf-4a93-88eb-c71bde27bf5b] Deallocating network for instance {{(pid=75216) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 19:18:44 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: b048c677-85bf-4a93-88eb-c71bde27bf5b] deallocate_for_instance() {{(pid=75216) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 19:18:44 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:18:44 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: b048c677-85bf-4a93-88eb-c71bde27bf5b] Updating instance_info_cache with network_info: [] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:18:44 user nova-compute[75216]: INFO nova.compute.manager [-] [instance: b048c677-85bf-4a93-88eb-c71bde27bf5b] Took 0.78 seconds to deallocate network for instance.
Nov 13 19:18:44 user nova-compute[75216]: DEBUG nova.compute.manager [req-846d83ae-94e3-4143-af9d-39e5680d05f4 req-f69992ba-196a-44b4-8719-cd7e9bfa6911 service nova] [instance: b048c677-85bf-4a93-88eb-c71bde27bf5b] Received event network-vif-deleted-4ae536b2-7829-45c2-8739-a3f838008e74 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:18:45 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-c89ba358-faca-4239-8a4e-af96ff42c4c3 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.287s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 19:18:45 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-c89ba358-faca-4239-8a4e-af96ff42c4c3 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] <== connect_volume: return (1290ms) {'type': 'block', 'scsi_wwn': '23730363638653366', 'path': '/dev/sdb'} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 19:18:45 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c89ba358-faca-4239-8a4e-af96ff42c4c3 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] [instance: 138c85af-655a-4a5c-ade7-daa7d7b58456] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23730363638653366', 'path': '/dev/sdb'} {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 19:18:45 user nova-compute[75216]: DEBUG nova.objects.instance [None req-c89ba358-faca-4239-8a4e-af96ff42c4c3 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Lazy-loading 'flavor' on Instance uuid 138c85af-655a-4a5c-ade7-daa7d7b58456 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:18:45 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-c89ba358-faca-4239-8a4e-af96ff42c4c3 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] attach device xml: <disk type="block" device="disk">
Nov 13 19:18:45 user nova-compute[75216]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 19:18:45 user nova-compute[75216]:   <source dev="/dev/sdb"/>
Nov 13 19:18:45 user nova-compute[75216]:   <target dev="vdb" bus="virtio"/>
Nov 13 19:18:45 user nova-compute[75216]:   <serial>d45727bc-d46f-45a0-8dd3-5687aaf2543f</serial>
Nov 13 19:18:45 user nova-compute[75216]: </disk>
Nov 13 19:18:45 user nova-compute[75216]:  {{(pid=75216) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 13 19:18:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f3d216ed-0293-465a-bc2d-30c6add9a862 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:18:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f3d216ed-0293-465a-bc2d-30c6add9a862 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:18:45 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-f3d216ed-0293-465a-bc2d-30c6add9a862 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 19:18:45 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-f3d216ed-0293-465a-bc2d-30c6add9a862 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 19:18:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f3d216ed-0293-465a-bc2d-30c6add9a862 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.205s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:18:45 user nova-compute[75216]: INFO nova.scheduler.client.report [None req-f3d216ed-0293-465a-bc2d-30c6add9a862 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Deleted allocations for instance b048c677-85bf-4a93-88eb-c71bde27bf5b
Nov 13 19:18:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f3d216ed-0293-465a-bc2d-30c6add9a862 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Lock "b048c677-85bf-4a93-88eb-c71bde27bf5b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.117s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:18:45 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-c89ba358-faca-4239-8a4e-af96ff42c4c3 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 19:18:45 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-c89ba358-faca-4239-8a4e-af96ff42c4c3 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 19:18:45 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-c89ba358-faca-4239-8a4e-af96ff42c4c3 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] No VIF found with MAC fa:16:3e:0d:29:74, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 19:18:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-c89ba358-faca-4239-8a4e-af96ff42c4c3 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Lock "138c85af-655a-4a5c-ade7-daa7d7b58456" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.006s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:18:45 user nova-compute[75216]: DEBUG nova.compute.manager [req-2957a645-4987-4422-a5b5-b6cb2be5c2df req-fc0c1bda-2938-4451-955f-518c5ecc9810 service nova] [instance: b048c677-85bf-4a93-88eb-c71bde27bf5b] Received event network-vif-plugged-4ae536b2-7829-45c2-8739-a3f838008e74 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:18:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-2957a645-4987-4422-a5b5-b6cb2be5c2df req-fc0c1bda-2938-4451-955f-518c5ecc9810 service nova] Acquiring lock "b048c677-85bf-4a93-88eb-c71bde27bf5b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:18:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-2957a645-4987-4422-a5b5-b6cb2be5c2df req-fc0c1bda-2938-4451-955f-518c5ecc9810 service nova] Lock "b048c677-85bf-4a93-88eb-c71bde27bf5b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:18:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-2957a645-4987-4422-a5b5-b6cb2be5c2df req-fc0c1bda-2938-4451-955f-518c5ecc9810 service nova] Lock "b048c677-85bf-4a93-88eb-c71bde27bf5b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:18:45 user nova-compute[75216]: DEBUG nova.compute.manager [req-2957a645-4987-4422-a5b5-b6cb2be5c2df req-fc0c1bda-2938-4451-955f-518c5ecc9810 service nova] [instance: b048c677-85bf-4a93-88eb-c71bde27bf5b] No waiting events found dispatching network-vif-plugged-4ae536b2-7829-45c2-8739-a3f838008e74 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 19:18:45 user nova-compute[75216]: WARNING nova.compute.manager [req-2957a645-4987-4422-a5b5-b6cb2be5c2df req-fc0c1bda-2938-4451-955f-518c5ecc9810 service nova] [instance: b048c677-85bf-4a93-88eb-c71bde27bf5b] Received unexpected event network-vif-plugged-4ae536b2-7829-45c2-8739-a3f838008e74 for instance with vm_state deleted and task_state None.
Nov 13 19:18:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:18:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:18:52 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-8c2f6eb7-248a-4359-b777-46561fcd4d13 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Acquiring lock "138c85af-655a-4a5c-ade7-daa7d7b58456" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:18:52 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-8c2f6eb7-248a-4359-b777-46561fcd4d13 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Lock "138c85af-655a-4a5c-ade7-daa7d7b58456" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:18:52 user nova-compute[75216]: INFO nova.compute.manager [None req-8c2f6eb7-248a-4359-b777-46561fcd4d13 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] [instance: 138c85af-655a-4a5c-ade7-daa7d7b58456] Detaching volume d45727bc-d46f-45a0-8dd3-5687aaf2543f
Nov 13 19:18:52 user nova-compute[75216]: INFO nova.virt.block_device [None req-8c2f6eb7-248a-4359-b777-46561fcd4d13 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] [instance: 138c85af-655a-4a5c-ade7-daa7d7b58456] Attempting to driver detach volume d45727bc-d46f-45a0-8dd3-5687aaf2543f from mountpoint /dev/vdb
Nov 13 19:18:52 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-8c2f6eb7-248a-4359-b777-46561fcd4d13 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Attempting to detach device vdb from instance 138c85af-655a-4a5c-ade7-daa7d7b58456 from the persistent domain config. {{(pid=75216) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 13 19:18:52 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-8c2f6eb7-248a-4359-b777-46561fcd4d13 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 19:18:52 user nova-compute[75216]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 19:18:52 user nova-compute[75216]:   <source dev="/dev/sdb"/>
Nov 13 19:18:52 user nova-compute[75216]:   <target dev="vdb" bus="virtio"/>
Nov 13 19:18:52 user nova-compute[75216]:   <serial>d45727bc-d46f-45a0-8dd3-5687aaf2543f</serial>
Nov 13 19:18:52 user nova-compute[75216]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 19:18:52 user nova-compute[75216]: </disk>
Nov 13 19:18:52 user nova-compute[75216]:  {{(pid=75216) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 19:18:52 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-8c2f6eb7-248a-4359-b777-46561fcd4d13 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Successfully detached device vdb from instance 138c85af-655a-4a5c-ade7-daa7d7b58456 from the persistent domain config.
Nov 13 19:18:52 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-8c2f6eb7-248a-4359-b777-46561fcd4d13 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 138c85af-655a-4a5c-ade7-daa7d7b58456 from the live domain config. {{(pid=75216) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 13 19:18:52 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-8c2f6eb7-248a-4359-b777-46561fcd4d13 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 19:18:52 user nova-compute[75216]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 19:18:52 user nova-compute[75216]:   <source dev="/dev/sdb"/>
Nov 13 19:18:52 user nova-compute[75216]:   <target dev="vdb" bus="virtio"/>
Nov 13 19:18:52 user nova-compute[75216]:   <serial>d45727bc-d46f-45a0-8dd3-5687aaf2543f</serial>
Nov 13 19:18:52 user nova-compute[75216]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 19:18:52 user nova-compute[75216]: </disk>
Nov 13 19:18:52 user nova-compute[75216]:  {{(pid=75216) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 19:18:52 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-539f5d84-2b14-44ab-b8b7-17703ddbeded tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Acquiring lock "138c85af-655a-4a5c-ade7-daa7d7b58456" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:18:52 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-8c2f6eb7-248a-4359-b777-46561fcd4d13 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 138c85af-655a-4a5c-ade7-daa7d7b58456 {{(pid=75216) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 13 19:18:54 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:18:54 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:18:59 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:19:03 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:19:04 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:19:08 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:19:09 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:19:10 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:19:11 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:19:11 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75216) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 19:19:11 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:19:11 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:19:11 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:19:11 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:19:11 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Auditing locally available compute resources for user (node: user) {{(pid=75216) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 19:19:11 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/138c85af-655a-4a5c-ade7-daa7d7b58456/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:19:11 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/138c85af-655a-4a5c-ade7-daa7d7b58456/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:19:11 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/138c85af-655a-4a5c-ade7-daa7d7b58456/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:19:11 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/138c85af-655a-4a5c-ade7-daa7d7b58456/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:19:11 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de2e9a72-2d63-4de6-8d18-a9d7490579a9/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:19:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de2e9a72-2d63-4de6-8d18-a9d7490579a9/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:19:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de2e9a72-2d63-4de6-8d18-a9d7490579a9/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:19:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de2e9a72-2d63-4de6-8d18-a9d7490579a9/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:19:12 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 19:19:12 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 19:19:12 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Hypervisor/Node resource view: name=user free_ram=8790MB free_disk=25.307697296142578GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75216) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 19:19:12 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:19:12 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:19:12 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-8c2f6eb7-248a-4359-b777-46561fcd4d13 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 138c85af-655a-4a5c-ade7-daa7d7b58456 is timed out.
Nov 13 19:19:12 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-8c2f6eb7-248a-4359-b777-46561fcd4d13 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Successfully detached device vdb from instance 138c85af-655a-4a5c-ade7-daa7d7b58456 from the live domain config.
Nov 13 19:19:12 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8c2f6eb7-248a-4359-b777-46561fcd4d13 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] [instance: 138c85af-655a-4a5c-ade7-daa7d7b58456] calling os-brick to detach iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 19:19:12 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c2f6eb7-248a-4359-b777-46561fcd4d13 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3a8669e40>, {'target_iqn': 'iqn.2010-10.org.openstack:d45727bc-d46f-45a0-8dd3-5687aaf2543f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aHjAMBKi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 19:19:12 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-8c2f6eb7-248a-4359-b777-46561fcd4d13 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 19:19:12 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-8c2f6eb7-248a-4359-b777-46561fcd4d13 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 19:19:12 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-8c2f6eb7-248a-4359-b777-46561fcd4d13 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 19:19:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:19:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:19:12 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d03450c-1475-4f4f-b6b1-ad68f5fea852]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d45727bc-d46f-45a0-8dd3-5687aaf2543f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:19:12 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c2f6eb7-248a-4359-b777-46561fcd4d13 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 19:19:12 user nova-compute[75216]: No targets found.
Nov 13 19:19:12 user nova-compute[75216]: iSNS:
Nov 13 19:19:12 user nova-compute[75216]: No targets found.
Nov 13 19:19:12 user nova-compute[75216]: STATIC:
Nov 13 19:19:12 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:d45727bc-d46f-45a0-8dd3-5687aaf2543f
Nov 13 19:19:12 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 19:19:12 user nova-compute[75216]:                 Iface Name: default
Nov 13 19:19:12 user nova-compute[75216]: FIRMWARE:
Nov 13 19:19:12 user nova-compute[75216]: No targets found.
Nov 13 19:19:12 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 19:19:12 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c2f6eb7-248a-4359-b777-46561fcd4d13 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 19:19:12 user nova-compute[75216]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 19:19:12 user nova-compute[75216]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75216) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 19:19:12 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c2f6eb7-248a-4359-b777-46561fcd4d13 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d45727bc-d46f-45a0-8dd3-5687aaf2543f', 0)] {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 19:19:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:19:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:19:12 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[c18efea1-9722-4a01-8fcd-4e72ba7b9984]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d45727bc-d46f-45a0-8dd3-5687aaf2543f\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:19:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:19:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:19:12 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[85774633-9b46-4178-81ec-a045d71787a1]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d45727bc-d46f-45a0-8dd3-5687aaf2543f (non-flash)\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:19:12 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c2f6eb7-248a-4359-b777-46561fcd4d13 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d45727bc-d46f-45a0-8dd3-5687aaf2543f (non-flash)
Nov 13 19:19:12 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 19:19:12 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c2f6eb7-248a-4359-b777-46561fcd4d13 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d45727bc-d46f-45a0-8dd3-5687aaf2543f (non-flash)
Nov 13 19:19:12 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 19:19:12 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c2f6eb7-248a-4359-b777-46561fcd4d13 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe3c02993f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d45727bc-d46f-45a0-8dd3-5687aaf2543f'): ({'sdb'}, set())}) {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 19:19:12 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-8c2f6eb7-248a-4359-b777-46561fcd4d13 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Removing single pathed devices sdb {{(pid=75216) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 19:19:12 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance 138c85af-655a-4a5c-ade7-daa7d7b58456 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 19:19:12 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance de2e9a72-2d63-4de6-8d18-a9d7490579a9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 19:19:12 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 19:19:12 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 19:19:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:19:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:19:12 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[5156140e-3684-492c-996d-2e700504d11c]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:19:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:19:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:19:12 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d1a927c-f9e9-4290-85b5-d36dd806cdc3]: (4, ('ok\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:19:12 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-8c2f6eb7-248a-4359-b777-46561fcd4d13 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Flushing IO for device /dev/sdb {{(pid=75216) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 19:19:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:19:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:19:12 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5d3bf8f-9fbc-4e7c-a91b-434e048ddd6f]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:19:12 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-8c2f6eb7-248a-4359-b777-46561fcd4d13 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75216) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 19:19:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:19:12 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 19:19:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.051s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:19:12 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[420e6e67-8ded-45db-985a-7fed471ed8e4]: (4, ('1', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:19:12 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-8c2f6eb7-248a-4359-b777-46561fcd4d13 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 19:19:12 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-8c2f6eb7-248a-4359-b777-46561fcd4d13 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] SCSI volumes sdb have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 19:19:12 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c2f6eb7-248a-4359-b777-46561fcd4d13 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d45727bc-d46f-45a0-8dd3-5687aaf2543f')] {{(pid=75216) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 19:19:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d45727bc-d46f-45a0-8dd3-5687aaf2543f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:19:12 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 19:19:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d45727bc-d46f-45a0-8dd3-5687aaf2543f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:19:12 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b32168b-febe-4ebe-8a0b-36aad1b876ec]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:19:12 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c2f6eb7-248a-4359-b777-46561fcd4d13 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:19:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d45727bc-d46f-45a0-8dd3-5687aaf2543f -p 172.16.0.220:3260 --logout {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:19:12 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Compute_service record updated for user:user {{(pid=75216) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 19:19:12 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.252s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:19:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d45727bc-d46f-45a0-8dd3-5687aaf2543f -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:19:12 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[7562aab6-de4e-4c39-9eff-28fe3be7af3f]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:d45727bc-d46f-45a0-8dd3-5687aaf2543f, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:d45727bc-d46f-45a0-8dd3-5687aaf2543f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:19:12 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c2f6eb7-248a-4359-b777-46561fcd4d13 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:d45727bc-d46f-45a0-8dd3-5687aaf2543f, portal: 172.16.0.220,3260]
Nov 13 19:19:12 user nova-compute[75216]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:d45727bc-d46f-45a0-8dd3-5687aaf2543f, portal: 172.16.0.220,3260] successful.
Nov 13 19:19:12 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:19:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d45727bc-d46f-45a0-8dd3-5687aaf2543f -p 172.16.0.220:3260 --op delete {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:19:12 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d45727bc-d46f-45a0-8dd3-5687aaf2543f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:19:12 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[9259121f-e518-4353-ace4-2e314522b38b]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:19:12 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c2f6eb7-248a-4359-b777-46561fcd4d13 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:19:12 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-8c2f6eb7-248a-4359-b777-46561fcd4d13 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.296s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 19:19:12 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c2f6eb7-248a-4359-b777-46561fcd4d13 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] <== disconnect_volume: return (298ms) None {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 19:19:12 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8c2f6eb7-248a-4359-b777-46561fcd4d13 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] [instance: 138c85af-655a-4a5c-ade7-daa7d7b58456] Disconnected iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 19:19:13 user nova-compute[75216]: DEBUG nova.objects.instance [None req-8c2f6eb7-248a-4359-b777-46561fcd4d13 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Lazy-loading 'flavor' on Instance uuid 138c85af-655a-4a5c-ade7-daa7d7b58456 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:19:13 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-8c2f6eb7-248a-4359-b777-46561fcd4d13 tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Lock "138c85af-655a-4a5c-ade7-daa7d7b58456" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.652s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:19:13 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-539f5d84-2b14-44ab-b8b7-17703ddbeded tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Lock "138c85af-655a-4a5c-ade7-daa7d7b58456" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.525s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:19:13 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-539f5d84-2b14-44ab-b8b7-17703ddbeded tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Acquiring lock "138c85af-655a-4a5c-ade7-daa7d7b58456-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:19:13 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-539f5d84-2b14-44ab-b8b7-17703ddbeded tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Lock "138c85af-655a-4a5c-ade7-daa7d7b58456-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:19:13 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-539f5d84-2b14-44ab-b8b7-17703ddbeded tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Lock "138c85af-655a-4a5c-ade7-daa7d7b58456-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:19:13 user nova-compute[75216]: INFO nova.compute.manager [None req-539f5d84-2b14-44ab-b8b7-17703ddbeded tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] [instance: 138c85af-655a-4a5c-ade7-daa7d7b58456] Terminating instance
Nov 13 19:19:13 user nova-compute[75216]: DEBUG nova.compute.manager [None req-539f5d84-2b14-44ab-b8b7-17703ddbeded tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] [instance: 138c85af-655a-4a5c-ade7-daa7d7b58456] Start destroying the instance on the hypervisor. {{(pid=75216) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 19:19:13 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:19:13 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:19:13 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:19:13 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:19:14 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:19:14 user nova-compute[75216]: DEBUG nova.compute.manager [req-04a6f0b6-04dd-43f8-83b6-2874464829d9 req-d72621fa-4e51-4832-9d05-72d9f49aee08 service nova] [instance: 138c85af-655a-4a5c-ade7-daa7d7b58456] Received event network-vif-unplugged-0d05704a-f922-44ef-984d-7c1d9e8546e5 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:19:14 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-04a6f0b6-04dd-43f8-83b6-2874464829d9 req-d72621fa-4e51-4832-9d05-72d9f49aee08 service nova] Acquiring lock "138c85af-655a-4a5c-ade7-daa7d7b58456-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:19:14 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-04a6f0b6-04dd-43f8-83b6-2874464829d9 req-d72621fa-4e51-4832-9d05-72d9f49aee08 service nova] Lock "138c85af-655a-4a5c-ade7-daa7d7b58456-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:19:14 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-04a6f0b6-04dd-43f8-83b6-2874464829d9 req-d72621fa-4e51-4832-9d05-72d9f49aee08 service nova] Lock "138c85af-655a-4a5c-ade7-daa7d7b58456-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:19:14 user nova-compute[75216]: DEBUG nova.compute.manager [req-04a6f0b6-04dd-43f8-83b6-2874464829d9 req-d72621fa-4e51-4832-9d05-72d9f49aee08 service nova] [instance: 138c85af-655a-4a5c-ade7-daa7d7b58456] No waiting events found dispatching network-vif-unplugged-0d05704a-f922-44ef-984d-7c1d9e8546e5 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 19:19:14 user nova-compute[75216]: DEBUG nova.compute.manager [req-04a6f0b6-04dd-43f8-83b6-2874464829d9 req-d72621fa-4e51-4832-9d05-72d9f49aee08 service nova] [instance: 138c85af-655a-4a5c-ade7-daa7d7b58456] Received event network-vif-unplugged-0d05704a-f922-44ef-984d-7c1d9e8546e5 for instance with task_state deleting. {{(pid=75216) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 19:19:14 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:19:14 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 138c85af-655a-4a5c-ade7-daa7d7b58456] Instance destroyed successfully.
Nov 13 19:19:14 user nova-compute[75216]: DEBUG nova.objects.instance [None req-539f5d84-2b14-44ab-b8b7-17703ddbeded tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Lazy-loading 'resources' on Instance uuid 138c85af-655a-4a5c-ade7-daa7d7b58456 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:19:14 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-539f5d84-2b14-44ab-b8b7-17703ddbeded tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T19:16:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-969172510',display_name='tempest-VolumesSnapshotTestJSON-instance-969172510',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-969172510',id=41,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDgzuYicWKfx8qQkUR4zZOJZFbX73zKCl1HJ6Hc5Y2oVfgdyB37L5V3oSNSqhbA+60Ya0uDClcogBt45XeMg0/RZE9Y10xquuh8OXOkjq41hwoahXtq1seJ5MlnOAzPWWg==',key_name='tempest-keypair-1095906425',keypairs=<?>,launch_index=0,launched_at=2023-11-13T19:16:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e8c5d1e9e06c4202b31637288388048a',ramdisk_id='',reservation_id='r-0tdoy5xf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1725517259',owner_user_name='tempest-VolumesSnapshotTestJSON-1725517259-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T19:16:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='75359f2870344d9d83ce124a7a990aaf',uuid=138c85af-655a-4a5c-ade7-daa7d7b58456,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0d05704a-f922-44ef-984d-7c1d9e8546e5", "address": "fa:16:3e:0d:29:74", "network": {"id": "5c3296e5-d81b-4378-9108-bcc3ced5458a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-381226649-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e8c5d1e9e06c4202b31637288388048a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d05704a-f9", "ovs_interfaceid": "0d05704a-f922-44ef-984d-7c1d9e8546e5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 19:19:14 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-539f5d84-2b14-44ab-b8b7-17703ddbeded tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Converting VIF {"id": "0d05704a-f922-44ef-984d-7c1d9e8546e5", "address": "fa:16:3e:0d:29:74", "network": {"id": "5c3296e5-d81b-4378-9108-bcc3ced5458a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-381226649-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e8c5d1e9e06c4202b31637288388048a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d05704a-f9", "ovs_interfaceid": "0d05704a-f922-44ef-984d-7c1d9e8546e5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 19:19:14 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-539f5d84-2b14-44ab-b8b7-17703ddbeded tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0d:29:74,bridge_name='br-int',has_traffic_filtering=True,id=0d05704a-f922-44ef-984d-7c1d9e8546e5,network=Network(5c3296e5-d81b-4378-9108-bcc3ced5458a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d05704a-f9') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 19:19:14 user nova-compute[75216]: DEBUG os_vif [None req-539f5d84-2b14-44ab-b8b7-17703ddbeded tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0d:29:74,bridge_name='br-int',has_traffic_filtering=True,id=0d05704a-f922-44ef-984d-7c1d9e8546e5,network=Network(5c3296e5-d81b-4378-9108-bcc3ced5458a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d05704a-f9') {{(pid=75216) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 19:19:14 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:19:14 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0d05704a-f9, bridge=br-int, if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:19:14 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:19:14 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:19:14 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:19:14 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2ea30a50-797b-4ae2-a1e1-32a3e88fb983) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:19:14 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:19:14 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:19:14 user nova-compute[75216]: INFO os_vif [None req-539f5d84-2b14-44ab-b8b7-17703ddbeded tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0d:29:74,bridge_name='br-int',has_traffic_filtering=True,id=0d05704a-f922-44ef-984d-7c1d9e8546e5,network=Network(5c3296e5-d81b-4378-9108-bcc3ced5458a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d05704a-f9')
Nov 13 19:19:14 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-539f5d84-2b14-44ab-b8b7-17703ddbeded tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] [instance: 138c85af-655a-4a5c-ade7-daa7d7b58456] calling os-brick to detach iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 19:19:14 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-539f5d84-2b14-44ab-b8b7-17703ddbeded tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3a8669e40>, {'target_iqn': 'iqn.2010-10.org.openstack:d45727bc-d46f-45a0-8dd3-5687aaf2543f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aHjAMBKi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 19:19:14 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-539f5d84-2b14-44ab-b8b7-17703ddbeded tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 19:19:14 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-539f5d84-2b14-44ab-b8b7-17703ddbeded tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 19:19:14 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-539f5d84-2b14-44ab-b8b7-17703ddbeded tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 19:19:14 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:19:14 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 21 in 0.019s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:19:14 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] 'iscsiadm -m discoverydb -o show -P 1' failed. Not Retrying. {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 19:19:14 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[ef40865e-ec0e-4145-b3ae-ab7ea2c9c64d]: Unexpected error while running command.
Nov 13 19:19:14 user nova-compute[75216]: Command: iscsiadm -m discoverydb -o show -P 1
Nov 13 19:19:14 user nova-compute[75216]: Exit code: 21
Nov 13 19:19:14 user nova-compute[75216]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Nov 13 19:19:14 user nova-compute[75216]: Stderr: '' {{(pid=85984) _process_cmd /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:477}}
Nov 13 19:19:14 user nova-compute[75216]: Traceback (most recent call last):
Nov 13 19:19:14 user nova-compute[75216]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py", line 474, in _process_cmd
Nov 13 19:19:14 user nova-compute[75216]:     ret = func(*f_args, **f_kwargs)
Nov 13 19:19:14 user nova-compute[75216]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/priv_context.py", line 274, in _wrap
Nov 13 19:19:14 user nova-compute[75216]:     return func(*args, **kwargs)
Nov 13 19:19:14 user nova-compute[75216]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 197, in execute_root
Nov 13 19:19:14 user nova-compute[75216]:     return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)
Nov 13 19:19:14 user nova-compute[75216]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 145, in custom_execute
Nov 13 19:19:14 user nova-compute[75216]:     return putils.execute(on_execute=on_execute,
Nov 13 19:19:14 user nova-compute[75216]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py", line 438, in execute
Nov 13 19:19:14 user nova-compute[75216]:     raise ProcessExecutionError(exit_code=_returncode,
Nov 13 19:19:14 user nova-compute[75216]: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Nov 13 19:19:14 user nova-compute[75216]: Command: iscsiadm -m discoverydb -o show -P 1
Nov 13 19:19:14 user nova-compute[75216]: Exit code: 21
Nov 13 19:19:14 user nova-compute[75216]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Nov 13 19:19:14 user nova-compute[75216]: Stderr: ''
Nov 13 19:19:14 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef40865e-ec0e-4145-b3ae-ab7ea2c9c64d]: (5, 'oslo_concurrency.processutils.ProcessExecutionError', ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n', '', 21, 'iscsiadm -m discoverydb -o show -P 1', None)) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:19:14 user nova-compute[75216]: ERROR os_brick.initiator.connectors.iscsi [None req-539f5d84-2b14-44ab-b8b7-17703ddbeded tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Exception encountered during portal discovery: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Nov 13 19:19:14 user nova-compute[75216]: Command: iscsiadm -m discoverydb -o show -P 1
Nov 13 19:19:14 user nova-compute[75216]: Exit code: 21
Nov 13 19:19:14 user nova-compute[75216]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Nov 13 19:19:14 user nova-compute[75216]: Stderr: ''
Nov 13 19:19:14 user nova-compute[75216]: ERROR os_brick.initiator.connectors.iscsi Traceback (most recent call last):
Nov 13 19:19:14 user nova-compute[75216]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 217, in _get_ips_iqns_luns
Nov 13 19:19:14 user nova-compute[75216]: ERROR os_brick.initiator.connectors.iscsi     ips_iqns_luns = method(connection_properties)
Nov 13 19:19:14 user nova-compute[75216]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 376, in _get_discoverydb_portals
Nov 13 19:19:14 user nova-compute[75216]: ERROR os_brick.initiator.connectors.iscsi     out = self._run_iscsiadm_bare(['-m', 'discoverydb',
Nov 13 19:19:14 user nova-compute[75216]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 1188, in _run_iscsiadm_bare
Nov 13 19:19:14 user nova-compute[75216]: ERROR os_brick.initiator.connectors.iscsi     (out, err) = self._execute('iscsiadm',
Nov 13 19:19:14 user nova-compute[75216]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/executor.py", line 55, in _execute
Nov 13 19:19:14 user nova-compute[75216]: ERROR os_brick.initiator.connectors.iscsi     result = self.__execute(*args, **kwargs)
Nov 13 19:19:14 user nova-compute[75216]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 172, in execute
Nov 13 19:19:14 user nova-compute[75216]: ERROR os_brick.initiator.connectors.iscsi     return execute_root(*cmd, **kwargs)
Nov 13 19:19:14 user nova-compute[75216]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/priv_context.py", line 271, in _wrap
Nov 13 19:19:14 user nova-compute[75216]: ERROR os_brick.initiator.connectors.iscsi     return self.channel.remote_call(name, args, kwargs,
Nov 13 19:19:14 user nova-compute[75216]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py", line 215, in remote_call
Nov 13 19:19:14 user nova-compute[75216]: ERROR os_brick.initiator.connectors.iscsi     raise exc_type(*result[2])
Nov 13 19:19:14 user nova-compute[75216]: ERROR os_brick.initiator.connectors.iscsi oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Nov 13 19:19:14 user nova-compute[75216]: ERROR os_brick.initiator.connectors.iscsi Command: iscsiadm -m discoverydb -o show -P 1
Nov 13 19:19:14 user nova-compute[75216]: ERROR os_brick.initiator.connectors.iscsi Exit code: 21
Nov 13 19:19:14 user nova-compute[75216]: ERROR os_brick.initiator.connectors.iscsi Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Nov 13 19:19:14 user nova-compute[75216]: ERROR os_brick.initiator.connectors.iscsi Stderr: ''
Nov 13 19:19:14 user nova-compute[75216]: ERROR os_brick.initiator.connectors.iscsi 
Nov 13 19:19:14 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-539f5d84-2b14-44ab-b8b7-17703ddbeded tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Skipping cleanup Unable to find target portal 172.16.0.220:3260. {{(pid=75216) _cleanup_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:934}}
Nov 13 19:19:14 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-539f5d84-2b14-44ab-b8b7-17703ddbeded tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.031s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 19:19:14 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-539f5d84-2b14-44ab-b8b7-17703ddbeded tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] <== disconnect_volume: return (33ms) None {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 19:19:14 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-539f5d84-2b14-44ab-b8b7-17703ddbeded tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] [instance: 138c85af-655a-4a5c-ade7-daa7d7b58456] Disconnected iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 19:19:14 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-539f5d84-2b14-44ab-b8b7-17703ddbeded tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] [instance: 138c85af-655a-4a5c-ade7-daa7d7b58456] Deleting instance files /opt/stack/data/nova/instances/138c85af-655a-4a5c-ade7-daa7d7b58456_del
Nov 13 19:19:14 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-539f5d84-2b14-44ab-b8b7-17703ddbeded tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] [instance: 138c85af-655a-4a5c-ade7-daa7d7b58456] Deletion of /opt/stack/data/nova/instances/138c85af-655a-4a5c-ade7-daa7d7b58456_del complete
Nov 13 19:19:14 user nova-compute[75216]: INFO nova.compute.manager [None req-539f5d84-2b14-44ab-b8b7-17703ddbeded tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] [instance: 138c85af-655a-4a5c-ade7-daa7d7b58456] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 13 19:19:14 user nova-compute[75216]: DEBUG oslo.service.loopingcall [None req-539f5d84-2b14-44ab-b8b7-17703ddbeded tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75216) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 19:19:14 user nova-compute[75216]: DEBUG nova.compute.manager [-] [instance: 138c85af-655a-4a5c-ade7-daa7d7b58456] Deallocating network for instance {{(pid=75216) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 19:19:14 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: 138c85af-655a-4a5c-ade7-daa7d7b58456] deallocate_for_instance() {{(pid=75216) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 19:19:14 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:19:14 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:19:15 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: 138c85af-655a-4a5c-ade7-daa7d7b58456] Updating instance_info_cache with network_info: [] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:19:15 user nova-compute[75216]: INFO nova.compute.manager [-] [instance: 138c85af-655a-4a5c-ade7-daa7d7b58456] Took 0.69 seconds to deallocate network for instance.
Nov 13 19:19:15 user nova-compute[75216]: WARNING nova.volume.cinder [None req-539f5d84-2b14-44ab-b8b7-17703ddbeded tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Attachment 853062c8-7772-488f-a451-617b95350a81 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 853062c8-7772-488f-a451-617b95350a81. (HTTP 404) (Request-ID: req-057cccef-2a40-401a-8429-0fd6d85ba94a)
Nov 13 19:19:15 user nova-compute[75216]: INFO nova.compute.manager [None req-539f5d84-2b14-44ab-b8b7-17703ddbeded tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] [instance: 138c85af-655a-4a5c-ade7-daa7d7b58456] Took 0.03 seconds to detach 1 volumes for instance.
Nov 13 19:19:15 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-539f5d84-2b14-44ab-b8b7-17703ddbeded tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:19:15 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-539f5d84-2b14-44ab-b8b7-17703ddbeded tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:19:15 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-539f5d84-2b14-44ab-b8b7-17703ddbeded tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 19:19:15 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-539f5d84-2b14-44ab-b8b7-17703ddbeded tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 19:19:15 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-539f5d84-2b14-44ab-b8b7-17703ddbeded tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.150s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:19:15 user nova-compute[75216]: INFO nova.scheduler.client.report [None req-539f5d84-2b14-44ab-b8b7-17703ddbeded tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Deleted allocations for instance 138c85af-655a-4a5c-ade7-daa7d7b58456
Nov 13 19:19:15 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-539f5d84-2b14-44ab-b8b7-17703ddbeded tempest-VolumesSnapshotTestJSON-1725517259 tempest-VolumesSnapshotTestJSON-1725517259-project-member] Lock "138c85af-655a-4a5c-ade7-daa7d7b58456" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.932s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:19:16 user nova-compute[75216]: DEBUG nova.compute.manager [req-56899d80-6ce4-42a7-8499-de0d7a639ec8 req-14f3c95f-bfe6-4849-bdc8-f0e8a0c9c89a service nova] [instance: 138c85af-655a-4a5c-ade7-daa7d7b58456] Received event network-vif-plugged-0d05704a-f922-44ef-984d-7c1d9e8546e5 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:19:16 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-56899d80-6ce4-42a7-8499-de0d7a639ec8 req-14f3c95f-bfe6-4849-bdc8-f0e8a0c9c89a service nova] Acquiring lock "138c85af-655a-4a5c-ade7-daa7d7b58456-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:19:16 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-56899d80-6ce4-42a7-8499-de0d7a639ec8 req-14f3c95f-bfe6-4849-bdc8-f0e8a0c9c89a service nova] Lock "138c85af-655a-4a5c-ade7-daa7d7b58456-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:19:16 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-56899d80-6ce4-42a7-8499-de0d7a639ec8 req-14f3c95f-bfe6-4849-bdc8-f0e8a0c9c89a service nova] Lock "138c85af-655a-4a5c-ade7-daa7d7b58456-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:19:16 user nova-compute[75216]: DEBUG nova.compute.manager [req-56899d80-6ce4-42a7-8499-de0d7a639ec8 req-14f3c95f-bfe6-4849-bdc8-f0e8a0c9c89a service nova] [instance: 138c85af-655a-4a5c-ade7-daa7d7b58456] No waiting events found dispatching network-vif-plugged-0d05704a-f922-44ef-984d-7c1d9e8546e5 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 19:19:16 user nova-compute[75216]: WARNING nova.compute.manager [req-56899d80-6ce4-42a7-8499-de0d7a639ec8 req-14f3c95f-bfe6-4849-bdc8-f0e8a0c9c89a service nova] [instance: 138c85af-655a-4a5c-ade7-daa7d7b58456] Received unexpected event network-vif-plugged-0d05704a-f922-44ef-984d-7c1d9e8546e5 for instance with vm_state deleted and task_state None.
Nov 13 19:19:16 user nova-compute[75216]: DEBUG nova.compute.manager [req-56899d80-6ce4-42a7-8499-de0d7a639ec8 req-14f3c95f-bfe6-4849-bdc8-f0e8a0c9c89a service nova] [instance: 138c85af-655a-4a5c-ade7-daa7d7b58456] Received event network-vif-deleted-0d05704a-f922-44ef-984d-7c1d9e8546e5 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:19:17 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:19:17 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Starting heal instance info cache {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 19:19:17 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Rebuilding the list of instances to heal {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 13 19:19:17 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "refresh_cache-de2e9a72-2d63-4de6-8d18-a9d7490579a9" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 19:19:17 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquired lock "refresh_cache-de2e9a72-2d63-4de6-8d18-a9d7490579a9" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 19:19:17 user nova-compute[75216]: DEBUG nova.network.neutron [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: de2e9a72-2d63-4de6-8d18-a9d7490579a9] Forcefully refreshing network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 19:19:17 user nova-compute[75216]: DEBUG nova.objects.instance [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lazy-loading 'info_cache' on Instance uuid de2e9a72-2d63-4de6-8d18-a9d7490579a9 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:19:17 user nova-compute[75216]: DEBUG nova.network.neutron [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: de2e9a72-2d63-4de6-8d18-a9d7490579a9] Updating instance_info_cache with network_info: [{"id": "1a0628c1-10a7-478a-a86e-0479da381b11", "address": "fa:16:3e:89:5b:db", "network": {"id": "913673cd-fbe9-48f6-b922-0fd6cf3b52e2", "bridge": "br-int", "label": "tempest-TestStampPattern-134235743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5c7034cfcc8457eb80e8f1875cd39f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a0628c1-10", "ovs_interfaceid": "1a0628c1-10a7-478a-a86e-0479da381b11", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:19:17 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Releasing lock "refresh_cache-de2e9a72-2d63-4de6-8d18-a9d7490579a9" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 19:19:17 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: de2e9a72-2d63-4de6-8d18-a9d7490579a9] Updated the network info_cache for instance {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 19:19:18 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:19:19 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:19:24 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:19:24 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:19:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:19:33 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:19:34 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:19:36 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a7f5aaf8-ce30-4df1-ba66-561e7c5d277a tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Acquiring lock "5fdd3ed4-447a-40b4-b325-19cf5094311d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:19:36 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a7f5aaf8-ce30-4df1-ba66-561e7c5d277a tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Lock "5fdd3ed4-447a-40b4-b325-19cf5094311d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:19:36 user nova-compute[75216]: DEBUG nova.compute.manager [None req-a7f5aaf8-ce30-4df1-ba66-561e7c5d277a tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] [instance: 5fdd3ed4-447a-40b4-b325-19cf5094311d] Starting instance... {{(pid=75216) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 19:19:37 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a7f5aaf8-ce30-4df1-ba66-561e7c5d277a tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:19:37 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a7f5aaf8-ce30-4df1-ba66-561e7c5d277a tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:19:37 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-a7f5aaf8-ce30-4df1-ba66-561e7c5d277a tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75216) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 19:19:37 user nova-compute[75216]: INFO nova.compute.claims [None req-a7f5aaf8-ce30-4df1-ba66-561e7c5d277a tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] [instance: 5fdd3ed4-447a-40b4-b325-19cf5094311d] Claim successful on node user
Nov 13 19:19:37 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-a7f5aaf8-ce30-4df1-ba66-561e7c5d277a tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 19:19:37 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-a7f5aaf8-ce30-4df1-ba66-561e7c5d277a tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 19:19:37 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a7f5aaf8-ce30-4df1-ba66-561e7c5d277a tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.223s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:19:37 user nova-compute[75216]: DEBUG nova.compute.manager [None req-a7f5aaf8-ce30-4df1-ba66-561e7c5d277a tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] [instance: 5fdd3ed4-447a-40b4-b325-19cf5094311d] Start building networks asynchronously for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 19:19:37 user nova-compute[75216]: DEBUG nova.compute.manager [None req-a7f5aaf8-ce30-4df1-ba66-561e7c5d277a tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] [instance: 5fdd3ed4-447a-40b4-b325-19cf5094311d] Allocating IP information in the background. {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 19:19:37 user nova-compute[75216]: DEBUG nova.network.neutron [None req-a7f5aaf8-ce30-4df1-ba66-561e7c5d277a tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] [instance: 5fdd3ed4-447a-40b4-b325-19cf5094311d] allocate_for_instance() {{(pid=75216) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 19:19:37 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-a7f5aaf8-ce30-4df1-ba66-561e7c5d277a tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] [instance: 5fdd3ed4-447a-40b4-b325-19cf5094311d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 19:19:37 user nova-compute[75216]: DEBUG nova.compute.manager [None req-a7f5aaf8-ce30-4df1-ba66-561e7c5d277a tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] [instance: 5fdd3ed4-447a-40b4-b325-19cf5094311d] Start building block device mappings for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 19:19:37 user nova-compute[75216]: DEBUG nova.policy [None req-a7f5aaf8-ce30-4df1-ba66-561e7c5d277a tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1ca750d884c3403394b46f53fbd633a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06cae29094846f1817036dc761a565d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75216) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 19:19:37 user nova-compute[75216]: DEBUG nova.compute.manager [None req-a7f5aaf8-ce30-4df1-ba66-561e7c5d277a tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] [instance: 5fdd3ed4-447a-40b4-b325-19cf5094311d] Start spawning the instance on the hypervisor. {{(pid=75216) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 19:19:37 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-a7f5aaf8-ce30-4df1-ba66-561e7c5d277a tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] [instance: 5fdd3ed4-447a-40b4-b325-19cf5094311d] Creating instance directory {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 19:19:37 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-a7f5aaf8-ce30-4df1-ba66-561e7c5d277a tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] [instance: 5fdd3ed4-447a-40b4-b325-19cf5094311d] Creating image(s)
Nov 13 19:19:37 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a7f5aaf8-ce30-4df1-ba66-561e7c5d277a tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Acquiring lock "/opt/stack/data/nova/instances/5fdd3ed4-447a-40b4-b325-19cf5094311d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:19:37 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a7f5aaf8-ce30-4df1-ba66-561e7c5d277a tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Lock "/opt/stack/data/nova/instances/5fdd3ed4-447a-40b4-b325-19cf5094311d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:19:37 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a7f5aaf8-ce30-4df1-ba66-561e7c5d277a tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Lock "/opt/stack/data/nova/instances/5fdd3ed4-447a-40b4-b325-19cf5094311d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:19:37 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-a7f5aaf8-ce30-4df1-ba66-561e7c5d277a tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:19:37 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-a7f5aaf8-ce30-4df1-ba66-561e7c5d277a tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json" returned: 0 in 0.167s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:19:37 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a7f5aaf8-ce30-4df1-ba66-561e7c5d277a tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Acquiring lock "88c50a45bec9d6b0427462b3242b9b8e5f49c2b6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:19:37 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a7f5aaf8-ce30-4df1-ba66-561e7c5d277a tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Lock "88c50a45bec9d6b0427462b3242b9b8e5f49c2b6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:19:37 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-a7f5aaf8-ce30-4df1-ba66-561e7c5d277a tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:19:37 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-a7f5aaf8-ce30-4df1-ba66-561e7c5d277a tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json" returned: 0 in 0.168s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:19:37 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-a7f5aaf8-ce30-4df1-ba66-561e7c5d277a tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6,backing_fmt=raw /opt/stack/data/nova/instances/5fdd3ed4-447a-40b4-b325-19cf5094311d/disk 1073741824 {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:19:37 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-a7f5aaf8-ce30-4df1-ba66-561e7c5d277a tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6,backing_fmt=raw /opt/stack/data/nova/instances/5fdd3ed4-447a-40b4-b325-19cf5094311d/disk 1073741824" returned: 0 in 0.051s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:19:37 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a7f5aaf8-ce30-4df1-ba66-561e7c5d277a tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Lock "88c50a45bec9d6b0427462b3242b9b8e5f49c2b6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.227s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:19:37 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-a7f5aaf8-ce30-4df1-ba66-561e7c5d277a tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:19:37 user nova-compute[75216]: DEBUG nova.network.neutron [None req-a7f5aaf8-ce30-4df1-ba66-561e7c5d277a tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] [instance: 5fdd3ed4-447a-40b4-b325-19cf5094311d] Successfully created port: 68ef4a31-9b53-4505-b10e-cdb40f3edab8 {{(pid=75216) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 19:19:38 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-a7f5aaf8-ce30-4df1-ba66-561e7c5d277a tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json" returned: 0 in 0.173s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:19:38 user nova-compute[75216]: DEBUG nova.virt.disk.api [None req-a7f5aaf8-ce30-4df1-ba66-561e7c5d277a tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5fdd3ed4-447a-40b4-b325-19cf5094311d/disk. size=1073741824 {{(pid=75216) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 19:19:38 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-a7f5aaf8-ce30-4df1-ba66-561e7c5d277a tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fdd3ed4-447a-40b4-b325-19cf5094311d/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:19:38 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-a7f5aaf8-ce30-4df1-ba66-561e7c5d277a tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fdd3ed4-447a-40b4-b325-19cf5094311d/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:19:38 user nova-compute[75216]: DEBUG nova.virt.disk.api [None req-a7f5aaf8-ce30-4df1-ba66-561e7c5d277a tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Cannot resize image /opt/stack/data/nova/instances/5fdd3ed4-447a-40b4-b325-19cf5094311d/disk to a smaller size. {{(pid=75216) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 19:19:38 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-a7f5aaf8-ce30-4df1-ba66-561e7c5d277a tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] [instance: 5fdd3ed4-447a-40b4-b325-19cf5094311d] Created local disks {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 19:19:38 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-a7f5aaf8-ce30-4df1-ba66-561e7c5d277a tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] [instance: 5fdd3ed4-447a-40b4-b325-19cf5094311d] Ensure instance console log exists: /opt/stack/data/nova/instances/5fdd3ed4-447a-40b4-b325-19cf5094311d/console.log {{(pid=75216) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 19:19:38 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a7f5aaf8-ce30-4df1-ba66-561e7c5d277a tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:19:38 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a7f5aaf8-ce30-4df1-ba66-561e7c5d277a tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:19:38 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a7f5aaf8-ce30-4df1-ba66-561e7c5d277a tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:19:38 user nova-compute[75216]: DEBUG nova.network.neutron [None req-a7f5aaf8-ce30-4df1-ba66-561e7c5d277a tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] [instance: 5fdd3ed4-447a-40b4-b325-19cf5094311d] Successfully updated port: 68ef4a31-9b53-4505-b10e-cdb40f3edab8 {{(pid=75216) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 19:19:38 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a7f5aaf8-ce30-4df1-ba66-561e7c5d277a tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Acquiring lock "refresh_cache-5fdd3ed4-447a-40b4-b325-19cf5094311d" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 19:19:38 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a7f5aaf8-ce30-4df1-ba66-561e7c5d277a tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Acquired lock "refresh_cache-5fdd3ed4-447a-40b4-b325-19cf5094311d" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 19:19:38 user nova-compute[75216]: DEBUG nova.network.neutron [None req-a7f5aaf8-ce30-4df1-ba66-561e7c5d277a tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] [instance: 5fdd3ed4-447a-40b4-b325-19cf5094311d] Building network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 19:19:38 user nova-compute[75216]: DEBUG nova.compute.manager [req-2bce8875-5657-4a24-9689-b6ec20c3531c req-3a2fdf63-ee9d-41af-805b-a00fb5fe4b1a service nova] [instance: 5fdd3ed4-447a-40b4-b325-19cf5094311d] Received event network-changed-68ef4a31-9b53-4505-b10e-cdb40f3edab8 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:19:38 user nova-compute[75216]: DEBUG nova.compute.manager [req-2bce8875-5657-4a24-9689-b6ec20c3531c req-3a2fdf63-ee9d-41af-805b-a00fb5fe4b1a service nova] [instance: 5fdd3ed4-447a-40b4-b325-19cf5094311d] Refreshing instance network info cache due to event network-changed-68ef4a31-9b53-4505-b10e-cdb40f3edab8. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 19:19:38 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-2bce8875-5657-4a24-9689-b6ec20c3531c req-3a2fdf63-ee9d-41af-805b-a00fb5fe4b1a service nova] Acquiring lock "refresh_cache-5fdd3ed4-447a-40b4-b325-19cf5094311d" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 19:19:38 user nova-compute[75216]: DEBUG nova.network.neutron [None req-a7f5aaf8-ce30-4df1-ba66-561e7c5d277a tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] [instance: 5fdd3ed4-447a-40b4-b325-19cf5094311d] Instance cache missing network info. {{(pid=75216) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 19:19:38 user nova-compute[75216]: DEBUG nova.network.neutron [None req-a7f5aaf8-ce30-4df1-ba66-561e7c5d277a tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] [instance: 5fdd3ed4-447a-40b4-b325-19cf5094311d] Updating instance_info_cache with network_info: [{"id": "68ef4a31-9b53-4505-b10e-cdb40f3edab8", "address": "fa:16:3e:b7:ff:a5", "network": {"id": "9dcbadf2-6b5e-41f1-88a3-17a579ad1bad", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-926239573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d06cae29094846f1817036dc761a565d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68ef4a31-9b", "ovs_interfaceid": "68ef4a31-9b53-4505-b10e-cdb40f3edab8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:19:38 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a7f5aaf8-ce30-4df1-ba66-561e7c5d277a tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Releasing lock "refresh_cache-5fdd3ed4-447a-40b4-b325-19cf5094311d" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 19:19:38 user nova-compute[75216]: DEBUG nova.compute.manager [None req-a7f5aaf8-ce30-4df1-ba66-561e7c5d277a tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] [instance: 5fdd3ed4-447a-40b4-b325-19cf5094311d] Instance network_info: |[{"id": "68ef4a31-9b53-4505-b10e-cdb40f3edab8", "address": "fa:16:3e:b7:ff:a5", "network": {"id": "9dcbadf2-6b5e-41f1-88a3-17a579ad1bad", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-926239573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d06cae29094846f1817036dc761a565d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68ef4a31-9b", "ovs_interfaceid": "68ef4a31-9b53-4505-b10e-cdb40f3edab8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 19:19:38 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-2bce8875-5657-4a24-9689-b6ec20c3531c req-3a2fdf63-ee9d-41af-805b-a00fb5fe4b1a service nova] Acquired lock "refresh_cache-5fdd3ed4-447a-40b4-b325-19cf5094311d" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 19:19:38 user nova-compute[75216]: DEBUG nova.network.neutron [req-2bce8875-5657-4a24-9689-b6ec20c3531c req-3a2fdf63-ee9d-41af-805b-a00fb5fe4b1a service nova] [instance: 5fdd3ed4-447a-40b4-b325-19cf5094311d] Refreshing network info cache for port 68ef4a31-9b53-4505-b10e-cdb40f3edab8 {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 19:19:38 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-a7f5aaf8-ce30-4df1-ba66-561e7c5d277a tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] [instance: 5fdd3ed4-447a-40b4-b325-19cf5094311d] Start _get_guest_xml network_info=[{"id": "68ef4a31-9b53-4505-b10e-cdb40f3edab8", "address": "fa:16:3e:b7:ff:a5", "network": {"id": "9dcbadf2-6b5e-41f1-88a3-17a579ad1bad", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-926239573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d06cae29094846f1817036dc761a565d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68ef4a31-9b", "ovs_interfaceid": "68ef4a31-9b53-4505-b10e-cdb40f3edab8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T18:41:06Z,direct_url=<?>,disk_format='qcow2',id=77bcb5ba-8510-41ec-a88d-96097bb431de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c465b7c26ec44582b6d1b7169536ecc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T18:41:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'guest_format': None, 'boot_index': 0, 'image_id': '77bcb5ba-8510-41ec-a88d-96097bb431de'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 19:19:38 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-a7f5aaf8-ce30-4df1-ba66-561e7c5d277a tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 19:19:38 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-a7f5aaf8-ce30-4df1-ba66-561e7c5d277a tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 19:19:38 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-a7f5aaf8-ce30-4df1-ba66-561e7c5d277a tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 19:19:38 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-a7f5aaf8-ce30-4df1-ba66-561e7c5d277a tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] CPU controller missing on host. {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 19:19:38 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-a7f5aaf8-ce30-4df1-ba66-561e7c5d277a tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 19:19:38 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-a7f5aaf8-ce30-4df1-ba66-561e7c5d277a tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] CPU controller found on host. {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 19:19:38 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-a7f5aaf8-ce30-4df1-ba66-561e7c5d277a tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75216) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 19:19:38 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-a7f5aaf8-ce30-4df1-ba66-561e7c5d277a tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T18:40:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T18:41:06Z,direct_url=<?>,disk_format='qcow2',id=77bcb5ba-8510-41ec-a88d-96097bb431de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c465b7c26ec44582b6d1b7169536ecc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T18:41:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 19:19:38 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-a7f5aaf8-ce30-4df1-ba66-561e7c5d277a tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Flavor limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 19:19:38 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-a7f5aaf8-ce30-4df1-ba66-561e7c5d277a tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Image limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 19:19:38 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-a7f5aaf8-ce30-4df1-ba66-561e7c5d277a tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Flavor pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 19:19:38 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-a7f5aaf8-ce30-4df1-ba66-561e7c5d277a tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Image pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 19:19:38 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-a7f5aaf8-ce30-4df1-ba66-561e7c5d277a tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 19:19:38 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-a7f5aaf8-ce30-4df1-ba66-561e7c5d277a tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 19:19:38 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-a7f5aaf8-ce30-4df1-ba66-561e7c5d277a tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 19:19:38 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-a7f5aaf8-ce30-4df1-ba66-561e7c5d277a tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Got 1 possible topologies {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 19:19:38 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-a7f5aaf8-ce30-4df1-ba66-561e7c5d277a tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 19:19:38 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-a7f5aaf8-ce30-4df1-ba66-561e7c5d277a tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 19:19:38 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-a7f5aaf8-ce30-4df1-ba66-561e7c5d277a tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T19:19:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-363154195',display_name='tempest-AttachVolumeNegativeTest-server-363154195',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-363154195',id=43,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOOu3H6hOiW3t9JNnTHCCoQ+NdqEBlkMMDHiLYKs8YFa/bYVY+b3bwDziGXe+cZEW+27SvXluE491SXFIJ1F0JK/1i0kRj4fIw0DXx94if/XHnG74APUsxeef1IdkDAGSA==',key_name='tempest-keypair-1123496158',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d06cae29094846f1817036dc761a565d',ramdisk_id='',reservation_id='r-acqkab20',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1187420962',owner_user_name='tempest-AttachVolumeNegativeTest-1187420962-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T19:19:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1ca750d884c3403394b46f53fbd633a1',uuid=5fdd3ed4-447a-40b4-b325-19cf5094311d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "68ef4a31-9b53-4505-b10e-cdb40f3edab8", "address": "fa:16:3e:b7:ff:a5", "network": {"id": "9dcbadf2-6b5e-41f1-88a3-17a579ad1bad", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-926239573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d06cae29094846f1817036dc761a565d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68ef4a31-9b", "ovs_interfaceid": "68ef4a31-9b53-4505-b10e-cdb40f3edab8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75216) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 19:19:38 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-a7f5aaf8-ce30-4df1-ba66-561e7c5d277a tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Converting VIF {"id": "68ef4a31-9b53-4505-b10e-cdb40f3edab8", "address": "fa:16:3e:b7:ff:a5", "network": {"id": "9dcbadf2-6b5e-41f1-88a3-17a579ad1bad", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-926239573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d06cae29094846f1817036dc761a565d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68ef4a31-9b", "ovs_interfaceid": "68ef4a31-9b53-4505-b10e-cdb40f3edab8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 19:19:38 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-a7f5aaf8-ce30-4df1-ba66-561e7c5d277a tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:ff:a5,bridge_name='br-int',has_traffic_filtering=True,id=68ef4a31-9b53-4505-b10e-cdb40f3edab8,network=Network(9dcbadf2-6b5e-41f1-88a3-17a579ad1bad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68ef4a31-9b') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 19:19:38 user nova-compute[75216]: DEBUG nova.objects.instance [None req-a7f5aaf8-ce30-4df1-ba66-561e7c5d277a tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Lazy-loading 'pci_devices' on Instance uuid 5fdd3ed4-447a-40b4-b325-19cf5094311d {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:19:38 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-a7f5aaf8-ce30-4df1-ba66-561e7c5d277a tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] [instance: 5fdd3ed4-447a-40b4-b325-19cf5094311d] End _get_guest_xml xml=<domain type="kvm">
Nov 13 19:19:38 user nova-compute[75216]:   <uuid>5fdd3ed4-447a-40b4-b325-19cf5094311d</uuid>
Nov 13 19:19:38 user nova-compute[75216]:   <name>instance-0000002b</name>
Nov 13 19:19:38 user nova-compute[75216]:   <memory>524288</memory>
Nov 13 19:19:38 user nova-compute[75216]:   <vcpu>1</vcpu>
Nov 13 19:19:38 user nova-compute[75216]:   <metadata>
Nov 13 19:19:38 user nova-compute[75216]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 19:19:38 user nova-compute[75216]:       <nova:package version="0.0.0"/>
Nov 13 19:19:38 user nova-compute[75216]:       <nova:name>tempest-AttachVolumeNegativeTest-server-363154195</nova:name>
Nov 13 19:19:38 user nova-compute[75216]:       <nova:creationTime>2023-11-13 19:19:38</nova:creationTime>
Nov 13 19:19:38 user nova-compute[75216]:       <nova:flavor name="m1.tiny">
Nov 13 19:19:38 user nova-compute[75216]:         <nova:memory>512</nova:memory>
Nov 13 19:19:38 user nova-compute[75216]:         <nova:disk>1</nova:disk>
Nov 13 19:19:38 user nova-compute[75216]:         <nova:swap>0</nova:swap>
Nov 13 19:19:38 user nova-compute[75216]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 19:19:38 user nova-compute[75216]:         <nova:vcpus>1</nova:vcpus>
Nov 13 19:19:38 user nova-compute[75216]:       </nova:flavor>
Nov 13 19:19:38 user nova-compute[75216]:       <nova:owner>
Nov 13 19:19:38 user nova-compute[75216]:         <nova:user uuid="1ca750d884c3403394b46f53fbd633a1">tempest-AttachVolumeNegativeTest-1187420962-project-member</nova:user>
Nov 13 19:19:38 user nova-compute[75216]:         <nova:project uuid="d06cae29094846f1817036dc761a565d">tempest-AttachVolumeNegativeTest-1187420962</nova:project>
Nov 13 19:19:38 user nova-compute[75216]:       </nova:owner>
Nov 13 19:19:38 user nova-compute[75216]:       <nova:root type="image" uuid="77bcb5ba-8510-41ec-a88d-96097bb431de"/>
Nov 13 19:19:38 user nova-compute[75216]:       <nova:ports>
Nov 13 19:19:38 user nova-compute[75216]:         <nova:port uuid="68ef4a31-9b53-4505-b10e-cdb40f3edab8">
Nov 13 19:19:38 user nova-compute[75216]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 13 19:19:38 user nova-compute[75216]:         </nova:port>
Nov 13 19:19:38 user nova-compute[75216]:       </nova:ports>
Nov 13 19:19:38 user nova-compute[75216]:     </nova:instance>
Nov 13 19:19:38 user nova-compute[75216]:   </metadata>
Nov 13 19:19:38 user nova-compute[75216]:   <sysinfo type="smbios">
Nov 13 19:19:38 user nova-compute[75216]:     <system>
Nov 13 19:19:38 user nova-compute[75216]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 19:19:38 user nova-compute[75216]:       <entry name="product">OpenStack Nova</entry>
Nov 13 19:19:38 user nova-compute[75216]:       <entry name="version">0.0.0</entry>
Nov 13 19:19:38 user nova-compute[75216]:       <entry name="serial">5fdd3ed4-447a-40b4-b325-19cf5094311d</entry>
Nov 13 19:19:38 user nova-compute[75216]:       <entry name="uuid">5fdd3ed4-447a-40b4-b325-19cf5094311d</entry>
Nov 13 19:19:38 user nova-compute[75216]:       <entry name="family">Virtual Machine</entry>
Nov 13 19:19:38 user nova-compute[75216]:     </system>
Nov 13 19:19:38 user nova-compute[75216]:   </sysinfo>
Nov 13 19:19:38 user nova-compute[75216]:   <os>
Nov 13 19:19:38 user nova-compute[75216]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 19:19:38 user nova-compute[75216]:     <boot dev="hd"/>
Nov 13 19:19:38 user nova-compute[75216]:     <smbios mode="sysinfo"/>
Nov 13 19:19:38 user nova-compute[75216]:   </os>
Nov 13 19:19:38 user nova-compute[75216]:   <features>
Nov 13 19:19:38 user nova-compute[75216]:     <acpi/>
Nov 13 19:19:38 user nova-compute[75216]:     <apic/>
Nov 13 19:19:38 user nova-compute[75216]:     <vmcoreinfo/>
Nov 13 19:19:38 user nova-compute[75216]:   </features>
Nov 13 19:19:38 user nova-compute[75216]:   <clock offset="utc">
Nov 13 19:19:38 user nova-compute[75216]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 19:19:38 user nova-compute[75216]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 19:19:38 user nova-compute[75216]:     <timer name="hpet" present="no"/>
Nov 13 19:19:38 user nova-compute[75216]:   </clock>
Nov 13 19:19:38 user nova-compute[75216]:   <cpu mode="custom" match="exact">
Nov 13 19:19:38 user nova-compute[75216]:     <model>Nehalem</model>
Nov 13 19:19:38 user nova-compute[75216]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 19:19:38 user nova-compute[75216]:   </cpu>
Nov 13 19:19:38 user nova-compute[75216]:   <devices>
Nov 13 19:19:38 user nova-compute[75216]:     <disk type="file" device="disk">
Nov 13 19:19:38 user nova-compute[75216]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 19:19:38 user nova-compute[75216]:       <source file="/opt/stack/data/nova/instances/5fdd3ed4-447a-40b4-b325-19cf5094311d/disk"/>
Nov 13 19:19:38 user nova-compute[75216]:       <target dev="vda" bus="virtio"/>
Nov 13 19:19:38 user nova-compute[75216]:     </disk>
Nov 13 19:19:38 user nova-compute[75216]:     <interface type="ethernet">
Nov 13 19:19:38 user nova-compute[75216]:       <mac address="fa:16:3e:b7:ff:a5"/>
Nov 13 19:19:38 user nova-compute[75216]:       <model type="virtio"/>
Nov 13 19:19:38 user nova-compute[75216]:       <mtu size="1442"/>
Nov 13 19:19:38 user nova-compute[75216]:       <target dev="tap68ef4a31-9b"/>
Nov 13 19:19:38 user nova-compute[75216]:     </interface>
Nov 13 19:19:38 user nova-compute[75216]:     <serial type="pty">
Nov 13 19:19:38 user nova-compute[75216]:       <log file="/opt/stack/data/nova/instances/5fdd3ed4-447a-40b4-b325-19cf5094311d/console.log" append="off"/>
Nov 13 19:19:38 user nova-compute[75216]:     </serial>
Nov 13 19:19:38 user nova-compute[75216]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 19:19:38 user nova-compute[75216]:     <video>
Nov 13 19:19:38 user nova-compute[75216]:       <model type="virtio"/>
Nov 13 19:19:38 user nova-compute[75216]:     </video>
Nov 13 19:19:38 user nova-compute[75216]:     <rng model="virtio">
Nov 13 19:19:38 user nova-compute[75216]:       <backend model="random">/dev/urandom</backend>
Nov 13 19:19:38 user nova-compute[75216]:     </rng>
Nov 13 19:19:38 user nova-compute[75216]:     <controller type="usb" index="0" model="none"/>
Nov 13 19:19:38 user nova-compute[75216]:     <memballoon model="virtio">
Nov 13 19:19:38 user nova-compute[75216]:       <stats period="10"/>
Nov 13 19:19:38 user nova-compute[75216]:     </memballoon>
Nov 13 19:19:38 user nova-compute[75216]:   </devices>
Nov 13 19:19:38 user nova-compute[75216]: </domain>
Nov 13 19:19:38 user nova-compute[75216]:  {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 19:19:38 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-a7f5aaf8-ce30-4df1-ba66-561e7c5d277a tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T19:19:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-363154195',display_name='tempest-AttachVolumeNegativeTest-server-363154195',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-363154195',id=43,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOOu3H6hOiW3t9JNnTHCCoQ+NdqEBlkMMDHiLYKs8YFa/bYVY+b3bwDziGXe+cZEW+27SvXluE491SXFIJ1F0JK/1i0kRj4fIw0DXx94if/XHnG74APUsxeef1IdkDAGSA==',key_name='tempest-keypair-1123496158',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d06cae29094846f1817036dc761a565d',ramdisk_id='',reservation_id='r-acqkab20',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1187420962',owner_user_name='tempest-AttachVolumeNegativeTest-1187420962-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T19:19:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1ca750d884c3403394b46f53fbd633a1',uuid=5fdd3ed4-447a-40b4-b325-19cf5094311d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "68ef4a31-9b53-4505-b10e-cdb40f3edab8", "address": "fa:16:3e:b7:ff:a5", "network": {"id": "9dcbadf2-6b5e-41f1-88a3-17a579ad1bad", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-926239573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d06cae29094846f1817036dc761a565d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68ef4a31-9b", "ovs_interfaceid": "68ef4a31-9b53-4505-b10e-cdb40f3edab8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 19:19:38 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-a7f5aaf8-ce30-4df1-ba66-561e7c5d277a tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Converting VIF {"id": "68ef4a31-9b53-4505-b10e-cdb40f3edab8", "address": "fa:16:3e:b7:ff:a5", "network": {"id": "9dcbadf2-6b5e-41f1-88a3-17a579ad1bad", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-926239573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d06cae29094846f1817036dc761a565d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68ef4a31-9b", "ovs_interfaceid": "68ef4a31-9b53-4505-b10e-cdb40f3edab8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 19:19:38 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-a7f5aaf8-ce30-4df1-ba66-561e7c5d277a tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:ff:a5,bridge_name='br-int',has_traffic_filtering=True,id=68ef4a31-9b53-4505-b10e-cdb40f3edab8,network=Network(9dcbadf2-6b5e-41f1-88a3-17a579ad1bad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68ef4a31-9b') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 19:19:38 user nova-compute[75216]: DEBUG os_vif [None req-a7f5aaf8-ce30-4df1-ba66-561e7c5d277a tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:ff:a5,bridge_name='br-int',has_traffic_filtering=True,id=68ef4a31-9b53-4505-b10e-cdb40f3edab8,network=Network(9dcbadf2-6b5e-41f1-88a3-17a579ad1bad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68ef4a31-9b') {{(pid=75216) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 19:19:38 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:19:38 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:19:38 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 19:19:38 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:19:38 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '03403b74-4ad2-5907-9fd5-7a6841219ad3', '_type': 'linux-noop'}}, row=False) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:19:38 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:19:38 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:19:38 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:19:38 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap68ef4a31-9b, may_exist=True, interface_attrs={}) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:19:38 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap68ef4a31-9b, col_values=(('qos', UUID('3a73a178-8268-4d3a-a685-b73e88613bae')),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:19:38 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap68ef4a31-9b, col_values=(('external_ids', {'iface-id': '68ef4a31-9b53-4505-b10e-cdb40f3edab8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b7:ff:a5', 'vm-uuid': '5fdd3ed4-447a-40b4-b325-19cf5094311d'}),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:19:38 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:19:38 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:19:38 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:19:38 user nova-compute[75216]: INFO os_vif [None req-a7f5aaf8-ce30-4df1-ba66-561e7c5d277a tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:ff:a5,bridge_name='br-int',has_traffic_filtering=True,id=68ef4a31-9b53-4505-b10e-cdb40f3edab8,network=Network(9dcbadf2-6b5e-41f1-88a3-17a579ad1bad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68ef4a31-9b')
Nov 13 19:19:38 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-a7f5aaf8-ce30-4df1-ba66-561e7c5d277a tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 19:19:38 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-a7f5aaf8-ce30-4df1-ba66-561e7c5d277a tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] No VIF found with MAC fa:16:3e:b7:ff:a5, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 19:19:39 user nova-compute[75216]: DEBUG nova.network.neutron [req-2bce8875-5657-4a24-9689-b6ec20c3531c req-3a2fdf63-ee9d-41af-805b-a00fb5fe4b1a service nova] [instance: 5fdd3ed4-447a-40b4-b325-19cf5094311d] Updated VIF entry in instance network info cache for port 68ef4a31-9b53-4505-b10e-cdb40f3edab8. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 19:19:39 user nova-compute[75216]: DEBUG nova.network.neutron [req-2bce8875-5657-4a24-9689-b6ec20c3531c req-3a2fdf63-ee9d-41af-805b-a00fb5fe4b1a service nova] [instance: 5fdd3ed4-447a-40b4-b325-19cf5094311d] Updating instance_info_cache with network_info: [{"id": "68ef4a31-9b53-4505-b10e-cdb40f3edab8", "address": "fa:16:3e:b7:ff:a5", "network": {"id": "9dcbadf2-6b5e-41f1-88a3-17a579ad1bad", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-926239573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d06cae29094846f1817036dc761a565d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68ef4a31-9b", "ovs_interfaceid": "68ef4a31-9b53-4505-b10e-cdb40f3edab8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:19:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-2bce8875-5657-4a24-9689-b6ec20c3531c req-3a2fdf63-ee9d-41af-805b-a00fb5fe4b1a service nova] Releasing lock "refresh_cache-5fdd3ed4-447a-40b4-b325-19cf5094311d" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 19:19:40 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:19:40 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:19:40 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:19:40 user nova-compute[75216]: DEBUG nova.compute.manager [req-80a91dd5-cba4-4536-9672-be6805682771 req-8f0a1ad0-9bec-40de-883b-bf301893eb4d service nova] [instance: 5fdd3ed4-447a-40b4-b325-19cf5094311d] Received event network-vif-plugged-68ef4a31-9b53-4505-b10e-cdb40f3edab8 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:19:40 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-80a91dd5-cba4-4536-9672-be6805682771 req-8f0a1ad0-9bec-40de-883b-bf301893eb4d service nova] Acquiring lock "5fdd3ed4-447a-40b4-b325-19cf5094311d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:19:40 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-80a91dd5-cba4-4536-9672-be6805682771 req-8f0a1ad0-9bec-40de-883b-bf301893eb4d service nova] Lock "5fdd3ed4-447a-40b4-b325-19cf5094311d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:19:40 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-80a91dd5-cba4-4536-9672-be6805682771 req-8f0a1ad0-9bec-40de-883b-bf301893eb4d service nova] Lock "5fdd3ed4-447a-40b4-b325-19cf5094311d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:19:40 user nova-compute[75216]: DEBUG nova.compute.manager [req-80a91dd5-cba4-4536-9672-be6805682771 req-8f0a1ad0-9bec-40de-883b-bf301893eb4d service nova] [instance: 5fdd3ed4-447a-40b4-b325-19cf5094311d] No waiting events found dispatching network-vif-plugged-68ef4a31-9b53-4505-b10e-cdb40f3edab8 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 19:19:40 user nova-compute[75216]: WARNING nova.compute.manager [req-80a91dd5-cba4-4536-9672-be6805682771 req-8f0a1ad0-9bec-40de-883b-bf301893eb4d service nova] [instance: 5fdd3ed4-447a-40b4-b325-19cf5094311d] Received unexpected event network-vif-plugged-68ef4a31-9b53-4505-b10e-cdb40f3edab8 for instance with vm_state building and task_state spawning.
Nov 13 19:19:40 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:19:40 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:19:40 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:19:40 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:19:42 user nova-compute[75216]: DEBUG nova.compute.manager [None req-a7f5aaf8-ce30-4df1-ba66-561e7c5d277a tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] [instance: 5fdd3ed4-447a-40b4-b325-19cf5094311d] Instance event wait completed in 0 seconds for  {{(pid=75216) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 19:19:42 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-a7f5aaf8-ce30-4df1-ba66-561e7c5d277a tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] [instance: 5fdd3ed4-447a-40b4-b325-19cf5094311d] Guest created on hypervisor {{(pid=75216) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 19:19:42 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 5fdd3ed4-447a-40b4-b325-19cf5094311d] Instance spawned successfully.
Nov 13 19:19:42 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-a7f5aaf8-ce30-4df1-ba66-561e7c5d277a tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] [instance: 5fdd3ed4-447a-40b4-b325-19cf5094311d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 19:19:42 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-a7f5aaf8-ce30-4df1-ba66-561e7c5d277a tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] [instance: 5fdd3ed4-447a-40b4-b325-19cf5094311d] Found default for hw_cdrom_bus of ide {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 19:19:42 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-a7f5aaf8-ce30-4df1-ba66-561e7c5d277a tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] [instance: 5fdd3ed4-447a-40b4-b325-19cf5094311d] Found default for hw_disk_bus of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 19:19:42 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-a7f5aaf8-ce30-4df1-ba66-561e7c5d277a tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] [instance: 5fdd3ed4-447a-40b4-b325-19cf5094311d] Found default for hw_input_bus of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 19:19:42 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-a7f5aaf8-ce30-4df1-ba66-561e7c5d277a tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] [instance: 5fdd3ed4-447a-40b4-b325-19cf5094311d] Found default for hw_pointer_model of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 19:19:42 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-a7f5aaf8-ce30-4df1-ba66-561e7c5d277a tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] [instance: 5fdd3ed4-447a-40b4-b325-19cf5094311d] Found default for hw_video_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 19:19:42 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-a7f5aaf8-ce30-4df1-ba66-561e7c5d277a tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] [instance: 5fdd3ed4-447a-40b4-b325-19cf5094311d] Found default for hw_vif_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 19:19:42 user nova-compute[75216]: INFO nova.compute.manager [None req-a7f5aaf8-ce30-4df1-ba66-561e7c5d277a tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] [instance: 5fdd3ed4-447a-40b4-b325-19cf5094311d] Took 4.98 seconds to spawn the instance on the hypervisor.
Nov 13 19:19:42 user nova-compute[75216]: DEBUG nova.compute.manager [None req-a7f5aaf8-ce30-4df1-ba66-561e7c5d277a tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] [instance: 5fdd3ed4-447a-40b4-b325-19cf5094311d] Checking state {{(pid=75216) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 19:19:42 user nova-compute[75216]: DEBUG nova.compute.manager [req-f0c2029b-266e-4b1a-9c30-5860b97128e4 req-9d4bc2c0-4b68-4d12-882d-b33e027c5f41 service nova] [instance: 5fdd3ed4-447a-40b4-b325-19cf5094311d] Received event network-vif-plugged-68ef4a31-9b53-4505-b10e-cdb40f3edab8 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:19:42 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-f0c2029b-266e-4b1a-9c30-5860b97128e4 req-9d4bc2c0-4b68-4d12-882d-b33e027c5f41 service nova] Acquiring lock "5fdd3ed4-447a-40b4-b325-19cf5094311d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:19:42 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-f0c2029b-266e-4b1a-9c30-5860b97128e4 req-9d4bc2c0-4b68-4d12-882d-b33e027c5f41 service nova] Lock "5fdd3ed4-447a-40b4-b325-19cf5094311d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:19:42 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-f0c2029b-266e-4b1a-9c30-5860b97128e4 req-9d4bc2c0-4b68-4d12-882d-b33e027c5f41 service nova] Lock "5fdd3ed4-447a-40b4-b325-19cf5094311d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:19:42 user nova-compute[75216]: DEBUG nova.compute.manager [req-f0c2029b-266e-4b1a-9c30-5860b97128e4 req-9d4bc2c0-4b68-4d12-882d-b33e027c5f41 service nova] [instance: 5fdd3ed4-447a-40b4-b325-19cf5094311d] No waiting events found dispatching network-vif-plugged-68ef4a31-9b53-4505-b10e-cdb40f3edab8 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 19:19:42 user nova-compute[75216]: WARNING nova.compute.manager [req-f0c2029b-266e-4b1a-9c30-5860b97128e4 req-9d4bc2c0-4b68-4d12-882d-b33e027c5f41 service nova] [instance: 5fdd3ed4-447a-40b4-b325-19cf5094311d] Received unexpected event network-vif-plugged-68ef4a31-9b53-4505-b10e-cdb40f3edab8 for instance with vm_state building and task_state spawning.
Nov 13 19:19:42 user nova-compute[75216]: INFO nova.compute.manager [None req-a7f5aaf8-ce30-4df1-ba66-561e7c5d277a tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] [instance: 5fdd3ed4-447a-40b4-b325-19cf5094311d] Took 5.55 seconds to build instance.
Nov 13 19:19:42 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a7f5aaf8-ce30-4df1-ba66-561e7c5d277a tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Lock "5fdd3ed4-447a-40b4-b325-19cf5094311d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.682s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:19:43 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:19:44 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:19:48 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:19:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:19:49 user nova-compute[75216]: DEBUG nova.compute.manager [req-eda3f2f1-e5c1-4e26-a6d1-28c7e22faeaa req-4d895b88-caf3-45ba-b7df-f4f5aa456ddc service nova] [instance: de2e9a72-2d63-4de6-8d18-a9d7490579a9] Received event network-changed-1a0628c1-10a7-478a-a86e-0479da381b11 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:19:49 user nova-compute[75216]: DEBUG nova.compute.manager [req-eda3f2f1-e5c1-4e26-a6d1-28c7e22faeaa req-4d895b88-caf3-45ba-b7df-f4f5aa456ddc service nova] [instance: de2e9a72-2d63-4de6-8d18-a9d7490579a9] Refreshing instance network info cache due to event network-changed-1a0628c1-10a7-478a-a86e-0479da381b11. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 19:19:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-eda3f2f1-e5c1-4e26-a6d1-28c7e22faeaa req-4d895b88-caf3-45ba-b7df-f4f5aa456ddc service nova] Acquiring lock "refresh_cache-de2e9a72-2d63-4de6-8d18-a9d7490579a9" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 19:19:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-eda3f2f1-e5c1-4e26-a6d1-28c7e22faeaa req-4d895b88-caf3-45ba-b7df-f4f5aa456ddc service nova] Acquired lock "refresh_cache-de2e9a72-2d63-4de6-8d18-a9d7490579a9" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 19:19:49 user nova-compute[75216]: DEBUG nova.network.neutron [req-eda3f2f1-e5c1-4e26-a6d1-28c7e22faeaa req-4d895b88-caf3-45ba-b7df-f4f5aa456ddc service nova] [instance: de2e9a72-2d63-4de6-8d18-a9d7490579a9] Refreshing network info cache for port 1a0628c1-10a7-478a-a86e-0479da381b11 {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 19:19:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-fd0c888b-663d-4b8d-9a14-66cb623e69a7 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Acquiring lock "de2e9a72-2d63-4de6-8d18-a9d7490579a9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:19:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-fd0c888b-663d-4b8d-9a14-66cb623e69a7 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Lock "de2e9a72-2d63-4de6-8d18-a9d7490579a9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:19:49 user nova-compute[75216]: DEBUG nova.objects.instance [None req-fd0c888b-663d-4b8d-9a14-66cb623e69a7 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Lazy-loading 'flavor' on Instance uuid de2e9a72-2d63-4de6-8d18-a9d7490579a9 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:19:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-fd0c888b-663d-4b8d-9a14-66cb623e69a7 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Lock "de2e9a72-2d63-4de6-8d18-a9d7490579a9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:19:50 user nova-compute[75216]: DEBUG nova.network.neutron [req-eda3f2f1-e5c1-4e26-a6d1-28c7e22faeaa req-4d895b88-caf3-45ba-b7df-f4f5aa456ddc service nova] [instance: de2e9a72-2d63-4de6-8d18-a9d7490579a9] Updated VIF entry in instance network info cache for port 1a0628c1-10a7-478a-a86e-0479da381b11. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 19:19:50 user nova-compute[75216]: DEBUG nova.network.neutron [req-eda3f2f1-e5c1-4e26-a6d1-28c7e22faeaa req-4d895b88-caf3-45ba-b7df-f4f5aa456ddc service nova] [instance: de2e9a72-2d63-4de6-8d18-a9d7490579a9] Updating instance_info_cache with network_info: [{"id": "1a0628c1-10a7-478a-a86e-0479da381b11", "address": "fa:16:3e:89:5b:db", "network": {"id": "913673cd-fbe9-48f6-b922-0fd6cf3b52e2", "bridge": "br-int", "label": "tempest-TestStampPattern-134235743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5c7034cfcc8457eb80e8f1875cd39f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a0628c1-10", "ovs_interfaceid": "1a0628c1-10a7-478a-a86e-0479da381b11", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:19:50 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-fd0c888b-663d-4b8d-9a14-66cb623e69a7 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Acquiring lock "de2e9a72-2d63-4de6-8d18-a9d7490579a9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:19:50 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-fd0c888b-663d-4b8d-9a14-66cb623e69a7 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Lock "de2e9a72-2d63-4de6-8d18-a9d7490579a9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:19:50 user nova-compute[75216]: INFO nova.compute.manager [None req-fd0c888b-663d-4b8d-9a14-66cb623e69a7 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] [instance: de2e9a72-2d63-4de6-8d18-a9d7490579a9] Attaching volume a6d5155a-2af8-4248-ade5-3fbf1e67cd8b to /dev/vdb
Nov 13 19:19:50 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-eda3f2f1-e5c1-4e26-a6d1-28c7e22faeaa req-4d895b88-caf3-45ba-b7df-f4f5aa456ddc service nova] Releasing lock "refresh_cache-de2e9a72-2d63-4de6-8d18-a9d7490579a9" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 19:19:50 user nova-compute[75216]: DEBUG os_brick.utils [None req-fd0c888b-663d-4b8d-9a14-66cb623e69a7 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 19:19:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:19:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.034s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:19:50 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[46db0c1e-b98a-40d6-9abf-ad6ba646ed23]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aea6fcfe14b9\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:19:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:19:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:19:50 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[d81dae67-66ab-4286-bb54-7a8a2977520e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:19:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:19:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:19:50 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[48b06221-ba1d-479b-8535-2880a1350b0d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:19:50 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[690c3db5-45ef-45ff-b165-1097bebb5a03]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:19:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-fd0c888b-663d-4b8d-9a14-66cb623e69a7 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Running cmd (subprocess): nvme version {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:19:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-fd0c888b-663d-4b8d-9a14-66cb623e69a7 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] 'nvme version' failed. Not Retrying. {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 19:19:50 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fd0c888b-663d-4b8d-9a14-66cb623e69a7 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] nvme not present on system {{(pid=75216) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 19:19:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:19:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 19:19:50 user nova-compute[75216]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 19:19:50 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[38204ccb-1346-4947-8a5f-2ca63b4f864a]: (4, '') {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:19:50 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-fd0c888b-663d-4b8d-9a14-66cb623e69a7 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75216) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 19:19:50 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-fd0c888b-663d-4b8d-9a14-66cb623e69a7 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 19:19:50 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-fd0c888b-663d-4b8d-9a14-66cb623e69a7 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] LIGHTOS: no hostnqn found. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 19:19:50 user nova-compute[75216]: DEBUG os_brick.utils [None req-fd0c888b-663d-4b8d-9a14-66cb623e69a7 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] <== get_connector_properties: return (146ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aea6fcfe14b9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 19:19:50 user nova-compute[75216]: DEBUG nova.virt.block_device [None req-fd0c888b-663d-4b8d-9a14-66cb623e69a7 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] [instance: de2e9a72-2d63-4de6-8d18-a9d7490579a9] Updating existing volume attachment record: e5d03e91-c4dc-4d53-b739-08daa2a3f26e {{(pid=75216) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 19:19:53 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:19:54 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd0c888b-663d-4b8d-9a14-66cb623e69a7 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] [instance: de2e9a72-2d63-4de6-8d18-a9d7490579a9] Calling os-brick to attach iSCSI Volume {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 19:19:54 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd0c888b-663d-4b8d-9a14-66cb623e69a7 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3a8669e40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a6d5155a-2af8-4248-ade5-3fbf1e67cd8b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BwJvgsNL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 19:19:54 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-fd0c888b-663d-4b8d-9a14-66cb623e69a7 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 19:19:54 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-fd0c888b-663d-4b8d-9a14-66cb623e69a7 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 19:19:54 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-fd0c888b-663d-4b8d-9a14-66cb623e69a7 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 19:19:54 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-fd0c888b-663d-4b8d-9a14-66cb623e69a7 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 19:19:54 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-fd0c888b-663d-4b8d-9a14-66cb623e69a7 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a6d5155a-2af8-4248-ade5-3fbf1e67cd8b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 19:19:54 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-fd0c888b-663d-4b8d-9a14-66cb623e69a7 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a6d5155a-2af8-4248-ade5-3fbf1e67cd8b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 19:19:54 user nova-compute[75216]: INFO os_brick.initiator.connectors.iscsi [None req-fd0c888b-663d-4b8d-9a14-66cb623e69a7 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 19:19:54 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6d5155a-2af8-4248-ade5-3fbf1e67cd8b -p 172.16.0.220:3260 {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:19:54 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:19:54 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6d5155a-2af8-4248-ade5-3fbf1e67cd8b -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:19:54 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[da5fbe54-b0d6-47b6-a14d-bf18d83ef1f6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:19:54 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd0c888b-663d-4b8d-9a14-66cb623e69a7 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 19:19:54 user nova-compute[75216]:  {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:19:54 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6d5155a-2af8-4248-ade5-3fbf1e67cd8b -p 172.16.0.220:3260 --interface default --op new {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:19:54 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6d5155a-2af8-4248-ade5-3fbf1e67cd8b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:19:54 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8b61090-1473-4310-b325-353f5f7a9137]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a6d5155a-2af8-4248-ade5-3fbf1e67cd8b] added\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:19:54 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd0c888b-663d-4b8d-9a14-66cb623e69a7 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a6d5155a-2af8-4248-ade5-3fbf1e67cd8b] added
Nov 13 19:19:54 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:19:54 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6d5155a-2af8-4248-ade5-3fbf1e67cd8b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:19:54 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6d5155a-2af8-4248-ade5-3fbf1e67cd8b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:19:54 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9c640d7-b165-4c74-8c40-34326cedd976]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:19:54 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd0c888b-663d-4b8d-9a14-66cb623e69a7 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:19:54 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6d5155a-2af8-4248-ade5-3fbf1e67cd8b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:19:54 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6d5155a-2af8-4248-ade5-3fbf1e67cd8b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:19:54 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ae4c691-fe74-43bf-827c-623330b4835a]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:19:54 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd0c888b-663d-4b8d-9a14-66cb623e69a7 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:19:54 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6d5155a-2af8-4248-ade5-3fbf1e67cd8b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BwJvgsNL {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:19:54 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6d5155a-2af8-4248-ade5-3fbf1e67cd8b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BwJvgsNL" returned: 0 in 0.035s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:19:54 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7ac9aa8-203c-49ac-9283-4cb490193b61]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:19:54 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd0c888b-663d-4b8d-9a14-66cb623e69a7 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BwJvgsNL'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:19:54 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6d5155a-2af8-4248-ade5-3fbf1e67cd8b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:19:54 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6d5155a-2af8-4248-ade5-3fbf1e67cd8b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:19:54 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[db13a8ca-9bcd-44ae-8b95-31ce2807f8b3]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:19:54 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd0c888b-663d-4b8d-9a14-66cb623e69a7 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:19:54 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:19:54 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:19:54 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[81d96093-5fab-473a-88fb-277f1f6558bf]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:19:54 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd0c888b-663d-4b8d-9a14-66cb623e69a7 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 13 19:19:54 user nova-compute[75216]:  {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 19:19:54 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd0c888b-663d-4b8d-9a14-66cb623e69a7 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 13 19:19:54 user nova-compute[75216]:  {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 19:19:54 user nova-compute[75216]: WARNING os_brick.initiator.connectors.iscsi [None req-fd0c888b-663d-4b8d-9a14-66cb623e69a7 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 13 19:19:54 user nova-compute[75216]: 
Nov 13 19:19:54 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6d5155a-2af8-4248-ade5-3fbf1e67cd8b -p 172.16.0.220:3260 --login {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:19:54 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6d5155a-2af8-4248-ade5-3fbf1e67cd8b -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:19:54 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[969c8234-f488-4bcc-b42a-28da8e76668a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a6d5155a-2af8-4248-ade5-3fbf1e67cd8b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a6d5155a-2af8-4248-ade5-3fbf1e67cd8b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:19:54 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd0c888b-663d-4b8d-9a14-66cb623e69a7 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a6d5155a-2af8-4248-ade5-3fbf1e67cd8b, portal: 172.16.0.220,3260]
Nov 13 19:19:54 user nova-compute[75216]: Login to [iface: default, target: iqn.2010-10.org.openstack:a6d5155a-2af8-4248-ade5-3fbf1e67cd8b, portal: 172.16.0.220,3260] successful.
Nov 13 19:19:54 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:19:54 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6d5155a-2af8-4248-ade5-3fbf1e67cd8b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:19:54 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6d5155a-2af8-4248-ade5-3fbf1e67cd8b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:19:54 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[c52ae4f3-757b-44ff-8a2b-226cee175b87]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:19:54 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd0c888b-663d-4b8d-9a14-66cb623e69a7 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:19:54 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:19:54 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:19:54 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4168f84-82e8-4947-a9af-2db15421a410]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6d5155a-2af8-4248-ade5-3fbf1e67cd8b (non-flash)\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:19:54 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd0c888b-663d-4b8d-9a14-66cb623e69a7 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6d5155a-2af8-4248-ade5-3fbf1e67cd8b (non-flash)
Nov 13 19:19:54 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 19:19:54 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd0c888b-663d-4b8d-9a14-66cb623e69a7 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6d5155a-2af8-4248-ade5-3fbf1e67cd8b (non-flash)
Nov 13 19:19:54 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 19:19:54 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-fd0c888b-663d-4b8d-9a14-66cb623e69a7 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a6d5155a-2af8-4248-ade5-3fbf1e67cd8b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.257s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 19:19:54 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd0c888b-663d-4b8d-9a14-66cb623e69a7 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Connected to 172.16.0.220:3260 {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 19:19:54 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-fd0c888b-663d-4b8d-9a14-66cb623e69a7 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] HCTL ('33', '-', '-', 0) found on session 50 with lun 0 {{(pid=75216) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 19:19:54 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-fd0c888b-663d-4b8d-9a14-66cb623e69a7 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75216) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 19:19:54 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:19:54 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:19:54 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8e49b2e-3af3-4662-a994-e820603b9f35]: (4, ('- - 0', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:19:54 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-fd0c888b-663d-4b8d-9a14-66cb623e69a7 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Searching for a device in session 50 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75216) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 19:19:54 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd0c888b-663d-4b8d-9a14-66cb623e69a7 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:a6d5155a-2af8-4248-ade5-3fbf1e67cd8b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BwJvgsNL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 19:19:55 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-fd0c888b-663d-4b8d-9a14-66cb623e69a7 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.287s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 19:19:55 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd0c888b-663d-4b8d-9a14-66cb623e69a7 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] <== connect_volume: return (1289ms) {'type': 'block', 'scsi_wwn': '23334356565663838', 'path': '/dev/sdb'} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 19:19:55 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd0c888b-663d-4b8d-9a14-66cb623e69a7 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] [instance: de2e9a72-2d63-4de6-8d18-a9d7490579a9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23334356565663838', 'path': '/dev/sdb'} {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 19:19:55 user nova-compute[75216]: DEBUG nova.objects.instance [None req-fd0c888b-663d-4b8d-9a14-66cb623e69a7 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Lazy-loading 'flavor' on Instance uuid de2e9a72-2d63-4de6-8d18-a9d7490579a9 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:19:55 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-fd0c888b-663d-4b8d-9a14-66cb623e69a7 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] attach device xml: <disk type="block" device="disk">
Nov 13 19:19:55 user nova-compute[75216]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 19:19:55 user nova-compute[75216]:   <source dev="/dev/sdb"/>
Nov 13 19:19:55 user nova-compute[75216]:   <target dev="vdb" bus="virtio"/>
Nov 13 19:19:55 user nova-compute[75216]:   <serial>a6d5155a-2af8-4248-ade5-3fbf1e67cd8b</serial>
Nov 13 19:19:55 user nova-compute[75216]: </disk>
Nov 13 19:19:55 user nova-compute[75216]:  {{(pid=75216) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 13 19:19:56 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-fd0c888b-663d-4b8d-9a14-66cb623e69a7 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 19:19:56 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-fd0c888b-663d-4b8d-9a14-66cb623e69a7 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 19:19:56 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-fd0c888b-663d-4b8d-9a14-66cb623e69a7 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] No VIF found with MAC fa:16:3e:89:5b:db, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 19:19:56 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-fd0c888b-663d-4b8d-9a14-66cb623e69a7 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Lock "de2e9a72-2d63-4de6-8d18-a9d7490579a9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.184s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:19:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-3bee281b-a932-40f8-8b25-dc0db8e4ce6f tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Acquiring lock "de2e9a72-2d63-4de6-8d18-a9d7490579a9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:19:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-3bee281b-a932-40f8-8b25-dc0db8e4ce6f tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Lock "de2e9a72-2d63-4de6-8d18-a9d7490579a9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:19:58 user nova-compute[75216]: INFO nova.compute.manager [None req-3bee281b-a932-40f8-8b25-dc0db8e4ce6f tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] [instance: de2e9a72-2d63-4de6-8d18-a9d7490579a9] Detaching volume a6d5155a-2af8-4248-ade5-3fbf1e67cd8b
Nov 13 19:19:58 user nova-compute[75216]: INFO nova.virt.block_device [None req-3bee281b-a932-40f8-8b25-dc0db8e4ce6f tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] [instance: de2e9a72-2d63-4de6-8d18-a9d7490579a9] Attempting to driver detach volume a6d5155a-2af8-4248-ade5-3fbf1e67cd8b from mountpoint /dev/vdb
Nov 13 19:19:58 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-3bee281b-a932-40f8-8b25-dc0db8e4ce6f tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Attempting to detach device vdb from instance de2e9a72-2d63-4de6-8d18-a9d7490579a9 from the persistent domain config. {{(pid=75216) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 13 19:19:58 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-3bee281b-a932-40f8-8b25-dc0db8e4ce6f tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 19:19:58 user nova-compute[75216]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 19:19:58 user nova-compute[75216]:   <source dev="/dev/sdb"/>
Nov 13 19:19:58 user nova-compute[75216]:   <target dev="vdb" bus="virtio"/>
Nov 13 19:19:58 user nova-compute[75216]:   <serial>a6d5155a-2af8-4248-ade5-3fbf1e67cd8b</serial>
Nov 13 19:19:58 user nova-compute[75216]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 19:19:58 user nova-compute[75216]: </disk>
Nov 13 19:19:58 user nova-compute[75216]:  {{(pid=75216) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 19:19:58 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-3bee281b-a932-40f8-8b25-dc0db8e4ce6f tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Successfully detached device vdb from instance de2e9a72-2d63-4de6-8d18-a9d7490579a9 from the persistent domain config.
Nov 13 19:19:58 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-3bee281b-a932-40f8-8b25-dc0db8e4ce6f tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance de2e9a72-2d63-4de6-8d18-a9d7490579a9 from the live domain config. {{(pid=75216) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 13 19:19:58 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-3bee281b-a932-40f8-8b25-dc0db8e4ce6f tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 19:19:58 user nova-compute[75216]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 19:19:58 user nova-compute[75216]:   <source dev="/dev/sdb"/>
Nov 13 19:19:58 user nova-compute[75216]:   <target dev="vdb" bus="virtio"/>
Nov 13 19:19:58 user nova-compute[75216]:   <serial>a6d5155a-2af8-4248-ade5-3fbf1e67cd8b</serial>
Nov 13 19:19:58 user nova-compute[75216]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 19:19:58 user nova-compute[75216]: </disk>
Nov 13 19:19:58 user nova-compute[75216]:  {{(pid=75216) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 19:19:58 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-3bee281b-a932-40f8-8b25-dc0db8e4ce6f tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance de2e9a72-2d63-4de6-8d18-a9d7490579a9 {{(pid=75216) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 13 19:19:58 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:19:59 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:20:02 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:20:03 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:20:04 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:20:04 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:20:08 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:20:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:20:09 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:20:11 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:20:11 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75216) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 19:20:12 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:20:13 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:20:13 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:20:13 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:20:13 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:20:13 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:20:13 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:20:13 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Auditing locally available compute resources for user (node: user) {{(pid=75216) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 19:20:13 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fdd3ed4-447a-40b4-b325-19cf5094311d/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:20:13 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fdd3ed4-447a-40b4-b325-19cf5094311d/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:20:13 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fdd3ed4-447a-40b4-b325-19cf5094311d/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:20:13 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fdd3ed4-447a-40b4-b325-19cf5094311d/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:20:13 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de2e9a72-2d63-4de6-8d18-a9d7490579a9/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:20:13 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:20:14 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de2e9a72-2d63-4de6-8d18-a9d7490579a9/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:20:14 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de2e9a72-2d63-4de6-8d18-a9d7490579a9/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:20:14 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de2e9a72-2d63-4de6-8d18-a9d7490579a9/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:20:14 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:20:14 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 19:20:14 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 19:20:14 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Hypervisor/Node resource view: name=user free_ram=8800MB free_disk=25.29644775390625GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75216) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 19:20:14 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:20:14 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:20:14 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance de2e9a72-2d63-4de6-8d18-a9d7490579a9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 19:20:14 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance 5fdd3ed4-447a-40b4-b325-19cf5094311d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 19:20:14 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 19:20:14 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 19:20:14 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 19:20:14 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 19:20:14 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Compute_service record updated for user:user {{(pid=75216) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 19:20:14 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.209s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:20:18 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-3bee281b-a932-40f8-8b25-dc0db8e4ce6f tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance de2e9a72-2d63-4de6-8d18-a9d7490579a9 is timed out.
Nov 13 19:20:18 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-3bee281b-a932-40f8-8b25-dc0db8e4ce6f tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Successfully detached device vdb from instance de2e9a72-2d63-4de6-8d18-a9d7490579a9 from the live domain config.
Nov 13 19:20:18 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3bee281b-a932-40f8-8b25-dc0db8e4ce6f tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] [instance: de2e9a72-2d63-4de6-8d18-a9d7490579a9] calling os-brick to detach iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 19:20:18 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bee281b-a932-40f8-8b25-dc0db8e4ce6f tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3a8669e40>, {'target_iqn': 'iqn.2010-10.org.openstack:a6d5155a-2af8-4248-ade5-3fbf1e67cd8b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BwJvgsNL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 19:20:18 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-3bee281b-a932-40f8-8b25-dc0db8e4ce6f tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 19:20:18 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-3bee281b-a932-40f8-8b25-dc0db8e4ce6f tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 19:20:18 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-3bee281b-a932-40f8-8b25-dc0db8e4ce6f tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 19:20:18 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:20:18 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:20:18 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[07f0595a-bcf9-46ff-ba3f-3f02f0a42e45]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a6d5155a-2af8-4248-ade5-3fbf1e67cd8b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:20:18 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bee281b-a932-40f8-8b25-dc0db8e4ce6f tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 19:20:18 user nova-compute[75216]: No targets found.
Nov 13 19:20:18 user nova-compute[75216]: iSNS:
Nov 13 19:20:18 user nova-compute[75216]: No targets found.
Nov 13 19:20:18 user nova-compute[75216]: STATIC:
Nov 13 19:20:18 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:a6d5155a-2af8-4248-ade5-3fbf1e67cd8b
Nov 13 19:20:18 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 19:20:18 user nova-compute[75216]:                 Iface Name: default
Nov 13 19:20:18 user nova-compute[75216]: FIRMWARE:
Nov 13 19:20:18 user nova-compute[75216]: No targets found.
Nov 13 19:20:18 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 19:20:18 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bee281b-a932-40f8-8b25-dc0db8e4ce6f tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 19:20:18 user nova-compute[75216]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 19:20:18 user nova-compute[75216]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75216) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 19:20:18 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bee281b-a932-40f8-8b25-dc0db8e4ce6f tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a6d5155a-2af8-4248-ade5-3fbf1e67cd8b', 0)] {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 19:20:18 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:20:18 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:20:18 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[43442c15-5130-4a82-aed3-142c1563d4de]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a6d5155a-2af8-4248-ade5-3fbf1e67cd8b\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:20:18 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:20:18 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:20:18 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ae27662-cff0-4583-b82c-765a0cfc848a]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6d5155a-2af8-4248-ade5-3fbf1e67cd8b (non-flash)\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:20:18 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bee281b-a932-40f8-8b25-dc0db8e4ce6f tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6d5155a-2af8-4248-ade5-3fbf1e67cd8b (non-flash)
Nov 13 19:20:18 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 19:20:18 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bee281b-a932-40f8-8b25-dc0db8e4ce6f tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6d5155a-2af8-4248-ade5-3fbf1e67cd8b (non-flash)
Nov 13 19:20:18 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 19:20:18 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bee281b-a932-40f8-8b25-dc0db8e4ce6f tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe3a879d2d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a6d5155a-2af8-4248-ade5-3fbf1e67cd8b'): ({'sdb'}, set())}) {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 19:20:18 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-3bee281b-a932-40f8-8b25-dc0db8e4ce6f tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Removing single pathed devices sdb {{(pid=75216) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 19:20:18 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:20:18 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:20:18 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[f59f5271-3591-4c61-8620-668f17fd0c92]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:20:18 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:20:18 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:20:18 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:20:18 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[74ed7932-4f07-4570-b689-c2406a7ec913]: (4, ('ok\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:20:18 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-3bee281b-a932-40f8-8b25-dc0db8e4ce6f tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Flushing IO for device /dev/sdb {{(pid=75216) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 19:20:18 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:20:18 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:20:18 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[c360bb82-3488-4a2d-8f2e-c6d7d35eee02]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:20:18 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-3bee281b-a932-40f8-8b25-dc0db8e4ce6f tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75216) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 19:20:18 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:20:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.052s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:20:19 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[56438220-a2f3-41ca-8c2e-14ff08001961]: (4, ('1', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:20:19 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-3bee281b-a932-40f8-8b25-dc0db8e4ce6f tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 19:20:19 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-3bee281b-a932-40f8-8b25-dc0db8e4ce6f tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] SCSI volumes sdb have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 19:20:19 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bee281b-a932-40f8-8b25-dc0db8e4ce6f tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a6d5155a-2af8-4248-ade5-3fbf1e67cd8b')] {{(pid=75216) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 19:20:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6d5155a-2af8-4248-ade5-3fbf1e67cd8b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:20:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6d5155a-2af8-4248-ade5-3fbf1e67cd8b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:20:19 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f2dadf7-7bc6-43af-abcf-ad3d01e85858]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:20:19 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bee281b-a932-40f8-8b25-dc0db8e4ce6f tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:20:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6d5155a-2af8-4248-ade5-3fbf1e67cd8b -p 172.16.0.220:3260 --logout {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:20:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6d5155a-2af8-4248-ade5-3fbf1e67cd8b -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:20:19 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0a4bb50-17b5-428b-819b-0408fe32f87c]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:a6d5155a-2af8-4248-ade5-3fbf1e67cd8b, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:a6d5155a-2af8-4248-ade5-3fbf1e67cd8b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:20:19 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bee281b-a932-40f8-8b25-dc0db8e4ce6f tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:a6d5155a-2af8-4248-ade5-3fbf1e67cd8b, portal: 172.16.0.220,3260]
Nov 13 19:20:19 user nova-compute[75216]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:a6d5155a-2af8-4248-ade5-3fbf1e67cd8b, portal: 172.16.0.220,3260] successful.
Nov 13 19:20:19 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:20:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6d5155a-2af8-4248-ade5-3fbf1e67cd8b -p 172.16.0.220:3260 --op delete {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:20:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6d5155a-2af8-4248-ade5-3fbf1e67cd8b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:20:19 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f421cb4-2419-4619-9521-a4800e2db16e]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:20:19 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bee281b-a932-40f8-8b25-dc0db8e4ce6f tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:20:19 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-3bee281b-a932-40f8-8b25-dc0db8e4ce6f tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.330s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 19:20:19 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bee281b-a932-40f8-8b25-dc0db8e4ce6f tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] <== disconnect_volume: return (332ms) None {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 19:20:19 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3bee281b-a932-40f8-8b25-dc0db8e4ce6f tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] [instance: de2e9a72-2d63-4de6-8d18-a9d7490579a9] Disconnected iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 19:20:19 user nova-compute[75216]: DEBUG nova.objects.instance [None req-3bee281b-a932-40f8-8b25-dc0db8e4ce6f tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Lazy-loading 'flavor' on Instance uuid de2e9a72-2d63-4de6-8d18-a9d7490579a9 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:20:20 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-3bee281b-a932-40f8-8b25-dc0db8e4ce6f tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Lock "de2e9a72-2d63-4de6-8d18-a9d7490579a9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.804s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:20:20 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:20:20 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Starting heal instance info cache {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 19:20:20 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Rebuilding the list of instances to heal {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 13 19:20:20 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "refresh_cache-de2e9a72-2d63-4de6-8d18-a9d7490579a9" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 19:20:20 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquired lock "refresh_cache-de2e9a72-2d63-4de6-8d18-a9d7490579a9" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 19:20:20 user nova-compute[75216]: DEBUG nova.network.neutron [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: de2e9a72-2d63-4de6-8d18-a9d7490579a9] Forcefully refreshing network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 19:20:20 user nova-compute[75216]: DEBUG nova.objects.instance [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lazy-loading 'info_cache' on Instance uuid de2e9a72-2d63-4de6-8d18-a9d7490579a9 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:20:21 user nova-compute[75216]: DEBUG nova.network.neutron [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: de2e9a72-2d63-4de6-8d18-a9d7490579a9] Updating instance_info_cache with network_info: [{"id": "1a0628c1-10a7-478a-a86e-0479da381b11", "address": "fa:16:3e:89:5b:db", "network": {"id": "913673cd-fbe9-48f6-b922-0fd6cf3b52e2", "bridge": "br-int", "label": "tempest-TestStampPattern-134235743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5c7034cfcc8457eb80e8f1875cd39f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a0628c1-10", "ovs_interfaceid": "1a0628c1-10a7-478a-a86e-0479da381b11", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:20:21 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Releasing lock "refresh_cache-de2e9a72-2d63-4de6-8d18-a9d7490579a9" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 19:20:21 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: de2e9a72-2d63-4de6-8d18-a9d7490579a9] Updated the network info_cache for instance {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 19:20:21 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:20:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:20:24 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:20:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:20:33 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:20:37 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:20:37 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:20:37 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:20:37 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:20:37 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:20:37 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:20:37 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:20:37 user nova-compute[75216]: DEBUG nova.virt.libvirt.imagecache [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Verify base images {{(pid=75216) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Nov 13 19:20:37 user nova-compute[75216]: DEBUG nova.virt.libvirt.imagecache [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Image id 77bcb5ba-8510-41ec-a88d-96097bb431de yields fingerprint 88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 {{(pid=75216) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 13 19:20:37 user nova-compute[75216]: INFO nova.virt.libvirt.imagecache [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] image 77bcb5ba-8510-41ec-a88d-96097bb431de at (/opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6): checking
Nov 13 19:20:37 user nova-compute[75216]: DEBUG nova.virt.libvirt.imagecache [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] image 77bcb5ba-8510-41ec-a88d-96097bb431de at (/opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6): image is in use {{(pid=75216) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Nov 13 19:20:37 user nova-compute[75216]: DEBUG nova.virt.libvirt.imagecache [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=75216) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 13 19:20:37 user nova-compute[75216]: DEBUG nova.virt.libvirt.imagecache [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] de2e9a72-2d63-4de6-8d18-a9d7490579a9 is a valid instance name {{(pid=75216) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 13 19:20:37 user nova-compute[75216]: DEBUG nova.virt.libvirt.imagecache [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] de2e9a72-2d63-4de6-8d18-a9d7490579a9 has a disk file {{(pid=75216) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 13 19:20:37 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de2e9a72-2d63-4de6-8d18-a9d7490579a9/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:20:37 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de2e9a72-2d63-4de6-8d18-a9d7490579a9/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:20:37 user nova-compute[75216]: DEBUG nova.virt.libvirt.imagecache [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance de2e9a72-2d63-4de6-8d18-a9d7490579a9 is backed by 88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 {{(pid=75216) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 13 19:20:37 user nova-compute[75216]: DEBUG nova.virt.libvirt.imagecache [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] 5fdd3ed4-447a-40b4-b325-19cf5094311d is a valid instance name {{(pid=75216) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 13 19:20:37 user nova-compute[75216]: DEBUG nova.virt.libvirt.imagecache [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] 5fdd3ed4-447a-40b4-b325-19cf5094311d has a disk file {{(pid=75216) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 13 19:20:37 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fdd3ed4-447a-40b4-b325-19cf5094311d/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:20:37 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fdd3ed4-447a-40b4-b325-19cf5094311d/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:20:37 user nova-compute[75216]: DEBUG nova.virt.libvirt.imagecache [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance 5fdd3ed4-447a-40b4-b325-19cf5094311d is backed by 88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 {{(pid=75216) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 13 19:20:37 user nova-compute[75216]: WARNING nova.virt.libvirt.imagecache [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Unknown base file: /opt/stack/data/nova/instances/_base/b5e1c640f34f21d2c6b20cd3235743c7e0f6e8b1
Nov 13 19:20:37 user nova-compute[75216]: WARNING nova.virt.libvirt.imagecache [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Unknown base file: /opt/stack/data/nova/instances/_base/6941c672f5a762c53dbd3715a683339a4a8e35e2
Nov 13 19:20:37 user nova-compute[75216]: WARNING nova.virt.libvirt.imagecache [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Unknown base file: /opt/stack/data/nova/instances/_base/0f6017f6df39adbb7b100164a0e31980a309298d
Nov 13 19:20:37 user nova-compute[75216]: WARNING nova.virt.libvirt.imagecache [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Unknown base file: /opt/stack/data/nova/instances/_base/ba27db4f713454211519af52282c99a80ac238f1
Nov 13 19:20:37 user nova-compute[75216]: WARNING nova.virt.libvirt.imagecache [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Unknown base file: /opt/stack/data/nova/instances/_base/9b24ed58ad40c754c777e9542268c55a0d7b7833
Nov 13 19:20:37 user nova-compute[75216]: WARNING nova.virt.libvirt.imagecache [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Unknown base file: /opt/stack/data/nova/instances/_base/015cc816bc48a395e2ae0409eb6cf8380c6040d9
Nov 13 19:20:37 user nova-compute[75216]: WARNING nova.virt.libvirt.imagecache [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Unknown base file: /opt/stack/data/nova/instances/_base/1a96792b5ea4f840a218df36fb3abab2368172a6
Nov 13 19:20:37 user nova-compute[75216]: WARNING nova.virt.libvirt.imagecache [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Unknown base file: /opt/stack/data/nova/instances/_base/a8743d5a88207b520489f05b745c820c739d74ca
Nov 13 19:20:37 user nova-compute[75216]: INFO nova.virt.libvirt.imagecache [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Active base files: /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6
Nov 13 19:20:37 user nova-compute[75216]: INFO nova.virt.libvirt.imagecache [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Removable base files: /opt/stack/data/nova/instances/_base/b5e1c640f34f21d2c6b20cd3235743c7e0f6e8b1 /opt/stack/data/nova/instances/_base/6941c672f5a762c53dbd3715a683339a4a8e35e2 /opt/stack/data/nova/instances/_base/0f6017f6df39adbb7b100164a0e31980a309298d /opt/stack/data/nova/instances/_base/ba27db4f713454211519af52282c99a80ac238f1 /opt/stack/data/nova/instances/_base/9b24ed58ad40c754c777e9542268c55a0d7b7833 /opt/stack/data/nova/instances/_base/015cc816bc48a395e2ae0409eb6cf8380c6040d9 /opt/stack/data/nova/instances/_base/1a96792b5ea4f840a218df36fb3abab2368172a6 /opt/stack/data/nova/instances/_base/a8743d5a88207b520489f05b745c820c739d74ca
Nov 13 19:20:37 user nova-compute[75216]: INFO nova.virt.libvirt.imagecache [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/b5e1c640f34f21d2c6b20cd3235743c7e0f6e8b1
Nov 13 19:20:37 user nova-compute[75216]: INFO nova.virt.libvirt.imagecache [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/6941c672f5a762c53dbd3715a683339a4a8e35e2
Nov 13 19:20:37 user nova-compute[75216]: INFO nova.virt.libvirt.imagecache [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/0f6017f6df39adbb7b100164a0e31980a309298d
Nov 13 19:20:37 user nova-compute[75216]: INFO nova.virt.libvirt.imagecache [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/ba27db4f713454211519af52282c99a80ac238f1
Nov 13 19:20:37 user nova-compute[75216]: INFO nova.virt.libvirt.imagecache [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/9b24ed58ad40c754c777e9542268c55a0d7b7833
Nov 13 19:20:37 user nova-compute[75216]: INFO nova.virt.libvirt.imagecache [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/015cc816bc48a395e2ae0409eb6cf8380c6040d9
Nov 13 19:20:37 user nova-compute[75216]: INFO nova.virt.libvirt.imagecache [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/1a96792b5ea4f840a218df36fb3abab2368172a6
Nov 13 19:20:37 user nova-compute[75216]: INFO nova.virt.libvirt.imagecache [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/a8743d5a88207b520489f05b745c820c739d74ca
Nov 13 19:20:37 user nova-compute[75216]: DEBUG nova.virt.libvirt.imagecache [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Verification complete {{(pid=75216) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Nov 13 19:20:37 user nova-compute[75216]: DEBUG nova.virt.libvirt.imagecache [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Verify swap images {{(pid=75216) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Nov 13 19:20:37 user nova-compute[75216]: DEBUG nova.virt.libvirt.imagecache [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Verify ephemeral images {{(pid=75216) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Nov 13 19:20:38 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:20:43 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:20:48 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:20:50 user nova-compute[75216]: DEBUG nova.compute.manager [None req-b4780b61-d07e-46eb-bbe5-c7d12b1acc99 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] [instance: de2e9a72-2d63-4de6-8d18-a9d7490579a9] Checking state {{(pid=75216) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 19:20:50 user nova-compute[75216]: INFO nova.compute.manager [None req-b4780b61-d07e-46eb-bbe5-c7d12b1acc99 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] [instance: de2e9a72-2d63-4de6-8d18-a9d7490579a9] instance snapshotting
Nov 13 19:20:50 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-b4780b61-d07e-46eb-bbe5-c7d12b1acc99 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] [instance: de2e9a72-2d63-4de6-8d18-a9d7490579a9] Beginning live snapshot process
Nov 13 19:20:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-b4780b61-d07e-46eb-bbe5-c7d12b1acc99 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de2e9a72-2d63-4de6-8d18-a9d7490579a9/disk --force-share --output=json -f qcow2 {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:20:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-b4780b61-d07e-46eb-bbe5-c7d12b1acc99 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de2e9a72-2d63-4de6-8d18-a9d7490579a9/disk --force-share --output=json -f qcow2" returned: 0 in 0.187s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:20:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-b4780b61-d07e-46eb-bbe5-c7d12b1acc99 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de2e9a72-2d63-4de6-8d18-a9d7490579a9/disk --force-share --output=json -f qcow2 {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:20:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-b4780b61-d07e-46eb-bbe5-c7d12b1acc99 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de2e9a72-2d63-4de6-8d18-a9d7490579a9/disk --force-share --output=json -f qcow2" returned: 0 in 0.172s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:20:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-b4780b61-d07e-46eb-bbe5-c7d12b1acc99 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:20:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-b4780b61-d07e-46eb-bbe5-c7d12b1acc99 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json" returned: 0 in 0.179s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:20:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-b4780b61-d07e-46eb-bbe5-c7d12b1acc99 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp94tfpru_/7dd8e910e53b44e483ff7e74d9a0df8b.delta 1073741824 {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:20:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-b4780b61-d07e-46eb-bbe5-c7d12b1acc99 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp94tfpru_/7dd8e910e53b44e483ff7e74d9a0df8b.delta 1073741824" returned: 0 in 0.057s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:20:51 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-b4780b61-d07e-46eb-bbe5-c7d12b1acc99 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] [instance: de2e9a72-2d63-4de6-8d18-a9d7490579a9] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 13 19:20:52 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-b4780b61-d07e-46eb-bbe5-c7d12b1acc99 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=75216) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 13 19:20:52 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-b4780b61-d07e-46eb-bbe5-c7d12b1acc99 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=75216) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 13 19:20:52 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-b4780b61-d07e-46eb-bbe5-c7d12b1acc99 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] [instance: de2e9a72-2d63-4de6-8d18-a9d7490579a9] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 13 19:20:52 user nova-compute[75216]: DEBUG nova.privsep.utils [None req-b4780b61-d07e-46eb-bbe5-c7d12b1acc99 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75216) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 13 19:20:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-b4780b61-d07e-46eb-bbe5-c7d12b1acc99 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp94tfpru_/7dd8e910e53b44e483ff7e74d9a0df8b.delta /opt/stack/data/nova/instances/snapshots/tmp94tfpru_/7dd8e910e53b44e483ff7e74d9a0df8b {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:20:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-b4780b61-d07e-46eb-bbe5-c7d12b1acc99 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp94tfpru_/7dd8e910e53b44e483ff7e74d9a0df8b.delta /opt/stack/data/nova/instances/snapshots/tmp94tfpru_/7dd8e910e53b44e483ff7e74d9a0df8b" returned: 0 in 0.713s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:20:53 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-b4780b61-d07e-46eb-bbe5-c7d12b1acc99 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] [instance: de2e9a72-2d63-4de6-8d18-a9d7490579a9] Snapshot extracted, beginning image upload
Nov 13 19:20:53 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:20:55 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-b4780b61-d07e-46eb-bbe5-c7d12b1acc99 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] [instance: de2e9a72-2d63-4de6-8d18-a9d7490579a9] Snapshot image upload complete
Nov 13 19:20:55 user nova-compute[75216]: INFO nova.compute.manager [None req-b4780b61-d07e-46eb-bbe5-c7d12b1acc99 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] [instance: de2e9a72-2d63-4de6-8d18-a9d7490579a9] Took 5.17 seconds to snapshot the instance on the hypervisor.
Nov 13 19:20:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-94d8038e-9c78-4463-8173-7aac9f663e08 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Acquiring lock "1b8275e3-6ba3-4231-b6a7-79d59b99a724" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:20:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-94d8038e-9c78-4463-8173-7aac9f663e08 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Lock "1b8275e3-6ba3-4231-b6a7-79d59b99a724" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:20:58 user nova-compute[75216]: DEBUG nova.compute.manager [None req-94d8038e-9c78-4463-8173-7aac9f663e08 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] [instance: 1b8275e3-6ba3-4231-b6a7-79d59b99a724] Starting instance... {{(pid=75216) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 19:20:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-94d8038e-9c78-4463-8173-7aac9f663e08 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:20:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-94d8038e-9c78-4463-8173-7aac9f663e08 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:20:58 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-94d8038e-9c78-4463-8173-7aac9f663e08 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75216) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 19:20:58 user nova-compute[75216]: INFO nova.compute.claims [None req-94d8038e-9c78-4463-8173-7aac9f663e08 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] [instance: 1b8275e3-6ba3-4231-b6a7-79d59b99a724] Claim successful on node user
Nov 13 19:20:58 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-94d8038e-9c78-4463-8173-7aac9f663e08 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 19:20:58 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-94d8038e-9c78-4463-8173-7aac9f663e08 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 19:20:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-94d8038e-9c78-4463-8173-7aac9f663e08 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.243s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:20:58 user nova-compute[75216]: DEBUG nova.compute.manager [None req-94d8038e-9c78-4463-8173-7aac9f663e08 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] [instance: 1b8275e3-6ba3-4231-b6a7-79d59b99a724] Start building networks asynchronously for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 19:20:58 user nova-compute[75216]: DEBUG nova.compute.manager [None req-94d8038e-9c78-4463-8173-7aac9f663e08 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] [instance: 1b8275e3-6ba3-4231-b6a7-79d59b99a724] Allocating IP information in the background. {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 19:20:58 user nova-compute[75216]: DEBUG nova.network.neutron [None req-94d8038e-9c78-4463-8173-7aac9f663e08 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] [instance: 1b8275e3-6ba3-4231-b6a7-79d59b99a724] allocate_for_instance() {{(pid=75216) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 19:20:58 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-94d8038e-9c78-4463-8173-7aac9f663e08 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] [instance: 1b8275e3-6ba3-4231-b6a7-79d59b99a724] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 19:20:58 user nova-compute[75216]: DEBUG nova.compute.manager [None req-94d8038e-9c78-4463-8173-7aac9f663e08 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] [instance: 1b8275e3-6ba3-4231-b6a7-79d59b99a724] Start building block device mappings for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 19:20:58 user nova-compute[75216]: DEBUG nova.policy [None req-94d8038e-9c78-4463-8173-7aac9f663e08 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c2bef5032a924d99b8ab2a1677998111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c7034cfcc8457eb80e8f1875cd39f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75216) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 19:20:58 user nova-compute[75216]: DEBUG nova.compute.manager [None req-94d8038e-9c78-4463-8173-7aac9f663e08 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] [instance: 1b8275e3-6ba3-4231-b6a7-79d59b99a724] Start spawning the instance on the hypervisor. {{(pid=75216) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 19:20:58 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-94d8038e-9c78-4463-8173-7aac9f663e08 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] [instance: 1b8275e3-6ba3-4231-b6a7-79d59b99a724] Creating instance directory {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 19:20:58 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-94d8038e-9c78-4463-8173-7aac9f663e08 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] [instance: 1b8275e3-6ba3-4231-b6a7-79d59b99a724] Creating image(s)
Nov 13 19:20:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-94d8038e-9c78-4463-8173-7aac9f663e08 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Acquiring lock "/opt/stack/data/nova/instances/1b8275e3-6ba3-4231-b6a7-79d59b99a724/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:20:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-94d8038e-9c78-4463-8173-7aac9f663e08 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Lock "/opt/stack/data/nova/instances/1b8275e3-6ba3-4231-b6a7-79d59b99a724/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:20:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-94d8038e-9c78-4463-8173-7aac9f663e08 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Lock "/opt/stack/data/nova/instances/1b8275e3-6ba3-4231-b6a7-79d59b99a724/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:20:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-94d8038e-9c78-4463-8173-7aac9f663e08 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Acquiring lock "512af706b053cf9b85bbfda8eb91235eeec9654e" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:20:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-94d8038e-9c78-4463-8173-7aac9f663e08 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Lock "512af706b053cf9b85bbfda8eb91235eeec9654e" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:20:59 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-94d8038e-9c78-4463-8173-7aac9f663e08 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/512af706b053cf9b85bbfda8eb91235eeec9654e.part --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:20:59 user nova-compute[75216]: DEBUG nova.network.neutron [None req-94d8038e-9c78-4463-8173-7aac9f663e08 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] [instance: 1b8275e3-6ba3-4231-b6a7-79d59b99a724] Successfully created port: f93b7077-4a76-4af4-b958-6a397ef2fbdd {{(pid=75216) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 19:20:59 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:20:59 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-94d8038e-9c78-4463-8173-7aac9f663e08 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/512af706b053cf9b85bbfda8eb91235eeec9654e.part --force-share --output=json" returned: 0 in 0.178s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:20:59 user nova-compute[75216]: DEBUG nova.virt.images [None req-94d8038e-9c78-4463-8173-7aac9f663e08 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] f702e840-1915-4d27-827e-038823a69e8a was qcow2, converting to raw {{(pid=75216) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 13 19:20:59 user nova-compute[75216]: DEBUG nova.privsep.utils [None req-94d8038e-9c78-4463-8173-7aac9f663e08 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75216) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 13 19:20:59 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-94d8038e-9c78-4463-8173-7aac9f663e08 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/512af706b053cf9b85bbfda8eb91235eeec9654e.part /opt/stack/data/nova/instances/_base/512af706b053cf9b85bbfda8eb91235eeec9654e.converted {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:21:00 user nova-compute[75216]: DEBUG nova.network.neutron [None req-94d8038e-9c78-4463-8173-7aac9f663e08 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] [instance: 1b8275e3-6ba3-4231-b6a7-79d59b99a724] Successfully updated port: f93b7077-4a76-4af4-b958-6a397ef2fbdd {{(pid=75216) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 19:21:00 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-94d8038e-9c78-4463-8173-7aac9f663e08 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Acquiring lock "refresh_cache-1b8275e3-6ba3-4231-b6a7-79d59b99a724" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 19:21:00 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-94d8038e-9c78-4463-8173-7aac9f663e08 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Acquired lock "refresh_cache-1b8275e3-6ba3-4231-b6a7-79d59b99a724" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 19:21:00 user nova-compute[75216]: DEBUG nova.network.neutron [None req-94d8038e-9c78-4463-8173-7aac9f663e08 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] [instance: 1b8275e3-6ba3-4231-b6a7-79d59b99a724] Building network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 19:21:00 user nova-compute[75216]: DEBUG nova.compute.manager [req-c0e8f2cc-03e4-4bc8-a502-f5399dcbd40a req-daa2f7ea-3a77-4fe2-b898-6df41a58ecac service nova] [instance: 1b8275e3-6ba3-4231-b6a7-79d59b99a724] Received event network-changed-f93b7077-4a76-4af4-b958-6a397ef2fbdd {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:21:00 user nova-compute[75216]: DEBUG nova.compute.manager [req-c0e8f2cc-03e4-4bc8-a502-f5399dcbd40a req-daa2f7ea-3a77-4fe2-b898-6df41a58ecac service nova] [instance: 1b8275e3-6ba3-4231-b6a7-79d59b99a724] Refreshing instance network info cache due to event network-changed-f93b7077-4a76-4af4-b958-6a397ef2fbdd. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 19:21:00 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-c0e8f2cc-03e4-4bc8-a502-f5399dcbd40a req-daa2f7ea-3a77-4fe2-b898-6df41a58ecac service nova] Acquiring lock "refresh_cache-1b8275e3-6ba3-4231-b6a7-79d59b99a724" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 19:21:00 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-94d8038e-9c78-4463-8173-7aac9f663e08 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/512af706b053cf9b85bbfda8eb91235eeec9654e.part /opt/stack/data/nova/instances/_base/512af706b053cf9b85bbfda8eb91235eeec9654e.converted" returned: 0 in 1.007s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:21:00 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-94d8038e-9c78-4463-8173-7aac9f663e08 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/512af706b053cf9b85bbfda8eb91235eeec9654e.converted --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:21:00 user nova-compute[75216]: DEBUG nova.network.neutron [None req-94d8038e-9c78-4463-8173-7aac9f663e08 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] [instance: 1b8275e3-6ba3-4231-b6a7-79d59b99a724] Instance cache missing network info. {{(pid=75216) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 19:21:01 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-94d8038e-9c78-4463-8173-7aac9f663e08 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/512af706b053cf9b85bbfda8eb91235eeec9654e.converted --force-share --output=json" returned: 0 in 0.179s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:21:01 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-94d8038e-9c78-4463-8173-7aac9f663e08 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Lock "512af706b053cf9b85bbfda8eb91235eeec9654e" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.250s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:21:01 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-94d8038e-9c78-4463-8173-7aac9f663e08 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/512af706b053cf9b85bbfda8eb91235eeec9654e --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:21:01 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-94d8038e-9c78-4463-8173-7aac9f663e08 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/512af706b053cf9b85bbfda8eb91235eeec9654e --force-share --output=json" returned: 0 in 0.167s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:21:01 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-94d8038e-9c78-4463-8173-7aac9f663e08 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Acquiring lock "512af706b053cf9b85bbfda8eb91235eeec9654e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:21:01 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-94d8038e-9c78-4463-8173-7aac9f663e08 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Lock "512af706b053cf9b85bbfda8eb91235eeec9654e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:21:01 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-94d8038e-9c78-4463-8173-7aac9f663e08 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/512af706b053cf9b85bbfda8eb91235eeec9654e --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:21:01 user nova-compute[75216]: DEBUG nova.network.neutron [None req-94d8038e-9c78-4463-8173-7aac9f663e08 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] [instance: 1b8275e3-6ba3-4231-b6a7-79d59b99a724] Updating instance_info_cache with network_info: [{"id": "f93b7077-4a76-4af4-b958-6a397ef2fbdd", "address": "fa:16:3e:1d:f3:08", "network": {"id": "913673cd-fbe9-48f6-b922-0fd6cf3b52e2", "bridge": "br-int", "label": "tempest-TestStampPattern-134235743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5c7034cfcc8457eb80e8f1875cd39f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf93b7077-4a", "ovs_interfaceid": "f93b7077-4a76-4af4-b958-6a397ef2fbdd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:21:01 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-94d8038e-9c78-4463-8173-7aac9f663e08 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Releasing lock "refresh_cache-1b8275e3-6ba3-4231-b6a7-79d59b99a724" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 19:21:01 user nova-compute[75216]: DEBUG nova.compute.manager [None req-94d8038e-9c78-4463-8173-7aac9f663e08 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] [instance: 1b8275e3-6ba3-4231-b6a7-79d59b99a724] Instance network_info: |[{"id": "f93b7077-4a76-4af4-b958-6a397ef2fbdd", "address": "fa:16:3e:1d:f3:08", "network": {"id": "913673cd-fbe9-48f6-b922-0fd6cf3b52e2", "bridge": "br-int", "label": "tempest-TestStampPattern-134235743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5c7034cfcc8457eb80e8f1875cd39f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf93b7077-4a", "ovs_interfaceid": "f93b7077-4a76-4af4-b958-6a397ef2fbdd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 19:21:01 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-c0e8f2cc-03e4-4bc8-a502-f5399dcbd40a req-daa2f7ea-3a77-4fe2-b898-6df41a58ecac service nova] Acquired lock "refresh_cache-1b8275e3-6ba3-4231-b6a7-79d59b99a724" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 19:21:01 user nova-compute[75216]: DEBUG nova.network.neutron [req-c0e8f2cc-03e4-4bc8-a502-f5399dcbd40a req-daa2f7ea-3a77-4fe2-b898-6df41a58ecac service nova] [instance: 1b8275e3-6ba3-4231-b6a7-79d59b99a724] Refreshing network info cache for port f93b7077-4a76-4af4-b958-6a397ef2fbdd {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 19:21:01 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-94d8038e-9c78-4463-8173-7aac9f663e08 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/512af706b053cf9b85bbfda8eb91235eeec9654e --force-share --output=json" returned: 0 in 0.257s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:21:01 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-94d8038e-9c78-4463-8173-7aac9f663e08 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/512af706b053cf9b85bbfda8eb91235eeec9654e,backing_fmt=raw /opt/stack/data/nova/instances/1b8275e3-6ba3-4231-b6a7-79d59b99a724/disk 1073741824 {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:21:01 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-94d8038e-9c78-4463-8173-7aac9f663e08 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/512af706b053cf9b85bbfda8eb91235eeec9654e,backing_fmt=raw /opt/stack/data/nova/instances/1b8275e3-6ba3-4231-b6a7-79d59b99a724/disk 1073741824" returned: 0 in 0.052s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:21:01 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-94d8038e-9c78-4463-8173-7aac9f663e08 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Lock "512af706b053cf9b85bbfda8eb91235eeec9654e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.314s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:21:01 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-94d8038e-9c78-4463-8173-7aac9f663e08 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/512af706b053cf9b85bbfda8eb91235eeec9654e --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:21:01 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-94d8038e-9c78-4463-8173-7aac9f663e08 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/512af706b053cf9b85bbfda8eb91235eeec9654e --force-share --output=json" returned: 0 in 0.170s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:21:01 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-94d8038e-9c78-4463-8173-7aac9f663e08 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] [instance: 1b8275e3-6ba3-4231-b6a7-79d59b99a724] Created local disks {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 19:21:01 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-94d8038e-9c78-4463-8173-7aac9f663e08 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] [instance: 1b8275e3-6ba3-4231-b6a7-79d59b99a724] Ensure instance console log exists: /opt/stack/data/nova/instances/1b8275e3-6ba3-4231-b6a7-79d59b99a724/console.log {{(pid=75216) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 19:21:01 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-94d8038e-9c78-4463-8173-7aac9f663e08 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:21:01 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-94d8038e-9c78-4463-8173-7aac9f663e08 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:21:01 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-94d8038e-9c78-4463-8173-7aac9f663e08 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:21:01 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-94d8038e-9c78-4463-8173-7aac9f663e08 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] [instance: 1b8275e3-6ba3-4231-b6a7-79d59b99a724] Start _get_guest_xml network_info=[{"id": "f93b7077-4a76-4af4-b958-6a397ef2fbdd", "address": "fa:16:3e:1d:f3:08", "network": {"id": "913673cd-fbe9-48f6-b922-0fd6cf3b52e2", "bridge": "br-int", "label": "tempest-TestStampPattern-134235743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5c7034cfcc8457eb80e8f1875cd39f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf93b7077-4a", "ovs_interfaceid": "f93b7077-4a76-4af4-b958-6a397ef2fbdd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='3565ddfb39f0432c96e3b9a829266922',container_format='bare',created_at=2023-11-13T19:20:50Z,direct_url=<?>,disk_format='qcow2',id=f702e840-1915-4d27-827e-038823a69e8a,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-161103508',owner='f5c7034cfcc8457eb80e8f1875cd39f5',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-13T19:20:56Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'guest_format': None, 'boot_index': 0, 'image_id': 'f702e840-1915-4d27-827e-038823a69e8a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 19:21:01 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-94d8038e-9c78-4463-8173-7aac9f663e08 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 19:21:01 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-94d8038e-9c78-4463-8173-7aac9f663e08 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 19:21:01 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-94d8038e-9c78-4463-8173-7aac9f663e08 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 19:21:01 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-94d8038e-9c78-4463-8173-7aac9f663e08 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] CPU controller missing on host. {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 19:21:01 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-94d8038e-9c78-4463-8173-7aac9f663e08 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 19:21:01 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-94d8038e-9c78-4463-8173-7aac9f663e08 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] CPU controller found on host. {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 19:21:01 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-94d8038e-9c78-4463-8173-7aac9f663e08 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75216) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 19:21:01 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-94d8038e-9c78-4463-8173-7aac9f663e08 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T18:40:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='3565ddfb39f0432c96e3b9a829266922',container_format='bare',created_at=2023-11-13T19:20:50Z,direct_url=<?>,disk_format='qcow2',id=f702e840-1915-4d27-827e-038823a69e8a,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-161103508',owner='f5c7034cfcc8457eb80e8f1875cd39f5',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-13T19:20:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 19:21:01 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-94d8038e-9c78-4463-8173-7aac9f663e08 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Flavor limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 19:21:01 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-94d8038e-9c78-4463-8173-7aac9f663e08 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Image limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 19:21:01 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-94d8038e-9c78-4463-8173-7aac9f663e08 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Flavor pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 19:21:01 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-94d8038e-9c78-4463-8173-7aac9f663e08 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Image pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 19:21:01 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-94d8038e-9c78-4463-8173-7aac9f663e08 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 19:21:01 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-94d8038e-9c78-4463-8173-7aac9f663e08 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 19:21:01 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-94d8038e-9c78-4463-8173-7aac9f663e08 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 19:21:01 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-94d8038e-9c78-4463-8173-7aac9f663e08 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Got 1 possible topologies {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 19:21:01 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-94d8038e-9c78-4463-8173-7aac9f663e08 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 19:21:01 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-94d8038e-9c78-4463-8173-7aac9f663e08 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 19:21:01 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-94d8038e-9c78-4463-8173-7aac9f663e08 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T19:20:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-2100939953',display_name='tempest-TestStampPattern-server-2100939953',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-2100939953',id=44,image_ref='f702e840-1915-4d27-827e-038823a69e8a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHapKYnJox8DhCyPix19DTcs5oKU+V19VrNIaR46tufXvIA+F2UnG19Dx1NagebwmDrx5mO4JLdGpW9E+B7Ex0fbatUl+nUSHveU/X/HEvANxarEVUlRKv5XNJ7vjTh5Qg==',key_name='tempest-TestStampPattern-1280105983',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f5c7034cfcc8457eb80e8f1875cd39f5',ramdisk_id='',reservation_id='r-jgj9dm1g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='de2e9a72-2d63-4de6-8d18-a9d7490579a9',image_min_disk='1',image_min_ram='0',image_owner_id='f5c7034cfcc8457eb80e8f1875cd39f5',image_owner_project_name='tempest-TestStampPattern-851121657',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-851121657-project-member',image_user_id='c2bef5032a924d99b8ab2a1677998111',network_allocated='True',owner_project_name='tempest-TestStampPattern-851121657',owner_user_name='tempest-TestStampPattern-851121657-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T19:20:59Z,user_data=None,user_id='c2bef5032a924d99b8ab2a1677998111',uuid=1b8275e3-6ba3-4231-b6a7-79d59b99a724,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f93b7077-4a76-4af4-b958-6a397ef2fbdd", "address": "fa:16:3e:1d:f3:08", "network": {"id": "913673cd-fbe9-48f6-b922-0fd6cf3b52e2", "bridge": "br-int", "label": "tempest-TestStampPattern-134235743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5c7034cfcc8457eb80e8f1875cd39f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf93b7077-4a", "ovs_interfaceid": "f93b7077-4a76-4af4-b958-6a397ef2fbdd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75216) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 19:21:01 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-94d8038e-9c78-4463-8173-7aac9f663e08 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Converting VIF {"id": "f93b7077-4a76-4af4-b958-6a397ef2fbdd", "address": "fa:16:3e:1d:f3:08", "network": {"id": "913673cd-fbe9-48f6-b922-0fd6cf3b52e2", "bridge": "br-int", "label": "tempest-TestStampPattern-134235743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5c7034cfcc8457eb80e8f1875cd39f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf93b7077-4a", "ovs_interfaceid": "f93b7077-4a76-4af4-b958-6a397ef2fbdd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 19:21:01 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-94d8038e-9c78-4463-8173-7aac9f663e08 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1d:f3:08,bridge_name='br-int',has_traffic_filtering=True,id=f93b7077-4a76-4af4-b958-6a397ef2fbdd,network=Network(913673cd-fbe9-48f6-b922-0fd6cf3b52e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf93b7077-4a') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 19:21:01 user nova-compute[75216]: DEBUG nova.objects.instance [None req-94d8038e-9c78-4463-8173-7aac9f663e08 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Lazy-loading 'pci_devices' on Instance uuid 1b8275e3-6ba3-4231-b6a7-79d59b99a724 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:21:01 user nova-compute[75216]: DEBUG nova.network.neutron [req-c0e8f2cc-03e4-4bc8-a502-f5399dcbd40a req-daa2f7ea-3a77-4fe2-b898-6df41a58ecac service nova] [instance: 1b8275e3-6ba3-4231-b6a7-79d59b99a724] Updated VIF entry in instance network info cache for port f93b7077-4a76-4af4-b958-6a397ef2fbdd. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 19:21:01 user nova-compute[75216]: DEBUG nova.network.neutron [req-c0e8f2cc-03e4-4bc8-a502-f5399dcbd40a req-daa2f7ea-3a77-4fe2-b898-6df41a58ecac service nova] [instance: 1b8275e3-6ba3-4231-b6a7-79d59b99a724] Updating instance_info_cache with network_info: [{"id": "f93b7077-4a76-4af4-b958-6a397ef2fbdd", "address": "fa:16:3e:1d:f3:08", "network": {"id": "913673cd-fbe9-48f6-b922-0fd6cf3b52e2", "bridge": "br-int", "label": "tempest-TestStampPattern-134235743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5c7034cfcc8457eb80e8f1875cd39f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf93b7077-4a", "ovs_interfaceid": "f93b7077-4a76-4af4-b958-6a397ef2fbdd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:21:01 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-94d8038e-9c78-4463-8173-7aac9f663e08 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] [instance: 1b8275e3-6ba3-4231-b6a7-79d59b99a724] End _get_guest_xml xml=<domain type="kvm">
Nov 13 19:21:01 user nova-compute[75216]:   <uuid>1b8275e3-6ba3-4231-b6a7-79d59b99a724</uuid>
Nov 13 19:21:01 user nova-compute[75216]:   <name>instance-0000002c</name>
Nov 13 19:21:01 user nova-compute[75216]:   <memory>524288</memory>
Nov 13 19:21:01 user nova-compute[75216]:   <vcpu>1</vcpu>
Nov 13 19:21:01 user nova-compute[75216]:   <metadata>
Nov 13 19:21:01 user nova-compute[75216]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 19:21:01 user nova-compute[75216]:       <nova:package version="0.0.0"/>
Nov 13 19:21:01 user nova-compute[75216]:       <nova:name>tempest-TestStampPattern-server-2100939953</nova:name>
Nov 13 19:21:01 user nova-compute[75216]:       <nova:creationTime>2023-11-13 19:21:01</nova:creationTime>
Nov 13 19:21:01 user nova-compute[75216]:       <nova:flavor name="m1.tiny">
Nov 13 19:21:01 user nova-compute[75216]:         <nova:memory>512</nova:memory>
Nov 13 19:21:01 user nova-compute[75216]:         <nova:disk>1</nova:disk>
Nov 13 19:21:01 user nova-compute[75216]:         <nova:swap>0</nova:swap>
Nov 13 19:21:01 user nova-compute[75216]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 19:21:01 user nova-compute[75216]:         <nova:vcpus>1</nova:vcpus>
Nov 13 19:21:01 user nova-compute[75216]:       </nova:flavor>
Nov 13 19:21:01 user nova-compute[75216]:       <nova:owner>
Nov 13 19:21:01 user nova-compute[75216]:         <nova:user uuid="c2bef5032a924d99b8ab2a1677998111">tempest-TestStampPattern-851121657-project-member</nova:user>
Nov 13 19:21:01 user nova-compute[75216]:         <nova:project uuid="f5c7034cfcc8457eb80e8f1875cd39f5">tempest-TestStampPattern-851121657</nova:project>
Nov 13 19:21:01 user nova-compute[75216]:       </nova:owner>
Nov 13 19:21:01 user nova-compute[75216]:       <nova:root type="image" uuid="f702e840-1915-4d27-827e-038823a69e8a"/>
Nov 13 19:21:01 user nova-compute[75216]:       <nova:ports>
Nov 13 19:21:01 user nova-compute[75216]:         <nova:port uuid="f93b7077-4a76-4af4-b958-6a397ef2fbdd">
Nov 13 19:21:01 user nova-compute[75216]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 13 19:21:01 user nova-compute[75216]:         </nova:port>
Nov 13 19:21:01 user nova-compute[75216]:       </nova:ports>
Nov 13 19:21:01 user nova-compute[75216]:     </nova:instance>
Nov 13 19:21:01 user nova-compute[75216]:   </metadata>
Nov 13 19:21:01 user nova-compute[75216]:   <sysinfo type="smbios">
Nov 13 19:21:01 user nova-compute[75216]:     <system>
Nov 13 19:21:01 user nova-compute[75216]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 19:21:01 user nova-compute[75216]:       <entry name="product">OpenStack Nova</entry>
Nov 13 19:21:01 user nova-compute[75216]:       <entry name="version">0.0.0</entry>
Nov 13 19:21:01 user nova-compute[75216]:       <entry name="serial">1b8275e3-6ba3-4231-b6a7-79d59b99a724</entry>
Nov 13 19:21:01 user nova-compute[75216]:       <entry name="uuid">1b8275e3-6ba3-4231-b6a7-79d59b99a724</entry>
Nov 13 19:21:01 user nova-compute[75216]:       <entry name="family">Virtual Machine</entry>
Nov 13 19:21:01 user nova-compute[75216]:     </system>
Nov 13 19:21:01 user nova-compute[75216]:   </sysinfo>
Nov 13 19:21:01 user nova-compute[75216]:   <os>
Nov 13 19:21:01 user nova-compute[75216]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 19:21:01 user nova-compute[75216]:     <boot dev="hd"/>
Nov 13 19:21:01 user nova-compute[75216]:     <smbios mode="sysinfo"/>
Nov 13 19:21:01 user nova-compute[75216]:   </os>
Nov 13 19:21:01 user nova-compute[75216]:   <features>
Nov 13 19:21:01 user nova-compute[75216]:     <acpi/>
Nov 13 19:21:01 user nova-compute[75216]:     <apic/>
Nov 13 19:21:01 user nova-compute[75216]:     <vmcoreinfo/>
Nov 13 19:21:01 user nova-compute[75216]:   </features>
Nov 13 19:21:01 user nova-compute[75216]:   <clock offset="utc">
Nov 13 19:21:01 user nova-compute[75216]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 19:21:01 user nova-compute[75216]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 19:21:01 user nova-compute[75216]:     <timer name="hpet" present="no"/>
Nov 13 19:21:01 user nova-compute[75216]:   </clock>
Nov 13 19:21:01 user nova-compute[75216]:   <cpu mode="custom" match="exact">
Nov 13 19:21:01 user nova-compute[75216]:     <model>Nehalem</model>
Nov 13 19:21:01 user nova-compute[75216]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 19:21:01 user nova-compute[75216]:   </cpu>
Nov 13 19:21:01 user nova-compute[75216]:   <devices>
Nov 13 19:21:01 user nova-compute[75216]:     <disk type="file" device="disk">
Nov 13 19:21:01 user nova-compute[75216]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 19:21:01 user nova-compute[75216]:       <source file="/opt/stack/data/nova/instances/1b8275e3-6ba3-4231-b6a7-79d59b99a724/disk"/>
Nov 13 19:21:01 user nova-compute[75216]:       <target dev="vda" bus="virtio"/>
Nov 13 19:21:01 user nova-compute[75216]:     </disk>
Nov 13 19:21:01 user nova-compute[75216]:     <interface type="ethernet">
Nov 13 19:21:01 user nova-compute[75216]:       <mac address="fa:16:3e:1d:f3:08"/>
Nov 13 19:21:01 user nova-compute[75216]:       <model type="virtio"/>
Nov 13 19:21:01 user nova-compute[75216]:       <mtu size="1442"/>
Nov 13 19:21:01 user nova-compute[75216]:       <target dev="tapf93b7077-4a"/>
Nov 13 19:21:01 user nova-compute[75216]:     </interface>
Nov 13 19:21:01 user nova-compute[75216]:     <serial type="pty">
Nov 13 19:21:01 user nova-compute[75216]:       <log file="/opt/stack/data/nova/instances/1b8275e3-6ba3-4231-b6a7-79d59b99a724/console.log" append="off"/>
Nov 13 19:21:01 user nova-compute[75216]:     </serial>
Nov 13 19:21:01 user nova-compute[75216]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 19:21:01 user nova-compute[75216]:     <video>
Nov 13 19:21:01 user nova-compute[75216]:       <model type="virtio"/>
Nov 13 19:21:01 user nova-compute[75216]:     </video>
Nov 13 19:21:01 user nova-compute[75216]:     <rng model="virtio">
Nov 13 19:21:01 user nova-compute[75216]:       <backend model="random">/dev/urandom</backend>
Nov 13 19:21:01 user nova-compute[75216]:     </rng>
Nov 13 19:21:01 user nova-compute[75216]:     <controller type="usb" index="0" model="none"/>
Nov 13 19:21:01 user nova-compute[75216]:     <memballoon model="virtio">
Nov 13 19:21:01 user nova-compute[75216]:       <stats period="10"/>
Nov 13 19:21:01 user nova-compute[75216]:     </memballoon>
Nov 13 19:21:01 user nova-compute[75216]:   </devices>
Nov 13 19:21:01 user nova-compute[75216]: </domain>
Nov 13 19:21:01 user nova-compute[75216]:  {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 19:21:01 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-94d8038e-9c78-4463-8173-7aac9f663e08 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T19:20:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-2100939953',display_name='tempest-TestStampPattern-server-2100939953',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-2100939953',id=44,image_ref='f702e840-1915-4d27-827e-038823a69e8a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHapKYnJox8DhCyPix19DTcs5oKU+V19VrNIaR46tufXvIA+F2UnG19Dx1NagebwmDrx5mO4JLdGpW9E+B7Ex0fbatUl+nUSHveU/X/HEvANxarEVUlRKv5XNJ7vjTh5Qg==',key_name='tempest-TestStampPattern-1280105983',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f5c7034cfcc8457eb80e8f1875cd39f5',ramdisk_id='',reservation_id='r-jgj9dm1g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='de2e9a72-2d63-4de6-8d18-a9d7490579a9',image_min_disk='1',image_min_ram='0',image_owner_id='f5c7034cfcc8457eb80e8f1875cd39f5',image_owner_project_name='tempest-TestStampPattern-851121657',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-851121657-project-member',image_user_id='c2bef5032a924d99b8ab2a1677998111',network_allocated='True',owner_project_name='tempest-TestStampPattern-851121657',owner_user_name='tempest-TestStampPattern-851121657-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T19:20:59Z,user_data=None,user_id='c2bef5032a924d99b8ab2a1677998111',uuid=1b8275e3-6ba3-4231-b6a7-79d59b99a724,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f93b7077-4a76-4af4-b958-6a397ef2fbdd", "address": "fa:16:3e:1d:f3:08", "network": {"id": "913673cd-fbe9-48f6-b922-0fd6cf3b52e2", "bridge": "br-int", "label": "tempest-TestStampPattern-134235743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5c7034cfcc8457eb80e8f1875cd39f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf93b7077-4a", "ovs_interfaceid": "f93b7077-4a76-4af4-b958-6a397ef2fbdd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 19:21:01 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-94d8038e-9c78-4463-8173-7aac9f663e08 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Converting VIF {"id": "f93b7077-4a76-4af4-b958-6a397ef2fbdd", "address": "fa:16:3e:1d:f3:08", "network": {"id": "913673cd-fbe9-48f6-b922-0fd6cf3b52e2", "bridge": "br-int", "label": "tempest-TestStampPattern-134235743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5c7034cfcc8457eb80e8f1875cd39f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf93b7077-4a", "ovs_interfaceid": "f93b7077-4a76-4af4-b958-6a397ef2fbdd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 19:21:01 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-94d8038e-9c78-4463-8173-7aac9f663e08 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1d:f3:08,bridge_name='br-int',has_traffic_filtering=True,id=f93b7077-4a76-4af4-b958-6a397ef2fbdd,network=Network(913673cd-fbe9-48f6-b922-0fd6cf3b52e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf93b7077-4a') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 19:21:01 user nova-compute[75216]: DEBUG os_vif [None req-94d8038e-9c78-4463-8173-7aac9f663e08 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:f3:08,bridge_name='br-int',has_traffic_filtering=True,id=f93b7077-4a76-4af4-b958-6a397ef2fbdd,network=Network(913673cd-fbe9-48f6-b922-0fd6cf3b52e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf93b7077-4a') {{(pid=75216) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 19:21:01 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:21:01 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:21:01 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 19:21:01 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-c0e8f2cc-03e4-4bc8-a502-f5399dcbd40a req-daa2f7ea-3a77-4fe2-b898-6df41a58ecac service nova] Releasing lock "refresh_cache-1b8275e3-6ba3-4231-b6a7-79d59b99a724" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 19:21:01 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:21:01 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7ca5742a-b27b-5874-9866-140e64807650', '_type': 'linux-noop'}}, row=False) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:21:01 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:21:01 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:21:01 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf93b7077-4a, may_exist=True, interface_attrs={}) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:21:01 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf93b7077-4a, col_values=(('qos', UUID('1e7aab87-1180-42d9-955b-a91e1c175873')),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:21:01 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf93b7077-4a, col_values=(('external_ids', {'iface-id': 'f93b7077-4a76-4af4-b958-6a397ef2fbdd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1d:f3:08', 'vm-uuid': '1b8275e3-6ba3-4231-b6a7-79d59b99a724'}),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:21:01 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:21:01 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:21:01 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:21:01 user nova-compute[75216]: INFO os_vif [None req-94d8038e-9c78-4463-8173-7aac9f663e08 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:f3:08,bridge_name='br-int',has_traffic_filtering=True,id=f93b7077-4a76-4af4-b958-6a397ef2fbdd,network=Network(913673cd-fbe9-48f6-b922-0fd6cf3b52e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf93b7077-4a')
Nov 13 19:21:01 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-94d8038e-9c78-4463-8173-7aac9f663e08 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 19:21:01 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-94d8038e-9c78-4463-8173-7aac9f663e08 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] No VIF found with MAC fa:16:3e:1d:f3:08, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 19:21:03 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:21:03 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:21:03 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:21:03 user nova-compute[75216]: DEBUG nova.compute.manager [req-1ac55c48-d79c-4679-8a0c-895902619940 req-f1ce71f6-a712-410a-a0ec-a80dc1b6ddf2 service nova] [instance: 1b8275e3-6ba3-4231-b6a7-79d59b99a724] Received event network-vif-plugged-f93b7077-4a76-4af4-b958-6a397ef2fbdd {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:21:03 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-1ac55c48-d79c-4679-8a0c-895902619940 req-f1ce71f6-a712-410a-a0ec-a80dc1b6ddf2 service nova] Acquiring lock "1b8275e3-6ba3-4231-b6a7-79d59b99a724-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:21:03 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-1ac55c48-d79c-4679-8a0c-895902619940 req-f1ce71f6-a712-410a-a0ec-a80dc1b6ddf2 service nova] Lock "1b8275e3-6ba3-4231-b6a7-79d59b99a724-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:21:03 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-1ac55c48-d79c-4679-8a0c-895902619940 req-f1ce71f6-a712-410a-a0ec-a80dc1b6ddf2 service nova] Lock "1b8275e3-6ba3-4231-b6a7-79d59b99a724-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:21:03 user nova-compute[75216]: DEBUG nova.compute.manager [req-1ac55c48-d79c-4679-8a0c-895902619940 req-f1ce71f6-a712-410a-a0ec-a80dc1b6ddf2 service nova] [instance: 1b8275e3-6ba3-4231-b6a7-79d59b99a724] No waiting events found dispatching network-vif-plugged-f93b7077-4a76-4af4-b958-6a397ef2fbdd {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 19:21:03 user nova-compute[75216]: WARNING nova.compute.manager [req-1ac55c48-d79c-4679-8a0c-895902619940 req-f1ce71f6-a712-410a-a0ec-a80dc1b6ddf2 service nova] [instance: 1b8275e3-6ba3-4231-b6a7-79d59b99a724] Received unexpected event network-vif-plugged-f93b7077-4a76-4af4-b958-6a397ef2fbdd for instance with vm_state building and task_state spawning.
Nov 13 19:21:03 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:21:03 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:21:03 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:21:04 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:21:04 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:21:05 user nova-compute[75216]: DEBUG nova.compute.manager [None req-94d8038e-9c78-4463-8173-7aac9f663e08 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] [instance: 1b8275e3-6ba3-4231-b6a7-79d59b99a724] Instance event wait completed in 0 seconds for  {{(pid=75216) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 19:21:05 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-94d8038e-9c78-4463-8173-7aac9f663e08 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] [instance: 1b8275e3-6ba3-4231-b6a7-79d59b99a724] Guest created on hypervisor {{(pid=75216) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 19:21:05 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 1b8275e3-6ba3-4231-b6a7-79d59b99a724] Instance spawned successfully.
Nov 13 19:21:05 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-94d8038e-9c78-4463-8173-7aac9f663e08 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] [instance: 1b8275e3-6ba3-4231-b6a7-79d59b99a724] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 19:21:05 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-94d8038e-9c78-4463-8173-7aac9f663e08 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] [instance: 1b8275e3-6ba3-4231-b6a7-79d59b99a724] Found default for hw_input_bus of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 19:21:05 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-94d8038e-9c78-4463-8173-7aac9f663e08 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] [instance: 1b8275e3-6ba3-4231-b6a7-79d59b99a724] Found default for hw_pointer_model of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 19:21:05 user nova-compute[75216]: INFO nova.compute.manager [None req-94d8038e-9c78-4463-8173-7aac9f663e08 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] [instance: 1b8275e3-6ba3-4231-b6a7-79d59b99a724] Took 6.53 seconds to spawn the instance on the hypervisor.
Nov 13 19:21:05 user nova-compute[75216]: DEBUG nova.compute.manager [None req-94d8038e-9c78-4463-8173-7aac9f663e08 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] [instance: 1b8275e3-6ba3-4231-b6a7-79d59b99a724] Checking state {{(pid=75216) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 19:21:05 user nova-compute[75216]: DEBUG nova.compute.manager [req-f89ec6ea-d1c8-4b16-979d-d9071312d43e req-f0f81356-3859-493f-be13-071d0bdd66dc service nova] [instance: 1b8275e3-6ba3-4231-b6a7-79d59b99a724] Received event network-vif-plugged-f93b7077-4a76-4af4-b958-6a397ef2fbdd {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:21:05 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-f89ec6ea-d1c8-4b16-979d-d9071312d43e req-f0f81356-3859-493f-be13-071d0bdd66dc service nova] Acquiring lock "1b8275e3-6ba3-4231-b6a7-79d59b99a724-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:21:05 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-f89ec6ea-d1c8-4b16-979d-d9071312d43e req-f0f81356-3859-493f-be13-071d0bdd66dc service nova] Lock "1b8275e3-6ba3-4231-b6a7-79d59b99a724-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:21:05 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-f89ec6ea-d1c8-4b16-979d-d9071312d43e req-f0f81356-3859-493f-be13-071d0bdd66dc service nova] Lock "1b8275e3-6ba3-4231-b6a7-79d59b99a724-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:21:05 user nova-compute[75216]: DEBUG nova.compute.manager [req-f89ec6ea-d1c8-4b16-979d-d9071312d43e req-f0f81356-3859-493f-be13-071d0bdd66dc service nova] [instance: 1b8275e3-6ba3-4231-b6a7-79d59b99a724] No waiting events found dispatching network-vif-plugged-f93b7077-4a76-4af4-b958-6a397ef2fbdd {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 19:21:05 user nova-compute[75216]: WARNING nova.compute.manager [req-f89ec6ea-d1c8-4b16-979d-d9071312d43e req-f0f81356-3859-493f-be13-071d0bdd66dc service nova] [instance: 1b8275e3-6ba3-4231-b6a7-79d59b99a724] Received unexpected event network-vif-plugged-f93b7077-4a76-4af4-b958-6a397ef2fbdd for instance with vm_state building and task_state spawning.
Nov 13 19:21:05 user nova-compute[75216]: INFO nova.compute.manager [None req-94d8038e-9c78-4463-8173-7aac9f663e08 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] [instance: 1b8275e3-6ba3-4231-b6a7-79d59b99a724] Took 7.11 seconds to build instance.
Nov 13 19:21:05 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-94d8038e-9c78-4463-8173-7aac9f663e08 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Lock "1b8275e3-6ba3-4231-b6a7-79d59b99a724" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.223s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:21:06 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:21:09 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:21:11 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:21:11 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75216) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 19:21:11 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:21:11 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:21:11 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:21:11 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75216) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 19:21:11 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 19:21:11 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 19:21:11 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:21:12 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:21:12 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Triggering sync for uuid de2e9a72-2d63-4de6-8d18-a9d7490579a9 {{(pid=75216) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 13 19:21:12 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Triggering sync for uuid 5fdd3ed4-447a-40b4-b325-19cf5094311d {{(pid=75216) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 13 19:21:12 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Triggering sync for uuid 1b8275e3-6ba3-4231-b6a7-79d59b99a724 {{(pid=75216) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 13 19:21:12 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "de2e9a72-2d63-4de6-8d18-a9d7490579a9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:21:12 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "de2e9a72-2d63-4de6-8d18-a9d7490579a9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:21:12 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "5fdd3ed4-447a-40b4-b325-19cf5094311d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:21:12 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "5fdd3ed4-447a-40b4-b325-19cf5094311d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:21:12 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "1b8275e3-6ba3-4231-b6a7-79d59b99a724" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:21:12 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "1b8275e3-6ba3-4231-b6a7-79d59b99a724" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:21:12 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "de2e9a72-2d63-4de6-8d18-a9d7490579a9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.026s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:21:12 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "5fdd3ed4-447a-40b4-b325-19cf5094311d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.028s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:21:12 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "1b8275e3-6ba3-4231-b6a7-79d59b99a724" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.029s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:21:13 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:21:14 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:21:14 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:21:15 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:21:15 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:21:15 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:21:15 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:21:15 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Auditing locally available compute resources for user (node: user) {{(pid=75216) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 19:21:15 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b8275e3-6ba3-4231-b6a7-79d59b99a724/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:21:15 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b8275e3-6ba3-4231-b6a7-79d59b99a724/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:21:15 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b8275e3-6ba3-4231-b6a7-79d59b99a724/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:21:15 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b8275e3-6ba3-4231-b6a7-79d59b99a724/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:21:15 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fdd3ed4-447a-40b4-b325-19cf5094311d/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:21:16 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fdd3ed4-447a-40b4-b325-19cf5094311d/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:21:16 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fdd3ed4-447a-40b4-b325-19cf5094311d/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:21:16 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fdd3ed4-447a-40b4-b325-19cf5094311d/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:21:16 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de2e9a72-2d63-4de6-8d18-a9d7490579a9/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:21:16 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de2e9a72-2d63-4de6-8d18-a9d7490579a9/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:21:16 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de2e9a72-2d63-4de6-8d18-a9d7490579a9/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:21:16 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de2e9a72-2d63-4de6-8d18-a9d7490579a9/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:21:16 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:21:16 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 19:21:16 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 19:21:16 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Hypervisor/Node resource view: name=user free_ram=8785MB free_disk=25.151317596435547GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75216) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 19:21:16 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:21:16 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:21:17 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance de2e9a72-2d63-4de6-8d18-a9d7490579a9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 19:21:17 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance 5fdd3ed4-447a-40b4-b325-19cf5094311d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 19:21:17 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance 1b8275e3-6ba3-4231-b6a7-79d59b99a724 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 19:21:17 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 19:21:17 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 19:21:17 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Refreshing inventories for resource provider d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 13 19:21:17 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Updating ProviderTree inventory for provider d927e00d-5a8b-43f7-ac04-6437958fac1f from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 13 19:21:17 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Updating inventory in ProviderTree for provider d927e00d-5a8b-43f7-ac04-6437958fac1f with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 13 19:21:17 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Refreshing aggregate associations for resource provider d927e00d-5a8b-43f7-ac04-6437958fac1f, aggregates: None {{(pid=75216) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 13 19:21:17 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Refreshing trait associations for resource provider d927e00d-5a8b-43f7-ac04-6437958fac1f, traits: COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_MMX {{(pid=75216) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 13 19:21:17 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 19:21:17 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 19:21:17 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Compute_service record updated for user:user {{(pid=75216) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 19:21:17 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.571s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:21:19 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:21:21 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:21:22 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:21:22 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Starting heal instance info cache {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 19:21:22 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "refresh_cache-5fdd3ed4-447a-40b4-b325-19cf5094311d" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 19:21:22 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquired lock "refresh_cache-5fdd3ed4-447a-40b4-b325-19cf5094311d" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 19:21:22 user nova-compute[75216]: DEBUG nova.network.neutron [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: 5fdd3ed4-447a-40b4-b325-19cf5094311d] Forcefully refreshing network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 19:21:22 user nova-compute[75216]: DEBUG nova.network.neutron [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: 5fdd3ed4-447a-40b4-b325-19cf5094311d] Updating instance_info_cache with network_info: [{"id": "68ef4a31-9b53-4505-b10e-cdb40f3edab8", "address": "fa:16:3e:b7:ff:a5", "network": {"id": "9dcbadf2-6b5e-41f1-88a3-17a579ad1bad", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-926239573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d06cae29094846f1817036dc761a565d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68ef4a31-9b", "ovs_interfaceid": "68ef4a31-9b53-4505-b10e-cdb40f3edab8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:21:22 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Releasing lock "refresh_cache-5fdd3ed4-447a-40b4-b325-19cf5094311d" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 19:21:22 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: 5fdd3ed4-447a-40b4-b325-19cf5094311d] Updated the network info_cache for instance {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 19:21:22 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:21:24 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:21:26 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:21:28 user nova-compute[75216]: DEBUG nova.compute.manager [req-31d88677-304c-4a5b-b16a-44662bb8b10e req-aa5bb102-4fb2-4123-8f06-3bc991987e58 service nova] [instance: 5fdd3ed4-447a-40b4-b325-19cf5094311d] Received event network-changed-68ef4a31-9b53-4505-b10e-cdb40f3edab8 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:21:28 user nova-compute[75216]: DEBUG nova.compute.manager [req-31d88677-304c-4a5b-b16a-44662bb8b10e req-aa5bb102-4fb2-4123-8f06-3bc991987e58 service nova] [instance: 5fdd3ed4-447a-40b4-b325-19cf5094311d] Refreshing instance network info cache due to event network-changed-68ef4a31-9b53-4505-b10e-cdb40f3edab8. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 19:21:28 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-31d88677-304c-4a5b-b16a-44662bb8b10e req-aa5bb102-4fb2-4123-8f06-3bc991987e58 service nova] Acquiring lock "refresh_cache-5fdd3ed4-447a-40b4-b325-19cf5094311d" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 19:21:28 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-31d88677-304c-4a5b-b16a-44662bb8b10e req-aa5bb102-4fb2-4123-8f06-3bc991987e58 service nova] Acquired lock "refresh_cache-5fdd3ed4-447a-40b4-b325-19cf5094311d" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 19:21:28 user nova-compute[75216]: DEBUG nova.network.neutron [req-31d88677-304c-4a5b-b16a-44662bb8b10e req-aa5bb102-4fb2-4123-8f06-3bc991987e58 service nova] [instance: 5fdd3ed4-447a-40b4-b325-19cf5094311d] Refreshing network info cache for port 68ef4a31-9b53-4505-b10e-cdb40f3edab8 {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 19:21:28 user nova-compute[75216]: DEBUG nova.network.neutron [req-31d88677-304c-4a5b-b16a-44662bb8b10e req-aa5bb102-4fb2-4123-8f06-3bc991987e58 service nova] [instance: 5fdd3ed4-447a-40b4-b325-19cf5094311d] Updated VIF entry in instance network info cache for port 68ef4a31-9b53-4505-b10e-cdb40f3edab8. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 19:21:28 user nova-compute[75216]: DEBUG nova.network.neutron [req-31d88677-304c-4a5b-b16a-44662bb8b10e req-aa5bb102-4fb2-4123-8f06-3bc991987e58 service nova] [instance: 5fdd3ed4-447a-40b4-b325-19cf5094311d] Updating instance_info_cache with network_info: [{"id": "68ef4a31-9b53-4505-b10e-cdb40f3edab8", "address": "fa:16:3e:b7:ff:a5", "network": {"id": "9dcbadf2-6b5e-41f1-88a3-17a579ad1bad", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-926239573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d06cae29094846f1817036dc761a565d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68ef4a31-9b", "ovs_interfaceid": "68ef4a31-9b53-4505-b10e-cdb40f3edab8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:21:28 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-31d88677-304c-4a5b-b16a-44662bb8b10e req-aa5bb102-4fb2-4123-8f06-3bc991987e58 service nova] Releasing lock "refresh_cache-5fdd3ed4-447a-40b4-b325-19cf5094311d" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 19:21:28 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:21:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:21:29 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-8834ac63-1ae1-457c-b6ec-5b5f21ba477c tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Acquiring lock "5fdd3ed4-447a-40b4-b325-19cf5094311d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:21:29 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-8834ac63-1ae1-457c-b6ec-5b5f21ba477c tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Lock "5fdd3ed4-447a-40b4-b325-19cf5094311d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:21:29 user nova-compute[75216]: DEBUG nova.objects.instance [None req-8834ac63-1ae1-457c-b6ec-5b5f21ba477c tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Lazy-loading 'flavor' on Instance uuid 5fdd3ed4-447a-40b4-b325-19cf5094311d {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:21:29 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-8834ac63-1ae1-457c-b6ec-5b5f21ba477c tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Lock "5fdd3ed4-447a-40b4-b325-19cf5094311d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:21:29 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-8834ac63-1ae1-457c-b6ec-5b5f21ba477c tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Acquiring lock "5fdd3ed4-447a-40b4-b325-19cf5094311d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:21:29 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-8834ac63-1ae1-457c-b6ec-5b5f21ba477c tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Lock "5fdd3ed4-447a-40b4-b325-19cf5094311d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:21:29 user nova-compute[75216]: INFO nova.compute.manager [None req-8834ac63-1ae1-457c-b6ec-5b5f21ba477c tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] [instance: 5fdd3ed4-447a-40b4-b325-19cf5094311d] Attaching volume 8a56ae49-ed45-450e-897b-99c669d28819 to /dev/vdb
Nov 13 19:21:29 user nova-compute[75216]: DEBUG os_brick.utils [None req-8834ac63-1ae1-457c-b6ec-5b5f21ba477c tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 19:21:29 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:21:29 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:21:29 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[492862e4-abea-48cd-9536-b41387d44234]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aea6fcfe14b9\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:21:29 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:21:29 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:21:29 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[5abee9c3-8819-4f79-8827-34d0c38e953b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:21:29 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:21:29 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:21:29 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[b64dccd8-85e9-43c2-9ccc-05a1e3ecf167]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:21:29 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8fb9409-8097-4977-8950-3a74d37e732d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:21:29 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-8834ac63-1ae1-457c-b6ec-5b5f21ba477c tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Running cmd (subprocess): nvme version {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:21:30 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-8834ac63-1ae1-457c-b6ec-5b5f21ba477c tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] 'nvme version' failed. Not Retrying. {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 19:21:30 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8834ac63-1ae1-457c-b6ec-5b5f21ba477c tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] nvme not present on system {{(pid=75216) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 19:21:30 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:21:30 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 19:21:30 user nova-compute[75216]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 19:21:30 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9d78f50-6907-40bf-bfa6-ea9851572507]: (4, '') {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:21:30 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-8834ac63-1ae1-457c-b6ec-5b5f21ba477c tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75216) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 19:21:30 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-8834ac63-1ae1-457c-b6ec-5b5f21ba477c tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 19:21:30 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-8834ac63-1ae1-457c-b6ec-5b5f21ba477c tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] LIGHTOS: no hostnqn found. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 19:21:30 user nova-compute[75216]: DEBUG os_brick.utils [None req-8834ac63-1ae1-457c-b6ec-5b5f21ba477c tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aea6fcfe14b9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 19:21:30 user nova-compute[75216]: DEBUG nova.virt.block_device [None req-8834ac63-1ae1-457c-b6ec-5b5f21ba477c tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] [instance: 5fdd3ed4-447a-40b4-b325-19cf5094311d] Updating existing volume attachment record: 80eca82a-a56d-4ddd-8955-c14fe3270806 {{(pid=75216) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 19:21:31 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:21:33 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:21:33 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Cleaning up deleted instances {{(pid=75216) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 13 19:21:33 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] There are 0 instances to clean {{(pid=75216) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 13 19:21:33 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8834ac63-1ae1-457c-b6ec-5b5f21ba477c tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] [instance: 5fdd3ed4-447a-40b4-b325-19cf5094311d] Calling os-brick to attach iSCSI Volume {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 19:21:33 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-8834ac63-1ae1-457c-b6ec-5b5f21ba477c tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3a8669e40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8a56ae49-ed45-450e-897b-99c669d28819', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yFQXsMjD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 19:21:33 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-8834ac63-1ae1-457c-b6ec-5b5f21ba477c tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 19:21:33 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-8834ac63-1ae1-457c-b6ec-5b5f21ba477c tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 19:21:33 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-8834ac63-1ae1-457c-b6ec-5b5f21ba477c tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 19:21:33 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-8834ac63-1ae1-457c-b6ec-5b5f21ba477c tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 19:21:33 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-8834ac63-1ae1-457c-b6ec-5b5f21ba477c tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8a56ae49-ed45-450e-897b-99c669d28819" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 19:21:33 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-8834ac63-1ae1-457c-b6ec-5b5f21ba477c tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8a56ae49-ed45-450e-897b-99c669d28819" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 19:21:33 user nova-compute[75216]: INFO os_brick.initiator.connectors.iscsi [None req-8834ac63-1ae1-457c-b6ec-5b5f21ba477c tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 19:21:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a56ae49-ed45-450e-897b-99c669d28819 -p 172.16.0.220:3260 {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:21:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a56ae49-ed45-450e-897b-99c669d28819 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:21:33 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b99eb56-c987-4ea9-b2e0-a473e257a0af]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:21:33 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-8834ac63-1ae1-457c-b6ec-5b5f21ba477c tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 19:21:33 user nova-compute[75216]:  {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:21:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a56ae49-ed45-450e-897b-99c669d28819 -p 172.16.0.220:3260 --interface default --op new {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:21:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a56ae49-ed45-450e-897b-99c669d28819 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:21:33 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3229a91-bc70-4ab4-9da0-48f50bcfe465]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8a56ae49-ed45-450e-897b-99c669d28819] added\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:21:33 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-8834ac63-1ae1-457c-b6ec-5b5f21ba477c tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8a56ae49-ed45-450e-897b-99c669d28819] added
Nov 13 19:21:33 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:21:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a56ae49-ed45-450e-897b-99c669d28819 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:21:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a56ae49-ed45-450e-897b-99c669d28819 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:21:33 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d65260e-c440-4ea8-aced-4ab3662db1a3]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:21:33 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-8834ac63-1ae1-457c-b6ec-5b5f21ba477c tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:21:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a56ae49-ed45-450e-897b-99c669d28819 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:21:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a56ae49-ed45-450e-897b-99c669d28819 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:21:33 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[36c7e198-b021-4b46-a5e9-27fd4326588b]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:21:33 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-8834ac63-1ae1-457c-b6ec-5b5f21ba477c tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:21:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a56ae49-ed45-450e-897b-99c669d28819 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yFQXsMjD {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:21:34 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a56ae49-ed45-450e-897b-99c669d28819 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yFQXsMjD" returned: 0 in 0.017s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:21:34 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1a98297-6b68-4a08-a61e-1ee02a7be88a]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:21:34 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-8834ac63-1ae1-457c-b6ec-5b5f21ba477c tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yFQXsMjD'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:21:34 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a56ae49-ed45-450e-897b-99c669d28819 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:21:34 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a56ae49-ed45-450e-897b-99c669d28819 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:21:34 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb3ba6c1-a15f-4f1d-bb5a-acf50e0f036d]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:21:34 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-8834ac63-1ae1-457c-b6ec-5b5f21ba477c tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:21:34 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:21:34 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:21:34 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fb7dfb4-b2a8-45b9-bcce-cc121c9ad4fb]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:21:34 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-8834ac63-1ae1-457c-b6ec-5b5f21ba477c tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 13 19:21:34 user nova-compute[75216]:  {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 19:21:34 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-8834ac63-1ae1-457c-b6ec-5b5f21ba477c tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 13 19:21:34 user nova-compute[75216]:  {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 19:21:34 user nova-compute[75216]: WARNING os_brick.initiator.connectors.iscsi [None req-8834ac63-1ae1-457c-b6ec-5b5f21ba477c tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 13 19:21:34 user nova-compute[75216]: 
Nov 13 19:21:34 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a56ae49-ed45-450e-897b-99c669d28819 -p 172.16.0.220:3260 --login {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:21:34 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a56ae49-ed45-450e-897b-99c669d28819 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:21:34 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a3dd6b8-2846-4c15-b3dd-6d3c8a2f19ef]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8a56ae49-ed45-450e-897b-99c669d28819, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8a56ae49-ed45-450e-897b-99c669d28819, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:21:34 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-8834ac63-1ae1-457c-b6ec-5b5f21ba477c tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8a56ae49-ed45-450e-897b-99c669d28819, portal: 172.16.0.220,3260]
Nov 13 19:21:34 user nova-compute[75216]: Login to [iface: default, target: iqn.2010-10.org.openstack:8a56ae49-ed45-450e-897b-99c669d28819, portal: 172.16.0.220,3260] successful.
Nov 13 19:21:34 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:21:34 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a56ae49-ed45-450e-897b-99c669d28819 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:21:34 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a56ae49-ed45-450e-897b-99c669d28819 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:21:34 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9921f25-9520-4674-b03e-3f71e09ccd46]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:21:34 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-8834ac63-1ae1-457c-b6ec-5b5f21ba477c tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:21:34 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:21:34 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:21:34 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8feb45b-2ee2-4ada-9d3c-c0b80966c8f6]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a56ae49-ed45-450e-897b-99c669d28819 (non-flash)\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:21:34 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-8834ac63-1ae1-457c-b6ec-5b5f21ba477c tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a56ae49-ed45-450e-897b-99c669d28819 (non-flash)
Nov 13 19:21:34 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 19:21:34 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-8834ac63-1ae1-457c-b6ec-5b5f21ba477c tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a56ae49-ed45-450e-897b-99c669d28819 (non-flash)
Nov 13 19:21:34 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 19:21:34 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-8834ac63-1ae1-457c-b6ec-5b5f21ba477c tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8a56ae49-ed45-450e-897b-99c669d28819" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.233s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 19:21:34 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-8834ac63-1ae1-457c-b6ec-5b5f21ba477c tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Connected to 172.16.0.220:3260 {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 19:21:34 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-8834ac63-1ae1-457c-b6ec-5b5f21ba477c tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] HCTL ('33', '-', '-', 0) found on session 51 with lun 0 {{(pid=75216) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 19:21:34 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-8834ac63-1ae1-457c-b6ec-5b5f21ba477c tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75216) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 19:21:34 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:21:34 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:21:34 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[424d5f6e-2543-48c5-b73b-6fa477259331]: (4, ('- - 0', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:21:34 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-8834ac63-1ae1-457c-b6ec-5b5f21ba477c tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Searching for a device in session 51 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75216) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 19:21:34 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-8834ac63-1ae1-457c-b6ec-5b5f21ba477c tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:8a56ae49-ed45-450e-897b-99c669d28819', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yFQXsMjD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 19:21:34 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:21:35 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-8834ac63-1ae1-457c-b6ec-5b5f21ba477c tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.267s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 19:21:35 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-8834ac63-1ae1-457c-b6ec-5b5f21ba477c tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] <== connect_volume: return (1269ms) {'type': 'block', 'scsi_wwn': '26439383164633638', 'path': '/dev/sdb'} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 19:21:35 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8834ac63-1ae1-457c-b6ec-5b5f21ba477c tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] [instance: 5fdd3ed4-447a-40b4-b325-19cf5094311d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26439383164633638', 'path': '/dev/sdb'} {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 19:21:35 user nova-compute[75216]: DEBUG nova.objects.instance [None req-8834ac63-1ae1-457c-b6ec-5b5f21ba477c tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Lazy-loading 'flavor' on Instance uuid 5fdd3ed4-447a-40b4-b325-19cf5094311d {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:21:35 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-8834ac63-1ae1-457c-b6ec-5b5f21ba477c tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] attach device xml: <disk type="block" device="disk">
Nov 13 19:21:35 user nova-compute[75216]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 19:21:35 user nova-compute[75216]:   <source dev="/dev/sdb"/>
Nov 13 19:21:35 user nova-compute[75216]:   <target dev="vdb" bus="virtio"/>
Nov 13 19:21:35 user nova-compute[75216]:   <serial>8a56ae49-ed45-450e-897b-99c669d28819</serial>
Nov 13 19:21:35 user nova-compute[75216]: </disk>
Nov 13 19:21:35 user nova-compute[75216]:  {{(pid=75216) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 13 19:21:35 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-8834ac63-1ae1-457c-b6ec-5b5f21ba477c tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 19:21:35 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-8834ac63-1ae1-457c-b6ec-5b5f21ba477c tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 19:21:35 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-8834ac63-1ae1-457c-b6ec-5b5f21ba477c tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] No VIF found with MAC fa:16:3e:b7:ff:a5, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 19:21:35 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-8834ac63-1ae1-457c-b6ec-5b5f21ba477c tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Lock "5fdd3ed4-447a-40b4-b325-19cf5094311d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 5.871s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:21:36 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:21:36 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75216) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 13 19:21:36 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a40d67be-a058-415b-8d64-0bc0c7d01e44 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Acquiring lock "5fdd3ed4-447a-40b4-b325-19cf5094311d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:21:36 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a40d67be-a058-415b-8d64-0bc0c7d01e44 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Lock "5fdd3ed4-447a-40b4-b325-19cf5094311d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:21:36 user nova-compute[75216]: INFO nova.compute.manager [None req-a40d67be-a058-415b-8d64-0bc0c7d01e44 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] [instance: 5fdd3ed4-447a-40b4-b325-19cf5094311d] Detaching volume 8a56ae49-ed45-450e-897b-99c669d28819
Nov 13 19:21:36 user nova-compute[75216]: INFO nova.virt.block_device [None req-a40d67be-a058-415b-8d64-0bc0c7d01e44 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] [instance: 5fdd3ed4-447a-40b4-b325-19cf5094311d] Attempting to driver detach volume 8a56ae49-ed45-450e-897b-99c669d28819 from mountpoint /dev/vdb
Nov 13 19:21:36 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-a40d67be-a058-415b-8d64-0bc0c7d01e44 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Attempting to detach device vdb from instance 5fdd3ed4-447a-40b4-b325-19cf5094311d from the persistent domain config. {{(pid=75216) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 13 19:21:36 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-a40d67be-a058-415b-8d64-0bc0c7d01e44 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 19:21:36 user nova-compute[75216]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 19:21:36 user nova-compute[75216]:   <source dev="/dev/sdb"/>
Nov 13 19:21:36 user nova-compute[75216]:   <target dev="vdb" bus="virtio"/>
Nov 13 19:21:36 user nova-compute[75216]:   <serial>8a56ae49-ed45-450e-897b-99c669d28819</serial>
Nov 13 19:21:36 user nova-compute[75216]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 19:21:36 user nova-compute[75216]: </disk>
Nov 13 19:21:36 user nova-compute[75216]:  {{(pid=75216) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 19:21:36 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-a40d67be-a058-415b-8d64-0bc0c7d01e44 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Successfully detached device vdb from instance 5fdd3ed4-447a-40b4-b325-19cf5094311d from the persistent domain config.
Nov 13 19:21:36 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-a40d67be-a058-415b-8d64-0bc0c7d01e44 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5fdd3ed4-447a-40b4-b325-19cf5094311d from the live domain config. {{(pid=75216) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 13 19:21:36 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-a40d67be-a058-415b-8d64-0bc0c7d01e44 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 19:21:36 user nova-compute[75216]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 19:21:36 user nova-compute[75216]:   <source dev="/dev/sdb"/>
Nov 13 19:21:36 user nova-compute[75216]:   <target dev="vdb" bus="virtio"/>
Nov 13 19:21:36 user nova-compute[75216]:   <serial>8a56ae49-ed45-450e-897b-99c669d28819</serial>
Nov 13 19:21:36 user nova-compute[75216]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 19:21:36 user nova-compute[75216]: </disk>
Nov 13 19:21:36 user nova-compute[75216]:  {{(pid=75216) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 19:21:36 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:21:37 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-a40d67be-a058-415b-8d64-0bc0c7d01e44 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5fdd3ed4-447a-40b4-b325-19cf5094311d {{(pid=75216) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 13 19:21:39 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:21:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:21:44 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:21:46 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:21:51 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:21:51 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:21:51 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75216) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 19:21:51 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 19:21:51 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 19:21:51 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:21:56 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:21:56 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:21:56 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75216) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 19:21:56 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 19:21:56 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 19:21:56 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:21:57 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-a40d67be-a058-415b-8d64-0bc0c7d01e44 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 5fdd3ed4-447a-40b4-b325-19cf5094311d is timed out.
Nov 13 19:21:57 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-a40d67be-a058-415b-8d64-0bc0c7d01e44 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Successfully detached device vdb from instance 5fdd3ed4-447a-40b4-b325-19cf5094311d from the live domain config.
Nov 13 19:21:57 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a40d67be-a058-415b-8d64-0bc0c7d01e44 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] [instance: 5fdd3ed4-447a-40b4-b325-19cf5094311d] calling os-brick to detach iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 19:21:57 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a40d67be-a058-415b-8d64-0bc0c7d01e44 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3a8669e40>, {'target_iqn': 'iqn.2010-10.org.openstack:8a56ae49-ed45-450e-897b-99c669d28819', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yFQXsMjD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 19:21:57 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-a40d67be-a058-415b-8d64-0bc0c7d01e44 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 19:21:57 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-a40d67be-a058-415b-8d64-0bc0c7d01e44 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 19:21:57 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-a40d67be-a058-415b-8d64-0bc0c7d01e44 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 19:21:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:21:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:21:57 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1bb1ffe-f86d-4878-8046-bb9973a134a0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8a56ae49-ed45-450e-897b-99c669d28819\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:21:57 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a40d67be-a058-415b-8d64-0bc0c7d01e44 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 19:21:57 user nova-compute[75216]: No targets found.
Nov 13 19:21:57 user nova-compute[75216]: iSNS:
Nov 13 19:21:57 user nova-compute[75216]: No targets found.
Nov 13 19:21:57 user nova-compute[75216]: STATIC:
Nov 13 19:21:57 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:8a56ae49-ed45-450e-897b-99c669d28819
Nov 13 19:21:57 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 19:21:57 user nova-compute[75216]:                 Iface Name: default
Nov 13 19:21:57 user nova-compute[75216]: FIRMWARE:
Nov 13 19:21:57 user nova-compute[75216]: No targets found.
Nov 13 19:21:57 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 19:21:57 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a40d67be-a058-415b-8d64-0bc0c7d01e44 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 19:21:57 user nova-compute[75216]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 19:21:57 user nova-compute[75216]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75216) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 19:21:57 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a40d67be-a058-415b-8d64-0bc0c7d01e44 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8a56ae49-ed45-450e-897b-99c669d28819', 0)] {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 19:21:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:21:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:21:57 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d8d97a6-4aed-40f7-92f4-46fe41e73231]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8a56ae49-ed45-450e-897b-99c669d28819\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:21:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:21:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:21:57 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eb7bcd6-471c-491a-8871-ee7447fab747]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a56ae49-ed45-450e-897b-99c669d28819 (non-flash)\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:21:57 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a40d67be-a058-415b-8d64-0bc0c7d01e44 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a56ae49-ed45-450e-897b-99c669d28819 (non-flash)
Nov 13 19:21:57 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 19:21:57 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a40d67be-a058-415b-8d64-0bc0c7d01e44 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a56ae49-ed45-450e-897b-99c669d28819 (non-flash)
Nov 13 19:21:57 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 19:21:57 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a40d67be-a058-415b-8d64-0bc0c7d01e44 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe3a87d25f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8a56ae49-ed45-450e-897b-99c669d28819'): ({'sdb'}, set())}) {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 19:21:57 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-a40d67be-a058-415b-8d64-0bc0c7d01e44 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Removing single pathed devices sdb {{(pid=75216) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 19:21:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:21:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:21:57 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[62ed0216-88b7-4f9e-b21f-1daff33367b8]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:21:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:21:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:21:57 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[98a17ee7-0bec-4d89-a6a9-28de2ecf3407]: (4, ('ok\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:21:57 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-a40d67be-a058-415b-8d64-0bc0c7d01e44 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Flushing IO for device /dev/sdb {{(pid=75216) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 19:21:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:21:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:21:57 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[03021bb7-3183-4085-aa31-45ce884e641f]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:21:57 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-a40d67be-a058-415b-8d64-0bc0c7d01e44 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75216) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 19:21:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:21:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:21:57 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[eafaa9e2-7b72-4aec-8c9f-a552d91df63d]: (4, ('1', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:21:57 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-a40d67be-a058-415b-8d64-0bc0c7d01e44 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 19:21:57 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-a40d67be-a058-415b-8d64-0bc0c7d01e44 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] SCSI volumes sdb have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 19:21:57 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a40d67be-a058-415b-8d64-0bc0c7d01e44 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8a56ae49-ed45-450e-897b-99c669d28819')] {{(pid=75216) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 19:21:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a56ae49-ed45-450e-897b-99c669d28819 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:21:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a56ae49-ed45-450e-897b-99c669d28819 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:21:57 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea244f27-598e-4025-a6b4-8f1547ca537e]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:21:57 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a40d67be-a058-415b-8d64-0bc0c7d01e44 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:21:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a56ae49-ed45-450e-897b-99c669d28819 -p 172.16.0.220:3260 --logout {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:21:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a56ae49-ed45-450e-897b-99c669d28819 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:21:57 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[7052c505-6fd7-4081-8480-88dc1a8141e1]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:8a56ae49-ed45-450e-897b-99c669d28819, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:8a56ae49-ed45-450e-897b-99c669d28819, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:21:57 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a40d67be-a058-415b-8d64-0bc0c7d01e44 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:8a56ae49-ed45-450e-897b-99c669d28819, portal: 172.16.0.220,3260]
Nov 13 19:21:57 user nova-compute[75216]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:8a56ae49-ed45-450e-897b-99c669d28819, portal: 172.16.0.220,3260] successful.
Nov 13 19:21:57 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:21:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a56ae49-ed45-450e-897b-99c669d28819 -p 172.16.0.220:3260 --op delete {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:21:57 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a56ae49-ed45-450e-897b-99c669d28819 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:21:57 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bd85f98-c7ec-4cd7-81fd-5f3ca4c52b38]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:21:57 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a40d67be-a058-415b-8d64-0bc0c7d01e44 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:21:57 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-a40d67be-a058-415b-8d64-0bc0c7d01e44 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.269s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 19:21:57 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a40d67be-a058-415b-8d64-0bc0c7d01e44 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] <== disconnect_volume: return (271ms) None {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 19:21:57 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a40d67be-a058-415b-8d64-0bc0c7d01e44 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] [instance: 5fdd3ed4-447a-40b4-b325-19cf5094311d] Disconnected iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 19:21:58 user nova-compute[75216]: DEBUG nova.objects.instance [None req-a40d67be-a058-415b-8d64-0bc0c7d01e44 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Lazy-loading 'flavor' on Instance uuid 5fdd3ed4-447a-40b4-b325-19cf5094311d {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:21:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a40d67be-a058-415b-8d64-0bc0c7d01e44 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Lock "5fdd3ed4-447a-40b4-b325-19cf5094311d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.568s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:21:59 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:22:01 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:22:05 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:22:06 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:22:06 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:22:06 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75216) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 19:22:06 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 19:22:06 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 19:22:06 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:22:11 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:22:11 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:22:11 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:22:11 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75216) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 19:22:11 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 19:22:11 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 19:22:11 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:22:13 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:22:13 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75216) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 19:22:15 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:22:15 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:22:16 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:22:16 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:22:16 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:22:16 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:22:16 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:22:16 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Auditing locally available compute resources for user (node: user) {{(pid=75216) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 19:22:16 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b8275e3-6ba3-4231-b6a7-79d59b99a724/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:22:16 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b8275e3-6ba3-4231-b6a7-79d59b99a724/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:22:16 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b8275e3-6ba3-4231-b6a7-79d59b99a724/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:22:16 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b8275e3-6ba3-4231-b6a7-79d59b99a724/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:22:16 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fdd3ed4-447a-40b4-b325-19cf5094311d/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:22:16 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:22:17 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fdd3ed4-447a-40b4-b325-19cf5094311d/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:22:17 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fdd3ed4-447a-40b4-b325-19cf5094311d/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:22:17 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fdd3ed4-447a-40b4-b325-19cf5094311d/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:22:17 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de2e9a72-2d63-4de6-8d18-a9d7490579a9/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:22:17 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de2e9a72-2d63-4de6-8d18-a9d7490579a9/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:22:17 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de2e9a72-2d63-4de6-8d18-a9d7490579a9/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:22:17 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de2e9a72-2d63-4de6-8d18-a9d7490579a9/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:22:18 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 19:22:18 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 19:22:18 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Hypervisor/Node resource view: name=user free_ram=8775MB free_disk=25.14911651611328GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75216) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 19:22:18 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:22:18 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:22:18 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance de2e9a72-2d63-4de6-8d18-a9d7490579a9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 19:22:18 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance 5fdd3ed4-447a-40b4-b325-19cf5094311d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 19:22:18 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance 1b8275e3-6ba3-4231-b6a7-79d59b99a724 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 19:22:18 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 19:22:18 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 19:22:18 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 19:22:18 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 19:22:18 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Compute_service record updated for user:user {{(pid=75216) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 19:22:18 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.261s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:22:21 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:22:23 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:22:23 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:22:23 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Starting heal instance info cache {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 19:22:23 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Rebuilding the list of instances to heal {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 13 19:22:23 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "refresh_cache-de2e9a72-2d63-4de6-8d18-a9d7490579a9" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 19:22:23 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquired lock "refresh_cache-de2e9a72-2d63-4de6-8d18-a9d7490579a9" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 19:22:23 user nova-compute[75216]: DEBUG nova.network.neutron [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: de2e9a72-2d63-4de6-8d18-a9d7490579a9] Forcefully refreshing network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 19:22:23 user nova-compute[75216]: DEBUG nova.objects.instance [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lazy-loading 'info_cache' on Instance uuid de2e9a72-2d63-4de6-8d18-a9d7490579a9 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:22:23 user nova-compute[75216]: DEBUG nova.network.neutron [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: de2e9a72-2d63-4de6-8d18-a9d7490579a9] Updating instance_info_cache with network_info: [{"id": "1a0628c1-10a7-478a-a86e-0479da381b11", "address": "fa:16:3e:89:5b:db", "network": {"id": "913673cd-fbe9-48f6-b922-0fd6cf3b52e2", "bridge": "br-int", "label": "tempest-TestStampPattern-134235743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5c7034cfcc8457eb80e8f1875cd39f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a0628c1-10", "ovs_interfaceid": "1a0628c1-10a7-478a-a86e-0479da381b11", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:22:23 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Releasing lock "refresh_cache-de2e9a72-2d63-4de6-8d18-a9d7490579a9" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 19:22:23 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: de2e9a72-2d63-4de6-8d18-a9d7490579a9] Updated the network info_cache for instance {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 19:22:26 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:22:27 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f1854bff-bfc7-43c9-88ae-d46dc7061706 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Acquiring lock "5fdd3ed4-447a-40b4-b325-19cf5094311d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:22:27 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f1854bff-bfc7-43c9-88ae-d46dc7061706 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Lock "5fdd3ed4-447a-40b4-b325-19cf5094311d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:22:27 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f1854bff-bfc7-43c9-88ae-d46dc7061706 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Acquiring lock "5fdd3ed4-447a-40b4-b325-19cf5094311d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:22:27 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f1854bff-bfc7-43c9-88ae-d46dc7061706 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Lock "5fdd3ed4-447a-40b4-b325-19cf5094311d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:22:27 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f1854bff-bfc7-43c9-88ae-d46dc7061706 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Lock "5fdd3ed4-447a-40b4-b325-19cf5094311d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:22:27 user nova-compute[75216]: INFO nova.compute.manager [None req-f1854bff-bfc7-43c9-88ae-d46dc7061706 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] [instance: 5fdd3ed4-447a-40b4-b325-19cf5094311d] Terminating instance
Nov 13 19:22:27 user nova-compute[75216]: DEBUG nova.compute.manager [None req-f1854bff-bfc7-43c9-88ae-d46dc7061706 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] [instance: 5fdd3ed4-447a-40b4-b325-19cf5094311d] Start destroying the instance on the hypervisor. {{(pid=75216) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 19:22:27 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:22:27 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:22:27 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:22:27 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:22:27 user nova-compute[75216]: DEBUG nova.compute.manager [req-e6c9ad13-c1e6-462c-92da-31955c95218b req-e096cc20-f3c3-4682-a4af-31a29551ff14 service nova] [instance: 5fdd3ed4-447a-40b4-b325-19cf5094311d] Received event network-vif-unplugged-68ef4a31-9b53-4505-b10e-cdb40f3edab8 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:22:27 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-e6c9ad13-c1e6-462c-92da-31955c95218b req-e096cc20-f3c3-4682-a4af-31a29551ff14 service nova] Acquiring lock "5fdd3ed4-447a-40b4-b325-19cf5094311d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:22:27 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-e6c9ad13-c1e6-462c-92da-31955c95218b req-e096cc20-f3c3-4682-a4af-31a29551ff14 service nova] Lock "5fdd3ed4-447a-40b4-b325-19cf5094311d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:22:27 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-e6c9ad13-c1e6-462c-92da-31955c95218b req-e096cc20-f3c3-4682-a4af-31a29551ff14 service nova] Lock "5fdd3ed4-447a-40b4-b325-19cf5094311d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:22:27 user nova-compute[75216]: DEBUG nova.compute.manager [req-e6c9ad13-c1e6-462c-92da-31955c95218b req-e096cc20-f3c3-4682-a4af-31a29551ff14 service nova] [instance: 5fdd3ed4-447a-40b4-b325-19cf5094311d] No waiting events found dispatching network-vif-unplugged-68ef4a31-9b53-4505-b10e-cdb40f3edab8 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 19:22:27 user nova-compute[75216]: DEBUG nova.compute.manager [req-e6c9ad13-c1e6-462c-92da-31955c95218b req-e096cc20-f3c3-4682-a4af-31a29551ff14 service nova] [instance: 5fdd3ed4-447a-40b4-b325-19cf5094311d] Received event network-vif-unplugged-68ef4a31-9b53-4505-b10e-cdb40f3edab8 for instance with task_state deleting. {{(pid=75216) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 19:22:27 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 5fdd3ed4-447a-40b4-b325-19cf5094311d] Instance destroyed successfully.
Nov 13 19:22:27 user nova-compute[75216]: DEBUG nova.objects.instance [None req-f1854bff-bfc7-43c9-88ae-d46dc7061706 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Lazy-loading 'resources' on Instance uuid 5fdd3ed4-447a-40b4-b325-19cf5094311d {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:22:27 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-f1854bff-bfc7-43c9-88ae-d46dc7061706 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T19:19:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-363154195',display_name='tempest-AttachVolumeNegativeTest-server-363154195',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-363154195',id=43,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOOu3H6hOiW3t9JNnTHCCoQ+NdqEBlkMMDHiLYKs8YFa/bYVY+b3bwDziGXe+cZEW+27SvXluE491SXFIJ1F0JK/1i0kRj4fIw0DXx94if/XHnG74APUsxeef1IdkDAGSA==',key_name='tempest-keypair-1123496158',keypairs=<?>,launch_index=0,launched_at=2023-11-13T19:19:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d06cae29094846f1817036dc761a565d',ramdisk_id='',reservation_id='r-acqkab20',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1187420962',owner_user_name='tempest-AttachVolumeNegativeTest-1187420962-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T19:19:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1ca750d884c3403394b46f53fbd633a1',uuid=5fdd3ed4-447a-40b4-b325-19cf5094311d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "68ef4a31-9b53-4505-b10e-cdb40f3edab8", "address": "fa:16:3e:b7:ff:a5", "network": {"id": "9dcbadf2-6b5e-41f1-88a3-17a579ad1bad", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-926239573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d06cae29094846f1817036dc761a565d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68ef4a31-9b", "ovs_interfaceid": "68ef4a31-9b53-4505-b10e-cdb40f3edab8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 19:22:27 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-f1854bff-bfc7-43c9-88ae-d46dc7061706 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Converting VIF {"id": "68ef4a31-9b53-4505-b10e-cdb40f3edab8", "address": "fa:16:3e:b7:ff:a5", "network": {"id": "9dcbadf2-6b5e-41f1-88a3-17a579ad1bad", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-926239573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d06cae29094846f1817036dc761a565d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68ef4a31-9b", "ovs_interfaceid": "68ef4a31-9b53-4505-b10e-cdb40f3edab8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 19:22:27 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-f1854bff-bfc7-43c9-88ae-d46dc7061706 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b7:ff:a5,bridge_name='br-int',has_traffic_filtering=True,id=68ef4a31-9b53-4505-b10e-cdb40f3edab8,network=Network(9dcbadf2-6b5e-41f1-88a3-17a579ad1bad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68ef4a31-9b') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 19:22:27 user nova-compute[75216]: DEBUG os_vif [None req-f1854bff-bfc7-43c9-88ae-d46dc7061706 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b7:ff:a5,bridge_name='br-int',has_traffic_filtering=True,id=68ef4a31-9b53-4505-b10e-cdb40f3edab8,network=Network(9dcbadf2-6b5e-41f1-88a3-17a579ad1bad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68ef4a31-9b') {{(pid=75216) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 19:22:27 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:22:27 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap68ef4a31-9b, bridge=br-int, if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:22:27 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:22:27 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:22:27 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:22:27 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3a73a178-8268-4d3a-a685-b73e88613bae) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:22:27 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:22:27 user nova-compute[75216]: INFO os_vif [None req-f1854bff-bfc7-43c9-88ae-d46dc7061706 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b7:ff:a5,bridge_name='br-int',has_traffic_filtering=True,id=68ef4a31-9b53-4505-b10e-cdb40f3edab8,network=Network(9dcbadf2-6b5e-41f1-88a3-17a579ad1bad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68ef4a31-9b')
Nov 13 19:22:27 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-f1854bff-bfc7-43c9-88ae-d46dc7061706 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] [instance: 5fdd3ed4-447a-40b4-b325-19cf5094311d] Deleting instance files /opt/stack/data/nova/instances/5fdd3ed4-447a-40b4-b325-19cf5094311d_del
Nov 13 19:22:27 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-f1854bff-bfc7-43c9-88ae-d46dc7061706 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] [instance: 5fdd3ed4-447a-40b4-b325-19cf5094311d] Deletion of /opt/stack/data/nova/instances/5fdd3ed4-447a-40b4-b325-19cf5094311d_del complete
Nov 13 19:22:27 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:22:28 user nova-compute[75216]: INFO nova.compute.manager [None req-f1854bff-bfc7-43c9-88ae-d46dc7061706 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] [instance: 5fdd3ed4-447a-40b4-b325-19cf5094311d] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 13 19:22:28 user nova-compute[75216]: DEBUG oslo.service.loopingcall [None req-f1854bff-bfc7-43c9-88ae-d46dc7061706 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75216) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 19:22:28 user nova-compute[75216]: DEBUG nova.compute.manager [-] [instance: 5fdd3ed4-447a-40b4-b325-19cf5094311d] Deallocating network for instance {{(pid=75216) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 19:22:28 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: 5fdd3ed4-447a-40b4-b325-19cf5094311d] deallocate_for_instance() {{(pid=75216) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 19:22:28 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: 5fdd3ed4-447a-40b4-b325-19cf5094311d] Updating instance_info_cache with network_info: [] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:22:28 user nova-compute[75216]: INFO nova.compute.manager [-] [instance: 5fdd3ed4-447a-40b4-b325-19cf5094311d] Took 0.62 seconds to deallocate network for instance.
Nov 13 19:22:28 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f1854bff-bfc7-43c9-88ae-d46dc7061706 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:22:28 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f1854bff-bfc7-43c9-88ae-d46dc7061706 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:22:28 user nova-compute[75216]: DEBUG nova.compute.manager [req-7a5b00fa-df1b-4bf7-abba-60177b21fa9a req-a04f6606-9b97-4da0-b853-3f370574ff79 service nova] [instance: 5fdd3ed4-447a-40b4-b325-19cf5094311d] Received event network-vif-deleted-68ef4a31-9b53-4505-b10e-cdb40f3edab8 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:22:28 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-f1854bff-bfc7-43c9-88ae-d46dc7061706 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 19:22:28 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-f1854bff-bfc7-43c9-88ae-d46dc7061706 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 19:22:28 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f1854bff-bfc7-43c9-88ae-d46dc7061706 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.161s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:22:28 user nova-compute[75216]: INFO nova.scheduler.client.report [None req-f1854bff-bfc7-43c9-88ae-d46dc7061706 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Deleted allocations for instance 5fdd3ed4-447a-40b4-b325-19cf5094311d
Nov 13 19:22:29 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f1854bff-bfc7-43c9-88ae-d46dc7061706 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Lock "5fdd3ed4-447a-40b4-b325-19cf5094311d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.836s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:22:29 user nova-compute[75216]: DEBUG nova.compute.manager [req-b5352aa6-c36e-42e6-92e4-5845389edf22 req-a5526a36-9a82-4d62-b29d-6bd6fbe0f1d3 service nova] [instance: 5fdd3ed4-447a-40b4-b325-19cf5094311d] Received event network-vif-plugged-68ef4a31-9b53-4505-b10e-cdb40f3edab8 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:22:29 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-b5352aa6-c36e-42e6-92e4-5845389edf22 req-a5526a36-9a82-4d62-b29d-6bd6fbe0f1d3 service nova] Acquiring lock "5fdd3ed4-447a-40b4-b325-19cf5094311d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:22:29 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-b5352aa6-c36e-42e6-92e4-5845389edf22 req-a5526a36-9a82-4d62-b29d-6bd6fbe0f1d3 service nova] Lock "5fdd3ed4-447a-40b4-b325-19cf5094311d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:22:29 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-b5352aa6-c36e-42e6-92e4-5845389edf22 req-a5526a36-9a82-4d62-b29d-6bd6fbe0f1d3 service nova] Lock "5fdd3ed4-447a-40b4-b325-19cf5094311d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:22:29 user nova-compute[75216]: DEBUG nova.compute.manager [req-b5352aa6-c36e-42e6-92e4-5845389edf22 req-a5526a36-9a82-4d62-b29d-6bd6fbe0f1d3 service nova] [instance: 5fdd3ed4-447a-40b4-b325-19cf5094311d] No waiting events found dispatching network-vif-plugged-68ef4a31-9b53-4505-b10e-cdb40f3edab8 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 19:22:29 user nova-compute[75216]: WARNING nova.compute.manager [req-b5352aa6-c36e-42e6-92e4-5845389edf22 req-a5526a36-9a82-4d62-b29d-6bd6fbe0f1d3 service nova] [instance: 5fdd3ed4-447a-40b4-b325-19cf5094311d] Received unexpected event network-vif-plugged-68ef4a31-9b53-4505-b10e-cdb40f3edab8 for instance with vm_state deleted and task_state None.
Nov 13 19:22:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:22:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:22:42 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:22:47 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:22:47 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:22:47 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75216) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 19:22:47 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 19:22:47 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 19:22:47 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:22:49 user nova-compute[75216]: DEBUG nova.compute.manager [req-00c0f246-9729-413b-b547-2a730d07ba0d req-315b37e3-ea0a-47ed-8cbd-8a15c0601881 service nova] [instance: 1b8275e3-6ba3-4231-b6a7-79d59b99a724] Received event network-changed-f93b7077-4a76-4af4-b958-6a397ef2fbdd {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:22:49 user nova-compute[75216]: DEBUG nova.compute.manager [req-00c0f246-9729-413b-b547-2a730d07ba0d req-315b37e3-ea0a-47ed-8cbd-8a15c0601881 service nova] [instance: 1b8275e3-6ba3-4231-b6a7-79d59b99a724] Refreshing instance network info cache due to event network-changed-f93b7077-4a76-4af4-b958-6a397ef2fbdd. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 19:22:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-00c0f246-9729-413b-b547-2a730d07ba0d req-315b37e3-ea0a-47ed-8cbd-8a15c0601881 service nova] Acquiring lock "refresh_cache-1b8275e3-6ba3-4231-b6a7-79d59b99a724" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 19:22:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-00c0f246-9729-413b-b547-2a730d07ba0d req-315b37e3-ea0a-47ed-8cbd-8a15c0601881 service nova] Acquired lock "refresh_cache-1b8275e3-6ba3-4231-b6a7-79d59b99a724" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 19:22:49 user nova-compute[75216]: DEBUG nova.network.neutron [req-00c0f246-9729-413b-b547-2a730d07ba0d req-315b37e3-ea0a-47ed-8cbd-8a15c0601881 service nova] [instance: 1b8275e3-6ba3-4231-b6a7-79d59b99a724] Refreshing network info cache for port f93b7077-4a76-4af4-b958-6a397ef2fbdd {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 19:22:50 user nova-compute[75216]: DEBUG nova.network.neutron [req-00c0f246-9729-413b-b547-2a730d07ba0d req-315b37e3-ea0a-47ed-8cbd-8a15c0601881 service nova] [instance: 1b8275e3-6ba3-4231-b6a7-79d59b99a724] Updated VIF entry in instance network info cache for port f93b7077-4a76-4af4-b958-6a397ef2fbdd. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 19:22:50 user nova-compute[75216]: DEBUG nova.network.neutron [req-00c0f246-9729-413b-b547-2a730d07ba0d req-315b37e3-ea0a-47ed-8cbd-8a15c0601881 service nova] [instance: 1b8275e3-6ba3-4231-b6a7-79d59b99a724] Updating instance_info_cache with network_info: [{"id": "f93b7077-4a76-4af4-b958-6a397ef2fbdd", "address": "fa:16:3e:1d:f3:08", "network": {"id": "913673cd-fbe9-48f6-b922-0fd6cf3b52e2", "bridge": "br-int", "label": "tempest-TestStampPattern-134235743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5c7034cfcc8457eb80e8f1875cd39f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf93b7077-4a", "ovs_interfaceid": "f93b7077-4a76-4af4-b958-6a397ef2fbdd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:22:50 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-00c0f246-9729-413b-b547-2a730d07ba0d req-315b37e3-ea0a-47ed-8cbd-8a15c0601881 service nova] Releasing lock "refresh_cache-1b8275e3-6ba3-4231-b6a7-79d59b99a724" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 19:22:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-bbd65d93-604b-4082-a8cb-0fb52d8f78e2 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Acquiring lock "1b8275e3-6ba3-4231-b6a7-79d59b99a724" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:22:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-bbd65d93-604b-4082-a8cb-0fb52d8f78e2 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Lock "1b8275e3-6ba3-4231-b6a7-79d59b99a724" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:22:51 user nova-compute[75216]: DEBUG nova.objects.instance [None req-bbd65d93-604b-4082-a8cb-0fb52d8f78e2 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Lazy-loading 'flavor' on Instance uuid 1b8275e3-6ba3-4231-b6a7-79d59b99a724 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:22:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-bbd65d93-604b-4082-a8cb-0fb52d8f78e2 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Lock "1b8275e3-6ba3-4231-b6a7-79d59b99a724" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:22:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-bbd65d93-604b-4082-a8cb-0fb52d8f78e2 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Acquiring lock "1b8275e3-6ba3-4231-b6a7-79d59b99a724" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:22:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-bbd65d93-604b-4082-a8cb-0fb52d8f78e2 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Lock "1b8275e3-6ba3-4231-b6a7-79d59b99a724" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:22:51 user nova-compute[75216]: INFO nova.compute.manager [None req-bbd65d93-604b-4082-a8cb-0fb52d8f78e2 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] [instance: 1b8275e3-6ba3-4231-b6a7-79d59b99a724] Attaching volume 0a93fc84-0e48-4575-830a-5b9300632808 to /dev/vdb
Nov 13 19:22:51 user nova-compute[75216]: DEBUG os_brick.utils [None req-bbd65d93-604b-4082-a8cb-0fb52d8f78e2 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 19:22:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:22:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:22:51 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5a24931-6421-44ab-924e-28977aa3d01b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aea6fcfe14b9\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:22:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:22:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:22:51 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[299ba21b-4dbd-4641-88f0-3d1dca4cf8b8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:22:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:22:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:22:51 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bc41bf1-44a4-4b0a-a5c1-3edba299cdfd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:22:51 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[26222cdb-cb69-4e87-9081-db0d9e07e188]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:22:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-bbd65d93-604b-4082-a8cb-0fb52d8f78e2 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Running cmd (subprocess): nvme version {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:22:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-bbd65d93-604b-4082-a8cb-0fb52d8f78e2 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] 'nvme version' failed. Not Retrying. {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 19:22:51 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bbd65d93-604b-4082-a8cb-0fb52d8f78e2 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] nvme not present on system {{(pid=75216) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 19:22:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:22:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 19:22:51 user nova-compute[75216]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 19:22:51 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea6df8a4-9399-4332-af33-e29541f7f319]: (4, '') {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:22:51 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-bbd65d93-604b-4082-a8cb-0fb52d8f78e2 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75216) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 19:22:51 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-bbd65d93-604b-4082-a8cb-0fb52d8f78e2 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 19:22:51 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-bbd65d93-604b-4082-a8cb-0fb52d8f78e2 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] LIGHTOS: no hostnqn found. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 19:22:51 user nova-compute[75216]: DEBUG os_brick.utils [None req-bbd65d93-604b-4082-a8cb-0fb52d8f78e2 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aea6fcfe14b9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 19:22:51 user nova-compute[75216]: DEBUG nova.virt.block_device [None req-bbd65d93-604b-4082-a8cb-0fb52d8f78e2 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] [instance: 1b8275e3-6ba3-4231-b6a7-79d59b99a724] Updating existing volume attachment record: ffb997bb-fc7d-44ac-8554-fbd3dc4a9f2d {{(pid=75216) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 19:22:52 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:22:54 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:22:55 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bbd65d93-604b-4082-a8cb-0fb52d8f78e2 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] [instance: 1b8275e3-6ba3-4231-b6a7-79d59b99a724] Calling os-brick to attach iSCSI Volume {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 19:22:55 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbd65d93-604b-4082-a8cb-0fb52d8f78e2 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3a8669e40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0a93fc84-0e48-4575-830a-5b9300632808', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zBAHmWxc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 19:22:55 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-bbd65d93-604b-4082-a8cb-0fb52d8f78e2 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 19:22:55 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-bbd65d93-604b-4082-a8cb-0fb52d8f78e2 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 19:22:55 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-bbd65d93-604b-4082-a8cb-0fb52d8f78e2 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 19:22:55 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-bbd65d93-604b-4082-a8cb-0fb52d8f78e2 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 19:22:55 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-bbd65d93-604b-4082-a8cb-0fb52d8f78e2 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0a93fc84-0e48-4575-830a-5b9300632808" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 19:22:55 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-bbd65d93-604b-4082-a8cb-0fb52d8f78e2 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0a93fc84-0e48-4575-830a-5b9300632808" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 19:22:55 user nova-compute[75216]: INFO os_brick.initiator.connectors.iscsi [None req-bbd65d93-604b-4082-a8cb-0fb52d8f78e2 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 19:22:55 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a93fc84-0e48-4575-830a-5b9300632808 -p 172.16.0.220:3260 {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:22:55 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a93fc84-0e48-4575-830a-5b9300632808 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:22:55 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[be30e916-0be7-490d-8dc6-dd28da4835cb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:22:55 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbd65d93-604b-4082-a8cb-0fb52d8f78e2 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 19:22:55 user nova-compute[75216]:  {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:22:55 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a93fc84-0e48-4575-830a-5b9300632808 -p 172.16.0.220:3260 --interface default --op new {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:22:55 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a93fc84-0e48-4575-830a-5b9300632808 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:22:55 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[254065ec-0740-4cc5-8ae9-2eab3c9dc86c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0a93fc84-0e48-4575-830a-5b9300632808] added\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:22:55 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbd65d93-604b-4082-a8cb-0fb52d8f78e2 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0a93fc84-0e48-4575-830a-5b9300632808] added
Nov 13 19:22:55 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:22:55 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a93fc84-0e48-4575-830a-5b9300632808 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:22:55 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a93fc84-0e48-4575-830a-5b9300632808 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:22:55 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[69681e0c-a79e-4888-acdd-708242883b24]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:22:55 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbd65d93-604b-4082-a8cb-0fb52d8f78e2 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:22:55 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a93fc84-0e48-4575-830a-5b9300632808 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:22:55 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a93fc84-0e48-4575-830a-5b9300632808 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:22:55 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dae488a-6349-448c-abab-9ae9ead3213b]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:22:55 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbd65d93-604b-4082-a8cb-0fb52d8f78e2 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:22:55 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a93fc84-0e48-4575-830a-5b9300632808 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zBAHmWxc {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:22:55 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a93fc84-0e48-4575-830a-5b9300632808 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zBAHmWxc" returned: 0 in 0.017s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:22:55 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[737af117-2e3a-49c0-8a00-e3c28453945b]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:22:55 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbd65d93-604b-4082-a8cb-0fb52d8f78e2 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zBAHmWxc'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:22:55 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a93fc84-0e48-4575-830a-5b9300632808 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:22:55 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a93fc84-0e48-4575-830a-5b9300632808 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:22:55 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[e90092a9-fdb6-4ed0-b0a3-00e0a157c370]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:22:55 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbd65d93-604b-4082-a8cb-0fb52d8f78e2 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:22:55 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:22:55 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:22:55 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bd1287f-ae3e-48d4-a33f-061913654918]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:22:55 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbd65d93-604b-4082-a8cb-0fb52d8f78e2 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 13 19:22:55 user nova-compute[75216]:  {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 19:22:55 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbd65d93-604b-4082-a8cb-0fb52d8f78e2 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 13 19:22:55 user nova-compute[75216]:  {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 19:22:55 user nova-compute[75216]: WARNING os_brick.initiator.connectors.iscsi [None req-bbd65d93-604b-4082-a8cb-0fb52d8f78e2 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 13 19:22:55 user nova-compute[75216]: 
Nov 13 19:22:55 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a93fc84-0e48-4575-830a-5b9300632808 -p 172.16.0.220:3260 --login {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:22:55 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a93fc84-0e48-4575-830a-5b9300632808 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:22:55 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[5511d69c-404c-4e5c-9168-d8db7582cd04]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0a93fc84-0e48-4575-830a-5b9300632808, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0a93fc84-0e48-4575-830a-5b9300632808, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:22:55 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbd65d93-604b-4082-a8cb-0fb52d8f78e2 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0a93fc84-0e48-4575-830a-5b9300632808, portal: 172.16.0.220,3260]
Nov 13 19:22:55 user nova-compute[75216]: Login to [iface: default, target: iqn.2010-10.org.openstack:0a93fc84-0e48-4575-830a-5b9300632808, portal: 172.16.0.220,3260] successful.
Nov 13 19:22:55 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:22:55 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a93fc84-0e48-4575-830a-5b9300632808 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:22:55 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a93fc84-0e48-4575-830a-5b9300632808 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:22:55 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[387fcea6-6fca-405e-9959-20e7b79dd321]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:22:55 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbd65d93-604b-4082-a8cb-0fb52d8f78e2 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:22:55 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:22:55 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:22:55 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0068e57-0eed-4ccc-8c9f-8c5daeff35b0]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a93fc84-0e48-4575-830a-5b9300632808 (non-flash)\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:22:55 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbd65d93-604b-4082-a8cb-0fb52d8f78e2 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a93fc84-0e48-4575-830a-5b9300632808 (non-flash)
Nov 13 19:22:55 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 19:22:55 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbd65d93-604b-4082-a8cb-0fb52d8f78e2 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a93fc84-0e48-4575-830a-5b9300632808 (non-flash)
Nov 13 19:22:55 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 19:22:55 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-bbd65d93-604b-4082-a8cb-0fb52d8f78e2 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0a93fc84-0e48-4575-830a-5b9300632808" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.248s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 19:22:55 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbd65d93-604b-4082-a8cb-0fb52d8f78e2 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Connected to 172.16.0.220:3260 {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 19:22:55 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-bbd65d93-604b-4082-a8cb-0fb52d8f78e2 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] HCTL ('33', '-', '-', 0) found on session 52 with lun 0 {{(pid=75216) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 19:22:55 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-bbd65d93-604b-4082-a8cb-0fb52d8f78e2 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75216) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 19:22:55 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:22:55 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:22:55 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[d85e2833-4ab3-4c7d-822c-14558aeb1006]: (4, ('- - 0', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:22:55 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-bbd65d93-604b-4082-a8cb-0fb52d8f78e2 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Searching for a device in session 52 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75216) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 19:22:55 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbd65d93-604b-4082-a8cb-0fb52d8f78e2 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:0a93fc84-0e48-4575-830a-5b9300632808', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zBAHmWxc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 19:22:56 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-bbd65d93-604b-4082-a8cb-0fb52d8f78e2 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.281s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 19:22:56 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbd65d93-604b-4082-a8cb-0fb52d8f78e2 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] <== connect_volume: return (1283ms) {'type': 'block', 'scsi_wwn': '26231383266313138', 'path': '/dev/sdb'} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 19:22:56 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bbd65d93-604b-4082-a8cb-0fb52d8f78e2 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] [instance: 1b8275e3-6ba3-4231-b6a7-79d59b99a724] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26231383266313138', 'path': '/dev/sdb'} {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 19:22:56 user nova-compute[75216]: DEBUG nova.objects.instance [None req-bbd65d93-604b-4082-a8cb-0fb52d8f78e2 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Lazy-loading 'flavor' on Instance uuid 1b8275e3-6ba3-4231-b6a7-79d59b99a724 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:22:56 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-bbd65d93-604b-4082-a8cb-0fb52d8f78e2 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] attach device xml: <disk type="block" device="disk">
Nov 13 19:22:56 user nova-compute[75216]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 19:22:56 user nova-compute[75216]:   <source dev="/dev/sdb"/>
Nov 13 19:22:56 user nova-compute[75216]:   <target dev="vdb" bus="virtio"/>
Nov 13 19:22:56 user nova-compute[75216]:   <serial>0a93fc84-0e48-4575-830a-5b9300632808</serial>
Nov 13 19:22:56 user nova-compute[75216]: </disk>
Nov 13 19:22:56 user nova-compute[75216]:  {{(pid=75216) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 13 19:22:57 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-bbd65d93-604b-4082-a8cb-0fb52d8f78e2 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 19:22:57 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-bbd65d93-604b-4082-a8cb-0fb52d8f78e2 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 19:22:57 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-bbd65d93-604b-4082-a8cb-0fb52d8f78e2 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] No VIF found with MAC fa:16:3e:1d:f3:08, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 19:22:57 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-bbd65d93-604b-4082-a8cb-0fb52d8f78e2 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Lock "1b8275e3-6ba3-4231-b6a7-79d59b99a724" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 5.882s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:22:57 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:22:59 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f6ac24ba-4a67-4f9e-bf9f-23368112efad tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Acquiring lock "1b8275e3-6ba3-4231-b6a7-79d59b99a724" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:22:59 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f6ac24ba-4a67-4f9e-bf9f-23368112efad tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Lock "1b8275e3-6ba3-4231-b6a7-79d59b99a724" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:22:59 user nova-compute[75216]: INFO nova.compute.manager [None req-f6ac24ba-4a67-4f9e-bf9f-23368112efad tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] [instance: 1b8275e3-6ba3-4231-b6a7-79d59b99a724] Detaching volume 0a93fc84-0e48-4575-830a-5b9300632808
Nov 13 19:22:59 user nova-compute[75216]: INFO nova.virt.block_device [None req-f6ac24ba-4a67-4f9e-bf9f-23368112efad tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] [instance: 1b8275e3-6ba3-4231-b6a7-79d59b99a724] Attempting to driver detach volume 0a93fc84-0e48-4575-830a-5b9300632808 from mountpoint /dev/vdb
Nov 13 19:22:59 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-f6ac24ba-4a67-4f9e-bf9f-23368112efad tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Attempting to detach device vdb from instance 1b8275e3-6ba3-4231-b6a7-79d59b99a724 from the persistent domain config. {{(pid=75216) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 13 19:22:59 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-f6ac24ba-4a67-4f9e-bf9f-23368112efad tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 19:22:59 user nova-compute[75216]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 19:22:59 user nova-compute[75216]:   <source dev="/dev/sdb"/>
Nov 13 19:22:59 user nova-compute[75216]:   <target dev="vdb" bus="virtio"/>
Nov 13 19:22:59 user nova-compute[75216]:   <serial>0a93fc84-0e48-4575-830a-5b9300632808</serial>
Nov 13 19:22:59 user nova-compute[75216]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 19:22:59 user nova-compute[75216]: </disk>
Nov 13 19:22:59 user nova-compute[75216]:  {{(pid=75216) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 19:22:59 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-f6ac24ba-4a67-4f9e-bf9f-23368112efad tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Successfully detached device vdb from instance 1b8275e3-6ba3-4231-b6a7-79d59b99a724 from the persistent domain config.
Nov 13 19:22:59 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-f6ac24ba-4a67-4f9e-bf9f-23368112efad tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1b8275e3-6ba3-4231-b6a7-79d59b99a724 from the live domain config. {{(pid=75216) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 13 19:22:59 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-f6ac24ba-4a67-4f9e-bf9f-23368112efad tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 19:22:59 user nova-compute[75216]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 19:22:59 user nova-compute[75216]:   <source dev="/dev/sdb"/>
Nov 13 19:22:59 user nova-compute[75216]:   <target dev="vdb" bus="virtio"/>
Nov 13 19:22:59 user nova-compute[75216]:   <serial>0a93fc84-0e48-4575-830a-5b9300632808</serial>
Nov 13 19:22:59 user nova-compute[75216]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 19:22:59 user nova-compute[75216]: </disk>
Nov 13 19:22:59 user nova-compute[75216]:  {{(pid=75216) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 19:22:59 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:22:59 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-f6ac24ba-4a67-4f9e-bf9f-23368112efad tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1b8275e3-6ba3-4231-b6a7-79d59b99a724 {{(pid=75216) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 13 19:23:02 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:23:06 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:23:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:23:09 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:23:11 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:23:13 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:23:15 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:23:15 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:23:15 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75216) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 19:23:17 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:23:17 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:23:17 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:23:18 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:23:18 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:23:18 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:23:18 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:23:18 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:23:18 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Auditing locally available compute resources for user (node: user) {{(pid=75216) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 19:23:18 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b8275e3-6ba3-4231-b6a7-79d59b99a724/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:23:18 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b8275e3-6ba3-4231-b6a7-79d59b99a724/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:23:18 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b8275e3-6ba3-4231-b6a7-79d59b99a724/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:23:18 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b8275e3-6ba3-4231-b6a7-79d59b99a724/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:23:18 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de2e9a72-2d63-4de6-8d18-a9d7490579a9/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:23:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de2e9a72-2d63-4de6-8d18-a9d7490579a9/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:23:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de2e9a72-2d63-4de6-8d18-a9d7490579a9/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:23:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de2e9a72-2d63-4de6-8d18-a9d7490579a9/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:23:19 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 19:23:19 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 19:23:19 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Hypervisor/Node resource view: name=user free_ram=8848MB free_disk=25.175662994384766GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75216) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 19:23:19 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:23:19 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:23:19 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-f6ac24ba-4a67-4f9e-bf9f-23368112efad tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 1b8275e3-6ba3-4231-b6a7-79d59b99a724 is timed out.
Nov 13 19:23:19 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-f6ac24ba-4a67-4f9e-bf9f-23368112efad tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Successfully detached device vdb from instance 1b8275e3-6ba3-4231-b6a7-79d59b99a724 from the live domain config.
Nov 13 19:23:19 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f6ac24ba-4a67-4f9e-bf9f-23368112efad tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] [instance: 1b8275e3-6ba3-4231-b6a7-79d59b99a724] calling os-brick to detach iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 19:23:19 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6ac24ba-4a67-4f9e-bf9f-23368112efad tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3a8669e40>, {'target_iqn': 'iqn.2010-10.org.openstack:0a93fc84-0e48-4575-830a-5b9300632808', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zBAHmWxc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 19:23:19 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-f6ac24ba-4a67-4f9e-bf9f-23368112efad tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 19:23:19 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-f6ac24ba-4a67-4f9e-bf9f-23368112efad tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 19:23:19 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-f6ac24ba-4a67-4f9e-bf9f-23368112efad tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 19:23:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:23:19 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance de2e9a72-2d63-4de6-8d18-a9d7490579a9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 19:23:19 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance 1b8275e3-6ba3-4231-b6a7-79d59b99a724 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 19:23:19 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 19:23:19 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 19:23:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:23:19 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f27d484-823e-4772-b85a-8f55b276b09d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0a93fc84-0e48-4575-830a-5b9300632808\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:23:19 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6ac24ba-4a67-4f9e-bf9f-23368112efad tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 19:23:19 user nova-compute[75216]: No targets found.
Nov 13 19:23:19 user nova-compute[75216]: iSNS:
Nov 13 19:23:19 user nova-compute[75216]: No targets found.
Nov 13 19:23:19 user nova-compute[75216]: STATIC:
Nov 13 19:23:19 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:0a93fc84-0e48-4575-830a-5b9300632808
Nov 13 19:23:19 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 19:23:19 user nova-compute[75216]:                 Iface Name: default
Nov 13 19:23:19 user nova-compute[75216]: FIRMWARE:
Nov 13 19:23:19 user nova-compute[75216]: No targets found.
Nov 13 19:23:19 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 19:23:19 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6ac24ba-4a67-4f9e-bf9f-23368112efad tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 19:23:19 user nova-compute[75216]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 19:23:19 user nova-compute[75216]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75216) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 19:23:19 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6ac24ba-4a67-4f9e-bf9f-23368112efad tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0a93fc84-0e48-4575-830a-5b9300632808', 0)] {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 19:23:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:23:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:23:19 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa8d3ac3-f4e3-408d-8c90-42399f3c7750]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0a93fc84-0e48-4575-830a-5b9300632808\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:23:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:23:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:23:19 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[e531304d-78f0-4fc7-ba8c-91d956e87c77]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a93fc84-0e48-4575-830a-5b9300632808 (non-flash)\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:23:19 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6ac24ba-4a67-4f9e-bf9f-23368112efad tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a93fc84-0e48-4575-830a-5b9300632808 (non-flash)
Nov 13 19:23:19 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 19:23:19 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6ac24ba-4a67-4f9e-bf9f-23368112efad tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a93fc84-0e48-4575-830a-5b9300632808 (non-flash)
Nov 13 19:23:19 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 19:23:19 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6ac24ba-4a67-4f9e-bf9f-23368112efad tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe3a8178160>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0a93fc84-0e48-4575-830a-5b9300632808'): ({'sdb'}, set())}) {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 19:23:19 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-f6ac24ba-4a67-4f9e-bf9f-23368112efad tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Removing single pathed devices sdb {{(pid=75216) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 19:23:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:23:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:23:19 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7685ced-c6c0-4cd1-8b85-b7da57cc739a]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:23:19 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 19:23:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:23:19 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 19:23:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.029s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:23:19 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c31b2b0-c681-40dc-b237-76319ff3c4b6]: (4, ('ok\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:23:19 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-f6ac24ba-4a67-4f9e-bf9f-23368112efad tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Flushing IO for device /dev/sdb {{(pid=75216) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 19:23:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:23:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.019s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:23:19 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[aef74bc4-fe12-4921-9773-10ab1a488a0a]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:23:19 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-f6ac24ba-4a67-4f9e-bf9f-23368112efad tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75216) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 19:23:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:23:19 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Compute_service record updated for user:user {{(pid=75216) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 19:23:19 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.287s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:23:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:23:19 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9f6a518-da43-4f08-85e0-90beb37faacc]: (4, ('1', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:23:19 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-f6ac24ba-4a67-4f9e-bf9f-23368112efad tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 19:23:19 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-f6ac24ba-4a67-4f9e-bf9f-23368112efad tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] SCSI volumes sdb have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 19:23:19 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6ac24ba-4a67-4f9e-bf9f-23368112efad tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0a93fc84-0e48-4575-830a-5b9300632808')] {{(pid=75216) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 19:23:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a93fc84-0e48-4575-830a-5b9300632808 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:23:20 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a93fc84-0e48-4575-830a-5b9300632808 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.037s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:23:20 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9342156-d7bb-4c5d-abfb-887382d6ab12]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:23:20 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6ac24ba-4a67-4f9e-bf9f-23368112efad tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:23:20 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a93fc84-0e48-4575-830a-5b9300632808 -p 172.16.0.220:3260 --logout {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:23:20 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a93fc84-0e48-4575-830a-5b9300632808 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:23:20 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[50a4036b-da73-4d61-8e0c-9e1b5be075b9]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:0a93fc84-0e48-4575-830a-5b9300632808, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:0a93fc84-0e48-4575-830a-5b9300632808, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:23:20 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6ac24ba-4a67-4f9e-bf9f-23368112efad tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:0a93fc84-0e48-4575-830a-5b9300632808, portal: 172.16.0.220,3260]
Nov 13 19:23:20 user nova-compute[75216]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:0a93fc84-0e48-4575-830a-5b9300632808, portal: 172.16.0.220,3260] successful.
Nov 13 19:23:20 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:23:20 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a93fc84-0e48-4575-830a-5b9300632808 -p 172.16.0.220:3260 --op delete {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:23:20 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a93fc84-0e48-4575-830a-5b9300632808 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:23:20 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3dcdcd4-eb88-41cd-a5ca-86f6874b0f3e]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:23:20 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6ac24ba-4a67-4f9e-bf9f-23368112efad tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:23:20 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-f6ac24ba-4a67-4f9e-bf9f-23368112efad tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.368s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 19:23:20 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6ac24ba-4a67-4f9e-bf9f-23368112efad tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] <== disconnect_volume: return (371ms) None {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 19:23:20 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f6ac24ba-4a67-4f9e-bf9f-23368112efad tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] [instance: 1b8275e3-6ba3-4231-b6a7-79d59b99a724] Disconnected iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 19:23:20 user nova-compute[75216]: DEBUG nova.objects.instance [None req-f6ac24ba-4a67-4f9e-bf9f-23368112efad tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Lazy-loading 'flavor' on Instance uuid 1b8275e3-6ba3-4231-b6a7-79d59b99a724 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:23:20 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f6ac24ba-4a67-4f9e-bf9f-23368112efad tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Lock "1b8275e3-6ba3-4231-b6a7-79d59b99a724" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.754s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:23:21 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f6161a3d-b235-4ab2-a082-53a3ebe8577e tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Acquiring lock "874468f0-1d7c-4ba2-b01e-9584c46b956a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:23:21 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f6161a3d-b235-4ab2-a082-53a3ebe8577e tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Lock "874468f0-1d7c-4ba2-b01e-9584c46b956a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:23:21 user nova-compute[75216]: DEBUG nova.compute.manager [None req-f6161a3d-b235-4ab2-a082-53a3ebe8577e tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] [instance: 874468f0-1d7c-4ba2-b01e-9584c46b956a] Starting instance... {{(pid=75216) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 19:23:21 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f6161a3d-b235-4ab2-a082-53a3ebe8577e tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:23:21 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f6161a3d-b235-4ab2-a082-53a3ebe8577e tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:23:21 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-f6161a3d-b235-4ab2-a082-53a3ebe8577e tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75216) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 19:23:21 user nova-compute[75216]: INFO nova.compute.claims [None req-f6161a3d-b235-4ab2-a082-53a3ebe8577e tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] [instance: 874468f0-1d7c-4ba2-b01e-9584c46b956a] Claim successful on node user
Nov 13 19:23:21 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-f6161a3d-b235-4ab2-a082-53a3ebe8577e tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 19:23:21 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-f6161a3d-b235-4ab2-a082-53a3ebe8577e tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 19:23:21 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f6161a3d-b235-4ab2-a082-53a3ebe8577e tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.274s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:23:21 user nova-compute[75216]: DEBUG nova.compute.manager [None req-f6161a3d-b235-4ab2-a082-53a3ebe8577e tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] [instance: 874468f0-1d7c-4ba2-b01e-9584c46b956a] Start building networks asynchronously for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 19:23:21 user nova-compute[75216]: DEBUG nova.compute.manager [None req-f6161a3d-b235-4ab2-a082-53a3ebe8577e tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] [instance: 874468f0-1d7c-4ba2-b01e-9584c46b956a] Allocating IP information in the background. {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 19:23:21 user nova-compute[75216]: DEBUG nova.network.neutron [None req-f6161a3d-b235-4ab2-a082-53a3ebe8577e tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] [instance: 874468f0-1d7c-4ba2-b01e-9584c46b956a] allocate_for_instance() {{(pid=75216) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 19:23:21 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-f6161a3d-b235-4ab2-a082-53a3ebe8577e tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] [instance: 874468f0-1d7c-4ba2-b01e-9584c46b956a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 19:23:21 user nova-compute[75216]: DEBUG nova.compute.manager [None req-f6161a3d-b235-4ab2-a082-53a3ebe8577e tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] [instance: 874468f0-1d7c-4ba2-b01e-9584c46b956a] Start building block device mappings for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 19:23:21 user nova-compute[75216]: DEBUG nova.policy [None req-f6161a3d-b235-4ab2-a082-53a3ebe8577e tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1ca750d884c3403394b46f53fbd633a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06cae29094846f1817036dc761a565d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75216) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 19:23:22 user nova-compute[75216]: DEBUG nova.compute.manager [None req-f6161a3d-b235-4ab2-a082-53a3ebe8577e tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] [instance: 874468f0-1d7c-4ba2-b01e-9584c46b956a] Start spawning the instance on the hypervisor. {{(pid=75216) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 19:23:22 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-f6161a3d-b235-4ab2-a082-53a3ebe8577e tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] [instance: 874468f0-1d7c-4ba2-b01e-9584c46b956a] Creating instance directory {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 19:23:22 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-f6161a3d-b235-4ab2-a082-53a3ebe8577e tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] [instance: 874468f0-1d7c-4ba2-b01e-9584c46b956a] Creating image(s)
Nov 13 19:23:22 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f6161a3d-b235-4ab2-a082-53a3ebe8577e tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Acquiring lock "/opt/stack/data/nova/instances/874468f0-1d7c-4ba2-b01e-9584c46b956a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:23:22 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f6161a3d-b235-4ab2-a082-53a3ebe8577e tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Lock "/opt/stack/data/nova/instances/874468f0-1d7c-4ba2-b01e-9584c46b956a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:23:22 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f6161a3d-b235-4ab2-a082-53a3ebe8577e tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Lock "/opt/stack/data/nova/instances/874468f0-1d7c-4ba2-b01e-9584c46b956a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:23:22 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-f6161a3d-b235-4ab2-a082-53a3ebe8577e tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:23:22 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-f6161a3d-b235-4ab2-a082-53a3ebe8577e tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json" returned: 0 in 0.182s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:23:22 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f6161a3d-b235-4ab2-a082-53a3ebe8577e tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Acquiring lock "88c50a45bec9d6b0427462b3242b9b8e5f49c2b6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:23:22 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f6161a3d-b235-4ab2-a082-53a3ebe8577e tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Lock "88c50a45bec9d6b0427462b3242b9b8e5f49c2b6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:23:22 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-f6161a3d-b235-4ab2-a082-53a3ebe8577e tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:23:22 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-f6161a3d-b235-4ab2-a082-53a3ebe8577e tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json" returned: 0 in 0.183s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:23:22 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-f6161a3d-b235-4ab2-a082-53a3ebe8577e tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6,backing_fmt=raw /opt/stack/data/nova/instances/874468f0-1d7c-4ba2-b01e-9584c46b956a/disk 1073741824 {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:23:22 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-f6161a3d-b235-4ab2-a082-53a3ebe8577e tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6,backing_fmt=raw /opt/stack/data/nova/instances/874468f0-1d7c-4ba2-b01e-9584c46b956a/disk 1073741824" returned: 0 in 0.049s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:23:22 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f6161a3d-b235-4ab2-a082-53a3ebe8577e tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Lock "88c50a45bec9d6b0427462b3242b9b8e5f49c2b6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.240s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:23:22 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-f6161a3d-b235-4ab2-a082-53a3ebe8577e tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:23:22 user nova-compute[75216]: DEBUG nova.network.neutron [None req-f6161a3d-b235-4ab2-a082-53a3ebe8577e tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] [instance: 874468f0-1d7c-4ba2-b01e-9584c46b956a] Successfully created port: ec14a363-0571-4332-a85e-3194b039c7c3 {{(pid=75216) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 19:23:22 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-f6161a3d-b235-4ab2-a082-53a3ebe8577e tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json" returned: 0 in 0.174s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:23:22 user nova-compute[75216]: DEBUG nova.virt.disk.api [None req-f6161a3d-b235-4ab2-a082-53a3ebe8577e tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Checking if we can resize image /opt/stack/data/nova/instances/874468f0-1d7c-4ba2-b01e-9584c46b956a/disk. size=1073741824 {{(pid=75216) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 19:23:22 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-f6161a3d-b235-4ab2-a082-53a3ebe8577e tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/874468f0-1d7c-4ba2-b01e-9584c46b956a/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:23:22 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-f6161a3d-b235-4ab2-a082-53a3ebe8577e tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/874468f0-1d7c-4ba2-b01e-9584c46b956a/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:23:22 user nova-compute[75216]: DEBUG nova.virt.disk.api [None req-f6161a3d-b235-4ab2-a082-53a3ebe8577e tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Cannot resize image /opt/stack/data/nova/instances/874468f0-1d7c-4ba2-b01e-9584c46b956a/disk to a smaller size. {{(pid=75216) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 19:23:22 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-f6161a3d-b235-4ab2-a082-53a3ebe8577e tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] [instance: 874468f0-1d7c-4ba2-b01e-9584c46b956a] Created local disks {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 19:23:22 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-f6161a3d-b235-4ab2-a082-53a3ebe8577e tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] [instance: 874468f0-1d7c-4ba2-b01e-9584c46b956a] Ensure instance console log exists: /opt/stack/data/nova/instances/874468f0-1d7c-4ba2-b01e-9584c46b956a/console.log {{(pid=75216) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 19:23:22 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f6161a3d-b235-4ab2-a082-53a3ebe8577e tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:23:22 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f6161a3d-b235-4ab2-a082-53a3ebe8577e tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:23:22 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f6161a3d-b235-4ab2-a082-53a3ebe8577e tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:23:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:23:23 user nova-compute[75216]: DEBUG nova.network.neutron [None req-f6161a3d-b235-4ab2-a082-53a3ebe8577e tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] [instance: 874468f0-1d7c-4ba2-b01e-9584c46b956a] Successfully updated port: ec14a363-0571-4332-a85e-3194b039c7c3 {{(pid=75216) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 19:23:23 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f6161a3d-b235-4ab2-a082-53a3ebe8577e tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Acquiring lock "refresh_cache-874468f0-1d7c-4ba2-b01e-9584c46b956a" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 19:23:23 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f6161a3d-b235-4ab2-a082-53a3ebe8577e tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Acquired lock "refresh_cache-874468f0-1d7c-4ba2-b01e-9584c46b956a" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 19:23:23 user nova-compute[75216]: DEBUG nova.network.neutron [None req-f6161a3d-b235-4ab2-a082-53a3ebe8577e tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] [instance: 874468f0-1d7c-4ba2-b01e-9584c46b956a] Building network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 19:23:23 user nova-compute[75216]: DEBUG nova.compute.manager [req-f725e796-d131-45c3-bea8-3ed5fc79a375 req-4412b79e-3de7-4933-bf79-f1f7cf63cba4 service nova] [instance: 874468f0-1d7c-4ba2-b01e-9584c46b956a] Received event network-changed-ec14a363-0571-4332-a85e-3194b039c7c3 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:23:23 user nova-compute[75216]: DEBUG nova.compute.manager [req-f725e796-d131-45c3-bea8-3ed5fc79a375 req-4412b79e-3de7-4933-bf79-f1f7cf63cba4 service nova] [instance: 874468f0-1d7c-4ba2-b01e-9584c46b956a] Refreshing instance network info cache due to event network-changed-ec14a363-0571-4332-a85e-3194b039c7c3. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 19:23:23 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-f725e796-d131-45c3-bea8-3ed5fc79a375 req-4412b79e-3de7-4933-bf79-f1f7cf63cba4 service nova] Acquiring lock "refresh_cache-874468f0-1d7c-4ba2-b01e-9584c46b956a" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 19:23:23 user nova-compute[75216]: DEBUG nova.network.neutron [None req-f6161a3d-b235-4ab2-a082-53a3ebe8577e tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] [instance: 874468f0-1d7c-4ba2-b01e-9584c46b956a] Instance cache missing network info. {{(pid=75216) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 19:23:23 user nova-compute[75216]: DEBUG nova.network.neutron [None req-f6161a3d-b235-4ab2-a082-53a3ebe8577e tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] [instance: 874468f0-1d7c-4ba2-b01e-9584c46b956a] Updating instance_info_cache with network_info: [{"id": "ec14a363-0571-4332-a85e-3194b039c7c3", "address": "fa:16:3e:40:41:53", "network": {"id": "9dcbadf2-6b5e-41f1-88a3-17a579ad1bad", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-926239573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d06cae29094846f1817036dc761a565d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec14a363-05", "ovs_interfaceid": "ec14a363-0571-4332-a85e-3194b039c7c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:23:23 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f6161a3d-b235-4ab2-a082-53a3ebe8577e tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Releasing lock "refresh_cache-874468f0-1d7c-4ba2-b01e-9584c46b956a" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 19:23:23 user nova-compute[75216]: DEBUG nova.compute.manager [None req-f6161a3d-b235-4ab2-a082-53a3ebe8577e tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] [instance: 874468f0-1d7c-4ba2-b01e-9584c46b956a] Instance network_info: |[{"id": "ec14a363-0571-4332-a85e-3194b039c7c3", "address": "fa:16:3e:40:41:53", "network": {"id": "9dcbadf2-6b5e-41f1-88a3-17a579ad1bad", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-926239573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d06cae29094846f1817036dc761a565d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec14a363-05", "ovs_interfaceid": "ec14a363-0571-4332-a85e-3194b039c7c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 19:23:23 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-f725e796-d131-45c3-bea8-3ed5fc79a375 req-4412b79e-3de7-4933-bf79-f1f7cf63cba4 service nova] Acquired lock "refresh_cache-874468f0-1d7c-4ba2-b01e-9584c46b956a" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 19:23:23 user nova-compute[75216]: DEBUG nova.network.neutron [req-f725e796-d131-45c3-bea8-3ed5fc79a375 req-4412b79e-3de7-4933-bf79-f1f7cf63cba4 service nova] [instance: 874468f0-1d7c-4ba2-b01e-9584c46b956a] Refreshing network info cache for port ec14a363-0571-4332-a85e-3194b039c7c3 {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 19:23:23 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-f6161a3d-b235-4ab2-a082-53a3ebe8577e tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] [instance: 874468f0-1d7c-4ba2-b01e-9584c46b956a] Start _get_guest_xml network_info=[{"id": "ec14a363-0571-4332-a85e-3194b039c7c3", "address": "fa:16:3e:40:41:53", "network": {"id": "9dcbadf2-6b5e-41f1-88a3-17a579ad1bad", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-926239573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d06cae29094846f1817036dc761a565d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec14a363-05", "ovs_interfaceid": "ec14a363-0571-4332-a85e-3194b039c7c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T18:41:06Z,direct_url=<?>,disk_format='qcow2',id=77bcb5ba-8510-41ec-a88d-96097bb431de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c465b7c26ec44582b6d1b7169536ecc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T18:41:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'guest_format': None, 'boot_index': 0, 'image_id': '77bcb5ba-8510-41ec-a88d-96097bb431de'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 19:23:23 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-f6161a3d-b235-4ab2-a082-53a3ebe8577e tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 19:23:23 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-f6161a3d-b235-4ab2-a082-53a3ebe8577e tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 19:23:23 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-f6161a3d-b235-4ab2-a082-53a3ebe8577e tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 19:23:23 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-f6161a3d-b235-4ab2-a082-53a3ebe8577e tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] CPU controller missing on host. {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 19:23:23 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-f6161a3d-b235-4ab2-a082-53a3ebe8577e tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 19:23:23 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-f6161a3d-b235-4ab2-a082-53a3ebe8577e tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] CPU controller found on host. {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 19:23:23 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-f6161a3d-b235-4ab2-a082-53a3ebe8577e tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75216) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 19:23:23 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-f6161a3d-b235-4ab2-a082-53a3ebe8577e tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T18:40:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T18:41:06Z,direct_url=<?>,disk_format='qcow2',id=77bcb5ba-8510-41ec-a88d-96097bb431de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c465b7c26ec44582b6d1b7169536ecc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T18:41:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 19:23:23 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-f6161a3d-b235-4ab2-a082-53a3ebe8577e tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Flavor limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 19:23:23 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-f6161a3d-b235-4ab2-a082-53a3ebe8577e tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Image limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 19:23:23 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-f6161a3d-b235-4ab2-a082-53a3ebe8577e tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Flavor pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 19:23:23 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-f6161a3d-b235-4ab2-a082-53a3ebe8577e tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Image pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 19:23:23 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-f6161a3d-b235-4ab2-a082-53a3ebe8577e tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 19:23:23 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-f6161a3d-b235-4ab2-a082-53a3ebe8577e tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 19:23:23 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-f6161a3d-b235-4ab2-a082-53a3ebe8577e tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 19:23:23 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-f6161a3d-b235-4ab2-a082-53a3ebe8577e tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Got 1 possible topologies {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 19:23:23 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-f6161a3d-b235-4ab2-a082-53a3ebe8577e tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 19:23:23 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-f6161a3d-b235-4ab2-a082-53a3ebe8577e tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 19:23:23 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-f6161a3d-b235-4ab2-a082-53a3ebe8577e tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T19:23:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1712111216',display_name='tempest-AttachVolumeNegativeTest-server-1712111216',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1712111216',id=45,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN2tN9acLF2QgyociyNmNoIoDpLLDyKgAiIGz8GDcj7kmYzWVqXXl+DhpAUiMkjeK/dvc0Niua4y2Vbhm9ip9TaMRHETi/xnVvBNPJz4apUhdnHKSWaYE9gnbbcp+pOfdQ==',key_name='tempest-keypair-1043587685',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d06cae29094846f1817036dc761a565d',ramdisk_id='',reservation_id='r-2q20w00p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1187420962',owner_user_name='tempest-AttachVolumeNegativeTest-1187420962-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T19:23:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1ca750d884c3403394b46f53fbd633a1',uuid=874468f0-1d7c-4ba2-b01e-9584c46b956a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ec14a363-0571-4332-a85e-3194b039c7c3", "address": "fa:16:3e:40:41:53", "network": {"id": "9dcbadf2-6b5e-41f1-88a3-17a579ad1bad", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-926239573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d06cae29094846f1817036dc761a565d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec14a363-05", "ovs_interfaceid": "ec14a363-0571-4332-a85e-3194b039c7c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75216) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 19:23:23 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-f6161a3d-b235-4ab2-a082-53a3ebe8577e tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Converting VIF {"id": "ec14a363-0571-4332-a85e-3194b039c7c3", "address": "fa:16:3e:40:41:53", "network": {"id": "9dcbadf2-6b5e-41f1-88a3-17a579ad1bad", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-926239573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d06cae29094846f1817036dc761a565d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec14a363-05", "ovs_interfaceid": "ec14a363-0571-4332-a85e-3194b039c7c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 19:23:23 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-f6161a3d-b235-4ab2-a082-53a3ebe8577e tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:41:53,bridge_name='br-int',has_traffic_filtering=True,id=ec14a363-0571-4332-a85e-3194b039c7c3,network=Network(9dcbadf2-6b5e-41f1-88a3-17a579ad1bad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec14a363-05') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 19:23:23 user nova-compute[75216]: DEBUG nova.objects.instance [None req-f6161a3d-b235-4ab2-a082-53a3ebe8577e tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Lazy-loading 'pci_devices' on Instance uuid 874468f0-1d7c-4ba2-b01e-9584c46b956a {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:23:23 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-f6161a3d-b235-4ab2-a082-53a3ebe8577e tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] [instance: 874468f0-1d7c-4ba2-b01e-9584c46b956a] End _get_guest_xml xml=<domain type="kvm">
Nov 13 19:23:23 user nova-compute[75216]:   <uuid>874468f0-1d7c-4ba2-b01e-9584c46b956a</uuid>
Nov 13 19:23:23 user nova-compute[75216]:   <name>instance-0000002d</name>
Nov 13 19:23:23 user nova-compute[75216]:   <memory>524288</memory>
Nov 13 19:23:23 user nova-compute[75216]:   <vcpu>1</vcpu>
Nov 13 19:23:23 user nova-compute[75216]:   <metadata>
Nov 13 19:23:23 user nova-compute[75216]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 19:23:23 user nova-compute[75216]:       <nova:package version="0.0.0"/>
Nov 13 19:23:23 user nova-compute[75216]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1712111216</nova:name>
Nov 13 19:23:23 user nova-compute[75216]:       <nova:creationTime>2023-11-13 19:23:23</nova:creationTime>
Nov 13 19:23:23 user nova-compute[75216]:       <nova:flavor name="m1.tiny">
Nov 13 19:23:23 user nova-compute[75216]:         <nova:memory>512</nova:memory>
Nov 13 19:23:23 user nova-compute[75216]:         <nova:disk>1</nova:disk>
Nov 13 19:23:23 user nova-compute[75216]:         <nova:swap>0</nova:swap>
Nov 13 19:23:23 user nova-compute[75216]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 19:23:23 user nova-compute[75216]:         <nova:vcpus>1</nova:vcpus>
Nov 13 19:23:23 user nova-compute[75216]:       </nova:flavor>
Nov 13 19:23:23 user nova-compute[75216]:       <nova:owner>
Nov 13 19:23:23 user nova-compute[75216]:         <nova:user uuid="1ca750d884c3403394b46f53fbd633a1">tempest-AttachVolumeNegativeTest-1187420962-project-member</nova:user>
Nov 13 19:23:23 user nova-compute[75216]:         <nova:project uuid="d06cae29094846f1817036dc761a565d">tempest-AttachVolumeNegativeTest-1187420962</nova:project>
Nov 13 19:23:23 user nova-compute[75216]:       </nova:owner>
Nov 13 19:23:23 user nova-compute[75216]:       <nova:root type="image" uuid="77bcb5ba-8510-41ec-a88d-96097bb431de"/>
Nov 13 19:23:23 user nova-compute[75216]:       <nova:ports>
Nov 13 19:23:23 user nova-compute[75216]:         <nova:port uuid="ec14a363-0571-4332-a85e-3194b039c7c3">
Nov 13 19:23:23 user nova-compute[75216]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 13 19:23:23 user nova-compute[75216]:         </nova:port>
Nov 13 19:23:23 user nova-compute[75216]:       </nova:ports>
Nov 13 19:23:23 user nova-compute[75216]:     </nova:instance>
Nov 13 19:23:23 user nova-compute[75216]:   </metadata>
Nov 13 19:23:23 user nova-compute[75216]:   <sysinfo type="smbios">
Nov 13 19:23:23 user nova-compute[75216]:     <system>
Nov 13 19:23:23 user nova-compute[75216]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 19:23:23 user nova-compute[75216]:       <entry name="product">OpenStack Nova</entry>
Nov 13 19:23:23 user nova-compute[75216]:       <entry name="version">0.0.0</entry>
Nov 13 19:23:23 user nova-compute[75216]:       <entry name="serial">874468f0-1d7c-4ba2-b01e-9584c46b956a</entry>
Nov 13 19:23:23 user nova-compute[75216]:       <entry name="uuid">874468f0-1d7c-4ba2-b01e-9584c46b956a</entry>
Nov 13 19:23:23 user nova-compute[75216]:       <entry name="family">Virtual Machine</entry>
Nov 13 19:23:23 user nova-compute[75216]:     </system>
Nov 13 19:23:23 user nova-compute[75216]:   </sysinfo>
Nov 13 19:23:23 user nova-compute[75216]:   <os>
Nov 13 19:23:23 user nova-compute[75216]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 19:23:23 user nova-compute[75216]:     <boot dev="hd"/>
Nov 13 19:23:23 user nova-compute[75216]:     <smbios mode="sysinfo"/>
Nov 13 19:23:23 user nova-compute[75216]:   </os>
Nov 13 19:23:23 user nova-compute[75216]:   <features>
Nov 13 19:23:23 user nova-compute[75216]:     <acpi/>
Nov 13 19:23:23 user nova-compute[75216]:     <apic/>
Nov 13 19:23:23 user nova-compute[75216]:     <vmcoreinfo/>
Nov 13 19:23:23 user nova-compute[75216]:   </features>
Nov 13 19:23:23 user nova-compute[75216]:   <clock offset="utc">
Nov 13 19:23:23 user nova-compute[75216]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 19:23:23 user nova-compute[75216]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 19:23:23 user nova-compute[75216]:     <timer name="hpet" present="no"/>
Nov 13 19:23:23 user nova-compute[75216]:   </clock>
Nov 13 19:23:23 user nova-compute[75216]:   <cpu mode="custom" match="exact">
Nov 13 19:23:23 user nova-compute[75216]:     <model>Nehalem</model>
Nov 13 19:23:23 user nova-compute[75216]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 19:23:23 user nova-compute[75216]:   </cpu>
Nov 13 19:23:23 user nova-compute[75216]:   <devices>
Nov 13 19:23:23 user nova-compute[75216]:     <disk type="file" device="disk">
Nov 13 19:23:23 user nova-compute[75216]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 19:23:23 user nova-compute[75216]:       <source file="/opt/stack/data/nova/instances/874468f0-1d7c-4ba2-b01e-9584c46b956a/disk"/>
Nov 13 19:23:23 user nova-compute[75216]:       <target dev="vda" bus="virtio"/>
Nov 13 19:23:23 user nova-compute[75216]:     </disk>
Nov 13 19:23:23 user nova-compute[75216]:     <interface type="ethernet">
Nov 13 19:23:23 user nova-compute[75216]:       <mac address="fa:16:3e:40:41:53"/>
Nov 13 19:23:23 user nova-compute[75216]:       <model type="virtio"/>
Nov 13 19:23:23 user nova-compute[75216]:       <mtu size="1442"/>
Nov 13 19:23:23 user nova-compute[75216]:       <target dev="tapec14a363-05"/>
Nov 13 19:23:23 user nova-compute[75216]:     </interface>
Nov 13 19:23:23 user nova-compute[75216]:     <serial type="pty">
Nov 13 19:23:23 user nova-compute[75216]:       <log file="/opt/stack/data/nova/instances/874468f0-1d7c-4ba2-b01e-9584c46b956a/console.log" append="off"/>
Nov 13 19:23:23 user nova-compute[75216]:     </serial>
Nov 13 19:23:23 user nova-compute[75216]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 19:23:23 user nova-compute[75216]:     <video>
Nov 13 19:23:23 user nova-compute[75216]:       <model type="virtio"/>
Nov 13 19:23:23 user nova-compute[75216]:     </video>
Nov 13 19:23:23 user nova-compute[75216]:     <rng model="virtio">
Nov 13 19:23:23 user nova-compute[75216]:       <backend model="random">/dev/urandom</backend>
Nov 13 19:23:23 user nova-compute[75216]:     </rng>
Nov 13 19:23:23 user nova-compute[75216]:     <controller type="usb" index="0" model="none"/>
Nov 13 19:23:23 user nova-compute[75216]:     <memballoon model="virtio">
Nov 13 19:23:23 user nova-compute[75216]:       <stats period="10"/>
Nov 13 19:23:23 user nova-compute[75216]:     </memballoon>
Nov 13 19:23:23 user nova-compute[75216]:   </devices>
Nov 13 19:23:23 user nova-compute[75216]: </domain>
Nov 13 19:23:23 user nova-compute[75216]:  {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 19:23:23 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-f6161a3d-b235-4ab2-a082-53a3ebe8577e tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T19:23:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1712111216',display_name='tempest-AttachVolumeNegativeTest-server-1712111216',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1712111216',id=45,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN2tN9acLF2QgyociyNmNoIoDpLLDyKgAiIGz8GDcj7kmYzWVqXXl+DhpAUiMkjeK/dvc0Niua4y2Vbhm9ip9TaMRHETi/xnVvBNPJz4apUhdnHKSWaYE9gnbbcp+pOfdQ==',key_name='tempest-keypair-1043587685',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d06cae29094846f1817036dc761a565d',ramdisk_id='',reservation_id='r-2q20w00p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1187420962',owner_user_name='tempest-AttachVolumeNegativeTest-1187420962-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T19:23:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1ca750d884c3403394b46f53fbd633a1',uuid=874468f0-1d7c-4ba2-b01e-9584c46b956a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ec14a363-0571-4332-a85e-3194b039c7c3", "address": "fa:16:3e:40:41:53", "network": {"id": "9dcbadf2-6b5e-41f1-88a3-17a579ad1bad", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-926239573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d06cae29094846f1817036dc761a565d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec14a363-05", "ovs_interfaceid": "ec14a363-0571-4332-a85e-3194b039c7c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 19:23:23 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-f6161a3d-b235-4ab2-a082-53a3ebe8577e tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Converting VIF {"id": "ec14a363-0571-4332-a85e-3194b039c7c3", "address": "fa:16:3e:40:41:53", "network": {"id": "9dcbadf2-6b5e-41f1-88a3-17a579ad1bad", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-926239573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d06cae29094846f1817036dc761a565d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec14a363-05", "ovs_interfaceid": "ec14a363-0571-4332-a85e-3194b039c7c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 19:23:23 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-f6161a3d-b235-4ab2-a082-53a3ebe8577e tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:41:53,bridge_name='br-int',has_traffic_filtering=True,id=ec14a363-0571-4332-a85e-3194b039c7c3,network=Network(9dcbadf2-6b5e-41f1-88a3-17a579ad1bad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec14a363-05') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 19:23:23 user nova-compute[75216]: DEBUG os_vif [None req-f6161a3d-b235-4ab2-a082-53a3ebe8577e tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:41:53,bridge_name='br-int',has_traffic_filtering=True,id=ec14a363-0571-4332-a85e-3194b039c7c3,network=Network(9dcbadf2-6b5e-41f1-88a3-17a579ad1bad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec14a363-05') {{(pid=75216) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 19:23:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:23:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:23:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 19:23:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:23:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5671f498-25d1-5022-982e-e77ae9127942', '_type': 'linux-noop'}}, row=False) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:23:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:23:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:23:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapec14a363-05, may_exist=True, interface_attrs={}) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:23:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapec14a363-05, col_values=(('qos', UUID('8cfac8ab-db99-4aec-8c66-c8a8b4f6f7f7')),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:23:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapec14a363-05, col_values=(('external_ids', {'iface-id': 'ec14a363-0571-4332-a85e-3194b039c7c3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:40:41:53', 'vm-uuid': '874468f0-1d7c-4ba2-b01e-9584c46b956a'}),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:23:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:23:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:23:23 user nova-compute[75216]: INFO os_vif [None req-f6161a3d-b235-4ab2-a082-53a3ebe8577e tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:41:53,bridge_name='br-int',has_traffic_filtering=True,id=ec14a363-0571-4332-a85e-3194b039c7c3,network=Network(9dcbadf2-6b5e-41f1-88a3-17a579ad1bad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec14a363-05')
Nov 13 19:23:23 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-f6161a3d-b235-4ab2-a082-53a3ebe8577e tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 19:23:23 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-f6161a3d-b235-4ab2-a082-53a3ebe8577e tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] No VIF found with MAC fa:16:3e:40:41:53, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 19:23:23 user nova-compute[75216]: DEBUG nova.network.neutron [req-f725e796-d131-45c3-bea8-3ed5fc79a375 req-4412b79e-3de7-4933-bf79-f1f7cf63cba4 service nova] [instance: 874468f0-1d7c-4ba2-b01e-9584c46b956a] Updated VIF entry in instance network info cache for port ec14a363-0571-4332-a85e-3194b039c7c3. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 19:23:23 user nova-compute[75216]: DEBUG nova.network.neutron [req-f725e796-d131-45c3-bea8-3ed5fc79a375 req-4412b79e-3de7-4933-bf79-f1f7cf63cba4 service nova] [instance: 874468f0-1d7c-4ba2-b01e-9584c46b956a] Updating instance_info_cache with network_info: [{"id": "ec14a363-0571-4332-a85e-3194b039c7c3", "address": "fa:16:3e:40:41:53", "network": {"id": "9dcbadf2-6b5e-41f1-88a3-17a579ad1bad", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-926239573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d06cae29094846f1817036dc761a565d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec14a363-05", "ovs_interfaceid": "ec14a363-0571-4332-a85e-3194b039c7c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:23:23 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-f725e796-d131-45c3-bea8-3ed5fc79a375 req-4412b79e-3de7-4933-bf79-f1f7cf63cba4 service nova] Releasing lock "refresh_cache-874468f0-1d7c-4ba2-b01e-9584c46b956a" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 19:23:24 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:23:24 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:23:24 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:23:24 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:23:24 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:23:24 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Starting heal instance info cache {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 19:23:24 user nova-compute[75216]: DEBUG nova.compute.manager [req-1f0a454d-f7ef-42be-8c9e-401305c5994f req-669d62a0-6ea7-4a7f-a132-40fae50bc631 service nova] [instance: 874468f0-1d7c-4ba2-b01e-9584c46b956a] Received event network-vif-plugged-ec14a363-0571-4332-a85e-3194b039c7c3 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:23:24 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-1f0a454d-f7ef-42be-8c9e-401305c5994f req-669d62a0-6ea7-4a7f-a132-40fae50bc631 service nova] Acquiring lock "874468f0-1d7c-4ba2-b01e-9584c46b956a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:23:24 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-1f0a454d-f7ef-42be-8c9e-401305c5994f req-669d62a0-6ea7-4a7f-a132-40fae50bc631 service nova] Lock "874468f0-1d7c-4ba2-b01e-9584c46b956a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:23:24 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-1f0a454d-f7ef-42be-8c9e-401305c5994f req-669d62a0-6ea7-4a7f-a132-40fae50bc631 service nova] Lock "874468f0-1d7c-4ba2-b01e-9584c46b956a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:23:24 user nova-compute[75216]: DEBUG nova.compute.manager [req-1f0a454d-f7ef-42be-8c9e-401305c5994f req-669d62a0-6ea7-4a7f-a132-40fae50bc631 service nova] [instance: 874468f0-1d7c-4ba2-b01e-9584c46b956a] No waiting events found dispatching network-vif-plugged-ec14a363-0571-4332-a85e-3194b039c7c3 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 19:23:24 user nova-compute[75216]: WARNING nova.compute.manager [req-1f0a454d-f7ef-42be-8c9e-401305c5994f req-669d62a0-6ea7-4a7f-a132-40fae50bc631 service nova] [instance: 874468f0-1d7c-4ba2-b01e-9584c46b956a] Received unexpected event network-vif-plugged-ec14a363-0571-4332-a85e-3194b039c7c3 for instance with vm_state building and task_state spawning.
Nov 13 19:23:25 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "refresh_cache-1b8275e3-6ba3-4231-b6a7-79d59b99a724" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 19:23:25 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquired lock "refresh_cache-1b8275e3-6ba3-4231-b6a7-79d59b99a724" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 19:23:25 user nova-compute[75216]: DEBUG nova.network.neutron [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: 1b8275e3-6ba3-4231-b6a7-79d59b99a724] Forcefully refreshing network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 19:23:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:23:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:23:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:23:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:23:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:23:25 user nova-compute[75216]: DEBUG nova.network.neutron [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: 1b8275e3-6ba3-4231-b6a7-79d59b99a724] Updating instance_info_cache with network_info: [{"id": "f93b7077-4a76-4af4-b958-6a397ef2fbdd", "address": "fa:16:3e:1d:f3:08", "network": {"id": "913673cd-fbe9-48f6-b922-0fd6cf3b52e2", "bridge": "br-int", "label": "tempest-TestStampPattern-134235743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5c7034cfcc8457eb80e8f1875cd39f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf93b7077-4a", "ovs_interfaceid": "f93b7077-4a76-4af4-b958-6a397ef2fbdd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:23:25 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Releasing lock "refresh_cache-1b8275e3-6ba3-4231-b6a7-79d59b99a724" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 19:23:25 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: 1b8275e3-6ba3-4231-b6a7-79d59b99a724] Updated the network info_cache for instance {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 19:23:25 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:23:26 user nova-compute[75216]: DEBUG nova.compute.manager [None req-f6161a3d-b235-4ab2-a082-53a3ebe8577e tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] [instance: 874468f0-1d7c-4ba2-b01e-9584c46b956a] Instance event wait completed in 0 seconds for  {{(pid=75216) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 19:23:26 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-f6161a3d-b235-4ab2-a082-53a3ebe8577e tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] [instance: 874468f0-1d7c-4ba2-b01e-9584c46b956a] Guest created on hypervisor {{(pid=75216) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 19:23:26 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 874468f0-1d7c-4ba2-b01e-9584c46b956a] Instance spawned successfully.
Nov 13 19:23:26 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-f6161a3d-b235-4ab2-a082-53a3ebe8577e tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] [instance: 874468f0-1d7c-4ba2-b01e-9584c46b956a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 19:23:26 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-f6161a3d-b235-4ab2-a082-53a3ebe8577e tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] [instance: 874468f0-1d7c-4ba2-b01e-9584c46b956a] Found default for hw_cdrom_bus of ide {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 19:23:26 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-f6161a3d-b235-4ab2-a082-53a3ebe8577e tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] [instance: 874468f0-1d7c-4ba2-b01e-9584c46b956a] Found default for hw_disk_bus of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 19:23:26 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-f6161a3d-b235-4ab2-a082-53a3ebe8577e tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] [instance: 874468f0-1d7c-4ba2-b01e-9584c46b956a] Found default for hw_input_bus of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 19:23:26 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-f6161a3d-b235-4ab2-a082-53a3ebe8577e tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] [instance: 874468f0-1d7c-4ba2-b01e-9584c46b956a] Found default for hw_pointer_model of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 19:23:26 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-f6161a3d-b235-4ab2-a082-53a3ebe8577e tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] [instance: 874468f0-1d7c-4ba2-b01e-9584c46b956a] Found default for hw_video_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 19:23:26 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-f6161a3d-b235-4ab2-a082-53a3ebe8577e tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] [instance: 874468f0-1d7c-4ba2-b01e-9584c46b956a] Found default for hw_vif_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 19:23:26 user nova-compute[75216]: INFO nova.compute.manager [None req-f6161a3d-b235-4ab2-a082-53a3ebe8577e tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] [instance: 874468f0-1d7c-4ba2-b01e-9584c46b956a] Took 4.95 seconds to spawn the instance on the hypervisor.
Nov 13 19:23:26 user nova-compute[75216]: DEBUG nova.compute.manager [None req-f6161a3d-b235-4ab2-a082-53a3ebe8577e tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] [instance: 874468f0-1d7c-4ba2-b01e-9584c46b956a] Checking state {{(pid=75216) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 19:23:27 user nova-compute[75216]: DEBUG nova.compute.manager [req-a3392ad4-830b-4f81-a56c-d8d9552fc331 req-25a6567a-0162-4b36-8d53-8ee2396c6631 service nova] [instance: 874468f0-1d7c-4ba2-b01e-9584c46b956a] Received event network-vif-plugged-ec14a363-0571-4332-a85e-3194b039c7c3 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:23:27 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-a3392ad4-830b-4f81-a56c-d8d9552fc331 req-25a6567a-0162-4b36-8d53-8ee2396c6631 service nova] Acquiring lock "874468f0-1d7c-4ba2-b01e-9584c46b956a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:23:27 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-a3392ad4-830b-4f81-a56c-d8d9552fc331 req-25a6567a-0162-4b36-8d53-8ee2396c6631 service nova] Lock "874468f0-1d7c-4ba2-b01e-9584c46b956a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:23:27 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-a3392ad4-830b-4f81-a56c-d8d9552fc331 req-25a6567a-0162-4b36-8d53-8ee2396c6631 service nova] Lock "874468f0-1d7c-4ba2-b01e-9584c46b956a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:23:27 user nova-compute[75216]: DEBUG nova.compute.manager [req-a3392ad4-830b-4f81-a56c-d8d9552fc331 req-25a6567a-0162-4b36-8d53-8ee2396c6631 service nova] [instance: 874468f0-1d7c-4ba2-b01e-9584c46b956a] No waiting events found dispatching network-vif-plugged-ec14a363-0571-4332-a85e-3194b039c7c3 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 19:23:27 user nova-compute[75216]: WARNING nova.compute.manager [req-a3392ad4-830b-4f81-a56c-d8d9552fc331 req-25a6567a-0162-4b36-8d53-8ee2396c6631 service nova] [instance: 874468f0-1d7c-4ba2-b01e-9584c46b956a] Received unexpected event network-vif-plugged-ec14a363-0571-4332-a85e-3194b039c7c3 for instance with vm_state building and task_state spawning.
Nov 13 19:23:27 user nova-compute[75216]: INFO nova.compute.manager [None req-f6161a3d-b235-4ab2-a082-53a3ebe8577e tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] [instance: 874468f0-1d7c-4ba2-b01e-9584c46b956a] Took 5.54 seconds to build instance.
Nov 13 19:23:27 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-f6161a3d-b235-4ab2-a082-53a3ebe8577e tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Lock "874468f0-1d7c-4ba2-b01e-9584c46b956a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.637s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:23:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:23:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:23:33 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:23:33 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:23:38 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:23:38 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:23:38 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75216) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 19:23:38 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 19:23:38 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 19:23:38 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:23:43 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:23:44 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:23:48 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:23:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:23:50 user nova-compute[75216]: DEBUG nova.compute.manager [req-d5cd80b1-d446-4022-9e0d-6e1fbbc1ab4d req-973dd0c8-11ab-4e91-93ad-55ea148fdbc1 service nova] [instance: 1b8275e3-6ba3-4231-b6a7-79d59b99a724] Received event network-changed-f93b7077-4a76-4af4-b958-6a397ef2fbdd {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:23:50 user nova-compute[75216]: DEBUG nova.compute.manager [req-d5cd80b1-d446-4022-9e0d-6e1fbbc1ab4d req-973dd0c8-11ab-4e91-93ad-55ea148fdbc1 service nova] [instance: 1b8275e3-6ba3-4231-b6a7-79d59b99a724] Refreshing instance network info cache due to event network-changed-f93b7077-4a76-4af4-b958-6a397ef2fbdd. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 19:23:50 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-d5cd80b1-d446-4022-9e0d-6e1fbbc1ab4d req-973dd0c8-11ab-4e91-93ad-55ea148fdbc1 service nova] Acquiring lock "refresh_cache-1b8275e3-6ba3-4231-b6a7-79d59b99a724" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 19:23:50 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-d5cd80b1-d446-4022-9e0d-6e1fbbc1ab4d req-973dd0c8-11ab-4e91-93ad-55ea148fdbc1 service nova] Acquired lock "refresh_cache-1b8275e3-6ba3-4231-b6a7-79d59b99a724" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 19:23:50 user nova-compute[75216]: DEBUG nova.network.neutron [req-d5cd80b1-d446-4022-9e0d-6e1fbbc1ab4d req-973dd0c8-11ab-4e91-93ad-55ea148fdbc1 service nova] [instance: 1b8275e3-6ba3-4231-b6a7-79d59b99a724] Refreshing network info cache for port f93b7077-4a76-4af4-b958-6a397ef2fbdd {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 19:23:50 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-026f7b5f-8337-4d9d-a8fb-004eafb5e3c1 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Acquiring lock "1b8275e3-6ba3-4231-b6a7-79d59b99a724" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:23:50 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-026f7b5f-8337-4d9d-a8fb-004eafb5e3c1 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Lock "1b8275e3-6ba3-4231-b6a7-79d59b99a724" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:23:50 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-026f7b5f-8337-4d9d-a8fb-004eafb5e3c1 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Acquiring lock "1b8275e3-6ba3-4231-b6a7-79d59b99a724-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:23:50 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-026f7b5f-8337-4d9d-a8fb-004eafb5e3c1 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Lock "1b8275e3-6ba3-4231-b6a7-79d59b99a724-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:23:50 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-026f7b5f-8337-4d9d-a8fb-004eafb5e3c1 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Lock "1b8275e3-6ba3-4231-b6a7-79d59b99a724-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:23:50 user nova-compute[75216]: INFO nova.compute.manager [None req-026f7b5f-8337-4d9d-a8fb-004eafb5e3c1 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] [instance: 1b8275e3-6ba3-4231-b6a7-79d59b99a724] Terminating instance
Nov 13 19:23:50 user nova-compute[75216]: DEBUG nova.compute.manager [None req-026f7b5f-8337-4d9d-a8fb-004eafb5e3c1 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] [instance: 1b8275e3-6ba3-4231-b6a7-79d59b99a724] Start destroying the instance on the hypervisor. {{(pid=75216) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 19:23:50 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:23:50 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:23:50 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:23:50 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:23:50 user nova-compute[75216]: DEBUG nova.compute.manager [req-b798d666-5f73-4229-8fde-856aea402d49 req-d1c17c2d-2614-4b61-bcfc-dbafe6361a82 service nova] [instance: 1b8275e3-6ba3-4231-b6a7-79d59b99a724] Received event network-vif-unplugged-f93b7077-4a76-4af4-b958-6a397ef2fbdd {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:23:50 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-b798d666-5f73-4229-8fde-856aea402d49 req-d1c17c2d-2614-4b61-bcfc-dbafe6361a82 service nova] Acquiring lock "1b8275e3-6ba3-4231-b6a7-79d59b99a724-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:23:50 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-b798d666-5f73-4229-8fde-856aea402d49 req-d1c17c2d-2614-4b61-bcfc-dbafe6361a82 service nova] Lock "1b8275e3-6ba3-4231-b6a7-79d59b99a724-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:23:50 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-b798d666-5f73-4229-8fde-856aea402d49 req-d1c17c2d-2614-4b61-bcfc-dbafe6361a82 service nova] Lock "1b8275e3-6ba3-4231-b6a7-79d59b99a724-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:23:50 user nova-compute[75216]: DEBUG nova.compute.manager [req-b798d666-5f73-4229-8fde-856aea402d49 req-d1c17c2d-2614-4b61-bcfc-dbafe6361a82 service nova] [instance: 1b8275e3-6ba3-4231-b6a7-79d59b99a724] No waiting events found dispatching network-vif-unplugged-f93b7077-4a76-4af4-b958-6a397ef2fbdd {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 19:23:50 user nova-compute[75216]: DEBUG nova.compute.manager [req-b798d666-5f73-4229-8fde-856aea402d49 req-d1c17c2d-2614-4b61-bcfc-dbafe6361a82 service nova] [instance: 1b8275e3-6ba3-4231-b6a7-79d59b99a724] Received event network-vif-unplugged-f93b7077-4a76-4af4-b958-6a397ef2fbdd for instance with task_state deleting. {{(pid=75216) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 19:23:50 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:23:50 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:23:50 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 1b8275e3-6ba3-4231-b6a7-79d59b99a724] Instance destroyed successfully.
Nov 13 19:23:50 user nova-compute[75216]: DEBUG nova.objects.instance [None req-026f7b5f-8337-4d9d-a8fb-004eafb5e3c1 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Lazy-loading 'resources' on Instance uuid 1b8275e3-6ba3-4231-b6a7-79d59b99a724 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:23:50 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:23:50 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-026f7b5f-8337-4d9d-a8fb-004eafb5e3c1 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T19:20:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-2100939953',display_name='tempest-TestStampPattern-server-2100939953',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-2100939953',id=44,image_ref='f702e840-1915-4d27-827e-038823a69e8a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHapKYnJox8DhCyPix19DTcs5oKU+V19VrNIaR46tufXvIA+F2UnG19Dx1NagebwmDrx5mO4JLdGpW9E+B7Ex0fbatUl+nUSHveU/X/HEvANxarEVUlRKv5XNJ7vjTh5Qg==',key_name='tempest-TestStampPattern-1280105983',keypairs=<?>,launch_index=0,launched_at=2023-11-13T19:21:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f5c7034cfcc8457eb80e8f1875cd39f5',ramdisk_id='',reservation_id='r-jgj9dm1g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='de2e9a72-2d63-4de6-8d18-a9d7490579a9',image_min_disk='1',image_min_ram='0',image_owner_id='f5c7034cfcc8457eb80e8f1875cd39f5',image_owner_project_name='tempest-TestStampPattern-851121657',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-851121657-project-member',image_user_id='c2bef5032a924d99b8ab2a1677998111',owner_project_name='tempest-TestStampPattern-851121657',owner_user_name='tempest-TestStampPattern-851121657-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T19:21:05Z,user_data=None,user_id='c2bef5032a924d99b8ab2a1677998111',uuid=1b8275e3-6ba3-4231-b6a7-79d59b99a724,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f93b7077-4a76-4af4-b958-6a397ef2fbdd", "address": "fa:16:3e:1d:f3:08", "network": {"id": "913673cd-fbe9-48f6-b922-0fd6cf3b52e2", "bridge": "br-int", "label": "tempest-TestStampPattern-134235743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5c7034cfcc8457eb80e8f1875cd39f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf93b7077-4a", "ovs_interfaceid": "f93b7077-4a76-4af4-b958-6a397ef2fbdd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 19:23:50 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-026f7b5f-8337-4d9d-a8fb-004eafb5e3c1 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Converting VIF {"id": "f93b7077-4a76-4af4-b958-6a397ef2fbdd", "address": "fa:16:3e:1d:f3:08", "network": {"id": "913673cd-fbe9-48f6-b922-0fd6cf3b52e2", "bridge": "br-int", "label": "tempest-TestStampPattern-134235743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5c7034cfcc8457eb80e8f1875cd39f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf93b7077-4a", "ovs_interfaceid": "f93b7077-4a76-4af4-b958-6a397ef2fbdd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 19:23:50 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-026f7b5f-8337-4d9d-a8fb-004eafb5e3c1 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1d:f3:08,bridge_name='br-int',has_traffic_filtering=True,id=f93b7077-4a76-4af4-b958-6a397ef2fbdd,network=Network(913673cd-fbe9-48f6-b922-0fd6cf3b52e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf93b7077-4a') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 19:23:50 user nova-compute[75216]: DEBUG os_vif [None req-026f7b5f-8337-4d9d-a8fb-004eafb5e3c1 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1d:f3:08,bridge_name='br-int',has_traffic_filtering=True,id=f93b7077-4a76-4af4-b958-6a397ef2fbdd,network=Network(913673cd-fbe9-48f6-b922-0fd6cf3b52e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf93b7077-4a') {{(pid=75216) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 19:23:50 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:23:50 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf93b7077-4a, bridge=br-int, if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:23:50 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:23:50 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:23:50 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:23:50 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:23:50 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1e7aab87-1180-42d9-955b-a91e1c175873) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:23:50 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:23:50 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:23:50 user nova-compute[75216]: INFO os_vif [None req-026f7b5f-8337-4d9d-a8fb-004eafb5e3c1 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1d:f3:08,bridge_name='br-int',has_traffic_filtering=True,id=f93b7077-4a76-4af4-b958-6a397ef2fbdd,network=Network(913673cd-fbe9-48f6-b922-0fd6cf3b52e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf93b7077-4a')
Nov 13 19:23:50 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-026f7b5f-8337-4d9d-a8fb-004eafb5e3c1 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] [instance: 1b8275e3-6ba3-4231-b6a7-79d59b99a724] Deleting instance files /opt/stack/data/nova/instances/1b8275e3-6ba3-4231-b6a7-79d59b99a724_del
Nov 13 19:23:50 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-026f7b5f-8337-4d9d-a8fb-004eafb5e3c1 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] [instance: 1b8275e3-6ba3-4231-b6a7-79d59b99a724] Deletion of /opt/stack/data/nova/instances/1b8275e3-6ba3-4231-b6a7-79d59b99a724_del complete
Nov 13 19:23:51 user nova-compute[75216]: DEBUG nova.network.neutron [req-d5cd80b1-d446-4022-9e0d-6e1fbbc1ab4d req-973dd0c8-11ab-4e91-93ad-55ea148fdbc1 service nova] [instance: 1b8275e3-6ba3-4231-b6a7-79d59b99a724] Updated VIF entry in instance network info cache for port f93b7077-4a76-4af4-b958-6a397ef2fbdd. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 19:23:51 user nova-compute[75216]: DEBUG nova.network.neutron [req-d5cd80b1-d446-4022-9e0d-6e1fbbc1ab4d req-973dd0c8-11ab-4e91-93ad-55ea148fdbc1 service nova] [instance: 1b8275e3-6ba3-4231-b6a7-79d59b99a724] Updating instance_info_cache with network_info: [{"id": "f93b7077-4a76-4af4-b958-6a397ef2fbdd", "address": "fa:16:3e:1d:f3:08", "network": {"id": "913673cd-fbe9-48f6-b922-0fd6cf3b52e2", "bridge": "br-int", "label": "tempest-TestStampPattern-134235743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5c7034cfcc8457eb80e8f1875cd39f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf93b7077-4a", "ovs_interfaceid": "f93b7077-4a76-4af4-b958-6a397ef2fbdd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:23:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-d5cd80b1-d446-4022-9e0d-6e1fbbc1ab4d req-973dd0c8-11ab-4e91-93ad-55ea148fdbc1 service nova] Releasing lock "refresh_cache-1b8275e3-6ba3-4231-b6a7-79d59b99a724" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 19:23:51 user nova-compute[75216]: INFO nova.compute.manager [None req-026f7b5f-8337-4d9d-a8fb-004eafb5e3c1 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] [instance: 1b8275e3-6ba3-4231-b6a7-79d59b99a724] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 13 19:23:51 user nova-compute[75216]: DEBUG oslo.service.loopingcall [None req-026f7b5f-8337-4d9d-a8fb-004eafb5e3c1 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75216) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 19:23:51 user nova-compute[75216]: DEBUG nova.compute.manager [-] [instance: 1b8275e3-6ba3-4231-b6a7-79d59b99a724] Deallocating network for instance {{(pid=75216) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 19:23:51 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: 1b8275e3-6ba3-4231-b6a7-79d59b99a724] deallocate_for_instance() {{(pid=75216) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 19:23:51 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:23:51 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:23:51 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: 1b8275e3-6ba3-4231-b6a7-79d59b99a724] Updating instance_info_cache with network_info: [] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:23:51 user nova-compute[75216]: INFO nova.compute.manager [-] [instance: 1b8275e3-6ba3-4231-b6a7-79d59b99a724] Took 0.66 seconds to deallocate network for instance.
Nov 13 19:23:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-026f7b5f-8337-4d9d-a8fb-004eafb5e3c1 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:23:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-026f7b5f-8337-4d9d-a8fb-004eafb5e3c1 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:23:52 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-026f7b5f-8337-4d9d-a8fb-004eafb5e3c1 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 19:23:52 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-026f7b5f-8337-4d9d-a8fb-004eafb5e3c1 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 19:23:52 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-026f7b5f-8337-4d9d-a8fb-004eafb5e3c1 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.167s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:23:52 user nova-compute[75216]: INFO nova.scheduler.client.report [None req-026f7b5f-8337-4d9d-a8fb-004eafb5e3c1 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Deleted allocations for instance 1b8275e3-6ba3-4231-b6a7-79d59b99a724
Nov 13 19:23:52 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-026f7b5f-8337-4d9d-a8fb-004eafb5e3c1 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Lock "1b8275e3-6ba3-4231-b6a7-79d59b99a724" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.026s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:23:52 user nova-compute[75216]: DEBUG nova.compute.manager [req-c31cfa30-4b61-49c2-b5a6-e27b0362c29c req-c671623b-019b-48d9-845c-b6e2b6fa2c5b service nova] [instance: 1b8275e3-6ba3-4231-b6a7-79d59b99a724] Received event network-vif-plugged-f93b7077-4a76-4af4-b958-6a397ef2fbdd {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:23:52 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-c31cfa30-4b61-49c2-b5a6-e27b0362c29c req-c671623b-019b-48d9-845c-b6e2b6fa2c5b service nova] Acquiring lock "1b8275e3-6ba3-4231-b6a7-79d59b99a724-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:23:52 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-c31cfa30-4b61-49c2-b5a6-e27b0362c29c req-c671623b-019b-48d9-845c-b6e2b6fa2c5b service nova] Lock "1b8275e3-6ba3-4231-b6a7-79d59b99a724-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:23:52 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-c31cfa30-4b61-49c2-b5a6-e27b0362c29c req-c671623b-019b-48d9-845c-b6e2b6fa2c5b service nova] Lock "1b8275e3-6ba3-4231-b6a7-79d59b99a724-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:23:52 user nova-compute[75216]: DEBUG nova.compute.manager [req-c31cfa30-4b61-49c2-b5a6-e27b0362c29c req-c671623b-019b-48d9-845c-b6e2b6fa2c5b service nova] [instance: 1b8275e3-6ba3-4231-b6a7-79d59b99a724] No waiting events found dispatching network-vif-plugged-f93b7077-4a76-4af4-b958-6a397ef2fbdd {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 19:23:52 user nova-compute[75216]: WARNING nova.compute.manager [req-c31cfa30-4b61-49c2-b5a6-e27b0362c29c req-c671623b-019b-48d9-845c-b6e2b6fa2c5b service nova] [instance: 1b8275e3-6ba3-4231-b6a7-79d59b99a724] Received unexpected event network-vif-plugged-f93b7077-4a76-4af4-b958-6a397ef2fbdd for instance with vm_state deleted and task_state None.
Nov 13 19:23:52 user nova-compute[75216]: DEBUG nova.compute.manager [req-c31cfa30-4b61-49c2-b5a6-e27b0362c29c req-c671623b-019b-48d9-845c-b6e2b6fa2c5b service nova] [instance: 1b8275e3-6ba3-4231-b6a7-79d59b99a724] Received event network-vif-plugged-f93b7077-4a76-4af4-b958-6a397ef2fbdd {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:23:52 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-c31cfa30-4b61-49c2-b5a6-e27b0362c29c req-c671623b-019b-48d9-845c-b6e2b6fa2c5b service nova] Acquiring lock "1b8275e3-6ba3-4231-b6a7-79d59b99a724-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:23:52 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-c31cfa30-4b61-49c2-b5a6-e27b0362c29c req-c671623b-019b-48d9-845c-b6e2b6fa2c5b service nova] Lock "1b8275e3-6ba3-4231-b6a7-79d59b99a724-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:23:52 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-c31cfa30-4b61-49c2-b5a6-e27b0362c29c req-c671623b-019b-48d9-845c-b6e2b6fa2c5b service nova] Lock "1b8275e3-6ba3-4231-b6a7-79d59b99a724-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:23:52 user nova-compute[75216]: DEBUG nova.compute.manager [req-c31cfa30-4b61-49c2-b5a6-e27b0362c29c req-c671623b-019b-48d9-845c-b6e2b6fa2c5b service nova] [instance: 1b8275e3-6ba3-4231-b6a7-79d59b99a724] No waiting events found dispatching network-vif-plugged-f93b7077-4a76-4af4-b958-6a397ef2fbdd {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 19:23:52 user nova-compute[75216]: WARNING nova.compute.manager [req-c31cfa30-4b61-49c2-b5a6-e27b0362c29c req-c671623b-019b-48d9-845c-b6e2b6fa2c5b service nova] [instance: 1b8275e3-6ba3-4231-b6a7-79d59b99a724] Received unexpected event network-vif-plugged-f93b7077-4a76-4af4-b958-6a397ef2fbdd for instance with vm_state deleted and task_state None.
Nov 13 19:23:52 user nova-compute[75216]: DEBUG nova.compute.manager [req-c31cfa30-4b61-49c2-b5a6-e27b0362c29c req-c671623b-019b-48d9-845c-b6e2b6fa2c5b service nova] [instance: 1b8275e3-6ba3-4231-b6a7-79d59b99a724] Received event network-vif-plugged-f93b7077-4a76-4af4-b958-6a397ef2fbdd {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:23:52 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-c31cfa30-4b61-49c2-b5a6-e27b0362c29c req-c671623b-019b-48d9-845c-b6e2b6fa2c5b service nova] Acquiring lock "1b8275e3-6ba3-4231-b6a7-79d59b99a724-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:23:52 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-c31cfa30-4b61-49c2-b5a6-e27b0362c29c req-c671623b-019b-48d9-845c-b6e2b6fa2c5b service nova] Lock "1b8275e3-6ba3-4231-b6a7-79d59b99a724-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:23:52 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-c31cfa30-4b61-49c2-b5a6-e27b0362c29c req-c671623b-019b-48d9-845c-b6e2b6fa2c5b service nova] Lock "1b8275e3-6ba3-4231-b6a7-79d59b99a724-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:23:52 user nova-compute[75216]: DEBUG nova.compute.manager [req-c31cfa30-4b61-49c2-b5a6-e27b0362c29c req-c671623b-019b-48d9-845c-b6e2b6fa2c5b service nova] [instance: 1b8275e3-6ba3-4231-b6a7-79d59b99a724] No waiting events found dispatching network-vif-plugged-f93b7077-4a76-4af4-b958-6a397ef2fbdd {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 19:23:52 user nova-compute[75216]: WARNING nova.compute.manager [req-c31cfa30-4b61-49c2-b5a6-e27b0362c29c req-c671623b-019b-48d9-845c-b6e2b6fa2c5b service nova] [instance: 1b8275e3-6ba3-4231-b6a7-79d59b99a724] Received unexpected event network-vif-plugged-f93b7077-4a76-4af4-b958-6a397ef2fbdd for instance with vm_state deleted and task_state None.
Nov 13 19:23:52 user nova-compute[75216]: DEBUG nova.compute.manager [req-c31cfa30-4b61-49c2-b5a6-e27b0362c29c req-c671623b-019b-48d9-845c-b6e2b6fa2c5b service nova] [instance: 1b8275e3-6ba3-4231-b6a7-79d59b99a724] Received event network-vif-deleted-f93b7077-4a76-4af4-b958-6a397ef2fbdd {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:23:54 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:23:55 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:24:00 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:24:00 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:24:00 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75216) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 19:24:00 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 19:24:00 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 19:24:00 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:24:05 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:24:06 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:24:10 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:24:13 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:24:15 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:24:15 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:24:17 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:24:17 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75216) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 19:24:18 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:24:18 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:24:18 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:24:18 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:24:18 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:24:18 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Auditing locally available compute resources for user (node: user) {{(pid=75216) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 19:24:18 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/874468f0-1d7c-4ba2-b01e-9584c46b956a/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:24:18 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/874468f0-1d7c-4ba2-b01e-9584c46b956a/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:24:18 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/874468f0-1d7c-4ba2-b01e-9584c46b956a/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:24:18 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/874468f0-1d7c-4ba2-b01e-9584c46b956a/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:24:18 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de2e9a72-2d63-4de6-8d18-a9d7490579a9/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:24:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de2e9a72-2d63-4de6-8d18-a9d7490579a9/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:24:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de2e9a72-2d63-4de6-8d18-a9d7490579a9/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:24:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de2e9a72-2d63-4de6-8d18-a9d7490579a9/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:24:19 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 19:24:19 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 19:24:19 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Hypervisor/Node resource view: name=user free_ram=8839MB free_disk=25.147125244140625GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75216) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 19:24:19 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:24:19 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:24:19 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance de2e9a72-2d63-4de6-8d18-a9d7490579a9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 19:24:19 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance 874468f0-1d7c-4ba2-b01e-9584c46b956a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 19:24:19 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 19:24:19 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 19:24:19 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 19:24:19 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 19:24:19 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Compute_service record updated for user:user {{(pid=75216) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 19:24:19 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.251s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:24:20 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:24:20 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:24:23 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:24:24 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:24:24 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Starting heal instance info cache {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 19:24:24 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Rebuilding the list of instances to heal {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 13 19:24:24 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "refresh_cache-de2e9a72-2d63-4de6-8d18-a9d7490579a9" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 19:24:24 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquired lock "refresh_cache-de2e9a72-2d63-4de6-8d18-a9d7490579a9" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 19:24:24 user nova-compute[75216]: DEBUG nova.network.neutron [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: de2e9a72-2d63-4de6-8d18-a9d7490579a9] Forcefully refreshing network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 19:24:24 user nova-compute[75216]: DEBUG nova.objects.instance [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lazy-loading 'info_cache' on Instance uuid de2e9a72-2d63-4de6-8d18-a9d7490579a9 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:24:24 user nova-compute[75216]: DEBUG nova.network.neutron [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: de2e9a72-2d63-4de6-8d18-a9d7490579a9] Updating instance_info_cache with network_info: [{"id": "1a0628c1-10a7-478a-a86e-0479da381b11", "address": "fa:16:3e:89:5b:db", "network": {"id": "913673cd-fbe9-48f6-b922-0fd6cf3b52e2", "bridge": "br-int", "label": "tempest-TestStampPattern-134235743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5c7034cfcc8457eb80e8f1875cd39f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a0628c1-10", "ovs_interfaceid": "1a0628c1-10a7-478a-a86e-0479da381b11", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:24:24 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Releasing lock "refresh_cache-de2e9a72-2d63-4de6-8d18-a9d7490579a9" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 19:24:24 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: de2e9a72-2d63-4de6-8d18-a9d7490579a9] Updated the network info_cache for instance {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 19:24:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:24:26 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:24:26 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75216) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 19:24:26 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 19:24:26 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 19:24:26 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:24:31 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:24:31 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:24:31 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75216) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 19:24:31 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 19:24:31 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 19:24:31 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:24:36 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:24:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:24:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:24:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75216) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 19:24:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 19:24:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 19:24:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:24:44 user nova-compute[75216]: DEBUG nova.compute.manager [req-47b4528c-f385-48e4-9103-723a0ef309b6 req-3bef44bf-4766-4191-9ee4-6b1d14242232 service nova] [instance: de2e9a72-2d63-4de6-8d18-a9d7490579a9] Received event network-changed-1a0628c1-10a7-478a-a86e-0479da381b11 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:24:44 user nova-compute[75216]: DEBUG nova.compute.manager [req-47b4528c-f385-48e4-9103-723a0ef309b6 req-3bef44bf-4766-4191-9ee4-6b1d14242232 service nova] [instance: de2e9a72-2d63-4de6-8d18-a9d7490579a9] Refreshing instance network info cache due to event network-changed-1a0628c1-10a7-478a-a86e-0479da381b11. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 19:24:44 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-47b4528c-f385-48e4-9103-723a0ef309b6 req-3bef44bf-4766-4191-9ee4-6b1d14242232 service nova] Acquiring lock "refresh_cache-de2e9a72-2d63-4de6-8d18-a9d7490579a9" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 19:24:44 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-47b4528c-f385-48e4-9103-723a0ef309b6 req-3bef44bf-4766-4191-9ee4-6b1d14242232 service nova] Acquired lock "refresh_cache-de2e9a72-2d63-4de6-8d18-a9d7490579a9" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 19:24:44 user nova-compute[75216]: DEBUG nova.network.neutron [req-47b4528c-f385-48e4-9103-723a0ef309b6 req-3bef44bf-4766-4191-9ee4-6b1d14242232 service nova] [instance: de2e9a72-2d63-4de6-8d18-a9d7490579a9] Refreshing network info cache for port 1a0628c1-10a7-478a-a86e-0479da381b11 {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 19:24:44 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-ea36f6f2-dfc1-4666-a902-fe2b4ea06309 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Acquiring lock "de2e9a72-2d63-4de6-8d18-a9d7490579a9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:24:44 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-ea36f6f2-dfc1-4666-a902-fe2b4ea06309 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Lock "de2e9a72-2d63-4de6-8d18-a9d7490579a9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:24:44 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-ea36f6f2-dfc1-4666-a902-fe2b4ea06309 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Acquiring lock "de2e9a72-2d63-4de6-8d18-a9d7490579a9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:24:44 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-ea36f6f2-dfc1-4666-a902-fe2b4ea06309 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Lock "de2e9a72-2d63-4de6-8d18-a9d7490579a9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:24:44 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-ea36f6f2-dfc1-4666-a902-fe2b4ea06309 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Lock "de2e9a72-2d63-4de6-8d18-a9d7490579a9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:24:44 user nova-compute[75216]: INFO nova.compute.manager [None req-ea36f6f2-dfc1-4666-a902-fe2b4ea06309 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] [instance: de2e9a72-2d63-4de6-8d18-a9d7490579a9] Terminating instance
Nov 13 19:24:44 user nova-compute[75216]: DEBUG nova.compute.manager [None req-ea36f6f2-dfc1-4666-a902-fe2b4ea06309 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] [instance: de2e9a72-2d63-4de6-8d18-a9d7490579a9] Start destroying the instance on the hypervisor. {{(pid=75216) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 19:24:44 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:24:44 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:24:44 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:24:44 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:24:44 user nova-compute[75216]: DEBUG nova.network.neutron [req-47b4528c-f385-48e4-9103-723a0ef309b6 req-3bef44bf-4766-4191-9ee4-6b1d14242232 service nova] [instance: de2e9a72-2d63-4de6-8d18-a9d7490579a9] Updated VIF entry in instance network info cache for port 1a0628c1-10a7-478a-a86e-0479da381b11. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 19:24:44 user nova-compute[75216]: DEBUG nova.network.neutron [req-47b4528c-f385-48e4-9103-723a0ef309b6 req-3bef44bf-4766-4191-9ee4-6b1d14242232 service nova] [instance: de2e9a72-2d63-4de6-8d18-a9d7490579a9] Updating instance_info_cache with network_info: [{"id": "1a0628c1-10a7-478a-a86e-0479da381b11", "address": "fa:16:3e:89:5b:db", "network": {"id": "913673cd-fbe9-48f6-b922-0fd6cf3b52e2", "bridge": "br-int", "label": "tempest-TestStampPattern-134235743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5c7034cfcc8457eb80e8f1875cd39f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a0628c1-10", "ovs_interfaceid": "1a0628c1-10a7-478a-a86e-0479da381b11", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:24:44 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-47b4528c-f385-48e4-9103-723a0ef309b6 req-3bef44bf-4766-4191-9ee4-6b1d14242232 service nova] Releasing lock "refresh_cache-de2e9a72-2d63-4de6-8d18-a9d7490579a9" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 19:24:45 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: de2e9a72-2d63-4de6-8d18-a9d7490579a9] Instance destroyed successfully.
Nov 13 19:24:45 user nova-compute[75216]: DEBUG nova.objects.instance [None req-ea36f6f2-dfc1-4666-a902-fe2b4ea06309 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Lazy-loading 'resources' on Instance uuid de2e9a72-2d63-4de6-8d18-a9d7490579a9 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:24:45 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-ea36f6f2-dfc1-4666-a902-fe2b4ea06309 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T19:17:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-744381031',display_name='tempest-TestStampPattern-server-744381031',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-744381031',id=42,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHapKYnJox8DhCyPix19DTcs5oKU+V19VrNIaR46tufXvIA+F2UnG19Dx1NagebwmDrx5mO4JLdGpW9E+B7Ex0fbatUl+nUSHveU/X/HEvANxarEVUlRKv5XNJ7vjTh5Qg==',key_name='tempest-TestStampPattern-1280105983',keypairs=<?>,launch_index=0,launched_at=2023-11-13T19:18:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f5c7034cfcc8457eb80e8f1875cd39f5',ramdisk_id='',reservation_id='r-dd5tfr15',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-851121657',owner_user_name='tempest-TestStampPattern-851121657-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T19:20:56Z,user_data=None,user_id='c2bef5032a924d99b8ab2a1677998111',uuid=de2e9a72-2d63-4de6-8d18-a9d7490579a9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1a0628c1-10a7-478a-a86e-0479da381b11", "address": "fa:16:3e:89:5b:db", "network": {"id": "913673cd-fbe9-48f6-b922-0fd6cf3b52e2", "bridge": "br-int", "label": "tempest-TestStampPattern-134235743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5c7034cfcc8457eb80e8f1875cd39f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a0628c1-10", "ovs_interfaceid": "1a0628c1-10a7-478a-a86e-0479da381b11", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 19:24:45 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-ea36f6f2-dfc1-4666-a902-fe2b4ea06309 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Converting VIF {"id": "1a0628c1-10a7-478a-a86e-0479da381b11", "address": "fa:16:3e:89:5b:db", "network": {"id": "913673cd-fbe9-48f6-b922-0fd6cf3b52e2", "bridge": "br-int", "label": "tempest-TestStampPattern-134235743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5c7034cfcc8457eb80e8f1875cd39f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a0628c1-10", "ovs_interfaceid": "1a0628c1-10a7-478a-a86e-0479da381b11", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 19:24:45 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-ea36f6f2-dfc1-4666-a902-fe2b4ea06309 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:89:5b:db,bridge_name='br-int',has_traffic_filtering=True,id=1a0628c1-10a7-478a-a86e-0479da381b11,network=Network(913673cd-fbe9-48f6-b922-0fd6cf3b52e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a0628c1-10') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 19:24:45 user nova-compute[75216]: DEBUG os_vif [None req-ea36f6f2-dfc1-4666-a902-fe2b4ea06309 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:89:5b:db,bridge_name='br-int',has_traffic_filtering=True,id=1a0628c1-10a7-478a-a86e-0479da381b11,network=Network(913673cd-fbe9-48f6-b922-0fd6cf3b52e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a0628c1-10') {{(pid=75216) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 19:24:45 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:24:45 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1a0628c1-10, bridge=br-int, if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:24:45 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:24:45 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:24:45 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:24:45 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b93497fd-5da5-47d3-9280-32dda2703100) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:24:45 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:24:45 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:24:45 user nova-compute[75216]: INFO os_vif [None req-ea36f6f2-dfc1-4666-a902-fe2b4ea06309 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:89:5b:db,bridge_name='br-int',has_traffic_filtering=True,id=1a0628c1-10a7-478a-a86e-0479da381b11,network=Network(913673cd-fbe9-48f6-b922-0fd6cf3b52e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a0628c1-10')
Nov 13 19:24:45 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-ea36f6f2-dfc1-4666-a902-fe2b4ea06309 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] [instance: de2e9a72-2d63-4de6-8d18-a9d7490579a9] Deleting instance files /opt/stack/data/nova/instances/de2e9a72-2d63-4de6-8d18-a9d7490579a9_del
Nov 13 19:24:45 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-ea36f6f2-dfc1-4666-a902-fe2b4ea06309 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] [instance: de2e9a72-2d63-4de6-8d18-a9d7490579a9] Deletion of /opt/stack/data/nova/instances/de2e9a72-2d63-4de6-8d18-a9d7490579a9_del complete
Nov 13 19:24:45 user nova-compute[75216]: INFO nova.compute.manager [None req-ea36f6f2-dfc1-4666-a902-fe2b4ea06309 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] [instance: de2e9a72-2d63-4de6-8d18-a9d7490579a9] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 13 19:24:45 user nova-compute[75216]: DEBUG oslo.service.loopingcall [None req-ea36f6f2-dfc1-4666-a902-fe2b4ea06309 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75216) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 19:24:45 user nova-compute[75216]: DEBUG nova.compute.manager [-] [instance: de2e9a72-2d63-4de6-8d18-a9d7490579a9] Deallocating network for instance {{(pid=75216) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 19:24:45 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: de2e9a72-2d63-4de6-8d18-a9d7490579a9] deallocate_for_instance() {{(pid=75216) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 19:24:45 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: de2e9a72-2d63-4de6-8d18-a9d7490579a9] Updating instance_info_cache with network_info: [] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:24:45 user nova-compute[75216]: INFO nova.compute.manager [-] [instance: de2e9a72-2d63-4de6-8d18-a9d7490579a9] Took 0.40 seconds to deallocate network for instance.
Nov 13 19:24:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-ea36f6f2-dfc1-4666-a902-fe2b4ea06309 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:24:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-ea36f6f2-dfc1-4666-a902-fe2b4ea06309 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:24:45 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-ea36f6f2-dfc1-4666-a902-fe2b4ea06309 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 19:24:45 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-ea36f6f2-dfc1-4666-a902-fe2b4ea06309 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 19:24:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-ea36f6f2-dfc1-4666-a902-fe2b4ea06309 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.140s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:24:45 user nova-compute[75216]: INFO nova.scheduler.client.report [None req-ea36f6f2-dfc1-4666-a902-fe2b4ea06309 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Deleted allocations for instance de2e9a72-2d63-4de6-8d18-a9d7490579a9
Nov 13 19:24:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-ea36f6f2-dfc1-4666-a902-fe2b4ea06309 tempest-TestStampPattern-851121657 tempest-TestStampPattern-851121657-project-member] Lock "de2e9a72-2d63-4de6-8d18-a9d7490579a9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.598s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:24:46 user nova-compute[75216]: DEBUG nova.compute.manager [req-68698480-9a32-4007-9112-0f3bc631a5a1 req-7b67ac82-e123-48b7-b100-01c9b84fe870 service nova] [instance: de2e9a72-2d63-4de6-8d18-a9d7490579a9] Received event network-vif-unplugged-1a0628c1-10a7-478a-a86e-0479da381b11 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:24:46 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-68698480-9a32-4007-9112-0f3bc631a5a1 req-7b67ac82-e123-48b7-b100-01c9b84fe870 service nova] Acquiring lock "de2e9a72-2d63-4de6-8d18-a9d7490579a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:24:46 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-68698480-9a32-4007-9112-0f3bc631a5a1 req-7b67ac82-e123-48b7-b100-01c9b84fe870 service nova] Lock "de2e9a72-2d63-4de6-8d18-a9d7490579a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:24:46 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-68698480-9a32-4007-9112-0f3bc631a5a1 req-7b67ac82-e123-48b7-b100-01c9b84fe870 service nova] Lock "de2e9a72-2d63-4de6-8d18-a9d7490579a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:24:46 user nova-compute[75216]: DEBUG nova.compute.manager [req-68698480-9a32-4007-9112-0f3bc631a5a1 req-7b67ac82-e123-48b7-b100-01c9b84fe870 service nova] [instance: de2e9a72-2d63-4de6-8d18-a9d7490579a9] No waiting events found dispatching network-vif-unplugged-1a0628c1-10a7-478a-a86e-0479da381b11 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 19:24:46 user nova-compute[75216]: WARNING nova.compute.manager [req-68698480-9a32-4007-9112-0f3bc631a5a1 req-7b67ac82-e123-48b7-b100-01c9b84fe870 service nova] [instance: de2e9a72-2d63-4de6-8d18-a9d7490579a9] Received unexpected event network-vif-unplugged-1a0628c1-10a7-478a-a86e-0479da381b11 for instance with vm_state deleted and task_state None.
Nov 13 19:24:46 user nova-compute[75216]: DEBUG nova.compute.manager [req-68698480-9a32-4007-9112-0f3bc631a5a1 req-7b67ac82-e123-48b7-b100-01c9b84fe870 service nova] [instance: de2e9a72-2d63-4de6-8d18-a9d7490579a9] Received event network-vif-plugged-1a0628c1-10a7-478a-a86e-0479da381b11 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:24:46 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-68698480-9a32-4007-9112-0f3bc631a5a1 req-7b67ac82-e123-48b7-b100-01c9b84fe870 service nova] Acquiring lock "de2e9a72-2d63-4de6-8d18-a9d7490579a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:24:46 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-68698480-9a32-4007-9112-0f3bc631a5a1 req-7b67ac82-e123-48b7-b100-01c9b84fe870 service nova] Lock "de2e9a72-2d63-4de6-8d18-a9d7490579a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:24:46 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-68698480-9a32-4007-9112-0f3bc631a5a1 req-7b67ac82-e123-48b7-b100-01c9b84fe870 service nova] Lock "de2e9a72-2d63-4de6-8d18-a9d7490579a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:24:46 user nova-compute[75216]: DEBUG nova.compute.manager [req-68698480-9a32-4007-9112-0f3bc631a5a1 req-7b67ac82-e123-48b7-b100-01c9b84fe870 service nova] [instance: de2e9a72-2d63-4de6-8d18-a9d7490579a9] No waiting events found dispatching network-vif-plugged-1a0628c1-10a7-478a-a86e-0479da381b11 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 19:24:46 user nova-compute[75216]: WARNING nova.compute.manager [req-68698480-9a32-4007-9112-0f3bc631a5a1 req-7b67ac82-e123-48b7-b100-01c9b84fe870 service nova] [instance: de2e9a72-2d63-4de6-8d18-a9d7490579a9] Received unexpected event network-vif-plugged-1a0628c1-10a7-478a-a86e-0479da381b11 for instance with vm_state deleted and task_state None.
Nov 13 19:24:46 user nova-compute[75216]: DEBUG nova.compute.manager [req-68698480-9a32-4007-9112-0f3bc631a5a1 req-7b67ac82-e123-48b7-b100-01c9b84fe870 service nova] [instance: de2e9a72-2d63-4de6-8d18-a9d7490579a9] Received event network-vif-deleted-1a0628c1-10a7-478a-a86e-0479da381b11 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:24:50 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:24:55 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:25:00 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:25:05 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:25:06 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:25:10 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:25:12 user nova-compute[75216]: DEBUG nova.compute.manager [req-c9ef0f22-061d-470d-8771-c4605e27e11e req-39b97b05-1d82-420d-b73e-994261ea9240 service nova] [instance: 874468f0-1d7c-4ba2-b01e-9584c46b956a] Received event network-changed-ec14a363-0571-4332-a85e-3194b039c7c3 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:25:12 user nova-compute[75216]: DEBUG nova.compute.manager [req-c9ef0f22-061d-470d-8771-c4605e27e11e req-39b97b05-1d82-420d-b73e-994261ea9240 service nova] [instance: 874468f0-1d7c-4ba2-b01e-9584c46b956a] Refreshing instance network info cache due to event network-changed-ec14a363-0571-4332-a85e-3194b039c7c3. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 19:25:12 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-c9ef0f22-061d-470d-8771-c4605e27e11e req-39b97b05-1d82-420d-b73e-994261ea9240 service nova] Acquiring lock "refresh_cache-874468f0-1d7c-4ba2-b01e-9584c46b956a" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 19:25:12 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-c9ef0f22-061d-470d-8771-c4605e27e11e req-39b97b05-1d82-420d-b73e-994261ea9240 service nova] Acquired lock "refresh_cache-874468f0-1d7c-4ba2-b01e-9584c46b956a" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 19:25:12 user nova-compute[75216]: DEBUG nova.network.neutron [req-c9ef0f22-061d-470d-8771-c4605e27e11e req-39b97b05-1d82-420d-b73e-994261ea9240 service nova] [instance: 874468f0-1d7c-4ba2-b01e-9584c46b956a] Refreshing network info cache for port ec14a363-0571-4332-a85e-3194b039c7c3 {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 19:25:13 user nova-compute[75216]: DEBUG nova.network.neutron [req-c9ef0f22-061d-470d-8771-c4605e27e11e req-39b97b05-1d82-420d-b73e-994261ea9240 service nova] [instance: 874468f0-1d7c-4ba2-b01e-9584c46b956a] Updated VIF entry in instance network info cache for port ec14a363-0571-4332-a85e-3194b039c7c3. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 19:25:13 user nova-compute[75216]: DEBUG nova.network.neutron [req-c9ef0f22-061d-470d-8771-c4605e27e11e req-39b97b05-1d82-420d-b73e-994261ea9240 service nova] [instance: 874468f0-1d7c-4ba2-b01e-9584c46b956a] Updating instance_info_cache with network_info: [{"id": "ec14a363-0571-4332-a85e-3194b039c7c3", "address": "fa:16:3e:40:41:53", "network": {"id": "9dcbadf2-6b5e-41f1-88a3-17a579ad1bad", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-926239573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d06cae29094846f1817036dc761a565d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec14a363-05", "ovs_interfaceid": "ec14a363-0571-4332-a85e-3194b039c7c3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:25:13 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-c9ef0f22-061d-470d-8771-c4605e27e11e req-39b97b05-1d82-420d-b73e-994261ea9240 service nova] Releasing lock "refresh_cache-874468f0-1d7c-4ba2-b01e-9584c46b956a" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 19:25:14 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e962500c-f771-4de9-b5e9-18b8adf95124 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Acquiring lock "874468f0-1d7c-4ba2-b01e-9584c46b956a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:25:14 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e962500c-f771-4de9-b5e9-18b8adf95124 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Lock "874468f0-1d7c-4ba2-b01e-9584c46b956a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:25:14 user nova-compute[75216]: DEBUG nova.objects.instance [None req-e962500c-f771-4de9-b5e9-18b8adf95124 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Lazy-loading 'flavor' on Instance uuid 874468f0-1d7c-4ba2-b01e-9584c46b956a {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:25:14 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e962500c-f771-4de9-b5e9-18b8adf95124 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Lock "874468f0-1d7c-4ba2-b01e-9584c46b956a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:25:14 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:25:14 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e962500c-f771-4de9-b5e9-18b8adf95124 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Acquiring lock "874468f0-1d7c-4ba2-b01e-9584c46b956a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:25:14 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e962500c-f771-4de9-b5e9-18b8adf95124 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Lock "874468f0-1d7c-4ba2-b01e-9584c46b956a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:25:14 user nova-compute[75216]: INFO nova.compute.manager [None req-e962500c-f771-4de9-b5e9-18b8adf95124 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] [instance: 874468f0-1d7c-4ba2-b01e-9584c46b956a] Attaching volume a8fe0205-12e4-4f6f-bf2f-721d3c007030 to /dev/vdb
Nov 13 19:25:14 user nova-compute[75216]: DEBUG os_brick.utils [None req-e962500c-f771-4de9-b5e9-18b8adf95124 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 19:25:14 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:25:14 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:25:14 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[19bce574-6f5d-4ed7-a598-d164cfb4a12f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aea6fcfe14b9\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:25:14 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:25:14 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:25:14 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a852354-13ce-48fa-af19-217058e50a8a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:25:14 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:25:14 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:25:14 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[de5ce8e2-606d-41a3-837f-db2e29bb2d57]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:25:14 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[95dd444a-0b63-4d95-81ca-8c0a718b5572]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:25:14 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-e962500c-f771-4de9-b5e9-18b8adf95124 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Running cmd (subprocess): nvme version {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:25:14 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-e962500c-f771-4de9-b5e9-18b8adf95124 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] 'nvme version' failed. Not Retrying. {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 19:25:14 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e962500c-f771-4de9-b5e9-18b8adf95124 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] nvme not present on system {{(pid=75216) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 19:25:14 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:25:14 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 19:25:14 user nova-compute[75216]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 19:25:14 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[307bfe86-a303-464c-a6d3-5fe48bcba21d]: (4, '') {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:25:14 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-e962500c-f771-4de9-b5e9-18b8adf95124 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75216) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 19:25:14 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-e962500c-f771-4de9-b5e9-18b8adf95124 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 19:25:14 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-e962500c-f771-4de9-b5e9-18b8adf95124 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] LIGHTOS: no hostnqn found. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 19:25:14 user nova-compute[75216]: DEBUG os_brick.utils [None req-e962500c-f771-4de9-b5e9-18b8adf95124 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aea6fcfe14b9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 19:25:14 user nova-compute[75216]: DEBUG nova.virt.block_device [None req-e962500c-f771-4de9-b5e9-18b8adf95124 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] [instance: 874468f0-1d7c-4ba2-b01e-9584c46b956a] Updating existing volume attachment record: 258a77a5-b79e-40b5-abc8-e59fdb29a4ae {{(pid=75216) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 19:25:15 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:25:15 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:25:17 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:25:18 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:25:18 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75216) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 19:25:18 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e962500c-f771-4de9-b5e9-18b8adf95124 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] [instance: 874468f0-1d7c-4ba2-b01e-9584c46b956a] Calling os-brick to attach iSCSI Volume {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 19:25:18 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e962500c-f771-4de9-b5e9-18b8adf95124 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3a8669e40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a8fe0205-12e4-4f6f-bf2f-721d3c007030', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fSulVPGL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 19:25:18 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-e962500c-f771-4de9-b5e9-18b8adf95124 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 19:25:18 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-e962500c-f771-4de9-b5e9-18b8adf95124 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 19:25:18 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-e962500c-f771-4de9-b5e9-18b8adf95124 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 19:25:18 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-e962500c-f771-4de9-b5e9-18b8adf95124 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 19:25:18 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-e962500c-f771-4de9-b5e9-18b8adf95124 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a8fe0205-12e4-4f6f-bf2f-721d3c007030" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 19:25:18 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-e962500c-f771-4de9-b5e9-18b8adf95124 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a8fe0205-12e4-4f6f-bf2f-721d3c007030" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 19:25:18 user nova-compute[75216]: INFO os_brick.initiator.connectors.iscsi [None req-e962500c-f771-4de9-b5e9-18b8adf95124 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 19:25:18 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8fe0205-12e4-4f6f-bf2f-721d3c007030 -p 172.16.0.220:3260 {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:25:18 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8fe0205-12e4-4f6f-bf2f-721d3c007030 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:25:18 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[22a22627-acdb-4c0b-80d9-8f3df2edc1a6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:25:18 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e962500c-f771-4de9-b5e9-18b8adf95124 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 19:25:18 user nova-compute[75216]:  {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:25:18 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8fe0205-12e4-4f6f-bf2f-721d3c007030 -p 172.16.0.220:3260 --interface default --op new {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:25:18 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8fe0205-12e4-4f6f-bf2f-721d3c007030 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:25:18 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[c37f09cd-7590-46a9-82a1-8b6db937a2ae]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a8fe0205-12e4-4f6f-bf2f-721d3c007030] added\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:25:18 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e962500c-f771-4de9-b5e9-18b8adf95124 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a8fe0205-12e4-4f6f-bf2f-721d3c007030] added
Nov 13 19:25:18 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:25:18 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8fe0205-12e4-4f6f-bf2f-721d3c007030 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:25:18 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8fe0205-12e4-4f6f-bf2f-721d3c007030 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:25:18 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a72a780-02bf-4878-9aaf-9d63b5af0f3a]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:25:18 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e962500c-f771-4de9-b5e9-18b8adf95124 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:25:18 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8fe0205-12e4-4f6f-bf2f-721d3c007030 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:25:18 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8fe0205-12e4-4f6f-bf2f-721d3c007030 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:25:18 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7e2d808-2e83-4cd6-92e8-42025be01ab0]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:25:18 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e962500c-f771-4de9-b5e9-18b8adf95124 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:25:18 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8fe0205-12e4-4f6f-bf2f-721d3c007030 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fSulVPGL {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:25:18 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8fe0205-12e4-4f6f-bf2f-721d3c007030 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fSulVPGL" returned: 0 in 0.016s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:25:18 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[54456d6b-4bb0-42ab-bc74-b5db83a24067]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:25:18 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e962500c-f771-4de9-b5e9-18b8adf95124 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fSulVPGL'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:25:18 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8fe0205-12e4-4f6f-bf2f-721d3c007030 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:25:18 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8fe0205-12e4-4f6f-bf2f-721d3c007030 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:25:18 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[3492b6b4-e953-4fff-853e-58aea5b9bb85]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:25:18 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e962500c-f771-4de9-b5e9-18b8adf95124 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:25:18 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:25:18 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:25:18 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[e02959d2-d594-4140-b4e0-425e7f4ca88d]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:25:18 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e962500c-f771-4de9-b5e9-18b8adf95124 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 13 19:25:18 user nova-compute[75216]:  {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 19:25:18 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e962500c-f771-4de9-b5e9-18b8adf95124 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 13 19:25:18 user nova-compute[75216]:  {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 19:25:18 user nova-compute[75216]: WARNING os_brick.initiator.connectors.iscsi [None req-e962500c-f771-4de9-b5e9-18b8adf95124 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 13 19:25:18 user nova-compute[75216]: 
Nov 13 19:25:18 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8fe0205-12e4-4f6f-bf2f-721d3c007030 -p 172.16.0.220:3260 --login {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:25:18 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8fe0205-12e4-4f6f-bf2f-721d3c007030 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:25:18 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d8ff4e0-686d-49c7-9db8-4e2a870a74af]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a8fe0205-12e4-4f6f-bf2f-721d3c007030, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a8fe0205-12e4-4f6f-bf2f-721d3c007030, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:25:18 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e962500c-f771-4de9-b5e9-18b8adf95124 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a8fe0205-12e4-4f6f-bf2f-721d3c007030, portal: 172.16.0.220,3260]
Nov 13 19:25:18 user nova-compute[75216]: Login to [iface: default, target: iqn.2010-10.org.openstack:a8fe0205-12e4-4f6f-bf2f-721d3c007030, portal: 172.16.0.220,3260] successful.
Nov 13 19:25:18 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:25:18 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8fe0205-12e4-4f6f-bf2f-721d3c007030 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:25:18 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8fe0205-12e4-4f6f-bf2f-721d3c007030 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:25:18 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d9007f7-ffe3-4e1e-b5ca-f99aacb3c1e8]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:25:18 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e962500c-f771-4de9-b5e9-18b8adf95124 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:25:18 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:25:18 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:25:18 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[1256940b-705a-4b46-b1c6-f71136c7f859]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8fe0205-12e4-4f6f-bf2f-721d3c007030 (non-flash)\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:25:18 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e962500c-f771-4de9-b5e9-18b8adf95124 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8fe0205-12e4-4f6f-bf2f-721d3c007030 (non-flash)
Nov 13 19:25:18 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 19:25:18 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e962500c-f771-4de9-b5e9-18b8adf95124 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8fe0205-12e4-4f6f-bf2f-721d3c007030 (non-flash)
Nov 13 19:25:18 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 19:25:18 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-e962500c-f771-4de9-b5e9-18b8adf95124 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a8fe0205-12e4-4f6f-bf2f-721d3c007030" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.248s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 19:25:18 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e962500c-f771-4de9-b5e9-18b8adf95124 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Connected to 172.16.0.220:3260 {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 19:25:18 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-e962500c-f771-4de9-b5e9-18b8adf95124 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] HCTL ('33', '-', '-', 0) found on session 53 with lun 0 {{(pid=75216) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 19:25:18 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-e962500c-f771-4de9-b5e9-18b8adf95124 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75216) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 19:25:18 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:25:18 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.024s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:25:18 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[f63a9ec6-f73f-406d-9347-a13cf229fbf2]: (4, ('- - 0', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:25:18 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-e962500c-f771-4de9-b5e9-18b8adf95124 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: None {{(pid=75216) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 19:25:19 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:25:19 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:25:19 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-e962500c-f771-4de9-b5e9-18b8adf95124 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75216) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 19:25:19 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e962500c-f771-4de9-b5e9-18b8adf95124 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:a8fe0205-12e4-4f6f-bf2f-721d3c007030', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fSulVPGL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 19:25:19 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-e962500c-f771-4de9-b5e9-18b8adf95124 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.287s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 19:25:19 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e962500c-f771-4de9-b5e9-18b8adf95124 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] <== connect_volume: return (1289ms) {'type': 'block', 'scsi_wwn': '23635363433396534', 'path': '/dev/sdb'} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 19:25:19 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e962500c-f771-4de9-b5e9-18b8adf95124 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] [instance: 874468f0-1d7c-4ba2-b01e-9584c46b956a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23635363433396534', 'path': '/dev/sdb'} {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 19:25:19 user nova-compute[75216]: DEBUG nova.objects.instance [None req-e962500c-f771-4de9-b5e9-18b8adf95124 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Lazy-loading 'flavor' on Instance uuid 874468f0-1d7c-4ba2-b01e-9584c46b956a {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:25:19 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-e962500c-f771-4de9-b5e9-18b8adf95124 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] attach device xml: <disk type="block" device="disk">
Nov 13 19:25:19 user nova-compute[75216]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 19:25:19 user nova-compute[75216]:   <source dev="/dev/sdb"/>
Nov 13 19:25:19 user nova-compute[75216]:   <target dev="vdb" bus="virtio"/>
Nov 13 19:25:19 user nova-compute[75216]:   <serial>a8fe0205-12e4-4f6f-bf2f-721d3c007030</serial>
Nov 13 19:25:19 user nova-compute[75216]: </disk>
Nov 13 19:25:19 user nova-compute[75216]:  {{(pid=75216) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 13 19:25:20 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:25:20 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-e962500c-f771-4de9-b5e9-18b8adf95124 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 19:25:20 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-e962500c-f771-4de9-b5e9-18b8adf95124 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 19:25:20 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-e962500c-f771-4de9-b5e9-18b8adf95124 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] No VIF found with MAC fa:16:3e:40:41:53, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 19:25:20 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:25:20 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:25:20 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:25:20 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:25:20 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Auditing locally available compute resources for user (node: user) {{(pid=75216) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 19:25:20 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/874468f0-1d7c-4ba2-b01e-9584c46b956a/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:25:20 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e962500c-f771-4de9-b5e9-18b8adf95124 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Lock "874468f0-1d7c-4ba2-b01e-9584c46b956a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.197s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:25:20 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/874468f0-1d7c-4ba2-b01e-9584c46b956a/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:25:20 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/874468f0-1d7c-4ba2-b01e-9584c46b956a/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:25:20 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/874468f0-1d7c-4ba2-b01e-9584c46b956a/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:25:20 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 19:25:21 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 19:25:21 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 19:25:21 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Hypervisor/Node resource view: name=user free_ram=8920MB free_disk=25.271446228027344GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75216) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 19:25:21 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:25:21 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:25:21 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-8f4f7967-e583-45a4-85cc-75ef89bcf591 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Acquiring lock "874468f0-1d7c-4ba2-b01e-9584c46b956a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:25:21 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-8f4f7967-e583-45a4-85cc-75ef89bcf591 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Lock "874468f0-1d7c-4ba2-b01e-9584c46b956a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:25:21 user nova-compute[75216]: INFO nova.compute.manager [None req-8f4f7967-e583-45a4-85cc-75ef89bcf591 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] [instance: 874468f0-1d7c-4ba2-b01e-9584c46b956a] Detaching volume a8fe0205-12e4-4f6f-bf2f-721d3c007030
Nov 13 19:25:21 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance 874468f0-1d7c-4ba2-b01e-9584c46b956a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 19:25:21 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 19:25:21 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 19:25:21 user nova-compute[75216]: INFO nova.virt.block_device [None req-8f4f7967-e583-45a4-85cc-75ef89bcf591 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] [instance: 874468f0-1d7c-4ba2-b01e-9584c46b956a] Attempting to driver detach volume a8fe0205-12e4-4f6f-bf2f-721d3c007030 from mountpoint /dev/vdb
Nov 13 19:25:21 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-8f4f7967-e583-45a4-85cc-75ef89bcf591 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Attempting to detach device vdb from instance 874468f0-1d7c-4ba2-b01e-9584c46b956a from the persistent domain config. {{(pid=75216) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 13 19:25:21 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-8f4f7967-e583-45a4-85cc-75ef89bcf591 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 19:25:21 user nova-compute[75216]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 19:25:21 user nova-compute[75216]:   <source dev="/dev/sdb"/>
Nov 13 19:25:21 user nova-compute[75216]:   <target dev="vdb" bus="virtio"/>
Nov 13 19:25:21 user nova-compute[75216]:   <serial>a8fe0205-12e4-4f6f-bf2f-721d3c007030</serial>
Nov 13 19:25:21 user nova-compute[75216]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 19:25:21 user nova-compute[75216]: </disk>
Nov 13 19:25:21 user nova-compute[75216]:  {{(pid=75216) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 19:25:21 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-8f4f7967-e583-45a4-85cc-75ef89bcf591 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Successfully detached device vdb from instance 874468f0-1d7c-4ba2-b01e-9584c46b956a from the persistent domain config.
Nov 13 19:25:21 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-8f4f7967-e583-45a4-85cc-75ef89bcf591 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 874468f0-1d7c-4ba2-b01e-9584c46b956a from the live domain config. {{(pid=75216) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 13 19:25:21 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-8f4f7967-e583-45a4-85cc-75ef89bcf591 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 19:25:21 user nova-compute[75216]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 19:25:21 user nova-compute[75216]:   <source dev="/dev/sdb"/>
Nov 13 19:25:21 user nova-compute[75216]:   <target dev="vdb" bus="virtio"/>
Nov 13 19:25:21 user nova-compute[75216]:   <serial>a8fe0205-12e4-4f6f-bf2f-721d3c007030</serial>
Nov 13 19:25:21 user nova-compute[75216]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 19:25:21 user nova-compute[75216]: </disk>
Nov 13 19:25:21 user nova-compute[75216]:  {{(pid=75216) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 19:25:21 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 19:25:21 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 19:25:21 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Compute_service record updated for user:user {{(pid=75216) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 19:25:21 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.220s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:25:22 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-8f4f7967-e583-45a4-85cc-75ef89bcf591 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 874468f0-1d7c-4ba2-b01e-9584c46b956a {{(pid=75216) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 13 19:25:22 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:25:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:25:25 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:25:25 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Starting heal instance info cache {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 19:25:25 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "refresh_cache-874468f0-1d7c-4ba2-b01e-9584c46b956a" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 19:25:25 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquired lock "refresh_cache-874468f0-1d7c-4ba2-b01e-9584c46b956a" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 19:25:25 user nova-compute[75216]: DEBUG nova.network.neutron [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: 874468f0-1d7c-4ba2-b01e-9584c46b956a] Forcefully refreshing network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 19:25:25 user nova-compute[75216]: DEBUG nova.network.neutron [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: 874468f0-1d7c-4ba2-b01e-9584c46b956a] Updating instance_info_cache with network_info: [{"id": "ec14a363-0571-4332-a85e-3194b039c7c3", "address": "fa:16:3e:40:41:53", "network": {"id": "9dcbadf2-6b5e-41f1-88a3-17a579ad1bad", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-926239573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d06cae29094846f1817036dc761a565d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec14a363-05", "ovs_interfaceid": "ec14a363-0571-4332-a85e-3194b039c7c3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:25:25 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Releasing lock "refresh_cache-874468f0-1d7c-4ba2-b01e-9584c46b956a" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 19:25:25 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: 874468f0-1d7c-4ba2-b01e-9584c46b956a] Updated the network info_cache for instance {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 19:25:25 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:25:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:25:30 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:25:34 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:25:35 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:25:36 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:25:38 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:25:40 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:25:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:25:42 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-8f4f7967-e583-45a4-85cc-75ef89bcf591 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 874468f0-1d7c-4ba2-b01e-9584c46b956a is timed out.
Nov 13 19:25:42 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-8f4f7967-e583-45a4-85cc-75ef89bcf591 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Successfully detached device vdb from instance 874468f0-1d7c-4ba2-b01e-9584c46b956a from the live domain config.
Nov 13 19:25:42 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8f4f7967-e583-45a4-85cc-75ef89bcf591 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] [instance: 874468f0-1d7c-4ba2-b01e-9584c46b956a] calling os-brick to detach iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 19:25:42 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f4f7967-e583-45a4-85cc-75ef89bcf591 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3a8669e40>, {'target_iqn': 'iqn.2010-10.org.openstack:a8fe0205-12e4-4f6f-bf2f-721d3c007030', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fSulVPGL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 19:25:42 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-8f4f7967-e583-45a4-85cc-75ef89bcf591 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 19:25:42 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-8f4f7967-e583-45a4-85cc-75ef89bcf591 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 19:25:42 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-8f4f7967-e583-45a4-85cc-75ef89bcf591 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 19:25:42 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:25:42 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:25:42 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e30af84-8065-492e-9985-47b588e5a950]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a8fe0205-12e4-4f6f-bf2f-721d3c007030\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:25:42 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f4f7967-e583-45a4-85cc-75ef89bcf591 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 19:25:42 user nova-compute[75216]: No targets found.
Nov 13 19:25:42 user nova-compute[75216]: iSNS:
Nov 13 19:25:42 user nova-compute[75216]: No targets found.
Nov 13 19:25:42 user nova-compute[75216]: STATIC:
Nov 13 19:25:42 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:a8fe0205-12e4-4f6f-bf2f-721d3c007030
Nov 13 19:25:42 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 19:25:42 user nova-compute[75216]:                 Iface Name: default
Nov 13 19:25:42 user nova-compute[75216]: FIRMWARE:
Nov 13 19:25:42 user nova-compute[75216]: No targets found.
Nov 13 19:25:42 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 19:25:42 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f4f7967-e583-45a4-85cc-75ef89bcf591 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 19:25:42 user nova-compute[75216]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 19:25:42 user nova-compute[75216]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75216) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 19:25:42 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f4f7967-e583-45a4-85cc-75ef89bcf591 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a8fe0205-12e4-4f6f-bf2f-721d3c007030', 0)] {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 19:25:42 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:25:42 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:25:42 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[5575189c-ef84-4796-bd3c-5aba78b2c0ea]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a8fe0205-12e4-4f6f-bf2f-721d3c007030\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:25:42 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:25:42 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:25:42 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[c46fc649-171f-4a3d-93a8-15812273632b]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8fe0205-12e4-4f6f-bf2f-721d3c007030 (non-flash)\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:25:42 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f4f7967-e583-45a4-85cc-75ef89bcf591 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8fe0205-12e4-4f6f-bf2f-721d3c007030 (non-flash)
Nov 13 19:25:42 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 19:25:42 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f4f7967-e583-45a4-85cc-75ef89bcf591 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8fe0205-12e4-4f6f-bf2f-721d3c007030 (non-flash)
Nov 13 19:25:42 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 19:25:42 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f4f7967-e583-45a4-85cc-75ef89bcf591 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe3a81dfa30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a8fe0205-12e4-4f6f-bf2f-721d3c007030'): ({'sdb'}, set())}) {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 19:25:42 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-8f4f7967-e583-45a4-85cc-75ef89bcf591 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Removing single pathed devices sdb {{(pid=75216) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 19:25:42 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:25:42 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:25:42 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[354c00cb-75a4-41b7-95eb-623b6ec855ec]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:25:42 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:25:42 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:25:42 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[db53a1c4-3cd3-4c3a-b7c2-16c42f1c1ee3]: (4, ('ok\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:25:42 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-8f4f7967-e583-45a4-85cc-75ef89bcf591 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Flushing IO for device /dev/sdb {{(pid=75216) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 19:25:42 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:25:42 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:25:42 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9ae8327-5837-4d77-b612-7543c51e52f7]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:25:42 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-8f4f7967-e583-45a4-85cc-75ef89bcf591 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75216) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 19:25:42 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:25:42 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:25:42 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[391ed36e-129d-484c-bf73-47e854ca01fd]: (4, ('1', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:25:42 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-8f4f7967-e583-45a4-85cc-75ef89bcf591 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 19:25:42 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-8f4f7967-e583-45a4-85cc-75ef89bcf591 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] SCSI volumes sdb have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 19:25:42 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f4f7967-e583-45a4-85cc-75ef89bcf591 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a8fe0205-12e4-4f6f-bf2f-721d3c007030')] {{(pid=75216) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 19:25:42 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8fe0205-12e4-4f6f-bf2f-721d3c007030 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:25:42 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8fe0205-12e4-4f6f-bf2f-721d3c007030 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:25:42 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[86c34e80-88a8-4e4b-9b7b-124e633d855c]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:25:42 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f4f7967-e583-45a4-85cc-75ef89bcf591 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:25:42 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8fe0205-12e4-4f6f-bf2f-721d3c007030 -p 172.16.0.220:3260 --logout {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:25:42 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8fe0205-12e4-4f6f-bf2f-721d3c007030 -p 172.16.0.220:3260 --logout" returned: 0 in 0.041s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:25:42 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc569e52-b6dd-4e67-986c-2ac398922023]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:a8fe0205-12e4-4f6f-bf2f-721d3c007030, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:a8fe0205-12e4-4f6f-bf2f-721d3c007030, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:25:42 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f4f7967-e583-45a4-85cc-75ef89bcf591 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:a8fe0205-12e4-4f6f-bf2f-721d3c007030, portal: 172.16.0.220,3260]
Nov 13 19:25:42 user nova-compute[75216]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:a8fe0205-12e4-4f6f-bf2f-721d3c007030, portal: 172.16.0.220,3260] successful.
Nov 13 19:25:42 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:25:42 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8fe0205-12e4-4f6f-bf2f-721d3c007030 -p 172.16.0.220:3260 --op delete {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:25:42 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8fe0205-12e4-4f6f-bf2f-721d3c007030 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:25:42 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[f670ec26-d289-4c9d-bb89-8d9df716dbe9]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:25:42 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f4f7967-e583-45a4-85cc-75ef89bcf591 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:25:42 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-8f4f7967-e583-45a4-85cc-75ef89bcf591 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.270s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 19:25:42 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f4f7967-e583-45a4-85cc-75ef89bcf591 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] <== disconnect_volume: return (272ms) None {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 19:25:42 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8f4f7967-e583-45a4-85cc-75ef89bcf591 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] [instance: 874468f0-1d7c-4ba2-b01e-9584c46b956a] Disconnected iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 19:25:43 user nova-compute[75216]: DEBUG nova.objects.instance [None req-8f4f7967-e583-45a4-85cc-75ef89bcf591 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Lazy-loading 'flavor' on Instance uuid 874468f0-1d7c-4ba2-b01e-9584c46b956a {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:25:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-8f4f7967-e583-45a4-85cc-75ef89bcf591 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Lock "874468f0-1d7c-4ba2-b01e-9584c46b956a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.596s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:25:44 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:25:45 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:25:47 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:25:48 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:25:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:25:50 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:25:52 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:25:53 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:25:54 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:25:55 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:25:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-0e9c5421-b18e-40db-86ba-45454d2607c1 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Acquiring lock "4a77197f-6077-410e-8aa2-42d017b89381" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:25:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-0e9c5421-b18e-40db-86ba-45454d2607c1 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Lock "4a77197f-6077-410e-8aa2-42d017b89381" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:25:58 user nova-compute[75216]: DEBUG nova.compute.manager [None req-0e9c5421-b18e-40db-86ba-45454d2607c1 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 4a77197f-6077-410e-8aa2-42d017b89381] Starting instance... {{(pid=75216) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 19:25:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-0e9c5421-b18e-40db-86ba-45454d2607c1 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:25:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-0e9c5421-b18e-40db-86ba-45454d2607c1 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:25:58 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-0e9c5421-b18e-40db-86ba-45454d2607c1 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75216) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 19:25:58 user nova-compute[75216]: INFO nova.compute.claims [None req-0e9c5421-b18e-40db-86ba-45454d2607c1 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 4a77197f-6077-410e-8aa2-42d017b89381] Claim successful on node user
Nov 13 19:25:58 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-0e9c5421-b18e-40db-86ba-45454d2607c1 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 19:25:58 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-0e9c5421-b18e-40db-86ba-45454d2607c1 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 19:25:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-0e9c5421-b18e-40db-86ba-45454d2607c1 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.240s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:25:58 user nova-compute[75216]: DEBUG nova.compute.manager [None req-0e9c5421-b18e-40db-86ba-45454d2607c1 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 4a77197f-6077-410e-8aa2-42d017b89381] Start building networks asynchronously for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 19:25:58 user nova-compute[75216]: DEBUG nova.compute.manager [None req-0e9c5421-b18e-40db-86ba-45454d2607c1 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 4a77197f-6077-410e-8aa2-42d017b89381] Allocating IP information in the background. {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 19:25:58 user nova-compute[75216]: DEBUG nova.network.neutron [None req-0e9c5421-b18e-40db-86ba-45454d2607c1 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 4a77197f-6077-410e-8aa2-42d017b89381] allocate_for_instance() {{(pid=75216) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 19:25:58 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-0e9c5421-b18e-40db-86ba-45454d2607c1 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 4a77197f-6077-410e-8aa2-42d017b89381] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 19:25:58 user nova-compute[75216]: DEBUG nova.compute.manager [None req-0e9c5421-b18e-40db-86ba-45454d2607c1 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 4a77197f-6077-410e-8aa2-42d017b89381] Start building block device mappings for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 19:25:58 user nova-compute[75216]: DEBUG nova.policy [None req-0e9c5421-b18e-40db-86ba-45454d2607c1 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bfc6b02c16664b8dbea3a6f2088ec385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1951a52e7c4ef5ac6a0d9d5380d41a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75216) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 19:25:58 user nova-compute[75216]: INFO nova.virt.block_device [None req-0e9c5421-b18e-40db-86ba-45454d2607c1 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 4a77197f-6077-410e-8aa2-42d017b89381] Booting with volume snapshot b0f4bbc1-8e99-48e5-9816-6004d6d2f935 at /dev/vda
Nov 13 19:25:59 user nova-compute[75216]: DEBUG nova.network.neutron [None req-0e9c5421-b18e-40db-86ba-45454d2607c1 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 4a77197f-6077-410e-8aa2-42d017b89381] Successfully created port: 41af8c88-b21c-44bd-abd4-0e31fcaa174b {{(pid=75216) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 19:25:59 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:26:00 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:26:00 user nova-compute[75216]: DEBUG nova.network.neutron [None req-0e9c5421-b18e-40db-86ba-45454d2607c1 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 4a77197f-6077-410e-8aa2-42d017b89381] Successfully updated port: 41af8c88-b21c-44bd-abd4-0e31fcaa174b {{(pid=75216) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 19:26:00 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-0e9c5421-b18e-40db-86ba-45454d2607c1 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Acquiring lock "refresh_cache-4a77197f-6077-410e-8aa2-42d017b89381" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 19:26:00 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-0e9c5421-b18e-40db-86ba-45454d2607c1 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Acquired lock "refresh_cache-4a77197f-6077-410e-8aa2-42d017b89381" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 19:26:00 user nova-compute[75216]: DEBUG nova.network.neutron [None req-0e9c5421-b18e-40db-86ba-45454d2607c1 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 4a77197f-6077-410e-8aa2-42d017b89381] Building network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 19:26:00 user nova-compute[75216]: DEBUG nova.compute.manager [req-345c8760-fac6-4a77-8667-db99b8941f91 req-f9cc451c-f4f5-4e99-a529-9ec0fdec43df service nova] [instance: 4a77197f-6077-410e-8aa2-42d017b89381] Received event network-changed-41af8c88-b21c-44bd-abd4-0e31fcaa174b {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:26:00 user nova-compute[75216]: DEBUG nova.compute.manager [req-345c8760-fac6-4a77-8667-db99b8941f91 req-f9cc451c-f4f5-4e99-a529-9ec0fdec43df service nova] [instance: 4a77197f-6077-410e-8aa2-42d017b89381] Refreshing instance network info cache due to event network-changed-41af8c88-b21c-44bd-abd4-0e31fcaa174b. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 19:26:00 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-345c8760-fac6-4a77-8667-db99b8941f91 req-f9cc451c-f4f5-4e99-a529-9ec0fdec43df service nova] Acquiring lock "refresh_cache-4a77197f-6077-410e-8aa2-42d017b89381" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 19:26:00 user nova-compute[75216]: DEBUG nova.network.neutron [None req-0e9c5421-b18e-40db-86ba-45454d2607c1 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 4a77197f-6077-410e-8aa2-42d017b89381] Instance cache missing network info. {{(pid=75216) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 19:26:00 user nova-compute[75216]: DEBUG nova.network.neutron [None req-0e9c5421-b18e-40db-86ba-45454d2607c1 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 4a77197f-6077-410e-8aa2-42d017b89381] Updating instance_info_cache with network_info: [{"id": "41af8c88-b21c-44bd-abd4-0e31fcaa174b", "address": "fa:16:3e:77:eb:03", "network": {"id": "5881a45c-3f28-48c4-aa8e-045b3bea3227", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1651070715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a1951a52e7c4ef5ac6a0d9d5380d41a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41af8c88-b2", "ovs_interfaceid": "41af8c88-b21c-44bd-abd4-0e31fcaa174b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:26:00 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-0e9c5421-b18e-40db-86ba-45454d2607c1 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Releasing lock "refresh_cache-4a77197f-6077-410e-8aa2-42d017b89381" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 19:26:00 user nova-compute[75216]: DEBUG nova.compute.manager [None req-0e9c5421-b18e-40db-86ba-45454d2607c1 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 4a77197f-6077-410e-8aa2-42d017b89381] Instance network_info: |[{"id": "41af8c88-b21c-44bd-abd4-0e31fcaa174b", "address": "fa:16:3e:77:eb:03", "network": {"id": "5881a45c-3f28-48c4-aa8e-045b3bea3227", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1651070715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a1951a52e7c4ef5ac6a0d9d5380d41a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41af8c88-b2", "ovs_interfaceid": "41af8c88-b21c-44bd-abd4-0e31fcaa174b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 19:26:00 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-345c8760-fac6-4a77-8667-db99b8941f91 req-f9cc451c-f4f5-4e99-a529-9ec0fdec43df service nova] Acquired lock "refresh_cache-4a77197f-6077-410e-8aa2-42d017b89381" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 19:26:00 user nova-compute[75216]: DEBUG nova.network.neutron [req-345c8760-fac6-4a77-8667-db99b8941f91 req-f9cc451c-f4f5-4e99-a529-9ec0fdec43df service nova] [instance: 4a77197f-6077-410e-8aa2-42d017b89381] Refreshing network info cache for port 41af8c88-b21c-44bd-abd4-0e31fcaa174b {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 19:26:00 user nova-compute[75216]: DEBUG nova.network.neutron [req-345c8760-fac6-4a77-8667-db99b8941f91 req-f9cc451c-f4f5-4e99-a529-9ec0fdec43df service nova] [instance: 4a77197f-6077-410e-8aa2-42d017b89381] Updated VIF entry in instance network info cache for port 41af8c88-b21c-44bd-abd4-0e31fcaa174b. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 19:26:00 user nova-compute[75216]: DEBUG nova.network.neutron [req-345c8760-fac6-4a77-8667-db99b8941f91 req-f9cc451c-f4f5-4e99-a529-9ec0fdec43df service nova] [instance: 4a77197f-6077-410e-8aa2-42d017b89381] Updating instance_info_cache with network_info: [{"id": "41af8c88-b21c-44bd-abd4-0e31fcaa174b", "address": "fa:16:3e:77:eb:03", "network": {"id": "5881a45c-3f28-48c4-aa8e-045b3bea3227", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1651070715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a1951a52e7c4ef5ac6a0d9d5380d41a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41af8c88-b2", "ovs_interfaceid": "41af8c88-b21c-44bd-abd4-0e31fcaa174b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:26:00 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-345c8760-fac6-4a77-8667-db99b8941f91 req-f9cc451c-f4f5-4e99-a529-9ec0fdec43df service nova] Releasing lock "refresh_cache-4a77197f-6077-410e-8aa2-42d017b89381" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 19:26:04 user nova-compute[75216]: DEBUG os_brick.utils [None req-0e9c5421-b18e-40db-86ba-45454d2607c1 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 19:26:04 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:26:04 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:26:04 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dd23466-7b8b-4dde-b05d-b141d5c35355]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aea6fcfe14b9\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:26:04 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:26:04 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:26:04 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[54b4f486-d330-42b7-929a-02e2aba3ccdb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:26:04 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:26:04 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:26:04 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[2933d963-01f2-468c-ab59-a53ad23029ec]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:26:04 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a69200f-9205-409e-a583-0c1f95106f49]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:26:04 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-0e9c5421-b18e-40db-86ba-45454d2607c1 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Running cmd (subprocess): nvme version {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:26:04 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-0e9c5421-b18e-40db-86ba-45454d2607c1 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] 'nvme version' failed. Not Retrying. {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 19:26:04 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0e9c5421-b18e-40db-86ba-45454d2607c1 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] nvme not present on system {{(pid=75216) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 19:26:04 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:26:04 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 19:26:04 user nova-compute[75216]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 19:26:04 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[afef0a47-c24f-4a9f-8cf6-648caf08e41b]: (4, '') {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:26:04 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-0e9c5421-b18e-40db-86ba-45454d2607c1 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75216) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 19:26:04 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-0e9c5421-b18e-40db-86ba-45454d2607c1 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 19:26:04 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-0e9c5421-b18e-40db-86ba-45454d2607c1 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] LIGHTOS: no hostnqn found. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 19:26:04 user nova-compute[75216]: DEBUG os_brick.utils [None req-0e9c5421-b18e-40db-86ba-45454d2607c1 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aea6fcfe14b9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 19:26:04 user nova-compute[75216]: DEBUG nova.virt.block_device [None req-0e9c5421-b18e-40db-86ba-45454d2607c1 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 4a77197f-6077-410e-8aa2-42d017b89381] Updating existing volume attachment record: af24e159-8cf5-44a9-a6ad-a08215b5fd8f {{(pid=75216) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 19:26:04 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:26:05 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:26:07 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:26:08 user nova-compute[75216]: DEBUG nova.compute.manager [None req-0e9c5421-b18e-40db-86ba-45454d2607c1 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 4a77197f-6077-410e-8aa2-42d017b89381] Start spawning the instance on the hypervisor. {{(pid=75216) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 19:26:08 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-0e9c5421-b18e-40db-86ba-45454d2607c1 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 4a77197f-6077-410e-8aa2-42d017b89381] Creating instance directory {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 19:26:08 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-0e9c5421-b18e-40db-86ba-45454d2607c1 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 4a77197f-6077-410e-8aa2-42d017b89381] Creating image(s)
Nov 13 19:26:08 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-0e9c5421-b18e-40db-86ba-45454d2607c1 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 4a77197f-6077-410e-8aa2-42d017b89381] Did not create local disks {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 13 19:26:08 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-0e9c5421-b18e-40db-86ba-45454d2607c1 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 4a77197f-6077-410e-8aa2-42d017b89381] Ensure instance console log exists: /opt/stack/data/nova/instances/4a77197f-6077-410e-8aa2-42d017b89381/console.log {{(pid=75216) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 19:26:08 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-0e9c5421-b18e-40db-86ba-45454d2607c1 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:26:08 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-0e9c5421-b18e-40db-86ba-45454d2607c1 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:26:08 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-0e9c5421-b18e-40db-86ba-45454d2607c1 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:26:08 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-0e9c5421-b18e-40db-86ba-45454d2607c1 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 4a77197f-6077-410e-8aa2-42d017b89381] Start _get_guest_xml network_info=[{"id": "41af8c88-b21c-44bd-abd4-0e31fcaa174b", "address": "fa:16:3e:77:eb:03", "network": {"id": "5881a45c-3f28-48c4-aa8e-045b3bea3227", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1651070715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a1951a52e7c4ef5ac6a0d9d5380d41a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41af8c88-b2", "ovs_interfaceid": "41af8c88-b21c-44bd-abd4-0e31fcaa174b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e9bd5a2a-da46-433a-8342-22366d96fc65', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hbPyvAIg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4a77197f-6077-410e-8aa2-42d017b89381', 'attached_at': '', 'detached_at': '', 'volume_id': 'e9bd5a2a-da46-433a-8342-22366d96fc65', 'serial': 'e9bd5a2a-da46-433a-8342-22366d96fc65'}, 'attachment_id': 'af24e159-8cf5-44a9-a6ad-a08215b5fd8f', 'guest_format': None, 'mount_device': '/dev/vda', 'delete_on_termination': True, 'boot_index': 0, 'volume_type': None} {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 19:26:08 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-0e9c5421-b18e-40db-86ba-45454d2607c1 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 19:26:08 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-0e9c5421-b18e-40db-86ba-45454d2607c1 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 19:26:08 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-0e9c5421-b18e-40db-86ba-45454d2607c1 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 19:26:08 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-0e9c5421-b18e-40db-86ba-45454d2607c1 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] CPU controller missing on host. {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 19:26:08 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-0e9c5421-b18e-40db-86ba-45454d2607c1 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 19:26:08 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-0e9c5421-b18e-40db-86ba-45454d2607c1 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] CPU controller found on host. {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 19:26:08 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-0e9c5421-b18e-40db-86ba-45454d2607c1 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75216) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 19:26:08 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-0e9c5421-b18e-40db-86ba-45454d2607c1 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T18:40:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 19:26:08 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-0e9c5421-b18e-40db-86ba-45454d2607c1 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Flavor limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 19:26:08 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-0e9c5421-b18e-40db-86ba-45454d2607c1 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Image limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 19:26:08 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-0e9c5421-b18e-40db-86ba-45454d2607c1 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Flavor pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 19:26:08 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-0e9c5421-b18e-40db-86ba-45454d2607c1 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Image pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 19:26:08 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-0e9c5421-b18e-40db-86ba-45454d2607c1 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 19:26:08 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-0e9c5421-b18e-40db-86ba-45454d2607c1 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 19:26:08 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-0e9c5421-b18e-40db-86ba-45454d2607c1 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 19:26:08 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-0e9c5421-b18e-40db-86ba-45454d2607c1 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Got 1 possible topologies {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 19:26:08 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-0e9c5421-b18e-40db-86ba-45454d2607c1 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 19:26:08 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-0e9c5421-b18e-40db-86ba-45454d2607c1 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 19:26:08 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e9c5421-b18e-40db-86ba-45454d2607c1 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 4a77197f-6077-410e-8aa2-42d017b89381] Calling os-brick to attach iSCSI Volume {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 19:26:08 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e9c5421-b18e-40db-86ba-45454d2607c1 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3a8669e40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e9bd5a2a-da46-433a-8342-22366d96fc65', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hbPyvAIg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 19:26:08 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-0e9c5421-b18e-40db-86ba-45454d2607c1 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 19:26:08 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-0e9c5421-b18e-40db-86ba-45454d2607c1 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 19:26:08 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-0e9c5421-b18e-40db-86ba-45454d2607c1 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 19:26:08 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-0e9c5421-b18e-40db-86ba-45454d2607c1 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 19:26:08 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-0e9c5421-b18e-40db-86ba-45454d2607c1 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e9bd5a2a-da46-433a-8342-22366d96fc65" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 19:26:08 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-0e9c5421-b18e-40db-86ba-45454d2607c1 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e9bd5a2a-da46-433a-8342-22366d96fc65" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 19:26:08 user nova-compute[75216]: INFO os_brick.initiator.connectors.iscsi [None req-0e9c5421-b18e-40db-86ba-45454d2607c1 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 19:26:08 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9bd5a2a-da46-433a-8342-22366d96fc65 -p 172.16.0.220:3260 {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:26:08 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9bd5a2a-da46-433a-8342-22366d96fc65 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:26:08 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b1a8fab-973b-4e58-9ca3-51698dc64912]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:26:08 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e9c5421-b18e-40db-86ba-45454d2607c1 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 19:26:08 user nova-compute[75216]:  {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:26:08 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9bd5a2a-da46-433a-8342-22366d96fc65 -p 172.16.0.220:3260 --interface default --op new {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:26:08 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9bd5a2a-da46-433a-8342-22366d96fc65 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:26:08 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b9b0923-a09e-42f3-80cd-8f634f311a34]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e9bd5a2a-da46-433a-8342-22366d96fc65] added\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:26:08 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e9c5421-b18e-40db-86ba-45454d2607c1 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e9bd5a2a-da46-433a-8342-22366d96fc65] added
Nov 13 19:26:08 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:26:08 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9bd5a2a-da46-433a-8342-22366d96fc65 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:26:08 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9bd5a2a-da46-433a-8342-22366d96fc65 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:26:08 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[f961a9ed-9aa6-4fc8-9c03-a7b800422d89]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:26:08 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e9c5421-b18e-40db-86ba-45454d2607c1 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:26:08 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9bd5a2a-da46-433a-8342-22366d96fc65 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:26:08 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9bd5a2a-da46-433a-8342-22366d96fc65 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:26:08 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[75f678a3-c8d4-4537-9edf-aae4a03860a3]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:26:08 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e9c5421-b18e-40db-86ba-45454d2607c1 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:26:08 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9bd5a2a-da46-433a-8342-22366d96fc65 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hbPyvAIg {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:26:08 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9bd5a2a-da46-433a-8342-22366d96fc65 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hbPyvAIg" returned: 0 in 0.023s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:26:08 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[357c9d22-6dd1-4022-997c-c3de18507ceb]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:26:08 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e9c5421-b18e-40db-86ba-45454d2607c1 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hbPyvAIg'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:26:08 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9bd5a2a-da46-433a-8342-22366d96fc65 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:26:08 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9bd5a2a-da46-433a-8342-22366d96fc65 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.039s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:26:08 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[e282467f-ac51-44c8-b31b-f561027dca0c]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:26:08 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e9c5421-b18e-40db-86ba-45454d2607c1 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:26:08 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:26:08 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:26:08 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[b07698e2-b2c4-49ab-bdb7-afcfd9d64a04]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:26:08 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e9c5421-b18e-40db-86ba-45454d2607c1 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 13 19:26:08 user nova-compute[75216]:  {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 19:26:08 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e9c5421-b18e-40db-86ba-45454d2607c1 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 13 19:26:08 user nova-compute[75216]:  {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 19:26:08 user nova-compute[75216]: WARNING os_brick.initiator.connectors.iscsi [None req-0e9c5421-b18e-40db-86ba-45454d2607c1 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 13 19:26:08 user nova-compute[75216]: 
Nov 13 19:26:08 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9bd5a2a-da46-433a-8342-22366d96fc65 -p 172.16.0.220:3260 --login {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:26:08 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9bd5a2a-da46-433a-8342-22366d96fc65 -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:26:08 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[1554e0f8-bf1f-4de3-91ce-083c0d8a485a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e9bd5a2a-da46-433a-8342-22366d96fc65, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e9bd5a2a-da46-433a-8342-22366d96fc65, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:26:08 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e9c5421-b18e-40db-86ba-45454d2607c1 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e9bd5a2a-da46-433a-8342-22366d96fc65, portal: 172.16.0.220,3260]
Nov 13 19:26:08 user nova-compute[75216]: Login to [iface: default, target: iqn.2010-10.org.openstack:e9bd5a2a-da46-433a-8342-22366d96fc65, portal: 172.16.0.220,3260] successful.
Nov 13 19:26:08 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:26:08 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9bd5a2a-da46-433a-8342-22366d96fc65 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:26:08 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9bd5a2a-da46-433a-8342-22366d96fc65 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:26:08 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[221f35d9-b5f5-4a99-a079-12f081108f91]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:26:08 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e9c5421-b18e-40db-86ba-45454d2607c1 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:26:08 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:26:08 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:26:08 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[efb44348-b662-4d6f-949e-55eae83fc638]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9bd5a2a-da46-433a-8342-22366d96fc65 (non-flash)\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:26:08 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e9c5421-b18e-40db-86ba-45454d2607c1 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9bd5a2a-da46-433a-8342-22366d96fc65 (non-flash)
Nov 13 19:26:08 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 19:26:08 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e9c5421-b18e-40db-86ba-45454d2607c1 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9bd5a2a-da46-433a-8342-22366d96fc65 (non-flash)
Nov 13 19:26:08 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 19:26:08 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-0e9c5421-b18e-40db-86ba-45454d2607c1 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e9bd5a2a-da46-433a-8342-22366d96fc65" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.272s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 19:26:08 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e9c5421-b18e-40db-86ba-45454d2607c1 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Connected to 172.16.0.220:3260 {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 19:26:08 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-0e9c5421-b18e-40db-86ba-45454d2607c1 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] HCTL ('33', '-', '-', 0) found on session 54 with lun 0 {{(pid=75216) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 19:26:08 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-0e9c5421-b18e-40db-86ba-45454d2607c1 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75216) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 19:26:08 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:26:08 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:26:08 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1c1b6e2-7739-4cf7-ba33-c531ed5633d1]: (4, ('- - 0', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:26:08 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-0e9c5421-b18e-40db-86ba-45454d2607c1 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Searching for a device in session 54 and hctl ['33', '*', '*', 0] yield: None {{(pid=75216) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 19:26:09 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:26:09 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-0e9c5421-b18e-40db-86ba-45454d2607c1 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Searching for a device in session 54 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75216) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 19:26:09 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e9c5421-b18e-40db-86ba-45454d2607c1 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:e9bd5a2a-da46-433a-8342-22366d96fc65', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hbPyvAIg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 19:26:09 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-0e9c5421-b18e-40db-86ba-45454d2607c1 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.300s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 19:26:09 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e9c5421-b18e-40db-86ba-45454d2607c1 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] <== connect_volume: return (1301ms) {'type': 'block', 'scsi_wwn': '23232613931613662', 'path': '/dev/sdb'} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 19:26:09 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e9c5421-b18e-40db-86ba-45454d2607c1 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 4a77197f-6077-410e-8aa2-42d017b89381] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23232613931613662', 'path': '/dev/sdb'} {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 19:26:09 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-0e9c5421-b18e-40db-86ba-45454d2607c1 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T19:25:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-402224028',display_name='tempest-TestVolumeBootPattern-server-402224028',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-402224028',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3a1951a52e7c4ef5ac6a0d9d5380d41a',ramdisk_id='',reservation_id='r-9skjwm4x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1444343509',owner_user_name='tempest-TestVolumeBootPattern-1444343509-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T19:25:59Z,user_data=None,user_id='bfc6b02c16664b8dbea3a6f2088ec385',uuid=4a77197f-6077-410e-8aa2-42d017b89381,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "41af8c88-b21c-44bd-abd4-0e31fcaa174b", "address": "fa:16:3e:77:eb:03", "network": {"id": "5881a45c-3f28-48c4-aa8e-045b3bea3227", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1651070715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a1951a52e7c4ef5ac6a0d9d5380d41a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41af8c88-b2", "ovs_interfaceid": "41af8c88-b21c-44bd-abd4-0e31fcaa174b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75216) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 19:26:09 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-0e9c5421-b18e-40db-86ba-45454d2607c1 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Converting VIF {"id": "41af8c88-b21c-44bd-abd4-0e31fcaa174b", "address": "fa:16:3e:77:eb:03", "network": {"id": "5881a45c-3f28-48c4-aa8e-045b3bea3227", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1651070715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a1951a52e7c4ef5ac6a0d9d5380d41a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41af8c88-b2", "ovs_interfaceid": "41af8c88-b21c-44bd-abd4-0e31fcaa174b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 19:26:09 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-0e9c5421-b18e-40db-86ba-45454d2607c1 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:eb:03,bridge_name='br-int',has_traffic_filtering=True,id=41af8c88-b21c-44bd-abd4-0e31fcaa174b,network=Network(5881a45c-3f28-48c4-aa8e-045b3bea3227),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41af8c88-b2') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 19:26:09 user nova-compute[75216]: DEBUG nova.objects.instance [None req-0e9c5421-b18e-40db-86ba-45454d2607c1 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Lazy-loading 'pci_devices' on Instance uuid 4a77197f-6077-410e-8aa2-42d017b89381 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:26:09 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-0e9c5421-b18e-40db-86ba-45454d2607c1 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 4a77197f-6077-410e-8aa2-42d017b89381] End _get_guest_xml xml=<domain type="kvm">
Nov 13 19:26:09 user nova-compute[75216]:   <uuid>4a77197f-6077-410e-8aa2-42d017b89381</uuid>
Nov 13 19:26:09 user nova-compute[75216]:   <name>instance-0000002e</name>
Nov 13 19:26:09 user nova-compute[75216]:   <memory>524288</memory>
Nov 13 19:26:09 user nova-compute[75216]:   <vcpu>1</vcpu>
Nov 13 19:26:09 user nova-compute[75216]:   <metadata>
Nov 13 19:26:09 user nova-compute[75216]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 19:26:09 user nova-compute[75216]:       <nova:package version="0.0.0"/>
Nov 13 19:26:09 user nova-compute[75216]:       <nova:name>tempest-TestVolumeBootPattern-server-402224028</nova:name>
Nov 13 19:26:09 user nova-compute[75216]:       <nova:creationTime>2023-11-13 19:26:08</nova:creationTime>
Nov 13 19:26:09 user nova-compute[75216]:       <nova:flavor name="m1.tiny">
Nov 13 19:26:09 user nova-compute[75216]:         <nova:memory>512</nova:memory>
Nov 13 19:26:09 user nova-compute[75216]:         <nova:disk>1</nova:disk>
Nov 13 19:26:09 user nova-compute[75216]:         <nova:swap>0</nova:swap>
Nov 13 19:26:09 user nova-compute[75216]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 19:26:09 user nova-compute[75216]:         <nova:vcpus>1</nova:vcpus>
Nov 13 19:26:09 user nova-compute[75216]:       </nova:flavor>
Nov 13 19:26:09 user nova-compute[75216]:       <nova:owner>
Nov 13 19:26:09 user nova-compute[75216]:         <nova:user uuid="bfc6b02c16664b8dbea3a6f2088ec385">tempest-TestVolumeBootPattern-1444343509-project-member</nova:user>
Nov 13 19:26:09 user nova-compute[75216]:         <nova:project uuid="3a1951a52e7c4ef5ac6a0d9d5380d41a">tempest-TestVolumeBootPattern-1444343509</nova:project>
Nov 13 19:26:09 user nova-compute[75216]:       </nova:owner>
Nov 13 19:26:09 user nova-compute[75216]:       <nova:ports>
Nov 13 19:26:09 user nova-compute[75216]:         <nova:port uuid="41af8c88-b21c-44bd-abd4-0e31fcaa174b">
Nov 13 19:26:09 user nova-compute[75216]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 13 19:26:09 user nova-compute[75216]:         </nova:port>
Nov 13 19:26:09 user nova-compute[75216]:       </nova:ports>
Nov 13 19:26:09 user nova-compute[75216]:     </nova:instance>
Nov 13 19:26:09 user nova-compute[75216]:   </metadata>
Nov 13 19:26:09 user nova-compute[75216]:   <sysinfo type="smbios">
Nov 13 19:26:09 user nova-compute[75216]:     <system>
Nov 13 19:26:09 user nova-compute[75216]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 19:26:09 user nova-compute[75216]:       <entry name="product">OpenStack Nova</entry>
Nov 13 19:26:09 user nova-compute[75216]:       <entry name="version">0.0.0</entry>
Nov 13 19:26:09 user nova-compute[75216]:       <entry name="serial">4a77197f-6077-410e-8aa2-42d017b89381</entry>
Nov 13 19:26:09 user nova-compute[75216]:       <entry name="uuid">4a77197f-6077-410e-8aa2-42d017b89381</entry>
Nov 13 19:26:09 user nova-compute[75216]:       <entry name="family">Virtual Machine</entry>
Nov 13 19:26:09 user nova-compute[75216]:     </system>
Nov 13 19:26:09 user nova-compute[75216]:   </sysinfo>
Nov 13 19:26:09 user nova-compute[75216]:   <os>
Nov 13 19:26:09 user nova-compute[75216]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 19:26:09 user nova-compute[75216]:     <boot dev="hd"/>
Nov 13 19:26:09 user nova-compute[75216]:     <smbios mode="sysinfo"/>
Nov 13 19:26:09 user nova-compute[75216]:   </os>
Nov 13 19:26:09 user nova-compute[75216]:   <features>
Nov 13 19:26:09 user nova-compute[75216]:     <acpi/>
Nov 13 19:26:09 user nova-compute[75216]:     <apic/>
Nov 13 19:26:09 user nova-compute[75216]:     <vmcoreinfo/>
Nov 13 19:26:09 user nova-compute[75216]:   </features>
Nov 13 19:26:09 user nova-compute[75216]:   <clock offset="utc">
Nov 13 19:26:09 user nova-compute[75216]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 19:26:09 user nova-compute[75216]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 19:26:09 user nova-compute[75216]:     <timer name="hpet" present="no"/>
Nov 13 19:26:09 user nova-compute[75216]:   </clock>
Nov 13 19:26:09 user nova-compute[75216]:   <cpu mode="custom" match="exact">
Nov 13 19:26:09 user nova-compute[75216]:     <model>Nehalem</model>
Nov 13 19:26:09 user nova-compute[75216]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 19:26:09 user nova-compute[75216]:   </cpu>
Nov 13 19:26:09 user nova-compute[75216]:   <devices>
Nov 13 19:26:09 user nova-compute[75216]:     <disk type="block" device="disk">
Nov 13 19:26:09 user nova-compute[75216]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 19:26:09 user nova-compute[75216]:       <source dev="/dev/sdb"/>
Nov 13 19:26:09 user nova-compute[75216]:       <target dev="vda" bus="virtio"/>
Nov 13 19:26:09 user nova-compute[75216]:       <serial>e9bd5a2a-da46-433a-8342-22366d96fc65</serial>
Nov 13 19:26:09 user nova-compute[75216]:     </disk>
Nov 13 19:26:09 user nova-compute[75216]:     <interface type="ethernet">
Nov 13 19:26:09 user nova-compute[75216]:       <mac address="fa:16:3e:77:eb:03"/>
Nov 13 19:26:09 user nova-compute[75216]:       <model type="virtio"/>
Nov 13 19:26:09 user nova-compute[75216]:       <mtu size="1442"/>
Nov 13 19:26:09 user nova-compute[75216]:       <target dev="tap41af8c88-b2"/>
Nov 13 19:26:09 user nova-compute[75216]:     </interface>
Nov 13 19:26:09 user nova-compute[75216]:     <serial type="pty">
Nov 13 19:26:09 user nova-compute[75216]:       <log file="/opt/stack/data/nova/instances/4a77197f-6077-410e-8aa2-42d017b89381/console.log" append="off"/>
Nov 13 19:26:09 user nova-compute[75216]:     </serial>
Nov 13 19:26:09 user nova-compute[75216]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 19:26:09 user nova-compute[75216]:     <video>
Nov 13 19:26:09 user nova-compute[75216]:       <model type="virtio"/>
Nov 13 19:26:09 user nova-compute[75216]:     </video>
Nov 13 19:26:09 user nova-compute[75216]:     <rng model="virtio">
Nov 13 19:26:09 user nova-compute[75216]:       <backend model="random">/dev/urandom</backend>
Nov 13 19:26:09 user nova-compute[75216]:     </rng>
Nov 13 19:26:09 user nova-compute[75216]:     <controller type="usb" index="0" model="none"/>
Nov 13 19:26:09 user nova-compute[75216]:     <memballoon model="virtio">
Nov 13 19:26:09 user nova-compute[75216]:       <stats period="10"/>
Nov 13 19:26:09 user nova-compute[75216]:     </memballoon>
Nov 13 19:26:09 user nova-compute[75216]:   </devices>
Nov 13 19:26:09 user nova-compute[75216]: </domain>
Nov 13 19:26:09 user nova-compute[75216]:  {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 19:26:09 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-0e9c5421-b18e-40db-86ba-45454d2607c1 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T19:25:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-402224028',display_name='tempest-TestVolumeBootPattern-server-402224028',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-402224028',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3a1951a52e7c4ef5ac6a0d9d5380d41a',ramdisk_id='',reservation_id='r-9skjwm4x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1444343509',owner_user_name='tempest-TestVolumeBootPattern-1444343509-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T19:25:59Z,user_data=None,user_id='bfc6b02c16664b8dbea3a6f2088ec385',uuid=4a77197f-6077-410e-8aa2-42d017b89381,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "41af8c88-b21c-44bd-abd4-0e31fcaa174b", "address": "fa:16:3e:77:eb:03", "network": {"id": "5881a45c-3f28-48c4-aa8e-045b3bea3227", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1651070715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a1951a52e7c4ef5ac6a0d9d5380d41a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41af8c88-b2", "ovs_interfaceid": "41af8c88-b21c-44bd-abd4-0e31fcaa174b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 19:26:09 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-0e9c5421-b18e-40db-86ba-45454d2607c1 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Converting VIF {"id": "41af8c88-b21c-44bd-abd4-0e31fcaa174b", "address": "fa:16:3e:77:eb:03", "network": {"id": "5881a45c-3f28-48c4-aa8e-045b3bea3227", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1651070715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a1951a52e7c4ef5ac6a0d9d5380d41a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41af8c88-b2", "ovs_interfaceid": "41af8c88-b21c-44bd-abd4-0e31fcaa174b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 19:26:09 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-0e9c5421-b18e-40db-86ba-45454d2607c1 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:eb:03,bridge_name='br-int',has_traffic_filtering=True,id=41af8c88-b21c-44bd-abd4-0e31fcaa174b,network=Network(5881a45c-3f28-48c4-aa8e-045b3bea3227),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41af8c88-b2') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 19:26:09 user nova-compute[75216]: DEBUG os_vif [None req-0e9c5421-b18e-40db-86ba-45454d2607c1 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:eb:03,bridge_name='br-int',has_traffic_filtering=True,id=41af8c88-b21c-44bd-abd4-0e31fcaa174b,network=Network(5881a45c-3f28-48c4-aa8e-045b3bea3227),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41af8c88-b2') {{(pid=75216) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 19:26:09 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:26:09 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:26:09 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 19:26:09 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:26:09 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd74203d0-da35-52db-b6d5-c28202cd2a19', '_type': 'linux-noop'}}, row=False) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:26:09 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:26:09 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:26:09 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap41af8c88-b2, may_exist=True, interface_attrs={}) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:26:09 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap41af8c88-b2, col_values=(('qos', UUID('723dcf42-023c-401c-89b7-a2c83d32539a')),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:26:09 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap41af8c88-b2, col_values=(('external_ids', {'iface-id': '41af8c88-b21c-44bd-abd4-0e31fcaa174b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:77:eb:03', 'vm-uuid': '4a77197f-6077-410e-8aa2-42d017b89381'}),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:26:09 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:26:09 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:26:09 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:26:09 user nova-compute[75216]: INFO os_vif [None req-0e9c5421-b18e-40db-86ba-45454d2607c1 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:eb:03,bridge_name='br-int',has_traffic_filtering=True,id=41af8c88-b21c-44bd-abd4-0e31fcaa174b,network=Network(5881a45c-3f28-48c4-aa8e-045b3bea3227),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41af8c88-b2')
Nov 13 19:26:09 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-0e9c5421-b18e-40db-86ba-45454d2607c1 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 19:26:09 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-0e9c5421-b18e-40db-86ba-45454d2607c1 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] No VIF found with MAC fa:16:3e:77:eb:03, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 19:26:11 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:26:11 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:26:11 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:26:11 user nova-compute[75216]: DEBUG nova.compute.manager [req-70e23862-cbf7-48a1-882d-497a42adc90e req-059e3836-dbf6-4328-8e4b-d19ca6d83366 service nova] [instance: 4a77197f-6077-410e-8aa2-42d017b89381] Received event network-vif-plugged-41af8c88-b21c-44bd-abd4-0e31fcaa174b {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:26:11 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-70e23862-cbf7-48a1-882d-497a42adc90e req-059e3836-dbf6-4328-8e4b-d19ca6d83366 service nova] Acquiring lock "4a77197f-6077-410e-8aa2-42d017b89381-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:26:11 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-70e23862-cbf7-48a1-882d-497a42adc90e req-059e3836-dbf6-4328-8e4b-d19ca6d83366 service nova] Lock "4a77197f-6077-410e-8aa2-42d017b89381-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:26:11 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-70e23862-cbf7-48a1-882d-497a42adc90e req-059e3836-dbf6-4328-8e4b-d19ca6d83366 service nova] Lock "4a77197f-6077-410e-8aa2-42d017b89381-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:26:11 user nova-compute[75216]: DEBUG nova.compute.manager [req-70e23862-cbf7-48a1-882d-497a42adc90e req-059e3836-dbf6-4328-8e4b-d19ca6d83366 service nova] [instance: 4a77197f-6077-410e-8aa2-42d017b89381] No waiting events found dispatching network-vif-plugged-41af8c88-b21c-44bd-abd4-0e31fcaa174b {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 19:26:11 user nova-compute[75216]: WARNING nova.compute.manager [req-70e23862-cbf7-48a1-882d-497a42adc90e req-059e3836-dbf6-4328-8e4b-d19ca6d83366 service nova] [instance: 4a77197f-6077-410e-8aa2-42d017b89381] Received unexpected event network-vif-plugged-41af8c88-b21c-44bd-abd4-0e31fcaa174b for instance with vm_state building and task_state spawning.
Nov 13 19:26:11 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:26:11 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:26:11 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:26:11 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:26:11 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-485dbc00-b5e1-4289-b434-e0c19dd66981 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Acquiring lock "874468f0-1d7c-4ba2-b01e-9584c46b956a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:26:11 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-485dbc00-b5e1-4289-b434-e0c19dd66981 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Lock "874468f0-1d7c-4ba2-b01e-9584c46b956a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:26:11 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-485dbc00-b5e1-4289-b434-e0c19dd66981 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Acquiring lock "874468f0-1d7c-4ba2-b01e-9584c46b956a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:26:11 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-485dbc00-b5e1-4289-b434-e0c19dd66981 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Lock "874468f0-1d7c-4ba2-b01e-9584c46b956a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:26:11 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-485dbc00-b5e1-4289-b434-e0c19dd66981 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Lock "874468f0-1d7c-4ba2-b01e-9584c46b956a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:26:11 user nova-compute[75216]: INFO nova.compute.manager [None req-485dbc00-b5e1-4289-b434-e0c19dd66981 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] [instance: 874468f0-1d7c-4ba2-b01e-9584c46b956a] Terminating instance
Nov 13 19:26:11 user nova-compute[75216]: DEBUG nova.compute.manager [None req-485dbc00-b5e1-4289-b434-e0c19dd66981 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] [instance: 874468f0-1d7c-4ba2-b01e-9584c46b956a] Start destroying the instance on the hypervisor. {{(pid=75216) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 19:26:11 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:26:11 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:26:11 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:26:11 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:26:11 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:26:12 user nova-compute[75216]: DEBUG nova.compute.manager [req-022f83cc-f034-4521-b144-af5cae6510f1 req-a11703b1-fb1f-4900-8805-5e91f68dcdec service nova] [instance: 874468f0-1d7c-4ba2-b01e-9584c46b956a] Received event network-vif-unplugged-ec14a363-0571-4332-a85e-3194b039c7c3 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:26:12 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-022f83cc-f034-4521-b144-af5cae6510f1 req-a11703b1-fb1f-4900-8805-5e91f68dcdec service nova] Acquiring lock "874468f0-1d7c-4ba2-b01e-9584c46b956a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:26:12 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-022f83cc-f034-4521-b144-af5cae6510f1 req-a11703b1-fb1f-4900-8805-5e91f68dcdec service nova] Lock "874468f0-1d7c-4ba2-b01e-9584c46b956a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:26:12 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-022f83cc-f034-4521-b144-af5cae6510f1 req-a11703b1-fb1f-4900-8805-5e91f68dcdec service nova] Lock "874468f0-1d7c-4ba2-b01e-9584c46b956a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:26:12 user nova-compute[75216]: DEBUG nova.compute.manager [req-022f83cc-f034-4521-b144-af5cae6510f1 req-a11703b1-fb1f-4900-8805-5e91f68dcdec service nova] [instance: 874468f0-1d7c-4ba2-b01e-9584c46b956a] No waiting events found dispatching network-vif-unplugged-ec14a363-0571-4332-a85e-3194b039c7c3 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 19:26:12 user nova-compute[75216]: DEBUG nova.compute.manager [req-022f83cc-f034-4521-b144-af5cae6510f1 req-a11703b1-fb1f-4900-8805-5e91f68dcdec service nova] [instance: 874468f0-1d7c-4ba2-b01e-9584c46b956a] Received event network-vif-unplugged-ec14a363-0571-4332-a85e-3194b039c7c3 for instance with task_state deleting. {{(pid=75216) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 19:26:12 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 874468f0-1d7c-4ba2-b01e-9584c46b956a] Instance destroyed successfully.
Nov 13 19:26:12 user nova-compute[75216]: DEBUG nova.objects.instance [None req-485dbc00-b5e1-4289-b434-e0c19dd66981 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Lazy-loading 'resources' on Instance uuid 874468f0-1d7c-4ba2-b01e-9584c46b956a {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:26:12 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-485dbc00-b5e1-4289-b434-e0c19dd66981 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T19:23:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1712111216',display_name='tempest-AttachVolumeNegativeTest-server-1712111216',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1712111216',id=45,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN2tN9acLF2QgyociyNmNoIoDpLLDyKgAiIGz8GDcj7kmYzWVqXXl+DhpAUiMkjeK/dvc0Niua4y2Vbhm9ip9TaMRHETi/xnVvBNPJz4apUhdnHKSWaYE9gnbbcp+pOfdQ==',key_name='tempest-keypair-1043587685',keypairs=<?>,launch_index=0,launched_at=2023-11-13T19:23:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d06cae29094846f1817036dc761a565d',ramdisk_id='',reservation_id='r-2q20w00p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1187420962',owner_user_name='tempest-AttachVolumeNegativeTest-1187420962-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T19:23:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1ca750d884c3403394b46f53fbd633a1',uuid=874468f0-1d7c-4ba2-b01e-9584c46b956a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ec14a363-0571-4332-a85e-3194b039c7c3", "address": "fa:16:3e:40:41:53", "network": {"id": "9dcbadf2-6b5e-41f1-88a3-17a579ad1bad", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-926239573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d06cae29094846f1817036dc761a565d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec14a363-05", "ovs_interfaceid": "ec14a363-0571-4332-a85e-3194b039c7c3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 19:26:12 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-485dbc00-b5e1-4289-b434-e0c19dd66981 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Converting VIF {"id": "ec14a363-0571-4332-a85e-3194b039c7c3", "address": "fa:16:3e:40:41:53", "network": {"id": "9dcbadf2-6b5e-41f1-88a3-17a579ad1bad", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-926239573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d06cae29094846f1817036dc761a565d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec14a363-05", "ovs_interfaceid": "ec14a363-0571-4332-a85e-3194b039c7c3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 19:26:12 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-485dbc00-b5e1-4289-b434-e0c19dd66981 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:40:41:53,bridge_name='br-int',has_traffic_filtering=True,id=ec14a363-0571-4332-a85e-3194b039c7c3,network=Network(9dcbadf2-6b5e-41f1-88a3-17a579ad1bad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec14a363-05') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 19:26:12 user nova-compute[75216]: DEBUG os_vif [None req-485dbc00-b5e1-4289-b434-e0c19dd66981 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:40:41:53,bridge_name='br-int',has_traffic_filtering=True,id=ec14a363-0571-4332-a85e-3194b039c7c3,network=Network(9dcbadf2-6b5e-41f1-88a3-17a579ad1bad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec14a363-05') {{(pid=75216) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 19:26:12 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:26:12 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapec14a363-05, bridge=br-int, if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:26:12 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:26:12 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:26:12 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:26:12 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8cfac8ab-db99-4aec-8c66-c8a8b4f6f7f7) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:26:12 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:26:12 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:26:12 user nova-compute[75216]: INFO os_vif [None req-485dbc00-b5e1-4289-b434-e0c19dd66981 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:40:41:53,bridge_name='br-int',has_traffic_filtering=True,id=ec14a363-0571-4332-a85e-3194b039c7c3,network=Network(9dcbadf2-6b5e-41f1-88a3-17a579ad1bad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec14a363-05')
Nov 13 19:26:12 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-485dbc00-b5e1-4289-b434-e0c19dd66981 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] [instance: 874468f0-1d7c-4ba2-b01e-9584c46b956a] Deleting instance files /opt/stack/data/nova/instances/874468f0-1d7c-4ba2-b01e-9584c46b956a_del
Nov 13 19:26:12 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-485dbc00-b5e1-4289-b434-e0c19dd66981 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] [instance: 874468f0-1d7c-4ba2-b01e-9584c46b956a] Deletion of /opt/stack/data/nova/instances/874468f0-1d7c-4ba2-b01e-9584c46b956a_del complete
Nov 13 19:26:12 user nova-compute[75216]: INFO nova.compute.manager [None req-485dbc00-b5e1-4289-b434-e0c19dd66981 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] [instance: 874468f0-1d7c-4ba2-b01e-9584c46b956a] Took 0.83 seconds to destroy the instance on the hypervisor.
Nov 13 19:26:12 user nova-compute[75216]: DEBUG oslo.service.loopingcall [None req-485dbc00-b5e1-4289-b434-e0c19dd66981 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75216) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 19:26:12 user nova-compute[75216]: DEBUG nova.compute.manager [-] [instance: 874468f0-1d7c-4ba2-b01e-9584c46b956a] Deallocating network for instance {{(pid=75216) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 19:26:12 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: 874468f0-1d7c-4ba2-b01e-9584c46b956a] deallocate_for_instance() {{(pid=75216) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 19:26:13 user nova-compute[75216]: DEBUG nova.compute.manager [None req-0e9c5421-b18e-40db-86ba-45454d2607c1 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 4a77197f-6077-410e-8aa2-42d017b89381] Instance event wait completed in 0 seconds for  {{(pid=75216) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 19:26:13 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-0e9c5421-b18e-40db-86ba-45454d2607c1 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 4a77197f-6077-410e-8aa2-42d017b89381] Guest created on hypervisor {{(pid=75216) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 19:26:13 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 4a77197f-6077-410e-8aa2-42d017b89381] Instance spawned successfully.
Nov 13 19:26:13 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-0e9c5421-b18e-40db-86ba-45454d2607c1 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 4a77197f-6077-410e-8aa2-42d017b89381] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 19:26:13 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-0e9c5421-b18e-40db-86ba-45454d2607c1 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 4a77197f-6077-410e-8aa2-42d017b89381] Found default for hw_cdrom_bus of ide {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 19:26:13 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-0e9c5421-b18e-40db-86ba-45454d2607c1 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 4a77197f-6077-410e-8aa2-42d017b89381] Found default for hw_disk_bus of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 19:26:13 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-0e9c5421-b18e-40db-86ba-45454d2607c1 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 4a77197f-6077-410e-8aa2-42d017b89381] Found default for hw_input_bus of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 19:26:13 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-0e9c5421-b18e-40db-86ba-45454d2607c1 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 4a77197f-6077-410e-8aa2-42d017b89381] Found default for hw_pointer_model of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 19:26:13 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-0e9c5421-b18e-40db-86ba-45454d2607c1 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 4a77197f-6077-410e-8aa2-42d017b89381] Found default for hw_video_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 19:26:13 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-0e9c5421-b18e-40db-86ba-45454d2607c1 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 4a77197f-6077-410e-8aa2-42d017b89381] Found default for hw_vif_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 19:26:13 user nova-compute[75216]: INFO nova.compute.manager [None req-0e9c5421-b18e-40db-86ba-45454d2607c1 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 4a77197f-6077-410e-8aa2-42d017b89381] Took 4.95 seconds to spawn the instance on the hypervisor.
Nov 13 19:26:13 user nova-compute[75216]: DEBUG nova.compute.manager [None req-0e9c5421-b18e-40db-86ba-45454d2607c1 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 4a77197f-6077-410e-8aa2-42d017b89381] Checking state {{(pid=75216) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 19:26:13 user nova-compute[75216]: DEBUG nova.compute.manager [req-1a808e18-a743-4bf7-93b4-c82339518f2b req-10a87bd0-a7e9-4760-8de6-d858f4a2293c service nova] [instance: 4a77197f-6077-410e-8aa2-42d017b89381] Received event network-vif-plugged-41af8c88-b21c-44bd-abd4-0e31fcaa174b {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:26:13 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-1a808e18-a743-4bf7-93b4-c82339518f2b req-10a87bd0-a7e9-4760-8de6-d858f4a2293c service nova] Acquiring lock "4a77197f-6077-410e-8aa2-42d017b89381-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:26:13 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-1a808e18-a743-4bf7-93b4-c82339518f2b req-10a87bd0-a7e9-4760-8de6-d858f4a2293c service nova] Lock "4a77197f-6077-410e-8aa2-42d017b89381-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:26:13 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-1a808e18-a743-4bf7-93b4-c82339518f2b req-10a87bd0-a7e9-4760-8de6-d858f4a2293c service nova] Lock "4a77197f-6077-410e-8aa2-42d017b89381-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:26:13 user nova-compute[75216]: DEBUG nova.compute.manager [req-1a808e18-a743-4bf7-93b4-c82339518f2b req-10a87bd0-a7e9-4760-8de6-d858f4a2293c service nova] [instance: 4a77197f-6077-410e-8aa2-42d017b89381] No waiting events found dispatching network-vif-plugged-41af8c88-b21c-44bd-abd4-0e31fcaa174b {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 19:26:13 user nova-compute[75216]: WARNING nova.compute.manager [req-1a808e18-a743-4bf7-93b4-c82339518f2b req-10a87bd0-a7e9-4760-8de6-d858f4a2293c service nova] [instance: 4a77197f-6077-410e-8aa2-42d017b89381] Received unexpected event network-vif-plugged-41af8c88-b21c-44bd-abd4-0e31fcaa174b for instance with vm_state building and task_state spawning.
Nov 13 19:26:13 user nova-compute[75216]: INFO nova.compute.manager [None req-0e9c5421-b18e-40db-86ba-45454d2607c1 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 4a77197f-6077-410e-8aa2-42d017b89381] Took 15.22 seconds to build instance.
Nov 13 19:26:13 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-0e9c5421-b18e-40db-86ba-45454d2607c1 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Lock "4a77197f-6077-410e-8aa2-42d017b89381" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.349s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:26:13 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: 874468f0-1d7c-4ba2-b01e-9584c46b956a] Updating instance_info_cache with network_info: [] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:26:13 user nova-compute[75216]: INFO nova.compute.manager [-] [instance: 874468f0-1d7c-4ba2-b01e-9584c46b956a] Took 0.80 seconds to deallocate network for instance.
Nov 13 19:26:13 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-485dbc00-b5e1-4289-b434-e0c19dd66981 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:26:13 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-485dbc00-b5e1-4289-b434-e0c19dd66981 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:26:13 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-485dbc00-b5e1-4289-b434-e0c19dd66981 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 19:26:13 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-485dbc00-b5e1-4289-b434-e0c19dd66981 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 19:26:13 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-485dbc00-b5e1-4289-b434-e0c19dd66981 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.166s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:26:13 user nova-compute[75216]: INFO nova.scheduler.client.report [None req-485dbc00-b5e1-4289-b434-e0c19dd66981 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Deleted allocations for instance 874468f0-1d7c-4ba2-b01e-9584c46b956a
Nov 13 19:26:13 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-485dbc00-b5e1-4289-b434-e0c19dd66981 tempest-AttachVolumeNegativeTest-1187420962 tempest-AttachVolumeNegativeTest-1187420962-project-member] Lock "874468f0-1d7c-4ba2-b01e-9584c46b956a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.984s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:26:14 user nova-compute[75216]: DEBUG nova.compute.manager [req-9e9623fd-66f8-4dbe-abdc-05d06ef4ef0b req-188c1bae-ab41-41f5-a4d4-e51e78ced396 service nova] [instance: 874468f0-1d7c-4ba2-b01e-9584c46b956a] Received event network-vif-plugged-ec14a363-0571-4332-a85e-3194b039c7c3 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:26:14 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-9e9623fd-66f8-4dbe-abdc-05d06ef4ef0b req-188c1bae-ab41-41f5-a4d4-e51e78ced396 service nova] Acquiring lock "874468f0-1d7c-4ba2-b01e-9584c46b956a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:26:14 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-9e9623fd-66f8-4dbe-abdc-05d06ef4ef0b req-188c1bae-ab41-41f5-a4d4-e51e78ced396 service nova] Lock "874468f0-1d7c-4ba2-b01e-9584c46b956a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:26:14 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-9e9623fd-66f8-4dbe-abdc-05d06ef4ef0b req-188c1bae-ab41-41f5-a4d4-e51e78ced396 service nova] Lock "874468f0-1d7c-4ba2-b01e-9584c46b956a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:26:14 user nova-compute[75216]: DEBUG nova.compute.manager [req-9e9623fd-66f8-4dbe-abdc-05d06ef4ef0b req-188c1bae-ab41-41f5-a4d4-e51e78ced396 service nova] [instance: 874468f0-1d7c-4ba2-b01e-9584c46b956a] No waiting events found dispatching network-vif-plugged-ec14a363-0571-4332-a85e-3194b039c7c3 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 19:26:14 user nova-compute[75216]: WARNING nova.compute.manager [req-9e9623fd-66f8-4dbe-abdc-05d06ef4ef0b req-188c1bae-ab41-41f5-a4d4-e51e78ced396 service nova] [instance: 874468f0-1d7c-4ba2-b01e-9584c46b956a] Received unexpected event network-vif-plugged-ec14a363-0571-4332-a85e-3194b039c7c3 for instance with vm_state deleted and task_state None.
Nov 13 19:26:14 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:26:15 user nova-compute[75216]: DEBUG nova.compute.manager [req-9cb0b6f5-474c-4355-8bba-a24e0f1b14eb req-3983937a-b402-4dbe-8b29-5c201f4faf39 service nova] [instance: 874468f0-1d7c-4ba2-b01e-9584c46b956a] Received event network-vif-deleted-ec14a363-0571-4332-a85e-3194b039c7c3 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:26:15 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:26:17 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:26:17 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:26:19 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:26:19 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:26:19 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75216) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 19:26:19 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:26:19 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:26:21 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:26:21 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:26:21 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:26:21 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:26:21 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Auditing locally available compute resources for user (node: user) {{(pid=75216) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 19:26:21 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 19:26:21 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 19:26:21 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 19:26:21 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Hypervisor/Node resource view: name=user free_ram=9020MB free_disk=25.28803253173828GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75216) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 19:26:21 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:26:21 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:26:22 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance 4a77197f-6077-410e-8aa2-42d017b89381 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 19:26:22 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 19:26:22 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 19:26:22 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Refreshing inventories for resource provider d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 13 19:26:22 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Updating ProviderTree inventory for provider d927e00d-5a8b-43f7-ac04-6437958fac1f from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 13 19:26:22 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Updating inventory in ProviderTree for provider d927e00d-5a8b-43f7-ac04-6437958fac1f with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 13 19:26:22 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Refreshing aggregate associations for resource provider d927e00d-5a8b-43f7-ac04-6437958fac1f, aggregates: None {{(pid=75216) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 13 19:26:22 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Refreshing trait associations for resource provider d927e00d-5a8b-43f7-ac04-6437958fac1f, traits: COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_MMX {{(pid=75216) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 13 19:26:22 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 19:26:22 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 19:26:22 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Compute_service record updated for user:user {{(pid=75216) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 19:26:22 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.394s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:26:22 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:26:24 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:26:24 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:26:25 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:26:25 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Starting heal instance info cache {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 19:26:25 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Rebuilding the list of instances to heal {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 13 19:26:25 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "refresh_cache-4a77197f-6077-410e-8aa2-42d017b89381" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 19:26:25 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquired lock "refresh_cache-4a77197f-6077-410e-8aa2-42d017b89381" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 19:26:25 user nova-compute[75216]: DEBUG nova.network.neutron [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: 4a77197f-6077-410e-8aa2-42d017b89381] Forcefully refreshing network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 19:26:25 user nova-compute[75216]: DEBUG nova.objects.instance [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lazy-loading 'info_cache' on Instance uuid 4a77197f-6077-410e-8aa2-42d017b89381 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:26:25 user nova-compute[75216]: DEBUG nova.network.neutron [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: 4a77197f-6077-410e-8aa2-42d017b89381] Updating instance_info_cache with network_info: [{"id": "41af8c88-b21c-44bd-abd4-0e31fcaa174b", "address": "fa:16:3e:77:eb:03", "network": {"id": "5881a45c-3f28-48c4-aa8e-045b3bea3227", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1651070715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a1951a52e7c4ef5ac6a0d9d5380d41a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41af8c88-b2", "ovs_interfaceid": "41af8c88-b21c-44bd-abd4-0e31fcaa174b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:26:25 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Releasing lock "refresh_cache-4a77197f-6077-410e-8aa2-42d017b89381" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 19:26:25 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: 4a77197f-6077-410e-8aa2-42d017b89381] Updated the network info_cache for instance {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 19:26:27 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:26:27 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:26:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:26:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:26:34 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:26:37 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:26:37 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Cleaning up deleted instances {{(pid=75216) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 13 19:26:37 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] There are 0 instances to clean {{(pid=75216) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 13 19:26:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:26:39 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:26:42 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:26:44 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:26:46 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:26:46 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75216) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 13 19:26:47 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:26:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:26:52 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:26:57 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:27:02 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:27:02 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:27:07 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:27:08 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:27:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:27:12 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:27:15 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:27:17 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:27:17 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:27:20 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:27:20 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:27:20 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75216) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 19:27:21 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:27:21 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:27:21 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:27:21 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:27:21 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Auditing locally available compute resources for user (node: user) {{(pid=75216) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 19:27:21 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 19:27:21 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 19:27:21 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 19:27:21 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Hypervisor/Node resource view: name=user free_ram=8946MB free_disk=25.28620147705078GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75216) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 19:27:21 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:27:21 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:27:21 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance 4a77197f-6077-410e-8aa2-42d017b89381 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 19:27:21 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 19:27:21 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 19:27:22 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 19:27:22 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 19:27:22 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Compute_service record updated for user:user {{(pid=75216) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 19:27:22 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.145s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:27:22 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:27:22 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:27:22 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75216) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 19:27:22 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 19:27:22 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 19:27:22 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:27:26 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:27:26 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Starting heal instance info cache {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 19:27:26 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Rebuilding the list of instances to heal {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 13 19:27:26 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "refresh_cache-4a77197f-6077-410e-8aa2-42d017b89381" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 19:27:26 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquired lock "refresh_cache-4a77197f-6077-410e-8aa2-42d017b89381" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 19:27:26 user nova-compute[75216]: DEBUG nova.network.neutron [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: 4a77197f-6077-410e-8aa2-42d017b89381] Forcefully refreshing network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 19:27:26 user nova-compute[75216]: DEBUG nova.objects.instance [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lazy-loading 'info_cache' on Instance uuid 4a77197f-6077-410e-8aa2-42d017b89381 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:27:26 user nova-compute[75216]: DEBUG nova.network.neutron [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: 4a77197f-6077-410e-8aa2-42d017b89381] Updating instance_info_cache with network_info: [{"id": "41af8c88-b21c-44bd-abd4-0e31fcaa174b", "address": "fa:16:3e:77:eb:03", "network": {"id": "5881a45c-3f28-48c4-aa8e-045b3bea3227", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1651070715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a1951a52e7c4ef5ac6a0d9d5380d41a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41af8c88-b2", "ovs_interfaceid": "41af8c88-b21c-44bd-abd4-0e31fcaa174b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:27:26 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Releasing lock "refresh_cache-4a77197f-6077-410e-8aa2-42d017b89381" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 19:27:26 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: 4a77197f-6077-410e-8aa2-42d017b89381] Updated the network info_cache for instance {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 19:27:26 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:27:27 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:27:29 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:27:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:27:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:27:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:27:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75216) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 19:27:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 19:27:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 19:27:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:27:39 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:27:42 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:27:47 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:27:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-cd446b9f-ea99-42cd-842b-757595e993d8 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Acquiring lock "4a77197f-6077-410e-8aa2-42d017b89381" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:27:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-cd446b9f-ea99-42cd-842b-757595e993d8 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Lock "4a77197f-6077-410e-8aa2-42d017b89381" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:27:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-cd446b9f-ea99-42cd-842b-757595e993d8 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Acquiring lock "4a77197f-6077-410e-8aa2-42d017b89381-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:27:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-cd446b9f-ea99-42cd-842b-757595e993d8 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Lock "4a77197f-6077-410e-8aa2-42d017b89381-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:27:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-cd446b9f-ea99-42cd-842b-757595e993d8 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Lock "4a77197f-6077-410e-8aa2-42d017b89381-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:27:49 user nova-compute[75216]: INFO nova.compute.manager [None req-cd446b9f-ea99-42cd-842b-757595e993d8 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 4a77197f-6077-410e-8aa2-42d017b89381] Terminating instance
Nov 13 19:27:49 user nova-compute[75216]: DEBUG nova.compute.manager [None req-cd446b9f-ea99-42cd-842b-757595e993d8 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 4a77197f-6077-410e-8aa2-42d017b89381] Start destroying the instance on the hypervisor. {{(pid=75216) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 19:27:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:27:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:27:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:27:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:27:49 user nova-compute[75216]: DEBUG nova.compute.manager [req-31cd1209-070c-478c-9f4a-a5ddfd16abea req-0d345181-e3a1-41cb-ade4-fd50204bfaf0 service nova] [instance: 4a77197f-6077-410e-8aa2-42d017b89381] Received event network-vif-unplugged-41af8c88-b21c-44bd-abd4-0e31fcaa174b {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:27:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-31cd1209-070c-478c-9f4a-a5ddfd16abea req-0d345181-e3a1-41cb-ade4-fd50204bfaf0 service nova] Acquiring lock "4a77197f-6077-410e-8aa2-42d017b89381-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:27:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-31cd1209-070c-478c-9f4a-a5ddfd16abea req-0d345181-e3a1-41cb-ade4-fd50204bfaf0 service nova] Lock "4a77197f-6077-410e-8aa2-42d017b89381-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:27:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-31cd1209-070c-478c-9f4a-a5ddfd16abea req-0d345181-e3a1-41cb-ade4-fd50204bfaf0 service nova] Lock "4a77197f-6077-410e-8aa2-42d017b89381-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:27:49 user nova-compute[75216]: DEBUG nova.compute.manager [req-31cd1209-070c-478c-9f4a-a5ddfd16abea req-0d345181-e3a1-41cb-ade4-fd50204bfaf0 service nova] [instance: 4a77197f-6077-410e-8aa2-42d017b89381] No waiting events found dispatching network-vif-unplugged-41af8c88-b21c-44bd-abd4-0e31fcaa174b {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 19:27:49 user nova-compute[75216]: DEBUG nova.compute.manager [req-31cd1209-070c-478c-9f4a-a5ddfd16abea req-0d345181-e3a1-41cb-ade4-fd50204bfaf0 service nova] [instance: 4a77197f-6077-410e-8aa2-42d017b89381] Received event network-vif-unplugged-41af8c88-b21c-44bd-abd4-0e31fcaa174b for instance with task_state deleting. {{(pid=75216) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 19:27:49 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 4a77197f-6077-410e-8aa2-42d017b89381] Instance destroyed successfully.
Nov 13 19:27:49 user nova-compute[75216]: DEBUG nova.objects.instance [None req-cd446b9f-ea99-42cd-842b-757595e993d8 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Lazy-loading 'resources' on Instance uuid 4a77197f-6077-410e-8aa2-42d017b89381 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:27:49 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-cd446b9f-ea99-42cd-842b-757595e993d8 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T19:25:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-402224028',display_name='tempest-TestVolumeBootPattern-server-402224028',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-402224028',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-13T19:26:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3a1951a52e7c4ef5ac6a0d9d5380d41a',ramdisk_id='',reservation_id='r-9skjwm4x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1444343509',owner_user_name='tempest-TestVolumeBootPattern-1444343509-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T19:26:13Z,user_data=None,user_id='bfc6b02c16664b8dbea3a6f2088ec385',uuid=4a77197f-6077-410e-8aa2-42d017b89381,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "41af8c88-b21c-44bd-abd4-0e31fcaa174b", "address": "fa:16:3e:77:eb:03", "network": {"id": "5881a45c-3f28-48c4-aa8e-045b3bea3227", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1651070715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a1951a52e7c4ef5ac6a0d9d5380d41a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41af8c88-b2", "ovs_interfaceid": "41af8c88-b21c-44bd-abd4-0e31fcaa174b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 19:27:49 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-cd446b9f-ea99-42cd-842b-757595e993d8 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Converting VIF {"id": "41af8c88-b21c-44bd-abd4-0e31fcaa174b", "address": "fa:16:3e:77:eb:03", "network": {"id": "5881a45c-3f28-48c4-aa8e-045b3bea3227", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1651070715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a1951a52e7c4ef5ac6a0d9d5380d41a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41af8c88-b2", "ovs_interfaceid": "41af8c88-b21c-44bd-abd4-0e31fcaa174b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 19:27:49 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-cd446b9f-ea99-42cd-842b-757595e993d8 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:77:eb:03,bridge_name='br-int',has_traffic_filtering=True,id=41af8c88-b21c-44bd-abd4-0e31fcaa174b,network=Network(5881a45c-3f28-48c4-aa8e-045b3bea3227),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41af8c88-b2') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 19:27:49 user nova-compute[75216]: DEBUG os_vif [None req-cd446b9f-ea99-42cd-842b-757595e993d8 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:77:eb:03,bridge_name='br-int',has_traffic_filtering=True,id=41af8c88-b21c-44bd-abd4-0e31fcaa174b,network=Network(5881a45c-3f28-48c4-aa8e-045b3bea3227),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41af8c88-b2') {{(pid=75216) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 19:27:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:27:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap41af8c88-b2, bridge=br-int, if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:27:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:27:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:27:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:27:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=723dcf42-023c-401c-89b7-a2c83d32539a) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:27:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:27:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:27:49 user nova-compute[75216]: INFO os_vif [None req-cd446b9f-ea99-42cd-842b-757595e993d8 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:77:eb:03,bridge_name='br-int',has_traffic_filtering=True,id=41af8c88-b21c-44bd-abd4-0e31fcaa174b,network=Network(5881a45c-3f28-48c4-aa8e-045b3bea3227),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41af8c88-b2')
Nov 13 19:27:49 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd446b9f-ea99-42cd-842b-757595e993d8 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 4a77197f-6077-410e-8aa2-42d017b89381] calling os-brick to detach iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 19:27:49 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd446b9f-ea99-42cd-842b-757595e993d8 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3a8669e40>, {'target_iqn': 'iqn.2010-10.org.openstack:e9bd5a2a-da46-433a-8342-22366d96fc65', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hbPyvAIg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 19:27:49 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-cd446b9f-ea99-42cd-842b-757595e993d8 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 19:27:49 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-cd446b9f-ea99-42cd-842b-757595e993d8 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 19:27:49 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-cd446b9f-ea99-42cd-842b-757595e993d8 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 19:27:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:27:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:27:49 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5fb7c8d-4d95-4897-af33-c2fe3081285c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e9bd5a2a-da46-433a-8342-22366d96fc65\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:27:49 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd446b9f-ea99-42cd-842b-757595e993d8 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 19:27:49 user nova-compute[75216]: No targets found.
Nov 13 19:27:49 user nova-compute[75216]: iSNS:
Nov 13 19:27:49 user nova-compute[75216]: No targets found.
Nov 13 19:27:49 user nova-compute[75216]: STATIC:
Nov 13 19:27:49 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:e9bd5a2a-da46-433a-8342-22366d96fc65
Nov 13 19:27:49 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 19:27:49 user nova-compute[75216]:                 Iface Name: default
Nov 13 19:27:49 user nova-compute[75216]: FIRMWARE:
Nov 13 19:27:49 user nova-compute[75216]: No targets found.
Nov 13 19:27:49 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 19:27:49 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd446b9f-ea99-42cd-842b-757595e993d8 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 19:27:49 user nova-compute[75216]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 19:27:49 user nova-compute[75216]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75216) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 19:27:49 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd446b9f-ea99-42cd-842b-757595e993d8 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e9bd5a2a-da46-433a-8342-22366d96fc65', 0)] {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 19:27:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:27:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:27:49 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[e95f648c-67e5-4a2e-81d9-3c1f12b1cf5d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e9bd5a2a-da46-433a-8342-22366d96fc65\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:27:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:27:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:27:49 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[3115cffd-2d4f-4f9a-992b-596989c6875a]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9bd5a2a-da46-433a-8342-22366d96fc65 (non-flash)\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:27:49 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd446b9f-ea99-42cd-842b-757595e993d8 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9bd5a2a-da46-433a-8342-22366d96fc65 (non-flash)
Nov 13 19:27:49 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 19:27:49 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd446b9f-ea99-42cd-842b-757595e993d8 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9bd5a2a-da46-433a-8342-22366d96fc65 (non-flash)
Nov 13 19:27:49 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 19:27:49 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd446b9f-ea99-42cd-842b-757595e993d8 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe3a8785240>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e9bd5a2a-da46-433a-8342-22366d96fc65'): ({'sdb'}, set())}) {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 19:27:49 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-cd446b9f-ea99-42cd-842b-757595e993d8 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Removing single pathed devices sdb {{(pid=75216) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 19:27:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:27:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:27:49 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[04530a63-aa14-48fd-ba05-b094baa859ef]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:27:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:27:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:27:49 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0a2a98e-c955-420c-bfd6-149d1a465ae1]: (4, ('ok\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:27:49 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-cd446b9f-ea99-42cd-842b-757595e993d8 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Flushing IO for device /dev/sdb {{(pid=75216) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 19:27:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:27:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:27:49 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb8e80a4-a310-4c36-a727-585f71f8bc62]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:27:49 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-cd446b9f-ea99-42cd-842b-757595e993d8 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75216) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 19:27:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:27:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:27:49 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf820abb-a017-4ba3-a8cb-6774368461b8]: (4, ('1', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:27:49 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-cd446b9f-ea99-42cd-842b-757595e993d8 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 19:27:49 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-cd446b9f-ea99-42cd-842b-757595e993d8 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] SCSI volumes sdb have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 19:27:49 user nova-compute[75216]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO8ea35e85-22a91a6bfb284d7e', '/dev/disk/by-id/scsi-23232613931613662', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_8ea35e85') {{(pid=85984) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 13 19:27:49 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[98f51060-bf15-43a9-afb0-26ecb4bd8416]: (4, None) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:27:49 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd446b9f-ea99-42cd-842b-757595e993d8 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e9bd5a2a-da46-433a-8342-22366d96fc65')] {{(pid=75216) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 19:27:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9bd5a2a-da46-433a-8342-22366d96fc65 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:27:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9bd5a2a-da46-433a-8342-22366d96fc65 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:27:50 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e56d82a-0c9a-4cd3-b822-92e725e38dfe]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:27:50 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd446b9f-ea99-42cd-842b-757595e993d8 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:27:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9bd5a2a-da46-433a-8342-22366d96fc65 -p 172.16.0.220:3260 --logout {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:27:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9bd5a2a-da46-433a-8342-22366d96fc65 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:27:50 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[69b4f050-6272-4615-9525-de33c9a2b687]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:e9bd5a2a-da46-433a-8342-22366d96fc65, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:e9bd5a2a-da46-433a-8342-22366d96fc65, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:27:50 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd446b9f-ea99-42cd-842b-757595e993d8 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:e9bd5a2a-da46-433a-8342-22366d96fc65, portal: 172.16.0.220,3260]
Nov 13 19:27:50 user nova-compute[75216]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:e9bd5a2a-da46-433a-8342-22366d96fc65, portal: 172.16.0.220,3260] successful.
Nov 13 19:27:50 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:27:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9bd5a2a-da46-433a-8342-22366d96fc65 -p 172.16.0.220:3260 --op delete {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:27:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9bd5a2a-da46-433a-8342-22366d96fc65 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:27:50 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d0c64bc-3936-4b91-92af-dff7e5e6f859]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:27:50 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd446b9f-ea99-42cd-842b-757595e993d8 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:27:50 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-cd446b9f-ea99-42cd-842b-757595e993d8 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.292s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 19:27:50 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd446b9f-ea99-42cd-842b-757595e993d8 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] <== disconnect_volume: return (293ms) None {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 19:27:50 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd446b9f-ea99-42cd-842b-757595e993d8 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 4a77197f-6077-410e-8aa2-42d017b89381] Disconnected iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 19:27:50 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-cd446b9f-ea99-42cd-842b-757595e993d8 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 4a77197f-6077-410e-8aa2-42d017b89381] Deleting instance files /opt/stack/data/nova/instances/4a77197f-6077-410e-8aa2-42d017b89381_del
Nov 13 19:27:50 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-cd446b9f-ea99-42cd-842b-757595e993d8 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 4a77197f-6077-410e-8aa2-42d017b89381] Deletion of /opt/stack/data/nova/instances/4a77197f-6077-410e-8aa2-42d017b89381_del complete
Nov 13 19:27:50 user nova-compute[75216]: INFO nova.compute.manager [None req-cd446b9f-ea99-42cd-842b-757595e993d8 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 4a77197f-6077-410e-8aa2-42d017b89381] Took 1.14 seconds to destroy the instance on the hypervisor.
Nov 13 19:27:50 user nova-compute[75216]: DEBUG oslo.service.loopingcall [None req-cd446b9f-ea99-42cd-842b-757595e993d8 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75216) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 19:27:50 user nova-compute[75216]: DEBUG nova.compute.manager [-] [instance: 4a77197f-6077-410e-8aa2-42d017b89381] Deallocating network for instance {{(pid=75216) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 19:27:50 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: 4a77197f-6077-410e-8aa2-42d017b89381] deallocate_for_instance() {{(pid=75216) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 19:27:50 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: 4a77197f-6077-410e-8aa2-42d017b89381] Updating instance_info_cache with network_info: [] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:27:50 user nova-compute[75216]: INFO nova.compute.manager [-] [instance: 4a77197f-6077-410e-8aa2-42d017b89381] Took 0.38 seconds to deallocate network for instance.
Nov 13 19:27:51 user nova-compute[75216]: INFO nova.compute.manager [None req-cd446b9f-ea99-42cd-842b-757595e993d8 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 4a77197f-6077-410e-8aa2-42d017b89381] Took 0.77 seconds to detach 1 volumes for instance.
Nov 13 19:27:51 user nova-compute[75216]: DEBUG nova.compute.manager [None req-cd446b9f-ea99-42cd-842b-757595e993d8 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 4a77197f-6077-410e-8aa2-42d017b89381] Deleting volume: e9bd5a2a-da46-433a-8342-22366d96fc65 {{(pid=75216) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 13 19:27:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-cd446b9f-ea99-42cd-842b-757595e993d8 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:27:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-cd446b9f-ea99-42cd-842b-757595e993d8 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:27:51 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-cd446b9f-ea99-42cd-842b-757595e993d8 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 19:27:51 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-cd446b9f-ea99-42cd-842b-757595e993d8 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 19:27:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-cd446b9f-ea99-42cd-842b-757595e993d8 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.106s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:27:51 user nova-compute[75216]: INFO nova.scheduler.client.report [None req-cd446b9f-ea99-42cd-842b-757595e993d8 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Deleted allocations for instance 4a77197f-6077-410e-8aa2-42d017b89381
Nov 13 19:27:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-cd446b9f-ea99-42cd-842b-757595e993d8 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Lock "4a77197f-6077-410e-8aa2-42d017b89381" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.635s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:27:51 user nova-compute[75216]: DEBUG nova.compute.manager [req-39d1fc7c-0131-43ea-b948-43f95db203f3 req-b11155c1-647c-492f-8274-2bd25e02a1b1 service nova] [instance: 4a77197f-6077-410e-8aa2-42d017b89381] Received event network-vif-plugged-41af8c88-b21c-44bd-abd4-0e31fcaa174b {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:27:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-39d1fc7c-0131-43ea-b948-43f95db203f3 req-b11155c1-647c-492f-8274-2bd25e02a1b1 service nova] Acquiring lock "4a77197f-6077-410e-8aa2-42d017b89381-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:27:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-39d1fc7c-0131-43ea-b948-43f95db203f3 req-b11155c1-647c-492f-8274-2bd25e02a1b1 service nova] Lock "4a77197f-6077-410e-8aa2-42d017b89381-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:27:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-39d1fc7c-0131-43ea-b948-43f95db203f3 req-b11155c1-647c-492f-8274-2bd25e02a1b1 service nova] Lock "4a77197f-6077-410e-8aa2-42d017b89381-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:27:51 user nova-compute[75216]: DEBUG nova.compute.manager [req-39d1fc7c-0131-43ea-b948-43f95db203f3 req-b11155c1-647c-492f-8274-2bd25e02a1b1 service nova] [instance: 4a77197f-6077-410e-8aa2-42d017b89381] No waiting events found dispatching network-vif-plugged-41af8c88-b21c-44bd-abd4-0e31fcaa174b {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 19:27:51 user nova-compute[75216]: WARNING nova.compute.manager [req-39d1fc7c-0131-43ea-b948-43f95db203f3 req-b11155c1-647c-492f-8274-2bd25e02a1b1 service nova] [instance: 4a77197f-6077-410e-8aa2-42d017b89381] Received unexpected event network-vif-plugged-41af8c88-b21c-44bd-abd4-0e31fcaa174b for instance with vm_state deleted and task_state None.
Nov 13 19:27:51 user nova-compute[75216]: DEBUG nova.compute.manager [req-39d1fc7c-0131-43ea-b948-43f95db203f3 req-b11155c1-647c-492f-8274-2bd25e02a1b1 service nova] [instance: 4a77197f-6077-410e-8aa2-42d017b89381] Received event network-vif-deleted-41af8c88-b21c-44bd-abd4-0e31fcaa174b {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:27:54 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:27:59 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:27:59 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:27:59 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75216) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 19:27:59 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 19:27:59 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 19:27:59 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:28:04 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:28:09 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:28:09 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:28:14 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:28:14 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:28:14 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75216) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 19:28:14 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 19:28:14 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 19:28:14 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:28:15 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:28:19 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:28:19 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:28:20 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:28:21 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:28:21 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75216) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 19:28:23 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:28:23 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:28:23 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:28:23 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:28:23 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Auditing locally available compute resources for user (node: user) {{(pid=75216) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 19:28:23 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 19:28:23 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 19:28:23 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Hypervisor/Node resource view: name=user free_ram=9138MB free_disk=25.28537368774414GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75216) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 19:28:23 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:28:23 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:28:23 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 19:28:23 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 19:28:23 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 19:28:23 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 19:28:23 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Compute_service record updated for user:user {{(pid=75216) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 19:28:23 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.154s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:28:24 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:28:25 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:28:25 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Starting heal instance info cache {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 19:28:25 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Rebuilding the list of instances to heal {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 13 19:28:25 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Didn't find any instances for network info cache update. {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 13 19:28:27 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:28:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:28:31 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:28:34 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:28:39 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:28:43 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:28:44 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:28:46 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-134ed0c4-baef-41c7-b400-055120870c04 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Acquiring lock "06fd14bc-508c-4d70-b7b6-f536bb2601a6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:28:46 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-134ed0c4-baef-41c7-b400-055120870c04 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Lock "06fd14bc-508c-4d70-b7b6-f536bb2601a6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:28:46 user nova-compute[75216]: DEBUG nova.compute.manager [None req-134ed0c4-baef-41c7-b400-055120870c04 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 06fd14bc-508c-4d70-b7b6-f536bb2601a6] Starting instance... {{(pid=75216) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 19:28:46 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-134ed0c4-baef-41c7-b400-055120870c04 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:28:46 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-134ed0c4-baef-41c7-b400-055120870c04 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:28:46 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-134ed0c4-baef-41c7-b400-055120870c04 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75216) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 19:28:46 user nova-compute[75216]: INFO nova.compute.claims [None req-134ed0c4-baef-41c7-b400-055120870c04 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 06fd14bc-508c-4d70-b7b6-f536bb2601a6] Claim successful on node user
Nov 13 19:28:46 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-134ed0c4-baef-41c7-b400-055120870c04 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 19:28:46 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-134ed0c4-baef-41c7-b400-055120870c04 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 19:28:46 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-134ed0c4-baef-41c7-b400-055120870c04 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.212s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:28:46 user nova-compute[75216]: DEBUG nova.compute.manager [None req-134ed0c4-baef-41c7-b400-055120870c04 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 06fd14bc-508c-4d70-b7b6-f536bb2601a6] Start building networks asynchronously for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 19:28:46 user nova-compute[75216]: DEBUG nova.compute.manager [None req-134ed0c4-baef-41c7-b400-055120870c04 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 06fd14bc-508c-4d70-b7b6-f536bb2601a6] Allocating IP information in the background. {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 19:28:46 user nova-compute[75216]: DEBUG nova.network.neutron [None req-134ed0c4-baef-41c7-b400-055120870c04 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 06fd14bc-508c-4d70-b7b6-f536bb2601a6] allocate_for_instance() {{(pid=75216) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 19:28:46 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-134ed0c4-baef-41c7-b400-055120870c04 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 06fd14bc-508c-4d70-b7b6-f536bb2601a6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 19:28:46 user nova-compute[75216]: DEBUG nova.compute.manager [None req-134ed0c4-baef-41c7-b400-055120870c04 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 06fd14bc-508c-4d70-b7b6-f536bb2601a6] Start building block device mappings for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 19:28:46 user nova-compute[75216]: DEBUG nova.policy [None req-134ed0c4-baef-41c7-b400-055120870c04 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bfc6b02c16664b8dbea3a6f2088ec385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1951a52e7c4ef5ac6a0d9d5380d41a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75216) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 19:28:46 user nova-compute[75216]: INFO nova.virt.block_device [None req-134ed0c4-baef-41c7-b400-055120870c04 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 06fd14bc-508c-4d70-b7b6-f536bb2601a6] Booting with volume 0bb8e1a0-1257-4491-b9ef-d8b8e07ef1f7 at /dev/vda
Nov 13 19:28:46 user nova-compute[75216]: DEBUG os_brick.utils [None req-134ed0c4-baef-41c7-b400-055120870c04 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 19:28:46 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:28:46 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:28:46 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4b7a88c-59d0-45b3-9293-34b7627d8d0c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aea6fcfe14b9\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:28:46 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:28:46 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:28:46 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa5e4842-cae2-408e-966f-e806028b18a7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:28:46 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:28:46 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:28:46 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[181f8f6c-eaa9-406d-b06a-33cdfff51d88]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:28:46 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dc1735a-1a53-485b-b71b-4a885fe75602]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:28:46 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-134ed0c4-baef-41c7-b400-055120870c04 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Running cmd (subprocess): nvme version {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:28:46 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-134ed0c4-baef-41c7-b400-055120870c04 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] 'nvme version' failed. Not Retrying. {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 19:28:46 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.nvmeof [None req-134ed0c4-baef-41c7-b400-055120870c04 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] nvme not present on system {{(pid=75216) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 19:28:46 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:28:46 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 19:28:46 user nova-compute[75216]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 19:28:46 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[893503f3-092e-40df-a06b-4b102bea0e7e]: (4, '') {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:28:46 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-134ed0c4-baef-41c7-b400-055120870c04 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75216) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 19:28:46 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-134ed0c4-baef-41c7-b400-055120870c04 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 19:28:46 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-134ed0c4-baef-41c7-b400-055120870c04 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] LIGHTOS: no hostnqn found. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 19:28:46 user nova-compute[75216]: DEBUG os_brick.utils [None req-134ed0c4-baef-41c7-b400-055120870c04 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aea6fcfe14b9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 19:28:46 user nova-compute[75216]: DEBUG nova.virt.block_device [None req-134ed0c4-baef-41c7-b400-055120870c04 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 06fd14bc-508c-4d70-b7b6-f536bb2601a6] Updating existing volume attachment record: f30673e0-804d-4863-a226-2fabc66f14c8 {{(pid=75216) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 19:28:47 user nova-compute[75216]: DEBUG nova.network.neutron [None req-134ed0c4-baef-41c7-b400-055120870c04 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 06fd14bc-508c-4d70-b7b6-f536bb2601a6] Successfully created port: 17485923-5f1e-4a16-9279-032f55bf4ce6 {{(pid=75216) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 19:28:47 user nova-compute[75216]: DEBUG nova.network.neutron [None req-134ed0c4-baef-41c7-b400-055120870c04 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 06fd14bc-508c-4d70-b7b6-f536bb2601a6] Successfully updated port: 17485923-5f1e-4a16-9279-032f55bf4ce6 {{(pid=75216) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 19:28:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-134ed0c4-baef-41c7-b400-055120870c04 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Acquiring lock "refresh_cache-06fd14bc-508c-4d70-b7b6-f536bb2601a6" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 19:28:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-134ed0c4-baef-41c7-b400-055120870c04 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Acquired lock "refresh_cache-06fd14bc-508c-4d70-b7b6-f536bb2601a6" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 19:28:47 user nova-compute[75216]: DEBUG nova.network.neutron [None req-134ed0c4-baef-41c7-b400-055120870c04 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 06fd14bc-508c-4d70-b7b6-f536bb2601a6] Building network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 19:28:47 user nova-compute[75216]: DEBUG nova.compute.manager [req-b6717654-82ec-4a05-abc2-afe3baed4f08 req-1ea2fbad-5710-4c70-a524-a639479c6d92 service nova] [instance: 06fd14bc-508c-4d70-b7b6-f536bb2601a6] Received event network-changed-17485923-5f1e-4a16-9279-032f55bf4ce6 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:28:47 user nova-compute[75216]: DEBUG nova.compute.manager [req-b6717654-82ec-4a05-abc2-afe3baed4f08 req-1ea2fbad-5710-4c70-a524-a639479c6d92 service nova] [instance: 06fd14bc-508c-4d70-b7b6-f536bb2601a6] Refreshing instance network info cache due to event network-changed-17485923-5f1e-4a16-9279-032f55bf4ce6. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 19:28:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-b6717654-82ec-4a05-abc2-afe3baed4f08 req-1ea2fbad-5710-4c70-a524-a639479c6d92 service nova] Acquiring lock "refresh_cache-06fd14bc-508c-4d70-b7b6-f536bb2601a6" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 19:28:47 user nova-compute[75216]: DEBUG nova.network.neutron [None req-134ed0c4-baef-41c7-b400-055120870c04 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 06fd14bc-508c-4d70-b7b6-f536bb2601a6] Instance cache missing network info. {{(pid=75216) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 19:28:48 user nova-compute[75216]: DEBUG nova.network.neutron [None req-134ed0c4-baef-41c7-b400-055120870c04 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 06fd14bc-508c-4d70-b7b6-f536bb2601a6] Updating instance_info_cache with network_info: [{"id": "17485923-5f1e-4a16-9279-032f55bf4ce6", "address": "fa:16:3e:71:d7:59", "network": {"id": "5881a45c-3f28-48c4-aa8e-045b3bea3227", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1651070715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a1951a52e7c4ef5ac6a0d9d5380d41a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17485923-5f", "ovs_interfaceid": "17485923-5f1e-4a16-9279-032f55bf4ce6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:28:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-134ed0c4-baef-41c7-b400-055120870c04 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Releasing lock "refresh_cache-06fd14bc-508c-4d70-b7b6-f536bb2601a6" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 19:28:48 user nova-compute[75216]: DEBUG nova.compute.manager [None req-134ed0c4-baef-41c7-b400-055120870c04 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 06fd14bc-508c-4d70-b7b6-f536bb2601a6] Instance network_info: |[{"id": "17485923-5f1e-4a16-9279-032f55bf4ce6", "address": "fa:16:3e:71:d7:59", "network": {"id": "5881a45c-3f28-48c4-aa8e-045b3bea3227", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1651070715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a1951a52e7c4ef5ac6a0d9d5380d41a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17485923-5f", "ovs_interfaceid": "17485923-5f1e-4a16-9279-032f55bf4ce6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 19:28:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-b6717654-82ec-4a05-abc2-afe3baed4f08 req-1ea2fbad-5710-4c70-a524-a639479c6d92 service nova] Acquired lock "refresh_cache-06fd14bc-508c-4d70-b7b6-f536bb2601a6" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 19:28:48 user nova-compute[75216]: DEBUG nova.network.neutron [req-b6717654-82ec-4a05-abc2-afe3baed4f08 req-1ea2fbad-5710-4c70-a524-a639479c6d92 service nova] [instance: 06fd14bc-508c-4d70-b7b6-f536bb2601a6] Refreshing network info cache for port 17485923-5f1e-4a16-9279-032f55bf4ce6 {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 19:28:48 user nova-compute[75216]: DEBUG nova.network.neutron [req-b6717654-82ec-4a05-abc2-afe3baed4f08 req-1ea2fbad-5710-4c70-a524-a639479c6d92 service nova] [instance: 06fd14bc-508c-4d70-b7b6-f536bb2601a6] Updated VIF entry in instance network info cache for port 17485923-5f1e-4a16-9279-032f55bf4ce6. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 19:28:48 user nova-compute[75216]: DEBUG nova.network.neutron [req-b6717654-82ec-4a05-abc2-afe3baed4f08 req-1ea2fbad-5710-4c70-a524-a639479c6d92 service nova] [instance: 06fd14bc-508c-4d70-b7b6-f536bb2601a6] Updating instance_info_cache with network_info: [{"id": "17485923-5f1e-4a16-9279-032f55bf4ce6", "address": "fa:16:3e:71:d7:59", "network": {"id": "5881a45c-3f28-48c4-aa8e-045b3bea3227", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1651070715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a1951a52e7c4ef5ac6a0d9d5380d41a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17485923-5f", "ovs_interfaceid": "17485923-5f1e-4a16-9279-032f55bf4ce6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:28:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-b6717654-82ec-4a05-abc2-afe3baed4f08 req-1ea2fbad-5710-4c70-a524-a639479c6d92 service nova] Releasing lock "refresh_cache-06fd14bc-508c-4d70-b7b6-f536bb2601a6" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 19:28:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:28:50 user nova-compute[75216]: DEBUG nova.compute.manager [None req-134ed0c4-baef-41c7-b400-055120870c04 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 06fd14bc-508c-4d70-b7b6-f536bb2601a6] Start spawning the instance on the hypervisor. {{(pid=75216) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 19:28:50 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-134ed0c4-baef-41c7-b400-055120870c04 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 06fd14bc-508c-4d70-b7b6-f536bb2601a6] Creating instance directory {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 19:28:50 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-134ed0c4-baef-41c7-b400-055120870c04 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 06fd14bc-508c-4d70-b7b6-f536bb2601a6] Creating image(s)
Nov 13 19:28:50 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-134ed0c4-baef-41c7-b400-055120870c04 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 06fd14bc-508c-4d70-b7b6-f536bb2601a6] Did not create local disks {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 13 19:28:50 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-134ed0c4-baef-41c7-b400-055120870c04 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 06fd14bc-508c-4d70-b7b6-f536bb2601a6] Ensure instance console log exists: /opt/stack/data/nova/instances/06fd14bc-508c-4d70-b7b6-f536bb2601a6/console.log {{(pid=75216) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 19:28:50 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-134ed0c4-baef-41c7-b400-055120870c04 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:28:50 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-134ed0c4-baef-41c7-b400-055120870c04 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:28:50 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-134ed0c4-baef-41c7-b400-055120870c04 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:28:50 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-134ed0c4-baef-41c7-b400-055120870c04 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 06fd14bc-508c-4d70-b7b6-f536bb2601a6] Start _get_guest_xml network_info=[{"id": "17485923-5f1e-4a16-9279-032f55bf4ce6", "address": "fa:16:3e:71:d7:59", "network": {"id": "5881a45c-3f28-48c4-aa8e-045b3bea3227", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1651070715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a1951a52e7c4ef5ac6a0d9d5380d41a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17485923-5f", "ovs_interfaceid": "17485923-5f1e-4a16-9279-032f55bf4ce6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0bb8e1a0-1257-4491-b9ef-d8b8e07ef1f7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rIKDqmXc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '06fd14bc-508c-4d70-b7b6-f536bb2601a6', 'attached_at': '', 'detached_at': '', 'volume_id': '0bb8e1a0-1257-4491-b9ef-d8b8e07ef1f7', 'serial': '0bb8e1a0-1257-4491-b9ef-d8b8e07ef1f7'}, 'attachment_id': 'f30673e0-804d-4863-a226-2fabc66f14c8', 'guest_format': None, 'mount_device': '/dev/vda', 'delete_on_termination': True, 'boot_index': 0, 'volume_type': None} {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 19:28:50 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-134ed0c4-baef-41c7-b400-055120870c04 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 19:28:50 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-134ed0c4-baef-41c7-b400-055120870c04 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 19:28:50 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-134ed0c4-baef-41c7-b400-055120870c04 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 19:28:50 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-134ed0c4-baef-41c7-b400-055120870c04 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] CPU controller missing on host. {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 19:28:50 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-134ed0c4-baef-41c7-b400-055120870c04 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 19:28:50 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-134ed0c4-baef-41c7-b400-055120870c04 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] CPU controller found on host. {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 19:28:50 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-134ed0c4-baef-41c7-b400-055120870c04 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75216) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 19:28:50 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-134ed0c4-baef-41c7-b400-055120870c04 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T18:40:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 19:28:50 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-134ed0c4-baef-41c7-b400-055120870c04 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Flavor limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 19:28:50 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-134ed0c4-baef-41c7-b400-055120870c04 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Image limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 19:28:50 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-134ed0c4-baef-41c7-b400-055120870c04 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Flavor pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 19:28:50 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-134ed0c4-baef-41c7-b400-055120870c04 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Image pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 19:28:50 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-134ed0c4-baef-41c7-b400-055120870c04 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 19:28:50 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-134ed0c4-baef-41c7-b400-055120870c04 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 19:28:50 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-134ed0c4-baef-41c7-b400-055120870c04 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 19:28:50 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-134ed0c4-baef-41c7-b400-055120870c04 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Got 1 possible topologies {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 19:28:50 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-134ed0c4-baef-41c7-b400-055120870c04 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 19:28:50 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-134ed0c4-baef-41c7-b400-055120870c04 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 19:28:50 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-134ed0c4-baef-41c7-b400-055120870c04 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 06fd14bc-508c-4d70-b7b6-f536bb2601a6] Calling os-brick to attach iSCSI Volume {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 19:28:50 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-134ed0c4-baef-41c7-b400-055120870c04 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3a8669e40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0bb8e1a0-1257-4491-b9ef-d8b8e07ef1f7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rIKDqmXc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 19:28:50 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-134ed0c4-baef-41c7-b400-055120870c04 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 19:28:50 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-134ed0c4-baef-41c7-b400-055120870c04 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 19:28:50 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-134ed0c4-baef-41c7-b400-055120870c04 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 19:28:50 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-134ed0c4-baef-41c7-b400-055120870c04 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 19:28:50 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-134ed0c4-baef-41c7-b400-055120870c04 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0bb8e1a0-1257-4491-b9ef-d8b8e07ef1f7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 19:28:50 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-134ed0c4-baef-41c7-b400-055120870c04 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0bb8e1a0-1257-4491-b9ef-d8b8e07ef1f7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 19:28:50 user nova-compute[75216]: INFO os_brick.initiator.connectors.iscsi [None req-134ed0c4-baef-41c7-b400-055120870c04 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 19:28:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0bb8e1a0-1257-4491-b9ef-d8b8e07ef1f7 -p 172.16.0.220:3260 {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:28:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0bb8e1a0-1257-4491-b9ef-d8b8e07ef1f7 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:28:50 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[744935db-012b-4d6b-948f-f1c70e6587f8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:28:50 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-134ed0c4-baef-41c7-b400-055120870c04 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 19:28:50 user nova-compute[75216]:  {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:28:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0bb8e1a0-1257-4491-b9ef-d8b8e07ef1f7 -p 172.16.0.220:3260 --interface default --op new {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:28:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0bb8e1a0-1257-4491-b9ef-d8b8e07ef1f7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:28:50 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[5704bf0f-3b2d-4357-98cf-b0b2dfdc2994]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0bb8e1a0-1257-4491-b9ef-d8b8e07ef1f7] added\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:28:50 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-134ed0c4-baef-41c7-b400-055120870c04 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0bb8e1a0-1257-4491-b9ef-d8b8e07ef1f7] added
Nov 13 19:28:50 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:28:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0bb8e1a0-1257-4491-b9ef-d8b8e07ef1f7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:28:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0bb8e1a0-1257-4491-b9ef-d8b8e07ef1f7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:28:50 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[10d9e6cc-ca10-44ce-bee2-30b614f75a50]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:28:50 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-134ed0c4-baef-41c7-b400-055120870c04 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:28:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0bb8e1a0-1257-4491-b9ef-d8b8e07ef1f7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:28:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0bb8e1a0-1257-4491-b9ef-d8b8e07ef1f7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:28:51 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[b63c2c7b-7884-4b6c-ab10-722b80dbf3eb]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:28:51 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-134ed0c4-baef-41c7-b400-055120870c04 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:28:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0bb8e1a0-1257-4491-b9ef-d8b8e07ef1f7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rIKDqmXc {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:28:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0bb8e1a0-1257-4491-b9ef-d8b8e07ef1f7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rIKDqmXc" returned: 0 in 0.016s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:28:51 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[c12ac5a1-4aba-4f11-b691-9db197a11ade]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:28:51 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-134ed0c4-baef-41c7-b400-055120870c04 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rIKDqmXc'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:28:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0bb8e1a0-1257-4491-b9ef-d8b8e07ef1f7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:28:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0bb8e1a0-1257-4491-b9ef-d8b8e07ef1f7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:28:51 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[989d1bac-8904-483d-a2fa-901486b56408]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:28:51 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-134ed0c4-baef-41c7-b400-055120870c04 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:28:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:28:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:28:51 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bac7902-d055-4d56-b6d3-64a9477ceade]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:28:51 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-134ed0c4-baef-41c7-b400-055120870c04 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 13 19:28:51 user nova-compute[75216]:  {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 19:28:51 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-134ed0c4-baef-41c7-b400-055120870c04 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 13 19:28:51 user nova-compute[75216]:  {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 19:28:51 user nova-compute[75216]: WARNING os_brick.initiator.connectors.iscsi [None req-134ed0c4-baef-41c7-b400-055120870c04 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 13 19:28:51 user nova-compute[75216]: 
Nov 13 19:28:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0bb8e1a0-1257-4491-b9ef-d8b8e07ef1f7 -p 172.16.0.220:3260 --login {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:28:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0bb8e1a0-1257-4491-b9ef-d8b8e07ef1f7 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:28:51 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[673c1ed9-8234-466e-86bb-d1254cc0486f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0bb8e1a0-1257-4491-b9ef-d8b8e07ef1f7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0bb8e1a0-1257-4491-b9ef-d8b8e07ef1f7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:28:51 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-134ed0c4-baef-41c7-b400-055120870c04 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0bb8e1a0-1257-4491-b9ef-d8b8e07ef1f7, portal: 172.16.0.220,3260]
Nov 13 19:28:51 user nova-compute[75216]: Login to [iface: default, target: iqn.2010-10.org.openstack:0bb8e1a0-1257-4491-b9ef-d8b8e07ef1f7, portal: 172.16.0.220,3260] successful.
Nov 13 19:28:51 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:28:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0bb8e1a0-1257-4491-b9ef-d8b8e07ef1f7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:28:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0bb8e1a0-1257-4491-b9ef-d8b8e07ef1f7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:28:51 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b6a04fc-8376-48e7-978b-68188c236593]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:28:51 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-134ed0c4-baef-41c7-b400-055120870c04 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:28:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:28:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:28:51 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[82df0fca-f83f-4534-8e8b-3d4c9173f936]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bb8e1a0-1257-4491-b9ef-d8b8e07ef1f7 (non-flash)\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:28:51 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-134ed0c4-baef-41c7-b400-055120870c04 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bb8e1a0-1257-4491-b9ef-d8b8e07ef1f7 (non-flash)
Nov 13 19:28:51 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 19:28:51 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-134ed0c4-baef-41c7-b400-055120870c04 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bb8e1a0-1257-4491-b9ef-d8b8e07ef1f7 (non-flash)
Nov 13 19:28:51 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 19:28:51 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-134ed0c4-baef-41c7-b400-055120870c04 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0bb8e1a0-1257-4491-b9ef-d8b8e07ef1f7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.230s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 19:28:51 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-134ed0c4-baef-41c7-b400-055120870c04 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Connected to 172.16.0.220:3260 {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 19:28:51 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-134ed0c4-baef-41c7-b400-055120870c04 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] HCTL ('33', '-', '-', 0) found on session 55 with lun 0 {{(pid=75216) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 19:28:51 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-134ed0c4-baef-41c7-b400-055120870c04 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75216) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 19:28:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:28:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:28:51 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[36648918-8a87-45ac-bbc0-626822d006ac]: (4, ('- - 0', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:28:51 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-134ed0c4-baef-41c7-b400-055120870c04 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Searching for a device in session 55 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75216) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 19:28:51 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-134ed0c4-baef-41c7-b400-055120870c04 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:0bb8e1a0-1257-4491-b9ef-d8b8e07ef1f7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rIKDqmXc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 19:28:52 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-134ed0c4-baef-41c7-b400-055120870c04 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.259s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 19:28:52 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-134ed0c4-baef-41c7-b400-055120870c04 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] <== connect_volume: return (1260ms) {'type': 'block', 'scsi_wwn': '26439336463393666', 'path': '/dev/sdb'} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 19:28:52 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-134ed0c4-baef-41c7-b400-055120870c04 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 06fd14bc-508c-4d70-b7b6-f536bb2601a6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26439336463393666', 'path': '/dev/sdb'} {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 19:28:52 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-134ed0c4-baef-41c7-b400-055120870c04 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T19:28:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1943562899',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1943562899',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1943562899',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOyDmmYAuXaR/FoXT1rCO06bdHIDD5dg0Qn4bjo1Ds3aNj4RWLZEzden0kT+RqfSfD1Hvvy+zEcoA2+RWaqewGcic7fay+hKlj1XZ0U9mJJ9bp7mUJtC/siK9RnmLhRUTQ==',key_name='tempest-keypair-1176163373',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3a1951a52e7c4ef5ac6a0d9d5380d41a',ramdisk_id='',reservation_id='r-ra0t0h25',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1444343509',owner_user_name='tempest-TestVolumeBootPattern-1444343509-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T19:28:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bfc6b02c16664b8dbea3a6f2088ec385',uuid=06fd14bc-508c-4d70-b7b6-f536bb2601a6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "17485923-5f1e-4a16-9279-032f55bf4ce6", "address": "fa:16:3e:71:d7:59", "network": {"id": "5881a45c-3f28-48c4-aa8e-045b3bea3227", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1651070715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a1951a52e7c4ef5ac6a0d9d5380d41a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17485923-5f", "ovs_interfaceid": "17485923-5f1e-4a16-9279-032f55bf4ce6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75216) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 19:28:52 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-134ed0c4-baef-41c7-b400-055120870c04 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Converting VIF {"id": "17485923-5f1e-4a16-9279-032f55bf4ce6", "address": "fa:16:3e:71:d7:59", "network": {"id": "5881a45c-3f28-48c4-aa8e-045b3bea3227", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1651070715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a1951a52e7c4ef5ac6a0d9d5380d41a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17485923-5f", "ovs_interfaceid": "17485923-5f1e-4a16-9279-032f55bf4ce6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 19:28:52 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-134ed0c4-baef-41c7-b400-055120870c04 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:71:d7:59,bridge_name='br-int',has_traffic_filtering=True,id=17485923-5f1e-4a16-9279-032f55bf4ce6,network=Network(5881a45c-3f28-48c4-aa8e-045b3bea3227),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17485923-5f') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 19:28:52 user nova-compute[75216]: DEBUG nova.objects.instance [None req-134ed0c4-baef-41c7-b400-055120870c04 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Lazy-loading 'pci_devices' on Instance uuid 06fd14bc-508c-4d70-b7b6-f536bb2601a6 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:28:52 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-134ed0c4-baef-41c7-b400-055120870c04 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 06fd14bc-508c-4d70-b7b6-f536bb2601a6] End _get_guest_xml xml=<domain type="kvm">
Nov 13 19:28:52 user nova-compute[75216]:   <uuid>06fd14bc-508c-4d70-b7b6-f536bb2601a6</uuid>
Nov 13 19:28:52 user nova-compute[75216]:   <name>instance-0000002f</name>
Nov 13 19:28:52 user nova-compute[75216]:   <memory>524288</memory>
Nov 13 19:28:52 user nova-compute[75216]:   <vcpu>1</vcpu>
Nov 13 19:28:52 user nova-compute[75216]:   <metadata>
Nov 13 19:28:52 user nova-compute[75216]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 19:28:52 user nova-compute[75216]:       <nova:package version="0.0.0"/>
Nov 13 19:28:52 user nova-compute[75216]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-1943562899</nova:name>
Nov 13 19:28:52 user nova-compute[75216]:       <nova:creationTime>2023-11-13 19:28:50</nova:creationTime>
Nov 13 19:28:52 user nova-compute[75216]:       <nova:flavor name="m1.tiny">
Nov 13 19:28:52 user nova-compute[75216]:         <nova:memory>512</nova:memory>
Nov 13 19:28:52 user nova-compute[75216]:         <nova:disk>1</nova:disk>
Nov 13 19:28:52 user nova-compute[75216]:         <nova:swap>0</nova:swap>
Nov 13 19:28:52 user nova-compute[75216]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 19:28:52 user nova-compute[75216]:         <nova:vcpus>1</nova:vcpus>
Nov 13 19:28:52 user nova-compute[75216]:       </nova:flavor>
Nov 13 19:28:52 user nova-compute[75216]:       <nova:owner>
Nov 13 19:28:52 user nova-compute[75216]:         <nova:user uuid="bfc6b02c16664b8dbea3a6f2088ec385">tempest-TestVolumeBootPattern-1444343509-project-member</nova:user>
Nov 13 19:28:52 user nova-compute[75216]:         <nova:project uuid="3a1951a52e7c4ef5ac6a0d9d5380d41a">tempest-TestVolumeBootPattern-1444343509</nova:project>
Nov 13 19:28:52 user nova-compute[75216]:       </nova:owner>
Nov 13 19:28:52 user nova-compute[75216]:       <nova:ports>
Nov 13 19:28:52 user nova-compute[75216]:         <nova:port uuid="17485923-5f1e-4a16-9279-032f55bf4ce6">
Nov 13 19:28:52 user nova-compute[75216]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 13 19:28:52 user nova-compute[75216]:         </nova:port>
Nov 13 19:28:52 user nova-compute[75216]:       </nova:ports>
Nov 13 19:28:52 user nova-compute[75216]:     </nova:instance>
Nov 13 19:28:52 user nova-compute[75216]:   </metadata>
Nov 13 19:28:52 user nova-compute[75216]:   <sysinfo type="smbios">
Nov 13 19:28:52 user nova-compute[75216]:     <system>
Nov 13 19:28:52 user nova-compute[75216]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 19:28:52 user nova-compute[75216]:       <entry name="product">OpenStack Nova</entry>
Nov 13 19:28:52 user nova-compute[75216]:       <entry name="version">0.0.0</entry>
Nov 13 19:28:52 user nova-compute[75216]:       <entry name="serial">06fd14bc-508c-4d70-b7b6-f536bb2601a6</entry>
Nov 13 19:28:52 user nova-compute[75216]:       <entry name="uuid">06fd14bc-508c-4d70-b7b6-f536bb2601a6</entry>
Nov 13 19:28:52 user nova-compute[75216]:       <entry name="family">Virtual Machine</entry>
Nov 13 19:28:52 user nova-compute[75216]:     </system>
Nov 13 19:28:52 user nova-compute[75216]:   </sysinfo>
Nov 13 19:28:52 user nova-compute[75216]:   <os>
Nov 13 19:28:52 user nova-compute[75216]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 19:28:52 user nova-compute[75216]:     <boot dev="hd"/>
Nov 13 19:28:52 user nova-compute[75216]:     <smbios mode="sysinfo"/>
Nov 13 19:28:52 user nova-compute[75216]:   </os>
Nov 13 19:28:52 user nova-compute[75216]:   <features>
Nov 13 19:28:52 user nova-compute[75216]:     <acpi/>
Nov 13 19:28:52 user nova-compute[75216]:     <apic/>
Nov 13 19:28:52 user nova-compute[75216]:     <vmcoreinfo/>
Nov 13 19:28:52 user nova-compute[75216]:   </features>
Nov 13 19:28:52 user nova-compute[75216]:   <clock offset="utc">
Nov 13 19:28:52 user nova-compute[75216]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 19:28:52 user nova-compute[75216]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 19:28:52 user nova-compute[75216]:     <timer name="hpet" present="no"/>
Nov 13 19:28:52 user nova-compute[75216]:   </clock>
Nov 13 19:28:52 user nova-compute[75216]:   <cpu mode="custom" match="exact">
Nov 13 19:28:52 user nova-compute[75216]:     <model>Nehalem</model>
Nov 13 19:28:52 user nova-compute[75216]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 19:28:52 user nova-compute[75216]:   </cpu>
Nov 13 19:28:52 user nova-compute[75216]:   <devices>
Nov 13 19:28:52 user nova-compute[75216]:     <disk type="block" device="disk">
Nov 13 19:28:52 user nova-compute[75216]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 19:28:52 user nova-compute[75216]:       <source dev="/dev/sdb"/>
Nov 13 19:28:52 user nova-compute[75216]:       <target dev="vda" bus="virtio"/>
Nov 13 19:28:52 user nova-compute[75216]:       <serial>0bb8e1a0-1257-4491-b9ef-d8b8e07ef1f7</serial>
Nov 13 19:28:52 user nova-compute[75216]:     </disk>
Nov 13 19:28:52 user nova-compute[75216]:     <interface type="ethernet">
Nov 13 19:28:52 user nova-compute[75216]:       <mac address="fa:16:3e:71:d7:59"/>
Nov 13 19:28:52 user nova-compute[75216]:       <model type="virtio"/>
Nov 13 19:28:52 user nova-compute[75216]:       <mtu size="1442"/>
Nov 13 19:28:52 user nova-compute[75216]:       <target dev="tap17485923-5f"/>
Nov 13 19:28:52 user nova-compute[75216]:     </interface>
Nov 13 19:28:52 user nova-compute[75216]:     <serial type="pty">
Nov 13 19:28:52 user nova-compute[75216]:       <log file="/opt/stack/data/nova/instances/06fd14bc-508c-4d70-b7b6-f536bb2601a6/console.log" append="off"/>
Nov 13 19:28:52 user nova-compute[75216]:     </serial>
Nov 13 19:28:52 user nova-compute[75216]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 19:28:52 user nova-compute[75216]:     <video>
Nov 13 19:28:52 user nova-compute[75216]:       <model type="virtio"/>
Nov 13 19:28:52 user nova-compute[75216]:     </video>
Nov 13 19:28:52 user nova-compute[75216]:     <rng model="virtio">
Nov 13 19:28:52 user nova-compute[75216]:       <backend model="random">/dev/urandom</backend>
Nov 13 19:28:52 user nova-compute[75216]:     </rng>
Nov 13 19:28:52 user nova-compute[75216]:     <controller type="usb" index="0" model="none"/>
Nov 13 19:28:52 user nova-compute[75216]:     <memballoon model="virtio">
Nov 13 19:28:52 user nova-compute[75216]:       <stats period="10"/>
Nov 13 19:28:52 user nova-compute[75216]:     </memballoon>
Nov 13 19:28:52 user nova-compute[75216]:   </devices>
Nov 13 19:28:52 user nova-compute[75216]: </domain>
Nov 13 19:28:52 user nova-compute[75216]:  {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 19:28:52 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-134ed0c4-baef-41c7-b400-055120870c04 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T19:28:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1943562899',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1943562899',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1943562899',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOyDmmYAuXaR/FoXT1rCO06bdHIDD5dg0Qn4bjo1Ds3aNj4RWLZEzden0kT+RqfSfD1Hvvy+zEcoA2+RWaqewGcic7fay+hKlj1XZ0U9mJJ9bp7mUJtC/siK9RnmLhRUTQ==',key_name='tempest-keypair-1176163373',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3a1951a52e7c4ef5ac6a0d9d5380d41a',ramdisk_id='',reservation_id='r-ra0t0h25',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1444343509',owner_user_name='tempest-TestVolumeBootPattern-1444343509-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T19:28:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bfc6b02c16664b8dbea3a6f2088ec385',uuid=06fd14bc-508c-4d70-b7b6-f536bb2601a6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "17485923-5f1e-4a16-9279-032f55bf4ce6", "address": "fa:16:3e:71:d7:59", "network": {"id": "5881a45c-3f28-48c4-aa8e-045b3bea3227", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1651070715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a1951a52e7c4ef5ac6a0d9d5380d41a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17485923-5f", "ovs_interfaceid": "17485923-5f1e-4a16-9279-032f55bf4ce6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 19:28:52 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-134ed0c4-baef-41c7-b400-055120870c04 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Converting VIF {"id": "17485923-5f1e-4a16-9279-032f55bf4ce6", "address": "fa:16:3e:71:d7:59", "network": {"id": "5881a45c-3f28-48c4-aa8e-045b3bea3227", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1651070715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a1951a52e7c4ef5ac6a0d9d5380d41a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17485923-5f", "ovs_interfaceid": "17485923-5f1e-4a16-9279-032f55bf4ce6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 19:28:52 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-134ed0c4-baef-41c7-b400-055120870c04 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:71:d7:59,bridge_name='br-int',has_traffic_filtering=True,id=17485923-5f1e-4a16-9279-032f55bf4ce6,network=Network(5881a45c-3f28-48c4-aa8e-045b3bea3227),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17485923-5f') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 19:28:52 user nova-compute[75216]: DEBUG os_vif [None req-134ed0c4-baef-41c7-b400-055120870c04 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:d7:59,bridge_name='br-int',has_traffic_filtering=True,id=17485923-5f1e-4a16-9279-032f55bf4ce6,network=Network(5881a45c-3f28-48c4-aa8e-045b3bea3227),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17485923-5f') {{(pid=75216) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 19:28:52 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:28:52 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:28:52 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 19:28:52 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:28:52 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f5454664-36e0-5089-893d-df2a93b07f2c', '_type': 'linux-noop'}}, row=False) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:28:52 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:28:52 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:28:52 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:28:52 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap17485923-5f, may_exist=True, interface_attrs={}) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:28:52 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap17485923-5f, col_values=(('qos', UUID('72af3190-28cd-4de1-9f35-327f26102e95')),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:28:52 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap17485923-5f, col_values=(('external_ids', {'iface-id': '17485923-5f1e-4a16-9279-032f55bf4ce6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:71:d7:59', 'vm-uuid': '06fd14bc-508c-4d70-b7b6-f536bb2601a6'}),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:28:52 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:28:52 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:28:52 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:28:52 user nova-compute[75216]: INFO os_vif [None req-134ed0c4-baef-41c7-b400-055120870c04 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:d7:59,bridge_name='br-int',has_traffic_filtering=True,id=17485923-5f1e-4a16-9279-032f55bf4ce6,network=Network(5881a45c-3f28-48c4-aa8e-045b3bea3227),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17485923-5f')
Nov 13 19:28:52 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-134ed0c4-baef-41c7-b400-055120870c04 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 19:28:52 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-134ed0c4-baef-41c7-b400-055120870c04 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] No VIF found with MAC fa:16:3e:71:d7:59, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 19:28:53 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:28:53 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:28:53 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:28:53 user nova-compute[75216]: DEBUG nova.compute.manager [req-3c7bfe3c-ac91-4202-9f9a-99d1f1a3fade req-35284114-d79b-4c3e-9036-c67eab9fbe4b service nova] [instance: 06fd14bc-508c-4d70-b7b6-f536bb2601a6] Received event network-vif-plugged-17485923-5f1e-4a16-9279-032f55bf4ce6 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:28:53 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-3c7bfe3c-ac91-4202-9f9a-99d1f1a3fade req-35284114-d79b-4c3e-9036-c67eab9fbe4b service nova] Acquiring lock "06fd14bc-508c-4d70-b7b6-f536bb2601a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:28:53 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-3c7bfe3c-ac91-4202-9f9a-99d1f1a3fade req-35284114-d79b-4c3e-9036-c67eab9fbe4b service nova] Lock "06fd14bc-508c-4d70-b7b6-f536bb2601a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:28:53 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-3c7bfe3c-ac91-4202-9f9a-99d1f1a3fade req-35284114-d79b-4c3e-9036-c67eab9fbe4b service nova] Lock "06fd14bc-508c-4d70-b7b6-f536bb2601a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:28:53 user nova-compute[75216]: DEBUG nova.compute.manager [req-3c7bfe3c-ac91-4202-9f9a-99d1f1a3fade req-35284114-d79b-4c3e-9036-c67eab9fbe4b service nova] [instance: 06fd14bc-508c-4d70-b7b6-f536bb2601a6] No waiting events found dispatching network-vif-plugged-17485923-5f1e-4a16-9279-032f55bf4ce6 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 19:28:53 user nova-compute[75216]: WARNING nova.compute.manager [req-3c7bfe3c-ac91-4202-9f9a-99d1f1a3fade req-35284114-d79b-4c3e-9036-c67eab9fbe4b service nova] [instance: 06fd14bc-508c-4d70-b7b6-f536bb2601a6] Received unexpected event network-vif-plugged-17485923-5f1e-4a16-9279-032f55bf4ce6 for instance with vm_state building and task_state spawning.
Nov 13 19:28:54 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:28:54 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:28:54 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:28:54 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:28:54 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:28:55 user nova-compute[75216]: DEBUG nova.compute.manager [None req-134ed0c4-baef-41c7-b400-055120870c04 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 06fd14bc-508c-4d70-b7b6-f536bb2601a6] Instance event wait completed in 0 seconds for  {{(pid=75216) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 19:28:55 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-134ed0c4-baef-41c7-b400-055120870c04 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 06fd14bc-508c-4d70-b7b6-f536bb2601a6] Guest created on hypervisor {{(pid=75216) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 19:28:55 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 06fd14bc-508c-4d70-b7b6-f536bb2601a6] Instance spawned successfully.
Nov 13 19:28:55 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-134ed0c4-baef-41c7-b400-055120870c04 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 06fd14bc-508c-4d70-b7b6-f536bb2601a6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 19:28:55 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-134ed0c4-baef-41c7-b400-055120870c04 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 06fd14bc-508c-4d70-b7b6-f536bb2601a6] Found default for hw_cdrom_bus of ide {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 19:28:55 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-134ed0c4-baef-41c7-b400-055120870c04 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 06fd14bc-508c-4d70-b7b6-f536bb2601a6] Found default for hw_disk_bus of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 19:28:55 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-134ed0c4-baef-41c7-b400-055120870c04 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 06fd14bc-508c-4d70-b7b6-f536bb2601a6] Found default for hw_input_bus of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 19:28:55 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-134ed0c4-baef-41c7-b400-055120870c04 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 06fd14bc-508c-4d70-b7b6-f536bb2601a6] Found default for hw_pointer_model of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 19:28:55 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-134ed0c4-baef-41c7-b400-055120870c04 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 06fd14bc-508c-4d70-b7b6-f536bb2601a6] Found default for hw_video_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 19:28:55 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-134ed0c4-baef-41c7-b400-055120870c04 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 06fd14bc-508c-4d70-b7b6-f536bb2601a6] Found default for hw_vif_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 19:28:55 user nova-compute[75216]: INFO nova.compute.manager [None req-134ed0c4-baef-41c7-b400-055120870c04 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 06fd14bc-508c-4d70-b7b6-f536bb2601a6] Took 4.82 seconds to spawn the instance on the hypervisor.
Nov 13 19:28:55 user nova-compute[75216]: DEBUG nova.compute.manager [None req-134ed0c4-baef-41c7-b400-055120870c04 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 06fd14bc-508c-4d70-b7b6-f536bb2601a6] Checking state {{(pid=75216) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 19:28:55 user nova-compute[75216]: DEBUG nova.compute.manager [req-4a773529-6ba3-4572-b3f0-4b97b9268dc1 req-7cb86b19-7c7f-44cb-ae95-994d2ac10ea6 service nova] [instance: 06fd14bc-508c-4d70-b7b6-f536bb2601a6] Received event network-vif-plugged-17485923-5f1e-4a16-9279-032f55bf4ce6 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:28:55 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-4a773529-6ba3-4572-b3f0-4b97b9268dc1 req-7cb86b19-7c7f-44cb-ae95-994d2ac10ea6 service nova] Acquiring lock "06fd14bc-508c-4d70-b7b6-f536bb2601a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:28:55 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-4a773529-6ba3-4572-b3f0-4b97b9268dc1 req-7cb86b19-7c7f-44cb-ae95-994d2ac10ea6 service nova] Lock "06fd14bc-508c-4d70-b7b6-f536bb2601a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:28:55 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-4a773529-6ba3-4572-b3f0-4b97b9268dc1 req-7cb86b19-7c7f-44cb-ae95-994d2ac10ea6 service nova] Lock "06fd14bc-508c-4d70-b7b6-f536bb2601a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:28:55 user nova-compute[75216]: DEBUG nova.compute.manager [req-4a773529-6ba3-4572-b3f0-4b97b9268dc1 req-7cb86b19-7c7f-44cb-ae95-994d2ac10ea6 service nova] [instance: 06fd14bc-508c-4d70-b7b6-f536bb2601a6] No waiting events found dispatching network-vif-plugged-17485923-5f1e-4a16-9279-032f55bf4ce6 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 19:28:55 user nova-compute[75216]: WARNING nova.compute.manager [req-4a773529-6ba3-4572-b3f0-4b97b9268dc1 req-7cb86b19-7c7f-44cb-ae95-994d2ac10ea6 service nova] [instance: 06fd14bc-508c-4d70-b7b6-f536bb2601a6] Received unexpected event network-vif-plugged-17485923-5f1e-4a16-9279-032f55bf4ce6 for instance with vm_state building and task_state spawning.
Nov 13 19:28:55 user nova-compute[75216]: INFO nova.compute.manager [None req-134ed0c4-baef-41c7-b400-055120870c04 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 06fd14bc-508c-4d70-b7b6-f536bb2601a6] Took 9.49 seconds to build instance.
Nov 13 19:28:55 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-134ed0c4-baef-41c7-b400-055120870c04 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Lock "06fd14bc-508c-4d70-b7b6-f536bb2601a6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.607s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:28:57 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:28:59 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:29:02 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:29:07 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:29:10 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:29:12 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:29:12 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:29:12 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75216) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 19:29:12 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 19:29:12 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 19:29:12 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:29:14 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:29:17 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:29:17 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:29:19 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:29:21 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:29:22 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:29:22 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:29:22 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:29:22 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75216) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 19:29:24 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:29:25 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:29:25 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:29:25 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:29:25 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:29:25 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Auditing locally available compute resources for user (node: user) {{(pid=75216) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 19:29:25 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 19:29:25 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 19:29:25 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 19:29:25 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Hypervisor/Node resource view: name=user free_ram=9033MB free_disk=25.28331756591797GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75216) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 19:29:25 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:29:25 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:29:25 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance 06fd14bc-508c-4d70-b7b6-f536bb2601a6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 19:29:25 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 19:29:25 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 19:29:26 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 19:29:26 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 19:29:26 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Compute_service record updated for user:user {{(pid=75216) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 19:29:26 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.180s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:29:27 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:29:27 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Starting heal instance info cache {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 19:29:27 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Rebuilding the list of instances to heal {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 13 19:29:27 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "refresh_cache-06fd14bc-508c-4d70-b7b6-f536bb2601a6" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 19:29:27 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquired lock "refresh_cache-06fd14bc-508c-4d70-b7b6-f536bb2601a6" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 19:29:27 user nova-compute[75216]: DEBUG nova.network.neutron [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: 06fd14bc-508c-4d70-b7b6-f536bb2601a6] Forcefully refreshing network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 19:29:27 user nova-compute[75216]: DEBUG nova.objects.instance [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lazy-loading 'info_cache' on Instance uuid 06fd14bc-508c-4d70-b7b6-f536bb2601a6 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:29:27 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:29:27 user nova-compute[75216]: DEBUG nova.network.neutron [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: 06fd14bc-508c-4d70-b7b6-f536bb2601a6] Updating instance_info_cache with network_info: [{"id": "17485923-5f1e-4a16-9279-032f55bf4ce6", "address": "fa:16:3e:71:d7:59", "network": {"id": "5881a45c-3f28-48c4-aa8e-045b3bea3227", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1651070715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a1951a52e7c4ef5ac6a0d9d5380d41a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17485923-5f", "ovs_interfaceid": "17485923-5f1e-4a16-9279-032f55bf4ce6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:29:27 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Releasing lock "refresh_cache-06fd14bc-508c-4d70-b7b6-f536bb2601a6" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 19:29:27 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: 06fd14bc-508c-4d70-b7b6-f536bb2601a6] Updated the network info_cache for instance {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 19:29:28 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:29:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:29:33 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:29:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:29:40 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:29:42 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:29:42 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:29:42 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=75216) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 19:29:42 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 19:29:42 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 19:29:42 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:29:47 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:29:52 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:29:52 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:29:52 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75216) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 19:29:52 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 19:29:52 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 19:29:52 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:29:57 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:30:02 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:30:02 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:30:02 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75216) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 19:30:02 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 19:30:02 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 19:30:02 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:30:07 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:30:07 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:30:07 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75216) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 19:30:07 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 19:30:07 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 19:30:07 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:30:10 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:30:12 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:30:17 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:30:17 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:30:17 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75216) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 19:30:17 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 19:30:17 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 19:30:17 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:30:18 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:30:22 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:30:23 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:30:24 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:30:24 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:30:24 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75216) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 19:30:25 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:30:25 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:30:25 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:30:25 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:30:25 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Auditing locally available compute resources for user (node: user) {{(pid=75216) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 19:30:25 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 19:30:25 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 19:30:25 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 19:30:25 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Hypervisor/Node resource view: name=user free_ram=9024MB free_disk=25.282756805419922GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75216) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 19:30:25 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:30:25 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:30:26 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance 06fd14bc-508c-4d70-b7b6-f536bb2601a6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 19:30:26 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 19:30:26 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 19:30:26 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 19:30:26 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 19:30:26 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Compute_service record updated for user:user {{(pid=75216) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 19:30:26 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.163s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:30:27 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:30:27 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:30:27 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75216) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 19:30:27 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 19:30:27 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 19:30:27 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:30:29 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:30:29 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Starting heal instance info cache {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 19:30:29 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Rebuilding the list of instances to heal {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 13 19:30:29 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "refresh_cache-06fd14bc-508c-4d70-b7b6-f536bb2601a6" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 19:30:29 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquired lock "refresh_cache-06fd14bc-508c-4d70-b7b6-f536bb2601a6" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 19:30:29 user nova-compute[75216]: DEBUG nova.network.neutron [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: 06fd14bc-508c-4d70-b7b6-f536bb2601a6] Forcefully refreshing network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 19:30:29 user nova-compute[75216]: DEBUG nova.objects.instance [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lazy-loading 'info_cache' on Instance uuid 06fd14bc-508c-4d70-b7b6-f536bb2601a6 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:30:29 user nova-compute[75216]: DEBUG nova.network.neutron [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: 06fd14bc-508c-4d70-b7b6-f536bb2601a6] Updating instance_info_cache with network_info: [{"id": "17485923-5f1e-4a16-9279-032f55bf4ce6", "address": "fa:16:3e:71:d7:59", "network": {"id": "5881a45c-3f28-48c4-aa8e-045b3bea3227", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1651070715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a1951a52e7c4ef5ac6a0d9d5380d41a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17485923-5f", "ovs_interfaceid": "17485923-5f1e-4a16-9279-032f55bf4ce6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:30:29 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Releasing lock "refresh_cache-06fd14bc-508c-4d70-b7b6-f536bb2601a6" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 19:30:29 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: 06fd14bc-508c-4d70-b7b6-f536bb2601a6] Updated the network info_cache for instance {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 19:30:29 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:30:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:30:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:30:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75216) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 19:30:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 19:30:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 19:30:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:30:33 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:30:36 user nova-compute[75216]: DEBUG nova.compute.manager [req-beda4f1d-aff5-4029-943e-0ea141120a97 req-c38430f6-8182-415a-9f28-9a0bcdbf6f95 service nova] [instance: 06fd14bc-508c-4d70-b7b6-f536bb2601a6] Received event network-changed-17485923-5f1e-4a16-9279-032f55bf4ce6 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:30:36 user nova-compute[75216]: DEBUG nova.compute.manager [req-beda4f1d-aff5-4029-943e-0ea141120a97 req-c38430f6-8182-415a-9f28-9a0bcdbf6f95 service nova] [instance: 06fd14bc-508c-4d70-b7b6-f536bb2601a6] Refreshing instance network info cache due to event network-changed-17485923-5f1e-4a16-9279-032f55bf4ce6. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 19:30:36 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-beda4f1d-aff5-4029-943e-0ea141120a97 req-c38430f6-8182-415a-9f28-9a0bcdbf6f95 service nova] Acquiring lock "refresh_cache-06fd14bc-508c-4d70-b7b6-f536bb2601a6" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 19:30:36 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-beda4f1d-aff5-4029-943e-0ea141120a97 req-c38430f6-8182-415a-9f28-9a0bcdbf6f95 service nova] Acquired lock "refresh_cache-06fd14bc-508c-4d70-b7b6-f536bb2601a6" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 19:30:36 user nova-compute[75216]: DEBUG nova.network.neutron [req-beda4f1d-aff5-4029-943e-0ea141120a97 req-c38430f6-8182-415a-9f28-9a0bcdbf6f95 service nova] [instance: 06fd14bc-508c-4d70-b7b6-f536bb2601a6] Refreshing network info cache for port 17485923-5f1e-4a16-9279-032f55bf4ce6 {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 19:30:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:30:37 user nova-compute[75216]: DEBUG nova.network.neutron [req-beda4f1d-aff5-4029-943e-0ea141120a97 req-c38430f6-8182-415a-9f28-9a0bcdbf6f95 service nova] [instance: 06fd14bc-508c-4d70-b7b6-f536bb2601a6] Updated VIF entry in instance network info cache for port 17485923-5f1e-4a16-9279-032f55bf4ce6. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 19:30:37 user nova-compute[75216]: DEBUG nova.network.neutron [req-beda4f1d-aff5-4029-943e-0ea141120a97 req-c38430f6-8182-415a-9f28-9a0bcdbf6f95 service nova] [instance: 06fd14bc-508c-4d70-b7b6-f536bb2601a6] Updating instance_info_cache with network_info: [{"id": "17485923-5f1e-4a16-9279-032f55bf4ce6", "address": "fa:16:3e:71:d7:59", "network": {"id": "5881a45c-3f28-48c4-aa8e-045b3bea3227", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1651070715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a1951a52e7c4ef5ac6a0d9d5380d41a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17485923-5f", "ovs_interfaceid": "17485923-5f1e-4a16-9279-032f55bf4ce6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:30:37 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-beda4f1d-aff5-4029-943e-0ea141120a97 req-c38430f6-8182-415a-9f28-9a0bcdbf6f95 service nova] Releasing lock "refresh_cache-06fd14bc-508c-4d70-b7b6-f536bb2601a6" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 19:30:39 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:30:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:30:42 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:30:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-2cc5d780-dc41-4a24-9906-fc4130d2f5aa tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Acquiring lock "b0742004-f76a-4a9a-9485-7d32c4a6bb49" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:30:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-2cc5d780-dc41-4a24-9906-fc4130d2f5aa tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Lock "b0742004-f76a-4a9a-9485-7d32c4a6bb49" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:30:43 user nova-compute[75216]: DEBUG nova.compute.manager [None req-2cc5d780-dc41-4a24-9906-fc4130d2f5aa tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: b0742004-f76a-4a9a-9485-7d32c4a6bb49] Starting instance... {{(pid=75216) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 19:30:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-2cc5d780-dc41-4a24-9906-fc4130d2f5aa tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:30:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-2cc5d780-dc41-4a24-9906-fc4130d2f5aa tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:30:43 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-2cc5d780-dc41-4a24-9906-fc4130d2f5aa tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75216) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 19:30:43 user nova-compute[75216]: INFO nova.compute.claims [None req-2cc5d780-dc41-4a24-9906-fc4130d2f5aa tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: b0742004-f76a-4a9a-9485-7d32c4a6bb49] Claim successful on node user
Nov 13 19:30:43 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-2cc5d780-dc41-4a24-9906-fc4130d2f5aa tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 19:30:43 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-2cc5d780-dc41-4a24-9906-fc4130d2f5aa tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 19:30:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-2cc5d780-dc41-4a24-9906-fc4130d2f5aa tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.207s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:30:43 user nova-compute[75216]: DEBUG nova.compute.manager [None req-2cc5d780-dc41-4a24-9906-fc4130d2f5aa tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: b0742004-f76a-4a9a-9485-7d32c4a6bb49] Start building networks asynchronously for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 19:30:44 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-2cc5d780-dc41-4a24-9906-fc4130d2f5aa tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: b0742004-f76a-4a9a-9485-7d32c4a6bb49] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 19:30:44 user nova-compute[75216]: DEBUG nova.compute.manager [None req-2cc5d780-dc41-4a24-9906-fc4130d2f5aa tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: b0742004-f76a-4a9a-9485-7d32c4a6bb49] Allocating IP information in the background. {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 19:30:44 user nova-compute[75216]: DEBUG nova.network.neutron [None req-2cc5d780-dc41-4a24-9906-fc4130d2f5aa tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: b0742004-f76a-4a9a-9485-7d32c4a6bb49] allocate_for_instance() {{(pid=75216) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 19:30:44 user nova-compute[75216]: DEBUG nova.compute.manager [None req-2cc5d780-dc41-4a24-9906-fc4130d2f5aa tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: b0742004-f76a-4a9a-9485-7d32c4a6bb49] Start building block device mappings for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 19:30:44 user nova-compute[75216]: INFO nova.virt.block_device [None req-2cc5d780-dc41-4a24-9906-fc4130d2f5aa tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: b0742004-f76a-4a9a-9485-7d32c4a6bb49] Booting with volume snapshot 28d3c3d7-cc58-4afb-9907-cf586b1bd33f at /dev/vda
Nov 13 19:30:44 user nova-compute[75216]: DEBUG nova.policy [None req-2cc5d780-dc41-4a24-9906-fc4130d2f5aa tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bfc6b02c16664b8dbea3a6f2088ec385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1951a52e7c4ef5ac6a0d9d5380d41a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75216) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 19:30:44 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:30:44 user nova-compute[75216]: DEBUG nova.network.neutron [None req-2cc5d780-dc41-4a24-9906-fc4130d2f5aa tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: b0742004-f76a-4a9a-9485-7d32c4a6bb49] Successfully created port: f401ace9-8d39-4567-bf98-a1f1365a238e {{(pid=75216) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 19:30:45 user nova-compute[75216]: DEBUG nova.network.neutron [None req-2cc5d780-dc41-4a24-9906-fc4130d2f5aa tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: b0742004-f76a-4a9a-9485-7d32c4a6bb49] Successfully updated port: f401ace9-8d39-4567-bf98-a1f1365a238e {{(pid=75216) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 19:30:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-2cc5d780-dc41-4a24-9906-fc4130d2f5aa tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Acquiring lock "refresh_cache-b0742004-f76a-4a9a-9485-7d32c4a6bb49" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 19:30:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-2cc5d780-dc41-4a24-9906-fc4130d2f5aa tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Acquired lock "refresh_cache-b0742004-f76a-4a9a-9485-7d32c4a6bb49" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 19:30:45 user nova-compute[75216]: DEBUG nova.network.neutron [None req-2cc5d780-dc41-4a24-9906-fc4130d2f5aa tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: b0742004-f76a-4a9a-9485-7d32c4a6bb49] Building network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 19:30:45 user nova-compute[75216]: DEBUG nova.compute.manager [req-e15413fe-d2d7-4ac8-997d-7dd7b77d4d76 req-f9c3fcf1-e2ec-49d9-8619-c271b1ee826f service nova] [instance: b0742004-f76a-4a9a-9485-7d32c4a6bb49] Received event network-changed-f401ace9-8d39-4567-bf98-a1f1365a238e {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:30:45 user nova-compute[75216]: DEBUG nova.compute.manager [req-e15413fe-d2d7-4ac8-997d-7dd7b77d4d76 req-f9c3fcf1-e2ec-49d9-8619-c271b1ee826f service nova] [instance: b0742004-f76a-4a9a-9485-7d32c4a6bb49] Refreshing instance network info cache due to event network-changed-f401ace9-8d39-4567-bf98-a1f1365a238e. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 19:30:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-e15413fe-d2d7-4ac8-997d-7dd7b77d4d76 req-f9c3fcf1-e2ec-49d9-8619-c271b1ee826f service nova] Acquiring lock "refresh_cache-b0742004-f76a-4a9a-9485-7d32c4a6bb49" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 19:30:45 user nova-compute[75216]: DEBUG nova.network.neutron [None req-2cc5d780-dc41-4a24-9906-fc4130d2f5aa tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: b0742004-f76a-4a9a-9485-7d32c4a6bb49] Instance cache missing network info. {{(pid=75216) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 19:30:45 user nova-compute[75216]: DEBUG nova.network.neutron [None req-2cc5d780-dc41-4a24-9906-fc4130d2f5aa tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: b0742004-f76a-4a9a-9485-7d32c4a6bb49] Updating instance_info_cache with network_info: [{"id": "f401ace9-8d39-4567-bf98-a1f1365a238e", "address": "fa:16:3e:55:0e:f8", "network": {"id": "5881a45c-3f28-48c4-aa8e-045b3bea3227", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1651070715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a1951a52e7c4ef5ac6a0d9d5380d41a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf401ace9-8d", "ovs_interfaceid": "f401ace9-8d39-4567-bf98-a1f1365a238e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:30:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-2cc5d780-dc41-4a24-9906-fc4130d2f5aa tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Releasing lock "refresh_cache-b0742004-f76a-4a9a-9485-7d32c4a6bb49" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 19:30:45 user nova-compute[75216]: DEBUG nova.compute.manager [None req-2cc5d780-dc41-4a24-9906-fc4130d2f5aa tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: b0742004-f76a-4a9a-9485-7d32c4a6bb49] Instance network_info: |[{"id": "f401ace9-8d39-4567-bf98-a1f1365a238e", "address": "fa:16:3e:55:0e:f8", "network": {"id": "5881a45c-3f28-48c4-aa8e-045b3bea3227", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1651070715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a1951a52e7c4ef5ac6a0d9d5380d41a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf401ace9-8d", "ovs_interfaceid": "f401ace9-8d39-4567-bf98-a1f1365a238e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 19:30:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-e15413fe-d2d7-4ac8-997d-7dd7b77d4d76 req-f9c3fcf1-e2ec-49d9-8619-c271b1ee826f service nova] Acquired lock "refresh_cache-b0742004-f76a-4a9a-9485-7d32c4a6bb49" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 19:30:45 user nova-compute[75216]: DEBUG nova.network.neutron [req-e15413fe-d2d7-4ac8-997d-7dd7b77d4d76 req-f9c3fcf1-e2ec-49d9-8619-c271b1ee826f service nova] [instance: b0742004-f76a-4a9a-9485-7d32c4a6bb49] Refreshing network info cache for port f401ace9-8d39-4567-bf98-a1f1365a238e {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 19:30:46 user nova-compute[75216]: DEBUG nova.network.neutron [req-e15413fe-d2d7-4ac8-997d-7dd7b77d4d76 req-f9c3fcf1-e2ec-49d9-8619-c271b1ee826f service nova] [instance: b0742004-f76a-4a9a-9485-7d32c4a6bb49] Updated VIF entry in instance network info cache for port f401ace9-8d39-4567-bf98-a1f1365a238e. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 19:30:46 user nova-compute[75216]: DEBUG nova.network.neutron [req-e15413fe-d2d7-4ac8-997d-7dd7b77d4d76 req-f9c3fcf1-e2ec-49d9-8619-c271b1ee826f service nova] [instance: b0742004-f76a-4a9a-9485-7d32c4a6bb49] Updating instance_info_cache with network_info: [{"id": "f401ace9-8d39-4567-bf98-a1f1365a238e", "address": "fa:16:3e:55:0e:f8", "network": {"id": "5881a45c-3f28-48c4-aa8e-045b3bea3227", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1651070715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a1951a52e7c4ef5ac6a0d9d5380d41a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf401ace9-8d", "ovs_interfaceid": "f401ace9-8d39-4567-bf98-a1f1365a238e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:30:46 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-e15413fe-d2d7-4ac8-997d-7dd7b77d4d76 req-f9c3fcf1-e2ec-49d9-8619-c271b1ee826f service nova] Releasing lock "refresh_cache-b0742004-f76a-4a9a-9485-7d32c4a6bb49" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 19:30:47 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:30:50 user nova-compute[75216]: DEBUG os_brick.utils [None req-2cc5d780-dc41-4a24-9906-fc4130d2f5aa tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 19:30:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:30:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:30:50 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[5039034b-5df5-4ac3-92de-879a86e5a96d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aea6fcfe14b9\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:30:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:30:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:30:50 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bd44afd-c3aa-4feb-a473-9eb452dc3350]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:30:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:30:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:30:50 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[790f84b4-04f4-40b4-9729-36f557a10057]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:30:50 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c4e25eb-5a54-48a3-9d61-77f1febb2655]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:30:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-2cc5d780-dc41-4a24-9906-fc4130d2f5aa tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Running cmd (subprocess): nvme version {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:30:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-2cc5d780-dc41-4a24-9906-fc4130d2f5aa tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] 'nvme version' failed. Not Retrying. {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 19:30:50 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2cc5d780-dc41-4a24-9906-fc4130d2f5aa tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] nvme not present on system {{(pid=75216) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 19:30:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:30:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 19:30:50 user nova-compute[75216]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 19:30:50 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[a38c1561-4588-4b72-b7f6-e80ed04f9102]: (4, '') {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:30:50 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-2cc5d780-dc41-4a24-9906-fc4130d2f5aa tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75216) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 19:30:50 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-2cc5d780-dc41-4a24-9906-fc4130d2f5aa tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 19:30:50 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-2cc5d780-dc41-4a24-9906-fc4130d2f5aa tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] LIGHTOS: no hostnqn found. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 19:30:50 user nova-compute[75216]: DEBUG os_brick.utils [None req-2cc5d780-dc41-4a24-9906-fc4130d2f5aa tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aea6fcfe14b9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 19:30:50 user nova-compute[75216]: DEBUG nova.virt.block_device [None req-2cc5d780-dc41-4a24-9906-fc4130d2f5aa tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: b0742004-f76a-4a9a-9485-7d32c4a6bb49] Updating existing volume attachment record: eac385c0-8bf7-41eb-879d-899449f0672b {{(pid=75216) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 19:30:52 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:30:54 user nova-compute[75216]: DEBUG nova.compute.manager [None req-2cc5d780-dc41-4a24-9906-fc4130d2f5aa tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: b0742004-f76a-4a9a-9485-7d32c4a6bb49] Start spawning the instance on the hypervisor. {{(pid=75216) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 19:30:54 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-2cc5d780-dc41-4a24-9906-fc4130d2f5aa tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: b0742004-f76a-4a9a-9485-7d32c4a6bb49] Creating instance directory {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 19:30:54 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-2cc5d780-dc41-4a24-9906-fc4130d2f5aa tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: b0742004-f76a-4a9a-9485-7d32c4a6bb49] Creating image(s)
Nov 13 19:30:54 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-2cc5d780-dc41-4a24-9906-fc4130d2f5aa tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: b0742004-f76a-4a9a-9485-7d32c4a6bb49] Did not create local disks {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 13 19:30:54 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-2cc5d780-dc41-4a24-9906-fc4130d2f5aa tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: b0742004-f76a-4a9a-9485-7d32c4a6bb49] Ensure instance console log exists: /opt/stack/data/nova/instances/b0742004-f76a-4a9a-9485-7d32c4a6bb49/console.log {{(pid=75216) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 19:30:54 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-2cc5d780-dc41-4a24-9906-fc4130d2f5aa tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:30:54 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-2cc5d780-dc41-4a24-9906-fc4130d2f5aa tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:30:54 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-2cc5d780-dc41-4a24-9906-fc4130d2f5aa tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:30:54 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-2cc5d780-dc41-4a24-9906-fc4130d2f5aa tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: b0742004-f76a-4a9a-9485-7d32c4a6bb49] Start _get_guest_xml network_info=[{"id": "f401ace9-8d39-4567-bf98-a1f1365a238e", "address": "fa:16:3e:55:0e:f8", "network": {"id": "5881a45c-3f28-48c4-aa8e-045b3bea3227", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1651070715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a1951a52e7c4ef5ac6a0d9d5380d41a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf401ace9-8d", "ovs_interfaceid": "f401ace9-8d39-4567-bf98-a1f1365a238e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-13T19:30:39Z,direct_url=<?>,disk_format='qcow2',id=d7f2e8ea-e700-44bc-9c08-cd495016efac,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1558141886',owner='3a1951a52e7c4ef5ac6a0d9d5380d41a',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-13T19:30:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5c75fd9b-b53c-4f66-b91b-536cd6f4fe5c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VRLwGxgc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b0742004-f76a-4a9a-9485-7d32c4a6bb49', 'attached_at': '', 'detached_at': '', 'volume_id': '5c75fd9b-b53c-4f66-b91b-536cd6f4fe5c', 'serial': '5c75fd9b-b53c-4f66-b91b-536cd6f4fe5c'}, 'attachment_id': 'eac385c0-8bf7-41eb-879d-899449f0672b', 'guest_format': None, 'mount_device': '/dev/vda', 'delete_on_termination': True, 'boot_index': 0, 'volume_type': None} {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 19:30:54 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-2cc5d780-dc41-4a24-9906-fc4130d2f5aa tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 19:30:54 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-2cc5d780-dc41-4a24-9906-fc4130d2f5aa tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 19:30:54 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-2cc5d780-dc41-4a24-9906-fc4130d2f5aa tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 19:30:54 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-2cc5d780-dc41-4a24-9906-fc4130d2f5aa tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] CPU controller missing on host. {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 19:30:54 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:30:54 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-2cc5d780-dc41-4a24-9906-fc4130d2f5aa tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 19:30:54 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-2cc5d780-dc41-4a24-9906-fc4130d2f5aa tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] CPU controller found on host. {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 19:30:54 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-2cc5d780-dc41-4a24-9906-fc4130d2f5aa tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75216) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 19:30:54 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-2cc5d780-dc41-4a24-9906-fc4130d2f5aa tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T18:40:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-13T19:30:39Z,direct_url=<?>,disk_format='qcow2',id=d7f2e8ea-e700-44bc-9c08-cd495016efac,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1558141886',owner='3a1951a52e7c4ef5ac6a0d9d5380d41a',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-13T19:30:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 19:30:54 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-2cc5d780-dc41-4a24-9906-fc4130d2f5aa tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Flavor limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 19:30:54 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-2cc5d780-dc41-4a24-9906-fc4130d2f5aa tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Image limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 19:30:54 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-2cc5d780-dc41-4a24-9906-fc4130d2f5aa tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Flavor pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 19:30:54 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-2cc5d780-dc41-4a24-9906-fc4130d2f5aa tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Image pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 19:30:54 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-2cc5d780-dc41-4a24-9906-fc4130d2f5aa tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 19:30:54 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-2cc5d780-dc41-4a24-9906-fc4130d2f5aa tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 19:30:54 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-2cc5d780-dc41-4a24-9906-fc4130d2f5aa tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 19:30:54 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-2cc5d780-dc41-4a24-9906-fc4130d2f5aa tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Got 1 possible topologies {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 19:30:54 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-2cc5d780-dc41-4a24-9906-fc4130d2f5aa tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 19:30:54 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-2cc5d780-dc41-4a24-9906-fc4130d2f5aa tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 19:30:54 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2cc5d780-dc41-4a24-9906-fc4130d2f5aa tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: b0742004-f76a-4a9a-9485-7d32c4a6bb49] Calling os-brick to attach iSCSI Volume {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 19:30:54 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cc5d780-dc41-4a24-9906-fc4130d2f5aa tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3a8669e40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5c75fd9b-b53c-4f66-b91b-536cd6f4fe5c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VRLwGxgc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 19:30:54 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-2cc5d780-dc41-4a24-9906-fc4130d2f5aa tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 19:30:54 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-2cc5d780-dc41-4a24-9906-fc4130d2f5aa tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 19:30:54 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-2cc5d780-dc41-4a24-9906-fc4130d2f5aa tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 19:30:54 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-2cc5d780-dc41-4a24-9906-fc4130d2f5aa tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 19:30:54 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-2cc5d780-dc41-4a24-9906-fc4130d2f5aa tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5c75fd9b-b53c-4f66-b91b-536cd6f4fe5c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 19:30:54 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-2cc5d780-dc41-4a24-9906-fc4130d2f5aa tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5c75fd9b-b53c-4f66-b91b-536cd6f4fe5c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 19:30:54 user nova-compute[75216]: INFO os_brick.initiator.connectors.iscsi [None req-2cc5d780-dc41-4a24-9906-fc4130d2f5aa tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 19:30:54 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c75fd9b-b53c-4f66-b91b-536cd6f4fe5c -p 172.16.0.220:3260 {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:30:54 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c75fd9b-b53c-4f66-b91b-536cd6f4fe5c -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:30:54 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f2e6737-b197-4f48-ab3a-d7164dbaacda]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:30:54 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cc5d780-dc41-4a24-9906-fc4130d2f5aa tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 19:30:54 user nova-compute[75216]:  {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:30:54 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c75fd9b-b53c-4f66-b91b-536cd6f4fe5c -p 172.16.0.220:3260 --interface default --op new {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:30:54 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c75fd9b-b53c-4f66-b91b-536cd6f4fe5c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:30:54 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7551daa-67ad-4ec6-ae39-c530a582866f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5c75fd9b-b53c-4f66-b91b-536cd6f4fe5c] added\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:30:54 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cc5d780-dc41-4a24-9906-fc4130d2f5aa tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5c75fd9b-b53c-4f66-b91b-536cd6f4fe5c] added
Nov 13 19:30:54 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:30:54 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c75fd9b-b53c-4f66-b91b-536cd6f4fe5c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:30:54 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c75fd9b-b53c-4f66-b91b-536cd6f4fe5c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:30:54 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d321eb3-bef4-45ab-8370-e5eb463b2205]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:30:54 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cc5d780-dc41-4a24-9906-fc4130d2f5aa tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:30:54 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c75fd9b-b53c-4f66-b91b-536cd6f4fe5c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:30:54 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c75fd9b-b53c-4f66-b91b-536cd6f4fe5c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:30:54 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd691d1c-1dcf-457e-ab67-103024f7b710]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:30:54 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cc5d780-dc41-4a24-9906-fc4130d2f5aa tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:30:54 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c75fd9b-b53c-4f66-b91b-536cd6f4fe5c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VRLwGxgc {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:30:54 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c75fd9b-b53c-4f66-b91b-536cd6f4fe5c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VRLwGxgc" returned: 0 in 0.017s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:30:54 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[746df7be-7991-4163-8e93-c14ed15a5330]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:30:54 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cc5d780-dc41-4a24-9906-fc4130d2f5aa tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VRLwGxgc'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:30:54 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c75fd9b-b53c-4f66-b91b-536cd6f4fe5c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:30:54 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c75fd9b-b53c-4f66-b91b-536cd6f4fe5c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:30:54 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[d98ffeda-3e69-4c35-9380-46cea9aa3cd6]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:30:54 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cc5d780-dc41-4a24-9906-fc4130d2f5aa tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:30:54 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:30:54 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:30:54 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[e858651b-c43e-4bb8-994f-3fd80b6f44b5]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bb8e1a0-1257-4491-b9ef-d8b8e07ef1f7 (non-flash)\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:30:54 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cc5d780-dc41-4a24-9906-fc4130d2f5aa tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bb8e1a0-1257-4491-b9ef-d8b8e07ef1f7 (non-flash)
Nov 13 19:30:54 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 19:30:54 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cc5d780-dc41-4a24-9906-fc4130d2f5aa tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bb8e1a0-1257-4491-b9ef-d8b8e07ef1f7 (non-flash)
Nov 13 19:30:54 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 19:30:54 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c75fd9b-b53c-4f66-b91b-536cd6f4fe5c -p 172.16.0.220:3260 --login {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:30:54 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c75fd9b-b53c-4f66-b91b-536cd6f4fe5c -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:30:54 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f552b34-d582-4d99-9328-df8c0b8b1c4a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5c75fd9b-b53c-4f66-b91b-536cd6f4fe5c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5c75fd9b-b53c-4f66-b91b-536cd6f4fe5c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:30:54 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cc5d780-dc41-4a24-9906-fc4130d2f5aa tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5c75fd9b-b53c-4f66-b91b-536cd6f4fe5c, portal: 172.16.0.220,3260]
Nov 13 19:30:54 user nova-compute[75216]: Login to [iface: default, target: iqn.2010-10.org.openstack:5c75fd9b-b53c-4f66-b91b-536cd6f4fe5c, portal: 172.16.0.220,3260] successful.
Nov 13 19:30:54 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:30:54 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c75fd9b-b53c-4f66-b91b-536cd6f4fe5c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:30:54 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c75fd9b-b53c-4f66-b91b-536cd6f4fe5c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:30:54 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf8fbf29-40d1-47a9-8f22-755dd388d4a4]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:30:54 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cc5d780-dc41-4a24-9906-fc4130d2f5aa tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:30:54 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:30:54 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:30:54 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[5102f31c-b8ea-42ea-88a1-c5b03b48a734]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bb8e1a0-1257-4491-b9ef-d8b8e07ef1f7 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c75fd9b-b53c-4f66-b91b-536cd6f4fe5c (non-flash)\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:30:54 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cc5d780-dc41-4a24-9906-fc4130d2f5aa tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bb8e1a0-1257-4491-b9ef-d8b8e07ef1f7 (non-flash)
Nov 13 19:30:54 user nova-compute[75216]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c75fd9b-b53c-4f66-b91b-536cd6f4fe5c (non-flash)
Nov 13 19:30:54 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 19:30:54 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cc5d780-dc41-4a24-9906-fc4130d2f5aa tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bb8e1a0-1257-4491-b9ef-d8b8e07ef1f7 (non-flash)
Nov 13 19:30:54 user nova-compute[75216]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c75fd9b-b53c-4f66-b91b-536cd6f4fe5c (non-flash)
Nov 13 19:30:54 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 19:30:54 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-2cc5d780-dc41-4a24-9906-fc4130d2f5aa tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5c75fd9b-b53c-4f66-b91b-536cd6f4fe5c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.251s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 19:30:54 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cc5d780-dc41-4a24-9906-fc4130d2f5aa tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Connected to 172.16.0.220:3260 {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 19:30:54 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-2cc5d780-dc41-4a24-9906-fc4130d2f5aa tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] HCTL ('34', '-', '-', 0) found on session 56 with lun 0 {{(pid=75216) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 19:30:54 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-2cc5d780-dc41-4a24-9906-fc4130d2f5aa tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75216) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 19:30:54 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:30:54 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:30:54 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d4a46d7-fad1-4fe8-a5c6-64cb7d96e479]: (4, ('- - 0', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:30:54 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-2cc5d780-dc41-4a24-9906-fc4130d2f5aa tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Searching for a device in session 56 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75216) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 19:30:54 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cc5d780-dc41-4a24-9906-fc4130d2f5aa tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:5c75fd9b-b53c-4f66-b91b-536cd6f4fe5c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VRLwGxgc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 19:30:55 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-2cc5d780-dc41-4a24-9906-fc4130d2f5aa tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.281s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 19:30:55 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cc5d780-dc41-4a24-9906-fc4130d2f5aa tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] <== connect_volume: return (1283ms) {'type': 'block', 'scsi_wwn': '23266363933393565', 'path': '/dev/sdc'} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 19:30:55 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2cc5d780-dc41-4a24-9906-fc4130d2f5aa tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: b0742004-f76a-4a9a-9485-7d32c4a6bb49] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23266363933393565', 'path': '/dev/sdc'} {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 19:30:55 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-2cc5d780-dc41-4a24-9906-fc4130d2f5aa tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T19:30:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-222133674',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-222133674',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-222133674',id=48,image_ref='d7f2e8ea-e700-44bc-9c08-cd495016efac',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK8aceXcTDmg8S1l/FpjiPhPh0S22tZa/ph87yqreHK4AHbqn04tiBaDtOWnOSKvCm1yxuH7GVcMW5DzJ7XZ8EpSPVqWp7eHAuoqIcdaLdEKTMwAQz7zC7w7gcJdnefQiQ==',key_name='tempest-keypair-1117035065',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3a1951a52e7c4ef5ac6a0d9d5380d41a',ramdisk_id='',reservation_id='r-d0l02mp5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1444343509',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1444343509-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1444343509',owner_user_name='tempest-TestVolumeBootPattern-1444343509-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T19:30:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bfc6b02c16664b8dbea3a6f2088ec385',uuid=b0742004-f76a-4a9a-9485-7d32c4a6bb49,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f401ace9-8d39-4567-bf98-a1f1365a238e", "address": "fa:16:3e:55:0e:f8", "network": {"id": "5881a45c-3f28-48c4-aa8e-045b3bea3227", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1651070715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a1951a52e7c4ef5ac6a0d9d5380d41a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf401ace9-8d", "ovs_interfaceid": "f401ace9-8d39-4567-bf98-a1f1365a238e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75216) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 19:30:55 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-2cc5d780-dc41-4a24-9906-fc4130d2f5aa tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Converting VIF {"id": "f401ace9-8d39-4567-bf98-a1f1365a238e", "address": "fa:16:3e:55:0e:f8", "network": {"id": "5881a45c-3f28-48c4-aa8e-045b3bea3227", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1651070715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a1951a52e7c4ef5ac6a0d9d5380d41a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf401ace9-8d", "ovs_interfaceid": "f401ace9-8d39-4567-bf98-a1f1365a238e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 19:30:55 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-2cc5d780-dc41-4a24-9906-fc4130d2f5aa tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:55:0e:f8,bridge_name='br-int',has_traffic_filtering=True,id=f401ace9-8d39-4567-bf98-a1f1365a238e,network=Network(5881a45c-3f28-48c4-aa8e-045b3bea3227),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf401ace9-8d') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 19:30:55 user nova-compute[75216]: DEBUG nova.objects.instance [None req-2cc5d780-dc41-4a24-9906-fc4130d2f5aa tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Lazy-loading 'pci_devices' on Instance uuid b0742004-f76a-4a9a-9485-7d32c4a6bb49 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:30:55 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-2cc5d780-dc41-4a24-9906-fc4130d2f5aa tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: b0742004-f76a-4a9a-9485-7d32c4a6bb49] End _get_guest_xml xml=<domain type="kvm">
Nov 13 19:30:55 user nova-compute[75216]:   <uuid>b0742004-f76a-4a9a-9485-7d32c4a6bb49</uuid>
Nov 13 19:30:55 user nova-compute[75216]:   <name>instance-00000030</name>
Nov 13 19:30:55 user nova-compute[75216]:   <memory>524288</memory>
Nov 13 19:30:55 user nova-compute[75216]:   <vcpu>1</vcpu>
Nov 13 19:30:55 user nova-compute[75216]:   <metadata>
Nov 13 19:30:55 user nova-compute[75216]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 19:30:55 user nova-compute[75216]:       <nova:package version="0.0.0"/>
Nov 13 19:30:55 user nova-compute[75216]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-222133674</nova:name>
Nov 13 19:30:55 user nova-compute[75216]:       <nova:creationTime>2023-11-13 19:30:54</nova:creationTime>
Nov 13 19:30:55 user nova-compute[75216]:       <nova:flavor name="m1.tiny">
Nov 13 19:30:55 user nova-compute[75216]:         <nova:memory>512</nova:memory>
Nov 13 19:30:55 user nova-compute[75216]:         <nova:disk>1</nova:disk>
Nov 13 19:30:55 user nova-compute[75216]:         <nova:swap>0</nova:swap>
Nov 13 19:30:55 user nova-compute[75216]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 19:30:55 user nova-compute[75216]:         <nova:vcpus>1</nova:vcpus>
Nov 13 19:30:55 user nova-compute[75216]:       </nova:flavor>
Nov 13 19:30:55 user nova-compute[75216]:       <nova:owner>
Nov 13 19:30:55 user nova-compute[75216]:         <nova:user uuid="bfc6b02c16664b8dbea3a6f2088ec385">tempest-TestVolumeBootPattern-1444343509-project-member</nova:user>
Nov 13 19:30:55 user nova-compute[75216]:         <nova:project uuid="3a1951a52e7c4ef5ac6a0d9d5380d41a">tempest-TestVolumeBootPattern-1444343509</nova:project>
Nov 13 19:30:55 user nova-compute[75216]:       </nova:owner>
Nov 13 19:30:55 user nova-compute[75216]:       <nova:root type="image" uuid="d7f2e8ea-e700-44bc-9c08-cd495016efac"/>
Nov 13 19:30:55 user nova-compute[75216]:       <nova:ports>
Nov 13 19:30:55 user nova-compute[75216]:         <nova:port uuid="f401ace9-8d39-4567-bf98-a1f1365a238e">
Nov 13 19:30:55 user nova-compute[75216]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 13 19:30:55 user nova-compute[75216]:         </nova:port>
Nov 13 19:30:55 user nova-compute[75216]:       </nova:ports>
Nov 13 19:30:55 user nova-compute[75216]:     </nova:instance>
Nov 13 19:30:55 user nova-compute[75216]:   </metadata>
Nov 13 19:30:55 user nova-compute[75216]:   <sysinfo type="smbios">
Nov 13 19:30:55 user nova-compute[75216]:     <system>
Nov 13 19:30:55 user nova-compute[75216]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 19:30:55 user nova-compute[75216]:       <entry name="product">OpenStack Nova</entry>
Nov 13 19:30:55 user nova-compute[75216]:       <entry name="version">0.0.0</entry>
Nov 13 19:30:55 user nova-compute[75216]:       <entry name="serial">b0742004-f76a-4a9a-9485-7d32c4a6bb49</entry>
Nov 13 19:30:55 user nova-compute[75216]:       <entry name="uuid">b0742004-f76a-4a9a-9485-7d32c4a6bb49</entry>
Nov 13 19:30:55 user nova-compute[75216]:       <entry name="family">Virtual Machine</entry>
Nov 13 19:30:55 user nova-compute[75216]:     </system>
Nov 13 19:30:55 user nova-compute[75216]:   </sysinfo>
Nov 13 19:30:55 user nova-compute[75216]:   <os>
Nov 13 19:30:55 user nova-compute[75216]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 19:30:55 user nova-compute[75216]:     <boot dev="hd"/>
Nov 13 19:30:55 user nova-compute[75216]:     <smbios mode="sysinfo"/>
Nov 13 19:30:55 user nova-compute[75216]:   </os>
Nov 13 19:30:55 user nova-compute[75216]:   <features>
Nov 13 19:30:55 user nova-compute[75216]:     <acpi/>
Nov 13 19:30:55 user nova-compute[75216]:     <apic/>
Nov 13 19:30:55 user nova-compute[75216]:     <vmcoreinfo/>
Nov 13 19:30:55 user nova-compute[75216]:   </features>
Nov 13 19:30:55 user nova-compute[75216]:   <clock offset="utc">
Nov 13 19:30:55 user nova-compute[75216]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 19:30:55 user nova-compute[75216]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 19:30:55 user nova-compute[75216]:     <timer name="hpet" present="no"/>
Nov 13 19:30:55 user nova-compute[75216]:   </clock>
Nov 13 19:30:55 user nova-compute[75216]:   <cpu mode="custom" match="exact">
Nov 13 19:30:55 user nova-compute[75216]:     <model>Nehalem</model>
Nov 13 19:30:55 user nova-compute[75216]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 19:30:55 user nova-compute[75216]:   </cpu>
Nov 13 19:30:55 user nova-compute[75216]:   <devices>
Nov 13 19:30:55 user nova-compute[75216]:     <disk type="block" device="disk">
Nov 13 19:30:55 user nova-compute[75216]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 19:30:55 user nova-compute[75216]:       <source dev="/dev/sdc"/>
Nov 13 19:30:55 user nova-compute[75216]:       <target dev="vda" bus="virtio"/>
Nov 13 19:30:55 user nova-compute[75216]:       <serial>5c75fd9b-b53c-4f66-b91b-536cd6f4fe5c</serial>
Nov 13 19:30:55 user nova-compute[75216]:     </disk>
Nov 13 19:30:55 user nova-compute[75216]:     <interface type="ethernet">
Nov 13 19:30:55 user nova-compute[75216]:       <mac address="fa:16:3e:55:0e:f8"/>
Nov 13 19:30:55 user nova-compute[75216]:       <model type="virtio"/>
Nov 13 19:30:55 user nova-compute[75216]:       <mtu size="1442"/>
Nov 13 19:30:55 user nova-compute[75216]:       <target dev="tapf401ace9-8d"/>
Nov 13 19:30:55 user nova-compute[75216]:     </interface>
Nov 13 19:30:55 user nova-compute[75216]:     <serial type="pty">
Nov 13 19:30:55 user nova-compute[75216]:       <log file="/opt/stack/data/nova/instances/b0742004-f76a-4a9a-9485-7d32c4a6bb49/console.log" append="off"/>
Nov 13 19:30:55 user nova-compute[75216]:     </serial>
Nov 13 19:30:55 user nova-compute[75216]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 19:30:55 user nova-compute[75216]:     <video>
Nov 13 19:30:55 user nova-compute[75216]:       <model type="virtio"/>
Nov 13 19:30:55 user nova-compute[75216]:     </video>
Nov 13 19:30:55 user nova-compute[75216]:     <rng model="virtio">
Nov 13 19:30:55 user nova-compute[75216]:       <backend model="random">/dev/urandom</backend>
Nov 13 19:30:55 user nova-compute[75216]:     </rng>
Nov 13 19:30:55 user nova-compute[75216]:     <controller type="usb" index="0" model="none"/>
Nov 13 19:30:55 user nova-compute[75216]:     <memballoon model="virtio">
Nov 13 19:30:55 user nova-compute[75216]:       <stats period="10"/>
Nov 13 19:30:55 user nova-compute[75216]:     </memballoon>
Nov 13 19:30:55 user nova-compute[75216]:   </devices>
Nov 13 19:30:55 user nova-compute[75216]: </domain>
Nov 13 19:30:55 user nova-compute[75216]:  {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 19:30:55 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-2cc5d780-dc41-4a24-9906-fc4130d2f5aa tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T19:30:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-222133674',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-222133674',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-222133674',id=48,image_ref='d7f2e8ea-e700-44bc-9c08-cd495016efac',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK8aceXcTDmg8S1l/FpjiPhPh0S22tZa/ph87yqreHK4AHbqn04tiBaDtOWnOSKvCm1yxuH7GVcMW5DzJ7XZ8EpSPVqWp7eHAuoqIcdaLdEKTMwAQz7zC7w7gcJdnefQiQ==',key_name='tempest-keypair-1117035065',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3a1951a52e7c4ef5ac6a0d9d5380d41a',ramdisk_id='',reservation_id='r-d0l02mp5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1444343509',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1444343509-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1444343509',owner_user_name='tempest-TestVolumeBootPattern-1444343509-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T19:30:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bfc6b02c16664b8dbea3a6f2088ec385',uuid=b0742004-f76a-4a9a-9485-7d32c4a6bb49,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f401ace9-8d39-4567-bf98-a1f1365a238e", "address": "fa:16:3e:55:0e:f8", "network": {"id": "5881a45c-3f28-48c4-aa8e-045b3bea3227", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1651070715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a1951a52e7c4ef5ac6a0d9d5380d41a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf401ace9-8d", "ovs_interfaceid": "f401ace9-8d39-4567-bf98-a1f1365a238e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 19:30:55 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-2cc5d780-dc41-4a24-9906-fc4130d2f5aa tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Converting VIF {"id": "f401ace9-8d39-4567-bf98-a1f1365a238e", "address": "fa:16:3e:55:0e:f8", "network": {"id": "5881a45c-3f28-48c4-aa8e-045b3bea3227", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1651070715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a1951a52e7c4ef5ac6a0d9d5380d41a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf401ace9-8d", "ovs_interfaceid": "f401ace9-8d39-4567-bf98-a1f1365a238e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 19:30:55 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-2cc5d780-dc41-4a24-9906-fc4130d2f5aa tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:55:0e:f8,bridge_name='br-int',has_traffic_filtering=True,id=f401ace9-8d39-4567-bf98-a1f1365a238e,network=Network(5881a45c-3f28-48c4-aa8e-045b3bea3227),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf401ace9-8d') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 19:30:55 user nova-compute[75216]: DEBUG os_vif [None req-2cc5d780-dc41-4a24-9906-fc4130d2f5aa tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:0e:f8,bridge_name='br-int',has_traffic_filtering=True,id=f401ace9-8d39-4567-bf98-a1f1365a238e,network=Network(5881a45c-3f28-48c4-aa8e-045b3bea3227),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf401ace9-8d') {{(pid=75216) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 19:30:55 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:30:55 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:30:55 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 19:30:55 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:30:55 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7e21bd00-d89f-5959-b441-3ee1e2c7e0b9', '_type': 'linux-noop'}}, row=False) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:30:55 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:30:55 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:30:55 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:30:55 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf401ace9-8d, may_exist=True, interface_attrs={}) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:30:55 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf401ace9-8d, col_values=(('qos', UUID('f14dbcec-2f3b-4ec5-ba8e-d38c5bc00c68')),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:30:55 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf401ace9-8d, col_values=(('external_ids', {'iface-id': 'f401ace9-8d39-4567-bf98-a1f1365a238e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:55:0e:f8', 'vm-uuid': 'b0742004-f76a-4a9a-9485-7d32c4a6bb49'}),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:30:55 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:30:55 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:30:55 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:30:55 user nova-compute[75216]: INFO os_vif [None req-2cc5d780-dc41-4a24-9906-fc4130d2f5aa tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:0e:f8,bridge_name='br-int',has_traffic_filtering=True,id=f401ace9-8d39-4567-bf98-a1f1365a238e,network=Network(5881a45c-3f28-48c4-aa8e-045b3bea3227),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf401ace9-8d')
Nov 13 19:30:55 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-2cc5d780-dc41-4a24-9906-fc4130d2f5aa tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 19:30:55 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-2cc5d780-dc41-4a24-9906-fc4130d2f5aa tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] No VIF found with MAC fa:16:3e:55:0e:f8, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 19:30:57 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:30:57 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:30:57 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:30:57 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:30:57 user nova-compute[75216]: DEBUG nova.compute.manager [req-1ebd7a01-2bac-4d6b-96ab-24c053593acd req-1669b7b5-0fb3-433f-a5be-9e970b8d219b service nova] [instance: b0742004-f76a-4a9a-9485-7d32c4a6bb49] Received event network-vif-plugged-f401ace9-8d39-4567-bf98-a1f1365a238e {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:30:57 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-1ebd7a01-2bac-4d6b-96ab-24c053593acd req-1669b7b5-0fb3-433f-a5be-9e970b8d219b service nova] Acquiring lock "b0742004-f76a-4a9a-9485-7d32c4a6bb49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:30:57 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-1ebd7a01-2bac-4d6b-96ab-24c053593acd req-1669b7b5-0fb3-433f-a5be-9e970b8d219b service nova] Lock "b0742004-f76a-4a9a-9485-7d32c4a6bb49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:30:57 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-1ebd7a01-2bac-4d6b-96ab-24c053593acd req-1669b7b5-0fb3-433f-a5be-9e970b8d219b service nova] Lock "b0742004-f76a-4a9a-9485-7d32c4a6bb49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:30:57 user nova-compute[75216]: DEBUG nova.compute.manager [req-1ebd7a01-2bac-4d6b-96ab-24c053593acd req-1669b7b5-0fb3-433f-a5be-9e970b8d219b service nova] [instance: b0742004-f76a-4a9a-9485-7d32c4a6bb49] No waiting events found dispatching network-vif-plugged-f401ace9-8d39-4567-bf98-a1f1365a238e {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 19:30:57 user nova-compute[75216]: WARNING nova.compute.manager [req-1ebd7a01-2bac-4d6b-96ab-24c053593acd req-1669b7b5-0fb3-433f-a5be-9e970b8d219b service nova] [instance: b0742004-f76a-4a9a-9485-7d32c4a6bb49] Received unexpected event network-vif-plugged-f401ace9-8d39-4567-bf98-a1f1365a238e for instance with vm_state building and task_state spawning.
Nov 13 19:30:59 user nova-compute[75216]: DEBUG nova.compute.manager [None req-2cc5d780-dc41-4a24-9906-fc4130d2f5aa tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: b0742004-f76a-4a9a-9485-7d32c4a6bb49] Instance event wait completed in 0 seconds for  {{(pid=75216) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 19:30:59 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-2cc5d780-dc41-4a24-9906-fc4130d2f5aa tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: b0742004-f76a-4a9a-9485-7d32c4a6bb49] Guest created on hypervisor {{(pid=75216) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 19:30:59 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: b0742004-f76a-4a9a-9485-7d32c4a6bb49] Instance spawned successfully.
Nov 13 19:30:59 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-2cc5d780-dc41-4a24-9906-fc4130d2f5aa tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: b0742004-f76a-4a9a-9485-7d32c4a6bb49] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 19:30:59 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-2cc5d780-dc41-4a24-9906-fc4130d2f5aa tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: b0742004-f76a-4a9a-9485-7d32c4a6bb49] Found default for hw_input_bus of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 19:30:59 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-2cc5d780-dc41-4a24-9906-fc4130d2f5aa tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: b0742004-f76a-4a9a-9485-7d32c4a6bb49] Found default for hw_pointer_model of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 19:30:59 user nova-compute[75216]: INFO nova.compute.manager [None req-2cc5d780-dc41-4a24-9906-fc4130d2f5aa tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: b0742004-f76a-4a9a-9485-7d32c4a6bb49] Took 4.71 seconds to spawn the instance on the hypervisor.
Nov 13 19:30:59 user nova-compute[75216]: DEBUG nova.compute.manager [None req-2cc5d780-dc41-4a24-9906-fc4130d2f5aa tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: b0742004-f76a-4a9a-9485-7d32c4a6bb49] Checking state {{(pid=75216) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 19:30:59 user nova-compute[75216]: INFO nova.compute.manager [None req-2cc5d780-dc41-4a24-9906-fc4130d2f5aa tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: b0742004-f76a-4a9a-9485-7d32c4a6bb49] Took 15.57 seconds to build instance.
Nov 13 19:30:59 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-2cc5d780-dc41-4a24-9906-fc4130d2f5aa tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Lock "b0742004-f76a-4a9a-9485-7d32c4a6bb49" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.670s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:30:59 user nova-compute[75216]: DEBUG nova.compute.manager [req-a2ba2692-ac96-4d08-95d0-9a2958f5e6cc req-94735d61-4067-4d48-a092-6ba2d45bb761 service nova] [instance: b0742004-f76a-4a9a-9485-7d32c4a6bb49] Received event network-vif-plugged-f401ace9-8d39-4567-bf98-a1f1365a238e {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:30:59 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-a2ba2692-ac96-4d08-95d0-9a2958f5e6cc req-94735d61-4067-4d48-a092-6ba2d45bb761 service nova] Acquiring lock "b0742004-f76a-4a9a-9485-7d32c4a6bb49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:30:59 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-a2ba2692-ac96-4d08-95d0-9a2958f5e6cc req-94735d61-4067-4d48-a092-6ba2d45bb761 service nova] Lock "b0742004-f76a-4a9a-9485-7d32c4a6bb49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:30:59 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-a2ba2692-ac96-4d08-95d0-9a2958f5e6cc req-94735d61-4067-4d48-a092-6ba2d45bb761 service nova] Lock "b0742004-f76a-4a9a-9485-7d32c4a6bb49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:30:59 user nova-compute[75216]: DEBUG nova.compute.manager [req-a2ba2692-ac96-4d08-95d0-9a2958f5e6cc req-94735d61-4067-4d48-a092-6ba2d45bb761 service nova] [instance: b0742004-f76a-4a9a-9485-7d32c4a6bb49] No waiting events found dispatching network-vif-plugged-f401ace9-8d39-4567-bf98-a1f1365a238e {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 19:30:59 user nova-compute[75216]: WARNING nova.compute.manager [req-a2ba2692-ac96-4d08-95d0-9a2958f5e6cc req-94735d61-4067-4d48-a092-6ba2d45bb761 service nova] [instance: b0742004-f76a-4a9a-9485-7d32c4a6bb49] Received unexpected event network-vif-plugged-f401ace9-8d39-4567-bf98-a1f1365a238e for instance with vm_state active and task_state None.
Nov 13 19:30:59 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:31:00 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:31:05 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:31:09 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:31:10 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:31:10 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:31:12 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:31:12 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Triggering sync for uuid 06fd14bc-508c-4d70-b7b6-f536bb2601a6 {{(pid=75216) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 13 19:31:12 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Triggering sync for uuid b0742004-f76a-4a9a-9485-7d32c4a6bb49 {{(pid=75216) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 13 19:31:12 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "06fd14bc-508c-4d70-b7b6-f536bb2601a6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:31:12 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "06fd14bc-508c-4d70-b7b6-f536bb2601a6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:31:12 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "b0742004-f76a-4a9a-9485-7d32c4a6bb49" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:31:12 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "b0742004-f76a-4a9a-9485-7d32c4a6bb49" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:31:12 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "06fd14bc-508c-4d70-b7b6-f536bb2601a6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.028s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:31:12 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "b0742004-f76a-4a9a-9485-7d32c4a6bb49" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.027s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:31:14 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:31:15 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:31:18 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:31:19 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:31:20 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:31:24 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:31:24 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:31:24 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75216) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 19:31:24 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:31:25 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:31:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:31:27 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:31:27 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:31:27 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:31:27 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:31:27 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Auditing locally available compute resources for user (node: user) {{(pid=75216) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 19:31:27 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 19:31:27 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 19:31:27 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 19:31:27 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 19:31:27 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Hypervisor/Node resource view: name=user free_ram=8866MB free_disk=25.272930145263672GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75216) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 19:31:27 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:31:27 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:31:28 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance 06fd14bc-508c-4d70-b7b6-f536bb2601a6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 19:31:28 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance b0742004-f76a-4a9a-9485-7d32c4a6bb49 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 19:31:28 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 19:31:28 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 19:31:28 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Refreshing inventories for resource provider d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 13 19:31:28 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Updating ProviderTree inventory for provider d927e00d-5a8b-43f7-ac04-6437958fac1f from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 13 19:31:28 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Updating inventory in ProviderTree for provider d927e00d-5a8b-43f7-ac04-6437958fac1f with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 13 19:31:28 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Refreshing aggregate associations for resource provider d927e00d-5a8b-43f7-ac04-6437958fac1f, aggregates: None {{(pid=75216) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 13 19:31:28 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Refreshing trait associations for resource provider d927e00d-5a8b-43f7-ac04-6437958fac1f, traits: COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_MMX {{(pid=75216) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 13 19:31:28 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 19:31:28 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 19:31:28 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Compute_service record updated for user:user {{(pid=75216) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 19:31:28 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.435s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:31:29 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:31:29 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:31:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:31:30 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:31:30 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Starting heal instance info cache {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 19:31:30 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Rebuilding the list of instances to heal {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 13 19:31:30 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "refresh_cache-06fd14bc-508c-4d70-b7b6-f536bb2601a6" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 19:31:30 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquired lock "refresh_cache-06fd14bc-508c-4d70-b7b6-f536bb2601a6" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 19:31:30 user nova-compute[75216]: DEBUG nova.network.neutron [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: 06fd14bc-508c-4d70-b7b6-f536bb2601a6] Forcefully refreshing network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 19:31:30 user nova-compute[75216]: DEBUG nova.objects.instance [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lazy-loading 'info_cache' on Instance uuid 06fd14bc-508c-4d70-b7b6-f536bb2601a6 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:31:30 user nova-compute[75216]: DEBUG nova.network.neutron [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: 06fd14bc-508c-4d70-b7b6-f536bb2601a6] Updating instance_info_cache with network_info: [{"id": "17485923-5f1e-4a16-9279-032f55bf4ce6", "address": "fa:16:3e:71:d7:59", "network": {"id": "5881a45c-3f28-48c4-aa8e-045b3bea3227", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1651070715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a1951a52e7c4ef5ac6a0d9d5380d41a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17485923-5f", "ovs_interfaceid": "17485923-5f1e-4a16-9279-032f55bf4ce6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:31:30 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Releasing lock "refresh_cache-06fd14bc-508c-4d70-b7b6-f536bb2601a6" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 19:31:30 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: 06fd14bc-508c-4d70-b7b6-f536bb2601a6] Updated the network info_cache for instance {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 19:31:30 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:31:34 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:31:35 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:31:40 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:31:40 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:31:40 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75216) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 19:31:40 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 19:31:40 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 19:31:40 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:31:43 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:31:43 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Cleaning up deleted instances {{(pid=75216) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 13 19:31:43 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] There are 0 instances to clean {{(pid=75216) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 13 19:31:44 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:31:45 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:31:48 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:31:48 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75216) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 13 19:31:50 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:31:55 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:32:00 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:32:05 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:32:10 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:32:10 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:32:10 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75216) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 19:32:10 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 19:32:10 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 19:32:10 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:32:12 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:32:15 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:32:18 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:32:20 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:32:24 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:32:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:32:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:32:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75216) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 19:32:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 19:32:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 19:32:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:32:26 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:32:26 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:32:26 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75216) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 19:32:29 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:32:29 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:32:29 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:32:29 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:32:29 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:32:29 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Auditing locally available compute resources for user (node: user) {{(pid=75216) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 19:32:29 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 19:32:29 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 19:32:29 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 19:32:29 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 19:32:29 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Hypervisor/Node resource view: name=user free_ram=8922MB free_disk=25.27237319946289GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75216) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 19:32:29 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:32:29 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:32:29 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance 06fd14bc-508c-4d70-b7b6-f536bb2601a6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 19:32:29 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance b0742004-f76a-4a9a-9485-7d32c4a6bb49 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 19:32:29 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 19:32:29 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 19:32:30 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 19:32:30 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 19:32:30 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Compute_service record updated for user:user {{(pid=75216) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 19:32:30 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.192s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:32:30 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:32:32 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:32:32 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Starting heal instance info cache {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 19:32:32 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "refresh_cache-b0742004-f76a-4a9a-9485-7d32c4a6bb49" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 19:32:32 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquired lock "refresh_cache-b0742004-f76a-4a9a-9485-7d32c4a6bb49" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 19:32:32 user nova-compute[75216]: DEBUG nova.network.neutron [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: b0742004-f76a-4a9a-9485-7d32c4a6bb49] Forcefully refreshing network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 19:32:32 user nova-compute[75216]: DEBUG nova.network.neutron [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: b0742004-f76a-4a9a-9485-7d32c4a6bb49] Updating instance_info_cache with network_info: [{"id": "f401ace9-8d39-4567-bf98-a1f1365a238e", "address": "fa:16:3e:55:0e:f8", "network": {"id": "5881a45c-3f28-48c4-aa8e-045b3bea3227", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1651070715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a1951a52e7c4ef5ac6a0d9d5380d41a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf401ace9-8d", "ovs_interfaceid": "f401ace9-8d39-4567-bf98-a1f1365a238e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:32:32 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Releasing lock "refresh_cache-b0742004-f76a-4a9a-9485-7d32c4a6bb49" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 19:32:32 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: b0742004-f76a-4a9a-9485-7d32c4a6bb49] Updated the network info_cache for instance {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 19:32:34 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:32:34 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:32:34 user nova-compute[75216]: DEBUG nova.compute.manager [req-f57ef02d-37d0-4caa-9616-2e72602040e6 req-0efee377-07a4-4f4c-a91a-0ae6b22a8fcb service nova] [instance: b0742004-f76a-4a9a-9485-7d32c4a6bb49] Received event network-changed-f401ace9-8d39-4567-bf98-a1f1365a238e {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:32:34 user nova-compute[75216]: DEBUG nova.compute.manager [req-f57ef02d-37d0-4caa-9616-2e72602040e6 req-0efee377-07a4-4f4c-a91a-0ae6b22a8fcb service nova] [instance: b0742004-f76a-4a9a-9485-7d32c4a6bb49] Refreshing instance network info cache due to event network-changed-f401ace9-8d39-4567-bf98-a1f1365a238e. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 19:32:34 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-f57ef02d-37d0-4caa-9616-2e72602040e6 req-0efee377-07a4-4f4c-a91a-0ae6b22a8fcb service nova] Acquiring lock "refresh_cache-b0742004-f76a-4a9a-9485-7d32c4a6bb49" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 19:32:34 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-f57ef02d-37d0-4caa-9616-2e72602040e6 req-0efee377-07a4-4f4c-a91a-0ae6b22a8fcb service nova] Acquired lock "refresh_cache-b0742004-f76a-4a9a-9485-7d32c4a6bb49" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 19:32:34 user nova-compute[75216]: DEBUG nova.network.neutron [req-f57ef02d-37d0-4caa-9616-2e72602040e6 req-0efee377-07a4-4f4c-a91a-0ae6b22a8fcb service nova] [instance: b0742004-f76a-4a9a-9485-7d32c4a6bb49] Refreshing network info cache for port f401ace9-8d39-4567-bf98-a1f1365a238e {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 19:32:35 user nova-compute[75216]: DEBUG nova.network.neutron [req-f57ef02d-37d0-4caa-9616-2e72602040e6 req-0efee377-07a4-4f4c-a91a-0ae6b22a8fcb service nova] [instance: b0742004-f76a-4a9a-9485-7d32c4a6bb49] Updated VIF entry in instance network info cache for port f401ace9-8d39-4567-bf98-a1f1365a238e. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 19:32:35 user nova-compute[75216]: DEBUG nova.network.neutron [req-f57ef02d-37d0-4caa-9616-2e72602040e6 req-0efee377-07a4-4f4c-a91a-0ae6b22a8fcb service nova] [instance: b0742004-f76a-4a9a-9485-7d32c4a6bb49] Updating instance_info_cache with network_info: [{"id": "f401ace9-8d39-4567-bf98-a1f1365a238e", "address": "fa:16:3e:55:0e:f8", "network": {"id": "5881a45c-3f28-48c4-aa8e-045b3bea3227", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1651070715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a1951a52e7c4ef5ac6a0d9d5380d41a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf401ace9-8d", "ovs_interfaceid": "f401ace9-8d39-4567-bf98-a1f1365a238e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:32:35 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-f57ef02d-37d0-4caa-9616-2e72602040e6 req-0efee377-07a4-4f4c-a91a-0ae6b22a8fcb service nova] Releasing lock "refresh_cache-b0742004-f76a-4a9a-9485-7d32c4a6bb49" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 19:32:35 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-6a4a2966-4e75-4e93-a1d4-d819c93b9667 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Acquiring lock "b0742004-f76a-4a9a-9485-7d32c4a6bb49" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:32:35 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-6a4a2966-4e75-4e93-a1d4-d819c93b9667 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Lock "b0742004-f76a-4a9a-9485-7d32c4a6bb49" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:32:35 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-6a4a2966-4e75-4e93-a1d4-d819c93b9667 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Acquiring lock "b0742004-f76a-4a9a-9485-7d32c4a6bb49-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:32:35 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-6a4a2966-4e75-4e93-a1d4-d819c93b9667 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Lock "b0742004-f76a-4a9a-9485-7d32c4a6bb49-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:32:35 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-6a4a2966-4e75-4e93-a1d4-d819c93b9667 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Lock "b0742004-f76a-4a9a-9485-7d32c4a6bb49-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:32:35 user nova-compute[75216]: INFO nova.compute.manager [None req-6a4a2966-4e75-4e93-a1d4-d819c93b9667 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: b0742004-f76a-4a9a-9485-7d32c4a6bb49] Terminating instance
Nov 13 19:32:35 user nova-compute[75216]: DEBUG nova.compute.manager [None req-6a4a2966-4e75-4e93-a1d4-d819c93b9667 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: b0742004-f76a-4a9a-9485-7d32c4a6bb49] Start destroying the instance on the hypervisor. {{(pid=75216) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 19:32:35 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:32:35 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:32:35 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:32:35 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:32:35 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:32:35 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:32:35 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:32:35 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:32:35 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:32:35 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:32:35 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: b0742004-f76a-4a9a-9485-7d32c4a6bb49] Instance destroyed successfully.
Nov 13 19:32:35 user nova-compute[75216]: DEBUG nova.objects.instance [None req-6a4a2966-4e75-4e93-a1d4-d819c93b9667 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Lazy-loading 'resources' on Instance uuid b0742004-f76a-4a9a-9485-7d32c4a6bb49 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:32:35 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-6a4a2966-4e75-4e93-a1d4-d819c93b9667 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T19:30:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-222133674',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-222133674',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-222133674',id=48,image_ref='d7f2e8ea-e700-44bc-9c08-cd495016efac',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK8aceXcTDmg8S1l/FpjiPhPh0S22tZa/ph87yqreHK4AHbqn04tiBaDtOWnOSKvCm1yxuH7GVcMW5DzJ7XZ8EpSPVqWp7eHAuoqIcdaLdEKTMwAQz7zC7w7gcJdnefQiQ==',key_name='tempest-keypair-1117035065',keypairs=<?>,launch_index=0,launched_at=2023-11-13T19:30:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3a1951a52e7c4ef5ac6a0d9d5380d41a',ramdisk_id='',reservation_id='r-d0l02mp5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1444343509',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1444343509-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-1444343509',owner_user_name='tempest-TestVolumeBootPattern-1444343509-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T19:30:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bfc6b02c16664b8dbea3a6f2088ec385',uuid=b0742004-f76a-4a9a-9485-7d32c4a6bb49,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f401ace9-8d39-4567-bf98-a1f1365a238e", "address": "fa:16:3e:55:0e:f8", "network": {"id": "5881a45c-3f28-48c4-aa8e-045b3bea3227", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1651070715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a1951a52e7c4ef5ac6a0d9d5380d41a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf401ace9-8d", "ovs_interfaceid": "f401ace9-8d39-4567-bf98-a1f1365a238e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 19:32:35 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-6a4a2966-4e75-4e93-a1d4-d819c93b9667 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Converting VIF {"id": "f401ace9-8d39-4567-bf98-a1f1365a238e", "address": "fa:16:3e:55:0e:f8", "network": {"id": "5881a45c-3f28-48c4-aa8e-045b3bea3227", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1651070715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a1951a52e7c4ef5ac6a0d9d5380d41a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf401ace9-8d", "ovs_interfaceid": "f401ace9-8d39-4567-bf98-a1f1365a238e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 19:32:35 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-6a4a2966-4e75-4e93-a1d4-d819c93b9667 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:55:0e:f8,bridge_name='br-int',has_traffic_filtering=True,id=f401ace9-8d39-4567-bf98-a1f1365a238e,network=Network(5881a45c-3f28-48c4-aa8e-045b3bea3227),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf401ace9-8d') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 19:32:35 user nova-compute[75216]: DEBUG os_vif [None req-6a4a2966-4e75-4e93-a1d4-d819c93b9667 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:55:0e:f8,bridge_name='br-int',has_traffic_filtering=True,id=f401ace9-8d39-4567-bf98-a1f1365a238e,network=Network(5881a45c-3f28-48c4-aa8e-045b3bea3227),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf401ace9-8d') {{(pid=75216) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 19:32:35 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:32:35 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf401ace9-8d, bridge=br-int, if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:32:35 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:32:35 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:32:35 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f14dbcec-2f3b-4ec5-ba8e-d38c5bc00c68) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:32:35 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:32:35 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:32:35 user nova-compute[75216]: INFO os_vif [None req-6a4a2966-4e75-4e93-a1d4-d819c93b9667 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:55:0e:f8,bridge_name='br-int',has_traffic_filtering=True,id=f401ace9-8d39-4567-bf98-a1f1365a238e,network=Network(5881a45c-3f28-48c4-aa8e-045b3bea3227),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf401ace9-8d')
Nov 13 19:32:35 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6a4a2966-4e75-4e93-a1d4-d819c93b9667 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: b0742004-f76a-4a9a-9485-7d32c4a6bb49] calling os-brick to detach iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 19:32:35 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a4a2966-4e75-4e93-a1d4-d819c93b9667 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3a8669e40>, {'target_iqn': 'iqn.2010-10.org.openstack:5c75fd9b-b53c-4f66-b91b-536cd6f4fe5c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VRLwGxgc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 19:32:35 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-6a4a2966-4e75-4e93-a1d4-d819c93b9667 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 19:32:35 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-6a4a2966-4e75-4e93-a1d4-d819c93b9667 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 19:32:35 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-6a4a2966-4e75-4e93-a1d4-d819c93b9667 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 19:32:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:32:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:32:35 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[5861d245-eb2c-44eb-adfd-66cedd4bbec0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5c75fd9b-b53c-4f66-b91b-536cd6f4fe5c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0bb8e1a0-1257-4491-b9ef-d8b8e07ef1f7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:32:35 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a4a2966-4e75-4e93-a1d4-d819c93b9667 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 19:32:35 user nova-compute[75216]: No targets found.
Nov 13 19:32:35 user nova-compute[75216]: iSNS:
Nov 13 19:32:35 user nova-compute[75216]: No targets found.
Nov 13 19:32:35 user nova-compute[75216]: STATIC:
Nov 13 19:32:35 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:5c75fd9b-b53c-4f66-b91b-536cd6f4fe5c
Nov 13 19:32:35 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 19:32:35 user nova-compute[75216]:                 Iface Name: default
Nov 13 19:32:35 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:0bb8e1a0-1257-4491-b9ef-d8b8e07ef1f7
Nov 13 19:32:35 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 19:32:35 user nova-compute[75216]:                 Iface Name: default
Nov 13 19:32:35 user nova-compute[75216]: FIRMWARE:
Nov 13 19:32:35 user nova-compute[75216]: No targets found.
Nov 13 19:32:35 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 19:32:35 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a4a2966-4e75-4e93-a1d4-d819c93b9667 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 19:32:35 user nova-compute[75216]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 19:32:35 user nova-compute[75216]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75216) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 19:32:35 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a4a2966-4e75-4e93-a1d4-d819c93b9667 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5c75fd9b-b53c-4f66-b91b-536cd6f4fe5c', 0)] {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 19:32:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:32:36 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:32:36 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[428ccf28-57e5-4418-a7e6-35563d186887]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0bb8e1a0-1257-4491-b9ef-d8b8e07ef1f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c75fd9b-b53c-4f66-b91b-536cd6f4fe5c\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:32:36 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:32:36 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:32:36 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[53c7e19b-a388-4b97-b437-db6061bfdee9]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bb8e1a0-1257-4491-b9ef-d8b8e07ef1f7 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c75fd9b-b53c-4f66-b91b-536cd6f4fe5c (non-flash)\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:32:36 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a4a2966-4e75-4e93-a1d4-d819c93b9667 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bb8e1a0-1257-4491-b9ef-d8b8e07ef1f7 (non-flash)
Nov 13 19:32:36 user nova-compute[75216]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c75fd9b-b53c-4f66-b91b-536cd6f4fe5c (non-flash)
Nov 13 19:32:36 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 19:32:36 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a4a2966-4e75-4e93-a1d4-d819c93b9667 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bb8e1a0-1257-4491-b9ef-d8b8e07ef1f7 (non-flash)
Nov 13 19:32:36 user nova-compute[75216]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c75fd9b-b53c-4f66-b91b-536cd6f4fe5c (non-flash)
Nov 13 19:32:36 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 19:32:36 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a4a2966-4e75-4e93-a1d4-d819c93b9667 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe3a83139a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5c75fd9b-b53c-4f66-b91b-536cd6f4fe5c'): ({'sdc'}, set())}) {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 19:32:36 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-6a4a2966-4e75-4e93-a1d4-d819c93b9667 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Removing single pathed devices sdc {{(pid=75216) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 19:32:36 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:32:36 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:32:36 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bb242fc-e723-44d0-9cff-47700a215d58]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:32:36 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:32:36 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:32:36 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[4798c8ea-b974-4bd7-a540-2d1ca2dfd3b0]: (4, ('ok\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:32:36 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-6a4a2966-4e75-4e93-a1d4-d819c93b9667 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Flushing IO for device /dev/sdc {{(pid=75216) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 19:32:36 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:32:36 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:32:36 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[50daca26-569d-4264-99b4-cbd723f0e15b]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:32:36 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-6a4a2966-4e75-4e93-a1d4-d819c93b9667 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75216) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 19:32:36 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:32:36 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:32:36 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:32:36 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.044s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:32:36 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[d33ad6b0-1c72-4ad6-9eb1-5b4a3819feaf]: (4, ('1', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:32:36 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-6a4a2966-4e75-4e93-a1d4-d819c93b9667 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 19:32:36 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-6a4a2966-4e75-4e93-a1d4-d819c93b9667 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] SCSI volumes sdc have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 19:32:36 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a4a2966-4e75-4e93-a1d4-d819c93b9667 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5c75fd9b-b53c-4f66-b91b-536cd6f4fe5c')] {{(pid=75216) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 19:32:36 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c75fd9b-b53c-4f66-b91b-536cd6f4fe5c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:32:36 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c75fd9b-b53c-4f66-b91b-536cd6f4fe5c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:32:36 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[06e2a3b3-10bd-49eb-b2df-22eefd105437]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:32:36 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a4a2966-4e75-4e93-a1d4-d819c93b9667 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:32:36 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c75fd9b-b53c-4f66-b91b-536cd6f4fe5c -p 172.16.0.220:3260 --logout {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:32:36 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c75fd9b-b53c-4f66-b91b-536cd6f4fe5c -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:32:36 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[295e7f97-1a7d-4078-8cb8-6dc06f0aba4c]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:5c75fd9b-b53c-4f66-b91b-536cd6f4fe5c, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:5c75fd9b-b53c-4f66-b91b-536cd6f4fe5c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:32:36 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a4a2966-4e75-4e93-a1d4-d819c93b9667 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:5c75fd9b-b53c-4f66-b91b-536cd6f4fe5c, portal: 172.16.0.220,3260]
Nov 13 19:32:36 user nova-compute[75216]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:5c75fd9b-b53c-4f66-b91b-536cd6f4fe5c, portal: 172.16.0.220,3260] successful.
Nov 13 19:32:36 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:32:36 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c75fd9b-b53c-4f66-b91b-536cd6f4fe5c -p 172.16.0.220:3260 --op delete {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:32:36 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c75fd9b-b53c-4f66-b91b-536cd6f4fe5c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:32:36 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9c6c2a4-7b7f-4c21-b27e-c6ad267461a9]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:32:36 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a4a2966-4e75-4e93-a1d4-d819c93b9667 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:32:36 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-6a4a2966-4e75-4e93-a1d4-d819c93b9667 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.300s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 19:32:36 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a4a2966-4e75-4e93-a1d4-d819c93b9667 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] <== disconnect_volume: return (302ms) None {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 19:32:36 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6a4a2966-4e75-4e93-a1d4-d819c93b9667 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: b0742004-f76a-4a9a-9485-7d32c4a6bb49] Disconnected iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 19:32:36 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-6a4a2966-4e75-4e93-a1d4-d819c93b9667 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: b0742004-f76a-4a9a-9485-7d32c4a6bb49] Deleting instance files /opt/stack/data/nova/instances/b0742004-f76a-4a9a-9485-7d32c4a6bb49_del
Nov 13 19:32:36 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-6a4a2966-4e75-4e93-a1d4-d819c93b9667 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: b0742004-f76a-4a9a-9485-7d32c4a6bb49] Deletion of /opt/stack/data/nova/instances/b0742004-f76a-4a9a-9485-7d32c4a6bb49_del complete
Nov 13 19:32:36 user nova-compute[75216]: INFO nova.compute.manager [None req-6a4a2966-4e75-4e93-a1d4-d819c93b9667 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: b0742004-f76a-4a9a-9485-7d32c4a6bb49] Took 1.18 seconds to destroy the instance on the hypervisor.
Nov 13 19:32:36 user nova-compute[75216]: DEBUG oslo.service.loopingcall [None req-6a4a2966-4e75-4e93-a1d4-d819c93b9667 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75216) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 19:32:36 user nova-compute[75216]: DEBUG nova.compute.manager [-] [instance: b0742004-f76a-4a9a-9485-7d32c4a6bb49] Deallocating network for instance {{(pid=75216) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 19:32:36 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: b0742004-f76a-4a9a-9485-7d32c4a6bb49] deallocate_for_instance() {{(pid=75216) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 19:32:36 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:32:36 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:32:36 user nova-compute[75216]: DEBUG nova.compute.manager [req-d6d2d50b-0764-42c3-8ffd-4434825bcabf req-157c67fb-fcb4-4bf4-9af2-86989ae7d85b service nova] [instance: b0742004-f76a-4a9a-9485-7d32c4a6bb49] Received event network-vif-unplugged-f401ace9-8d39-4567-bf98-a1f1365a238e {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:32:36 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-d6d2d50b-0764-42c3-8ffd-4434825bcabf req-157c67fb-fcb4-4bf4-9af2-86989ae7d85b service nova] Acquiring lock "b0742004-f76a-4a9a-9485-7d32c4a6bb49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:32:36 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-d6d2d50b-0764-42c3-8ffd-4434825bcabf req-157c67fb-fcb4-4bf4-9af2-86989ae7d85b service nova] Lock "b0742004-f76a-4a9a-9485-7d32c4a6bb49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:32:36 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-d6d2d50b-0764-42c3-8ffd-4434825bcabf req-157c67fb-fcb4-4bf4-9af2-86989ae7d85b service nova] Lock "b0742004-f76a-4a9a-9485-7d32c4a6bb49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:32:36 user nova-compute[75216]: DEBUG nova.compute.manager [req-d6d2d50b-0764-42c3-8ffd-4434825bcabf req-157c67fb-fcb4-4bf4-9af2-86989ae7d85b service nova] [instance: b0742004-f76a-4a9a-9485-7d32c4a6bb49] No waiting events found dispatching network-vif-unplugged-f401ace9-8d39-4567-bf98-a1f1365a238e {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 19:32:36 user nova-compute[75216]: DEBUG nova.compute.manager [req-d6d2d50b-0764-42c3-8ffd-4434825bcabf req-157c67fb-fcb4-4bf4-9af2-86989ae7d85b service nova] [instance: b0742004-f76a-4a9a-9485-7d32c4a6bb49] Received event network-vif-unplugged-f401ace9-8d39-4567-bf98-a1f1365a238e for instance with task_state deleting. {{(pid=75216) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 19:32:36 user nova-compute[75216]: DEBUG nova.compute.manager [req-d6d2d50b-0764-42c3-8ffd-4434825bcabf req-157c67fb-fcb4-4bf4-9af2-86989ae7d85b service nova] [instance: b0742004-f76a-4a9a-9485-7d32c4a6bb49] Received event network-vif-plugged-f401ace9-8d39-4567-bf98-a1f1365a238e {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:32:36 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-d6d2d50b-0764-42c3-8ffd-4434825bcabf req-157c67fb-fcb4-4bf4-9af2-86989ae7d85b service nova] Acquiring lock "b0742004-f76a-4a9a-9485-7d32c4a6bb49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:32:36 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-d6d2d50b-0764-42c3-8ffd-4434825bcabf req-157c67fb-fcb4-4bf4-9af2-86989ae7d85b service nova] Lock "b0742004-f76a-4a9a-9485-7d32c4a6bb49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:32:36 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-d6d2d50b-0764-42c3-8ffd-4434825bcabf req-157c67fb-fcb4-4bf4-9af2-86989ae7d85b service nova] Lock "b0742004-f76a-4a9a-9485-7d32c4a6bb49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:32:36 user nova-compute[75216]: DEBUG nova.compute.manager [req-d6d2d50b-0764-42c3-8ffd-4434825bcabf req-157c67fb-fcb4-4bf4-9af2-86989ae7d85b service nova] [instance: b0742004-f76a-4a9a-9485-7d32c4a6bb49] No waiting events found dispatching network-vif-plugged-f401ace9-8d39-4567-bf98-a1f1365a238e {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 19:32:36 user nova-compute[75216]: WARNING nova.compute.manager [req-d6d2d50b-0764-42c3-8ffd-4434825bcabf req-157c67fb-fcb4-4bf4-9af2-86989ae7d85b service nova] [instance: b0742004-f76a-4a9a-9485-7d32c4a6bb49] Received unexpected event network-vif-plugged-f401ace9-8d39-4567-bf98-a1f1365a238e for instance with vm_state active and task_state deleting.
Nov 13 19:32:36 user nova-compute[75216]: DEBUG nova.compute.manager [req-d6d2d50b-0764-42c3-8ffd-4434825bcabf req-157c67fb-fcb4-4bf4-9af2-86989ae7d85b service nova] [instance: b0742004-f76a-4a9a-9485-7d32c4a6bb49] Received event network-vif-plugged-f401ace9-8d39-4567-bf98-a1f1365a238e {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:32:36 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-d6d2d50b-0764-42c3-8ffd-4434825bcabf req-157c67fb-fcb4-4bf4-9af2-86989ae7d85b service nova] Acquiring lock "b0742004-f76a-4a9a-9485-7d32c4a6bb49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:32:36 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-d6d2d50b-0764-42c3-8ffd-4434825bcabf req-157c67fb-fcb4-4bf4-9af2-86989ae7d85b service nova] Lock "b0742004-f76a-4a9a-9485-7d32c4a6bb49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:32:36 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-d6d2d50b-0764-42c3-8ffd-4434825bcabf req-157c67fb-fcb4-4bf4-9af2-86989ae7d85b service nova] Lock "b0742004-f76a-4a9a-9485-7d32c4a6bb49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:32:36 user nova-compute[75216]: DEBUG nova.compute.manager [req-d6d2d50b-0764-42c3-8ffd-4434825bcabf req-157c67fb-fcb4-4bf4-9af2-86989ae7d85b service nova] [instance: b0742004-f76a-4a9a-9485-7d32c4a6bb49] No waiting events found dispatching network-vif-plugged-f401ace9-8d39-4567-bf98-a1f1365a238e {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 19:32:36 user nova-compute[75216]: WARNING nova.compute.manager [req-d6d2d50b-0764-42c3-8ffd-4434825bcabf req-157c67fb-fcb4-4bf4-9af2-86989ae7d85b service nova] [instance: b0742004-f76a-4a9a-9485-7d32c4a6bb49] Received unexpected event network-vif-plugged-f401ace9-8d39-4567-bf98-a1f1365a238e for instance with vm_state active and task_state deleting.
Nov 13 19:32:36 user nova-compute[75216]: DEBUG nova.compute.manager [req-d6d2d50b-0764-42c3-8ffd-4434825bcabf req-157c67fb-fcb4-4bf4-9af2-86989ae7d85b service nova] [instance: b0742004-f76a-4a9a-9485-7d32c4a6bb49] Received event network-vif-plugged-f401ace9-8d39-4567-bf98-a1f1365a238e {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:32:36 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-d6d2d50b-0764-42c3-8ffd-4434825bcabf req-157c67fb-fcb4-4bf4-9af2-86989ae7d85b service nova] Acquiring lock "b0742004-f76a-4a9a-9485-7d32c4a6bb49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:32:36 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-d6d2d50b-0764-42c3-8ffd-4434825bcabf req-157c67fb-fcb4-4bf4-9af2-86989ae7d85b service nova] Lock "b0742004-f76a-4a9a-9485-7d32c4a6bb49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:32:36 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-d6d2d50b-0764-42c3-8ffd-4434825bcabf req-157c67fb-fcb4-4bf4-9af2-86989ae7d85b service nova] Lock "b0742004-f76a-4a9a-9485-7d32c4a6bb49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:32:36 user nova-compute[75216]: DEBUG nova.compute.manager [req-d6d2d50b-0764-42c3-8ffd-4434825bcabf req-157c67fb-fcb4-4bf4-9af2-86989ae7d85b service nova] [instance: b0742004-f76a-4a9a-9485-7d32c4a6bb49] No waiting events found dispatching network-vif-plugged-f401ace9-8d39-4567-bf98-a1f1365a238e {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 19:32:36 user nova-compute[75216]: WARNING nova.compute.manager [req-d6d2d50b-0764-42c3-8ffd-4434825bcabf req-157c67fb-fcb4-4bf4-9af2-86989ae7d85b service nova] [instance: b0742004-f76a-4a9a-9485-7d32c4a6bb49] Received unexpected event network-vif-plugged-f401ace9-8d39-4567-bf98-a1f1365a238e for instance with vm_state active and task_state deleting.
Nov 13 19:32:36 user nova-compute[75216]: DEBUG nova.compute.manager [req-d6d2d50b-0764-42c3-8ffd-4434825bcabf req-157c67fb-fcb4-4bf4-9af2-86989ae7d85b service nova] [instance: b0742004-f76a-4a9a-9485-7d32c4a6bb49] Received event network-vif-unplugged-f401ace9-8d39-4567-bf98-a1f1365a238e {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:32:36 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-d6d2d50b-0764-42c3-8ffd-4434825bcabf req-157c67fb-fcb4-4bf4-9af2-86989ae7d85b service nova] Acquiring lock "b0742004-f76a-4a9a-9485-7d32c4a6bb49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:32:36 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-d6d2d50b-0764-42c3-8ffd-4434825bcabf req-157c67fb-fcb4-4bf4-9af2-86989ae7d85b service nova] Lock "b0742004-f76a-4a9a-9485-7d32c4a6bb49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:32:36 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-d6d2d50b-0764-42c3-8ffd-4434825bcabf req-157c67fb-fcb4-4bf4-9af2-86989ae7d85b service nova] Lock "b0742004-f76a-4a9a-9485-7d32c4a6bb49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:32:36 user nova-compute[75216]: DEBUG nova.compute.manager [req-d6d2d50b-0764-42c3-8ffd-4434825bcabf req-157c67fb-fcb4-4bf4-9af2-86989ae7d85b service nova] [instance: b0742004-f76a-4a9a-9485-7d32c4a6bb49] No waiting events found dispatching network-vif-unplugged-f401ace9-8d39-4567-bf98-a1f1365a238e {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 19:32:36 user nova-compute[75216]: DEBUG nova.compute.manager [req-d6d2d50b-0764-42c3-8ffd-4434825bcabf req-157c67fb-fcb4-4bf4-9af2-86989ae7d85b service nova] [instance: b0742004-f76a-4a9a-9485-7d32c4a6bb49] Received event network-vif-unplugged-f401ace9-8d39-4567-bf98-a1f1365a238e for instance with task_state deleting. {{(pid=75216) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 19:32:36 user nova-compute[75216]: DEBUG nova.compute.manager [req-d6d2d50b-0764-42c3-8ffd-4434825bcabf req-157c67fb-fcb4-4bf4-9af2-86989ae7d85b service nova] [instance: b0742004-f76a-4a9a-9485-7d32c4a6bb49] Received event network-vif-plugged-f401ace9-8d39-4567-bf98-a1f1365a238e {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:32:36 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-d6d2d50b-0764-42c3-8ffd-4434825bcabf req-157c67fb-fcb4-4bf4-9af2-86989ae7d85b service nova] Acquiring lock "b0742004-f76a-4a9a-9485-7d32c4a6bb49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:32:36 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-d6d2d50b-0764-42c3-8ffd-4434825bcabf req-157c67fb-fcb4-4bf4-9af2-86989ae7d85b service nova] Lock "b0742004-f76a-4a9a-9485-7d32c4a6bb49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:32:36 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-d6d2d50b-0764-42c3-8ffd-4434825bcabf req-157c67fb-fcb4-4bf4-9af2-86989ae7d85b service nova] Lock "b0742004-f76a-4a9a-9485-7d32c4a6bb49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:32:36 user nova-compute[75216]: DEBUG nova.compute.manager [req-d6d2d50b-0764-42c3-8ffd-4434825bcabf req-157c67fb-fcb4-4bf4-9af2-86989ae7d85b service nova] [instance: b0742004-f76a-4a9a-9485-7d32c4a6bb49] No waiting events found dispatching network-vif-plugged-f401ace9-8d39-4567-bf98-a1f1365a238e {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 19:32:36 user nova-compute[75216]: WARNING nova.compute.manager [req-d6d2d50b-0764-42c3-8ffd-4434825bcabf req-157c67fb-fcb4-4bf4-9af2-86989ae7d85b service nova] [instance: b0742004-f76a-4a9a-9485-7d32c4a6bb49] Received unexpected event network-vif-plugged-f401ace9-8d39-4567-bf98-a1f1365a238e for instance with vm_state active and task_state deleting.
Nov 13 19:32:37 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: b0742004-f76a-4a9a-9485-7d32c4a6bb49] Updating instance_info_cache with network_info: [] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:32:37 user nova-compute[75216]: INFO nova.compute.manager [-] [instance: b0742004-f76a-4a9a-9485-7d32c4a6bb49] Took 0.78 seconds to deallocate network for instance.
Nov 13 19:32:37 user nova-compute[75216]: DEBUG nova.compute.manager [req-00bd0bfb-4970-4694-99f6-a19cc9cc0a4d req-adf5d277-3999-4d71-b254-8a118bb1eb01 service nova] [instance: b0742004-f76a-4a9a-9485-7d32c4a6bb49] Received event network-vif-deleted-f401ace9-8d39-4567-bf98-a1f1365a238e {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:32:37 user nova-compute[75216]: INFO nova.compute.manager [req-00bd0bfb-4970-4694-99f6-a19cc9cc0a4d req-adf5d277-3999-4d71-b254-8a118bb1eb01 service nova] [instance: b0742004-f76a-4a9a-9485-7d32c4a6bb49] Neutron deleted interface f401ace9-8d39-4567-bf98-a1f1365a238e; detaching it from the instance and deleting it from the info cache
Nov 13 19:32:37 user nova-compute[75216]: DEBUG nova.network.neutron [req-00bd0bfb-4970-4694-99f6-a19cc9cc0a4d req-adf5d277-3999-4d71-b254-8a118bb1eb01 service nova] [instance: b0742004-f76a-4a9a-9485-7d32c4a6bb49] Updating instance_info_cache with network_info: [] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:32:37 user nova-compute[75216]: DEBUG nova.compute.manager [req-00bd0bfb-4970-4694-99f6-a19cc9cc0a4d req-adf5d277-3999-4d71-b254-8a118bb1eb01 service nova] [instance: b0742004-f76a-4a9a-9485-7d32c4a6bb49] Detach interface failed, port_id=f401ace9-8d39-4567-bf98-a1f1365a238e, reason: Instance b0742004-f76a-4a9a-9485-7d32c4a6bb49 could not be found. {{(pid=75216) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 13 19:32:37 user nova-compute[75216]: INFO nova.compute.manager [None req-6a4a2966-4e75-4e93-a1d4-d819c93b9667 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: b0742004-f76a-4a9a-9485-7d32c4a6bb49] Took 0.72 seconds to detach 1 volumes for instance.
Nov 13 19:32:37 user nova-compute[75216]: DEBUG nova.compute.manager [None req-6a4a2966-4e75-4e93-a1d4-d819c93b9667 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: b0742004-f76a-4a9a-9485-7d32c4a6bb49] Deleting volume: 5c75fd9b-b53c-4f66-b91b-536cd6f4fe5c {{(pid=75216) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 13 19:32:37 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-6a4a2966-4e75-4e93-a1d4-d819c93b9667 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:32:37 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-6a4a2966-4e75-4e93-a1d4-d819c93b9667 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:32:38 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-6a4a2966-4e75-4e93-a1d4-d819c93b9667 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 19:32:38 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-6a4a2966-4e75-4e93-a1d4-d819c93b9667 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 19:32:38 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-6a4a2966-4e75-4e93-a1d4-d819c93b9667 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.145s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:32:38 user nova-compute[75216]: INFO nova.scheduler.client.report [None req-6a4a2966-4e75-4e93-a1d4-d819c93b9667 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Deleted allocations for instance b0742004-f76a-4a9a-9485-7d32c4a6bb49
Nov 13 19:32:38 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-6a4a2966-4e75-4e93-a1d4-d819c93b9667 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Lock "b0742004-f76a-4a9a-9485-7d32c4a6bb49" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.072s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:32:39 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:32:40 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:32:45 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:32:50 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:32:55 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:33:00 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:33:00 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:33:00 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75216) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 19:33:00 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 19:33:00 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 19:33:00 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:33:05 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:33:10 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:33:14 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:33:15 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:33:18 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:33:20 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:33:25 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:33:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:33:26 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:33:26 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75216) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 19:33:26 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e7765a0e-68f4-4c3c-a002-bc79bbc611a0 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Acquiring lock "06fd14bc-508c-4d70-b7b6-f536bb2601a6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:33:26 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e7765a0e-68f4-4c3c-a002-bc79bbc611a0 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Lock "06fd14bc-508c-4d70-b7b6-f536bb2601a6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:33:26 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e7765a0e-68f4-4c3c-a002-bc79bbc611a0 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Acquiring lock "06fd14bc-508c-4d70-b7b6-f536bb2601a6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:33:26 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e7765a0e-68f4-4c3c-a002-bc79bbc611a0 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Lock "06fd14bc-508c-4d70-b7b6-f536bb2601a6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:33:26 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e7765a0e-68f4-4c3c-a002-bc79bbc611a0 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Lock "06fd14bc-508c-4d70-b7b6-f536bb2601a6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:33:26 user nova-compute[75216]: INFO nova.compute.manager [None req-e7765a0e-68f4-4c3c-a002-bc79bbc611a0 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 06fd14bc-508c-4d70-b7b6-f536bb2601a6] Terminating instance
Nov 13 19:33:26 user nova-compute[75216]: DEBUG nova.compute.manager [None req-e7765a0e-68f4-4c3c-a002-bc79bbc611a0 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 06fd14bc-508c-4d70-b7b6-f536bb2601a6] Start destroying the instance on the hypervisor. {{(pid=75216) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 19:33:26 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:33:26 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:33:26 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:33:26 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:33:27 user nova-compute[75216]: DEBUG nova.compute.manager [req-57187c06-3182-4633-810e-f13b9a77b691 req-bfa9372e-309d-4fcc-949d-a25556cb0a3e service nova] [instance: 06fd14bc-508c-4d70-b7b6-f536bb2601a6] Received event network-vif-unplugged-17485923-5f1e-4a16-9279-032f55bf4ce6 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:33:27 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-57187c06-3182-4633-810e-f13b9a77b691 req-bfa9372e-309d-4fcc-949d-a25556cb0a3e service nova] Acquiring lock "06fd14bc-508c-4d70-b7b6-f536bb2601a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:33:27 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-57187c06-3182-4633-810e-f13b9a77b691 req-bfa9372e-309d-4fcc-949d-a25556cb0a3e service nova] Lock "06fd14bc-508c-4d70-b7b6-f536bb2601a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:33:27 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-57187c06-3182-4633-810e-f13b9a77b691 req-bfa9372e-309d-4fcc-949d-a25556cb0a3e service nova] Lock "06fd14bc-508c-4d70-b7b6-f536bb2601a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:33:27 user nova-compute[75216]: DEBUG nova.compute.manager [req-57187c06-3182-4633-810e-f13b9a77b691 req-bfa9372e-309d-4fcc-949d-a25556cb0a3e service nova] [instance: 06fd14bc-508c-4d70-b7b6-f536bb2601a6] No waiting events found dispatching network-vif-unplugged-17485923-5f1e-4a16-9279-032f55bf4ce6 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 19:33:27 user nova-compute[75216]: DEBUG nova.compute.manager [req-57187c06-3182-4633-810e-f13b9a77b691 req-bfa9372e-309d-4fcc-949d-a25556cb0a3e service nova] [instance: 06fd14bc-508c-4d70-b7b6-f536bb2601a6] Received event network-vif-unplugged-17485923-5f1e-4a16-9279-032f55bf4ce6 for instance with task_state deleting. {{(pid=75216) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 19:33:27 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 06fd14bc-508c-4d70-b7b6-f536bb2601a6] Instance destroyed successfully.
Nov 13 19:33:27 user nova-compute[75216]: DEBUG nova.objects.instance [None req-e7765a0e-68f4-4c3c-a002-bc79bbc611a0 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Lazy-loading 'resources' on Instance uuid 06fd14bc-508c-4d70-b7b6-f536bb2601a6 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:33:27 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-e7765a0e-68f4-4c3c-a002-bc79bbc611a0 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T19:28:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1943562899',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1943562899',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1943562899',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOyDmmYAuXaR/FoXT1rCO06bdHIDD5dg0Qn4bjo1Ds3aNj4RWLZEzden0kT+RqfSfD1Hvvy+zEcoA2+RWaqewGcic7fay+hKlj1XZ0U9mJJ9bp7mUJtC/siK9RnmLhRUTQ==',key_name='tempest-keypair-1176163373',keypairs=<?>,launch_index=0,launched_at=2023-11-13T19:28:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3a1951a52e7c4ef5ac6a0d9d5380d41a',ramdisk_id='',reservation_id='r-ra0t0h25',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1444343509',owner_user_name='tempest-TestVolumeBootPattern-1444343509-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T19:28:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bfc6b02c16664b8dbea3a6f2088ec385',uuid=06fd14bc-508c-4d70-b7b6-f536bb2601a6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "17485923-5f1e-4a16-9279-032f55bf4ce6", "address": "fa:16:3e:71:d7:59", "network": {"id": "5881a45c-3f28-48c4-aa8e-045b3bea3227", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1651070715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a1951a52e7c4ef5ac6a0d9d5380d41a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17485923-5f", "ovs_interfaceid": "17485923-5f1e-4a16-9279-032f55bf4ce6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 19:33:27 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-e7765a0e-68f4-4c3c-a002-bc79bbc611a0 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Converting VIF {"id": "17485923-5f1e-4a16-9279-032f55bf4ce6", "address": "fa:16:3e:71:d7:59", "network": {"id": "5881a45c-3f28-48c4-aa8e-045b3bea3227", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1651070715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a1951a52e7c4ef5ac6a0d9d5380d41a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17485923-5f", "ovs_interfaceid": "17485923-5f1e-4a16-9279-032f55bf4ce6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 19:33:27 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-e7765a0e-68f4-4c3c-a002-bc79bbc611a0 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:71:d7:59,bridge_name='br-int',has_traffic_filtering=True,id=17485923-5f1e-4a16-9279-032f55bf4ce6,network=Network(5881a45c-3f28-48c4-aa8e-045b3bea3227),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17485923-5f') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 19:33:27 user nova-compute[75216]: DEBUG os_vif [None req-e7765a0e-68f4-4c3c-a002-bc79bbc611a0 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:71:d7:59,bridge_name='br-int',has_traffic_filtering=True,id=17485923-5f1e-4a16-9279-032f55bf4ce6,network=Network(5881a45c-3f28-48c4-aa8e-045b3bea3227),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17485923-5f') {{(pid=75216) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 19:33:27 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:33:27 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap17485923-5f, bridge=br-int, if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:33:27 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:33:27 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:33:27 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:33:27 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=72af3190-28cd-4de1-9f35-327f26102e95) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:33:27 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:33:27 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:33:27 user nova-compute[75216]: INFO os_vif [None req-e7765a0e-68f4-4c3c-a002-bc79bbc611a0 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:71:d7:59,bridge_name='br-int',has_traffic_filtering=True,id=17485923-5f1e-4a16-9279-032f55bf4ce6,network=Network(5881a45c-3f28-48c4-aa8e-045b3bea3227),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17485923-5f')
Nov 13 19:33:27 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e7765a0e-68f4-4c3c-a002-bc79bbc611a0 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 06fd14bc-508c-4d70-b7b6-f536bb2601a6] calling os-brick to detach iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 19:33:27 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7765a0e-68f4-4c3c-a002-bc79bbc611a0 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3a8669e40>, {'target_iqn': 'iqn.2010-10.org.openstack:0bb8e1a0-1257-4491-b9ef-d8b8e07ef1f7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rIKDqmXc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 19:33:27 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-e7765a0e-68f4-4c3c-a002-bc79bbc611a0 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 19:33:27 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-e7765a0e-68f4-4c3c-a002-bc79bbc611a0 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 19:33:27 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-e7765a0e-68f4-4c3c-a002-bc79bbc611a0 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 19:33:27 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:33:27 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:33:27 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[a062da01-63f1-4537-a5f1-534c18ac33a7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0bb8e1a0-1257-4491-b9ef-d8b8e07ef1f7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:33:27 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7765a0e-68f4-4c3c-a002-bc79bbc611a0 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 19:33:27 user nova-compute[75216]: No targets found.
Nov 13 19:33:27 user nova-compute[75216]: iSNS:
Nov 13 19:33:27 user nova-compute[75216]: No targets found.
Nov 13 19:33:27 user nova-compute[75216]: STATIC:
Nov 13 19:33:27 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:0bb8e1a0-1257-4491-b9ef-d8b8e07ef1f7
Nov 13 19:33:27 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 19:33:27 user nova-compute[75216]:                 Iface Name: default
Nov 13 19:33:27 user nova-compute[75216]: FIRMWARE:
Nov 13 19:33:27 user nova-compute[75216]: No targets found.
Nov 13 19:33:27 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 19:33:27 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7765a0e-68f4-4c3c-a002-bc79bbc611a0 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 19:33:27 user nova-compute[75216]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 19:33:27 user nova-compute[75216]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75216) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 19:33:27 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7765a0e-68f4-4c3c-a002-bc79bbc611a0 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0bb8e1a0-1257-4491-b9ef-d8b8e07ef1f7', 0)] {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 19:33:27 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:33:27 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:33:27 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[573476a3-6bfa-48c3-b843-5362266e1ee0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0bb8e1a0-1257-4491-b9ef-d8b8e07ef1f7\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:33:27 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:33:27 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:33:27 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[0834e6a0-53a0-4f58-853a-e41e29fc718a]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bb8e1a0-1257-4491-b9ef-d8b8e07ef1f7 (non-flash)\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:33:27 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7765a0e-68f4-4c3c-a002-bc79bbc611a0 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bb8e1a0-1257-4491-b9ef-d8b8e07ef1f7 (non-flash)
Nov 13 19:33:27 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 19:33:27 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7765a0e-68f4-4c3c-a002-bc79bbc611a0 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bb8e1a0-1257-4491-b9ef-d8b8e07ef1f7 (non-flash)
Nov 13 19:33:27 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 19:33:27 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7765a0e-68f4-4c3c-a002-bc79bbc611a0 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe3c0266f80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0bb8e1a0-1257-4491-b9ef-d8b8e07ef1f7'): ({'sdb'}, set())}) {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 19:33:27 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-e7765a0e-68f4-4c3c-a002-bc79bbc611a0 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Removing single pathed devices sdb {{(pid=75216) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 19:33:27 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:33:27 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:33:27 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff68b66d-7059-4882-b76f-b7444740cbf9]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:33:27 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:33:27 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:33:27 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c3db428-5d99-48f4-89f4-841ffe9aa0c4]: (4, ('ok\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:33:27 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-e7765a0e-68f4-4c3c-a002-bc79bbc611a0 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Flushing IO for device /dev/sdb {{(pid=75216) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 19:33:27 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:33:27 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:33:27 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5928beb-812e-4258-8e8e-24e4d31bf244]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:33:27 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-e7765a0e-68f4-4c3c-a002-bc79bbc611a0 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75216) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 19:33:27 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:33:27 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.055s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:33:27 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[bac9d61a-051f-4b68-ab0b-d6d2f8205178]: (4, ('1', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:33:27 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-e7765a0e-68f4-4c3c-a002-bc79bbc611a0 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 19:33:27 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-e7765a0e-68f4-4c3c-a002-bc79bbc611a0 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] SCSI volumes sdb have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 19:33:27 user nova-compute[75216]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOaff067b6-d93dc96f7f96a977', '/dev/disk/by-id/scsi-26439336463393666', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_aff067b6') {{(pid=85984) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 13 19:33:27 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[8213a50f-6147-426b-a883-1fcd99225298]: (4, None) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:33:27 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7765a0e-68f4-4c3c-a002-bc79bbc611a0 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0bb8e1a0-1257-4491-b9ef-d8b8e07ef1f7')] {{(pid=75216) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 19:33:27 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0bb8e1a0-1257-4491-b9ef-d8b8e07ef1f7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:33:27 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0bb8e1a0-1257-4491-b9ef-d8b8e07ef1f7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:33:27 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d020059-858d-4d40-ae5b-295fbf6762db]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:33:27 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7765a0e-68f4-4c3c-a002-bc79bbc611a0 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:33:27 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0bb8e1a0-1257-4491-b9ef-d8b8e07ef1f7 -p 172.16.0.220:3260 --logout {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:33:27 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0bb8e1a0-1257-4491-b9ef-d8b8e07ef1f7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:33:27 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f6024e9-a1ed-4274-9393-2058d25888a2]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:0bb8e1a0-1257-4491-b9ef-d8b8e07ef1f7, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:0bb8e1a0-1257-4491-b9ef-d8b8e07ef1f7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:33:27 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7765a0e-68f4-4c3c-a002-bc79bbc611a0 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:0bb8e1a0-1257-4491-b9ef-d8b8e07ef1f7, portal: 172.16.0.220,3260]
Nov 13 19:33:27 user nova-compute[75216]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:0bb8e1a0-1257-4491-b9ef-d8b8e07ef1f7, portal: 172.16.0.220,3260] successful.
Nov 13 19:33:27 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:33:27 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0bb8e1a0-1257-4491-b9ef-d8b8e07ef1f7 -p 172.16.0.220:3260 --op delete {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:33:27 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0bb8e1a0-1257-4491-b9ef-d8b8e07ef1f7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:33:27 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[42575deb-fdf2-48fb-bed2-d5da192a0f10]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:33:27 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7765a0e-68f4-4c3c-a002-bc79bbc611a0 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:33:27 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-e7765a0e-68f4-4c3c-a002-bc79bbc611a0 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.323s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 19:33:27 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7765a0e-68f4-4c3c-a002-bc79bbc611a0 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] <== disconnect_volume: return (325ms) None {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 19:33:27 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e7765a0e-68f4-4c3c-a002-bc79bbc611a0 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 06fd14bc-508c-4d70-b7b6-f536bb2601a6] Disconnected iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 19:33:27 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-e7765a0e-68f4-4c3c-a002-bc79bbc611a0 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 06fd14bc-508c-4d70-b7b6-f536bb2601a6] Deleting instance files /opt/stack/data/nova/instances/06fd14bc-508c-4d70-b7b6-f536bb2601a6_del
Nov 13 19:33:27 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-e7765a0e-68f4-4c3c-a002-bc79bbc611a0 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 06fd14bc-508c-4d70-b7b6-f536bb2601a6] Deletion of /opt/stack/data/nova/instances/06fd14bc-508c-4d70-b7b6-f536bb2601a6_del complete
Nov 13 19:33:28 user nova-compute[75216]: INFO nova.compute.manager [None req-e7765a0e-68f4-4c3c-a002-bc79bbc611a0 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 06fd14bc-508c-4d70-b7b6-f536bb2601a6] Took 1.18 seconds to destroy the instance on the hypervisor.
Nov 13 19:33:28 user nova-compute[75216]: DEBUG oslo.service.loopingcall [None req-e7765a0e-68f4-4c3c-a002-bc79bbc611a0 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75216) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 19:33:28 user nova-compute[75216]: DEBUG nova.compute.manager [-] [instance: 06fd14bc-508c-4d70-b7b6-f536bb2601a6] Deallocating network for instance {{(pid=75216) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 19:33:28 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: 06fd14bc-508c-4d70-b7b6-f536bb2601a6] deallocate_for_instance() {{(pid=75216) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 19:33:28 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:33:28 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: 06fd14bc-508c-4d70-b7b6-f536bb2601a6] Updating instance_info_cache with network_info: [] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:33:28 user nova-compute[75216]: INFO nova.compute.manager [-] [instance: 06fd14bc-508c-4d70-b7b6-f536bb2601a6] Took 0.62 seconds to deallocate network for instance.
Nov 13 19:33:29 user nova-compute[75216]: DEBUG nova.compute.manager [req-a236e562-70b7-450f-a397-885ea203c8cd req-2a0718bf-a0aa-443b-9889-2627b357fbce service nova] [instance: 06fd14bc-508c-4d70-b7b6-f536bb2601a6] Received event network-vif-plugged-17485923-5f1e-4a16-9279-032f55bf4ce6 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:33:29 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-a236e562-70b7-450f-a397-885ea203c8cd req-2a0718bf-a0aa-443b-9889-2627b357fbce service nova] Acquiring lock "06fd14bc-508c-4d70-b7b6-f536bb2601a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:33:29 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-a236e562-70b7-450f-a397-885ea203c8cd req-2a0718bf-a0aa-443b-9889-2627b357fbce service nova] Lock "06fd14bc-508c-4d70-b7b6-f536bb2601a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:33:29 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-a236e562-70b7-450f-a397-885ea203c8cd req-2a0718bf-a0aa-443b-9889-2627b357fbce service nova] Lock "06fd14bc-508c-4d70-b7b6-f536bb2601a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:33:29 user nova-compute[75216]: DEBUG nova.compute.manager [req-a236e562-70b7-450f-a397-885ea203c8cd req-2a0718bf-a0aa-443b-9889-2627b357fbce service nova] [instance: 06fd14bc-508c-4d70-b7b6-f536bb2601a6] No waiting events found dispatching network-vif-plugged-17485923-5f1e-4a16-9279-032f55bf4ce6 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 19:33:29 user nova-compute[75216]: WARNING nova.compute.manager [req-a236e562-70b7-450f-a397-885ea203c8cd req-2a0718bf-a0aa-443b-9889-2627b357fbce service nova] [instance: 06fd14bc-508c-4d70-b7b6-f536bb2601a6] Received unexpected event network-vif-plugged-17485923-5f1e-4a16-9279-032f55bf4ce6 for instance with vm_state active and task_state deleting.
Nov 13 19:33:29 user nova-compute[75216]: DEBUG nova.compute.manager [req-a236e562-70b7-450f-a397-885ea203c8cd req-2a0718bf-a0aa-443b-9889-2627b357fbce service nova] [instance: 06fd14bc-508c-4d70-b7b6-f536bb2601a6] Received event network-vif-deleted-17485923-5f1e-4a16-9279-032f55bf4ce6 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:33:29 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:33:29 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:33:29 user nova-compute[75216]: INFO nova.compute.manager [None req-e7765a0e-68f4-4c3c-a002-bc79bbc611a0 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 06fd14bc-508c-4d70-b7b6-f536bb2601a6] Took 0.75 seconds to detach 1 volumes for instance.
Nov 13 19:33:29 user nova-compute[75216]: DEBUG nova.compute.manager [None req-e7765a0e-68f4-4c3c-a002-bc79bbc611a0 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 06fd14bc-508c-4d70-b7b6-f536bb2601a6] Deleting volume: 0bb8e1a0-1257-4491-b9ef-d8b8e07ef1f7 {{(pid=75216) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 13 19:33:29 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:33:29 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:33:29 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:33:29 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Auditing locally available compute resources for user (node: user) {{(pid=75216) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 19:33:29 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e7765a0e-68f4-4c3c-a002-bc79bbc611a0 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:33:29 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e7765a0e-68f4-4c3c-a002-bc79bbc611a0 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:33:29 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 19:33:29 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 19:33:29 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Hypervisor/Node resource view: name=user free_ram=9101MB free_disk=25.271221160888672GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75216) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 19:33:29 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:33:29 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-e7765a0e-68f4-4c3c-a002-bc79bbc611a0 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 19:33:29 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-e7765a0e-68f4-4c3c-a002-bc79bbc611a0 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 19:33:29 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e7765a0e-68f4-4c3c-a002-bc79bbc611a0 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.119s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:33:29 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.112s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:33:29 user nova-compute[75216]: INFO nova.scheduler.client.report [None req-e7765a0e-68f4-4c3c-a002-bc79bbc611a0 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Deleted allocations for instance 06fd14bc-508c-4d70-b7b6-f536bb2601a6
Nov 13 19:33:29 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 19:33:29 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 19:33:30 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 19:33:30 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 19:33:30 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e7765a0e-68f4-4c3c-a002-bc79bbc611a0 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Lock "06fd14bc-508c-4d70-b7b6-f536bb2601a6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.185s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:33:30 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Compute_service record updated for user:user {{(pid=75216) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 19:33:30 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.154s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:33:32 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:33:32 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Starting heal instance info cache {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 19:33:32 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Rebuilding the list of instances to heal {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 13 19:33:32 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Didn't find any instances for network info cache update. {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 13 19:33:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:33:34 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:33:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:33:42 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:33:45 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:33:47 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:33:52 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:33:57 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:34:02 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:34:07 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:34:12 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:34:15 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:34:17 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:34:17 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:34:18 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:34:22 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:34:23 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-5f25469f-f3d4-48bd-abae-bc738a4d4e14 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Acquiring lock "402453a5-6ad0-4e71-b224-38e8004891af" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:34:23 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-5f25469f-f3d4-48bd-abae-bc738a4d4e14 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Lock "402453a5-6ad0-4e71-b224-38e8004891af" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:34:24 user nova-compute[75216]: DEBUG nova.compute.manager [None req-5f25469f-f3d4-48bd-abae-bc738a4d4e14 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 402453a5-6ad0-4e71-b224-38e8004891af] Starting instance... {{(pid=75216) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 19:34:24 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-5f25469f-f3d4-48bd-abae-bc738a4d4e14 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:34:24 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-5f25469f-f3d4-48bd-abae-bc738a4d4e14 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:34:24 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-5f25469f-f3d4-48bd-abae-bc738a4d4e14 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75216) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 19:34:24 user nova-compute[75216]: INFO nova.compute.claims [None req-5f25469f-f3d4-48bd-abae-bc738a4d4e14 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 402453a5-6ad0-4e71-b224-38e8004891af] Claim successful on node user
Nov 13 19:34:24 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-5f25469f-f3d4-48bd-abae-bc738a4d4e14 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 19:34:24 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-5f25469f-f3d4-48bd-abae-bc738a4d4e14 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 19:34:24 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-5f25469f-f3d4-48bd-abae-bc738a4d4e14 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.197s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:34:24 user nova-compute[75216]: DEBUG nova.compute.manager [None req-5f25469f-f3d4-48bd-abae-bc738a4d4e14 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 402453a5-6ad0-4e71-b224-38e8004891af] Start building networks asynchronously for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 19:34:24 user nova-compute[75216]: DEBUG nova.compute.manager [None req-5f25469f-f3d4-48bd-abae-bc738a4d4e14 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 402453a5-6ad0-4e71-b224-38e8004891af] Allocating IP information in the background. {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 19:34:24 user nova-compute[75216]: DEBUG nova.network.neutron [None req-5f25469f-f3d4-48bd-abae-bc738a4d4e14 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 402453a5-6ad0-4e71-b224-38e8004891af] allocate_for_instance() {{(pid=75216) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 19:34:24 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-5f25469f-f3d4-48bd-abae-bc738a4d4e14 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 402453a5-6ad0-4e71-b224-38e8004891af] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 19:34:24 user nova-compute[75216]: DEBUG nova.compute.manager [None req-5f25469f-f3d4-48bd-abae-bc738a4d4e14 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 402453a5-6ad0-4e71-b224-38e8004891af] Start building block device mappings for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 19:34:24 user nova-compute[75216]: DEBUG nova.policy [None req-5f25469f-f3d4-48bd-abae-bc738a4d4e14 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bfc6b02c16664b8dbea3a6f2088ec385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1951a52e7c4ef5ac6a0d9d5380d41a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75216) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 19:34:24 user nova-compute[75216]: INFO nova.virt.block_device [None req-5f25469f-f3d4-48bd-abae-bc738a4d4e14 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 402453a5-6ad0-4e71-b224-38e8004891af] Booting with volume dac4ffc7-c907-49c6-81da-c8700d141c1e at /dev/vda
Nov 13 19:34:24 user nova-compute[75216]: DEBUG os_brick.utils [None req-5f25469f-f3d4-48bd-abae-bc738a4d4e14 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 19:34:24 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:34:24 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:34:24 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[5badae43-0047-4187-9169-68903b6cbdc2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aea6fcfe14b9\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:34:24 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:34:24 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:34:24 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[538f66a2-42a4-4614-b59f-2358c645f0b9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:34:24 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:34:24 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:34:24 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[64273685-ec66-471c-8c42-130735d928d8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:34:24 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[de28d630-109b-41f5-a005-411d04c99392]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:34:24 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-5f25469f-f3d4-48bd-abae-bc738a4d4e14 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Running cmd (subprocess): nvme version {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:34:24 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-5f25469f-f3d4-48bd-abae-bc738a4d4e14 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] 'nvme version' failed. Not Retrying. {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 19:34:24 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5f25469f-f3d4-48bd-abae-bc738a4d4e14 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] nvme not present on system {{(pid=75216) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 19:34:24 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:34:24 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 19:34:24 user nova-compute[75216]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 19:34:24 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a187ebe-4b4a-44e7-b62b-43108606007e]: (4, '') {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:34:24 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-5f25469f-f3d4-48bd-abae-bc738a4d4e14 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75216) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 19:34:24 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-5f25469f-f3d4-48bd-abae-bc738a4d4e14 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 19:34:24 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-5f25469f-f3d4-48bd-abae-bc738a4d4e14 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] LIGHTOS: no hostnqn found. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 19:34:24 user nova-compute[75216]: DEBUG os_brick.utils [None req-5f25469f-f3d4-48bd-abae-bc738a4d4e14 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aea6fcfe14b9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 19:34:24 user nova-compute[75216]: DEBUG nova.virt.block_device [None req-5f25469f-f3d4-48bd-abae-bc738a4d4e14 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 402453a5-6ad0-4e71-b224-38e8004891af] Updating existing volume attachment record: 3b0621c0-1f71-41d7-8933-0457d25332e8 {{(pid=75216) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 19:34:25 user nova-compute[75216]: DEBUG nova.network.neutron [None req-5f25469f-f3d4-48bd-abae-bc738a4d4e14 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 402453a5-6ad0-4e71-b224-38e8004891af] Successfully created port: d6622ca6-8fea-4b1c-a9ab-04d6034237fb {{(pid=75216) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 19:34:25 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:34:25 user nova-compute[75216]: DEBUG nova.network.neutron [None req-5f25469f-f3d4-48bd-abae-bc738a4d4e14 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 402453a5-6ad0-4e71-b224-38e8004891af] Successfully updated port: d6622ca6-8fea-4b1c-a9ab-04d6034237fb {{(pid=75216) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 19:34:25 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-5f25469f-f3d4-48bd-abae-bc738a4d4e14 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Acquiring lock "refresh_cache-402453a5-6ad0-4e71-b224-38e8004891af" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 19:34:25 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-5f25469f-f3d4-48bd-abae-bc738a4d4e14 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Acquired lock "refresh_cache-402453a5-6ad0-4e71-b224-38e8004891af" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 19:34:25 user nova-compute[75216]: DEBUG nova.network.neutron [None req-5f25469f-f3d4-48bd-abae-bc738a4d4e14 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 402453a5-6ad0-4e71-b224-38e8004891af] Building network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 19:34:25 user nova-compute[75216]: DEBUG nova.compute.manager [req-ce7ac7a2-9ba8-4518-b4b2-09767190d345 req-4b5ea36f-09f8-4ff3-aa6c-e3c4d36906b9 service nova] [instance: 402453a5-6ad0-4e71-b224-38e8004891af] Received event network-changed-d6622ca6-8fea-4b1c-a9ab-04d6034237fb {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:34:25 user nova-compute[75216]: DEBUG nova.compute.manager [req-ce7ac7a2-9ba8-4518-b4b2-09767190d345 req-4b5ea36f-09f8-4ff3-aa6c-e3c4d36906b9 service nova] [instance: 402453a5-6ad0-4e71-b224-38e8004891af] Refreshing instance network info cache due to event network-changed-d6622ca6-8fea-4b1c-a9ab-04d6034237fb. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 19:34:25 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-ce7ac7a2-9ba8-4518-b4b2-09767190d345 req-4b5ea36f-09f8-4ff3-aa6c-e3c4d36906b9 service nova] Acquiring lock "refresh_cache-402453a5-6ad0-4e71-b224-38e8004891af" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 19:34:26 user nova-compute[75216]: DEBUG nova.network.neutron [None req-5f25469f-f3d4-48bd-abae-bc738a4d4e14 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 402453a5-6ad0-4e71-b224-38e8004891af] Instance cache missing network info. {{(pid=75216) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 19:34:26 user nova-compute[75216]: DEBUG nova.network.neutron [None req-5f25469f-f3d4-48bd-abae-bc738a4d4e14 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 402453a5-6ad0-4e71-b224-38e8004891af] Updating instance_info_cache with network_info: [{"id": "d6622ca6-8fea-4b1c-a9ab-04d6034237fb", "address": "fa:16:3e:de:31:8a", "network": {"id": "5881a45c-3f28-48c4-aa8e-045b3bea3227", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1651070715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a1951a52e7c4ef5ac6a0d9d5380d41a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6622ca6-8f", "ovs_interfaceid": "d6622ca6-8fea-4b1c-a9ab-04d6034237fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:34:26 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-5f25469f-f3d4-48bd-abae-bc738a4d4e14 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Releasing lock "refresh_cache-402453a5-6ad0-4e71-b224-38e8004891af" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 19:34:26 user nova-compute[75216]: DEBUG nova.compute.manager [None req-5f25469f-f3d4-48bd-abae-bc738a4d4e14 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 402453a5-6ad0-4e71-b224-38e8004891af] Instance network_info: |[{"id": "d6622ca6-8fea-4b1c-a9ab-04d6034237fb", "address": "fa:16:3e:de:31:8a", "network": {"id": "5881a45c-3f28-48c4-aa8e-045b3bea3227", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1651070715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a1951a52e7c4ef5ac6a0d9d5380d41a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6622ca6-8f", "ovs_interfaceid": "d6622ca6-8fea-4b1c-a9ab-04d6034237fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 19:34:26 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-ce7ac7a2-9ba8-4518-b4b2-09767190d345 req-4b5ea36f-09f8-4ff3-aa6c-e3c4d36906b9 service nova] Acquired lock "refresh_cache-402453a5-6ad0-4e71-b224-38e8004891af" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 19:34:26 user nova-compute[75216]: DEBUG nova.network.neutron [req-ce7ac7a2-9ba8-4518-b4b2-09767190d345 req-4b5ea36f-09f8-4ff3-aa6c-e3c4d36906b9 service nova] [instance: 402453a5-6ad0-4e71-b224-38e8004891af] Refreshing network info cache for port d6622ca6-8fea-4b1c-a9ab-04d6034237fb {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 19:34:26 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:34:26 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75216) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 19:34:26 user nova-compute[75216]: DEBUG nova.network.neutron [req-ce7ac7a2-9ba8-4518-b4b2-09767190d345 req-4b5ea36f-09f8-4ff3-aa6c-e3c4d36906b9 service nova] [instance: 402453a5-6ad0-4e71-b224-38e8004891af] Updated VIF entry in instance network info cache for port d6622ca6-8fea-4b1c-a9ab-04d6034237fb. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 19:34:26 user nova-compute[75216]: DEBUG nova.network.neutron [req-ce7ac7a2-9ba8-4518-b4b2-09767190d345 req-4b5ea36f-09f8-4ff3-aa6c-e3c4d36906b9 service nova] [instance: 402453a5-6ad0-4e71-b224-38e8004891af] Updating instance_info_cache with network_info: [{"id": "d6622ca6-8fea-4b1c-a9ab-04d6034237fb", "address": "fa:16:3e:de:31:8a", "network": {"id": "5881a45c-3f28-48c4-aa8e-045b3bea3227", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1651070715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a1951a52e7c4ef5ac6a0d9d5380d41a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6622ca6-8f", "ovs_interfaceid": "d6622ca6-8fea-4b1c-a9ab-04d6034237fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:34:26 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-ce7ac7a2-9ba8-4518-b4b2-09767190d345 req-4b5ea36f-09f8-4ff3-aa6c-e3c4d36906b9 service nova] Releasing lock "refresh_cache-402453a5-6ad0-4e71-b224-38e8004891af" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 19:34:27 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:34:28 user nova-compute[75216]: DEBUG nova.compute.manager [None req-5f25469f-f3d4-48bd-abae-bc738a4d4e14 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 402453a5-6ad0-4e71-b224-38e8004891af] Start spawning the instance on the hypervisor. {{(pid=75216) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 19:34:28 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-5f25469f-f3d4-48bd-abae-bc738a4d4e14 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 402453a5-6ad0-4e71-b224-38e8004891af] Creating instance directory {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 19:34:28 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-5f25469f-f3d4-48bd-abae-bc738a4d4e14 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 402453a5-6ad0-4e71-b224-38e8004891af] Creating image(s)
Nov 13 19:34:28 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-5f25469f-f3d4-48bd-abae-bc738a4d4e14 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 402453a5-6ad0-4e71-b224-38e8004891af] Did not create local disks {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 13 19:34:28 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-5f25469f-f3d4-48bd-abae-bc738a4d4e14 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 402453a5-6ad0-4e71-b224-38e8004891af] Ensure instance console log exists: /opt/stack/data/nova/instances/402453a5-6ad0-4e71-b224-38e8004891af/console.log {{(pid=75216) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 19:34:28 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-5f25469f-f3d4-48bd-abae-bc738a4d4e14 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:34:28 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-5f25469f-f3d4-48bd-abae-bc738a4d4e14 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:34:28 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-5f25469f-f3d4-48bd-abae-bc738a4d4e14 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:34:28 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-5f25469f-f3d4-48bd-abae-bc738a4d4e14 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 402453a5-6ad0-4e71-b224-38e8004891af] Start _get_guest_xml network_info=[{"id": "d6622ca6-8fea-4b1c-a9ab-04d6034237fb", "address": "fa:16:3e:de:31:8a", "network": {"id": "5881a45c-3f28-48c4-aa8e-045b3bea3227", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1651070715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a1951a52e7c4ef5ac6a0d9d5380d41a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6622ca6-8f", "ovs_interfaceid": "d6622ca6-8fea-4b1c-a9ab-04d6034237fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:dac4ffc7-c907-49c6-81da-c8700d141c1e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CcyHdMDU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '402453a5-6ad0-4e71-b224-38e8004891af', 'attached_at': '', 'detached_at': '', 'volume_id': 'dac4ffc7-c907-49c6-81da-c8700d141c1e', 'serial': 'dac4ffc7-c907-49c6-81da-c8700d141c1e'}, 'attachment_id': '3b0621c0-1f71-41d7-8933-0457d25332e8', 'guest_format': None, 'mount_device': '/dev/vda', 'delete_on_termination': False, 'boot_index': 0, 'volume_type': None} {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 19:34:28 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-5f25469f-f3d4-48bd-abae-bc738a4d4e14 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 19:34:28 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-5f25469f-f3d4-48bd-abae-bc738a4d4e14 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 19:34:28 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-5f25469f-f3d4-48bd-abae-bc738a4d4e14 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 19:34:28 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-5f25469f-f3d4-48bd-abae-bc738a4d4e14 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] CPU controller missing on host. {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 19:34:28 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-5f25469f-f3d4-48bd-abae-bc738a4d4e14 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 19:34:28 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-5f25469f-f3d4-48bd-abae-bc738a4d4e14 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] CPU controller found on host. {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 19:34:28 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-5f25469f-f3d4-48bd-abae-bc738a4d4e14 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75216) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 19:34:28 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-5f25469f-f3d4-48bd-abae-bc738a4d4e14 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T18:40:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 19:34:28 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-5f25469f-f3d4-48bd-abae-bc738a4d4e14 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Flavor limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 19:34:28 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-5f25469f-f3d4-48bd-abae-bc738a4d4e14 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Image limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 19:34:28 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-5f25469f-f3d4-48bd-abae-bc738a4d4e14 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Flavor pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 19:34:28 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-5f25469f-f3d4-48bd-abae-bc738a4d4e14 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Image pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 19:34:28 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-5f25469f-f3d4-48bd-abae-bc738a4d4e14 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 19:34:28 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-5f25469f-f3d4-48bd-abae-bc738a4d4e14 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 19:34:28 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-5f25469f-f3d4-48bd-abae-bc738a4d4e14 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 19:34:28 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-5f25469f-f3d4-48bd-abae-bc738a4d4e14 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Got 1 possible topologies {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 19:34:28 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-5f25469f-f3d4-48bd-abae-bc738a4d4e14 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 19:34:28 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-5f25469f-f3d4-48bd-abae-bc738a4d4e14 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 19:34:28 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5f25469f-f3d4-48bd-abae-bc738a4d4e14 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 402453a5-6ad0-4e71-b224-38e8004891af] Calling os-brick to attach iSCSI Volume {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 19:34:28 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f25469f-f3d4-48bd-abae-bc738a4d4e14 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3a8669e40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:dac4ffc7-c907-49c6-81da-c8700d141c1e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CcyHdMDU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 19:34:28 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-5f25469f-f3d4-48bd-abae-bc738a4d4e14 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 19:34:28 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-5f25469f-f3d4-48bd-abae-bc738a4d4e14 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 19:34:28 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-5f25469f-f3d4-48bd-abae-bc738a4d4e14 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 19:34:28 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-5f25469f-f3d4-48bd-abae-bc738a4d4e14 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 19:34:28 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-5f25469f-f3d4-48bd-abae-bc738a4d4e14 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dac4ffc7-c907-49c6-81da-c8700d141c1e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 19:34:28 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-5f25469f-f3d4-48bd-abae-bc738a4d4e14 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dac4ffc7-c907-49c6-81da-c8700d141c1e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 19:34:28 user nova-compute[75216]: INFO os_brick.initiator.connectors.iscsi [None req-5f25469f-f3d4-48bd-abae-bc738a4d4e14 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 19:34:28 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dac4ffc7-c907-49c6-81da-c8700d141c1e -p 172.16.0.220:3260 {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:34:28 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dac4ffc7-c907-49c6-81da-c8700d141c1e -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:34:28 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e8441ce-9432-4294-b6a5-513b0aedb2a8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:34:28 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f25469f-f3d4-48bd-abae-bc738a4d4e14 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 19:34:28 user nova-compute[75216]:  {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:34:28 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dac4ffc7-c907-49c6-81da-c8700d141c1e -p 172.16.0.220:3260 --interface default --op new {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:34:28 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dac4ffc7-c907-49c6-81da-c8700d141c1e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:34:28 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[50fb60bd-94c2-4831-8902-9f3fcc8288ba]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dac4ffc7-c907-49c6-81da-c8700d141c1e] added\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:34:28 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f25469f-f3d4-48bd-abae-bc738a4d4e14 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dac4ffc7-c907-49c6-81da-c8700d141c1e] added
Nov 13 19:34:28 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:34:28 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dac4ffc7-c907-49c6-81da-c8700d141c1e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:34:28 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dac4ffc7-c907-49c6-81da-c8700d141c1e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:34:28 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[07fd48b9-a292-4339-ab4e-93ad75520c75]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:34:28 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f25469f-f3d4-48bd-abae-bc738a4d4e14 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:34:28 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dac4ffc7-c907-49c6-81da-c8700d141c1e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:34:28 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dac4ffc7-c907-49c6-81da-c8700d141c1e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:34:28 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[42c182cb-208d-4354-b448-e0dc3db89c75]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:34:28 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f25469f-f3d4-48bd-abae-bc738a4d4e14 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:34:28 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dac4ffc7-c907-49c6-81da-c8700d141c1e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CcyHdMDU {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:34:28 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dac4ffc7-c907-49c6-81da-c8700d141c1e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CcyHdMDU" returned: 0 in 0.017s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:34:28 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[7af4ad01-2404-473f-b7a6-5a4087d31b0a]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:34:28 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f25469f-f3d4-48bd-abae-bc738a4d4e14 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CcyHdMDU'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:34:28 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dac4ffc7-c907-49c6-81da-c8700d141c1e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:34:28 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dac4ffc7-c907-49c6-81da-c8700d141c1e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:34:28 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fa3c20b-f83d-41e8-bf1c-dc4e1ebbecf3]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:34:28 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f25469f-f3d4-48bd-abae-bc738a4d4e14 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:34:28 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:34:29 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:34:29 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[b63680c9-d935-4e1d-b1ca-418a8cf4ea2e]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:34:29 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f25469f-f3d4-48bd-abae-bc738a4d4e14 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 13 19:34:29 user nova-compute[75216]:  {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 19:34:29 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f25469f-f3d4-48bd-abae-bc738a4d4e14 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 13 19:34:29 user nova-compute[75216]:  {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 19:34:29 user nova-compute[75216]: WARNING os_brick.initiator.connectors.iscsi [None req-5f25469f-f3d4-48bd-abae-bc738a4d4e14 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 13 19:34:29 user nova-compute[75216]: 
Nov 13 19:34:29 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dac4ffc7-c907-49c6-81da-c8700d141c1e -p 172.16.0.220:3260 --login {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:34:29 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dac4ffc7-c907-49c6-81da-c8700d141c1e -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:34:29 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[20ed9435-a038-4a5f-a34c-b192f3f62bf7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:dac4ffc7-c907-49c6-81da-c8700d141c1e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:dac4ffc7-c907-49c6-81da-c8700d141c1e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:34:29 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f25469f-f3d4-48bd-abae-bc738a4d4e14 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:dac4ffc7-c907-49c6-81da-c8700d141c1e, portal: 172.16.0.220,3260]
Nov 13 19:34:29 user nova-compute[75216]: Login to [iface: default, target: iqn.2010-10.org.openstack:dac4ffc7-c907-49c6-81da-c8700d141c1e, portal: 172.16.0.220,3260] successful.
Nov 13 19:34:29 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:34:29 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dac4ffc7-c907-49c6-81da-c8700d141c1e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:34:29 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dac4ffc7-c907-49c6-81da-c8700d141c1e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:34:29 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec9783a1-52d9-4a71-bd8a-940befec482e]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:34:29 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f25469f-f3d4-48bd-abae-bc738a4d4e14 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:34:29 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:34:29 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:34:29 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[03c02aef-d8ba-48e6-b322-bfd7b16074e3]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dac4ffc7-c907-49c6-81da-c8700d141c1e (non-flash)\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:34:29 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f25469f-f3d4-48bd-abae-bc738a4d4e14 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dac4ffc7-c907-49c6-81da-c8700d141c1e (non-flash)
Nov 13 19:34:29 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 19:34:29 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f25469f-f3d4-48bd-abae-bc738a4d4e14 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dac4ffc7-c907-49c6-81da-c8700d141c1e (non-flash)
Nov 13 19:34:29 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 19:34:29 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-5f25469f-f3d4-48bd-abae-bc738a4d4e14 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dac4ffc7-c907-49c6-81da-c8700d141c1e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.266s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 19:34:29 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f25469f-f3d4-48bd-abae-bc738a4d4e14 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Connected to 172.16.0.220:3260 {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 19:34:29 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-5f25469f-f3d4-48bd-abae-bc738a4d4e14 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] HCTL ('33', '-', '-', 0) found on session 57 with lun 0 {{(pid=75216) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 19:34:29 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-5f25469f-f3d4-48bd-abae-bc738a4d4e14 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75216) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 19:34:29 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:34:29 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:34:29 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdaeb27d-481c-4e3c-8667-c9554f9059af]: (4, ('- - 0', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:34:29 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-5f25469f-f3d4-48bd-abae-bc738a4d4e14 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Searching for a device in session 57 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75216) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 19:34:29 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f25469f-f3d4-48bd-abae-bc738a4d4e14 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:dac4ffc7-c907-49c6-81da-c8700d141c1e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CcyHdMDU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 19:34:30 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-5f25469f-f3d4-48bd-abae-bc738a4d4e14 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.298s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 19:34:30 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f25469f-f3d4-48bd-abae-bc738a4d4e14 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] <== connect_volume: return (1300ms) {'type': 'block', 'scsi_wwn': '23937373132626239', 'path': '/dev/sdb'} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 19:34:30 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5f25469f-f3d4-48bd-abae-bc738a4d4e14 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 402453a5-6ad0-4e71-b224-38e8004891af] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23937373132626239', 'path': '/dev/sdb'} {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 19:34:30 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-5f25469f-f3d4-48bd-abae-bc738a4d4e14 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T19:34:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-890582642',display_name='tempest-TestVolumeBootPattern-server-890582642',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-890582642',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJoiZwaxJA3L6zg1VlDIL2iywK8D207KUdpx1vJqr+ljXQkA4jTUHYbkCYqoa39qc34qT95KOeBJjIq8vzC1Og4pbsAomDAW7M51FJ+JGdR7hmjZWz1zbUNVDWRemA+lQw==',key_name='tempest-TestVolumeBootPattern-21317594',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3a1951a52e7c4ef5ac6a0d9d5380d41a',ramdisk_id='',reservation_id='r-4177rr22',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1444343509',owner_user_name='tempest-TestVolumeBootPattern-1444343509-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T19:34:24Z,user_data=None,user_id='bfc6b02c16664b8dbea3a6f2088ec385',uuid=402453a5-6ad0-4e71-b224-38e8004891af,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d6622ca6-8fea-4b1c-a9ab-04d6034237fb", "address": "fa:16:3e:de:31:8a", "network": {"id": "5881a45c-3f28-48c4-aa8e-045b3bea3227", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1651070715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a1951a52e7c4ef5ac6a0d9d5380d41a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6622ca6-8f", "ovs_interfaceid": "d6622ca6-8fea-4b1c-a9ab-04d6034237fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75216) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 19:34:30 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-5f25469f-f3d4-48bd-abae-bc738a4d4e14 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Converting VIF {"id": "d6622ca6-8fea-4b1c-a9ab-04d6034237fb", "address": "fa:16:3e:de:31:8a", "network": {"id": "5881a45c-3f28-48c4-aa8e-045b3bea3227", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1651070715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a1951a52e7c4ef5ac6a0d9d5380d41a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6622ca6-8f", "ovs_interfaceid": "d6622ca6-8fea-4b1c-a9ab-04d6034237fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 19:34:30 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-5f25469f-f3d4-48bd-abae-bc738a4d4e14 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:31:8a,bridge_name='br-int',has_traffic_filtering=True,id=d6622ca6-8fea-4b1c-a9ab-04d6034237fb,network=Network(5881a45c-3f28-48c4-aa8e-045b3bea3227),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6622ca6-8f') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 19:34:30 user nova-compute[75216]: DEBUG nova.objects.instance [None req-5f25469f-f3d4-48bd-abae-bc738a4d4e14 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Lazy-loading 'pci_devices' on Instance uuid 402453a5-6ad0-4e71-b224-38e8004891af {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:34:30 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-5f25469f-f3d4-48bd-abae-bc738a4d4e14 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 402453a5-6ad0-4e71-b224-38e8004891af] End _get_guest_xml xml=<domain type="kvm">
Nov 13 19:34:30 user nova-compute[75216]:   <uuid>402453a5-6ad0-4e71-b224-38e8004891af</uuid>
Nov 13 19:34:30 user nova-compute[75216]:   <name>instance-00000031</name>
Nov 13 19:34:30 user nova-compute[75216]:   <memory>524288</memory>
Nov 13 19:34:30 user nova-compute[75216]:   <vcpu>1</vcpu>
Nov 13 19:34:30 user nova-compute[75216]:   <metadata>
Nov 13 19:34:30 user nova-compute[75216]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 19:34:30 user nova-compute[75216]:       <nova:package version="0.0.0"/>
Nov 13 19:34:30 user nova-compute[75216]:       <nova:name>tempest-TestVolumeBootPattern-server-890582642</nova:name>
Nov 13 19:34:30 user nova-compute[75216]:       <nova:creationTime>2023-11-13 19:34:28</nova:creationTime>
Nov 13 19:34:30 user nova-compute[75216]:       <nova:flavor name="m1.tiny">
Nov 13 19:34:30 user nova-compute[75216]:         <nova:memory>512</nova:memory>
Nov 13 19:34:30 user nova-compute[75216]:         <nova:disk>1</nova:disk>
Nov 13 19:34:30 user nova-compute[75216]:         <nova:swap>0</nova:swap>
Nov 13 19:34:30 user nova-compute[75216]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 19:34:30 user nova-compute[75216]:         <nova:vcpus>1</nova:vcpus>
Nov 13 19:34:30 user nova-compute[75216]:       </nova:flavor>
Nov 13 19:34:30 user nova-compute[75216]:       <nova:owner>
Nov 13 19:34:30 user nova-compute[75216]:         <nova:user uuid="bfc6b02c16664b8dbea3a6f2088ec385">tempest-TestVolumeBootPattern-1444343509-project-member</nova:user>
Nov 13 19:34:30 user nova-compute[75216]:         <nova:project uuid="3a1951a52e7c4ef5ac6a0d9d5380d41a">tempest-TestVolumeBootPattern-1444343509</nova:project>
Nov 13 19:34:30 user nova-compute[75216]:       </nova:owner>
Nov 13 19:34:30 user nova-compute[75216]:       <nova:ports>
Nov 13 19:34:30 user nova-compute[75216]:         <nova:port uuid="d6622ca6-8fea-4b1c-a9ab-04d6034237fb">
Nov 13 19:34:30 user nova-compute[75216]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 13 19:34:30 user nova-compute[75216]:         </nova:port>
Nov 13 19:34:30 user nova-compute[75216]:       </nova:ports>
Nov 13 19:34:30 user nova-compute[75216]:     </nova:instance>
Nov 13 19:34:30 user nova-compute[75216]:   </metadata>
Nov 13 19:34:30 user nova-compute[75216]:   <sysinfo type="smbios">
Nov 13 19:34:30 user nova-compute[75216]:     <system>
Nov 13 19:34:30 user nova-compute[75216]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 19:34:30 user nova-compute[75216]:       <entry name="product">OpenStack Nova</entry>
Nov 13 19:34:30 user nova-compute[75216]:       <entry name="version">0.0.0</entry>
Nov 13 19:34:30 user nova-compute[75216]:       <entry name="serial">402453a5-6ad0-4e71-b224-38e8004891af</entry>
Nov 13 19:34:30 user nova-compute[75216]:       <entry name="uuid">402453a5-6ad0-4e71-b224-38e8004891af</entry>
Nov 13 19:34:30 user nova-compute[75216]:       <entry name="family">Virtual Machine</entry>
Nov 13 19:34:30 user nova-compute[75216]:     </system>
Nov 13 19:34:30 user nova-compute[75216]:   </sysinfo>
Nov 13 19:34:30 user nova-compute[75216]:   <os>
Nov 13 19:34:30 user nova-compute[75216]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 19:34:30 user nova-compute[75216]:     <boot dev="hd"/>
Nov 13 19:34:30 user nova-compute[75216]:     <smbios mode="sysinfo"/>
Nov 13 19:34:30 user nova-compute[75216]:   </os>
Nov 13 19:34:30 user nova-compute[75216]:   <features>
Nov 13 19:34:30 user nova-compute[75216]:     <acpi/>
Nov 13 19:34:30 user nova-compute[75216]:     <apic/>
Nov 13 19:34:30 user nova-compute[75216]:     <vmcoreinfo/>
Nov 13 19:34:30 user nova-compute[75216]:   </features>
Nov 13 19:34:30 user nova-compute[75216]:   <clock offset="utc">
Nov 13 19:34:30 user nova-compute[75216]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 19:34:30 user nova-compute[75216]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 19:34:30 user nova-compute[75216]:     <timer name="hpet" present="no"/>
Nov 13 19:34:30 user nova-compute[75216]:   </clock>
Nov 13 19:34:30 user nova-compute[75216]:   <cpu mode="custom" match="exact">
Nov 13 19:34:30 user nova-compute[75216]:     <model>Nehalem</model>
Nov 13 19:34:30 user nova-compute[75216]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 19:34:30 user nova-compute[75216]:   </cpu>
Nov 13 19:34:30 user nova-compute[75216]:   <devices>
Nov 13 19:34:30 user nova-compute[75216]:     <disk type="block" device="disk">
Nov 13 19:34:30 user nova-compute[75216]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 19:34:30 user nova-compute[75216]:       <source dev="/dev/sdb"/>
Nov 13 19:34:30 user nova-compute[75216]:       <target dev="vda" bus="virtio"/>
Nov 13 19:34:30 user nova-compute[75216]:       <serial>dac4ffc7-c907-49c6-81da-c8700d141c1e</serial>
Nov 13 19:34:30 user nova-compute[75216]:     </disk>
Nov 13 19:34:30 user nova-compute[75216]:     <interface type="ethernet">
Nov 13 19:34:30 user nova-compute[75216]:       <mac address="fa:16:3e:de:31:8a"/>
Nov 13 19:34:30 user nova-compute[75216]:       <model type="virtio"/>
Nov 13 19:34:30 user nova-compute[75216]:       <mtu size="1442"/>
Nov 13 19:34:30 user nova-compute[75216]:       <target dev="tapd6622ca6-8f"/>
Nov 13 19:34:30 user nova-compute[75216]:     </interface>
Nov 13 19:34:30 user nova-compute[75216]:     <serial type="pty">
Nov 13 19:34:30 user nova-compute[75216]:       <log file="/opt/stack/data/nova/instances/402453a5-6ad0-4e71-b224-38e8004891af/console.log" append="off"/>
Nov 13 19:34:30 user nova-compute[75216]:     </serial>
Nov 13 19:34:30 user nova-compute[75216]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 19:34:30 user nova-compute[75216]:     <video>
Nov 13 19:34:30 user nova-compute[75216]:       <model type="virtio"/>
Nov 13 19:34:30 user nova-compute[75216]:     </video>
Nov 13 19:34:30 user nova-compute[75216]:     <rng model="virtio">
Nov 13 19:34:30 user nova-compute[75216]:       <backend model="random">/dev/urandom</backend>
Nov 13 19:34:30 user nova-compute[75216]:     </rng>
Nov 13 19:34:30 user nova-compute[75216]:     <controller type="usb" index="0" model="none"/>
Nov 13 19:34:30 user nova-compute[75216]:     <memballoon model="virtio">
Nov 13 19:34:30 user nova-compute[75216]:       <stats period="10"/>
Nov 13 19:34:30 user nova-compute[75216]:     </memballoon>
Nov 13 19:34:30 user nova-compute[75216]:   </devices>
Nov 13 19:34:30 user nova-compute[75216]: </domain>
Nov 13 19:34:30 user nova-compute[75216]:  {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 19:34:30 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-5f25469f-f3d4-48bd-abae-bc738a4d4e14 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T19:34:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-890582642',display_name='tempest-TestVolumeBootPattern-server-890582642',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-890582642',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJoiZwaxJA3L6zg1VlDIL2iywK8D207KUdpx1vJqr+ljXQkA4jTUHYbkCYqoa39qc34qT95KOeBJjIq8vzC1Og4pbsAomDAW7M51FJ+JGdR7hmjZWz1zbUNVDWRemA+lQw==',key_name='tempest-TestVolumeBootPattern-21317594',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3a1951a52e7c4ef5ac6a0d9d5380d41a',ramdisk_id='',reservation_id='r-4177rr22',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1444343509',owner_user_name='tempest-TestVolumeBootPattern-1444343509-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T19:34:24Z,user_data=None,user_id='bfc6b02c16664b8dbea3a6f2088ec385',uuid=402453a5-6ad0-4e71-b224-38e8004891af,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d6622ca6-8fea-4b1c-a9ab-04d6034237fb", "address": "fa:16:3e:de:31:8a", "network": {"id": "5881a45c-3f28-48c4-aa8e-045b3bea3227", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1651070715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a1951a52e7c4ef5ac6a0d9d5380d41a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6622ca6-8f", "ovs_interfaceid": "d6622ca6-8fea-4b1c-a9ab-04d6034237fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 19:34:30 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-5f25469f-f3d4-48bd-abae-bc738a4d4e14 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Converting VIF {"id": "d6622ca6-8fea-4b1c-a9ab-04d6034237fb", "address": "fa:16:3e:de:31:8a", "network": {"id": "5881a45c-3f28-48c4-aa8e-045b3bea3227", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1651070715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a1951a52e7c4ef5ac6a0d9d5380d41a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6622ca6-8f", "ovs_interfaceid": "d6622ca6-8fea-4b1c-a9ab-04d6034237fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 19:34:30 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-5f25469f-f3d4-48bd-abae-bc738a4d4e14 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:31:8a,bridge_name='br-int',has_traffic_filtering=True,id=d6622ca6-8fea-4b1c-a9ab-04d6034237fb,network=Network(5881a45c-3f28-48c4-aa8e-045b3bea3227),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6622ca6-8f') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 19:34:30 user nova-compute[75216]: DEBUG os_vif [None req-5f25469f-f3d4-48bd-abae-bc738a4d4e14 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:31:8a,bridge_name='br-int',has_traffic_filtering=True,id=d6622ca6-8fea-4b1c-a9ab-04d6034237fb,network=Network(5881a45c-3f28-48c4-aa8e-045b3bea3227),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6622ca6-8f') {{(pid=75216) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 19:34:30 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:34:30 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:34:30 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 19:34:30 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:34:30 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6d3d39d7-1d60-5d82-9537-a9a170cb204f', '_type': 'linux-noop'}}, row=False) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:34:30 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:34:30 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:34:30 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:34:30 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd6622ca6-8f, may_exist=True, interface_attrs={}) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:34:30 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd6622ca6-8f, col_values=(('qos', UUID('43b7184a-1bea-407c-992d-23acb626d82d')),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:34:30 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd6622ca6-8f, col_values=(('external_ids', {'iface-id': 'd6622ca6-8fea-4b1c-a9ab-04d6034237fb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:de:31:8a', 'vm-uuid': '402453a5-6ad0-4e71-b224-38e8004891af'}),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:34:30 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:34:30 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:34:30 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:34:30 user nova-compute[75216]: INFO os_vif [None req-5f25469f-f3d4-48bd-abae-bc738a4d4e14 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:31:8a,bridge_name='br-int',has_traffic_filtering=True,id=d6622ca6-8fea-4b1c-a9ab-04d6034237fb,network=Network(5881a45c-3f28-48c4-aa8e-045b3bea3227),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6622ca6-8f')
Nov 13 19:34:30 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-5f25469f-f3d4-48bd-abae-bc738a4d4e14 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 19:34:30 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-5f25469f-f3d4-48bd-abae-bc738a4d4e14 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] No VIF found with MAC fa:16:3e:de:31:8a, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 19:34:30 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:34:30 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:34:31 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:34:31 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:34:31 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:34:31 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:34:31 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Auditing locally available compute resources for user (node: user) {{(pid=75216) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 19:34:31 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:34:31 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:34:31 user nova-compute[75216]: DEBUG nova.compute.manager [req-11723eaa-cb9a-4f1e-bd73-714b90b79fcf req-bfa6a830-a5e8-4182-9ec2-c6091d876b83 service nova] [instance: 402453a5-6ad0-4e71-b224-38e8004891af] Received event network-vif-plugged-d6622ca6-8fea-4b1c-a9ab-04d6034237fb {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:34:31 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-11723eaa-cb9a-4f1e-bd73-714b90b79fcf req-bfa6a830-a5e8-4182-9ec2-c6091d876b83 service nova] Acquiring lock "402453a5-6ad0-4e71-b224-38e8004891af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:34:31 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-11723eaa-cb9a-4f1e-bd73-714b90b79fcf req-bfa6a830-a5e8-4182-9ec2-c6091d876b83 service nova] Lock "402453a5-6ad0-4e71-b224-38e8004891af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:34:31 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-11723eaa-cb9a-4f1e-bd73-714b90b79fcf req-bfa6a830-a5e8-4182-9ec2-c6091d876b83 service nova] Lock "402453a5-6ad0-4e71-b224-38e8004891af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:34:31 user nova-compute[75216]: DEBUG nova.compute.manager [req-11723eaa-cb9a-4f1e-bd73-714b90b79fcf req-bfa6a830-a5e8-4182-9ec2-c6091d876b83 service nova] [instance: 402453a5-6ad0-4e71-b224-38e8004891af] No waiting events found dispatching network-vif-plugged-d6622ca6-8fea-4b1c-a9ab-04d6034237fb {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 19:34:31 user nova-compute[75216]: WARNING nova.compute.manager [req-11723eaa-cb9a-4f1e-bd73-714b90b79fcf req-bfa6a830-a5e8-4182-9ec2-c6091d876b83 service nova] [instance: 402453a5-6ad0-4e71-b224-38e8004891af] Received unexpected event network-vif-plugged-d6622ca6-8fea-4b1c-a9ab-04d6034237fb for instance with vm_state building and task_state spawning.
Nov 13 19:34:31 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 19:34:33 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:34:33 user nova-compute[75216]: DEBUG nova.compute.manager [None req-5f25469f-f3d4-48bd-abae-bc738a4d4e14 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 402453a5-6ad0-4e71-b224-38e8004891af] Instance event wait completed in 0 seconds for  {{(pid=75216) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 19:34:33 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-5f25469f-f3d4-48bd-abae-bc738a4d4e14 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 402453a5-6ad0-4e71-b224-38e8004891af] Guest created on hypervisor {{(pid=75216) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 19:34:33 user nova-compute[75216]: DEBUG nova.compute.manager [req-b9195414-1846-4839-97e0-1608367c0405 req-bfa328e3-f4f2-4173-b0e5-c76332046f0a service nova] [instance: 402453a5-6ad0-4e71-b224-38e8004891af] Received event network-vif-plugged-d6622ca6-8fea-4b1c-a9ab-04d6034237fb {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:34:33 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-b9195414-1846-4839-97e0-1608367c0405 req-bfa328e3-f4f2-4173-b0e5-c76332046f0a service nova] Acquiring lock "402453a5-6ad0-4e71-b224-38e8004891af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:34:33 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-b9195414-1846-4839-97e0-1608367c0405 req-bfa328e3-f4f2-4173-b0e5-c76332046f0a service nova] Lock "402453a5-6ad0-4e71-b224-38e8004891af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:34:33 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-b9195414-1846-4839-97e0-1608367c0405 req-bfa328e3-f4f2-4173-b0e5-c76332046f0a service nova] Lock "402453a5-6ad0-4e71-b224-38e8004891af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:34:33 user nova-compute[75216]: DEBUG nova.compute.manager [req-b9195414-1846-4839-97e0-1608367c0405 req-bfa328e3-f4f2-4173-b0e5-c76332046f0a service nova] [instance: 402453a5-6ad0-4e71-b224-38e8004891af] No waiting events found dispatching network-vif-plugged-d6622ca6-8fea-4b1c-a9ab-04d6034237fb {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 19:34:33 user nova-compute[75216]: WARNING nova.compute.manager [req-b9195414-1846-4839-97e0-1608367c0405 req-bfa328e3-f4f2-4173-b0e5-c76332046f0a service nova] [instance: 402453a5-6ad0-4e71-b224-38e8004891af] Received unexpected event network-vif-plugged-d6622ca6-8fea-4b1c-a9ab-04d6034237fb for instance with vm_state building and task_state spawning.
Nov 13 19:34:33 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 19:34:33 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 19:34:33 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Hypervisor/Node resource view: name=user free_ram=9071MB free_disk=25.26962661743164GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75216) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 19:34:33 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:34:33 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:34:33 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 402453a5-6ad0-4e71-b224-38e8004891af] Instance spawned successfully.
Nov 13 19:34:33 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-5f25469f-f3d4-48bd-abae-bc738a4d4e14 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 402453a5-6ad0-4e71-b224-38e8004891af] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 19:34:33 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-5f25469f-f3d4-48bd-abae-bc738a4d4e14 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 402453a5-6ad0-4e71-b224-38e8004891af] Found default for hw_cdrom_bus of ide {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 19:34:33 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-5f25469f-f3d4-48bd-abae-bc738a4d4e14 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 402453a5-6ad0-4e71-b224-38e8004891af] Found default for hw_disk_bus of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 19:34:33 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-5f25469f-f3d4-48bd-abae-bc738a4d4e14 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 402453a5-6ad0-4e71-b224-38e8004891af] Found default for hw_input_bus of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 19:34:33 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-5f25469f-f3d4-48bd-abae-bc738a4d4e14 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 402453a5-6ad0-4e71-b224-38e8004891af] Found default for hw_pointer_model of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 19:34:33 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-5f25469f-f3d4-48bd-abae-bc738a4d4e14 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 402453a5-6ad0-4e71-b224-38e8004891af] Found default for hw_video_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 19:34:33 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-5f25469f-f3d4-48bd-abae-bc738a4d4e14 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 402453a5-6ad0-4e71-b224-38e8004891af] Found default for hw_vif_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 19:34:33 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance 402453a5-6ad0-4e71-b224-38e8004891af actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 19:34:33 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 19:34:33 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 19:34:33 user nova-compute[75216]: INFO nova.compute.manager [None req-5f25469f-f3d4-48bd-abae-bc738a4d4e14 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 402453a5-6ad0-4e71-b224-38e8004891af] Took 5.16 seconds to spawn the instance on the hypervisor.
Nov 13 19:34:33 user nova-compute[75216]: DEBUG nova.compute.manager [None req-5f25469f-f3d4-48bd-abae-bc738a4d4e14 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 402453a5-6ad0-4e71-b224-38e8004891af] Checking state {{(pid=75216) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 19:34:33 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 19:34:34 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 19:34:34 user nova-compute[75216]: INFO nova.compute.manager [None req-5f25469f-f3d4-48bd-abae-bc738a4d4e14 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 402453a5-6ad0-4e71-b224-38e8004891af] Took 9.95 seconds to build instance.
Nov 13 19:34:34 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-5f25469f-f3d4-48bd-abae-bc738a4d4e14 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Lock "402453a5-6ad0-4e71-b224-38e8004891af" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.060s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:34:34 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Compute_service record updated for user:user {{(pid=75216) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 19:34:34 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.229s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:34:34 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:34:35 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:34:36 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:34:36 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Starting heal instance info cache {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 19:34:36 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Rebuilding the list of instances to heal {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 13 19:34:36 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "refresh_cache-402453a5-6ad0-4e71-b224-38e8004891af" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 19:34:36 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquired lock "refresh_cache-402453a5-6ad0-4e71-b224-38e8004891af" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 19:34:36 user nova-compute[75216]: DEBUG nova.network.neutron [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: 402453a5-6ad0-4e71-b224-38e8004891af] Forcefully refreshing network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 19:34:36 user nova-compute[75216]: DEBUG nova.objects.instance [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lazy-loading 'info_cache' on Instance uuid 402453a5-6ad0-4e71-b224-38e8004891af {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:34:36 user nova-compute[75216]: DEBUG nova.network.neutron [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: 402453a5-6ad0-4e71-b224-38e8004891af] Updating instance_info_cache with network_info: [{"id": "d6622ca6-8fea-4b1c-a9ab-04d6034237fb", "address": "fa:16:3e:de:31:8a", "network": {"id": "5881a45c-3f28-48c4-aa8e-045b3bea3227", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1651070715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a1951a52e7c4ef5ac6a0d9d5380d41a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6622ca6-8f", "ovs_interfaceid": "d6622ca6-8fea-4b1c-a9ab-04d6034237fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:34:36 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Releasing lock "refresh_cache-402453a5-6ad0-4e71-b224-38e8004891af" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 19:34:36 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: 402453a5-6ad0-4e71-b224-38e8004891af] Updated the network info_cache for instance {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 19:34:36 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:34:40 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:34:40 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:34:40 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75216) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 19:34:40 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 19:34:40 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 19:34:40 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:34:45 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:34:45 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:34:45 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75216) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 19:34:45 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 19:34:45 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 19:34:45 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:34:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:34:50 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:34:54 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:34:55 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:34:59 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:35:00 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:35:04 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:35:05 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:35:10 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:35:10 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:35:10 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75216) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 19:35:10 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 19:35:10 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 19:35:10 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:35:15 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:35:15 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:35:15 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75216) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 19:35:15 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 19:35:15 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 19:35:15 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:35:15 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:35:18 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:35:20 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:35:20 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:35:20 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75216) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 19:35:20 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 19:35:20 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 19:35:20 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:35:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:35:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:35:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75216) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 19:35:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 19:35:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 19:35:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:35:26 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:35:28 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:35:28 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75216) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 19:35:30 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:35:30 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:35:30 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75216) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 19:35:30 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 19:35:30 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 19:35:30 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:35:30 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:35:31 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:35:31 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:35:31 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:35:31 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:35:31 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:35:31 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Auditing locally available compute resources for user (node: user) {{(pid=75216) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 19:35:31 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 19:35:31 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 19:35:31 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 19:35:31 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Hypervisor/Node resource view: name=user free_ram=8971MB free_disk=25.268409729003906GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75216) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 19:35:31 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:35:31 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:35:32 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance 402453a5-6ad0-4e71-b224-38e8004891af actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 19:35:32 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 19:35:32 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 19:35:32 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 19:35:32 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 19:35:32 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Compute_service record updated for user:user {{(pid=75216) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 19:35:32 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.178s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:35:34 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:35:34 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Starting heal instance info cache {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 19:35:34 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Rebuilding the list of instances to heal {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 13 19:35:34 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "refresh_cache-402453a5-6ad0-4e71-b224-38e8004891af" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 19:35:34 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquired lock "refresh_cache-402453a5-6ad0-4e71-b224-38e8004891af" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 19:35:34 user nova-compute[75216]: DEBUG nova.network.neutron [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: 402453a5-6ad0-4e71-b224-38e8004891af] Forcefully refreshing network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 19:35:34 user nova-compute[75216]: DEBUG nova.objects.instance [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lazy-loading 'info_cache' on Instance uuid 402453a5-6ad0-4e71-b224-38e8004891af {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:35:34 user nova-compute[75216]: DEBUG nova.network.neutron [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: 402453a5-6ad0-4e71-b224-38e8004891af] Updating instance_info_cache with network_info: [{"id": "d6622ca6-8fea-4b1c-a9ab-04d6034237fb", "address": "fa:16:3e:de:31:8a", "network": {"id": "5881a45c-3f28-48c4-aa8e-045b3bea3227", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1651070715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a1951a52e7c4ef5ac6a0d9d5380d41a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6622ca6-8f", "ovs_interfaceid": "d6622ca6-8fea-4b1c-a9ab-04d6034237fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:35:34 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Releasing lock "refresh_cache-402453a5-6ad0-4e71-b224-38e8004891af" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 19:35:34 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: 402453a5-6ad0-4e71-b224-38e8004891af] Updated the network info_cache for instance {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 19:35:35 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:35:35 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:35:40 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:35:45 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:35:45 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:35:45 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75216) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 19:35:45 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 19:35:45 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 19:35:45 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:35:47 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:35:50 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:35:55 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:35:55 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:35:55 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75216) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 19:35:55 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 19:35:55 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 19:35:55 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:36:00 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:36:05 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:36:10 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:36:10 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:36:10 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=75216) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 19:36:10 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 19:36:10 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 19:36:10 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:36:15 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:36:15 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:36:15 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:36:15 user nova-compute[75216]: DEBUG nova.compute.manager [req-2620b30d-dd10-4249-9808-3980141df19c req-60d81d98-e600-4236-b8e6-971a3d42a22b service nova] [instance: 402453a5-6ad0-4e71-b224-38e8004891af] Received event network-changed-d6622ca6-8fea-4b1c-a9ab-04d6034237fb {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:36:15 user nova-compute[75216]: DEBUG nova.compute.manager [req-2620b30d-dd10-4249-9808-3980141df19c req-60d81d98-e600-4236-b8e6-971a3d42a22b service nova] [instance: 402453a5-6ad0-4e71-b224-38e8004891af] Refreshing instance network info cache due to event network-changed-d6622ca6-8fea-4b1c-a9ab-04d6034237fb. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 19:36:15 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-2620b30d-dd10-4249-9808-3980141df19c req-60d81d98-e600-4236-b8e6-971a3d42a22b service nova] Acquiring lock "refresh_cache-402453a5-6ad0-4e71-b224-38e8004891af" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 19:36:15 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-2620b30d-dd10-4249-9808-3980141df19c req-60d81d98-e600-4236-b8e6-971a3d42a22b service nova] Acquired lock "refresh_cache-402453a5-6ad0-4e71-b224-38e8004891af" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 19:36:15 user nova-compute[75216]: DEBUG nova.network.neutron [req-2620b30d-dd10-4249-9808-3980141df19c req-60d81d98-e600-4236-b8e6-971a3d42a22b service nova] [instance: 402453a5-6ad0-4e71-b224-38e8004891af] Refreshing network info cache for port d6622ca6-8fea-4b1c-a9ab-04d6034237fb {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 19:36:16 user nova-compute[75216]: DEBUG nova.network.neutron [req-2620b30d-dd10-4249-9808-3980141df19c req-60d81d98-e600-4236-b8e6-971a3d42a22b service nova] [instance: 402453a5-6ad0-4e71-b224-38e8004891af] Updated VIF entry in instance network info cache for port d6622ca6-8fea-4b1c-a9ab-04d6034237fb. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 19:36:16 user nova-compute[75216]: DEBUG nova.network.neutron [req-2620b30d-dd10-4249-9808-3980141df19c req-60d81d98-e600-4236-b8e6-971a3d42a22b service nova] [instance: 402453a5-6ad0-4e71-b224-38e8004891af] Updating instance_info_cache with network_info: [{"id": "d6622ca6-8fea-4b1c-a9ab-04d6034237fb", "address": "fa:16:3e:de:31:8a", "network": {"id": "5881a45c-3f28-48c4-aa8e-045b3bea3227", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1651070715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a1951a52e7c4ef5ac6a0d9d5380d41a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6622ca6-8f", "ovs_interfaceid": "d6622ca6-8fea-4b1c-a9ab-04d6034237fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:36:16 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-2620b30d-dd10-4249-9808-3980141df19c req-60d81d98-e600-4236-b8e6-971a3d42a22b service nova] Releasing lock "refresh_cache-402453a5-6ad0-4e71-b224-38e8004891af" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 19:36:16 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-3d8a9d0b-6ff8-43eb-952c-b25b71d69da2 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Acquiring lock "402453a5-6ad0-4e71-b224-38e8004891af" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:36:16 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-3d8a9d0b-6ff8-43eb-952c-b25b71d69da2 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Lock "402453a5-6ad0-4e71-b224-38e8004891af" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:36:16 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-3d8a9d0b-6ff8-43eb-952c-b25b71d69da2 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Acquiring lock "402453a5-6ad0-4e71-b224-38e8004891af-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:36:16 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-3d8a9d0b-6ff8-43eb-952c-b25b71d69da2 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Lock "402453a5-6ad0-4e71-b224-38e8004891af-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:36:16 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-3d8a9d0b-6ff8-43eb-952c-b25b71d69da2 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Lock "402453a5-6ad0-4e71-b224-38e8004891af-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:36:16 user nova-compute[75216]: INFO nova.compute.manager [None req-3d8a9d0b-6ff8-43eb-952c-b25b71d69da2 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 402453a5-6ad0-4e71-b224-38e8004891af] Terminating instance
Nov 13 19:36:16 user nova-compute[75216]: DEBUG nova.compute.manager [None req-3d8a9d0b-6ff8-43eb-952c-b25b71d69da2 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 402453a5-6ad0-4e71-b224-38e8004891af] Start destroying the instance on the hypervisor. {{(pid=75216) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 19:36:16 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:36:16 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:36:16 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:36:16 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:36:17 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 402453a5-6ad0-4e71-b224-38e8004891af] Instance destroyed successfully.
Nov 13 19:36:17 user nova-compute[75216]: DEBUG nova.objects.instance [None req-3d8a9d0b-6ff8-43eb-952c-b25b71d69da2 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Lazy-loading 'resources' on Instance uuid 402453a5-6ad0-4e71-b224-38e8004891af {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:36:17 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-3d8a9d0b-6ff8-43eb-952c-b25b71d69da2 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T19:34:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-890582642',display_name='tempest-TestVolumeBootPattern-server-890582642',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-890582642',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJoiZwaxJA3L6zg1VlDIL2iywK8D207KUdpx1vJqr+ljXQkA4jTUHYbkCYqoa39qc34qT95KOeBJjIq8vzC1Og4pbsAomDAW7M51FJ+JGdR7hmjZWz1zbUNVDWRemA+lQw==',key_name='tempest-TestVolumeBootPattern-21317594',keypairs=<?>,launch_index=0,launched_at=2023-11-13T19:34:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3a1951a52e7c4ef5ac6a0d9d5380d41a',ramdisk_id='',reservation_id='r-4177rr22',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1444343509',owner_user_name='tempest-TestVolumeBootPattern-1444343509-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T19:34:34Z,user_data=None,user_id='bfc6b02c16664b8dbea3a6f2088ec385',uuid=402453a5-6ad0-4e71-b224-38e8004891af,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d6622ca6-8fea-4b1c-a9ab-04d6034237fb", "address": "fa:16:3e:de:31:8a", "network": {"id": "5881a45c-3f28-48c4-aa8e-045b3bea3227", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1651070715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a1951a52e7c4ef5ac6a0d9d5380d41a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6622ca6-8f", "ovs_interfaceid": "d6622ca6-8fea-4b1c-a9ab-04d6034237fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 19:36:17 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-3d8a9d0b-6ff8-43eb-952c-b25b71d69da2 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Converting VIF {"id": "d6622ca6-8fea-4b1c-a9ab-04d6034237fb", "address": "fa:16:3e:de:31:8a", "network": {"id": "5881a45c-3f28-48c4-aa8e-045b3bea3227", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1651070715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a1951a52e7c4ef5ac6a0d9d5380d41a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6622ca6-8f", "ovs_interfaceid": "d6622ca6-8fea-4b1c-a9ab-04d6034237fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 19:36:17 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-3d8a9d0b-6ff8-43eb-952c-b25b71d69da2 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:de:31:8a,bridge_name='br-int',has_traffic_filtering=True,id=d6622ca6-8fea-4b1c-a9ab-04d6034237fb,network=Network(5881a45c-3f28-48c4-aa8e-045b3bea3227),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6622ca6-8f') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 19:36:17 user nova-compute[75216]: DEBUG os_vif [None req-3d8a9d0b-6ff8-43eb-952c-b25b71d69da2 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:de:31:8a,bridge_name='br-int',has_traffic_filtering=True,id=d6622ca6-8fea-4b1c-a9ab-04d6034237fb,network=Network(5881a45c-3f28-48c4-aa8e-045b3bea3227),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6622ca6-8f') {{(pid=75216) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 19:36:17 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:36:17 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd6622ca6-8f, bridge=br-int, if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:36:17 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:36:17 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:36:17 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:36:17 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=43b7184a-1bea-407c-992d-23acb626d82d) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:36:17 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:36:17 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:36:17 user nova-compute[75216]: INFO os_vif [None req-3d8a9d0b-6ff8-43eb-952c-b25b71d69da2 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:de:31:8a,bridge_name='br-int',has_traffic_filtering=True,id=d6622ca6-8fea-4b1c-a9ab-04d6034237fb,network=Network(5881a45c-3f28-48c4-aa8e-045b3bea3227),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6622ca6-8f')
Nov 13 19:36:17 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3d8a9d0b-6ff8-43eb-952c-b25b71d69da2 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 402453a5-6ad0-4e71-b224-38e8004891af] calling os-brick to detach iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 19:36:17 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d8a9d0b-6ff8-43eb-952c-b25b71d69da2 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3a8669e40>, {'target_iqn': 'iqn.2010-10.org.openstack:dac4ffc7-c907-49c6-81da-c8700d141c1e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CcyHdMDU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 19:36:17 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-3d8a9d0b-6ff8-43eb-952c-b25b71d69da2 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 19:36:17 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-3d8a9d0b-6ff8-43eb-952c-b25b71d69da2 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 19:36:17 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-3d8a9d0b-6ff8-43eb-952c-b25b71d69da2 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 19:36:17 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:36:17 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:36:17 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[8964a5c4-9fb4-412b-94a4-9ec0427dbcf3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:dac4ffc7-c907-49c6-81da-c8700d141c1e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:36:17 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d8a9d0b-6ff8-43eb-952c-b25b71d69da2 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 19:36:17 user nova-compute[75216]: No targets found.
Nov 13 19:36:17 user nova-compute[75216]: iSNS:
Nov 13 19:36:17 user nova-compute[75216]: No targets found.
Nov 13 19:36:17 user nova-compute[75216]: STATIC:
Nov 13 19:36:17 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:dac4ffc7-c907-49c6-81da-c8700d141c1e
Nov 13 19:36:17 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 19:36:17 user nova-compute[75216]:                 Iface Name: default
Nov 13 19:36:17 user nova-compute[75216]: FIRMWARE:
Nov 13 19:36:17 user nova-compute[75216]: No targets found.
Nov 13 19:36:17 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 19:36:17 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d8a9d0b-6ff8-43eb-952c-b25b71d69da2 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 19:36:17 user nova-compute[75216]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 19:36:17 user nova-compute[75216]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75216) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 19:36:17 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d8a9d0b-6ff8-43eb-952c-b25b71d69da2 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dac4ffc7-c907-49c6-81da-c8700d141c1e', 0)] {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 19:36:17 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:36:17 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:36:17 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[15bc3a82-fa7a-4ccf-8303-a45fe8d40944]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dac4ffc7-c907-49c6-81da-c8700d141c1e\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:36:17 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:36:17 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:36:17 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[4be99afa-35b0-48c9-b5cd-f6bfa3ca7221]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dac4ffc7-c907-49c6-81da-c8700d141c1e (non-flash)\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:36:17 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d8a9d0b-6ff8-43eb-952c-b25b71d69da2 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dac4ffc7-c907-49c6-81da-c8700d141c1e (non-flash)
Nov 13 19:36:17 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 19:36:17 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d8a9d0b-6ff8-43eb-952c-b25b71d69da2 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dac4ffc7-c907-49c6-81da-c8700d141c1e (non-flash)
Nov 13 19:36:17 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 19:36:17 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d8a9d0b-6ff8-43eb-952c-b25b71d69da2 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe3c0267ac0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dac4ffc7-c907-49c6-81da-c8700d141c1e'): ({'sdb'}, set())}) {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 19:36:17 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-3d8a9d0b-6ff8-43eb-952c-b25b71d69da2 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Removing single pathed devices sdb {{(pid=75216) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 19:36:17 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:36:17 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:36:17 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fc8a92d-9019-46d2-af66-37ec54c2bcda]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:36:17 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:36:17 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:36:17 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[892cf24f-f1c8-44a4-b446-8e9c184720aa]: (4, ('ok\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:36:17 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-3d8a9d0b-6ff8-43eb-952c-b25b71d69da2 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Flushing IO for device /dev/sdb {{(pid=75216) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 19:36:17 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:36:17 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:36:17 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cc08e40-ca7b-455a-8caa-e7255b4cb5e1]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:36:17 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-3d8a9d0b-6ff8-43eb-952c-b25b71d69da2 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75216) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 19:36:17 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:36:17 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.037s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:36:17 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbb70882-9d2e-4e18-8ecf-70a0d2f98c08]: (4, ('1', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:36:17 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-3d8a9d0b-6ff8-43eb-952c-b25b71d69da2 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 19:36:17 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-3d8a9d0b-6ff8-43eb-952c-b25b71d69da2 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] SCSI volumes sdb have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 19:36:17 user nova-compute[75216]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOe47f128a-97712bb926cfd87c', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_e47f128a', '/dev/disk/by-id/scsi-23937373132626239') {{(pid=85984) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 13 19:36:17 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[924e094b-b68f-4aa8-afd2-34404544d4e8]: (4, None) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:36:17 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d8a9d0b-6ff8-43eb-952c-b25b71d69da2 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dac4ffc7-c907-49c6-81da-c8700d141c1e')] {{(pid=75216) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 19:36:17 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dac4ffc7-c907-49c6-81da-c8700d141c1e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:36:17 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dac4ffc7-c907-49c6-81da-c8700d141c1e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.043s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:36:17 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb92f8f5-310b-403e-99bf-c53643eb09b5]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:36:17 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d8a9d0b-6ff8-43eb-952c-b25b71d69da2 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:36:17 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dac4ffc7-c907-49c6-81da-c8700d141c1e -p 172.16.0.220:3260 --logout {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:36:17 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dac4ffc7-c907-49c6-81da-c8700d141c1e -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:36:17 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[43442780-caaf-4494-be2d-70db4e28bf69]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:dac4ffc7-c907-49c6-81da-c8700d141c1e, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:dac4ffc7-c907-49c6-81da-c8700d141c1e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:36:17 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d8a9d0b-6ff8-43eb-952c-b25b71d69da2 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:dac4ffc7-c907-49c6-81da-c8700d141c1e, portal: 172.16.0.220,3260]
Nov 13 19:36:17 user nova-compute[75216]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:dac4ffc7-c907-49c6-81da-c8700d141c1e, portal: 172.16.0.220,3260] successful.
Nov 13 19:36:17 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:36:17 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dac4ffc7-c907-49c6-81da-c8700d141c1e -p 172.16.0.220:3260 --op delete {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:36:17 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dac4ffc7-c907-49c6-81da-c8700d141c1e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:36:17 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc1b36ad-b3e8-4493-b241-ec2dcc24ec27]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:36:17 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d8a9d0b-6ff8-43eb-952c-b25b71d69da2 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:36:17 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-3d8a9d0b-6ff8-43eb-952c-b25b71d69da2 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.298s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 19:36:17 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d8a9d0b-6ff8-43eb-952c-b25b71d69da2 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] <== disconnect_volume: return (300ms) None {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 19:36:17 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3d8a9d0b-6ff8-43eb-952c-b25b71d69da2 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 402453a5-6ad0-4e71-b224-38e8004891af] Disconnected iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 19:36:17 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-3d8a9d0b-6ff8-43eb-952c-b25b71d69da2 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 402453a5-6ad0-4e71-b224-38e8004891af] Deleting instance files /opt/stack/data/nova/instances/402453a5-6ad0-4e71-b224-38e8004891af_del
Nov 13 19:36:17 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-3d8a9d0b-6ff8-43eb-952c-b25b71d69da2 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 402453a5-6ad0-4e71-b224-38e8004891af] Deletion of /opt/stack/data/nova/instances/402453a5-6ad0-4e71-b224-38e8004891af_del complete
Nov 13 19:36:17 user nova-compute[75216]: INFO nova.compute.manager [None req-3d8a9d0b-6ff8-43eb-952c-b25b71d69da2 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 402453a5-6ad0-4e71-b224-38e8004891af] Took 1.13 seconds to destroy the instance on the hypervisor.
Nov 13 19:36:17 user nova-compute[75216]: DEBUG oslo.service.loopingcall [None req-3d8a9d0b-6ff8-43eb-952c-b25b71d69da2 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75216) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 19:36:17 user nova-compute[75216]: DEBUG nova.compute.manager [-] [instance: 402453a5-6ad0-4e71-b224-38e8004891af] Deallocating network for instance {{(pid=75216) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 19:36:17 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: 402453a5-6ad0-4e71-b224-38e8004891af] deallocate_for_instance() {{(pid=75216) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 19:36:17 user nova-compute[75216]: DEBUG nova.compute.manager [req-0c2cf027-066a-4a4e-8013-a3f04f894b5e req-ccc5f86a-1afa-4276-826b-2de90af5123e service nova] [instance: 402453a5-6ad0-4e71-b224-38e8004891af] Received event network-vif-unplugged-d6622ca6-8fea-4b1c-a9ab-04d6034237fb {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:36:17 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-0c2cf027-066a-4a4e-8013-a3f04f894b5e req-ccc5f86a-1afa-4276-826b-2de90af5123e service nova] Acquiring lock "402453a5-6ad0-4e71-b224-38e8004891af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:36:17 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-0c2cf027-066a-4a4e-8013-a3f04f894b5e req-ccc5f86a-1afa-4276-826b-2de90af5123e service nova] Lock "402453a5-6ad0-4e71-b224-38e8004891af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:36:17 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-0c2cf027-066a-4a4e-8013-a3f04f894b5e req-ccc5f86a-1afa-4276-826b-2de90af5123e service nova] Lock "402453a5-6ad0-4e71-b224-38e8004891af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:36:17 user nova-compute[75216]: DEBUG nova.compute.manager [req-0c2cf027-066a-4a4e-8013-a3f04f894b5e req-ccc5f86a-1afa-4276-826b-2de90af5123e service nova] [instance: 402453a5-6ad0-4e71-b224-38e8004891af] No waiting events found dispatching network-vif-unplugged-d6622ca6-8fea-4b1c-a9ab-04d6034237fb {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 19:36:17 user nova-compute[75216]: DEBUG nova.compute.manager [req-0c2cf027-066a-4a4e-8013-a3f04f894b5e req-ccc5f86a-1afa-4276-826b-2de90af5123e service nova] [instance: 402453a5-6ad0-4e71-b224-38e8004891af] Received event network-vif-unplugged-d6622ca6-8fea-4b1c-a9ab-04d6034237fb for instance with task_state deleting. {{(pid=75216) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 19:36:17 user nova-compute[75216]: DEBUG nova.compute.manager [req-0c2cf027-066a-4a4e-8013-a3f04f894b5e req-ccc5f86a-1afa-4276-826b-2de90af5123e service nova] [instance: 402453a5-6ad0-4e71-b224-38e8004891af] Received event network-vif-plugged-d6622ca6-8fea-4b1c-a9ab-04d6034237fb {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:36:17 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-0c2cf027-066a-4a4e-8013-a3f04f894b5e req-ccc5f86a-1afa-4276-826b-2de90af5123e service nova] Acquiring lock "402453a5-6ad0-4e71-b224-38e8004891af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:36:17 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-0c2cf027-066a-4a4e-8013-a3f04f894b5e req-ccc5f86a-1afa-4276-826b-2de90af5123e service nova] Lock "402453a5-6ad0-4e71-b224-38e8004891af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:36:17 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-0c2cf027-066a-4a4e-8013-a3f04f894b5e req-ccc5f86a-1afa-4276-826b-2de90af5123e service nova] Lock "402453a5-6ad0-4e71-b224-38e8004891af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:36:17 user nova-compute[75216]: DEBUG nova.compute.manager [req-0c2cf027-066a-4a4e-8013-a3f04f894b5e req-ccc5f86a-1afa-4276-826b-2de90af5123e service nova] [instance: 402453a5-6ad0-4e71-b224-38e8004891af] No waiting events found dispatching network-vif-plugged-d6622ca6-8fea-4b1c-a9ab-04d6034237fb {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 19:36:17 user nova-compute[75216]: WARNING nova.compute.manager [req-0c2cf027-066a-4a4e-8013-a3f04f894b5e req-ccc5f86a-1afa-4276-826b-2de90af5123e service nova] [instance: 402453a5-6ad0-4e71-b224-38e8004891af] Received unexpected event network-vif-plugged-d6622ca6-8fea-4b1c-a9ab-04d6034237fb for instance with vm_state active and task_state deleting.
Nov 13 19:36:18 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: 402453a5-6ad0-4e71-b224-38e8004891af] Updating instance_info_cache with network_info: [] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:36:18 user nova-compute[75216]: INFO nova.compute.manager [-] [instance: 402453a5-6ad0-4e71-b224-38e8004891af] Took 0.80 seconds to deallocate network for instance.
Nov 13 19:36:18 user nova-compute[75216]: DEBUG nova.compute.manager [req-e7802845-f6ab-46c4-9fd0-ca7058c56908 req-8cf9a3a5-ce91-49dc-90b6-0c534ed0002d service nova] [instance: 402453a5-6ad0-4e71-b224-38e8004891af] Received event network-vif-deleted-d6622ca6-8fea-4b1c-a9ab-04d6034237fb {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:36:19 user nova-compute[75216]: INFO nova.compute.manager [None req-3d8a9d0b-6ff8-43eb-952c-b25b71d69da2 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 402453a5-6ad0-4e71-b224-38e8004891af] Took 0.98 seconds to detach 1 volumes for instance.
Nov 13 19:36:19 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-3d8a9d0b-6ff8-43eb-952c-b25b71d69da2 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:36:19 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-3d8a9d0b-6ff8-43eb-952c-b25b71d69da2 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:36:19 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-3d8a9d0b-6ff8-43eb-952c-b25b71d69da2 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 19:36:19 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-3d8a9d0b-6ff8-43eb-952c-b25b71d69da2 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 19:36:19 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-3d8a9d0b-6ff8-43eb-952c-b25b71d69da2 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.114s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:36:19 user nova-compute[75216]: INFO nova.scheduler.client.report [None req-3d8a9d0b-6ff8-43eb-952c-b25b71d69da2 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Deleted allocations for instance 402453a5-6ad0-4e71-b224-38e8004891af
Nov 13 19:36:19 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:36:19 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-3d8a9d0b-6ff8-43eb-952c-b25b71d69da2 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Lock "402453a5-6ad0-4e71-b224-38e8004891af" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.233s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:36:20 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:36:22 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:36:27 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:36:27 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:36:27 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75216) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 19:36:27 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 19:36:27 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 19:36:27 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:36:28 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:36:30 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:36:30 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75216) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 19:36:31 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:36:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:36:32 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:36:33 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:36:33 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Starting heal instance info cache {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 19:36:33 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Rebuilding the list of instances to heal {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 13 19:36:33 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Didn't find any instances for network info cache update. {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 13 19:36:33 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:36:33 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:36:33 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:36:33 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:36:33 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Auditing locally available compute resources for user (node: user) {{(pid=75216) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 19:36:33 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 19:36:33 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 19:36:33 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Hypervisor/Node resource view: name=user free_ram=9117MB free_disk=25.26757049560547GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75216) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 19:36:33 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:36:33 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:36:33 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 19:36:33 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 19:36:34 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Refreshing inventories for resource provider d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 13 19:36:34 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Updating ProviderTree inventory for provider d927e00d-5a8b-43f7-ac04-6437958fac1f from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 13 19:36:34 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Updating inventory in ProviderTree for provider d927e00d-5a8b-43f7-ac04-6437958fac1f with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 13 19:36:34 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Refreshing aggregate associations for resource provider d927e00d-5a8b-43f7-ac04-6437958fac1f, aggregates: None {{(pid=75216) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 13 19:36:34 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Refreshing trait associations for resource provider d927e00d-5a8b-43f7-ac04-6437958fac1f, traits: COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_MMX {{(pid=75216) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 13 19:36:34 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 19:36:34 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 19:36:34 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Compute_service record updated for user:user {{(pid=75216) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 19:36:34 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.320s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:36:34 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:36:35 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:36:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:36:42 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:36:46 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:36:46 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Cleaning up deleted instances {{(pid=75216) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 13 19:36:46 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] There are 0 instances to clean {{(pid=75216) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 13 19:36:47 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:36:52 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:36:57 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:37:01 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:37:01 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75216) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 13 19:37:02 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:37:02 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:37:02 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75216) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 19:37:02 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 19:37:02 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 19:37:02 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:37:07 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:37:08 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-ee1f06db-f9c3-4c07-8924-7236a3d4540e tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Acquiring lock "7e21edf8-2308-43f5-b9c9-17dabacfb0ec" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:37:08 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-ee1f06db-f9c3-4c07-8924-7236a3d4540e tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Lock "7e21edf8-2308-43f5-b9c9-17dabacfb0ec" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:37:08 user nova-compute[75216]: DEBUG nova.compute.manager [None req-ee1f06db-f9c3-4c07-8924-7236a3d4540e tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 7e21edf8-2308-43f5-b9c9-17dabacfb0ec] Starting instance... {{(pid=75216) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 19:37:08 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-ee1f06db-f9c3-4c07-8924-7236a3d4540e tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:37:08 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-ee1f06db-f9c3-4c07-8924-7236a3d4540e tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:37:08 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-ee1f06db-f9c3-4c07-8924-7236a3d4540e tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75216) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 19:37:08 user nova-compute[75216]: INFO nova.compute.claims [None req-ee1f06db-f9c3-4c07-8924-7236a3d4540e tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 7e21edf8-2308-43f5-b9c9-17dabacfb0ec] Claim successful on node user
Nov 13 19:37:08 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-ee1f06db-f9c3-4c07-8924-7236a3d4540e tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 19:37:08 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-ee1f06db-f9c3-4c07-8924-7236a3d4540e tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 19:37:08 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-ee1f06db-f9c3-4c07-8924-7236a3d4540e tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.229s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:37:08 user nova-compute[75216]: DEBUG nova.compute.manager [None req-ee1f06db-f9c3-4c07-8924-7236a3d4540e tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 7e21edf8-2308-43f5-b9c9-17dabacfb0ec] Start building networks asynchronously for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 19:37:08 user nova-compute[75216]: DEBUG nova.compute.manager [None req-ee1f06db-f9c3-4c07-8924-7236a3d4540e tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 7e21edf8-2308-43f5-b9c9-17dabacfb0ec] Allocating IP information in the background. {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 19:37:08 user nova-compute[75216]: DEBUG nova.network.neutron [None req-ee1f06db-f9c3-4c07-8924-7236a3d4540e tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 7e21edf8-2308-43f5-b9c9-17dabacfb0ec] allocate_for_instance() {{(pid=75216) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 19:37:08 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-ee1f06db-f9c3-4c07-8924-7236a3d4540e tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 7e21edf8-2308-43f5-b9c9-17dabacfb0ec] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 19:37:08 user nova-compute[75216]: DEBUG nova.compute.manager [None req-ee1f06db-f9c3-4c07-8924-7236a3d4540e tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 7e21edf8-2308-43f5-b9c9-17dabacfb0ec] Start building block device mappings for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 19:37:08 user nova-compute[75216]: INFO nova.virt.block_device [None req-ee1f06db-f9c3-4c07-8924-7236a3d4540e tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 7e21edf8-2308-43f5-b9c9-17dabacfb0ec] Booting with volume dac4ffc7-c907-49c6-81da-c8700d141c1e at /dev/vda
Nov 13 19:37:08 user nova-compute[75216]: DEBUG nova.policy [None req-ee1f06db-f9c3-4c07-8924-7236a3d4540e tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bfc6b02c16664b8dbea3a6f2088ec385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1951a52e7c4ef5ac6a0d9d5380d41a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75216) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 19:37:08 user nova-compute[75216]: DEBUG os_brick.utils [None req-ee1f06db-f9c3-4c07-8924-7236a3d4540e tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 19:37:08 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:37:08 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:37:08 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[7149b4f1-ee71-4472-bd71-86deb54b5496]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aea6fcfe14b9\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:37:08 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:37:08 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:37:08 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[e38bc9cf-3fd4-4d27-81b2-7ee9ba3e6848]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:37:08 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:37:08 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:37:08 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aeefb5f-155a-4e0a-ab27-543ef252b476]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:37:08 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[747e7563-165c-4307-b154-eb963d227b32]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:37:08 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-ee1f06db-f9c3-4c07-8924-7236a3d4540e tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Running cmd (subprocess): nvme version {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:37:08 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-ee1f06db-f9c3-4c07-8924-7236a3d4540e tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] 'nvme version' failed. Not Retrying. {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 19:37:08 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ee1f06db-f9c3-4c07-8924-7236a3d4540e tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] nvme not present on system {{(pid=75216) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 19:37:08 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:37:08 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 19:37:08 user nova-compute[75216]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 19:37:08 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad2b0e6f-c7f4-4d03-94f7-6e565c50f4af]: (4, '') {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:37:08 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-ee1f06db-f9c3-4c07-8924-7236a3d4540e tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75216) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 19:37:08 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-ee1f06db-f9c3-4c07-8924-7236a3d4540e tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 19:37:08 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-ee1f06db-f9c3-4c07-8924-7236a3d4540e tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] LIGHTOS: no hostnqn found. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 19:37:08 user nova-compute[75216]: DEBUG os_brick.utils [None req-ee1f06db-f9c3-4c07-8924-7236a3d4540e tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aea6fcfe14b9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 19:37:08 user nova-compute[75216]: DEBUG nova.virt.block_device [None req-ee1f06db-f9c3-4c07-8924-7236a3d4540e tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 7e21edf8-2308-43f5-b9c9-17dabacfb0ec] Updating existing volume attachment record: 9b4390e0-4527-4889-a962-13cee6d3398d {{(pid=75216) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 19:37:09 user nova-compute[75216]: DEBUG nova.network.neutron [None req-ee1f06db-f9c3-4c07-8924-7236a3d4540e tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 7e21edf8-2308-43f5-b9c9-17dabacfb0ec] Successfully created port: 8d7855ef-7f8d-4f76-af3d-5e9c41759435 {{(pid=75216) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 19:37:10 user nova-compute[75216]: DEBUG nova.network.neutron [None req-ee1f06db-f9c3-4c07-8924-7236a3d4540e tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 7e21edf8-2308-43f5-b9c9-17dabacfb0ec] Successfully updated port: 8d7855ef-7f8d-4f76-af3d-5e9c41759435 {{(pid=75216) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 19:37:10 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-ee1f06db-f9c3-4c07-8924-7236a3d4540e tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Acquiring lock "refresh_cache-7e21edf8-2308-43f5-b9c9-17dabacfb0ec" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 19:37:10 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-ee1f06db-f9c3-4c07-8924-7236a3d4540e tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Acquired lock "refresh_cache-7e21edf8-2308-43f5-b9c9-17dabacfb0ec" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 19:37:10 user nova-compute[75216]: DEBUG nova.network.neutron [None req-ee1f06db-f9c3-4c07-8924-7236a3d4540e tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 7e21edf8-2308-43f5-b9c9-17dabacfb0ec] Building network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 19:37:10 user nova-compute[75216]: DEBUG nova.compute.manager [req-586cfca7-3048-49c6-9bc4-86e0dc9345de req-4b14210d-4b7e-4462-85a1-34156262a95b service nova] [instance: 7e21edf8-2308-43f5-b9c9-17dabacfb0ec] Received event network-changed-8d7855ef-7f8d-4f76-af3d-5e9c41759435 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:37:10 user nova-compute[75216]: DEBUG nova.compute.manager [req-586cfca7-3048-49c6-9bc4-86e0dc9345de req-4b14210d-4b7e-4462-85a1-34156262a95b service nova] [instance: 7e21edf8-2308-43f5-b9c9-17dabacfb0ec] Refreshing instance network info cache due to event network-changed-8d7855ef-7f8d-4f76-af3d-5e9c41759435. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 19:37:10 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-586cfca7-3048-49c6-9bc4-86e0dc9345de req-4b14210d-4b7e-4462-85a1-34156262a95b service nova] Acquiring lock "refresh_cache-7e21edf8-2308-43f5-b9c9-17dabacfb0ec" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 19:37:10 user nova-compute[75216]: DEBUG nova.network.neutron [None req-ee1f06db-f9c3-4c07-8924-7236a3d4540e tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 7e21edf8-2308-43f5-b9c9-17dabacfb0ec] Instance cache missing network info. {{(pid=75216) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 19:37:10 user nova-compute[75216]: DEBUG nova.network.neutron [None req-ee1f06db-f9c3-4c07-8924-7236a3d4540e tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 7e21edf8-2308-43f5-b9c9-17dabacfb0ec] Updating instance_info_cache with network_info: [{"id": "8d7855ef-7f8d-4f76-af3d-5e9c41759435", "address": "fa:16:3e:7f:73:bb", "network": {"id": "5881a45c-3f28-48c4-aa8e-045b3bea3227", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1651070715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a1951a52e7c4ef5ac6a0d9d5380d41a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d7855ef-7f", "ovs_interfaceid": "8d7855ef-7f8d-4f76-af3d-5e9c41759435", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:37:10 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-ee1f06db-f9c3-4c07-8924-7236a3d4540e tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Releasing lock "refresh_cache-7e21edf8-2308-43f5-b9c9-17dabacfb0ec" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 19:37:10 user nova-compute[75216]: DEBUG nova.compute.manager [None req-ee1f06db-f9c3-4c07-8924-7236a3d4540e tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 7e21edf8-2308-43f5-b9c9-17dabacfb0ec] Instance network_info: |[{"id": "8d7855ef-7f8d-4f76-af3d-5e9c41759435", "address": "fa:16:3e:7f:73:bb", "network": {"id": "5881a45c-3f28-48c4-aa8e-045b3bea3227", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1651070715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a1951a52e7c4ef5ac6a0d9d5380d41a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d7855ef-7f", "ovs_interfaceid": "8d7855ef-7f8d-4f76-af3d-5e9c41759435", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 19:37:10 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-586cfca7-3048-49c6-9bc4-86e0dc9345de req-4b14210d-4b7e-4462-85a1-34156262a95b service nova] Acquired lock "refresh_cache-7e21edf8-2308-43f5-b9c9-17dabacfb0ec" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 19:37:10 user nova-compute[75216]: DEBUG nova.network.neutron [req-586cfca7-3048-49c6-9bc4-86e0dc9345de req-4b14210d-4b7e-4462-85a1-34156262a95b service nova] [instance: 7e21edf8-2308-43f5-b9c9-17dabacfb0ec] Refreshing network info cache for port 8d7855ef-7f8d-4f76-af3d-5e9c41759435 {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 19:37:10 user nova-compute[75216]: DEBUG nova.network.neutron [req-586cfca7-3048-49c6-9bc4-86e0dc9345de req-4b14210d-4b7e-4462-85a1-34156262a95b service nova] [instance: 7e21edf8-2308-43f5-b9c9-17dabacfb0ec] Updated VIF entry in instance network info cache for port 8d7855ef-7f8d-4f76-af3d-5e9c41759435. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 19:37:10 user nova-compute[75216]: DEBUG nova.network.neutron [req-586cfca7-3048-49c6-9bc4-86e0dc9345de req-4b14210d-4b7e-4462-85a1-34156262a95b service nova] [instance: 7e21edf8-2308-43f5-b9c9-17dabacfb0ec] Updating instance_info_cache with network_info: [{"id": "8d7855ef-7f8d-4f76-af3d-5e9c41759435", "address": "fa:16:3e:7f:73:bb", "network": {"id": "5881a45c-3f28-48c4-aa8e-045b3bea3227", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1651070715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a1951a52e7c4ef5ac6a0d9d5380d41a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d7855ef-7f", "ovs_interfaceid": "8d7855ef-7f8d-4f76-af3d-5e9c41759435", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:37:11 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-586cfca7-3048-49c6-9bc4-86e0dc9345de req-4b14210d-4b7e-4462-85a1-34156262a95b service nova] Releasing lock "refresh_cache-7e21edf8-2308-43f5-b9c9-17dabacfb0ec" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 19:37:12 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:37:13 user nova-compute[75216]: DEBUG nova.compute.manager [None req-ee1f06db-f9c3-4c07-8924-7236a3d4540e tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 7e21edf8-2308-43f5-b9c9-17dabacfb0ec] Start spawning the instance on the hypervisor. {{(pid=75216) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 19:37:13 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-ee1f06db-f9c3-4c07-8924-7236a3d4540e tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 7e21edf8-2308-43f5-b9c9-17dabacfb0ec] Creating instance directory {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 19:37:13 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-ee1f06db-f9c3-4c07-8924-7236a3d4540e tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 7e21edf8-2308-43f5-b9c9-17dabacfb0ec] Creating image(s)
Nov 13 19:37:13 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-ee1f06db-f9c3-4c07-8924-7236a3d4540e tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 7e21edf8-2308-43f5-b9c9-17dabacfb0ec] Did not create local disks {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 13 19:37:13 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-ee1f06db-f9c3-4c07-8924-7236a3d4540e tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 7e21edf8-2308-43f5-b9c9-17dabacfb0ec] Ensure instance console log exists: /opt/stack/data/nova/instances/7e21edf8-2308-43f5-b9c9-17dabacfb0ec/console.log {{(pid=75216) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 19:37:13 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-ee1f06db-f9c3-4c07-8924-7236a3d4540e tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:37:13 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-ee1f06db-f9c3-4c07-8924-7236a3d4540e tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:37:13 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-ee1f06db-f9c3-4c07-8924-7236a3d4540e tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:37:13 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-ee1f06db-f9c3-4c07-8924-7236a3d4540e tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 7e21edf8-2308-43f5-b9c9-17dabacfb0ec] Start _get_guest_xml network_info=[{"id": "8d7855ef-7f8d-4f76-af3d-5e9c41759435", "address": "fa:16:3e:7f:73:bb", "network": {"id": "5881a45c-3f28-48c4-aa8e-045b3bea3227", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1651070715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a1951a52e7c4ef5ac6a0d9d5380d41a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d7855ef-7f", "ovs_interfaceid": "8d7855ef-7f8d-4f76-af3d-5e9c41759435", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:dac4ffc7-c907-49c6-81da-c8700d141c1e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CcyHdMDU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7e21edf8-2308-43f5-b9c9-17dabacfb0ec', 'attached_at': '', 'detached_at': '', 'volume_id': 'dac4ffc7-c907-49c6-81da-c8700d141c1e', 'serial': 'dac4ffc7-c907-49c6-81da-c8700d141c1e'}, 'attachment_id': '9b4390e0-4527-4889-a962-13cee6d3398d', 'guest_format': None, 'mount_device': '/dev/vda', 'delete_on_termination': False, 'boot_index': 0, 'volume_type': None} {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 19:37:13 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-ee1f06db-f9c3-4c07-8924-7236a3d4540e tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 19:37:13 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-ee1f06db-f9c3-4c07-8924-7236a3d4540e tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 19:37:13 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-ee1f06db-f9c3-4c07-8924-7236a3d4540e tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 19:37:13 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-ee1f06db-f9c3-4c07-8924-7236a3d4540e tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] CPU controller missing on host. {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 19:37:13 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-ee1f06db-f9c3-4c07-8924-7236a3d4540e tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 19:37:13 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-ee1f06db-f9c3-4c07-8924-7236a3d4540e tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] CPU controller found on host. {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 19:37:13 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-ee1f06db-f9c3-4c07-8924-7236a3d4540e tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75216) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 19:37:13 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-ee1f06db-f9c3-4c07-8924-7236a3d4540e tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T18:40:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 19:37:13 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-ee1f06db-f9c3-4c07-8924-7236a3d4540e tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Flavor limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 19:37:13 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-ee1f06db-f9c3-4c07-8924-7236a3d4540e tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Image limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 19:37:13 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-ee1f06db-f9c3-4c07-8924-7236a3d4540e tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Flavor pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 19:37:13 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-ee1f06db-f9c3-4c07-8924-7236a3d4540e tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Image pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 19:37:13 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-ee1f06db-f9c3-4c07-8924-7236a3d4540e tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 19:37:13 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-ee1f06db-f9c3-4c07-8924-7236a3d4540e tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 19:37:13 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-ee1f06db-f9c3-4c07-8924-7236a3d4540e tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 19:37:13 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-ee1f06db-f9c3-4c07-8924-7236a3d4540e tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Got 1 possible topologies {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 19:37:13 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-ee1f06db-f9c3-4c07-8924-7236a3d4540e tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 19:37:13 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-ee1f06db-f9c3-4c07-8924-7236a3d4540e tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 19:37:13 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ee1f06db-f9c3-4c07-8924-7236a3d4540e tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 7e21edf8-2308-43f5-b9c9-17dabacfb0ec] Calling os-brick to attach iSCSI Volume {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 19:37:13 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee1f06db-f9c3-4c07-8924-7236a3d4540e tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3a8669e40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:dac4ffc7-c907-49c6-81da-c8700d141c1e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CcyHdMDU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 19:37:13 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-ee1f06db-f9c3-4c07-8924-7236a3d4540e tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 19:37:13 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-ee1f06db-f9c3-4c07-8924-7236a3d4540e tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 19:37:13 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-ee1f06db-f9c3-4c07-8924-7236a3d4540e tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 19:37:13 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-ee1f06db-f9c3-4c07-8924-7236a3d4540e tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 19:37:13 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-ee1f06db-f9c3-4c07-8924-7236a3d4540e tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dac4ffc7-c907-49c6-81da-c8700d141c1e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 19:37:13 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-ee1f06db-f9c3-4c07-8924-7236a3d4540e tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dac4ffc7-c907-49c6-81da-c8700d141c1e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 19:37:13 user nova-compute[75216]: INFO os_brick.initiator.connectors.iscsi [None req-ee1f06db-f9c3-4c07-8924-7236a3d4540e tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 19:37:13 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dac4ffc7-c907-49c6-81da-c8700d141c1e -p 172.16.0.220:3260 {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:37:13 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dac4ffc7-c907-49c6-81da-c8700d141c1e -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:37:13 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff69216c-60a7-4253-a659-ac0ef2102fb9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:37:13 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee1f06db-f9c3-4c07-8924-7236a3d4540e tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 19:37:13 user nova-compute[75216]:  {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:37:13 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dac4ffc7-c907-49c6-81da-c8700d141c1e -p 172.16.0.220:3260 --interface default --op new {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:37:13 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dac4ffc7-c907-49c6-81da-c8700d141c1e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:37:13 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[17cd4352-26dd-43ec-9b1e-4e198b386105]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dac4ffc7-c907-49c6-81da-c8700d141c1e] added\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:37:13 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee1f06db-f9c3-4c07-8924-7236a3d4540e tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dac4ffc7-c907-49c6-81da-c8700d141c1e] added
Nov 13 19:37:13 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:37:13 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dac4ffc7-c907-49c6-81da-c8700d141c1e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:37:13 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dac4ffc7-c907-49c6-81da-c8700d141c1e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:37:13 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[b387b6b2-9bb7-4ca7-8f04-8f05f96c07a0]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:37:13 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee1f06db-f9c3-4c07-8924-7236a3d4540e tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:37:13 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dac4ffc7-c907-49c6-81da-c8700d141c1e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:37:13 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dac4ffc7-c907-49c6-81da-c8700d141c1e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:37:13 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b837bae-57ad-4eda-891b-a06fa38ec0cb]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:37:13 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee1f06db-f9c3-4c07-8924-7236a3d4540e tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:37:13 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dac4ffc7-c907-49c6-81da-c8700d141c1e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CcyHdMDU {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:37:13 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dac4ffc7-c907-49c6-81da-c8700d141c1e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CcyHdMDU" returned: 0 in 0.019s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:37:13 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc4a3c76-b205-4be5-98e8-1246ee0c00f5]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:37:13 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee1f06db-f9c3-4c07-8924-7236a3d4540e tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CcyHdMDU'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:37:13 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dac4ffc7-c907-49c6-81da-c8700d141c1e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:37:13 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dac4ffc7-c907-49c6-81da-c8700d141c1e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:37:13 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[54108987-0463-4c32-93ba-5b420ea955ac]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:37:13 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee1f06db-f9c3-4c07-8924-7236a3d4540e tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:37:13 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:37:13 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:37:13 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e363b3e-2d7f-428d-b621-ee5c369c351f]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:37:13 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee1f06db-f9c3-4c07-8924-7236a3d4540e tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 13 19:37:13 user nova-compute[75216]:  {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 19:37:13 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee1f06db-f9c3-4c07-8924-7236a3d4540e tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 13 19:37:13 user nova-compute[75216]:  {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 19:37:13 user nova-compute[75216]: WARNING os_brick.initiator.connectors.iscsi [None req-ee1f06db-f9c3-4c07-8924-7236a3d4540e tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 13 19:37:13 user nova-compute[75216]: 
Nov 13 19:37:13 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dac4ffc7-c907-49c6-81da-c8700d141c1e -p 172.16.0.220:3260 --login {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:37:13 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dac4ffc7-c907-49c6-81da-c8700d141c1e -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:37:13 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bd8617c-e06f-4b94-a4cb-6f39d695aabc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:dac4ffc7-c907-49c6-81da-c8700d141c1e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:dac4ffc7-c907-49c6-81da-c8700d141c1e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:37:13 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee1f06db-f9c3-4c07-8924-7236a3d4540e tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:dac4ffc7-c907-49c6-81da-c8700d141c1e, portal: 172.16.0.220,3260]
Nov 13 19:37:13 user nova-compute[75216]: Login to [iface: default, target: iqn.2010-10.org.openstack:dac4ffc7-c907-49c6-81da-c8700d141c1e, portal: 172.16.0.220,3260] successful.
Nov 13 19:37:13 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:37:13 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dac4ffc7-c907-49c6-81da-c8700d141c1e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:37:13 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dac4ffc7-c907-49c6-81da-c8700d141c1e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:37:13 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[92ab4d5d-1568-49b8-82a7-af5a35d2bec4]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:37:13 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee1f06db-f9c3-4c07-8924-7236a3d4540e tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:37:13 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:37:13 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:37:13 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[543eef8b-9cb3-4932-b19b-18b13218b0de]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dac4ffc7-c907-49c6-81da-c8700d141c1e (non-flash)\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:37:13 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee1f06db-f9c3-4c07-8924-7236a3d4540e tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dac4ffc7-c907-49c6-81da-c8700d141c1e (non-flash)
Nov 13 19:37:13 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 19:37:13 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee1f06db-f9c3-4c07-8924-7236a3d4540e tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dac4ffc7-c907-49c6-81da-c8700d141c1e (non-flash)
Nov 13 19:37:13 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 19:37:13 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-ee1f06db-f9c3-4c07-8924-7236a3d4540e tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dac4ffc7-c907-49c6-81da-c8700d141c1e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.270s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 19:37:13 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee1f06db-f9c3-4c07-8924-7236a3d4540e tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Connected to 172.16.0.220:3260 {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 19:37:13 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-ee1f06db-f9c3-4c07-8924-7236a3d4540e tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] HCTL ('33', '-', '-', 0) found on session 58 with lun 0 {{(pid=75216) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 19:37:13 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-ee1f06db-f9c3-4c07-8924-7236a3d4540e tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75216) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 19:37:13 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:37:13 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:37:13 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[88937ed3-6c7d-44ed-abc9-5e24a98bc1d3]: (4, ('- - 0', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:37:13 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-ee1f06db-f9c3-4c07-8924-7236a3d4540e tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Searching for a device in session 58 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75216) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 19:37:13 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee1f06db-f9c3-4c07-8924-7236a3d4540e tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:dac4ffc7-c907-49c6-81da-c8700d141c1e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CcyHdMDU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 19:37:14 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-ee1f06db-f9c3-4c07-8924-7236a3d4540e tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.297s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 19:37:14 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee1f06db-f9c3-4c07-8924-7236a3d4540e tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] <== connect_volume: return (1298ms) {'type': 'block', 'scsi_wwn': '23937373132626239', 'path': '/dev/sdb'} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 19:37:14 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ee1f06db-f9c3-4c07-8924-7236a3d4540e tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 7e21edf8-2308-43f5-b9c9-17dabacfb0ec] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23937373132626239', 'path': '/dev/sdb'} {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 19:37:14 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-ee1f06db-f9c3-4c07-8924-7236a3d4540e tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T19:37:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1308884141',display_name='tempest-TestVolumeBootPattern-server-1308884141',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1308884141',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJoiZwaxJA3L6zg1VlDIL2iywK8D207KUdpx1vJqr+ljXQkA4jTUHYbkCYqoa39qc34qT95KOeBJjIq8vzC1Og4pbsAomDAW7M51FJ+JGdR7hmjZWz1zbUNVDWRemA+lQw==',key_name='tempest-TestVolumeBootPattern-21317594',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3a1951a52e7c4ef5ac6a0d9d5380d41a',ramdisk_id='',reservation_id='r-sy0ebmea',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1444343509',owner_user_name='tempest-TestVolumeBootPattern-1444343509-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T19:37:09Z,user_data=None,user_id='bfc6b02c16664b8dbea3a6f2088ec385',uuid=7e21edf8-2308-43f5-b9c9-17dabacfb0ec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8d7855ef-7f8d-4f76-af3d-5e9c41759435", "address": "fa:16:3e:7f:73:bb", "network": {"id": "5881a45c-3f28-48c4-aa8e-045b3bea3227", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1651070715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a1951a52e7c4ef5ac6a0d9d5380d41a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d7855ef-7f", "ovs_interfaceid": "8d7855ef-7f8d-4f76-af3d-5e9c41759435", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75216) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 19:37:14 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-ee1f06db-f9c3-4c07-8924-7236a3d4540e tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Converting VIF {"id": "8d7855ef-7f8d-4f76-af3d-5e9c41759435", "address": "fa:16:3e:7f:73:bb", "network": {"id": "5881a45c-3f28-48c4-aa8e-045b3bea3227", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1651070715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a1951a52e7c4ef5ac6a0d9d5380d41a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d7855ef-7f", "ovs_interfaceid": "8d7855ef-7f8d-4f76-af3d-5e9c41759435", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 19:37:14 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-ee1f06db-f9c3-4c07-8924-7236a3d4540e tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:73:bb,bridge_name='br-int',has_traffic_filtering=True,id=8d7855ef-7f8d-4f76-af3d-5e9c41759435,network=Network(5881a45c-3f28-48c4-aa8e-045b3bea3227),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d7855ef-7f') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 19:37:14 user nova-compute[75216]: DEBUG nova.objects.instance [None req-ee1f06db-f9c3-4c07-8924-7236a3d4540e tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Lazy-loading 'pci_devices' on Instance uuid 7e21edf8-2308-43f5-b9c9-17dabacfb0ec {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:37:14 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-ee1f06db-f9c3-4c07-8924-7236a3d4540e tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 7e21edf8-2308-43f5-b9c9-17dabacfb0ec] End _get_guest_xml xml=<domain type="kvm">
Nov 13 19:37:14 user nova-compute[75216]:   <uuid>7e21edf8-2308-43f5-b9c9-17dabacfb0ec</uuid>
Nov 13 19:37:14 user nova-compute[75216]:   <name>instance-00000032</name>
Nov 13 19:37:14 user nova-compute[75216]:   <memory>524288</memory>
Nov 13 19:37:14 user nova-compute[75216]:   <vcpu>1</vcpu>
Nov 13 19:37:14 user nova-compute[75216]:   <metadata>
Nov 13 19:37:14 user nova-compute[75216]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 19:37:14 user nova-compute[75216]:       <nova:package version="0.0.0"/>
Nov 13 19:37:14 user nova-compute[75216]:       <nova:name>tempest-TestVolumeBootPattern-server-1308884141</nova:name>
Nov 13 19:37:14 user nova-compute[75216]:       <nova:creationTime>2023-11-13 19:37:13</nova:creationTime>
Nov 13 19:37:14 user nova-compute[75216]:       <nova:flavor name="m1.tiny">
Nov 13 19:37:14 user nova-compute[75216]:         <nova:memory>512</nova:memory>
Nov 13 19:37:14 user nova-compute[75216]:         <nova:disk>1</nova:disk>
Nov 13 19:37:14 user nova-compute[75216]:         <nova:swap>0</nova:swap>
Nov 13 19:37:14 user nova-compute[75216]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 19:37:14 user nova-compute[75216]:         <nova:vcpus>1</nova:vcpus>
Nov 13 19:37:14 user nova-compute[75216]:       </nova:flavor>
Nov 13 19:37:14 user nova-compute[75216]:       <nova:owner>
Nov 13 19:37:14 user nova-compute[75216]:         <nova:user uuid="bfc6b02c16664b8dbea3a6f2088ec385">tempest-TestVolumeBootPattern-1444343509-project-member</nova:user>
Nov 13 19:37:14 user nova-compute[75216]:         <nova:project uuid="3a1951a52e7c4ef5ac6a0d9d5380d41a">tempest-TestVolumeBootPattern-1444343509</nova:project>
Nov 13 19:37:14 user nova-compute[75216]:       </nova:owner>
Nov 13 19:37:14 user nova-compute[75216]:       <nova:ports>
Nov 13 19:37:14 user nova-compute[75216]:         <nova:port uuid="8d7855ef-7f8d-4f76-af3d-5e9c41759435">
Nov 13 19:37:14 user nova-compute[75216]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 13 19:37:14 user nova-compute[75216]:         </nova:port>
Nov 13 19:37:14 user nova-compute[75216]:       </nova:ports>
Nov 13 19:37:14 user nova-compute[75216]:     </nova:instance>
Nov 13 19:37:14 user nova-compute[75216]:   </metadata>
Nov 13 19:37:14 user nova-compute[75216]:   <sysinfo type="smbios">
Nov 13 19:37:14 user nova-compute[75216]:     <system>
Nov 13 19:37:14 user nova-compute[75216]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 19:37:14 user nova-compute[75216]:       <entry name="product">OpenStack Nova</entry>
Nov 13 19:37:14 user nova-compute[75216]:       <entry name="version">0.0.0</entry>
Nov 13 19:37:14 user nova-compute[75216]:       <entry name="serial">7e21edf8-2308-43f5-b9c9-17dabacfb0ec</entry>
Nov 13 19:37:14 user nova-compute[75216]:       <entry name="uuid">7e21edf8-2308-43f5-b9c9-17dabacfb0ec</entry>
Nov 13 19:37:14 user nova-compute[75216]:       <entry name="family">Virtual Machine</entry>
Nov 13 19:37:14 user nova-compute[75216]:     </system>
Nov 13 19:37:14 user nova-compute[75216]:   </sysinfo>
Nov 13 19:37:14 user nova-compute[75216]:   <os>
Nov 13 19:37:14 user nova-compute[75216]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 19:37:14 user nova-compute[75216]:     <boot dev="hd"/>
Nov 13 19:37:14 user nova-compute[75216]:     <smbios mode="sysinfo"/>
Nov 13 19:37:14 user nova-compute[75216]:   </os>
Nov 13 19:37:14 user nova-compute[75216]:   <features>
Nov 13 19:37:14 user nova-compute[75216]:     <acpi/>
Nov 13 19:37:14 user nova-compute[75216]:     <apic/>
Nov 13 19:37:14 user nova-compute[75216]:     <vmcoreinfo/>
Nov 13 19:37:14 user nova-compute[75216]:   </features>
Nov 13 19:37:14 user nova-compute[75216]:   <clock offset="utc">
Nov 13 19:37:14 user nova-compute[75216]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 19:37:14 user nova-compute[75216]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 19:37:14 user nova-compute[75216]:     <timer name="hpet" present="no"/>
Nov 13 19:37:14 user nova-compute[75216]:   </clock>
Nov 13 19:37:14 user nova-compute[75216]:   <cpu mode="custom" match="exact">
Nov 13 19:37:14 user nova-compute[75216]:     <model>Nehalem</model>
Nov 13 19:37:14 user nova-compute[75216]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 19:37:14 user nova-compute[75216]:   </cpu>
Nov 13 19:37:14 user nova-compute[75216]:   <devices>
Nov 13 19:37:14 user nova-compute[75216]:     <disk type="block" device="disk">
Nov 13 19:37:14 user nova-compute[75216]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 19:37:14 user nova-compute[75216]:       <source dev="/dev/sdb"/>
Nov 13 19:37:14 user nova-compute[75216]:       <target dev="vda" bus="virtio"/>
Nov 13 19:37:14 user nova-compute[75216]:       <serial>dac4ffc7-c907-49c6-81da-c8700d141c1e</serial>
Nov 13 19:37:14 user nova-compute[75216]:     </disk>
Nov 13 19:37:14 user nova-compute[75216]:     <interface type="ethernet">
Nov 13 19:37:14 user nova-compute[75216]:       <mac address="fa:16:3e:7f:73:bb"/>
Nov 13 19:37:14 user nova-compute[75216]:       <model type="virtio"/>
Nov 13 19:37:14 user nova-compute[75216]:       <mtu size="1442"/>
Nov 13 19:37:14 user nova-compute[75216]:       <target dev="tap8d7855ef-7f"/>
Nov 13 19:37:14 user nova-compute[75216]:     </interface>
Nov 13 19:37:14 user nova-compute[75216]:     <serial type="pty">
Nov 13 19:37:14 user nova-compute[75216]:       <log file="/opt/stack/data/nova/instances/7e21edf8-2308-43f5-b9c9-17dabacfb0ec/console.log" append="off"/>
Nov 13 19:37:14 user nova-compute[75216]:     </serial>
Nov 13 19:37:14 user nova-compute[75216]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 19:37:14 user nova-compute[75216]:     <video>
Nov 13 19:37:14 user nova-compute[75216]:       <model type="virtio"/>
Nov 13 19:37:14 user nova-compute[75216]:     </video>
Nov 13 19:37:14 user nova-compute[75216]:     <rng model="virtio">
Nov 13 19:37:14 user nova-compute[75216]:       <backend model="random">/dev/urandom</backend>
Nov 13 19:37:14 user nova-compute[75216]:     </rng>
Nov 13 19:37:14 user nova-compute[75216]:     <controller type="usb" index="0" model="none"/>
Nov 13 19:37:14 user nova-compute[75216]:     <memballoon model="virtio">
Nov 13 19:37:14 user nova-compute[75216]:       <stats period="10"/>
Nov 13 19:37:14 user nova-compute[75216]:     </memballoon>
Nov 13 19:37:14 user nova-compute[75216]:   </devices>
Nov 13 19:37:14 user nova-compute[75216]: </domain>
Nov 13 19:37:14 user nova-compute[75216]:  {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 19:37:14 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-ee1f06db-f9c3-4c07-8924-7236a3d4540e tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T19:37:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1308884141',display_name='tempest-TestVolumeBootPattern-server-1308884141',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1308884141',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJoiZwaxJA3L6zg1VlDIL2iywK8D207KUdpx1vJqr+ljXQkA4jTUHYbkCYqoa39qc34qT95KOeBJjIq8vzC1Og4pbsAomDAW7M51FJ+JGdR7hmjZWz1zbUNVDWRemA+lQw==',key_name='tempest-TestVolumeBootPattern-21317594',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3a1951a52e7c4ef5ac6a0d9d5380d41a',ramdisk_id='',reservation_id='r-sy0ebmea',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1444343509',owner_user_name='tempest-TestVolumeBootPattern-1444343509-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T19:37:09Z,user_data=None,user_id='bfc6b02c16664b8dbea3a6f2088ec385',uuid=7e21edf8-2308-43f5-b9c9-17dabacfb0ec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8d7855ef-7f8d-4f76-af3d-5e9c41759435", "address": "fa:16:3e:7f:73:bb", "network": {"id": "5881a45c-3f28-48c4-aa8e-045b3bea3227", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1651070715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a1951a52e7c4ef5ac6a0d9d5380d41a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d7855ef-7f", "ovs_interfaceid": "8d7855ef-7f8d-4f76-af3d-5e9c41759435", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 19:37:14 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-ee1f06db-f9c3-4c07-8924-7236a3d4540e tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Converting VIF {"id": "8d7855ef-7f8d-4f76-af3d-5e9c41759435", "address": "fa:16:3e:7f:73:bb", "network": {"id": "5881a45c-3f28-48c4-aa8e-045b3bea3227", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1651070715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a1951a52e7c4ef5ac6a0d9d5380d41a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d7855ef-7f", "ovs_interfaceid": "8d7855ef-7f8d-4f76-af3d-5e9c41759435", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 19:37:14 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-ee1f06db-f9c3-4c07-8924-7236a3d4540e tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:73:bb,bridge_name='br-int',has_traffic_filtering=True,id=8d7855ef-7f8d-4f76-af3d-5e9c41759435,network=Network(5881a45c-3f28-48c4-aa8e-045b3bea3227),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d7855ef-7f') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 19:37:14 user nova-compute[75216]: DEBUG os_vif [None req-ee1f06db-f9c3-4c07-8924-7236a3d4540e tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:73:bb,bridge_name='br-int',has_traffic_filtering=True,id=8d7855ef-7f8d-4f76-af3d-5e9c41759435,network=Network(5881a45c-3f28-48c4-aa8e-045b3bea3227),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d7855ef-7f') {{(pid=75216) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 19:37:14 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:37:14 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:37:14 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 19:37:14 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:37:14 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3d8be20b-2a28-5d3b-be46-a4e5d231959e', '_type': 'linux-noop'}}, row=False) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:37:14 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:37:14 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:37:14 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:37:14 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8d7855ef-7f, may_exist=True, interface_attrs={}) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:37:14 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8d7855ef-7f, col_values=(('qos', UUID('76bfbe96-bc9d-4390-b3c3-a042f9120ec7')),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:37:14 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8d7855ef-7f, col_values=(('external_ids', {'iface-id': '8d7855ef-7f8d-4f76-af3d-5e9c41759435', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7f:73:bb', 'vm-uuid': '7e21edf8-2308-43f5-b9c9-17dabacfb0ec'}),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:37:14 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:37:14 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:37:14 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:37:14 user nova-compute[75216]: INFO os_vif [None req-ee1f06db-f9c3-4c07-8924-7236a3d4540e tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:73:bb,bridge_name='br-int',has_traffic_filtering=True,id=8d7855ef-7f8d-4f76-af3d-5e9c41759435,network=Network(5881a45c-3f28-48c4-aa8e-045b3bea3227),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d7855ef-7f')
Nov 13 19:37:14 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-ee1f06db-f9c3-4c07-8924-7236a3d4540e tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 19:37:14 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-ee1f06db-f9c3-4c07-8924-7236a3d4540e tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] No VIF found with MAC fa:16:3e:7f:73:bb, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 19:37:15 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:37:15 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:37:15 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:37:15 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:37:15 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:37:15 user nova-compute[75216]: DEBUG nova.compute.manager [req-e3e5994a-60df-4397-90a8-5eb5be01fe50 req-02d55a35-c65a-4613-a189-2fd5d17d5ca0 service nova] [instance: 7e21edf8-2308-43f5-b9c9-17dabacfb0ec] Received event network-vif-plugged-8d7855ef-7f8d-4f76-af3d-5e9c41759435 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:37:15 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-e3e5994a-60df-4397-90a8-5eb5be01fe50 req-02d55a35-c65a-4613-a189-2fd5d17d5ca0 service nova] Acquiring lock "7e21edf8-2308-43f5-b9c9-17dabacfb0ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:37:15 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-e3e5994a-60df-4397-90a8-5eb5be01fe50 req-02d55a35-c65a-4613-a189-2fd5d17d5ca0 service nova] Lock "7e21edf8-2308-43f5-b9c9-17dabacfb0ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:37:15 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-e3e5994a-60df-4397-90a8-5eb5be01fe50 req-02d55a35-c65a-4613-a189-2fd5d17d5ca0 service nova] Lock "7e21edf8-2308-43f5-b9c9-17dabacfb0ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:37:15 user nova-compute[75216]: DEBUG nova.compute.manager [req-e3e5994a-60df-4397-90a8-5eb5be01fe50 req-02d55a35-c65a-4613-a189-2fd5d17d5ca0 service nova] [instance: 7e21edf8-2308-43f5-b9c9-17dabacfb0ec] No waiting events found dispatching network-vif-plugged-8d7855ef-7f8d-4f76-af3d-5e9c41759435 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 19:37:15 user nova-compute[75216]: WARNING nova.compute.manager [req-e3e5994a-60df-4397-90a8-5eb5be01fe50 req-02d55a35-c65a-4613-a189-2fd5d17d5ca0 service nova] [instance: 7e21edf8-2308-43f5-b9c9-17dabacfb0ec] Received unexpected event network-vif-plugged-8d7855ef-7f8d-4f76-af3d-5e9c41759435 for instance with vm_state building and task_state spawning.
Nov 13 19:37:16 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:37:16 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:37:16 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:37:16 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:37:16 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:37:17 user nova-compute[75216]: DEBUG nova.compute.manager [None req-ee1f06db-f9c3-4c07-8924-7236a3d4540e tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 7e21edf8-2308-43f5-b9c9-17dabacfb0ec] Instance event wait completed in 0 seconds for  {{(pid=75216) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 19:37:17 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-ee1f06db-f9c3-4c07-8924-7236a3d4540e tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 7e21edf8-2308-43f5-b9c9-17dabacfb0ec] Guest created on hypervisor {{(pid=75216) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 19:37:17 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 7e21edf8-2308-43f5-b9c9-17dabacfb0ec] Instance spawned successfully.
Nov 13 19:37:17 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-ee1f06db-f9c3-4c07-8924-7236a3d4540e tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 7e21edf8-2308-43f5-b9c9-17dabacfb0ec] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 19:37:17 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-ee1f06db-f9c3-4c07-8924-7236a3d4540e tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 7e21edf8-2308-43f5-b9c9-17dabacfb0ec] Found default for hw_cdrom_bus of ide {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 19:37:17 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-ee1f06db-f9c3-4c07-8924-7236a3d4540e tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 7e21edf8-2308-43f5-b9c9-17dabacfb0ec] Found default for hw_disk_bus of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 19:37:17 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-ee1f06db-f9c3-4c07-8924-7236a3d4540e tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 7e21edf8-2308-43f5-b9c9-17dabacfb0ec] Found default for hw_input_bus of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 19:37:17 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-ee1f06db-f9c3-4c07-8924-7236a3d4540e tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 7e21edf8-2308-43f5-b9c9-17dabacfb0ec] Found default for hw_pointer_model of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 19:37:17 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-ee1f06db-f9c3-4c07-8924-7236a3d4540e tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 7e21edf8-2308-43f5-b9c9-17dabacfb0ec] Found default for hw_video_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 19:37:17 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-ee1f06db-f9c3-4c07-8924-7236a3d4540e tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 7e21edf8-2308-43f5-b9c9-17dabacfb0ec] Found default for hw_vif_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 19:37:17 user nova-compute[75216]: INFO nova.compute.manager [None req-ee1f06db-f9c3-4c07-8924-7236a3d4540e tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 7e21edf8-2308-43f5-b9c9-17dabacfb0ec] Took 4.89 seconds to spawn the instance on the hypervisor.
Nov 13 19:37:17 user nova-compute[75216]: DEBUG nova.compute.manager [None req-ee1f06db-f9c3-4c07-8924-7236a3d4540e tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 7e21edf8-2308-43f5-b9c9-17dabacfb0ec] Checking state {{(pid=75216) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 19:37:18 user nova-compute[75216]: DEBUG nova.compute.manager [req-484ff8d6-bbdc-41ef-aca1-271ba6d049af req-6d7d1e5a-b675-4d40-b0d4-709914b2c8e8 service nova] [instance: 7e21edf8-2308-43f5-b9c9-17dabacfb0ec] Received event network-vif-plugged-8d7855ef-7f8d-4f76-af3d-5e9c41759435 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:37:18 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-484ff8d6-bbdc-41ef-aca1-271ba6d049af req-6d7d1e5a-b675-4d40-b0d4-709914b2c8e8 service nova] Acquiring lock "7e21edf8-2308-43f5-b9c9-17dabacfb0ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:37:18 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-484ff8d6-bbdc-41ef-aca1-271ba6d049af req-6d7d1e5a-b675-4d40-b0d4-709914b2c8e8 service nova] Lock "7e21edf8-2308-43f5-b9c9-17dabacfb0ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:37:18 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-484ff8d6-bbdc-41ef-aca1-271ba6d049af req-6d7d1e5a-b675-4d40-b0d4-709914b2c8e8 service nova] Lock "7e21edf8-2308-43f5-b9c9-17dabacfb0ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:37:18 user nova-compute[75216]: DEBUG nova.compute.manager [req-484ff8d6-bbdc-41ef-aca1-271ba6d049af req-6d7d1e5a-b675-4d40-b0d4-709914b2c8e8 service nova] [instance: 7e21edf8-2308-43f5-b9c9-17dabacfb0ec] No waiting events found dispatching network-vif-plugged-8d7855ef-7f8d-4f76-af3d-5e9c41759435 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 19:37:18 user nova-compute[75216]: WARNING nova.compute.manager [req-484ff8d6-bbdc-41ef-aca1-271ba6d049af req-6d7d1e5a-b675-4d40-b0d4-709914b2c8e8 service nova] [instance: 7e21edf8-2308-43f5-b9c9-17dabacfb0ec] Received unexpected event network-vif-plugged-8d7855ef-7f8d-4f76-af3d-5e9c41759435 for instance with vm_state active and task_state None.
Nov 13 19:37:18 user nova-compute[75216]: INFO nova.compute.manager [None req-ee1f06db-f9c3-4c07-8924-7236a3d4540e tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 7e21edf8-2308-43f5-b9c9-17dabacfb0ec] Took 9.73 seconds to build instance.
Nov 13 19:37:18 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-ee1f06db-f9c3-4c07-8924-7236a3d4540e tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Lock "7e21edf8-2308-43f5-b9c9-17dabacfb0ec" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.820s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:37:19 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:37:19 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:37:21 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:37:24 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:37:29 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:37:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:37:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:37:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75216) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 19:37:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 19:37:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 19:37:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:37:31 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:37:31 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75216) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 19:37:33 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:37:33 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:37:34 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:37:34 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:37:34 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75216) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 19:37:34 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 19:37:34 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 19:37:34 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:37:34 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:37:35 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:37:35 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Starting heal instance info cache {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 19:37:35 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Rebuilding the list of instances to heal {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 13 19:37:35 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "refresh_cache-7e21edf8-2308-43f5-b9c9-17dabacfb0ec" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 19:37:35 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquired lock "refresh_cache-7e21edf8-2308-43f5-b9c9-17dabacfb0ec" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 19:37:35 user nova-compute[75216]: DEBUG nova.network.neutron [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: 7e21edf8-2308-43f5-b9c9-17dabacfb0ec] Forcefully refreshing network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 19:37:35 user nova-compute[75216]: DEBUG nova.objects.instance [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lazy-loading 'info_cache' on Instance uuid 7e21edf8-2308-43f5-b9c9-17dabacfb0ec {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:37:35 user nova-compute[75216]: DEBUG nova.network.neutron [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: 7e21edf8-2308-43f5-b9c9-17dabacfb0ec] Updating instance_info_cache with network_info: [{"id": "8d7855ef-7f8d-4f76-af3d-5e9c41759435", "address": "fa:16:3e:7f:73:bb", "network": {"id": "5881a45c-3f28-48c4-aa8e-045b3bea3227", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1651070715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a1951a52e7c4ef5ac6a0d9d5380d41a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d7855ef-7f", "ovs_interfaceid": "8d7855ef-7f8d-4f76-af3d-5e9c41759435", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:37:35 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Releasing lock "refresh_cache-7e21edf8-2308-43f5-b9c9-17dabacfb0ec" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 19:37:35 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: 7e21edf8-2308-43f5-b9c9-17dabacfb0ec] Updated the network info_cache for instance {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 19:37:35 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:37:35 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:37:35 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:37:35 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:37:35 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Auditing locally available compute resources for user (node: user) {{(pid=75216) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 19:37:36 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 19:37:36 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 19:37:36 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 19:37:36 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Hypervisor/Node resource view: name=user free_ram=8939MB free_disk=25.258129119873047GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75216) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 19:37:36 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:37:36 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:37:36 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance 7e21edf8-2308-43f5-b9c9-17dabacfb0ec actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 19:37:36 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 19:37:36 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 19:37:36 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 19:37:36 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 19:37:36 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Compute_service record updated for user:user {{(pid=75216) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 19:37:36 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.210s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:37:37 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:37:39 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:37:39 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:37:44 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:37:44 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:37:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:37:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:37:52 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:37:54 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:37:59 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:38:04 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:38:09 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:38:14 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:38:16 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:38:19 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:38:21 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:38:24 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:38:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:38:30 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:38:32 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:38:32 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75216) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 19:38:33 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:38:33 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:38:34 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:38:36 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:38:36 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Starting heal instance info cache {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 19:38:36 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Rebuilding the list of instances to heal {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 13 19:38:36 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "refresh_cache-7e21edf8-2308-43f5-b9c9-17dabacfb0ec" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 19:38:36 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquired lock "refresh_cache-7e21edf8-2308-43f5-b9c9-17dabacfb0ec" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 19:38:36 user nova-compute[75216]: DEBUG nova.network.neutron [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: 7e21edf8-2308-43f5-b9c9-17dabacfb0ec] Forcefully refreshing network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 19:38:36 user nova-compute[75216]: DEBUG nova.objects.instance [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lazy-loading 'info_cache' on Instance uuid 7e21edf8-2308-43f5-b9c9-17dabacfb0ec {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:38:36 user nova-compute[75216]: DEBUG nova.network.neutron [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: 7e21edf8-2308-43f5-b9c9-17dabacfb0ec] Updating instance_info_cache with network_info: [{"id": "8d7855ef-7f8d-4f76-af3d-5e9c41759435", "address": "fa:16:3e:7f:73:bb", "network": {"id": "5881a45c-3f28-48c4-aa8e-045b3bea3227", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1651070715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a1951a52e7c4ef5ac6a0d9d5380d41a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d7855ef-7f", "ovs_interfaceid": "8d7855ef-7f8d-4f76-af3d-5e9c41759435", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:38:36 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Releasing lock "refresh_cache-7e21edf8-2308-43f5-b9c9-17dabacfb0ec" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 19:38:36 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: 7e21edf8-2308-43f5-b9c9-17dabacfb0ec] Updated the network info_cache for instance {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 19:38:36 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:38:36 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:38:36 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:38:36 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:38:36 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Auditing locally available compute resources for user (node: user) {{(pid=75216) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 19:38:37 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 19:38:37 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 19:38:37 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 19:38:37 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Hypervisor/Node resource view: name=user free_ram=8999MB free_disk=25.257537841796875GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75216) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 19:38:37 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:38:37 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:38:37 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance 7e21edf8-2308-43f5-b9c9-17dabacfb0ec actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 19:38:37 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 19:38:37 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 19:38:37 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 19:38:37 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 19:38:37 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Compute_service record updated for user:user {{(pid=75216) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 19:38:37 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.260s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:38:39 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:38:39 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:38:39 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:38:39 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75216) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 19:38:39 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 19:38:39 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 19:38:39 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:38:44 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:38:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:38:54 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:38:54 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:38:54 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75216) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 19:38:54 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 19:38:54 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 19:38:54 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:38:59 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:38:59 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:39:00 user nova-compute[75216]: DEBUG nova.compute.manager [req-c900a271-1862-45ec-a300-de9ad725e87a req-bb051a54-cb3b-4260-b2c4-6d794a3b301b service nova] [instance: 7e21edf8-2308-43f5-b9c9-17dabacfb0ec] Received event network-changed-8d7855ef-7f8d-4f76-af3d-5e9c41759435 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:39:00 user nova-compute[75216]: DEBUG nova.compute.manager [req-c900a271-1862-45ec-a300-de9ad725e87a req-bb051a54-cb3b-4260-b2c4-6d794a3b301b service nova] [instance: 7e21edf8-2308-43f5-b9c9-17dabacfb0ec] Refreshing instance network info cache due to event network-changed-8d7855ef-7f8d-4f76-af3d-5e9c41759435. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 19:39:00 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-c900a271-1862-45ec-a300-de9ad725e87a req-bb051a54-cb3b-4260-b2c4-6d794a3b301b service nova] Acquiring lock "refresh_cache-7e21edf8-2308-43f5-b9c9-17dabacfb0ec" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 19:39:00 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-c900a271-1862-45ec-a300-de9ad725e87a req-bb051a54-cb3b-4260-b2c4-6d794a3b301b service nova] Acquired lock "refresh_cache-7e21edf8-2308-43f5-b9c9-17dabacfb0ec" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 19:39:00 user nova-compute[75216]: DEBUG nova.network.neutron [req-c900a271-1862-45ec-a300-de9ad725e87a req-bb051a54-cb3b-4260-b2c4-6d794a3b301b service nova] [instance: 7e21edf8-2308-43f5-b9c9-17dabacfb0ec] Refreshing network info cache for port 8d7855ef-7f8d-4f76-af3d-5e9c41759435 {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 19:39:00 user nova-compute[75216]: DEBUG nova.network.neutron [req-c900a271-1862-45ec-a300-de9ad725e87a req-bb051a54-cb3b-4260-b2c4-6d794a3b301b service nova] [instance: 7e21edf8-2308-43f5-b9c9-17dabacfb0ec] Updated VIF entry in instance network info cache for port 8d7855ef-7f8d-4f76-af3d-5e9c41759435. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 19:39:00 user nova-compute[75216]: DEBUG nova.network.neutron [req-c900a271-1862-45ec-a300-de9ad725e87a req-bb051a54-cb3b-4260-b2c4-6d794a3b301b service nova] [instance: 7e21edf8-2308-43f5-b9c9-17dabacfb0ec] Updating instance_info_cache with network_info: [{"id": "8d7855ef-7f8d-4f76-af3d-5e9c41759435", "address": "fa:16:3e:7f:73:bb", "network": {"id": "5881a45c-3f28-48c4-aa8e-045b3bea3227", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1651070715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a1951a52e7c4ef5ac6a0d9d5380d41a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d7855ef-7f", "ovs_interfaceid": "8d7855ef-7f8d-4f76-af3d-5e9c41759435", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:39:00 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-c900a271-1862-45ec-a300-de9ad725e87a req-bb051a54-cb3b-4260-b2c4-6d794a3b301b service nova] Releasing lock "refresh_cache-7e21edf8-2308-43f5-b9c9-17dabacfb0ec" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 19:39:04 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:39:04 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a25df7df-a5f6-4bab-8211-5ad130696f92 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Acquiring lock "19059219-029e-40b3-a439-f9c152568ed0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:39:04 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a25df7df-a5f6-4bab-8211-5ad130696f92 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Lock "19059219-029e-40b3-a439-f9c152568ed0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:39:04 user nova-compute[75216]: DEBUG nova.compute.manager [None req-a25df7df-a5f6-4bab-8211-5ad130696f92 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 19059219-029e-40b3-a439-f9c152568ed0] Starting instance... {{(pid=75216) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 19:39:04 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:39:04 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a25df7df-a5f6-4bab-8211-5ad130696f92 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:39:04 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a25df7df-a5f6-4bab-8211-5ad130696f92 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:39:04 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-a25df7df-a5f6-4bab-8211-5ad130696f92 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75216) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 19:39:04 user nova-compute[75216]: INFO nova.compute.claims [None req-a25df7df-a5f6-4bab-8211-5ad130696f92 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 19059219-029e-40b3-a439-f9c152568ed0] Claim successful on node user
Nov 13 19:39:04 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-a25df7df-a5f6-4bab-8211-5ad130696f92 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 19:39:04 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-a25df7df-a5f6-4bab-8211-5ad130696f92 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 19:39:04 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a25df7df-a5f6-4bab-8211-5ad130696f92 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.202s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:39:04 user nova-compute[75216]: DEBUG nova.compute.manager [None req-a25df7df-a5f6-4bab-8211-5ad130696f92 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 19059219-029e-40b3-a439-f9c152568ed0] Start building networks asynchronously for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 19:39:05 user nova-compute[75216]: DEBUG nova.compute.manager [None req-a25df7df-a5f6-4bab-8211-5ad130696f92 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 19059219-029e-40b3-a439-f9c152568ed0] Allocating IP information in the background. {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 19:39:05 user nova-compute[75216]: DEBUG nova.network.neutron [None req-a25df7df-a5f6-4bab-8211-5ad130696f92 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 19059219-029e-40b3-a439-f9c152568ed0] allocate_for_instance() {{(pid=75216) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 19:39:05 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-a25df7df-a5f6-4bab-8211-5ad130696f92 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 19059219-029e-40b3-a439-f9c152568ed0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 19:39:05 user nova-compute[75216]: DEBUG nova.compute.manager [None req-a25df7df-a5f6-4bab-8211-5ad130696f92 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 19059219-029e-40b3-a439-f9c152568ed0] Start building block device mappings for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 19:39:05 user nova-compute[75216]: DEBUG nova.policy [None req-a25df7df-a5f6-4bab-8211-5ad130696f92 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bfc6b02c16664b8dbea3a6f2088ec385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1951a52e7c4ef5ac6a0d9d5380d41a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75216) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 19:39:05 user nova-compute[75216]: INFO nova.virt.block_device [None req-a25df7df-a5f6-4bab-8211-5ad130696f92 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 19059219-029e-40b3-a439-f9c152568ed0] Booting with volume 48dee582-3c2e-4e32-8d4d-3775ce38d32a at /dev/vda
Nov 13 19:39:05 user nova-compute[75216]: DEBUG os_brick.utils [None req-a25df7df-a5f6-4bab-8211-5ad130696f92 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 19:39:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:39:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:39:05 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5bb08a9-34e2-41d6-9d81-5be65fb09640]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aea6fcfe14b9\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:39:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:39:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:39:05 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[1097ef6c-c096-445e-a554-5eef533fdcc8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:39:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:39:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:39:05 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[15aaf6d2-d305-4ce0-a0b1-f0a095ebd423]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:39:05 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b43d7a9-76a7-46a6-af4c-e84e4bba54f5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:39:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-a25df7df-a5f6-4bab-8211-5ad130696f92 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Running cmd (subprocess): nvme version {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:39:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-a25df7df-a5f6-4bab-8211-5ad130696f92 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] 'nvme version' failed. Not Retrying. {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 19:39:05 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a25df7df-a5f6-4bab-8211-5ad130696f92 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] nvme not present on system {{(pid=75216) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 19:39:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:39:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 19:39:05 user nova-compute[75216]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 19:39:05 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a5a471b-2e78-4cb8-a427-2464d4610180]: (4, '') {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:39:05 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-a25df7df-a5f6-4bab-8211-5ad130696f92 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75216) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 19:39:05 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-a25df7df-a5f6-4bab-8211-5ad130696f92 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 19:39:05 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-a25df7df-a5f6-4bab-8211-5ad130696f92 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] LIGHTOS: no hostnqn found. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 19:39:05 user nova-compute[75216]: DEBUG os_brick.utils [None req-a25df7df-a5f6-4bab-8211-5ad130696f92 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aea6fcfe14b9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 19:39:05 user nova-compute[75216]: DEBUG nova.virt.block_device [None req-a25df7df-a5f6-4bab-8211-5ad130696f92 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 19059219-029e-40b3-a439-f9c152568ed0] Updating existing volume attachment record: 09925331-49b2-438b-ba81-b66a79ec0647 {{(pid=75216) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 19:39:06 user nova-compute[75216]: DEBUG nova.network.neutron [None req-a25df7df-a5f6-4bab-8211-5ad130696f92 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 19059219-029e-40b3-a439-f9c152568ed0] Successfully created port: 6f8325fb-aa09-4c06-a179-3433db4ce4ee {{(pid=75216) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 19:39:07 user nova-compute[75216]: DEBUG nova.network.neutron [None req-a25df7df-a5f6-4bab-8211-5ad130696f92 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 19059219-029e-40b3-a439-f9c152568ed0] Successfully updated port: 6f8325fb-aa09-4c06-a179-3433db4ce4ee {{(pid=75216) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 19:39:07 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a25df7df-a5f6-4bab-8211-5ad130696f92 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Acquiring lock "refresh_cache-19059219-029e-40b3-a439-f9c152568ed0" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 19:39:07 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a25df7df-a5f6-4bab-8211-5ad130696f92 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Acquired lock "refresh_cache-19059219-029e-40b3-a439-f9c152568ed0" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 19:39:07 user nova-compute[75216]: DEBUG nova.network.neutron [None req-a25df7df-a5f6-4bab-8211-5ad130696f92 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 19059219-029e-40b3-a439-f9c152568ed0] Building network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 19:39:07 user nova-compute[75216]: DEBUG nova.network.neutron [None req-a25df7df-a5f6-4bab-8211-5ad130696f92 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 19059219-029e-40b3-a439-f9c152568ed0] Instance cache missing network info. {{(pid=75216) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 19:39:07 user nova-compute[75216]: DEBUG nova.compute.manager [req-ff81e496-aac1-46b9-85ff-252eb756a7b5 req-56d55bab-a183-4a60-a292-baa0eb40dddd service nova] [instance: 19059219-029e-40b3-a439-f9c152568ed0] Received event network-changed-6f8325fb-aa09-4c06-a179-3433db4ce4ee {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:39:07 user nova-compute[75216]: DEBUG nova.compute.manager [req-ff81e496-aac1-46b9-85ff-252eb756a7b5 req-56d55bab-a183-4a60-a292-baa0eb40dddd service nova] [instance: 19059219-029e-40b3-a439-f9c152568ed0] Refreshing instance network info cache due to event network-changed-6f8325fb-aa09-4c06-a179-3433db4ce4ee. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 19:39:07 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-ff81e496-aac1-46b9-85ff-252eb756a7b5 req-56d55bab-a183-4a60-a292-baa0eb40dddd service nova] Acquiring lock "refresh_cache-19059219-029e-40b3-a439-f9c152568ed0" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 19:39:07 user nova-compute[75216]: DEBUG nova.network.neutron [None req-a25df7df-a5f6-4bab-8211-5ad130696f92 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 19059219-029e-40b3-a439-f9c152568ed0] Updating instance_info_cache with network_info: [{"id": "6f8325fb-aa09-4c06-a179-3433db4ce4ee", "address": "fa:16:3e:32:1b:3c", "network": {"id": "5881a45c-3f28-48c4-aa8e-045b3bea3227", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1651070715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a1951a52e7c4ef5ac6a0d9d5380d41a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f8325fb-aa", "ovs_interfaceid": "6f8325fb-aa09-4c06-a179-3433db4ce4ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:39:07 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a25df7df-a5f6-4bab-8211-5ad130696f92 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Releasing lock "refresh_cache-19059219-029e-40b3-a439-f9c152568ed0" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 19:39:07 user nova-compute[75216]: DEBUG nova.compute.manager [None req-a25df7df-a5f6-4bab-8211-5ad130696f92 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 19059219-029e-40b3-a439-f9c152568ed0] Instance network_info: |[{"id": "6f8325fb-aa09-4c06-a179-3433db4ce4ee", "address": "fa:16:3e:32:1b:3c", "network": {"id": "5881a45c-3f28-48c4-aa8e-045b3bea3227", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1651070715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a1951a52e7c4ef5ac6a0d9d5380d41a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f8325fb-aa", "ovs_interfaceid": "6f8325fb-aa09-4c06-a179-3433db4ce4ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 19:39:07 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-ff81e496-aac1-46b9-85ff-252eb756a7b5 req-56d55bab-a183-4a60-a292-baa0eb40dddd service nova] Acquired lock "refresh_cache-19059219-029e-40b3-a439-f9c152568ed0" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 19:39:07 user nova-compute[75216]: DEBUG nova.network.neutron [req-ff81e496-aac1-46b9-85ff-252eb756a7b5 req-56d55bab-a183-4a60-a292-baa0eb40dddd service nova] [instance: 19059219-029e-40b3-a439-f9c152568ed0] Refreshing network info cache for port 6f8325fb-aa09-4c06-a179-3433db4ce4ee {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 19:39:07 user nova-compute[75216]: DEBUG nova.network.neutron [req-ff81e496-aac1-46b9-85ff-252eb756a7b5 req-56d55bab-a183-4a60-a292-baa0eb40dddd service nova] [instance: 19059219-029e-40b3-a439-f9c152568ed0] Updated VIF entry in instance network info cache for port 6f8325fb-aa09-4c06-a179-3433db4ce4ee. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 19:39:07 user nova-compute[75216]: DEBUG nova.network.neutron [req-ff81e496-aac1-46b9-85ff-252eb756a7b5 req-56d55bab-a183-4a60-a292-baa0eb40dddd service nova] [instance: 19059219-029e-40b3-a439-f9c152568ed0] Updating instance_info_cache with network_info: [{"id": "6f8325fb-aa09-4c06-a179-3433db4ce4ee", "address": "fa:16:3e:32:1b:3c", "network": {"id": "5881a45c-3f28-48c4-aa8e-045b3bea3227", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1651070715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a1951a52e7c4ef5ac6a0d9d5380d41a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f8325fb-aa", "ovs_interfaceid": "6f8325fb-aa09-4c06-a179-3433db4ce4ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:39:07 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-ff81e496-aac1-46b9-85ff-252eb756a7b5 req-56d55bab-a183-4a60-a292-baa0eb40dddd service nova] Releasing lock "refresh_cache-19059219-029e-40b3-a439-f9c152568ed0" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 19:39:09 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:39:09 user nova-compute[75216]: DEBUG nova.compute.manager [None req-a25df7df-a5f6-4bab-8211-5ad130696f92 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 19059219-029e-40b3-a439-f9c152568ed0] Start spawning the instance on the hypervisor. {{(pid=75216) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 19:39:09 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-a25df7df-a5f6-4bab-8211-5ad130696f92 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 19059219-029e-40b3-a439-f9c152568ed0] Creating instance directory {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 19:39:09 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-a25df7df-a5f6-4bab-8211-5ad130696f92 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 19059219-029e-40b3-a439-f9c152568ed0] Creating image(s)
Nov 13 19:39:09 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-a25df7df-a5f6-4bab-8211-5ad130696f92 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 19059219-029e-40b3-a439-f9c152568ed0] Did not create local disks {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 13 19:39:09 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-a25df7df-a5f6-4bab-8211-5ad130696f92 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 19059219-029e-40b3-a439-f9c152568ed0] Ensure instance console log exists: /opt/stack/data/nova/instances/19059219-029e-40b3-a439-f9c152568ed0/console.log {{(pid=75216) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 19:39:09 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a25df7df-a5f6-4bab-8211-5ad130696f92 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:39:09 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a25df7df-a5f6-4bab-8211-5ad130696f92 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:39:09 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a25df7df-a5f6-4bab-8211-5ad130696f92 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:39:09 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-a25df7df-a5f6-4bab-8211-5ad130696f92 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 19059219-029e-40b3-a439-f9c152568ed0] Start _get_guest_xml network_info=[{"id": "6f8325fb-aa09-4c06-a179-3433db4ce4ee", "address": "fa:16:3e:32:1b:3c", "network": {"id": "5881a45c-3f28-48c4-aa8e-045b3bea3227", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1651070715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a1951a52e7c4ef5ac6a0d9d5380d41a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f8325fb-aa", "ovs_interfaceid": "6f8325fb-aa09-4c06-a179-3433db4ce4ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:48dee582-3c2e-4e32-8d4d-3775ce38d32a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mslTOqWy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '19059219-029e-40b3-a439-f9c152568ed0', 'attached_at': '', 'detached_at': '', 'volume_id': '48dee582-3c2e-4e32-8d4d-3775ce38d32a', 'serial': '48dee582-3c2e-4e32-8d4d-3775ce38d32a'}, 'attachment_id': '09925331-49b2-438b-ba81-b66a79ec0647', 'guest_format': None, 'mount_device': '/dev/vda', 'delete_on_termination': False, 'boot_index': 0, 'volume_type': None} {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 19:39:09 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-a25df7df-a5f6-4bab-8211-5ad130696f92 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 19:39:09 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-a25df7df-a5f6-4bab-8211-5ad130696f92 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 19:39:09 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-a25df7df-a5f6-4bab-8211-5ad130696f92 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 19:39:09 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-a25df7df-a5f6-4bab-8211-5ad130696f92 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] CPU controller missing on host. {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 19:39:09 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-a25df7df-a5f6-4bab-8211-5ad130696f92 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 19:39:09 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-a25df7df-a5f6-4bab-8211-5ad130696f92 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] CPU controller found on host. {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 19:39:09 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-a25df7df-a5f6-4bab-8211-5ad130696f92 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75216) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 19:39:09 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-a25df7df-a5f6-4bab-8211-5ad130696f92 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T18:40:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 19:39:09 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-a25df7df-a5f6-4bab-8211-5ad130696f92 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Flavor limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 19:39:09 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-a25df7df-a5f6-4bab-8211-5ad130696f92 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Image limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 19:39:09 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-a25df7df-a5f6-4bab-8211-5ad130696f92 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Flavor pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 19:39:09 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-a25df7df-a5f6-4bab-8211-5ad130696f92 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Image pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 19:39:09 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-a25df7df-a5f6-4bab-8211-5ad130696f92 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 19:39:09 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-a25df7df-a5f6-4bab-8211-5ad130696f92 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 19:39:09 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-a25df7df-a5f6-4bab-8211-5ad130696f92 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 19:39:09 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-a25df7df-a5f6-4bab-8211-5ad130696f92 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Got 1 possible topologies {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 19:39:09 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-a25df7df-a5f6-4bab-8211-5ad130696f92 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 19:39:09 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-a25df7df-a5f6-4bab-8211-5ad130696f92 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 19:39:09 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a25df7df-a5f6-4bab-8211-5ad130696f92 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 19059219-029e-40b3-a439-f9c152568ed0] Calling os-brick to attach iSCSI Volume {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 19:39:09 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a25df7df-a5f6-4bab-8211-5ad130696f92 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3a8669e40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:48dee582-3c2e-4e32-8d4d-3775ce38d32a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mslTOqWy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 19:39:09 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-a25df7df-a5f6-4bab-8211-5ad130696f92 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 19:39:09 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-a25df7df-a5f6-4bab-8211-5ad130696f92 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 19:39:09 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-a25df7df-a5f6-4bab-8211-5ad130696f92 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 19:39:09 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-a25df7df-a5f6-4bab-8211-5ad130696f92 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 19:39:09 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-a25df7df-a5f6-4bab-8211-5ad130696f92 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:48dee582-3c2e-4e32-8d4d-3775ce38d32a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 19:39:09 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-a25df7df-a5f6-4bab-8211-5ad130696f92 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:48dee582-3c2e-4e32-8d4d-3775ce38d32a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 19:39:09 user nova-compute[75216]: INFO os_brick.initiator.connectors.iscsi [None req-a25df7df-a5f6-4bab-8211-5ad130696f92 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 19:39:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48dee582-3c2e-4e32-8d4d-3775ce38d32a -p 172.16.0.220:3260 {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:39:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48dee582-3c2e-4e32-8d4d-3775ce38d32a -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:39:09 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[d061a152-267c-4a53-bd2b-639746023095]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:39:09 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a25df7df-a5f6-4bab-8211-5ad130696f92 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 19:39:09 user nova-compute[75216]:  {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:39:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48dee582-3c2e-4e32-8d4d-3775ce38d32a -p 172.16.0.220:3260 --interface default --op new {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:39:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48dee582-3c2e-4e32-8d4d-3775ce38d32a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:39:09 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f1d44d3-39f2-42d2-9dbd-7dc14ffd76ca]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:48dee582-3c2e-4e32-8d4d-3775ce38d32a] added\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:39:09 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a25df7df-a5f6-4bab-8211-5ad130696f92 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:48dee582-3c2e-4e32-8d4d-3775ce38d32a] added
Nov 13 19:39:09 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:39:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48dee582-3c2e-4e32-8d4d-3775ce38d32a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:39:09 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:39:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48dee582-3c2e-4e32-8d4d-3775ce38d32a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:39:09 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ce1b2d0-738a-4bcf-b316-d2607cb6de0c]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:39:09 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a25df7df-a5f6-4bab-8211-5ad130696f92 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:39:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48dee582-3c2e-4e32-8d4d-3775ce38d32a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:39:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48dee582-3c2e-4e32-8d4d-3775ce38d32a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:39:09 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1c9e2e6-5c20-413d-a89a-ca2c3914ff59]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:39:09 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a25df7df-a5f6-4bab-8211-5ad130696f92 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:39:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48dee582-3c2e-4e32-8d4d-3775ce38d32a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mslTOqWy {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:39:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48dee582-3c2e-4e32-8d4d-3775ce38d32a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mslTOqWy" returned: 0 in 0.020s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:39:09 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[08665aed-b068-4399-88b2-883953c1cc32]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:39:09 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a25df7df-a5f6-4bab-8211-5ad130696f92 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mslTOqWy'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:39:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48dee582-3c2e-4e32-8d4d-3775ce38d32a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:39:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48dee582-3c2e-4e32-8d4d-3775ce38d32a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.034s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:39:09 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[708bf0fe-610c-4f39-b768-724dbe009aa8]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:39:09 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a25df7df-a5f6-4bab-8211-5ad130696f92 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:39:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:39:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:39:09 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b7c9ca7-f4b2-4fae-9578-3cb0c5cd58d9]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dac4ffc7-c907-49c6-81da-c8700d141c1e (non-flash)\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:39:09 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a25df7df-a5f6-4bab-8211-5ad130696f92 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dac4ffc7-c907-49c6-81da-c8700d141c1e (non-flash)
Nov 13 19:39:09 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 19:39:09 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a25df7df-a5f6-4bab-8211-5ad130696f92 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dac4ffc7-c907-49c6-81da-c8700d141c1e (non-flash)
Nov 13 19:39:09 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 19:39:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48dee582-3c2e-4e32-8d4d-3775ce38d32a -p 172.16.0.220:3260 --login {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:39:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48dee582-3c2e-4e32-8d4d-3775ce38d32a -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:39:09 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[361f0ae5-abbc-408d-9dc1-543cbbf1edf7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:48dee582-3c2e-4e32-8d4d-3775ce38d32a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:48dee582-3c2e-4e32-8d4d-3775ce38d32a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:39:09 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a25df7df-a5f6-4bab-8211-5ad130696f92 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:48dee582-3c2e-4e32-8d4d-3775ce38d32a, portal: 172.16.0.220,3260]
Nov 13 19:39:09 user nova-compute[75216]: Login to [iface: default, target: iqn.2010-10.org.openstack:48dee582-3c2e-4e32-8d4d-3775ce38d32a, portal: 172.16.0.220,3260] successful.
Nov 13 19:39:09 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:39:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48dee582-3c2e-4e32-8d4d-3775ce38d32a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:39:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48dee582-3c2e-4e32-8d4d-3775ce38d32a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:39:09 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fe817fb-d5ce-4a6d-8718-c58394fd77c8]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:39:09 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a25df7df-a5f6-4bab-8211-5ad130696f92 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:39:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:39:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:39:09 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[1816e746-7b11-4f2c-a6bd-5f73fb64ba54]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dac4ffc7-c907-49c6-81da-c8700d141c1e (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48dee582-3c2e-4e32-8d4d-3775ce38d32a (non-flash)\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:39:09 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a25df7df-a5f6-4bab-8211-5ad130696f92 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dac4ffc7-c907-49c6-81da-c8700d141c1e (non-flash)
Nov 13 19:39:09 user nova-compute[75216]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48dee582-3c2e-4e32-8d4d-3775ce38d32a (non-flash)
Nov 13 19:39:09 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 19:39:09 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a25df7df-a5f6-4bab-8211-5ad130696f92 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dac4ffc7-c907-49c6-81da-c8700d141c1e (non-flash)
Nov 13 19:39:09 user nova-compute[75216]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48dee582-3c2e-4e32-8d4d-3775ce38d32a (non-flash)
Nov 13 19:39:09 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 19:39:09 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-a25df7df-a5f6-4bab-8211-5ad130696f92 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:48dee582-3c2e-4e32-8d4d-3775ce38d32a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.277s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 19:39:09 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a25df7df-a5f6-4bab-8211-5ad130696f92 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Connected to 172.16.0.220:3260 {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 19:39:09 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-a25df7df-a5f6-4bab-8211-5ad130696f92 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] HCTL ('34', '-', '-', 0) found on session 59 with lun 0 {{(pid=75216) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 19:39:09 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-a25df7df-a5f6-4bab-8211-5ad130696f92 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75216) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 19:39:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:39:09 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:39:09 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[90ebcae7-0923-4017-9010-2f4a011f80a2]: (4, ('- - 0', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:39:09 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-a25df7df-a5f6-4bab-8211-5ad130696f92 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Searching for a device in session 59 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75216) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 19:39:09 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a25df7df-a5f6-4bab-8211-5ad130696f92 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:48dee582-3c2e-4e32-8d4d-3775ce38d32a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mslTOqWy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 19:39:10 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-a25df7df-a5f6-4bab-8211-5ad130696f92 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.311s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 19:39:10 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a25df7df-a5f6-4bab-8211-5ad130696f92 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] <== connect_volume: return (1312ms) {'type': 'block', 'scsi_wwn': '26133643366613864', 'path': '/dev/sdc'} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 19:39:10 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a25df7df-a5f6-4bab-8211-5ad130696f92 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 19059219-029e-40b3-a439-f9c152568ed0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26133643366613864', 'path': '/dev/sdc'} {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 19:39:10 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-a25df7df-a5f6-4bab-8211-5ad130696f92 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T19:39:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-79176008',display_name='tempest-TestVolumeBootPattern-server-79176008',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-79176008',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJoiZwaxJA3L6zg1VlDIL2iywK8D207KUdpx1vJqr+ljXQkA4jTUHYbkCYqoa39qc34qT95KOeBJjIq8vzC1Og4pbsAomDAW7M51FJ+JGdR7hmjZWz1zbUNVDWRemA+lQw==',key_name='tempest-TestVolumeBootPattern-21317594',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3a1951a52e7c4ef5ac6a0d9d5380d41a',ramdisk_id='',reservation_id='r-5vfzb2v0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1444343509',owner_user_name='tempest-TestVolumeBootPattern-1444343509-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T19:39:05Z,user_data=None,user_id='bfc6b02c16664b8dbea3a6f2088ec385',uuid=19059219-029e-40b3-a439-f9c152568ed0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6f8325fb-aa09-4c06-a179-3433db4ce4ee", "address": "fa:16:3e:32:1b:3c", "network": {"id": "5881a45c-3f28-48c4-aa8e-045b3bea3227", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1651070715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a1951a52e7c4ef5ac6a0d9d5380d41a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f8325fb-aa", "ovs_interfaceid": "6f8325fb-aa09-4c06-a179-3433db4ce4ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75216) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 19:39:10 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-a25df7df-a5f6-4bab-8211-5ad130696f92 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Converting VIF {"id": "6f8325fb-aa09-4c06-a179-3433db4ce4ee", "address": "fa:16:3e:32:1b:3c", "network": {"id": "5881a45c-3f28-48c4-aa8e-045b3bea3227", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1651070715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a1951a52e7c4ef5ac6a0d9d5380d41a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f8325fb-aa", "ovs_interfaceid": "6f8325fb-aa09-4c06-a179-3433db4ce4ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 19:39:10 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-a25df7df-a5f6-4bab-8211-5ad130696f92 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:1b:3c,bridge_name='br-int',has_traffic_filtering=True,id=6f8325fb-aa09-4c06-a179-3433db4ce4ee,network=Network(5881a45c-3f28-48c4-aa8e-045b3bea3227),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f8325fb-aa') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 19:39:10 user nova-compute[75216]: DEBUG nova.objects.instance [None req-a25df7df-a5f6-4bab-8211-5ad130696f92 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Lazy-loading 'pci_devices' on Instance uuid 19059219-029e-40b3-a439-f9c152568ed0 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:39:10 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-a25df7df-a5f6-4bab-8211-5ad130696f92 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 19059219-029e-40b3-a439-f9c152568ed0] End _get_guest_xml xml=<domain type="kvm">
Nov 13 19:39:10 user nova-compute[75216]:   <uuid>19059219-029e-40b3-a439-f9c152568ed0</uuid>
Nov 13 19:39:10 user nova-compute[75216]:   <name>instance-00000033</name>
Nov 13 19:39:10 user nova-compute[75216]:   <memory>524288</memory>
Nov 13 19:39:10 user nova-compute[75216]:   <vcpu>1</vcpu>
Nov 13 19:39:10 user nova-compute[75216]:   <metadata>
Nov 13 19:39:10 user nova-compute[75216]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 19:39:10 user nova-compute[75216]:       <nova:package version="0.0.0"/>
Nov 13 19:39:10 user nova-compute[75216]:       <nova:name>tempest-TestVolumeBootPattern-server-79176008</nova:name>
Nov 13 19:39:10 user nova-compute[75216]:       <nova:creationTime>2023-11-13 19:39:09</nova:creationTime>
Nov 13 19:39:10 user nova-compute[75216]:       <nova:flavor name="m1.tiny">
Nov 13 19:39:10 user nova-compute[75216]:         <nova:memory>512</nova:memory>
Nov 13 19:39:10 user nova-compute[75216]:         <nova:disk>1</nova:disk>
Nov 13 19:39:10 user nova-compute[75216]:         <nova:swap>0</nova:swap>
Nov 13 19:39:10 user nova-compute[75216]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 19:39:10 user nova-compute[75216]:         <nova:vcpus>1</nova:vcpus>
Nov 13 19:39:10 user nova-compute[75216]:       </nova:flavor>
Nov 13 19:39:10 user nova-compute[75216]:       <nova:owner>
Nov 13 19:39:10 user nova-compute[75216]:         <nova:user uuid="bfc6b02c16664b8dbea3a6f2088ec385">tempest-TestVolumeBootPattern-1444343509-project-member</nova:user>
Nov 13 19:39:10 user nova-compute[75216]:         <nova:project uuid="3a1951a52e7c4ef5ac6a0d9d5380d41a">tempest-TestVolumeBootPattern-1444343509</nova:project>
Nov 13 19:39:10 user nova-compute[75216]:       </nova:owner>
Nov 13 19:39:10 user nova-compute[75216]:       <nova:ports>
Nov 13 19:39:10 user nova-compute[75216]:         <nova:port uuid="6f8325fb-aa09-4c06-a179-3433db4ce4ee">
Nov 13 19:39:10 user nova-compute[75216]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 13 19:39:10 user nova-compute[75216]:         </nova:port>
Nov 13 19:39:10 user nova-compute[75216]:       </nova:ports>
Nov 13 19:39:10 user nova-compute[75216]:     </nova:instance>
Nov 13 19:39:10 user nova-compute[75216]:   </metadata>
Nov 13 19:39:10 user nova-compute[75216]:   <sysinfo type="smbios">
Nov 13 19:39:10 user nova-compute[75216]:     <system>
Nov 13 19:39:10 user nova-compute[75216]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 19:39:10 user nova-compute[75216]:       <entry name="product">OpenStack Nova</entry>
Nov 13 19:39:10 user nova-compute[75216]:       <entry name="version">0.0.0</entry>
Nov 13 19:39:10 user nova-compute[75216]:       <entry name="serial">19059219-029e-40b3-a439-f9c152568ed0</entry>
Nov 13 19:39:10 user nova-compute[75216]:       <entry name="uuid">19059219-029e-40b3-a439-f9c152568ed0</entry>
Nov 13 19:39:10 user nova-compute[75216]:       <entry name="family">Virtual Machine</entry>
Nov 13 19:39:10 user nova-compute[75216]:     </system>
Nov 13 19:39:10 user nova-compute[75216]:   </sysinfo>
Nov 13 19:39:10 user nova-compute[75216]:   <os>
Nov 13 19:39:10 user nova-compute[75216]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 19:39:10 user nova-compute[75216]:     <boot dev="hd"/>
Nov 13 19:39:10 user nova-compute[75216]:     <smbios mode="sysinfo"/>
Nov 13 19:39:10 user nova-compute[75216]:   </os>
Nov 13 19:39:10 user nova-compute[75216]:   <features>
Nov 13 19:39:10 user nova-compute[75216]:     <acpi/>
Nov 13 19:39:10 user nova-compute[75216]:     <apic/>
Nov 13 19:39:10 user nova-compute[75216]:     <vmcoreinfo/>
Nov 13 19:39:10 user nova-compute[75216]:   </features>
Nov 13 19:39:10 user nova-compute[75216]:   <clock offset="utc">
Nov 13 19:39:10 user nova-compute[75216]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 19:39:10 user nova-compute[75216]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 19:39:10 user nova-compute[75216]:     <timer name="hpet" present="no"/>
Nov 13 19:39:10 user nova-compute[75216]:   </clock>
Nov 13 19:39:10 user nova-compute[75216]:   <cpu mode="custom" match="exact">
Nov 13 19:39:10 user nova-compute[75216]:     <model>Nehalem</model>
Nov 13 19:39:10 user nova-compute[75216]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 19:39:10 user nova-compute[75216]:   </cpu>
Nov 13 19:39:10 user nova-compute[75216]:   <devices>
Nov 13 19:39:10 user nova-compute[75216]:     <disk type="block" device="disk">
Nov 13 19:39:10 user nova-compute[75216]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 19:39:10 user nova-compute[75216]:       <source dev="/dev/sdc"/>
Nov 13 19:39:10 user nova-compute[75216]:       <target dev="vda" bus="virtio"/>
Nov 13 19:39:10 user nova-compute[75216]:       <serial>48dee582-3c2e-4e32-8d4d-3775ce38d32a</serial>
Nov 13 19:39:10 user nova-compute[75216]:     </disk>
Nov 13 19:39:10 user nova-compute[75216]:     <interface type="ethernet">
Nov 13 19:39:10 user nova-compute[75216]:       <mac address="fa:16:3e:32:1b:3c"/>
Nov 13 19:39:10 user nova-compute[75216]:       <model type="virtio"/>
Nov 13 19:39:10 user nova-compute[75216]:       <mtu size="1442"/>
Nov 13 19:39:10 user nova-compute[75216]:       <target dev="tap6f8325fb-aa"/>
Nov 13 19:39:10 user nova-compute[75216]:     </interface>
Nov 13 19:39:10 user nova-compute[75216]:     <serial type="pty">
Nov 13 19:39:10 user nova-compute[75216]:       <log file="/opt/stack/data/nova/instances/19059219-029e-40b3-a439-f9c152568ed0/console.log" append="off"/>
Nov 13 19:39:10 user nova-compute[75216]:     </serial>
Nov 13 19:39:10 user nova-compute[75216]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 19:39:10 user nova-compute[75216]:     <video>
Nov 13 19:39:10 user nova-compute[75216]:       <model type="virtio"/>
Nov 13 19:39:10 user nova-compute[75216]:     </video>
Nov 13 19:39:10 user nova-compute[75216]:     <rng model="virtio">
Nov 13 19:39:10 user nova-compute[75216]:       <backend model="random">/dev/urandom</backend>
Nov 13 19:39:10 user nova-compute[75216]:     </rng>
Nov 13 19:39:10 user nova-compute[75216]:     <controller type="usb" index="0" model="none"/>
Nov 13 19:39:10 user nova-compute[75216]:     <memballoon model="virtio">
Nov 13 19:39:10 user nova-compute[75216]:       <stats period="10"/>
Nov 13 19:39:10 user nova-compute[75216]:     </memballoon>
Nov 13 19:39:10 user nova-compute[75216]:   </devices>
Nov 13 19:39:10 user nova-compute[75216]: </domain>
Nov 13 19:39:10 user nova-compute[75216]:  {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 19:39:10 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-a25df7df-a5f6-4bab-8211-5ad130696f92 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T19:39:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-79176008',display_name='tempest-TestVolumeBootPattern-server-79176008',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-79176008',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJoiZwaxJA3L6zg1VlDIL2iywK8D207KUdpx1vJqr+ljXQkA4jTUHYbkCYqoa39qc34qT95KOeBJjIq8vzC1Og4pbsAomDAW7M51FJ+JGdR7hmjZWz1zbUNVDWRemA+lQw==',key_name='tempest-TestVolumeBootPattern-21317594',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3a1951a52e7c4ef5ac6a0d9d5380d41a',ramdisk_id='',reservation_id='r-5vfzb2v0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1444343509',owner_user_name='tempest-TestVolumeBootPattern-1444343509-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T19:39:05Z,user_data=None,user_id='bfc6b02c16664b8dbea3a6f2088ec385',uuid=19059219-029e-40b3-a439-f9c152568ed0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6f8325fb-aa09-4c06-a179-3433db4ce4ee", "address": "fa:16:3e:32:1b:3c", "network": {"id": "5881a45c-3f28-48c4-aa8e-045b3bea3227", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1651070715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a1951a52e7c4ef5ac6a0d9d5380d41a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f8325fb-aa", "ovs_interfaceid": "6f8325fb-aa09-4c06-a179-3433db4ce4ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 19:39:10 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-a25df7df-a5f6-4bab-8211-5ad130696f92 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Converting VIF {"id": "6f8325fb-aa09-4c06-a179-3433db4ce4ee", "address": "fa:16:3e:32:1b:3c", "network": {"id": "5881a45c-3f28-48c4-aa8e-045b3bea3227", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1651070715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a1951a52e7c4ef5ac6a0d9d5380d41a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f8325fb-aa", "ovs_interfaceid": "6f8325fb-aa09-4c06-a179-3433db4ce4ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 19:39:10 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-a25df7df-a5f6-4bab-8211-5ad130696f92 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:1b:3c,bridge_name='br-int',has_traffic_filtering=True,id=6f8325fb-aa09-4c06-a179-3433db4ce4ee,network=Network(5881a45c-3f28-48c4-aa8e-045b3bea3227),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f8325fb-aa') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 19:39:10 user nova-compute[75216]: DEBUG os_vif [None req-a25df7df-a5f6-4bab-8211-5ad130696f92 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:1b:3c,bridge_name='br-int',has_traffic_filtering=True,id=6f8325fb-aa09-4c06-a179-3433db4ce4ee,network=Network(5881a45c-3f28-48c4-aa8e-045b3bea3227),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f8325fb-aa') {{(pid=75216) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 19:39:10 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:39:10 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:39:10 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 19:39:10 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:39:10 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3d85d915-971e-532b-bb6e-1632388cdcd0', '_type': 'linux-noop'}}, row=False) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:39:10 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:39:10 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:39:10 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:39:10 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6f8325fb-aa, may_exist=True, interface_attrs={}) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:39:10 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6f8325fb-aa, col_values=(('qos', UUID('49119a4d-9c99-4f81-87f4-4bb8eb924ebc')),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:39:10 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6f8325fb-aa, col_values=(('external_ids', {'iface-id': '6f8325fb-aa09-4c06-a179-3433db4ce4ee', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:32:1b:3c', 'vm-uuid': '19059219-029e-40b3-a439-f9c152568ed0'}),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:39:10 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:39:11 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:39:11 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:39:11 user nova-compute[75216]: INFO os_vif [None req-a25df7df-a5f6-4bab-8211-5ad130696f92 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:1b:3c,bridge_name='br-int',has_traffic_filtering=True,id=6f8325fb-aa09-4c06-a179-3433db4ce4ee,network=Network(5881a45c-3f28-48c4-aa8e-045b3bea3227),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f8325fb-aa')
Nov 13 19:39:11 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-a25df7df-a5f6-4bab-8211-5ad130696f92 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 19:39:11 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-a25df7df-a5f6-4bab-8211-5ad130696f92 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] No VIF found with MAC fa:16:3e:32:1b:3c, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 19:39:12 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:39:12 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:39:12 user nova-compute[75216]: DEBUG nova.compute.manager [req-7a7793e6-f7a0-4d1d-a23b-10583c40b033 req-986257c5-dbd3-4c84-b609-52c00874310e service nova] [instance: 19059219-029e-40b3-a439-f9c152568ed0] Received event network-vif-plugged-6f8325fb-aa09-4c06-a179-3433db4ce4ee {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:39:12 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-7a7793e6-f7a0-4d1d-a23b-10583c40b033 req-986257c5-dbd3-4c84-b609-52c00874310e service nova] Acquiring lock "19059219-029e-40b3-a439-f9c152568ed0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:39:12 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-7a7793e6-f7a0-4d1d-a23b-10583c40b033 req-986257c5-dbd3-4c84-b609-52c00874310e service nova] Lock "19059219-029e-40b3-a439-f9c152568ed0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:39:12 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-7a7793e6-f7a0-4d1d-a23b-10583c40b033 req-986257c5-dbd3-4c84-b609-52c00874310e service nova] Lock "19059219-029e-40b3-a439-f9c152568ed0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:39:12 user nova-compute[75216]: DEBUG nova.compute.manager [req-7a7793e6-f7a0-4d1d-a23b-10583c40b033 req-986257c5-dbd3-4c84-b609-52c00874310e service nova] [instance: 19059219-029e-40b3-a439-f9c152568ed0] No waiting events found dispatching network-vif-plugged-6f8325fb-aa09-4c06-a179-3433db4ce4ee {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 19:39:12 user nova-compute[75216]: WARNING nova.compute.manager [req-7a7793e6-f7a0-4d1d-a23b-10583c40b033 req-986257c5-dbd3-4c84-b609-52c00874310e service nova] [instance: 19059219-029e-40b3-a439-f9c152568ed0] Received unexpected event network-vif-plugged-6f8325fb-aa09-4c06-a179-3433db4ce4ee for instance with vm_state building and task_state spawning.
Nov 13 19:39:12 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:39:12 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:39:14 user nova-compute[75216]: DEBUG nova.compute.manager [None req-a25df7df-a5f6-4bab-8211-5ad130696f92 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 19059219-029e-40b3-a439-f9c152568ed0] Instance event wait completed in 0 seconds for  {{(pid=75216) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 19:39:14 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-a25df7df-a5f6-4bab-8211-5ad130696f92 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 19059219-029e-40b3-a439-f9c152568ed0] Guest created on hypervisor {{(pid=75216) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 19:39:14 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 19059219-029e-40b3-a439-f9c152568ed0] Instance spawned successfully.
Nov 13 19:39:14 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-a25df7df-a5f6-4bab-8211-5ad130696f92 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 19059219-029e-40b3-a439-f9c152568ed0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 19:39:14 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-a25df7df-a5f6-4bab-8211-5ad130696f92 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 19059219-029e-40b3-a439-f9c152568ed0] Found default for hw_cdrom_bus of ide {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 19:39:14 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-a25df7df-a5f6-4bab-8211-5ad130696f92 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 19059219-029e-40b3-a439-f9c152568ed0] Found default for hw_disk_bus of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 19:39:14 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-a25df7df-a5f6-4bab-8211-5ad130696f92 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 19059219-029e-40b3-a439-f9c152568ed0] Found default for hw_input_bus of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 19:39:14 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-a25df7df-a5f6-4bab-8211-5ad130696f92 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 19059219-029e-40b3-a439-f9c152568ed0] Found default for hw_pointer_model of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 19:39:14 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-a25df7df-a5f6-4bab-8211-5ad130696f92 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 19059219-029e-40b3-a439-f9c152568ed0] Found default for hw_video_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 19:39:14 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-a25df7df-a5f6-4bab-8211-5ad130696f92 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 19059219-029e-40b3-a439-f9c152568ed0] Found default for hw_vif_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 19:39:14 user nova-compute[75216]: DEBUG nova.compute.manager [req-4784f642-5002-4c93-b48e-13d0715707af req-281cae5b-39a8-4755-83b0-265c34e65dc5 service nova] [instance: 19059219-029e-40b3-a439-f9c152568ed0] Received event network-vif-plugged-6f8325fb-aa09-4c06-a179-3433db4ce4ee {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:39:14 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-4784f642-5002-4c93-b48e-13d0715707af req-281cae5b-39a8-4755-83b0-265c34e65dc5 service nova] Acquiring lock "19059219-029e-40b3-a439-f9c152568ed0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:39:14 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-4784f642-5002-4c93-b48e-13d0715707af req-281cae5b-39a8-4755-83b0-265c34e65dc5 service nova] Lock "19059219-029e-40b3-a439-f9c152568ed0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:39:14 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-4784f642-5002-4c93-b48e-13d0715707af req-281cae5b-39a8-4755-83b0-265c34e65dc5 service nova] Lock "19059219-029e-40b3-a439-f9c152568ed0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:39:14 user nova-compute[75216]: DEBUG nova.compute.manager [req-4784f642-5002-4c93-b48e-13d0715707af req-281cae5b-39a8-4755-83b0-265c34e65dc5 service nova] [instance: 19059219-029e-40b3-a439-f9c152568ed0] No waiting events found dispatching network-vif-plugged-6f8325fb-aa09-4c06-a179-3433db4ce4ee {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 19:39:14 user nova-compute[75216]: WARNING nova.compute.manager [req-4784f642-5002-4c93-b48e-13d0715707af req-281cae5b-39a8-4755-83b0-265c34e65dc5 service nova] [instance: 19059219-029e-40b3-a439-f9c152568ed0] Received unexpected event network-vif-plugged-6f8325fb-aa09-4c06-a179-3433db4ce4ee for instance with vm_state building and task_state spawning.
Nov 13 19:39:14 user nova-compute[75216]: INFO nova.compute.manager [None req-a25df7df-a5f6-4bab-8211-5ad130696f92 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 19059219-029e-40b3-a439-f9c152568ed0] Took 4.97 seconds to spawn the instance on the hypervisor.
Nov 13 19:39:14 user nova-compute[75216]: DEBUG nova.compute.manager [None req-a25df7df-a5f6-4bab-8211-5ad130696f92 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 19059219-029e-40b3-a439-f9c152568ed0] Checking state {{(pid=75216) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 19:39:14 user nova-compute[75216]: INFO nova.compute.manager [None req-a25df7df-a5f6-4bab-8211-5ad130696f92 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 19059219-029e-40b3-a439-f9c152568ed0] Took 9.95 seconds to build instance.
Nov 13 19:39:14 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a25df7df-a5f6-4bab-8211-5ad130696f92 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Lock "19059219-029e-40b3-a439-f9c152568ed0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.039s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:39:14 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:39:15 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:39:17 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:39:19 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:39:21 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:39:23 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:39:26 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:39:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:39:30 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:39:31 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:39:33 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:39:33 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:39:33 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75216) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 19:39:34 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:39:35 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:39:36 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:39:36 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:39:36 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Starting heal instance info cache {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 19:39:36 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Rebuilding the list of instances to heal {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 13 19:39:36 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "refresh_cache-7e21edf8-2308-43f5-b9c9-17dabacfb0ec" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 19:39:36 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquired lock "refresh_cache-7e21edf8-2308-43f5-b9c9-17dabacfb0ec" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 19:39:36 user nova-compute[75216]: DEBUG nova.network.neutron [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: 7e21edf8-2308-43f5-b9c9-17dabacfb0ec] Forcefully refreshing network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 19:39:36 user nova-compute[75216]: DEBUG nova.objects.instance [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lazy-loading 'info_cache' on Instance uuid 7e21edf8-2308-43f5-b9c9-17dabacfb0ec {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:39:36 user nova-compute[75216]: DEBUG nova.network.neutron [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: 7e21edf8-2308-43f5-b9c9-17dabacfb0ec] Updating instance_info_cache with network_info: [{"id": "8d7855ef-7f8d-4f76-af3d-5e9c41759435", "address": "fa:16:3e:7f:73:bb", "network": {"id": "5881a45c-3f28-48c4-aa8e-045b3bea3227", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1651070715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a1951a52e7c4ef5ac6a0d9d5380d41a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d7855ef-7f", "ovs_interfaceid": "8d7855ef-7f8d-4f76-af3d-5e9c41759435", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:39:36 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Releasing lock "refresh_cache-7e21edf8-2308-43f5-b9c9-17dabacfb0ec" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 19:39:36 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: 7e21edf8-2308-43f5-b9c9-17dabacfb0ec] Updated the network info_cache for instance {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 19:39:38 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:39:38 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:39:38 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:39:38 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:39:38 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:39:38 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Auditing locally available compute resources for user (node: user) {{(pid=75216) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 19:39:38 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 19:39:38 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 19:39:38 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 19:39:38 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 19:39:38 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Hypervisor/Node resource view: name=user free_ram=8826MB free_disk=25.255680084228516GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75216) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 19:39:38 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:39:38 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:39:38 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance 7e21edf8-2308-43f5-b9c9-17dabacfb0ec actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 19:39:38 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance 19059219-029e-40b3-a439-f9c152568ed0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 19:39:38 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 19:39:38 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 19:39:39 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 19:39:39 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 19:39:39 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Compute_service record updated for user:user {{(pid=75216) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 19:39:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.265s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:39:39 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:39:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:39:44 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:39:46 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:39:51 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:39:54 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:39:56 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:39:57 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:40:01 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:40:01 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:40:01 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75216) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 19:40:01 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 19:40:01 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 19:40:01 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:40:06 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:40:11 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:40:16 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:40:16 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:40:16 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75216) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 19:40:16 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 19:40:16 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 19:40:16 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:40:19 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:40:21 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:40:25 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:40:26 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:40:26 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:40:26 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75216) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 19:40:26 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 19:40:26 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 19:40:26 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:40:31 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:40:32 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:40:34 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:40:34 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:40:34 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75216) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 19:40:36 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:40:36 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:40:36 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Starting heal instance info cache {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 19:40:36 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "refresh_cache-19059219-029e-40b3-a439-f9c152568ed0" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 19:40:36 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquired lock "refresh_cache-19059219-029e-40b3-a439-f9c152568ed0" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 19:40:36 user nova-compute[75216]: DEBUG nova.network.neutron [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: 19059219-029e-40b3-a439-f9c152568ed0] Forcefully refreshing network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 19:40:37 user nova-compute[75216]: DEBUG nova.network.neutron [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: 19059219-029e-40b3-a439-f9c152568ed0] Updating instance_info_cache with network_info: [{"id": "6f8325fb-aa09-4c06-a179-3433db4ce4ee", "address": "fa:16:3e:32:1b:3c", "network": {"id": "5881a45c-3f28-48c4-aa8e-045b3bea3227", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1651070715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a1951a52e7c4ef5ac6a0d9d5380d41a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f8325fb-aa", "ovs_interfaceid": "6f8325fb-aa09-4c06-a179-3433db4ce4ee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:40:37 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Releasing lock "refresh_cache-19059219-029e-40b3-a439-f9c152568ed0" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 19:40:37 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: 19059219-029e-40b3-a439-f9c152568ed0] Updated the network info_cache for instance {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 19:40:37 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_shelved_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:40:37 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:40:38 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:40:38 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:40:38 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:40:38 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:40:38 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Auditing locally available compute resources for user (node: user) {{(pid=75216) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 19:40:38 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 19:40:38 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 19:40:38 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 19:40:38 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 19:40:38 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Hypervisor/Node resource view: name=user free_ram=8930MB free_disk=25.255035400390625GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75216) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 19:40:38 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:40:38 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:40:38 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance 7e21edf8-2308-43f5-b9c9-17dabacfb0ec actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 19:40:38 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance 19059219-029e-40b3-a439-f9c152568ed0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 19:40:38 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 19:40:38 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 19:40:39 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 19:40:39 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 19:40:39 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Compute_service record updated for user:user {{(pid=75216) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 19:40:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.199s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:40:40 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:40:41 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:40:46 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:40:51 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:40:55 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:40:56 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:40:56 user nova-compute[75216]: DEBUG nova.compute.manager [req-c75754ad-c116-4cfb-b0e3-e6080858db86 req-833ee177-b03f-43c0-a77f-01ec0a5ce7c8 service nova] [instance: 19059219-029e-40b3-a439-f9c152568ed0] Received event network-changed-6f8325fb-aa09-4c06-a179-3433db4ce4ee {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:40:56 user nova-compute[75216]: DEBUG nova.compute.manager [req-c75754ad-c116-4cfb-b0e3-e6080858db86 req-833ee177-b03f-43c0-a77f-01ec0a5ce7c8 service nova] [instance: 19059219-029e-40b3-a439-f9c152568ed0] Refreshing instance network info cache due to event network-changed-6f8325fb-aa09-4c06-a179-3433db4ce4ee. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 19:40:56 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-c75754ad-c116-4cfb-b0e3-e6080858db86 req-833ee177-b03f-43c0-a77f-01ec0a5ce7c8 service nova] Acquiring lock "refresh_cache-19059219-029e-40b3-a439-f9c152568ed0" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 19:40:56 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-c75754ad-c116-4cfb-b0e3-e6080858db86 req-833ee177-b03f-43c0-a77f-01ec0a5ce7c8 service nova] Acquired lock "refresh_cache-19059219-029e-40b3-a439-f9c152568ed0" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 19:40:56 user nova-compute[75216]: DEBUG nova.network.neutron [req-c75754ad-c116-4cfb-b0e3-e6080858db86 req-833ee177-b03f-43c0-a77f-01ec0a5ce7c8 service nova] [instance: 19059219-029e-40b3-a439-f9c152568ed0] Refreshing network info cache for port 6f8325fb-aa09-4c06-a179-3433db4ce4ee {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 19:40:56 user nova-compute[75216]: DEBUG nova.network.neutron [req-c75754ad-c116-4cfb-b0e3-e6080858db86 req-833ee177-b03f-43c0-a77f-01ec0a5ce7c8 service nova] [instance: 19059219-029e-40b3-a439-f9c152568ed0] Updated VIF entry in instance network info cache for port 6f8325fb-aa09-4c06-a179-3433db4ce4ee. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 19:40:56 user nova-compute[75216]: DEBUG nova.network.neutron [req-c75754ad-c116-4cfb-b0e3-e6080858db86 req-833ee177-b03f-43c0-a77f-01ec0a5ce7c8 service nova] [instance: 19059219-029e-40b3-a439-f9c152568ed0] Updating instance_info_cache with network_info: [{"id": "6f8325fb-aa09-4c06-a179-3433db4ce4ee", "address": "fa:16:3e:32:1b:3c", "network": {"id": "5881a45c-3f28-48c4-aa8e-045b3bea3227", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1651070715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a1951a52e7c4ef5ac6a0d9d5380d41a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f8325fb-aa", "ovs_interfaceid": "6f8325fb-aa09-4c06-a179-3433db4ce4ee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:40:56 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-c75754ad-c116-4cfb-b0e3-e6080858db86 req-833ee177-b03f-43c0-a77f-01ec0a5ce7c8 service nova] Releasing lock "refresh_cache-19059219-029e-40b3-a439-f9c152568ed0" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 19:40:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a43af688-fe44-445a-99f3-4bd51263a720 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Acquiring lock "19059219-029e-40b3-a439-f9c152568ed0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:40:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a43af688-fe44-445a-99f3-4bd51263a720 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Lock "19059219-029e-40b3-a439-f9c152568ed0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:40:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a43af688-fe44-445a-99f3-4bd51263a720 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Acquiring lock "19059219-029e-40b3-a439-f9c152568ed0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:40:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a43af688-fe44-445a-99f3-4bd51263a720 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Lock "19059219-029e-40b3-a439-f9c152568ed0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:40:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a43af688-fe44-445a-99f3-4bd51263a720 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Lock "19059219-029e-40b3-a439-f9c152568ed0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:40:58 user nova-compute[75216]: INFO nova.compute.manager [None req-a43af688-fe44-445a-99f3-4bd51263a720 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 19059219-029e-40b3-a439-f9c152568ed0] Terminating instance
Nov 13 19:40:58 user nova-compute[75216]: DEBUG nova.compute.manager [None req-a43af688-fe44-445a-99f3-4bd51263a720 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 19059219-029e-40b3-a439-f9c152568ed0] Start destroying the instance on the hypervisor. {{(pid=75216) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 19:40:58 user nova-compute[75216]: DEBUG nova.compute.manager [req-dddd62e7-db86-4acf-8124-915b2746663e req-8939ddb6-7394-4937-bddf-130545218baf service nova] [instance: 19059219-029e-40b3-a439-f9c152568ed0] Received event network-changed-6f8325fb-aa09-4c06-a179-3433db4ce4ee {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:40:58 user nova-compute[75216]: DEBUG nova.compute.manager [req-dddd62e7-db86-4acf-8124-915b2746663e req-8939ddb6-7394-4937-bddf-130545218baf service nova] [instance: 19059219-029e-40b3-a439-f9c152568ed0] Refreshing instance network info cache due to event network-changed-6f8325fb-aa09-4c06-a179-3433db4ce4ee. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 19:40:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-dddd62e7-db86-4acf-8124-915b2746663e req-8939ddb6-7394-4937-bddf-130545218baf service nova] Acquiring lock "refresh_cache-19059219-029e-40b3-a439-f9c152568ed0" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 19:40:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-dddd62e7-db86-4acf-8124-915b2746663e req-8939ddb6-7394-4937-bddf-130545218baf service nova] Acquired lock "refresh_cache-19059219-029e-40b3-a439-f9c152568ed0" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 19:40:58 user nova-compute[75216]: DEBUG nova.network.neutron [req-dddd62e7-db86-4acf-8124-915b2746663e req-8939ddb6-7394-4937-bddf-130545218baf service nova] [instance: 19059219-029e-40b3-a439-f9c152568ed0] Refreshing network info cache for port 6f8325fb-aa09-4c06-a179-3433db4ce4ee {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 19:40:58 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:40:58 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:40:58 user nova-compute[75216]: DEBUG nova.compute.manager [req-bd792904-0028-430f-9d1b-9a9d0e61aab8 req-861ea8f4-45a6-47be-b702-744da7635c69 service nova] [instance: 19059219-029e-40b3-a439-f9c152568ed0] Received event network-vif-unplugged-6f8325fb-aa09-4c06-a179-3433db4ce4ee {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:40:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-bd792904-0028-430f-9d1b-9a9d0e61aab8 req-861ea8f4-45a6-47be-b702-744da7635c69 service nova] Acquiring lock "19059219-029e-40b3-a439-f9c152568ed0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:40:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-bd792904-0028-430f-9d1b-9a9d0e61aab8 req-861ea8f4-45a6-47be-b702-744da7635c69 service nova] Lock "19059219-029e-40b3-a439-f9c152568ed0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:40:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-bd792904-0028-430f-9d1b-9a9d0e61aab8 req-861ea8f4-45a6-47be-b702-744da7635c69 service nova] Lock "19059219-029e-40b3-a439-f9c152568ed0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:40:58 user nova-compute[75216]: DEBUG nova.compute.manager [req-bd792904-0028-430f-9d1b-9a9d0e61aab8 req-861ea8f4-45a6-47be-b702-744da7635c69 service nova] [instance: 19059219-029e-40b3-a439-f9c152568ed0] No waiting events found dispatching network-vif-unplugged-6f8325fb-aa09-4c06-a179-3433db4ce4ee {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 19:40:58 user nova-compute[75216]: DEBUG nova.compute.manager [req-bd792904-0028-430f-9d1b-9a9d0e61aab8 req-861ea8f4-45a6-47be-b702-744da7635c69 service nova] [instance: 19059219-029e-40b3-a439-f9c152568ed0] Received event network-vif-unplugged-6f8325fb-aa09-4c06-a179-3433db4ce4ee for instance with task_state deleting. {{(pid=75216) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 19:40:58 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:40:58 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:40:58 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:40:58 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 19059219-029e-40b3-a439-f9c152568ed0] Instance destroyed successfully.
Nov 13 19:40:58 user nova-compute[75216]: DEBUG nova.objects.instance [None req-a43af688-fe44-445a-99f3-4bd51263a720 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Lazy-loading 'resources' on Instance uuid 19059219-029e-40b3-a439-f9c152568ed0 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:40:58 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:40:59 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-a43af688-fe44-445a-99f3-4bd51263a720 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T19:39:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-79176008',display_name='tempest-TestVolumeBootPattern-server-79176008',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-79176008',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJoiZwaxJA3L6zg1VlDIL2iywK8D207KUdpx1vJqr+ljXQkA4jTUHYbkCYqoa39qc34qT95KOeBJjIq8vzC1Og4pbsAomDAW7M51FJ+JGdR7hmjZWz1zbUNVDWRemA+lQw==',key_name='tempest-TestVolumeBootPattern-21317594',keypairs=<?>,launch_index=0,launched_at=2023-11-13T19:39:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3a1951a52e7c4ef5ac6a0d9d5380d41a',ramdisk_id='',reservation_id='r-5vfzb2v0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1444343509',owner_user_name='tempest-TestVolumeBootPattern-1444343509-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T19:39:15Z,user_data=None,user_id='bfc6b02c16664b8dbea3a6f2088ec385',uuid=19059219-029e-40b3-a439-f9c152568ed0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6f8325fb-aa09-4c06-a179-3433db4ce4ee", "address": "fa:16:3e:32:1b:3c", "network": {"id": "5881a45c-3f28-48c4-aa8e-045b3bea3227", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1651070715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a1951a52e7c4ef5ac6a0d9d5380d41a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f8325fb-aa", "ovs_interfaceid": "6f8325fb-aa09-4c06-a179-3433db4ce4ee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 19:40:59 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-a43af688-fe44-445a-99f3-4bd51263a720 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Converting VIF {"id": "6f8325fb-aa09-4c06-a179-3433db4ce4ee", "address": "fa:16:3e:32:1b:3c", "network": {"id": "5881a45c-3f28-48c4-aa8e-045b3bea3227", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1651070715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a1951a52e7c4ef5ac6a0d9d5380d41a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f8325fb-aa", "ovs_interfaceid": "6f8325fb-aa09-4c06-a179-3433db4ce4ee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 19:40:59 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-a43af688-fe44-445a-99f3-4bd51263a720 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:32:1b:3c,bridge_name='br-int',has_traffic_filtering=True,id=6f8325fb-aa09-4c06-a179-3433db4ce4ee,network=Network(5881a45c-3f28-48c4-aa8e-045b3bea3227),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f8325fb-aa') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 19:40:59 user nova-compute[75216]: DEBUG os_vif [None req-a43af688-fe44-445a-99f3-4bd51263a720 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:32:1b:3c,bridge_name='br-int',has_traffic_filtering=True,id=6f8325fb-aa09-4c06-a179-3433db4ce4ee,network=Network(5881a45c-3f28-48c4-aa8e-045b3bea3227),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f8325fb-aa') {{(pid=75216) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 19:40:59 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:40:59 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6f8325fb-aa, bridge=br-int, if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:40:59 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:40:59 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:40:59 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:40:59 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=49119a4d-9c99-4f81-87f4-4bb8eb924ebc) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:40:59 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:40:59 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:40:59 user nova-compute[75216]: INFO os_vif [None req-a43af688-fe44-445a-99f3-4bd51263a720 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:32:1b:3c,bridge_name='br-int',has_traffic_filtering=True,id=6f8325fb-aa09-4c06-a179-3433db4ce4ee,network=Network(5881a45c-3f28-48c4-aa8e-045b3bea3227),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f8325fb-aa')
Nov 13 19:40:59 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a43af688-fe44-445a-99f3-4bd51263a720 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 19059219-029e-40b3-a439-f9c152568ed0] calling os-brick to detach iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 19:40:59 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a43af688-fe44-445a-99f3-4bd51263a720 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3a8669e40>, {'target_iqn': 'iqn.2010-10.org.openstack:48dee582-3c2e-4e32-8d4d-3775ce38d32a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mslTOqWy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 19:40:59 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-a43af688-fe44-445a-99f3-4bd51263a720 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 19:40:59 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-a43af688-fe44-445a-99f3-4bd51263a720 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 19:40:59 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-a43af688-fe44-445a-99f3-4bd51263a720 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 19:40:59 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:40:59 user nova-compute[75216]: DEBUG nova.network.neutron [req-dddd62e7-db86-4acf-8124-915b2746663e req-8939ddb6-7394-4937-bddf-130545218baf service nova] [instance: 19059219-029e-40b3-a439-f9c152568ed0] Updated VIF entry in instance network info cache for port 6f8325fb-aa09-4c06-a179-3433db4ce4ee. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 19:40:59 user nova-compute[75216]: DEBUG nova.network.neutron [req-dddd62e7-db86-4acf-8124-915b2746663e req-8939ddb6-7394-4937-bddf-130545218baf service nova] [instance: 19059219-029e-40b3-a439-f9c152568ed0] Updating instance_info_cache with network_info: [{"id": "6f8325fb-aa09-4c06-a179-3433db4ce4ee", "address": "fa:16:3e:32:1b:3c", "network": {"id": "5881a45c-3f28-48c4-aa8e-045b3bea3227", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1651070715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a1951a52e7c4ef5ac6a0d9d5380d41a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f8325fb-aa", "ovs_interfaceid": "6f8325fb-aa09-4c06-a179-3433db4ce4ee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:40:59 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:40:59 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a09f38f-266f-4793-968f-8286c91a91cb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:dac4ffc7-c907-49c6-81da-c8700d141c1e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:48dee582-3c2e-4e32-8d4d-3775ce38d32a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:40:59 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a43af688-fe44-445a-99f3-4bd51263a720 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 19:40:59 user nova-compute[75216]: No targets found.
Nov 13 19:40:59 user nova-compute[75216]: iSNS:
Nov 13 19:40:59 user nova-compute[75216]: No targets found.
Nov 13 19:40:59 user nova-compute[75216]: STATIC:
Nov 13 19:40:59 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:dac4ffc7-c907-49c6-81da-c8700d141c1e
Nov 13 19:40:59 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 19:40:59 user nova-compute[75216]:                 Iface Name: default
Nov 13 19:40:59 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:48dee582-3c2e-4e32-8d4d-3775ce38d32a
Nov 13 19:40:59 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 19:40:59 user nova-compute[75216]:                 Iface Name: default
Nov 13 19:40:59 user nova-compute[75216]: FIRMWARE:
Nov 13 19:40:59 user nova-compute[75216]: No targets found.
Nov 13 19:40:59 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 19:40:59 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a43af688-fe44-445a-99f3-4bd51263a720 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 19:40:59 user nova-compute[75216]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 19:40:59 user nova-compute[75216]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75216) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 19:40:59 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a43af688-fe44-445a-99f3-4bd51263a720 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:48dee582-3c2e-4e32-8d4d-3775ce38d32a', 0)] {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 19:40:59 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:40:59 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-dddd62e7-db86-4acf-8124-915b2746663e req-8939ddb6-7394-4937-bddf-130545218baf service nova] Releasing lock "refresh_cache-19059219-029e-40b3-a439-f9c152568ed0" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 19:40:59 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:40:59 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d16dacc-05bd-4b92-9cd9-96674d8571f3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:48dee582-3c2e-4e32-8d4d-3775ce38d32a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dac4ffc7-c907-49c6-81da-c8700d141c1e\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:40:59 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:40:59 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:40:59 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[d46386fe-db1a-4b80-a43e-946a126eea73]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dac4ffc7-c907-49c6-81da-c8700d141c1e (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48dee582-3c2e-4e32-8d4d-3775ce38d32a (non-flash)\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:40:59 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a43af688-fe44-445a-99f3-4bd51263a720 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dac4ffc7-c907-49c6-81da-c8700d141c1e (non-flash)
Nov 13 19:40:59 user nova-compute[75216]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48dee582-3c2e-4e32-8d4d-3775ce38d32a (non-flash)
Nov 13 19:40:59 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 19:40:59 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a43af688-fe44-445a-99f3-4bd51263a720 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dac4ffc7-c907-49c6-81da-c8700d141c1e (non-flash)
Nov 13 19:40:59 user nova-compute[75216]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48dee582-3c2e-4e32-8d4d-3775ce38d32a (non-flash)
Nov 13 19:40:59 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 19:40:59 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a43af688-fe44-445a-99f3-4bd51263a720 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe3c029a200>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:48dee582-3c2e-4e32-8d4d-3775ce38d32a'): ({'sdc'}, set())}) {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 19:40:59 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-a43af688-fe44-445a-99f3-4bd51263a720 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Removing single pathed devices sdc {{(pid=75216) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 19:40:59 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:40:59 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:40:59 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[854a84d5-4768-478c-a4c6-c565549fef91]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:40:59 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:40:59 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:40:59 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[0efc286b-ec8f-4c86-ae0f-8957c3e6b871]: (4, ('ok\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:40:59 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-a43af688-fe44-445a-99f3-4bd51263a720 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Flushing IO for device /dev/sdc {{(pid=75216) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 19:40:59 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:40:59 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:40:59 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[999d114f-6012-4e75-b11d-79c7d39df350]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:40:59 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-a43af688-fe44-445a-99f3-4bd51263a720 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75216) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 19:40:59 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:40:59 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:40:59 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.050s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:40:59 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[c960527f-9d6d-4d19-9efb-e4c4043271d7]: (4, ('1', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:40:59 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-a43af688-fe44-445a-99f3-4bd51263a720 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 19:40:59 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-a43af688-fe44-445a-99f3-4bd51263a720 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] SCSI volumes sdc have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 19:40:59 user nova-compute[75216]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_9c41e377', '/dev/disk/by-id/scsi-26133643366613864', '/dev/disk/by-id/scsi-1SCST_BIO9c41e377-a3d3fa8dabac8e3f') {{(pid=85984) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 13 19:40:59 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[caf4034d-1d71-42d1-b25e-7d4cca8d7ba9]: (4, None) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:40:59 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a43af688-fe44-445a-99f3-4bd51263a720 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:48dee582-3c2e-4e32-8d4d-3775ce38d32a')] {{(pid=75216) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 19:40:59 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48dee582-3c2e-4e32-8d4d-3775ce38d32a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:40:59 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48dee582-3c2e-4e32-8d4d-3775ce38d32a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:40:59 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4870151-aa7e-4b27-8427-4d4187e0faad]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:40:59 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a43af688-fe44-445a-99f3-4bd51263a720 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:40:59 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48dee582-3c2e-4e32-8d4d-3775ce38d32a -p 172.16.0.220:3260 --logout {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:40:59 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48dee582-3c2e-4e32-8d4d-3775ce38d32a -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:40:59 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[189c5495-004d-41b2-9faf-f311a23cde75]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:48dee582-3c2e-4e32-8d4d-3775ce38d32a, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:48dee582-3c2e-4e32-8d4d-3775ce38d32a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:40:59 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a43af688-fe44-445a-99f3-4bd51263a720 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:48dee582-3c2e-4e32-8d4d-3775ce38d32a, portal: 172.16.0.220,3260]
Nov 13 19:40:59 user nova-compute[75216]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:48dee582-3c2e-4e32-8d4d-3775ce38d32a, portal: 172.16.0.220,3260] successful.
Nov 13 19:40:59 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:40:59 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48dee582-3c2e-4e32-8d4d-3775ce38d32a -p 172.16.0.220:3260 --op delete {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:40:59 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48dee582-3c2e-4e32-8d4d-3775ce38d32a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:40:59 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[d93c289e-9577-4837-8f22-df4a9efc7b0b]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:40:59 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a43af688-fe44-445a-99f3-4bd51263a720 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:40:59 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-a43af688-fe44-445a-99f3-4bd51263a720 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.340s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 19:40:59 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a43af688-fe44-445a-99f3-4bd51263a720 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] <== disconnect_volume: return (341ms) None {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 19:40:59 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a43af688-fe44-445a-99f3-4bd51263a720 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 19059219-029e-40b3-a439-f9c152568ed0] Disconnected iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 19:40:59 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-a43af688-fe44-445a-99f3-4bd51263a720 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 19059219-029e-40b3-a439-f9c152568ed0] Deleting instance files /opt/stack/data/nova/instances/19059219-029e-40b3-a439-f9c152568ed0_del
Nov 13 19:40:59 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-a43af688-fe44-445a-99f3-4bd51263a720 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 19059219-029e-40b3-a439-f9c152568ed0] Deletion of /opt/stack/data/nova/instances/19059219-029e-40b3-a439-f9c152568ed0_del complete
Nov 13 19:40:59 user nova-compute[75216]: INFO nova.compute.manager [None req-a43af688-fe44-445a-99f3-4bd51263a720 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 19059219-029e-40b3-a439-f9c152568ed0] Took 1.24 seconds to destroy the instance on the hypervisor.
Nov 13 19:40:59 user nova-compute[75216]: DEBUG oslo.service.loopingcall [None req-a43af688-fe44-445a-99f3-4bd51263a720 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75216) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 19:40:59 user nova-compute[75216]: DEBUG nova.compute.manager [-] [instance: 19059219-029e-40b3-a439-f9c152568ed0] Deallocating network for instance {{(pid=75216) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 19:40:59 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: 19059219-029e-40b3-a439-f9c152568ed0] deallocate_for_instance() {{(pid=75216) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 19:40:59 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:40:59 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:40:59 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:40:59 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: 19059219-029e-40b3-a439-f9c152568ed0] Updating instance_info_cache with network_info: [] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:40:59 user nova-compute[75216]: INFO nova.compute.manager [-] [instance: 19059219-029e-40b3-a439-f9c152568ed0] Took 0.44 seconds to deallocate network for instance.
Nov 13 19:41:00 user nova-compute[75216]: DEBUG nova.compute.manager [req-175c907b-e3fb-4914-9fbd-73ca71f1230a req-de67fc2a-51a6-437c-be2f-b594dc5ab2e4 service nova] [instance: 19059219-029e-40b3-a439-f9c152568ed0] Received event network-vif-deleted-6f8325fb-aa09-4c06-a179-3433db4ce4ee {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:41:00 user nova-compute[75216]: DEBUG nova.compute.manager [req-508ba868-6318-4840-bb18-f5b2f4d1b14b req-0ea067e2-e86d-40d5-be0b-687413b9e826 service nova] [instance: 19059219-029e-40b3-a439-f9c152568ed0] Received event network-vif-plugged-6f8325fb-aa09-4c06-a179-3433db4ce4ee {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:41:00 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-508ba868-6318-4840-bb18-f5b2f4d1b14b req-0ea067e2-e86d-40d5-be0b-687413b9e826 service nova] Acquiring lock "19059219-029e-40b3-a439-f9c152568ed0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:41:00 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-508ba868-6318-4840-bb18-f5b2f4d1b14b req-0ea067e2-e86d-40d5-be0b-687413b9e826 service nova] Lock "19059219-029e-40b3-a439-f9c152568ed0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:41:00 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-508ba868-6318-4840-bb18-f5b2f4d1b14b req-0ea067e2-e86d-40d5-be0b-687413b9e826 service nova] Lock "19059219-029e-40b3-a439-f9c152568ed0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:41:00 user nova-compute[75216]: DEBUG nova.compute.manager [req-508ba868-6318-4840-bb18-f5b2f4d1b14b req-0ea067e2-e86d-40d5-be0b-687413b9e826 service nova] [instance: 19059219-029e-40b3-a439-f9c152568ed0] No waiting events found dispatching network-vif-plugged-6f8325fb-aa09-4c06-a179-3433db4ce4ee {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 19:41:00 user nova-compute[75216]: WARNING nova.compute.manager [req-508ba868-6318-4840-bb18-f5b2f4d1b14b req-0ea067e2-e86d-40d5-be0b-687413b9e826 service nova] [instance: 19059219-029e-40b3-a439-f9c152568ed0] Received unexpected event network-vif-plugged-6f8325fb-aa09-4c06-a179-3433db4ce4ee for instance with vm_state active and task_state deleting.
Nov 13 19:41:00 user nova-compute[75216]: DEBUG nova.compute.manager [req-508ba868-6318-4840-bb18-f5b2f4d1b14b req-0ea067e2-e86d-40d5-be0b-687413b9e826 service nova] [instance: 19059219-029e-40b3-a439-f9c152568ed0] Received event network-vif-plugged-6f8325fb-aa09-4c06-a179-3433db4ce4ee {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:41:00 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-508ba868-6318-4840-bb18-f5b2f4d1b14b req-0ea067e2-e86d-40d5-be0b-687413b9e826 service nova] Acquiring lock "19059219-029e-40b3-a439-f9c152568ed0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:41:00 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-508ba868-6318-4840-bb18-f5b2f4d1b14b req-0ea067e2-e86d-40d5-be0b-687413b9e826 service nova] Lock "19059219-029e-40b3-a439-f9c152568ed0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:41:00 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-508ba868-6318-4840-bb18-f5b2f4d1b14b req-0ea067e2-e86d-40d5-be0b-687413b9e826 service nova] Lock "19059219-029e-40b3-a439-f9c152568ed0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:41:00 user nova-compute[75216]: DEBUG nova.compute.manager [req-508ba868-6318-4840-bb18-f5b2f4d1b14b req-0ea067e2-e86d-40d5-be0b-687413b9e826 service nova] [instance: 19059219-029e-40b3-a439-f9c152568ed0] No waiting events found dispatching network-vif-plugged-6f8325fb-aa09-4c06-a179-3433db4ce4ee {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 19:41:00 user nova-compute[75216]: WARNING nova.compute.manager [req-508ba868-6318-4840-bb18-f5b2f4d1b14b req-0ea067e2-e86d-40d5-be0b-687413b9e826 service nova] [instance: 19059219-029e-40b3-a439-f9c152568ed0] Received unexpected event network-vif-plugged-6f8325fb-aa09-4c06-a179-3433db4ce4ee for instance with vm_state active and task_state deleting.
Nov 13 19:41:00 user nova-compute[75216]: DEBUG nova.compute.manager [req-508ba868-6318-4840-bb18-f5b2f4d1b14b req-0ea067e2-e86d-40d5-be0b-687413b9e826 service nova] [instance: 19059219-029e-40b3-a439-f9c152568ed0] Received event network-vif-plugged-6f8325fb-aa09-4c06-a179-3433db4ce4ee {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:41:00 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-508ba868-6318-4840-bb18-f5b2f4d1b14b req-0ea067e2-e86d-40d5-be0b-687413b9e826 service nova] Acquiring lock "19059219-029e-40b3-a439-f9c152568ed0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:41:00 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-508ba868-6318-4840-bb18-f5b2f4d1b14b req-0ea067e2-e86d-40d5-be0b-687413b9e826 service nova] Lock "19059219-029e-40b3-a439-f9c152568ed0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:41:00 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-508ba868-6318-4840-bb18-f5b2f4d1b14b req-0ea067e2-e86d-40d5-be0b-687413b9e826 service nova] Lock "19059219-029e-40b3-a439-f9c152568ed0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:41:00 user nova-compute[75216]: DEBUG nova.compute.manager [req-508ba868-6318-4840-bb18-f5b2f4d1b14b req-0ea067e2-e86d-40d5-be0b-687413b9e826 service nova] [instance: 19059219-029e-40b3-a439-f9c152568ed0] No waiting events found dispatching network-vif-plugged-6f8325fb-aa09-4c06-a179-3433db4ce4ee {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 19:41:00 user nova-compute[75216]: WARNING nova.compute.manager [req-508ba868-6318-4840-bb18-f5b2f4d1b14b req-0ea067e2-e86d-40d5-be0b-687413b9e826 service nova] [instance: 19059219-029e-40b3-a439-f9c152568ed0] Received unexpected event network-vif-plugged-6f8325fb-aa09-4c06-a179-3433db4ce4ee for instance with vm_state active and task_state deleting.
Nov 13 19:41:00 user nova-compute[75216]: DEBUG nova.compute.manager [req-508ba868-6318-4840-bb18-f5b2f4d1b14b req-0ea067e2-e86d-40d5-be0b-687413b9e826 service nova] [instance: 19059219-029e-40b3-a439-f9c152568ed0] Received event network-vif-unplugged-6f8325fb-aa09-4c06-a179-3433db4ce4ee {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:41:00 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-508ba868-6318-4840-bb18-f5b2f4d1b14b req-0ea067e2-e86d-40d5-be0b-687413b9e826 service nova] Acquiring lock "19059219-029e-40b3-a439-f9c152568ed0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:41:00 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-508ba868-6318-4840-bb18-f5b2f4d1b14b req-0ea067e2-e86d-40d5-be0b-687413b9e826 service nova] Lock "19059219-029e-40b3-a439-f9c152568ed0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:41:00 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-508ba868-6318-4840-bb18-f5b2f4d1b14b req-0ea067e2-e86d-40d5-be0b-687413b9e826 service nova] Lock "19059219-029e-40b3-a439-f9c152568ed0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:41:00 user nova-compute[75216]: DEBUG nova.compute.manager [req-508ba868-6318-4840-bb18-f5b2f4d1b14b req-0ea067e2-e86d-40d5-be0b-687413b9e826 service nova] [instance: 19059219-029e-40b3-a439-f9c152568ed0] No waiting events found dispatching network-vif-unplugged-6f8325fb-aa09-4c06-a179-3433db4ce4ee {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 19:41:00 user nova-compute[75216]: DEBUG nova.compute.manager [req-508ba868-6318-4840-bb18-f5b2f4d1b14b req-0ea067e2-e86d-40d5-be0b-687413b9e826 service nova] [instance: 19059219-029e-40b3-a439-f9c152568ed0] Received event network-vif-unplugged-6f8325fb-aa09-4c06-a179-3433db4ce4ee for instance with task_state deleting. {{(pid=75216) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 19:41:00 user nova-compute[75216]: DEBUG nova.compute.manager [req-508ba868-6318-4840-bb18-f5b2f4d1b14b req-0ea067e2-e86d-40d5-be0b-687413b9e826 service nova] [instance: 19059219-029e-40b3-a439-f9c152568ed0] Received event network-vif-plugged-6f8325fb-aa09-4c06-a179-3433db4ce4ee {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:41:00 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-508ba868-6318-4840-bb18-f5b2f4d1b14b req-0ea067e2-e86d-40d5-be0b-687413b9e826 service nova] Acquiring lock "19059219-029e-40b3-a439-f9c152568ed0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:41:00 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-508ba868-6318-4840-bb18-f5b2f4d1b14b req-0ea067e2-e86d-40d5-be0b-687413b9e826 service nova] Lock "19059219-029e-40b3-a439-f9c152568ed0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:41:00 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-508ba868-6318-4840-bb18-f5b2f4d1b14b req-0ea067e2-e86d-40d5-be0b-687413b9e826 service nova] Lock "19059219-029e-40b3-a439-f9c152568ed0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:41:00 user nova-compute[75216]: DEBUG nova.compute.manager [req-508ba868-6318-4840-bb18-f5b2f4d1b14b req-0ea067e2-e86d-40d5-be0b-687413b9e826 service nova] [instance: 19059219-029e-40b3-a439-f9c152568ed0] No waiting events found dispatching network-vif-plugged-6f8325fb-aa09-4c06-a179-3433db4ce4ee {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 19:41:00 user nova-compute[75216]: WARNING nova.compute.manager [req-508ba868-6318-4840-bb18-f5b2f4d1b14b req-0ea067e2-e86d-40d5-be0b-687413b9e826 service nova] [instance: 19059219-029e-40b3-a439-f9c152568ed0] Received unexpected event network-vif-plugged-6f8325fb-aa09-4c06-a179-3433db4ce4ee for instance with vm_state active and task_state deleting.
Nov 13 19:41:00 user nova-compute[75216]: INFO nova.compute.manager [None req-a43af688-fe44-445a-99f3-4bd51263a720 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 19059219-029e-40b3-a439-f9c152568ed0] Took 0.75 seconds to detach 1 volumes for instance.
Nov 13 19:41:00 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a43af688-fe44-445a-99f3-4bd51263a720 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:41:00 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a43af688-fe44-445a-99f3-4bd51263a720 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:41:00 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-a43af688-fe44-445a-99f3-4bd51263a720 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 19:41:00 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-a43af688-fe44-445a-99f3-4bd51263a720 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 19:41:00 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a43af688-fe44-445a-99f3-4bd51263a720 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.136s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:41:00 user nova-compute[75216]: INFO nova.scheduler.client.report [None req-a43af688-fe44-445a-99f3-4bd51263a720 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Deleted allocations for instance 19059219-029e-40b3-a439-f9c152568ed0
Nov 13 19:41:00 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a43af688-fe44-445a-99f3-4bd51263a720 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Lock "19059219-029e-40b3-a439-f9c152568ed0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.754s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:41:04 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:41:09 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:41:14 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:41:19 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:41:21 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:41:24 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:41:25 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:41:28 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:41:28 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Triggering sync for uuid 7e21edf8-2308-43f5-b9c9-17dabacfb0ec {{(pid=75216) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 13 19:41:28 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "7e21edf8-2308-43f5-b9c9-17dabacfb0ec" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:41:28 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "7e21edf8-2308-43f5-b9c9-17dabacfb0ec" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:41:28 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "7e21edf8-2308-43f5-b9c9-17dabacfb0ec" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.026s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:41:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:41:34 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:41:34 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:41:34 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75216) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 19:41:34 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 19:41:34 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 19:41:34 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:41:34 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:41:34 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:41:34 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:41:34 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75216) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 19:41:37 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:41:37 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Starting heal instance info cache {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 19:41:37 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Rebuilding the list of instances to heal {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 13 19:41:37 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "refresh_cache-7e21edf8-2308-43f5-b9c9-17dabacfb0ec" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 19:41:37 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquired lock "refresh_cache-7e21edf8-2308-43f5-b9c9-17dabacfb0ec" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 19:41:37 user nova-compute[75216]: DEBUG nova.network.neutron [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: 7e21edf8-2308-43f5-b9c9-17dabacfb0ec] Forcefully refreshing network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 19:41:37 user nova-compute[75216]: DEBUG nova.objects.instance [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lazy-loading 'info_cache' on Instance uuid 7e21edf8-2308-43f5-b9c9-17dabacfb0ec {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:41:37 user nova-compute[75216]: DEBUG nova.network.neutron [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: 7e21edf8-2308-43f5-b9c9-17dabacfb0ec] Updating instance_info_cache with network_info: [{"id": "8d7855ef-7f8d-4f76-af3d-5e9c41759435", "address": "fa:16:3e:7f:73:bb", "network": {"id": "5881a45c-3f28-48c4-aa8e-045b3bea3227", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1651070715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a1951a52e7c4ef5ac6a0d9d5380d41a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d7855ef-7f", "ovs_interfaceid": "8d7855ef-7f8d-4f76-af3d-5e9c41759435", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:41:37 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Releasing lock "refresh_cache-7e21edf8-2308-43f5-b9c9-17dabacfb0ec" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 19:41:37 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: 7e21edf8-2308-43f5-b9c9-17dabacfb0ec] Updated the network info_cache for instance {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 19:41:37 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:41:38 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:41:39 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:41:39 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:41:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:41:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:41:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:41:39 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Auditing locally available compute resources for user (node: user) {{(pid=75216) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 19:41:39 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 19:41:39 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 19:41:39 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 19:41:39 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Hypervisor/Node resource view: name=user free_ram=9007MB free_disk=25.254070281982422GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75216) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 19:41:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:41:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:41:40 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance 7e21edf8-2308-43f5-b9c9-17dabacfb0ec actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 19:41:40 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 19:41:40 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 19:41:40 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Refreshing inventories for resource provider d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 13 19:41:40 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Updating ProviderTree inventory for provider d927e00d-5a8b-43f7-ac04-6437958fac1f from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 13 19:41:40 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Updating inventory in ProviderTree for provider d927e00d-5a8b-43f7-ac04-6437958fac1f with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 13 19:41:40 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Refreshing aggregate associations for resource provider d927e00d-5a8b-43f7-ac04-6437958fac1f, aggregates: None {{(pid=75216) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 13 19:41:40 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Refreshing trait associations for resource provider d927e00d-5a8b-43f7-ac04-6437958fac1f, traits: COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_MMX {{(pid=75216) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 13 19:41:40 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 19:41:40 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 19:41:40 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Compute_service record updated for user:user {{(pid=75216) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 19:41:40 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.304s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:41:41 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:41:44 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:41:44 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:41:44 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75216) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 19:41:44 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 19:41:44 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 19:41:44 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:41:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:41:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:41:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75216) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 19:41:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 19:41:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 19:41:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:41:51 user nova-compute[75216]: DEBUG nova.compute.manager [req-711f6665-cee2-412a-8fb8-8ed84ede6a48 req-787d26ff-010a-428f-9429-9907d8e7fd6f service nova] [instance: 7e21edf8-2308-43f5-b9c9-17dabacfb0ec] Received event network-changed-8d7855ef-7f8d-4f76-af3d-5e9c41759435 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:41:51 user nova-compute[75216]: DEBUG nova.compute.manager [req-711f6665-cee2-412a-8fb8-8ed84ede6a48 req-787d26ff-010a-428f-9429-9907d8e7fd6f service nova] [instance: 7e21edf8-2308-43f5-b9c9-17dabacfb0ec] Refreshing instance network info cache due to event network-changed-8d7855ef-7f8d-4f76-af3d-5e9c41759435. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 19:41:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-711f6665-cee2-412a-8fb8-8ed84ede6a48 req-787d26ff-010a-428f-9429-9907d8e7fd6f service nova] Acquiring lock "refresh_cache-7e21edf8-2308-43f5-b9c9-17dabacfb0ec" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 19:41:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-711f6665-cee2-412a-8fb8-8ed84ede6a48 req-787d26ff-010a-428f-9429-9907d8e7fd6f service nova] Acquired lock "refresh_cache-7e21edf8-2308-43f5-b9c9-17dabacfb0ec" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 19:41:51 user nova-compute[75216]: DEBUG nova.network.neutron [req-711f6665-cee2-412a-8fb8-8ed84ede6a48 req-787d26ff-010a-428f-9429-9907d8e7fd6f service nova] [instance: 7e21edf8-2308-43f5-b9c9-17dabacfb0ec] Refreshing network info cache for port 8d7855ef-7f8d-4f76-af3d-5e9c41759435 {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 19:41:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-ab075097-0e9f-4134-995a-2befad095b06 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Acquiring lock "7e21edf8-2308-43f5-b9c9-17dabacfb0ec" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:41:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-ab075097-0e9f-4134-995a-2befad095b06 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Lock "7e21edf8-2308-43f5-b9c9-17dabacfb0ec" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:41:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-ab075097-0e9f-4134-995a-2befad095b06 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Acquiring lock "7e21edf8-2308-43f5-b9c9-17dabacfb0ec-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:41:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-ab075097-0e9f-4134-995a-2befad095b06 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Lock "7e21edf8-2308-43f5-b9c9-17dabacfb0ec-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:41:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-ab075097-0e9f-4134-995a-2befad095b06 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Lock "7e21edf8-2308-43f5-b9c9-17dabacfb0ec-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:41:51 user nova-compute[75216]: INFO nova.compute.manager [None req-ab075097-0e9f-4134-995a-2befad095b06 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 7e21edf8-2308-43f5-b9c9-17dabacfb0ec] Terminating instance
Nov 13 19:41:51 user nova-compute[75216]: DEBUG nova.compute.manager [None req-ab075097-0e9f-4134-995a-2befad095b06 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 7e21edf8-2308-43f5-b9c9-17dabacfb0ec] Start destroying the instance on the hypervisor. {{(pid=75216) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 19:41:51 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:41:51 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:41:51 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:41:51 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:41:52 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:41:52 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:41:52 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 7e21edf8-2308-43f5-b9c9-17dabacfb0ec] Instance destroyed successfully.
Nov 13 19:41:52 user nova-compute[75216]: DEBUG nova.objects.instance [None req-ab075097-0e9f-4134-995a-2befad095b06 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Lazy-loading 'resources' on Instance uuid 7e21edf8-2308-43f5-b9c9-17dabacfb0ec {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:41:52 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-ab075097-0e9f-4134-995a-2befad095b06 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T19:37:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1308884141',display_name='tempest-TestVolumeBootPattern-server-1308884141',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1308884141',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJoiZwaxJA3L6zg1VlDIL2iywK8D207KUdpx1vJqr+ljXQkA4jTUHYbkCYqoa39qc34qT95KOeBJjIq8vzC1Og4pbsAomDAW7M51FJ+JGdR7hmjZWz1zbUNVDWRemA+lQw==',key_name='tempest-TestVolumeBootPattern-21317594',keypairs=<?>,launch_index=0,launched_at=2023-11-13T19:37:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3a1951a52e7c4ef5ac6a0d9d5380d41a',ramdisk_id='',reservation_id='r-sy0ebmea',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1444343509',owner_user_name='tempest-TestVolumeBootPattern-1444343509-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T19:37:18Z,user_data=None,user_id='bfc6b02c16664b8dbea3a6f2088ec385',uuid=7e21edf8-2308-43f5-b9c9-17dabacfb0ec,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8d7855ef-7f8d-4f76-af3d-5e9c41759435", "address": "fa:16:3e:7f:73:bb", "network": {"id": "5881a45c-3f28-48c4-aa8e-045b3bea3227", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1651070715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a1951a52e7c4ef5ac6a0d9d5380d41a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d7855ef-7f", "ovs_interfaceid": "8d7855ef-7f8d-4f76-af3d-5e9c41759435", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 19:41:52 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-ab075097-0e9f-4134-995a-2befad095b06 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Converting VIF {"id": "8d7855ef-7f8d-4f76-af3d-5e9c41759435", "address": "fa:16:3e:7f:73:bb", "network": {"id": "5881a45c-3f28-48c4-aa8e-045b3bea3227", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1651070715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a1951a52e7c4ef5ac6a0d9d5380d41a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d7855ef-7f", "ovs_interfaceid": "8d7855ef-7f8d-4f76-af3d-5e9c41759435", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 19:41:52 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-ab075097-0e9f-4134-995a-2befad095b06 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7f:73:bb,bridge_name='br-int',has_traffic_filtering=True,id=8d7855ef-7f8d-4f76-af3d-5e9c41759435,network=Network(5881a45c-3f28-48c4-aa8e-045b3bea3227),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d7855ef-7f') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 19:41:52 user nova-compute[75216]: DEBUG os_vif [None req-ab075097-0e9f-4134-995a-2befad095b06 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7f:73:bb,bridge_name='br-int',has_traffic_filtering=True,id=8d7855ef-7f8d-4f76-af3d-5e9c41759435,network=Network(5881a45c-3f28-48c4-aa8e-045b3bea3227),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d7855ef-7f') {{(pid=75216) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 19:41:52 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:41:52 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8d7855ef-7f, bridge=br-int, if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:41:52 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:41:52 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:41:52 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:41:52 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=76bfbe96-bc9d-4390-b3c3-a042f9120ec7) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:41:52 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:41:52 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:41:52 user nova-compute[75216]: INFO os_vif [None req-ab075097-0e9f-4134-995a-2befad095b06 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7f:73:bb,bridge_name='br-int',has_traffic_filtering=True,id=8d7855ef-7f8d-4f76-af3d-5e9c41759435,network=Network(5881a45c-3f28-48c4-aa8e-045b3bea3227),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d7855ef-7f')
Nov 13 19:41:52 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ab075097-0e9f-4134-995a-2befad095b06 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 7e21edf8-2308-43f5-b9c9-17dabacfb0ec] calling os-brick to detach iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 19:41:52 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab075097-0e9f-4134-995a-2befad095b06 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3a8669e40>, {'target_iqn': 'iqn.2010-10.org.openstack:dac4ffc7-c907-49c6-81da-c8700d141c1e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CcyHdMDU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 19:41:52 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-ab075097-0e9f-4134-995a-2befad095b06 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 19:41:52 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-ab075097-0e9f-4134-995a-2befad095b06 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 19:41:52 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-ab075097-0e9f-4134-995a-2befad095b06 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.004s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 19:41:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:41:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:41:52 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[425baee7-64d0-4a17-a49b-866f535956c9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:dac4ffc7-c907-49c6-81da-c8700d141c1e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:41:52 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab075097-0e9f-4134-995a-2befad095b06 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 19:41:52 user nova-compute[75216]: No targets found.
Nov 13 19:41:52 user nova-compute[75216]: iSNS:
Nov 13 19:41:52 user nova-compute[75216]: No targets found.
Nov 13 19:41:52 user nova-compute[75216]: STATIC:
Nov 13 19:41:52 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:dac4ffc7-c907-49c6-81da-c8700d141c1e
Nov 13 19:41:52 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 19:41:52 user nova-compute[75216]:                 Iface Name: default
Nov 13 19:41:52 user nova-compute[75216]: FIRMWARE:
Nov 13 19:41:52 user nova-compute[75216]: No targets found.
Nov 13 19:41:52 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 19:41:52 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab075097-0e9f-4134-995a-2befad095b06 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 19:41:52 user nova-compute[75216]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 19:41:52 user nova-compute[75216]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75216) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 19:41:52 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab075097-0e9f-4134-995a-2befad095b06 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dac4ffc7-c907-49c6-81da-c8700d141c1e', 0)] {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 19:41:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:41:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:41:52 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7b7f3b7-5c5f-48fc-b39f-cedd099ebb0b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dac4ffc7-c907-49c6-81da-c8700d141c1e\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:41:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:41:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:41:52 user nova-compute[75216]: DEBUG nova.network.neutron [req-711f6665-cee2-412a-8fb8-8ed84ede6a48 req-787d26ff-010a-428f-9429-9907d8e7fd6f service nova] [instance: 7e21edf8-2308-43f5-b9c9-17dabacfb0ec] Updated VIF entry in instance network info cache for port 8d7855ef-7f8d-4f76-af3d-5e9c41759435. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 19:41:52 user nova-compute[75216]: DEBUG nova.network.neutron [req-711f6665-cee2-412a-8fb8-8ed84ede6a48 req-787d26ff-010a-428f-9429-9907d8e7fd6f service nova] [instance: 7e21edf8-2308-43f5-b9c9-17dabacfb0ec] Updating instance_info_cache with network_info: [{"id": "8d7855ef-7f8d-4f76-af3d-5e9c41759435", "address": "fa:16:3e:7f:73:bb", "network": {"id": "5881a45c-3f28-48c4-aa8e-045b3bea3227", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1651070715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a1951a52e7c4ef5ac6a0d9d5380d41a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d7855ef-7f", "ovs_interfaceid": "8d7855ef-7f8d-4f76-af3d-5e9c41759435", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:41:52 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8755952-ccc0-4d86-a51f-ebffc16214e8]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dac4ffc7-c907-49c6-81da-c8700d141c1e (non-flash)\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:41:52 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab075097-0e9f-4134-995a-2befad095b06 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dac4ffc7-c907-49c6-81da-c8700d141c1e (non-flash)
Nov 13 19:41:52 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 19:41:52 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab075097-0e9f-4134-995a-2befad095b06 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dac4ffc7-c907-49c6-81da-c8700d141c1e (non-flash)
Nov 13 19:41:52 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 19:41:52 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab075097-0e9f-4134-995a-2befad095b06 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe3a8579c60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dac4ffc7-c907-49c6-81da-c8700d141c1e'): ({'sdb'}, set())}) {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 19:41:52 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-ab075097-0e9f-4134-995a-2befad095b06 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Removing single pathed devices sdb {{(pid=75216) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 19:41:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:41:52 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-711f6665-cee2-412a-8fb8-8ed84ede6a48 req-787d26ff-010a-428f-9429-9907d8e7fd6f service nova] Releasing lock "refresh_cache-7e21edf8-2308-43f5-b9c9-17dabacfb0ec" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 19:41:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:41:52 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[d96f19fe-6091-4c04-a6c4-a2251fcdae4c]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:41:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:41:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:41:52 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[26fa3212-cb8e-445c-9692-bbda57ed70ff]: (4, ('ok\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:41:52 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-ab075097-0e9f-4134-995a-2befad095b06 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Flushing IO for device /dev/sdb {{(pid=75216) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 19:41:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:41:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:41:52 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d0e97fd-4505-4504-8e6a-2eb5f5ef8284]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:41:52 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-ab075097-0e9f-4134-995a-2befad095b06 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75216) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 19:41:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:41:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:41:52 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[18e3a51f-efbf-494b-a814-ec0ebd6c312c]: (4, ('1', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:41:52 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-ab075097-0e9f-4134-995a-2befad095b06 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 19:41:52 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-ab075097-0e9f-4134-995a-2befad095b06 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] SCSI volumes sdb have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 19:41:52 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab075097-0e9f-4134-995a-2befad095b06 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dac4ffc7-c907-49c6-81da-c8700d141c1e')] {{(pid=75216) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 19:41:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dac4ffc7-c907-49c6-81da-c8700d141c1e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:41:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dac4ffc7-c907-49c6-81da-c8700d141c1e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:41:52 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee89b4df-4821-41d3-ad3a-907165e545c6]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:41:52 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab075097-0e9f-4134-995a-2befad095b06 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:41:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dac4ffc7-c907-49c6-81da-c8700d141c1e -p 172.16.0.220:3260 --logout {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:41:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dac4ffc7-c907-49c6-81da-c8700d141c1e -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:41:53 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[789e43df-c7c9-472e-9b74-362ae0178248]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:dac4ffc7-c907-49c6-81da-c8700d141c1e, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:dac4ffc7-c907-49c6-81da-c8700d141c1e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:41:53 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab075097-0e9f-4134-995a-2befad095b06 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:dac4ffc7-c907-49c6-81da-c8700d141c1e, portal: 172.16.0.220,3260]
Nov 13 19:41:53 user nova-compute[75216]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:dac4ffc7-c907-49c6-81da-c8700d141c1e, portal: 172.16.0.220,3260] successful.
Nov 13 19:41:53 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:41:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dac4ffc7-c907-49c6-81da-c8700d141c1e -p 172.16.0.220:3260 --op delete {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:41:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dac4ffc7-c907-49c6-81da-c8700d141c1e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:41:53 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[ded3ba90-ddff-441f-97d8-44bebc028d44]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:41:53 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab075097-0e9f-4134-995a-2befad095b06 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:41:53 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-ab075097-0e9f-4134-995a-2befad095b06 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 19:41:53 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab075097-0e9f-4134-995a-2befad095b06 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] <== disconnect_volume: return (314ms) None {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 19:41:53 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ab075097-0e9f-4134-995a-2befad095b06 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 7e21edf8-2308-43f5-b9c9-17dabacfb0ec] Disconnected iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 19:41:53 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-ab075097-0e9f-4134-995a-2befad095b06 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 7e21edf8-2308-43f5-b9c9-17dabacfb0ec] Deleting instance files /opt/stack/data/nova/instances/7e21edf8-2308-43f5-b9c9-17dabacfb0ec_del
Nov 13 19:41:53 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-ab075097-0e9f-4134-995a-2befad095b06 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 7e21edf8-2308-43f5-b9c9-17dabacfb0ec] Deletion of /opt/stack/data/nova/instances/7e21edf8-2308-43f5-b9c9-17dabacfb0ec_del complete
Nov 13 19:41:53 user nova-compute[75216]: INFO nova.compute.manager [None req-ab075097-0e9f-4134-995a-2befad095b06 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 7e21edf8-2308-43f5-b9c9-17dabacfb0ec] Took 1.37 seconds to destroy the instance on the hypervisor.
Nov 13 19:41:53 user nova-compute[75216]: DEBUG oslo.service.loopingcall [None req-ab075097-0e9f-4134-995a-2befad095b06 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75216) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 19:41:53 user nova-compute[75216]: DEBUG nova.compute.manager [-] [instance: 7e21edf8-2308-43f5-b9c9-17dabacfb0ec] Deallocating network for instance {{(pid=75216) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 19:41:53 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: 7e21edf8-2308-43f5-b9c9-17dabacfb0ec] deallocate_for_instance() {{(pid=75216) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 19:41:53 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: 7e21edf8-2308-43f5-b9c9-17dabacfb0ec] Updating instance_info_cache with network_info: [] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:41:53 user nova-compute[75216]: INFO nova.compute.manager [-] [instance: 7e21edf8-2308-43f5-b9c9-17dabacfb0ec] Took 0.38 seconds to deallocate network for instance.
Nov 13 19:41:53 user nova-compute[75216]: DEBUG nova.compute.manager [req-a84ec91c-1d68-4067-a20f-c8038d436bc9 req-dae8c959-85c1-4319-baa3-9163d3c3f7d5 service nova] [instance: 7e21edf8-2308-43f5-b9c9-17dabacfb0ec] Received event network-vif-deleted-8d7855ef-7f8d-4f76-af3d-5e9c41759435 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:41:53 user nova-compute[75216]: DEBUG nova.compute.manager [req-a51db098-ba0d-4185-9fb7-770cd8a015c3 req-c0e62a07-91bf-4827-9023-cb588b8127a4 service nova] [instance: 7e21edf8-2308-43f5-b9c9-17dabacfb0ec] Received event network-vif-unplugged-8d7855ef-7f8d-4f76-af3d-5e9c41759435 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:41:53 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-a51db098-ba0d-4185-9fb7-770cd8a015c3 req-c0e62a07-91bf-4827-9023-cb588b8127a4 service nova] Acquiring lock "7e21edf8-2308-43f5-b9c9-17dabacfb0ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:41:53 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-a51db098-ba0d-4185-9fb7-770cd8a015c3 req-c0e62a07-91bf-4827-9023-cb588b8127a4 service nova] Lock "7e21edf8-2308-43f5-b9c9-17dabacfb0ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:41:53 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-a51db098-ba0d-4185-9fb7-770cd8a015c3 req-c0e62a07-91bf-4827-9023-cb588b8127a4 service nova] Lock "7e21edf8-2308-43f5-b9c9-17dabacfb0ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:41:53 user nova-compute[75216]: DEBUG nova.compute.manager [req-a51db098-ba0d-4185-9fb7-770cd8a015c3 req-c0e62a07-91bf-4827-9023-cb588b8127a4 service nova] [instance: 7e21edf8-2308-43f5-b9c9-17dabacfb0ec] No waiting events found dispatching network-vif-unplugged-8d7855ef-7f8d-4f76-af3d-5e9c41759435 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 19:41:53 user nova-compute[75216]: DEBUG nova.compute.manager [req-a51db098-ba0d-4185-9fb7-770cd8a015c3 req-c0e62a07-91bf-4827-9023-cb588b8127a4 service nova] [instance: 7e21edf8-2308-43f5-b9c9-17dabacfb0ec] Received event network-vif-unplugged-8d7855ef-7f8d-4f76-af3d-5e9c41759435 for instance with task_state deleting. {{(pid=75216) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 19:41:53 user nova-compute[75216]: DEBUG nova.compute.manager [req-a51db098-ba0d-4185-9fb7-770cd8a015c3 req-c0e62a07-91bf-4827-9023-cb588b8127a4 service nova] [instance: 7e21edf8-2308-43f5-b9c9-17dabacfb0ec] Received event network-vif-plugged-8d7855ef-7f8d-4f76-af3d-5e9c41759435 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:41:53 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-a51db098-ba0d-4185-9fb7-770cd8a015c3 req-c0e62a07-91bf-4827-9023-cb588b8127a4 service nova] Acquiring lock "7e21edf8-2308-43f5-b9c9-17dabacfb0ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:41:53 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-a51db098-ba0d-4185-9fb7-770cd8a015c3 req-c0e62a07-91bf-4827-9023-cb588b8127a4 service nova] Lock "7e21edf8-2308-43f5-b9c9-17dabacfb0ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:41:53 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-a51db098-ba0d-4185-9fb7-770cd8a015c3 req-c0e62a07-91bf-4827-9023-cb588b8127a4 service nova] Lock "7e21edf8-2308-43f5-b9c9-17dabacfb0ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:41:53 user nova-compute[75216]: DEBUG nova.compute.manager [req-a51db098-ba0d-4185-9fb7-770cd8a015c3 req-c0e62a07-91bf-4827-9023-cb588b8127a4 service nova] [instance: 7e21edf8-2308-43f5-b9c9-17dabacfb0ec] No waiting events found dispatching network-vif-plugged-8d7855ef-7f8d-4f76-af3d-5e9c41759435 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 19:41:53 user nova-compute[75216]: WARNING nova.compute.manager [req-a51db098-ba0d-4185-9fb7-770cd8a015c3 req-c0e62a07-91bf-4827-9023-cb588b8127a4 service nova] [instance: 7e21edf8-2308-43f5-b9c9-17dabacfb0ec] Received unexpected event network-vif-plugged-8d7855ef-7f8d-4f76-af3d-5e9c41759435 for instance with vm_state active and task_state deleting.
Nov 13 19:41:54 user nova-compute[75216]: INFO nova.compute.manager [None req-ab075097-0e9f-4134-995a-2befad095b06 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] [instance: 7e21edf8-2308-43f5-b9c9-17dabacfb0ec] Took 0.73 seconds to detach 1 volumes for instance.
Nov 13 19:41:54 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-ab075097-0e9f-4134-995a-2befad095b06 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:41:54 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-ab075097-0e9f-4134-995a-2befad095b06 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:41:54 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-ab075097-0e9f-4134-995a-2befad095b06 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 19:41:54 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-ab075097-0e9f-4134-995a-2befad095b06 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 19:41:54 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-ab075097-0e9f-4134-995a-2befad095b06 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.131s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:41:54 user nova-compute[75216]: INFO nova.scheduler.client.report [None req-ab075097-0e9f-4134-995a-2befad095b06 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Deleted allocations for instance 7e21edf8-2308-43f5-b9c9-17dabacfb0ec
Nov 13 19:41:54 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-ab075097-0e9f-4134-995a-2befad095b06 tempest-TestVolumeBootPattern-1444343509 tempest-TestVolumeBootPattern-1444343509-project-member] Lock "7e21edf8-2308-43f5-b9c9-17dabacfb0ec" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.803s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:41:57 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:41:57 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Cleaning up deleted instances {{(pid=75216) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 13 19:41:57 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] There are 0 instances to clean {{(pid=75216) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 13 19:41:57 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:41:59 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:42:01 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:42:01 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75216) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 13 19:42:02 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:42:07 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:42:09 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:42:12 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:42:12 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:42:12 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75216) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 19:42:12 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 19:42:12 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 19:42:12 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:42:17 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:42:22 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:42:22 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:42:27 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:42:27 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:42:32 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:42:34 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:42:34 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:42:36 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:42:36 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75216) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 19:42:37 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:42:37 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Starting heal instance info cache {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 19:42:37 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Rebuilding the list of instances to heal {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 13 19:42:37 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Didn't find any instances for network info cache update. {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 13 19:42:37 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:42:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:42:41 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:42:41 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:42:41 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:42:41 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:42:41 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Auditing locally available compute resources for user (node: user) {{(pid=75216) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 19:42:41 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 19:42:41 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 19:42:41 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Hypervisor/Node resource view: name=user free_ram=9129MB free_disk=25.253211975097656GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75216) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 19:42:41 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:42:41 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:42:41 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 19:42:41 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 19:42:41 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 19:42:41 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 19:42:41 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Compute_service record updated for user:user {{(pid=75216) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 19:42:41 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.140s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:42:42 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:42:42 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:42:43 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:42:46 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:42:47 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:42:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:42:52 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:42:55 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:42:56 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:42:57 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:42:59 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:42:59 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:43:01 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:43:02 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:43:04 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:43:06 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-0e47ab1a-495e-4869-9601-b03c2cecbf5b tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Acquiring lock "accae217-e37a-4262-afc2-6084869847b8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:43:06 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-0e47ab1a-495e-4869-9601-b03c2cecbf5b tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Lock "accae217-e37a-4262-afc2-6084869847b8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:43:06 user nova-compute[75216]: DEBUG nova.compute.manager [None req-0e47ab1a-495e-4869-9601-b03c2cecbf5b tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] [instance: accae217-e37a-4262-afc2-6084869847b8] Starting instance... {{(pid=75216) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 19:43:06 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-0e47ab1a-495e-4869-9601-b03c2cecbf5b tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:43:06 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-0e47ab1a-495e-4869-9601-b03c2cecbf5b tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:43:06 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-0e47ab1a-495e-4869-9601-b03c2cecbf5b tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75216) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 19:43:06 user nova-compute[75216]: INFO nova.compute.claims [None req-0e47ab1a-495e-4869-9601-b03c2cecbf5b tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] [instance: accae217-e37a-4262-afc2-6084869847b8] Claim successful on node user
Nov 13 19:43:06 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-0e47ab1a-495e-4869-9601-b03c2cecbf5b tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 19:43:06 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-0e47ab1a-495e-4869-9601-b03c2cecbf5b tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 19:43:06 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-0e47ab1a-495e-4869-9601-b03c2cecbf5b tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.250s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:43:06 user nova-compute[75216]: DEBUG nova.compute.manager [None req-0e47ab1a-495e-4869-9601-b03c2cecbf5b tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] [instance: accae217-e37a-4262-afc2-6084869847b8] Start building networks asynchronously for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 19:43:06 user nova-compute[75216]: DEBUG nova.compute.manager [None req-0e47ab1a-495e-4869-9601-b03c2cecbf5b tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] [instance: accae217-e37a-4262-afc2-6084869847b8] Allocating IP information in the background. {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 19:43:06 user nova-compute[75216]: DEBUG nova.network.neutron [None req-0e47ab1a-495e-4869-9601-b03c2cecbf5b tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] [instance: accae217-e37a-4262-afc2-6084869847b8] allocate_for_instance() {{(pid=75216) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 19:43:06 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-0e47ab1a-495e-4869-9601-b03c2cecbf5b tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] [instance: accae217-e37a-4262-afc2-6084869847b8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 19:43:06 user nova-compute[75216]: DEBUG nova.compute.manager [None req-0e47ab1a-495e-4869-9601-b03c2cecbf5b tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] [instance: accae217-e37a-4262-afc2-6084869847b8] Start building block device mappings for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 19:43:06 user nova-compute[75216]: DEBUG nova.compute.manager [None req-0e47ab1a-495e-4869-9601-b03c2cecbf5b tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] [instance: accae217-e37a-4262-afc2-6084869847b8] Start spawning the instance on the hypervisor. {{(pid=75216) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 19:43:06 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-0e47ab1a-495e-4869-9601-b03c2cecbf5b tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] [instance: accae217-e37a-4262-afc2-6084869847b8] Creating instance directory {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 19:43:06 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-0e47ab1a-495e-4869-9601-b03c2cecbf5b tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] [instance: accae217-e37a-4262-afc2-6084869847b8] Creating image(s)
Nov 13 19:43:06 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-0e47ab1a-495e-4869-9601-b03c2cecbf5b tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Acquiring lock "/opt/stack/data/nova/instances/accae217-e37a-4262-afc2-6084869847b8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:43:06 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-0e47ab1a-495e-4869-9601-b03c2cecbf5b tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Lock "/opt/stack/data/nova/instances/accae217-e37a-4262-afc2-6084869847b8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:43:06 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-0e47ab1a-495e-4869-9601-b03c2cecbf5b tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Lock "/opt/stack/data/nova/instances/accae217-e37a-4262-afc2-6084869847b8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:43:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-0e47ab1a-495e-4869-9601-b03c2cecbf5b tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:43:06 user nova-compute[75216]: DEBUG nova.policy [None req-0e47ab1a-495e-4869-9601-b03c2cecbf5b tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cd499a78c58f49a98011b91f246be6f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85b16b3854c4604a963f680906e6b77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75216) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 19:43:07 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-0e47ab1a-495e-4869-9601-b03c2cecbf5b tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json" returned: 0 in 0.176s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:43:07 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-0e47ab1a-495e-4869-9601-b03c2cecbf5b tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Acquiring lock "88c50a45bec9d6b0427462b3242b9b8e5f49c2b6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:43:07 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-0e47ab1a-495e-4869-9601-b03c2cecbf5b tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Lock "88c50a45bec9d6b0427462b3242b9b8e5f49c2b6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:43:07 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-0e47ab1a-495e-4869-9601-b03c2cecbf5b tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:43:07 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-0e47ab1a-495e-4869-9601-b03c2cecbf5b tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json" returned: 0 in 0.175s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:43:07 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-0e47ab1a-495e-4869-9601-b03c2cecbf5b tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6,backing_fmt=raw /opt/stack/data/nova/instances/accae217-e37a-4262-afc2-6084869847b8/disk 1073741824 {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:43:07 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-0e47ab1a-495e-4869-9601-b03c2cecbf5b tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6,backing_fmt=raw /opt/stack/data/nova/instances/accae217-e37a-4262-afc2-6084869847b8/disk 1073741824" returned: 0 in 0.054s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:43:07 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-0e47ab1a-495e-4869-9601-b03c2cecbf5b tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Lock "88c50a45bec9d6b0427462b3242b9b8e5f49c2b6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.237s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:43:07 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-0e47ab1a-495e-4869-9601-b03c2cecbf5b tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:43:07 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-0e47ab1a-495e-4869-9601-b03c2cecbf5b tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json" returned: 0 in 0.174s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:43:07 user nova-compute[75216]: DEBUG nova.virt.disk.api [None req-0e47ab1a-495e-4869-9601-b03c2cecbf5b tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Checking if we can resize image /opt/stack/data/nova/instances/accae217-e37a-4262-afc2-6084869847b8/disk. size=1073741824 {{(pid=75216) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 19:43:07 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-0e47ab1a-495e-4869-9601-b03c2cecbf5b tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/accae217-e37a-4262-afc2-6084869847b8/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:43:07 user nova-compute[75216]: DEBUG nova.network.neutron [None req-0e47ab1a-495e-4869-9601-b03c2cecbf5b tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] [instance: accae217-e37a-4262-afc2-6084869847b8] Successfully created port: 275d8444-8b2a-49f6-9982-e36f8995180b {{(pid=75216) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 19:43:07 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-0e47ab1a-495e-4869-9601-b03c2cecbf5b tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/accae217-e37a-4262-afc2-6084869847b8/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:43:07 user nova-compute[75216]: DEBUG nova.virt.disk.api [None req-0e47ab1a-495e-4869-9601-b03c2cecbf5b tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Cannot resize image /opt/stack/data/nova/instances/accae217-e37a-4262-afc2-6084869847b8/disk to a smaller size. {{(pid=75216) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 19:43:07 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-0e47ab1a-495e-4869-9601-b03c2cecbf5b tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] [instance: accae217-e37a-4262-afc2-6084869847b8] Created local disks {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 19:43:07 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-0e47ab1a-495e-4869-9601-b03c2cecbf5b tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] [instance: accae217-e37a-4262-afc2-6084869847b8] Ensure instance console log exists: /opt/stack/data/nova/instances/accae217-e37a-4262-afc2-6084869847b8/console.log {{(pid=75216) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 19:43:07 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-0e47ab1a-495e-4869-9601-b03c2cecbf5b tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:43:07 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-0e47ab1a-495e-4869-9601-b03c2cecbf5b tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:43:07 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-0e47ab1a-495e-4869-9601-b03c2cecbf5b tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:43:07 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:43:08 user nova-compute[75216]: DEBUG nova.network.neutron [None req-0e47ab1a-495e-4869-9601-b03c2cecbf5b tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] [instance: accae217-e37a-4262-afc2-6084869847b8] Successfully updated port: 275d8444-8b2a-49f6-9982-e36f8995180b {{(pid=75216) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 19:43:08 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-0e47ab1a-495e-4869-9601-b03c2cecbf5b tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Acquiring lock "refresh_cache-accae217-e37a-4262-afc2-6084869847b8" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 19:43:08 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-0e47ab1a-495e-4869-9601-b03c2cecbf5b tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Acquired lock "refresh_cache-accae217-e37a-4262-afc2-6084869847b8" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 19:43:08 user nova-compute[75216]: DEBUG nova.network.neutron [None req-0e47ab1a-495e-4869-9601-b03c2cecbf5b tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] [instance: accae217-e37a-4262-afc2-6084869847b8] Building network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 19:43:08 user nova-compute[75216]: DEBUG nova.network.neutron [None req-0e47ab1a-495e-4869-9601-b03c2cecbf5b tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] [instance: accae217-e37a-4262-afc2-6084869847b8] Instance cache missing network info. {{(pid=75216) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 19:43:08 user nova-compute[75216]: DEBUG nova.compute.manager [req-df296604-a65f-4a87-a707-42e78b19ea10 req-da5d0443-6314-41ae-9f6a-1bb9dd1251b9 service nova] [instance: accae217-e37a-4262-afc2-6084869847b8] Received event network-changed-275d8444-8b2a-49f6-9982-e36f8995180b {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:43:08 user nova-compute[75216]: DEBUG nova.compute.manager [req-df296604-a65f-4a87-a707-42e78b19ea10 req-da5d0443-6314-41ae-9f6a-1bb9dd1251b9 service nova] [instance: accae217-e37a-4262-afc2-6084869847b8] Refreshing instance network info cache due to event network-changed-275d8444-8b2a-49f6-9982-e36f8995180b. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 19:43:08 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-df296604-a65f-4a87-a707-42e78b19ea10 req-da5d0443-6314-41ae-9f6a-1bb9dd1251b9 service nova] Acquiring lock "refresh_cache-accae217-e37a-4262-afc2-6084869847b8" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 19:43:08 user nova-compute[75216]: DEBUG nova.network.neutron [None req-0e47ab1a-495e-4869-9601-b03c2cecbf5b tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] [instance: accae217-e37a-4262-afc2-6084869847b8] Updating instance_info_cache with network_info: [{"id": "275d8444-8b2a-49f6-9982-e36f8995180b", "address": "fa:16:3e:0b:a4:f8", "network": {"id": "648aeeec-8ba8-465a-81f4-83012bb2fe16", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-705892923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e85b16b3854c4604a963f680906e6b77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap275d8444-8b", "ovs_interfaceid": "275d8444-8b2a-49f6-9982-e36f8995180b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:43:08 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-0e47ab1a-495e-4869-9601-b03c2cecbf5b tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Releasing lock "refresh_cache-accae217-e37a-4262-afc2-6084869847b8" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 19:43:08 user nova-compute[75216]: DEBUG nova.compute.manager [None req-0e47ab1a-495e-4869-9601-b03c2cecbf5b tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] [instance: accae217-e37a-4262-afc2-6084869847b8] Instance network_info: |[{"id": "275d8444-8b2a-49f6-9982-e36f8995180b", "address": "fa:16:3e:0b:a4:f8", "network": {"id": "648aeeec-8ba8-465a-81f4-83012bb2fe16", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-705892923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e85b16b3854c4604a963f680906e6b77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap275d8444-8b", "ovs_interfaceid": "275d8444-8b2a-49f6-9982-e36f8995180b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 19:43:08 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-df296604-a65f-4a87-a707-42e78b19ea10 req-da5d0443-6314-41ae-9f6a-1bb9dd1251b9 service nova] Acquired lock "refresh_cache-accae217-e37a-4262-afc2-6084869847b8" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 19:43:08 user nova-compute[75216]: DEBUG nova.network.neutron [req-df296604-a65f-4a87-a707-42e78b19ea10 req-da5d0443-6314-41ae-9f6a-1bb9dd1251b9 service nova] [instance: accae217-e37a-4262-afc2-6084869847b8] Refreshing network info cache for port 275d8444-8b2a-49f6-9982-e36f8995180b {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 19:43:08 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-0e47ab1a-495e-4869-9601-b03c2cecbf5b tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] [instance: accae217-e37a-4262-afc2-6084869847b8] Start _get_guest_xml network_info=[{"id": "275d8444-8b2a-49f6-9982-e36f8995180b", "address": "fa:16:3e:0b:a4:f8", "network": {"id": "648aeeec-8ba8-465a-81f4-83012bb2fe16", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-705892923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e85b16b3854c4604a963f680906e6b77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap275d8444-8b", "ovs_interfaceid": "275d8444-8b2a-49f6-9982-e36f8995180b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T18:41:06Z,direct_url=<?>,disk_format='qcow2',id=77bcb5ba-8510-41ec-a88d-96097bb431de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c465b7c26ec44582b6d1b7169536ecc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T18:41:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'guest_format': None, 'boot_index': 0, 'image_id': '77bcb5ba-8510-41ec-a88d-96097bb431de'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 19:43:08 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-0e47ab1a-495e-4869-9601-b03c2cecbf5b tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 19:43:08 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-0e47ab1a-495e-4869-9601-b03c2cecbf5b tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 19:43:08 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-0e47ab1a-495e-4869-9601-b03c2cecbf5b tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 19:43:08 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-0e47ab1a-495e-4869-9601-b03c2cecbf5b tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] CPU controller missing on host. {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 19:43:08 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-0e47ab1a-495e-4869-9601-b03c2cecbf5b tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 19:43:08 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-0e47ab1a-495e-4869-9601-b03c2cecbf5b tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] CPU controller found on host. {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 19:43:08 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-0e47ab1a-495e-4869-9601-b03c2cecbf5b tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75216) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 19:43:08 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-0e47ab1a-495e-4869-9601-b03c2cecbf5b tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T18:40:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T18:41:06Z,direct_url=<?>,disk_format='qcow2',id=77bcb5ba-8510-41ec-a88d-96097bb431de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c465b7c26ec44582b6d1b7169536ecc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T18:41:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 19:43:08 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-0e47ab1a-495e-4869-9601-b03c2cecbf5b tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Flavor limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 19:43:08 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-0e47ab1a-495e-4869-9601-b03c2cecbf5b tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Image limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 19:43:08 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-0e47ab1a-495e-4869-9601-b03c2cecbf5b tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Flavor pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 19:43:08 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-0e47ab1a-495e-4869-9601-b03c2cecbf5b tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Image pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 19:43:08 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-0e47ab1a-495e-4869-9601-b03c2cecbf5b tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 19:43:08 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-0e47ab1a-495e-4869-9601-b03c2cecbf5b tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 19:43:08 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-0e47ab1a-495e-4869-9601-b03c2cecbf5b tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 19:43:08 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-0e47ab1a-495e-4869-9601-b03c2cecbf5b tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Got 1 possible topologies {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 19:43:08 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-0e47ab1a-495e-4869-9601-b03c2cecbf5b tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 19:43:08 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-0e47ab1a-495e-4869-9601-b03c2cecbf5b tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 19:43:08 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-0e47ab1a-495e-4869-9601-b03c2cecbf5b tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T19:43:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-876672199',display_name='tempest-SnapshotDataIntegrityTests-server-876672199',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-876672199',id=52,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEddoa3sojrKJxv0kpGNp4huLVo9ggpmdLFPx7Vs58mv8TK1QoNxDgnDnfjz28zmE7I6+4XefwA3DYQaWWKUd+yUr7oBrN8Fx8N8XixC31rTHcGB0e8maI+ZCNWfmNdEZQ==',key_name='tempest-keypair-1182363386',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e85b16b3854c4604a963f680906e6b77',ramdisk_id='',reservation_id='r-vnxg70um',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-2031098809',owner_user_name='tempest-SnapshotDataIntegrityTests-2031098809-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T19:43:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cd499a78c58f49a98011b91f246be6f6',uuid=accae217-e37a-4262-afc2-6084869847b8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "275d8444-8b2a-49f6-9982-e36f8995180b", "address": "fa:16:3e:0b:a4:f8", "network": {"id": "648aeeec-8ba8-465a-81f4-83012bb2fe16", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-705892923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e85b16b3854c4604a963f680906e6b77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap275d8444-8b", "ovs_interfaceid": "275d8444-8b2a-49f6-9982-e36f8995180b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75216) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 19:43:08 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-0e47ab1a-495e-4869-9601-b03c2cecbf5b tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Converting VIF {"id": "275d8444-8b2a-49f6-9982-e36f8995180b", "address": "fa:16:3e:0b:a4:f8", "network": {"id": "648aeeec-8ba8-465a-81f4-83012bb2fe16", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-705892923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e85b16b3854c4604a963f680906e6b77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap275d8444-8b", "ovs_interfaceid": "275d8444-8b2a-49f6-9982-e36f8995180b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 19:43:08 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-0e47ab1a-495e-4869-9601-b03c2cecbf5b tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:a4:f8,bridge_name='br-int',has_traffic_filtering=True,id=275d8444-8b2a-49f6-9982-e36f8995180b,network=Network(648aeeec-8ba8-465a-81f4-83012bb2fe16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap275d8444-8b') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 19:43:08 user nova-compute[75216]: DEBUG nova.objects.instance [None req-0e47ab1a-495e-4869-9601-b03c2cecbf5b tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Lazy-loading 'pci_devices' on Instance uuid accae217-e37a-4262-afc2-6084869847b8 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:43:08 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-0e47ab1a-495e-4869-9601-b03c2cecbf5b tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] [instance: accae217-e37a-4262-afc2-6084869847b8] End _get_guest_xml xml=<domain type="kvm">
Nov 13 19:43:08 user nova-compute[75216]:   <uuid>accae217-e37a-4262-afc2-6084869847b8</uuid>
Nov 13 19:43:08 user nova-compute[75216]:   <name>instance-00000034</name>
Nov 13 19:43:08 user nova-compute[75216]:   <memory>524288</memory>
Nov 13 19:43:08 user nova-compute[75216]:   <vcpu>1</vcpu>
Nov 13 19:43:08 user nova-compute[75216]:   <metadata>
Nov 13 19:43:08 user nova-compute[75216]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 19:43:08 user nova-compute[75216]:       <nova:package version="0.0.0"/>
Nov 13 19:43:08 user nova-compute[75216]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-876672199</nova:name>
Nov 13 19:43:08 user nova-compute[75216]:       <nova:creationTime>2023-11-13 19:43:08</nova:creationTime>
Nov 13 19:43:08 user nova-compute[75216]:       <nova:flavor name="m1.tiny">
Nov 13 19:43:08 user nova-compute[75216]:         <nova:memory>512</nova:memory>
Nov 13 19:43:08 user nova-compute[75216]:         <nova:disk>1</nova:disk>
Nov 13 19:43:08 user nova-compute[75216]:         <nova:swap>0</nova:swap>
Nov 13 19:43:08 user nova-compute[75216]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 19:43:08 user nova-compute[75216]:         <nova:vcpus>1</nova:vcpus>
Nov 13 19:43:08 user nova-compute[75216]:       </nova:flavor>
Nov 13 19:43:08 user nova-compute[75216]:       <nova:owner>
Nov 13 19:43:08 user nova-compute[75216]:         <nova:user uuid="cd499a78c58f49a98011b91f246be6f6">tempest-SnapshotDataIntegrityTests-2031098809-project-member</nova:user>
Nov 13 19:43:08 user nova-compute[75216]:         <nova:project uuid="e85b16b3854c4604a963f680906e6b77">tempest-SnapshotDataIntegrityTests-2031098809</nova:project>
Nov 13 19:43:08 user nova-compute[75216]:       </nova:owner>
Nov 13 19:43:08 user nova-compute[75216]:       <nova:root type="image" uuid="77bcb5ba-8510-41ec-a88d-96097bb431de"/>
Nov 13 19:43:08 user nova-compute[75216]:       <nova:ports>
Nov 13 19:43:08 user nova-compute[75216]:         <nova:port uuid="275d8444-8b2a-49f6-9982-e36f8995180b">
Nov 13 19:43:08 user nova-compute[75216]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 13 19:43:08 user nova-compute[75216]:         </nova:port>
Nov 13 19:43:08 user nova-compute[75216]:       </nova:ports>
Nov 13 19:43:08 user nova-compute[75216]:     </nova:instance>
Nov 13 19:43:08 user nova-compute[75216]:   </metadata>
Nov 13 19:43:08 user nova-compute[75216]:   <sysinfo type="smbios">
Nov 13 19:43:08 user nova-compute[75216]:     <system>
Nov 13 19:43:08 user nova-compute[75216]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 19:43:08 user nova-compute[75216]:       <entry name="product">OpenStack Nova</entry>
Nov 13 19:43:08 user nova-compute[75216]:       <entry name="version">0.0.0</entry>
Nov 13 19:43:08 user nova-compute[75216]:       <entry name="serial">accae217-e37a-4262-afc2-6084869847b8</entry>
Nov 13 19:43:08 user nova-compute[75216]:       <entry name="uuid">accae217-e37a-4262-afc2-6084869847b8</entry>
Nov 13 19:43:08 user nova-compute[75216]:       <entry name="family">Virtual Machine</entry>
Nov 13 19:43:08 user nova-compute[75216]:     </system>
Nov 13 19:43:08 user nova-compute[75216]:   </sysinfo>
Nov 13 19:43:08 user nova-compute[75216]:   <os>
Nov 13 19:43:08 user nova-compute[75216]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 19:43:08 user nova-compute[75216]:     <boot dev="hd"/>
Nov 13 19:43:08 user nova-compute[75216]:     <smbios mode="sysinfo"/>
Nov 13 19:43:08 user nova-compute[75216]:   </os>
Nov 13 19:43:08 user nova-compute[75216]:   <features>
Nov 13 19:43:08 user nova-compute[75216]:     <acpi/>
Nov 13 19:43:08 user nova-compute[75216]:     <apic/>
Nov 13 19:43:08 user nova-compute[75216]:     <vmcoreinfo/>
Nov 13 19:43:08 user nova-compute[75216]:   </features>
Nov 13 19:43:08 user nova-compute[75216]:   <clock offset="utc">
Nov 13 19:43:08 user nova-compute[75216]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 19:43:08 user nova-compute[75216]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 19:43:08 user nova-compute[75216]:     <timer name="hpet" present="no"/>
Nov 13 19:43:08 user nova-compute[75216]:   </clock>
Nov 13 19:43:08 user nova-compute[75216]:   <cpu mode="custom" match="exact">
Nov 13 19:43:08 user nova-compute[75216]:     <model>Nehalem</model>
Nov 13 19:43:08 user nova-compute[75216]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 19:43:08 user nova-compute[75216]:   </cpu>
Nov 13 19:43:08 user nova-compute[75216]:   <devices>
Nov 13 19:43:08 user nova-compute[75216]:     <disk type="file" device="disk">
Nov 13 19:43:08 user nova-compute[75216]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 19:43:08 user nova-compute[75216]:       <source file="/opt/stack/data/nova/instances/accae217-e37a-4262-afc2-6084869847b8/disk"/>
Nov 13 19:43:08 user nova-compute[75216]:       <target dev="vda" bus="virtio"/>
Nov 13 19:43:08 user nova-compute[75216]:     </disk>
Nov 13 19:43:08 user nova-compute[75216]:     <interface type="ethernet">
Nov 13 19:43:08 user nova-compute[75216]:       <mac address="fa:16:3e:0b:a4:f8"/>
Nov 13 19:43:08 user nova-compute[75216]:       <model type="virtio"/>
Nov 13 19:43:08 user nova-compute[75216]:       <mtu size="1442"/>
Nov 13 19:43:08 user nova-compute[75216]:       <target dev="tap275d8444-8b"/>
Nov 13 19:43:08 user nova-compute[75216]:     </interface>
Nov 13 19:43:08 user nova-compute[75216]:     <serial type="pty">
Nov 13 19:43:08 user nova-compute[75216]:       <log file="/opt/stack/data/nova/instances/accae217-e37a-4262-afc2-6084869847b8/console.log" append="off"/>
Nov 13 19:43:08 user nova-compute[75216]:     </serial>
Nov 13 19:43:08 user nova-compute[75216]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 19:43:08 user nova-compute[75216]:     <video>
Nov 13 19:43:08 user nova-compute[75216]:       <model type="virtio"/>
Nov 13 19:43:08 user nova-compute[75216]:     </video>
Nov 13 19:43:08 user nova-compute[75216]:     <rng model="virtio">
Nov 13 19:43:08 user nova-compute[75216]:       <backend model="random">/dev/urandom</backend>
Nov 13 19:43:08 user nova-compute[75216]:     </rng>
Nov 13 19:43:08 user nova-compute[75216]:     <controller type="usb" index="0" model="none"/>
Nov 13 19:43:08 user nova-compute[75216]:     <memballoon model="virtio">
Nov 13 19:43:08 user nova-compute[75216]:       <stats period="10"/>
Nov 13 19:43:08 user nova-compute[75216]:     </memballoon>
Nov 13 19:43:08 user nova-compute[75216]:   </devices>
Nov 13 19:43:08 user nova-compute[75216]: </domain>
Nov 13 19:43:08 user nova-compute[75216]:  {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 19:43:08 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-0e47ab1a-495e-4869-9601-b03c2cecbf5b tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T19:43:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-876672199',display_name='tempest-SnapshotDataIntegrityTests-server-876672199',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-876672199',id=52,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEddoa3sojrKJxv0kpGNp4huLVo9ggpmdLFPx7Vs58mv8TK1QoNxDgnDnfjz28zmE7I6+4XefwA3DYQaWWKUd+yUr7oBrN8Fx8N8XixC31rTHcGB0e8maI+ZCNWfmNdEZQ==',key_name='tempest-keypair-1182363386',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e85b16b3854c4604a963f680906e6b77',ramdisk_id='',reservation_id='r-vnxg70um',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-2031098809',owner_user_name='tempest-SnapshotDataIntegrityTests-2031098809-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T19:43:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cd499a78c58f49a98011b91f246be6f6',uuid=accae217-e37a-4262-afc2-6084869847b8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "275d8444-8b2a-49f6-9982-e36f8995180b", "address": "fa:16:3e:0b:a4:f8", "network": {"id": "648aeeec-8ba8-465a-81f4-83012bb2fe16", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-705892923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e85b16b3854c4604a963f680906e6b77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap275d8444-8b", "ovs_interfaceid": "275d8444-8b2a-49f6-9982-e36f8995180b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 19:43:08 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-0e47ab1a-495e-4869-9601-b03c2cecbf5b tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Converting VIF {"id": "275d8444-8b2a-49f6-9982-e36f8995180b", "address": "fa:16:3e:0b:a4:f8", "network": {"id": "648aeeec-8ba8-465a-81f4-83012bb2fe16", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-705892923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e85b16b3854c4604a963f680906e6b77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap275d8444-8b", "ovs_interfaceid": "275d8444-8b2a-49f6-9982-e36f8995180b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 19:43:08 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-0e47ab1a-495e-4869-9601-b03c2cecbf5b tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:a4:f8,bridge_name='br-int',has_traffic_filtering=True,id=275d8444-8b2a-49f6-9982-e36f8995180b,network=Network(648aeeec-8ba8-465a-81f4-83012bb2fe16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap275d8444-8b') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 19:43:08 user nova-compute[75216]: DEBUG os_vif [None req-0e47ab1a-495e-4869-9601-b03c2cecbf5b tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:a4:f8,bridge_name='br-int',has_traffic_filtering=True,id=275d8444-8b2a-49f6-9982-e36f8995180b,network=Network(648aeeec-8ba8-465a-81f4-83012bb2fe16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap275d8444-8b') {{(pid=75216) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 19:43:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:43:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:43:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 19:43:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:43:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a9647952-a235-55f7-a265-b31a6cb8c455', '_type': 'linux-noop'}}, row=False) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:43:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:43:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:43:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:43:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap275d8444-8b, may_exist=True, interface_attrs={}) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:43:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap275d8444-8b, col_values=(('qos', UUID('a9b0913f-b1fc-4810-a24d-699b7d22d00c')),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:43:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap275d8444-8b, col_values=(('external_ids', {'iface-id': '275d8444-8b2a-49f6-9982-e36f8995180b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0b:a4:f8', 'vm-uuid': 'accae217-e37a-4262-afc2-6084869847b8'}),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:43:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:43:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:43:08 user nova-compute[75216]: INFO os_vif [None req-0e47ab1a-495e-4869-9601-b03c2cecbf5b tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:a4:f8,bridge_name='br-int',has_traffic_filtering=True,id=275d8444-8b2a-49f6-9982-e36f8995180b,network=Network(648aeeec-8ba8-465a-81f4-83012bb2fe16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap275d8444-8b')
Nov 13 19:43:08 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-0e47ab1a-495e-4869-9601-b03c2cecbf5b tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 19:43:08 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-0e47ab1a-495e-4869-9601-b03c2cecbf5b tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] No VIF found with MAC fa:16:3e:0b:a4:f8, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 19:43:08 user nova-compute[75216]: DEBUG nova.network.neutron [req-df296604-a65f-4a87-a707-42e78b19ea10 req-da5d0443-6314-41ae-9f6a-1bb9dd1251b9 service nova] [instance: accae217-e37a-4262-afc2-6084869847b8] Updated VIF entry in instance network info cache for port 275d8444-8b2a-49f6-9982-e36f8995180b. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 19:43:08 user nova-compute[75216]: DEBUG nova.network.neutron [req-df296604-a65f-4a87-a707-42e78b19ea10 req-da5d0443-6314-41ae-9f6a-1bb9dd1251b9 service nova] [instance: accae217-e37a-4262-afc2-6084869847b8] Updating instance_info_cache with network_info: [{"id": "275d8444-8b2a-49f6-9982-e36f8995180b", "address": "fa:16:3e:0b:a4:f8", "network": {"id": "648aeeec-8ba8-465a-81f4-83012bb2fe16", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-705892923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e85b16b3854c4604a963f680906e6b77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap275d8444-8b", "ovs_interfaceid": "275d8444-8b2a-49f6-9982-e36f8995180b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:43:08 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-df296604-a65f-4a87-a707-42e78b19ea10 req-da5d0443-6314-41ae-9f6a-1bb9dd1251b9 service nova] Releasing lock "refresh_cache-accae217-e37a-4262-afc2-6084869847b8" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 19:43:09 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:43:10 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:43:10 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:43:10 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:43:10 user nova-compute[75216]: DEBUG nova.compute.manager [req-1a8f434a-c887-4d36-ab49-1473e6501fba req-0785e86f-df1b-477b-9607-844234bf5aa5 service nova] [instance: accae217-e37a-4262-afc2-6084869847b8] Received event network-vif-plugged-275d8444-8b2a-49f6-9982-e36f8995180b {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:43:10 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-1a8f434a-c887-4d36-ab49-1473e6501fba req-0785e86f-df1b-477b-9607-844234bf5aa5 service nova] Acquiring lock "accae217-e37a-4262-afc2-6084869847b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:43:10 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-1a8f434a-c887-4d36-ab49-1473e6501fba req-0785e86f-df1b-477b-9607-844234bf5aa5 service nova] Lock "accae217-e37a-4262-afc2-6084869847b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:43:10 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-1a8f434a-c887-4d36-ab49-1473e6501fba req-0785e86f-df1b-477b-9607-844234bf5aa5 service nova] Lock "accae217-e37a-4262-afc2-6084869847b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:43:10 user nova-compute[75216]: DEBUG nova.compute.manager [req-1a8f434a-c887-4d36-ab49-1473e6501fba req-0785e86f-df1b-477b-9607-844234bf5aa5 service nova] [instance: accae217-e37a-4262-afc2-6084869847b8] No waiting events found dispatching network-vif-plugged-275d8444-8b2a-49f6-9982-e36f8995180b {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 19:43:10 user nova-compute[75216]: WARNING nova.compute.manager [req-1a8f434a-c887-4d36-ab49-1473e6501fba req-0785e86f-df1b-477b-9607-844234bf5aa5 service nova] [instance: accae217-e37a-4262-afc2-6084869847b8] Received unexpected event network-vif-plugged-275d8444-8b2a-49f6-9982-e36f8995180b for instance with vm_state building and task_state spawning.
Nov 13 19:43:10 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:43:10 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:43:10 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:43:12 user nova-compute[75216]: DEBUG nova.compute.manager [None req-0e47ab1a-495e-4869-9601-b03c2cecbf5b tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] [instance: accae217-e37a-4262-afc2-6084869847b8] Instance event wait completed in 0 seconds for  {{(pid=75216) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 19:43:12 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-0e47ab1a-495e-4869-9601-b03c2cecbf5b tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] [instance: accae217-e37a-4262-afc2-6084869847b8] Guest created on hypervisor {{(pid=75216) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 19:43:12 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: accae217-e37a-4262-afc2-6084869847b8] Instance spawned successfully.
Nov 13 19:43:12 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-0e47ab1a-495e-4869-9601-b03c2cecbf5b tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] [instance: accae217-e37a-4262-afc2-6084869847b8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 19:43:12 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-0e47ab1a-495e-4869-9601-b03c2cecbf5b tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] [instance: accae217-e37a-4262-afc2-6084869847b8] Found default for hw_cdrom_bus of ide {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 19:43:12 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-0e47ab1a-495e-4869-9601-b03c2cecbf5b tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] [instance: accae217-e37a-4262-afc2-6084869847b8] Found default for hw_disk_bus of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 19:43:12 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-0e47ab1a-495e-4869-9601-b03c2cecbf5b tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] [instance: accae217-e37a-4262-afc2-6084869847b8] Found default for hw_input_bus of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 19:43:12 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-0e47ab1a-495e-4869-9601-b03c2cecbf5b tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] [instance: accae217-e37a-4262-afc2-6084869847b8] Found default for hw_pointer_model of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 19:43:12 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-0e47ab1a-495e-4869-9601-b03c2cecbf5b tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] [instance: accae217-e37a-4262-afc2-6084869847b8] Found default for hw_video_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 19:43:12 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-0e47ab1a-495e-4869-9601-b03c2cecbf5b tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] [instance: accae217-e37a-4262-afc2-6084869847b8] Found default for hw_vif_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 19:43:12 user nova-compute[75216]: INFO nova.compute.manager [None req-0e47ab1a-495e-4869-9601-b03c2cecbf5b tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] [instance: accae217-e37a-4262-afc2-6084869847b8] Took 5.39 seconds to spawn the instance on the hypervisor.
Nov 13 19:43:12 user nova-compute[75216]: DEBUG nova.compute.manager [None req-0e47ab1a-495e-4869-9601-b03c2cecbf5b tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] [instance: accae217-e37a-4262-afc2-6084869847b8] Checking state {{(pid=75216) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 19:43:12 user nova-compute[75216]: INFO nova.compute.manager [None req-0e47ab1a-495e-4869-9601-b03c2cecbf5b tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] [instance: accae217-e37a-4262-afc2-6084869847b8] Took 5.95 seconds to build instance.
Nov 13 19:43:12 user nova-compute[75216]: DEBUG nova.compute.manager [req-6a63110b-e095-4fe0-a945-2fb09e2d669d req-ab462279-22cd-4f48-b0b1-8a51e4959484 service nova] [instance: accae217-e37a-4262-afc2-6084869847b8] Received event network-vif-plugged-275d8444-8b2a-49f6-9982-e36f8995180b {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:43:12 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-6a63110b-e095-4fe0-a945-2fb09e2d669d req-ab462279-22cd-4f48-b0b1-8a51e4959484 service nova] Acquiring lock "accae217-e37a-4262-afc2-6084869847b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:43:12 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-6a63110b-e095-4fe0-a945-2fb09e2d669d req-ab462279-22cd-4f48-b0b1-8a51e4959484 service nova] Lock "accae217-e37a-4262-afc2-6084869847b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:43:12 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-6a63110b-e095-4fe0-a945-2fb09e2d669d req-ab462279-22cd-4f48-b0b1-8a51e4959484 service nova] Lock "accae217-e37a-4262-afc2-6084869847b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:43:12 user nova-compute[75216]: DEBUG nova.compute.manager [req-6a63110b-e095-4fe0-a945-2fb09e2d669d req-ab462279-22cd-4f48-b0b1-8a51e4959484 service nova] [instance: accae217-e37a-4262-afc2-6084869847b8] No waiting events found dispatching network-vif-plugged-275d8444-8b2a-49f6-9982-e36f8995180b {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 19:43:12 user nova-compute[75216]: WARNING nova.compute.manager [req-6a63110b-e095-4fe0-a945-2fb09e2d669d req-ab462279-22cd-4f48-b0b1-8a51e4959484 service nova] [instance: accae217-e37a-4262-afc2-6084869847b8] Received unexpected event network-vif-plugged-275d8444-8b2a-49f6-9982-e36f8995180b for instance with vm_state active and task_state None.
Nov 13 19:43:12 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-0e47ab1a-495e-4869-9601-b03c2cecbf5b tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Lock "accae217-e37a-4262-afc2-6084869847b8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.141s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:43:13 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:43:14 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:43:18 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:43:19 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:43:23 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:43:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:43:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:43:29 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:43:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:43:33 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:43:34 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:43:35 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:43:35 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:43:36 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:43:36 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75216) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 19:43:38 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:43:38 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:43:39 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:43:39 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Starting heal instance info cache {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 19:43:39 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Rebuilding the list of instances to heal {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 13 19:43:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "refresh_cache-accae217-e37a-4262-afc2-6084869847b8" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 19:43:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquired lock "refresh_cache-accae217-e37a-4262-afc2-6084869847b8" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 19:43:39 user nova-compute[75216]: DEBUG nova.network.neutron [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: accae217-e37a-4262-afc2-6084869847b8] Forcefully refreshing network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 19:43:39 user nova-compute[75216]: DEBUG nova.objects.instance [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lazy-loading 'info_cache' on Instance uuid accae217-e37a-4262-afc2-6084869847b8 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:43:39 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:43:39 user nova-compute[75216]: DEBUG nova.network.neutron [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: accae217-e37a-4262-afc2-6084869847b8] Updating instance_info_cache with network_info: [{"id": "275d8444-8b2a-49f6-9982-e36f8995180b", "address": "fa:16:3e:0b:a4:f8", "network": {"id": "648aeeec-8ba8-465a-81f4-83012bb2fe16", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-705892923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e85b16b3854c4604a963f680906e6b77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap275d8444-8b", "ovs_interfaceid": "275d8444-8b2a-49f6-9982-e36f8995180b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:43:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Releasing lock "refresh_cache-accae217-e37a-4262-afc2-6084869847b8" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 19:43:39 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: accae217-e37a-4262-afc2-6084869847b8] Updated the network info_cache for instance {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 19:43:41 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:43:41 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:43:41 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:43:41 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:43:41 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Auditing locally available compute resources for user (node: user) {{(pid=75216) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 19:43:41 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/accae217-e37a-4262-afc2-6084869847b8/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:43:41 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/accae217-e37a-4262-afc2-6084869847b8/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:43:41 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/accae217-e37a-4262-afc2-6084869847b8/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:43:41 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/accae217-e37a-4262-afc2-6084869847b8/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:43:42 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 19:43:42 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 19:43:42 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Hypervisor/Node resource view: name=user free_ram=8935MB free_disk=25.214397430419922GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75216) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 19:43:42 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:43:42 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:43:42 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance accae217-e37a-4262-afc2-6084869847b8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 19:43:42 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 19:43:42 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 19:43:42 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 19:43:42 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 19:43:42 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Compute_service record updated for user:user {{(pid=75216) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 19:43:42 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.258s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:43:43 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:43:44 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:43:45 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:43:48 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:43:53 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:43:53 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:43:53 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75216) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 19:43:53 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 19:43:53 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 19:43:53 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:43:58 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:43:59 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:44:03 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:44:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:44:13 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:44:18 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:44:23 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:44:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:44:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:44:30 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:44:33 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:44:36 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:44:37 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:44:38 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:44:38 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75216) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 19:44:38 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:44:39 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:44:39 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Starting heal instance info cache {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 19:44:39 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Rebuilding the list of instances to heal {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 13 19:44:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "refresh_cache-accae217-e37a-4262-afc2-6084869847b8" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 19:44:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquired lock "refresh_cache-accae217-e37a-4262-afc2-6084869847b8" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 19:44:39 user nova-compute[75216]: DEBUG nova.network.neutron [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: accae217-e37a-4262-afc2-6084869847b8] Forcefully refreshing network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 19:44:39 user nova-compute[75216]: DEBUG nova.objects.instance [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lazy-loading 'info_cache' on Instance uuid accae217-e37a-4262-afc2-6084869847b8 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:44:39 user nova-compute[75216]: DEBUG nova.network.neutron [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: accae217-e37a-4262-afc2-6084869847b8] Updating instance_info_cache with network_info: [{"id": "275d8444-8b2a-49f6-9982-e36f8995180b", "address": "fa:16:3e:0b:a4:f8", "network": {"id": "648aeeec-8ba8-465a-81f4-83012bb2fe16", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-705892923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e85b16b3854c4604a963f680906e6b77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap275d8444-8b", "ovs_interfaceid": "275d8444-8b2a-49f6-9982-e36f8995180b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:44:39 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Releasing lock "refresh_cache-accae217-e37a-4262-afc2-6084869847b8" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 19:44:39 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: accae217-e37a-4262-afc2-6084869847b8] Updated the network info_cache for instance {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 19:44:40 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:44:42 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:44:42 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:44:42 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:44:42 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:44:42 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Auditing locally available compute resources for user (node: user) {{(pid=75216) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 19:44:42 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/accae217-e37a-4262-afc2-6084869847b8/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:44:42 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/accae217-e37a-4262-afc2-6084869847b8/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:44:42 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/accae217-e37a-4262-afc2-6084869847b8/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:44:42 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/accae217-e37a-4262-afc2-6084869847b8/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:44:43 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 19:44:43 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 19:44:43 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Hypervisor/Node resource view: name=user free_ram=8995MB free_disk=25.213607788085938GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75216) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 19:44:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:44:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:44:43 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance accae217-e37a-4262-afc2-6084869847b8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 19:44:43 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 19:44:43 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 19:44:43 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 19:44:43 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 19:44:43 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Compute_service record updated for user:user {{(pid=75216) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 19:44:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.177s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:44:43 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:44:46 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:44:48 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:44:53 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:44:57 user nova-compute[75216]: DEBUG nova.compute.manager [req-ada776e8-b5fc-480d-860f-a6fcdadc53c4 req-01b5cfed-43b4-4383-bf4a-7e234f079c97 service nova] [instance: accae217-e37a-4262-afc2-6084869847b8] Received event network-changed-275d8444-8b2a-49f6-9982-e36f8995180b {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:44:57 user nova-compute[75216]: DEBUG nova.compute.manager [req-ada776e8-b5fc-480d-860f-a6fcdadc53c4 req-01b5cfed-43b4-4383-bf4a-7e234f079c97 service nova] [instance: accae217-e37a-4262-afc2-6084869847b8] Refreshing instance network info cache due to event network-changed-275d8444-8b2a-49f6-9982-e36f8995180b. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 19:44:57 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-ada776e8-b5fc-480d-860f-a6fcdadc53c4 req-01b5cfed-43b4-4383-bf4a-7e234f079c97 service nova] Acquiring lock "refresh_cache-accae217-e37a-4262-afc2-6084869847b8" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 19:44:57 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-ada776e8-b5fc-480d-860f-a6fcdadc53c4 req-01b5cfed-43b4-4383-bf4a-7e234f079c97 service nova] Acquired lock "refresh_cache-accae217-e37a-4262-afc2-6084869847b8" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 19:44:57 user nova-compute[75216]: DEBUG nova.network.neutron [req-ada776e8-b5fc-480d-860f-a6fcdadc53c4 req-01b5cfed-43b4-4383-bf4a-7e234f079c97 service nova] [instance: accae217-e37a-4262-afc2-6084869847b8] Refreshing network info cache for port 275d8444-8b2a-49f6-9982-e36f8995180b {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 19:44:57 user nova-compute[75216]: DEBUG nova.network.neutron [req-ada776e8-b5fc-480d-860f-a6fcdadc53c4 req-01b5cfed-43b4-4383-bf4a-7e234f079c97 service nova] [instance: accae217-e37a-4262-afc2-6084869847b8] Updated VIF entry in instance network info cache for port 275d8444-8b2a-49f6-9982-e36f8995180b. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 19:44:57 user nova-compute[75216]: DEBUG nova.network.neutron [req-ada776e8-b5fc-480d-860f-a6fcdadc53c4 req-01b5cfed-43b4-4383-bf4a-7e234f079c97 service nova] [instance: accae217-e37a-4262-afc2-6084869847b8] Updating instance_info_cache with network_info: [{"id": "275d8444-8b2a-49f6-9982-e36f8995180b", "address": "fa:16:3e:0b:a4:f8", "network": {"id": "648aeeec-8ba8-465a-81f4-83012bb2fe16", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-705892923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e85b16b3854c4604a963f680906e6b77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap275d8444-8b", "ovs_interfaceid": "275d8444-8b2a-49f6-9982-e36f8995180b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:44:57 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-ada776e8-b5fc-480d-860f-a6fcdadc53c4 req-01b5cfed-43b4-4383-bf4a-7e234f079c97 service nova] Releasing lock "refresh_cache-accae217-e37a-4262-afc2-6084869847b8" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 19:44:58 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:44:59 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:44:59 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-28dd89b5-89bd-4787-a411-bd70c013b8f8 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Acquiring lock "accae217-e37a-4262-afc2-6084869847b8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:44:59 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-28dd89b5-89bd-4787-a411-bd70c013b8f8 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Lock "accae217-e37a-4262-afc2-6084869847b8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:44:59 user nova-compute[75216]: DEBUG nova.objects.instance [None req-28dd89b5-89bd-4787-a411-bd70c013b8f8 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Lazy-loading 'flavor' on Instance uuid accae217-e37a-4262-afc2-6084869847b8 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:44:59 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-28dd89b5-89bd-4787-a411-bd70c013b8f8 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Lock "accae217-e37a-4262-afc2-6084869847b8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:45:00 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-28dd89b5-89bd-4787-a411-bd70c013b8f8 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Acquiring lock "accae217-e37a-4262-afc2-6084869847b8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:45:00 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-28dd89b5-89bd-4787-a411-bd70c013b8f8 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Lock "accae217-e37a-4262-afc2-6084869847b8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:45:00 user nova-compute[75216]: INFO nova.compute.manager [None req-28dd89b5-89bd-4787-a411-bd70c013b8f8 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] [instance: accae217-e37a-4262-afc2-6084869847b8] Attaching volume 4c21fd35-6851-4455-9bf4-68393e61e59a to /dev/vdb
Nov 13 19:45:00 user nova-compute[75216]: DEBUG os_brick.utils [None req-28dd89b5-89bd-4787-a411-bd70c013b8f8 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 19:45:00 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:45:00 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:45:00 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[22fc45e9-c4f2-4020-ab2a-1ea9003c2beb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aea6fcfe14b9\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:45:00 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:45:00 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:45:00 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee17ed5e-d5d8-424c-880c-7748c96091c0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:45:00 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:45:00 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:45:00 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe0ce578-a3e7-48f7-a33c-6a475b201083]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:45:00 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[50ce46ab-0d36-4a2d-97a1-e46df3ec1b0a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:45:00 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-28dd89b5-89bd-4787-a411-bd70c013b8f8 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Running cmd (subprocess): nvme version {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:45:00 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-28dd89b5-89bd-4787-a411-bd70c013b8f8 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] 'nvme version' failed. Not Retrying. {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 19:45:00 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.nvmeof [None req-28dd89b5-89bd-4787-a411-bd70c013b8f8 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] nvme not present on system {{(pid=75216) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 19:45:00 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:45:00 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 19:45:00 user nova-compute[75216]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 19:45:00 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[d13efa6b-cb86-4278-8aae-1c0f240893a5]: (4, '') {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:45:00 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-28dd89b5-89bd-4787-a411-bd70c013b8f8 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75216) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 19:45:00 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-28dd89b5-89bd-4787-a411-bd70c013b8f8 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 19:45:00 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-28dd89b5-89bd-4787-a411-bd70c013b8f8 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] LIGHTOS: no hostnqn found. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 19:45:00 user nova-compute[75216]: DEBUG os_brick.utils [None req-28dd89b5-89bd-4787-a411-bd70c013b8f8 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aea6fcfe14b9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 19:45:00 user nova-compute[75216]: DEBUG nova.virt.block_device [None req-28dd89b5-89bd-4787-a411-bd70c013b8f8 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] [instance: accae217-e37a-4262-afc2-6084869847b8] Updating existing volume attachment record: e9417389-ea68-4358-8333-785cdfa29bfb {{(pid=75216) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 19:45:03 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:45:04 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-28dd89b5-89bd-4787-a411-bd70c013b8f8 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] [instance: accae217-e37a-4262-afc2-6084869847b8] Calling os-brick to attach iSCSI Volume {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 19:45:04 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-28dd89b5-89bd-4787-a411-bd70c013b8f8 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3a8669e40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4c21fd35-6851-4455-9bf4-68393e61e59a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WcTHNIYl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 19:45:04 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-28dd89b5-89bd-4787-a411-bd70c013b8f8 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 19:45:04 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-28dd89b5-89bd-4787-a411-bd70c013b8f8 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 19:45:04 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-28dd89b5-89bd-4787-a411-bd70c013b8f8 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 19:45:04 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-28dd89b5-89bd-4787-a411-bd70c013b8f8 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 19:45:04 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-28dd89b5-89bd-4787-a411-bd70c013b8f8 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4c21fd35-6851-4455-9bf4-68393e61e59a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 19:45:04 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-28dd89b5-89bd-4787-a411-bd70c013b8f8 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4c21fd35-6851-4455-9bf4-68393e61e59a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 19:45:04 user nova-compute[75216]: INFO os_brick.initiator.connectors.iscsi [None req-28dd89b5-89bd-4787-a411-bd70c013b8f8 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 19:45:04 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c21fd35-6851-4455-9bf4-68393e61e59a -p 172.16.0.220:3260 {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:45:04 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c21fd35-6851-4455-9bf4-68393e61e59a -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:45:04 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb494876-a5f1-4916-aa41-611b4db5c8ea]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:45:04 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-28dd89b5-89bd-4787-a411-bd70c013b8f8 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 19:45:04 user nova-compute[75216]:  {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:45:04 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c21fd35-6851-4455-9bf4-68393e61e59a -p 172.16.0.220:3260 --interface default --op new {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:45:04 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c21fd35-6851-4455-9bf4-68393e61e59a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:45:04 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c464c92-191d-48e2-a394-3afac08ad0f6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4c21fd35-6851-4455-9bf4-68393e61e59a] added\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:45:04 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-28dd89b5-89bd-4787-a411-bd70c013b8f8 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4c21fd35-6851-4455-9bf4-68393e61e59a] added
Nov 13 19:45:04 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:45:04 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c21fd35-6851-4455-9bf4-68393e61e59a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:45:04 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c21fd35-6851-4455-9bf4-68393e61e59a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:45:04 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[994340b7-c1e3-4198-bf72-bf3a5822c1cb]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:45:04 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-28dd89b5-89bd-4787-a411-bd70c013b8f8 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:45:04 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c21fd35-6851-4455-9bf4-68393e61e59a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:45:04 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c21fd35-6851-4455-9bf4-68393e61e59a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:45:04 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[55a4488f-4e7b-4ec6-8b77-98b11cfb64ab]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:45:04 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-28dd89b5-89bd-4787-a411-bd70c013b8f8 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:45:04 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c21fd35-6851-4455-9bf4-68393e61e59a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WcTHNIYl {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:45:04 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c21fd35-6851-4455-9bf4-68393e61e59a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WcTHNIYl" returned: 0 in 0.019s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:45:04 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[41183319-c3b3-4baf-a751-cc805f6ea972]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:45:04 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-28dd89b5-89bd-4787-a411-bd70c013b8f8 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WcTHNIYl'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:45:04 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c21fd35-6851-4455-9bf4-68393e61e59a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:45:04 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c21fd35-6851-4455-9bf4-68393e61e59a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:45:04 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[f49005af-c5e3-4052-97b2-3fb3b0ea422f]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:45:04 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-28dd89b5-89bd-4787-a411-bd70c013b8f8 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:45:04 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:45:04 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:45:04 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[29235ea8-7270-4da2-92e0-38e9ec4d924e]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:45:04 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-28dd89b5-89bd-4787-a411-bd70c013b8f8 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 13 19:45:04 user nova-compute[75216]:  {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 19:45:04 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-28dd89b5-89bd-4787-a411-bd70c013b8f8 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 13 19:45:04 user nova-compute[75216]:  {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 19:45:04 user nova-compute[75216]: WARNING os_brick.initiator.connectors.iscsi [None req-28dd89b5-89bd-4787-a411-bd70c013b8f8 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 13 19:45:04 user nova-compute[75216]: 
Nov 13 19:45:04 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c21fd35-6851-4455-9bf4-68393e61e59a -p 172.16.0.220:3260 --login {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:45:04 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c21fd35-6851-4455-9bf4-68393e61e59a -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:45:04 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[b26e40d1-5bd3-4e0e-8e16-f9ddbae77f14]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4c21fd35-6851-4455-9bf4-68393e61e59a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4c21fd35-6851-4455-9bf4-68393e61e59a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:45:04 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-28dd89b5-89bd-4787-a411-bd70c013b8f8 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4c21fd35-6851-4455-9bf4-68393e61e59a, portal: 172.16.0.220,3260]
Nov 13 19:45:04 user nova-compute[75216]: Login to [iface: default, target: iqn.2010-10.org.openstack:4c21fd35-6851-4455-9bf4-68393e61e59a, portal: 172.16.0.220,3260] successful.
Nov 13 19:45:04 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:45:04 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c21fd35-6851-4455-9bf4-68393e61e59a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:45:04 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c21fd35-6851-4455-9bf4-68393e61e59a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:45:04 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c50b2a2-a386-43cc-9835-83873624a5df]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:45:04 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-28dd89b5-89bd-4787-a411-bd70c013b8f8 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:45:04 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:45:04 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:45:04 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b2d2d6b-3abb-46c2-96b3-2390207a8b4a]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c21fd35-6851-4455-9bf4-68393e61e59a (non-flash)\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:45:04 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-28dd89b5-89bd-4787-a411-bd70c013b8f8 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c21fd35-6851-4455-9bf4-68393e61e59a (non-flash)
Nov 13 19:45:04 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 19:45:04 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-28dd89b5-89bd-4787-a411-bd70c013b8f8 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c21fd35-6851-4455-9bf4-68393e61e59a (non-flash)
Nov 13 19:45:04 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 19:45:04 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-28dd89b5-89bd-4787-a411-bd70c013b8f8 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4c21fd35-6851-4455-9bf4-68393e61e59a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.262s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 19:45:04 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-28dd89b5-89bd-4787-a411-bd70c013b8f8 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Connected to 172.16.0.220:3260 {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 19:45:04 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-28dd89b5-89bd-4787-a411-bd70c013b8f8 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] HCTL ('33', '-', '-', 0) found on session 60 with lun 0 {{(pid=75216) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 19:45:04 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-28dd89b5-89bd-4787-a411-bd70c013b8f8 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75216) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 19:45:04 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:45:04 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:45:04 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[c58e5dfb-6f31-43e6-89a2-5a1da383d1d7]: (4, ('- - 0', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:45:04 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-28dd89b5-89bd-4787-a411-bd70c013b8f8 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Searching for a device in session 60 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75216) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 19:45:04 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-28dd89b5-89bd-4787-a411-bd70c013b8f8 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:4c21fd35-6851-4455-9bf4-68393e61e59a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WcTHNIYl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 19:45:04 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:45:05 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-28dd89b5-89bd-4787-a411-bd70c013b8f8 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.294s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 19:45:05 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-28dd89b5-89bd-4787-a411-bd70c013b8f8 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] <== connect_volume: return (1297ms) {'type': 'block', 'scsi_wwn': '23036663962376366', 'path': '/dev/sdb'} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 19:45:05 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-28dd89b5-89bd-4787-a411-bd70c013b8f8 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] [instance: accae217-e37a-4262-afc2-6084869847b8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23036663962376366', 'path': '/dev/sdb'} {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 19:45:05 user nova-compute[75216]: DEBUG nova.objects.instance [None req-28dd89b5-89bd-4787-a411-bd70c013b8f8 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Lazy-loading 'flavor' on Instance uuid accae217-e37a-4262-afc2-6084869847b8 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:45:05 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-28dd89b5-89bd-4787-a411-bd70c013b8f8 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] attach device xml: <disk type="block" device="disk">
Nov 13 19:45:05 user nova-compute[75216]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 19:45:05 user nova-compute[75216]:   <source dev="/dev/sdb"/>
Nov 13 19:45:05 user nova-compute[75216]:   <target dev="vdb" bus="virtio"/>
Nov 13 19:45:05 user nova-compute[75216]:   <serial>4c21fd35-6851-4455-9bf4-68393e61e59a</serial>
Nov 13 19:45:05 user nova-compute[75216]: </disk>
Nov 13 19:45:05 user nova-compute[75216]:  {{(pid=75216) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 13 19:45:05 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-28dd89b5-89bd-4787-a411-bd70c013b8f8 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 19:45:05 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-28dd89b5-89bd-4787-a411-bd70c013b8f8 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 19:45:05 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-28dd89b5-89bd-4787-a411-bd70c013b8f8 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] No VIF found with MAC fa:16:3e:0b:a4:f8, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 19:45:05 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-28dd89b5-89bd-4787-a411-bd70c013b8f8 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Lock "accae217-e37a-4262-afc2-6084869847b8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 5.819s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:45:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:45:09 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:45:13 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-09e26e50-26bc-48e1-b7f2-10a16d279778 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Acquiring lock "accae217-e37a-4262-afc2-6084869847b8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:45:13 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-09e26e50-26bc-48e1-b7f2-10a16d279778 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Lock "accae217-e37a-4262-afc2-6084869847b8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:45:13 user nova-compute[75216]: INFO nova.compute.manager [None req-09e26e50-26bc-48e1-b7f2-10a16d279778 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] [instance: accae217-e37a-4262-afc2-6084869847b8] Detaching volume 4c21fd35-6851-4455-9bf4-68393e61e59a
Nov 13 19:45:13 user nova-compute[75216]: INFO nova.virt.block_device [None req-09e26e50-26bc-48e1-b7f2-10a16d279778 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] [instance: accae217-e37a-4262-afc2-6084869847b8] Attempting to driver detach volume 4c21fd35-6851-4455-9bf4-68393e61e59a from mountpoint /dev/vdb
Nov 13 19:45:13 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-09e26e50-26bc-48e1-b7f2-10a16d279778 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Attempting to detach device vdb from instance accae217-e37a-4262-afc2-6084869847b8 from the persistent domain config. {{(pid=75216) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 13 19:45:13 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-09e26e50-26bc-48e1-b7f2-10a16d279778 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 19:45:13 user nova-compute[75216]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 19:45:13 user nova-compute[75216]:   <source dev="/dev/sdb"/>
Nov 13 19:45:13 user nova-compute[75216]:   <target dev="vdb" bus="virtio"/>
Nov 13 19:45:13 user nova-compute[75216]:   <serial>4c21fd35-6851-4455-9bf4-68393e61e59a</serial>
Nov 13 19:45:13 user nova-compute[75216]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 19:45:13 user nova-compute[75216]: </disk>
Nov 13 19:45:13 user nova-compute[75216]:  {{(pid=75216) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 19:45:13 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-09e26e50-26bc-48e1-b7f2-10a16d279778 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Successfully detached device vdb from instance accae217-e37a-4262-afc2-6084869847b8 from the persistent domain config.
Nov 13 19:45:13 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-09e26e50-26bc-48e1-b7f2-10a16d279778 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance accae217-e37a-4262-afc2-6084869847b8 from the live domain config. {{(pid=75216) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 13 19:45:13 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-09e26e50-26bc-48e1-b7f2-10a16d279778 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 19:45:13 user nova-compute[75216]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 19:45:13 user nova-compute[75216]:   <source dev="/dev/sdb"/>
Nov 13 19:45:13 user nova-compute[75216]:   <target dev="vdb" bus="virtio"/>
Nov 13 19:45:13 user nova-compute[75216]:   <serial>4c21fd35-6851-4455-9bf4-68393e61e59a</serial>
Nov 13 19:45:13 user nova-compute[75216]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 19:45:13 user nova-compute[75216]: </disk>
Nov 13 19:45:13 user nova-compute[75216]:  {{(pid=75216) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 19:45:13 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:45:13 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-09e26e50-26bc-48e1-b7f2-10a16d279778 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance accae217-e37a-4262-afc2-6084869847b8 {{(pid=75216) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 13 19:45:14 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:45:18 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:45:23 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:45:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:45:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:45:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:45:31 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:45:33 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:45:33 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-09e26e50-26bc-48e1-b7f2-10a16d279778 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance accae217-e37a-4262-afc2-6084869847b8 is timed out.
Nov 13 19:45:33 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-09e26e50-26bc-48e1-b7f2-10a16d279778 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Successfully detached device vdb from instance accae217-e37a-4262-afc2-6084869847b8 from the live domain config.
Nov 13 19:45:33 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-09e26e50-26bc-48e1-b7f2-10a16d279778 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] [instance: accae217-e37a-4262-afc2-6084869847b8] calling os-brick to detach iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 19:45:33 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-09e26e50-26bc-48e1-b7f2-10a16d279778 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3a8669e40>, {'target_iqn': 'iqn.2010-10.org.openstack:4c21fd35-6851-4455-9bf4-68393e61e59a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WcTHNIYl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 19:45:33 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-09e26e50-26bc-48e1-b7f2-10a16d279778 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 19:45:33 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-09e26e50-26bc-48e1-b7f2-10a16d279778 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 19:45:33 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-09e26e50-26bc-48e1-b7f2-10a16d279778 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 19:45:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:45:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:45:33 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[58e9c0a1-133d-4371-ad8c-cae832bac223]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4c21fd35-6851-4455-9bf4-68393e61e59a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:45:33 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-09e26e50-26bc-48e1-b7f2-10a16d279778 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 19:45:33 user nova-compute[75216]: No targets found.
Nov 13 19:45:33 user nova-compute[75216]: iSNS:
Nov 13 19:45:33 user nova-compute[75216]: No targets found.
Nov 13 19:45:33 user nova-compute[75216]: STATIC:
Nov 13 19:45:33 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:4c21fd35-6851-4455-9bf4-68393e61e59a
Nov 13 19:45:33 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 19:45:33 user nova-compute[75216]:                 Iface Name: default
Nov 13 19:45:33 user nova-compute[75216]: FIRMWARE:
Nov 13 19:45:33 user nova-compute[75216]: No targets found.
Nov 13 19:45:33 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 19:45:33 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-09e26e50-26bc-48e1-b7f2-10a16d279778 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 19:45:33 user nova-compute[75216]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 19:45:33 user nova-compute[75216]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75216) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 19:45:33 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-09e26e50-26bc-48e1-b7f2-10a16d279778 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4c21fd35-6851-4455-9bf4-68393e61e59a', 0)] {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 19:45:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:45:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:45:33 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[246ae940-db69-450b-8a99-12a18c23f771]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4c21fd35-6851-4455-9bf4-68393e61e59a\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:45:33 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:45:34 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:45:34 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[d46dc71f-5a1e-43e1-ac09-2ae99e4be468]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c21fd35-6851-4455-9bf4-68393e61e59a (non-flash)\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:45:34 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-09e26e50-26bc-48e1-b7f2-10a16d279778 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c21fd35-6851-4455-9bf4-68393e61e59a (non-flash)
Nov 13 19:45:34 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 19:45:34 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-09e26e50-26bc-48e1-b7f2-10a16d279778 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c21fd35-6851-4455-9bf4-68393e61e59a (non-flash)
Nov 13 19:45:34 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 19:45:34 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-09e26e50-26bc-48e1-b7f2-10a16d279778 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe3a82ca3b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4c21fd35-6851-4455-9bf4-68393e61e59a'): ({'sdb'}, set())}) {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 19:45:34 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-09e26e50-26bc-48e1-b7f2-10a16d279778 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Removing single pathed devices sdb {{(pid=75216) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 19:45:34 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:45:34 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:45:34 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee1abf9c-ed9d-4c62-aa5d-6e9cf74c0414]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:45:34 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:45:34 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:45:34 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[970192c9-f8e9-4b36-9943-06147e8032a2]: (4, ('ok\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:45:34 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-09e26e50-26bc-48e1-b7f2-10a16d279778 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Flushing IO for device /dev/sdb {{(pid=75216) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 19:45:34 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:45:34 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:45:34 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[45fe2310-61f5-4a02-9326-ccf3157008a3]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:45:34 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-09e26e50-26bc-48e1-b7f2-10a16d279778 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75216) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 19:45:34 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:45:34 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:45:34 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[82ab8039-4c07-41c7-ac4d-72fba79c2761]: (4, ('1', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:45:34 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-09e26e50-26bc-48e1-b7f2-10a16d279778 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 19:45:34 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-09e26e50-26bc-48e1-b7f2-10a16d279778 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] SCSI volumes sdb have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 19:45:34 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-09e26e50-26bc-48e1-b7f2-10a16d279778 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4c21fd35-6851-4455-9bf4-68393e61e59a')] {{(pid=75216) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 19:45:34 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c21fd35-6851-4455-9bf4-68393e61e59a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:45:34 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c21fd35-6851-4455-9bf4-68393e61e59a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:45:34 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f02617c-671e-468e-b686-c0190ff98acb]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:45:34 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-09e26e50-26bc-48e1-b7f2-10a16d279778 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:45:34 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c21fd35-6851-4455-9bf4-68393e61e59a -p 172.16.0.220:3260 --logout {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:45:34 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c21fd35-6851-4455-9bf4-68393e61e59a -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:45:34 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c764728-11e5-4229-94cd-720cd7d1e47c]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:4c21fd35-6851-4455-9bf4-68393e61e59a, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:4c21fd35-6851-4455-9bf4-68393e61e59a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:45:34 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-09e26e50-26bc-48e1-b7f2-10a16d279778 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:4c21fd35-6851-4455-9bf4-68393e61e59a, portal: 172.16.0.220,3260]
Nov 13 19:45:34 user nova-compute[75216]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:4c21fd35-6851-4455-9bf4-68393e61e59a, portal: 172.16.0.220,3260] successful.
Nov 13 19:45:34 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:45:34 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c21fd35-6851-4455-9bf4-68393e61e59a -p 172.16.0.220:3260 --op delete {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:45:34 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c21fd35-6851-4455-9bf4-68393e61e59a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:45:34 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c77eda2-889b-40dc-a2c4-3dd1dd5023e9]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:45:34 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-09e26e50-26bc-48e1-b7f2-10a16d279778 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:45:34 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-09e26e50-26bc-48e1-b7f2-10a16d279778 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.276s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 19:45:34 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-09e26e50-26bc-48e1-b7f2-10a16d279778 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] <== disconnect_volume: return (277ms) None {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 19:45:34 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-09e26e50-26bc-48e1-b7f2-10a16d279778 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] [instance: accae217-e37a-4262-afc2-6084869847b8] Disconnected iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 19:45:34 user nova-compute[75216]: DEBUG nova.objects.instance [None req-09e26e50-26bc-48e1-b7f2-10a16d279778 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Lazy-loading 'flavor' on Instance uuid accae217-e37a-4262-afc2-6084869847b8 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:45:34 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-09e26e50-26bc-48e1-b7f2-10a16d279778 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Lock "accae217-e37a-4262-afc2-6084869847b8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.576s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:45:38 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:45:38 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:45:38 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:45:38 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75216) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 19:45:38 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:45:40 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:45:40 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Starting heal instance info cache {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 19:45:40 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Rebuilding the list of instances to heal {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 13 19:45:40 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "refresh_cache-accae217-e37a-4262-afc2-6084869847b8" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 19:45:40 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquired lock "refresh_cache-accae217-e37a-4262-afc2-6084869847b8" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 19:45:40 user nova-compute[75216]: DEBUG nova.network.neutron [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: accae217-e37a-4262-afc2-6084869847b8] Forcefully refreshing network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 19:45:40 user nova-compute[75216]: DEBUG nova.objects.instance [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lazy-loading 'info_cache' on Instance uuid accae217-e37a-4262-afc2-6084869847b8 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:45:40 user nova-compute[75216]: DEBUG nova.network.neutron [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: accae217-e37a-4262-afc2-6084869847b8] Updating instance_info_cache with network_info: [{"id": "275d8444-8b2a-49f6-9982-e36f8995180b", "address": "fa:16:3e:0b:a4:f8", "network": {"id": "648aeeec-8ba8-465a-81f4-83012bb2fe16", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-705892923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e85b16b3854c4604a963f680906e6b77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap275d8444-8b", "ovs_interfaceid": "275d8444-8b2a-49f6-9982-e36f8995180b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:45:40 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Releasing lock "refresh_cache-accae217-e37a-4262-afc2-6084869847b8" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 19:45:40 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: accae217-e37a-4262-afc2-6084869847b8] Updated the network info_cache for instance {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 19:45:42 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:45:43 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:45:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:45:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:45:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:45:43 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Auditing locally available compute resources for user (node: user) {{(pid=75216) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 19:45:43 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/accae217-e37a-4262-afc2-6084869847b8/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:45:43 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:45:43 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/accae217-e37a-4262-afc2-6084869847b8/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:45:43 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/accae217-e37a-4262-afc2-6084869847b8/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:45:43 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/accae217-e37a-4262-afc2-6084869847b8/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:45:44 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 19:45:44 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 19:45:44 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Hypervisor/Node resource view: name=user free_ram=8964MB free_disk=25.212284088134766GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75216) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 19:45:44 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:45:44 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:45:44 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance accae217-e37a-4262-afc2-6084869847b8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 19:45:44 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 19:45:44 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 19:45:44 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 19:45:44 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 19:45:44 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Compute_service record updated for user:user {{(pid=75216) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 19:45:44 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.158s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:45:48 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:45:48 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:45:53 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:45:58 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:46:03 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:46:04 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:46:05 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a579cace-d49f-4bb9-8f65-3d0431b5a733 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Acquiring lock "accae217-e37a-4262-afc2-6084869847b8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:46:05 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a579cace-d49f-4bb9-8f65-3d0431b5a733 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Lock "accae217-e37a-4262-afc2-6084869847b8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:46:05 user nova-compute[75216]: DEBUG nova.objects.instance [None req-a579cace-d49f-4bb9-8f65-3d0431b5a733 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Lazy-loading 'flavor' on Instance uuid accae217-e37a-4262-afc2-6084869847b8 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:46:05 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a579cace-d49f-4bb9-8f65-3d0431b5a733 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Lock "accae217-e37a-4262-afc2-6084869847b8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:46:05 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a579cace-d49f-4bb9-8f65-3d0431b5a733 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Acquiring lock "accae217-e37a-4262-afc2-6084869847b8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:46:05 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a579cace-d49f-4bb9-8f65-3d0431b5a733 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Lock "accae217-e37a-4262-afc2-6084869847b8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:46:05 user nova-compute[75216]: INFO nova.compute.manager [None req-a579cace-d49f-4bb9-8f65-3d0431b5a733 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] [instance: accae217-e37a-4262-afc2-6084869847b8] Attaching volume 5e3cb0b0-5ce9-4795-a7bc-b8d5214a5080 to /dev/vdb
Nov 13 19:46:05 user nova-compute[75216]: DEBUG os_brick.utils [None req-a579cace-d49f-4bb9-8f65-3d0431b5a733 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 19:46:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:46:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:46:05 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[80d29ec9-8d15-42dd-9bb0-46c48598e4fe]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aea6fcfe14b9\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:46:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:46:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:46:05 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[aba6db72-ff6c-429c-8856-242f502dabf4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:46:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:46:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:46:05 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[90a1a8be-eca1-4a4f-82e7-f79e1a5701b6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:46:05 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[f52688f6-7da8-48ce-80c9-b24a073a3a77]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:46:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-a579cace-d49f-4bb9-8f65-3d0431b5a733 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Running cmd (subprocess): nvme version {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:46:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-a579cace-d49f-4bb9-8f65-3d0431b5a733 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] 'nvme version' failed. Not Retrying. {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 19:46:05 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a579cace-d49f-4bb9-8f65-3d0431b5a733 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] nvme not present on system {{(pid=75216) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 19:46:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:46:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 19:46:05 user nova-compute[75216]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 19:46:05 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[80116baa-64cd-42d4-8f97-a9f6309ddb1e]: (4, '') {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:46:05 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-a579cace-d49f-4bb9-8f65-3d0431b5a733 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75216) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 19:46:05 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-a579cace-d49f-4bb9-8f65-3d0431b5a733 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 19:46:05 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-a579cace-d49f-4bb9-8f65-3d0431b5a733 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] LIGHTOS: no hostnqn found. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 19:46:05 user nova-compute[75216]: DEBUG os_brick.utils [None req-a579cace-d49f-4bb9-8f65-3d0431b5a733 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aea6fcfe14b9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 19:46:05 user nova-compute[75216]: DEBUG nova.virt.block_device [None req-a579cace-d49f-4bb9-8f65-3d0431b5a733 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] [instance: accae217-e37a-4262-afc2-6084869847b8] Updating existing volume attachment record: 2db19eda-ddbf-4bac-9eef-b27007cb3a66 {{(pid=75216) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 19:46:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:46:09 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:46:10 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a579cace-d49f-4bb9-8f65-3d0431b5a733 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] [instance: accae217-e37a-4262-afc2-6084869847b8] Calling os-brick to attach iSCSI Volume {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 19:46:10 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a579cace-d49f-4bb9-8f65-3d0431b5a733 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3a8669e40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5e3cb0b0-5ce9-4795-a7bc-b8d5214a5080', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BThXfUip', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 19:46:10 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-a579cace-d49f-4bb9-8f65-3d0431b5a733 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 19:46:10 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-a579cace-d49f-4bb9-8f65-3d0431b5a733 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 19:46:10 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-a579cace-d49f-4bb9-8f65-3d0431b5a733 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 19:46:10 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-a579cace-d49f-4bb9-8f65-3d0431b5a733 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 19:46:10 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-a579cace-d49f-4bb9-8f65-3d0431b5a733 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5e3cb0b0-5ce9-4795-a7bc-b8d5214a5080" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 19:46:10 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-a579cace-d49f-4bb9-8f65-3d0431b5a733 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5e3cb0b0-5ce9-4795-a7bc-b8d5214a5080" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 19:46:10 user nova-compute[75216]: INFO os_brick.initiator.connectors.iscsi [None req-a579cace-d49f-4bb9-8f65-3d0431b5a733 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 19:46:10 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e3cb0b0-5ce9-4795-a7bc-b8d5214a5080 -p 172.16.0.220:3260 {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:46:10 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e3cb0b0-5ce9-4795-a7bc-b8d5214a5080 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:46:10 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5599b6e-c4d7-4b43-ae18-38bb7dfab5f7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:46:10 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a579cace-d49f-4bb9-8f65-3d0431b5a733 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 19:46:10 user nova-compute[75216]:  {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:46:10 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e3cb0b0-5ce9-4795-a7bc-b8d5214a5080 -p 172.16.0.220:3260 --interface default --op new {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:46:10 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e3cb0b0-5ce9-4795-a7bc-b8d5214a5080 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:46:10 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e768bce-c456-4a7b-94cc-6ba1c7b4fee1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5e3cb0b0-5ce9-4795-a7bc-b8d5214a5080] added\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:46:10 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a579cace-d49f-4bb9-8f65-3d0431b5a733 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5e3cb0b0-5ce9-4795-a7bc-b8d5214a5080] added
Nov 13 19:46:10 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:46:10 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e3cb0b0-5ce9-4795-a7bc-b8d5214a5080 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:46:10 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e3cb0b0-5ce9-4795-a7bc-b8d5214a5080 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:46:10 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3a85216-b3ca-48b8-b77f-4ca396d6ac0f]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:46:10 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a579cace-d49f-4bb9-8f65-3d0431b5a733 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:46:10 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e3cb0b0-5ce9-4795-a7bc-b8d5214a5080 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:46:10 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e3cb0b0-5ce9-4795-a7bc-b8d5214a5080 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:46:10 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[919015e0-9df2-4292-ba5d-4fa088c396ed]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:46:10 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a579cace-d49f-4bb9-8f65-3d0431b5a733 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:46:10 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e3cb0b0-5ce9-4795-a7bc-b8d5214a5080 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BThXfUip {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:46:10 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e3cb0b0-5ce9-4795-a7bc-b8d5214a5080 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BThXfUip" returned: 0 in 0.017s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:46:10 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8cdfe84-378a-4d30-9520-36e9711cef94]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:46:10 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a579cace-d49f-4bb9-8f65-3d0431b5a733 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BThXfUip'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:46:10 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e3cb0b0-5ce9-4795-a7bc-b8d5214a5080 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:46:10 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e3cb0b0-5ce9-4795-a7bc-b8d5214a5080 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:46:10 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[35041d68-dccd-457f-b8db-0ef2c3531d4b]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:46:10 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a579cace-d49f-4bb9-8f65-3d0431b5a733 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:46:10 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:46:10 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:46:10 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[83bf33fb-0117-4d7c-95f3-120951e79eb9]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:46:10 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a579cace-d49f-4bb9-8f65-3d0431b5a733 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 13 19:46:10 user nova-compute[75216]:  {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 19:46:10 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a579cace-d49f-4bb9-8f65-3d0431b5a733 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 13 19:46:10 user nova-compute[75216]:  {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 19:46:10 user nova-compute[75216]: WARNING os_brick.initiator.connectors.iscsi [None req-a579cace-d49f-4bb9-8f65-3d0431b5a733 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 13 19:46:10 user nova-compute[75216]: 
Nov 13 19:46:10 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e3cb0b0-5ce9-4795-a7bc-b8d5214a5080 -p 172.16.0.220:3260 --login {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:46:10 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e3cb0b0-5ce9-4795-a7bc-b8d5214a5080 -p 172.16.0.220:3260 --login" returned: 0 in 0.042s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:46:10 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1397c5a-23fe-4b3d-a9b5-fac460a0c0fc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5e3cb0b0-5ce9-4795-a7bc-b8d5214a5080, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5e3cb0b0-5ce9-4795-a7bc-b8d5214a5080, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:46:10 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a579cace-d49f-4bb9-8f65-3d0431b5a733 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5e3cb0b0-5ce9-4795-a7bc-b8d5214a5080, portal: 172.16.0.220,3260]
Nov 13 19:46:10 user nova-compute[75216]: Login to [iface: default, target: iqn.2010-10.org.openstack:5e3cb0b0-5ce9-4795-a7bc-b8d5214a5080, portal: 172.16.0.220,3260] successful.
Nov 13 19:46:10 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:46:10 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e3cb0b0-5ce9-4795-a7bc-b8d5214a5080 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:46:10 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e3cb0b0-5ce9-4795-a7bc-b8d5214a5080 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:46:10 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae604674-9b44-4bab-89f3-01b525cd738a]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:46:10 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a579cace-d49f-4bb9-8f65-3d0431b5a733 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:46:10 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:46:10 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:46:10 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[45ac3d16-30a6-4cc3-958f-cfa5fcd0b052]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e3cb0b0-5ce9-4795-a7bc-b8d5214a5080 (non-flash)\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:46:10 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a579cace-d49f-4bb9-8f65-3d0431b5a733 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e3cb0b0-5ce9-4795-a7bc-b8d5214a5080 (non-flash)
Nov 13 19:46:10 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 19:46:10 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a579cace-d49f-4bb9-8f65-3d0431b5a733 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e3cb0b0-5ce9-4795-a7bc-b8d5214a5080 (non-flash)
Nov 13 19:46:10 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 19:46:10 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-a579cace-d49f-4bb9-8f65-3d0431b5a733 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5e3cb0b0-5ce9-4795-a7bc-b8d5214a5080" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.242s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 19:46:10 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a579cace-d49f-4bb9-8f65-3d0431b5a733 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Connected to 172.16.0.220:3260 {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 19:46:10 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-a579cace-d49f-4bb9-8f65-3d0431b5a733 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] HCTL ('33', '-', '-', 0) found on session 61 with lun 0 {{(pid=75216) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 19:46:10 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-a579cace-d49f-4bb9-8f65-3d0431b5a733 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75216) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 19:46:10 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:46:10 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:46:10 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac7eeb6c-5174-4537-b622-d7e48ed0ae8a]: (4, ('- - 0', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:46:10 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-a579cace-d49f-4bb9-8f65-3d0431b5a733 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Searching for a device in session 61 and hctl ['33', '*', '*', 0] yield: None {{(pid=75216) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 19:46:11 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-a579cace-d49f-4bb9-8f65-3d0431b5a733 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Searching for a device in session 61 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75216) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 19:46:11 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a579cace-d49f-4bb9-8f65-3d0431b5a733 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:5e3cb0b0-5ce9-4795-a7bc-b8d5214a5080', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BThXfUip', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 19:46:11 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-a579cace-d49f-4bb9-8f65-3d0431b5a733 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.270s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 19:46:11 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-a579cace-d49f-4bb9-8f65-3d0431b5a733 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] <== connect_volume: return (1272ms) {'type': 'block', 'scsi_wwn': '23733643631353833', 'path': '/dev/sdb'} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 19:46:11 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a579cace-d49f-4bb9-8f65-3d0431b5a733 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] [instance: accae217-e37a-4262-afc2-6084869847b8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23733643631353833', 'path': '/dev/sdb'} {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 19:46:11 user nova-compute[75216]: DEBUG nova.objects.instance [None req-a579cace-d49f-4bb9-8f65-3d0431b5a733 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Lazy-loading 'flavor' on Instance uuid accae217-e37a-4262-afc2-6084869847b8 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:46:11 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-a579cace-d49f-4bb9-8f65-3d0431b5a733 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] attach device xml: <disk type="block" device="disk">
Nov 13 19:46:11 user nova-compute[75216]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 19:46:11 user nova-compute[75216]:   <source dev="/dev/sdb"/>
Nov 13 19:46:11 user nova-compute[75216]:   <target dev="vdb" bus="virtio"/>
Nov 13 19:46:11 user nova-compute[75216]:   <serial>5e3cb0b0-5ce9-4795-a7bc-b8d5214a5080</serial>
Nov 13 19:46:11 user nova-compute[75216]: </disk>
Nov 13 19:46:11 user nova-compute[75216]:  {{(pid=75216) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 13 19:46:11 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-a579cace-d49f-4bb9-8f65-3d0431b5a733 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 19:46:11 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-a579cace-d49f-4bb9-8f65-3d0431b5a733 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 19:46:11 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-a579cace-d49f-4bb9-8f65-3d0431b5a733 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] No VIF found with MAC fa:16:3e:0b:a4:f8, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 19:46:11 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a579cace-d49f-4bb9-8f65-3d0431b5a733 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Lock "accae217-e37a-4262-afc2-6084869847b8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.352s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:46:13 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e1236918-c163-4c4a-851e-a8b13018f236 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Acquiring lock "accae217-e37a-4262-afc2-6084869847b8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:46:13 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e1236918-c163-4c4a-851e-a8b13018f236 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Lock "accae217-e37a-4262-afc2-6084869847b8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:46:13 user nova-compute[75216]: INFO nova.compute.manager [None req-e1236918-c163-4c4a-851e-a8b13018f236 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] [instance: accae217-e37a-4262-afc2-6084869847b8] Detaching volume 5e3cb0b0-5ce9-4795-a7bc-b8d5214a5080
Nov 13 19:46:13 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:46:13 user nova-compute[75216]: INFO nova.virt.block_device [None req-e1236918-c163-4c4a-851e-a8b13018f236 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] [instance: accae217-e37a-4262-afc2-6084869847b8] Attempting to driver detach volume 5e3cb0b0-5ce9-4795-a7bc-b8d5214a5080 from mountpoint /dev/vdb
Nov 13 19:46:13 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-e1236918-c163-4c4a-851e-a8b13018f236 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Attempting to detach device vdb from instance accae217-e37a-4262-afc2-6084869847b8 from the persistent domain config. {{(pid=75216) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 13 19:46:13 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-e1236918-c163-4c4a-851e-a8b13018f236 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 19:46:13 user nova-compute[75216]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 19:46:13 user nova-compute[75216]:   <source dev="/dev/sdb"/>
Nov 13 19:46:13 user nova-compute[75216]:   <target dev="vdb" bus="virtio"/>
Nov 13 19:46:13 user nova-compute[75216]:   <serial>5e3cb0b0-5ce9-4795-a7bc-b8d5214a5080</serial>
Nov 13 19:46:13 user nova-compute[75216]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 19:46:13 user nova-compute[75216]: </disk>
Nov 13 19:46:13 user nova-compute[75216]:  {{(pid=75216) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 19:46:13 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-e1236918-c163-4c4a-851e-a8b13018f236 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Successfully detached device vdb from instance accae217-e37a-4262-afc2-6084869847b8 from the persistent domain config.
Nov 13 19:46:13 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-e1236918-c163-4c4a-851e-a8b13018f236 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance accae217-e37a-4262-afc2-6084869847b8 from the live domain config. {{(pid=75216) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 13 19:46:13 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-e1236918-c163-4c4a-851e-a8b13018f236 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 19:46:13 user nova-compute[75216]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 19:46:13 user nova-compute[75216]:   <source dev="/dev/sdb"/>
Nov 13 19:46:13 user nova-compute[75216]:   <target dev="vdb" bus="virtio"/>
Nov 13 19:46:13 user nova-compute[75216]:   <serial>5e3cb0b0-5ce9-4795-a7bc-b8d5214a5080</serial>
Nov 13 19:46:13 user nova-compute[75216]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 19:46:13 user nova-compute[75216]: </disk>
Nov 13 19:46:13 user nova-compute[75216]:  {{(pid=75216) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 19:46:14 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-e1236918-c163-4c4a-851e-a8b13018f236 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance accae217-e37a-4262-afc2-6084869847b8 {{(pid=75216) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 13 19:46:14 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:46:18 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:46:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:46:25 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:46:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:46:33 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:46:33 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:46:34 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-e1236918-c163-4c4a-851e-a8b13018f236 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance accae217-e37a-4262-afc2-6084869847b8 is timed out.
Nov 13 19:46:34 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-e1236918-c163-4c4a-851e-a8b13018f236 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Successfully detached device vdb from instance accae217-e37a-4262-afc2-6084869847b8 from the live domain config.
Nov 13 19:46:34 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e1236918-c163-4c4a-851e-a8b13018f236 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] [instance: accae217-e37a-4262-afc2-6084869847b8] calling os-brick to detach iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 19:46:34 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1236918-c163-4c4a-851e-a8b13018f236 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3a8669e40>, {'target_iqn': 'iqn.2010-10.org.openstack:5e3cb0b0-5ce9-4795-a7bc-b8d5214a5080', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BThXfUip', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 19:46:34 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-e1236918-c163-4c4a-851e-a8b13018f236 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 19:46:34 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-e1236918-c163-4c4a-851e-a8b13018f236 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 19:46:34 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-e1236918-c163-4c4a-851e-a8b13018f236 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 19:46:34 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:46:34 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:46:34 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[15d4c420-bc97-4fcd-b3fa-2da913d5dd52]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5e3cb0b0-5ce9-4795-a7bc-b8d5214a5080\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:46:34 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1236918-c163-4c4a-851e-a8b13018f236 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 19:46:34 user nova-compute[75216]: No targets found.
Nov 13 19:46:34 user nova-compute[75216]: iSNS:
Nov 13 19:46:34 user nova-compute[75216]: No targets found.
Nov 13 19:46:34 user nova-compute[75216]: STATIC:
Nov 13 19:46:34 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:5e3cb0b0-5ce9-4795-a7bc-b8d5214a5080
Nov 13 19:46:34 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 19:46:34 user nova-compute[75216]:                 Iface Name: default
Nov 13 19:46:34 user nova-compute[75216]: FIRMWARE:
Nov 13 19:46:34 user nova-compute[75216]: No targets found.
Nov 13 19:46:34 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 19:46:34 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1236918-c163-4c4a-851e-a8b13018f236 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 19:46:34 user nova-compute[75216]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 19:46:34 user nova-compute[75216]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75216) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 19:46:34 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1236918-c163-4c4a-851e-a8b13018f236 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5e3cb0b0-5ce9-4795-a7bc-b8d5214a5080', 0)] {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 19:46:34 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:46:34 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:46:34 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4dac444-1819-4384-87d7-2e27ca63a266]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5e3cb0b0-5ce9-4795-a7bc-b8d5214a5080\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:46:34 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:46:34 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:46:34 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[61d95ec3-3370-465a-b194-96808397f9b8]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e3cb0b0-5ce9-4795-a7bc-b8d5214a5080 (non-flash)\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:46:34 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1236918-c163-4c4a-851e-a8b13018f236 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e3cb0b0-5ce9-4795-a7bc-b8d5214a5080 (non-flash)
Nov 13 19:46:34 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 19:46:34 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1236918-c163-4c4a-851e-a8b13018f236 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e3cb0b0-5ce9-4795-a7bc-b8d5214a5080 (non-flash)
Nov 13 19:46:34 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 19:46:34 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1236918-c163-4c4a-851e-a8b13018f236 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe3c02993f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5e3cb0b0-5ce9-4795-a7bc-b8d5214a5080'): ({'sdb'}, set())}) {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 19:46:34 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-e1236918-c163-4c4a-851e-a8b13018f236 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Removing single pathed devices sdb {{(pid=75216) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 19:46:34 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:46:34 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:46:34 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5146e5c-b224-42ec-a3fa-d58c72b8ebd6]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:46:34 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:46:34 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:46:34 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e08bb85-b262-4b5a-b465-684bed0bbdec]: (4, ('ok\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:46:34 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-e1236918-c163-4c4a-851e-a8b13018f236 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Flushing IO for device /dev/sdb {{(pid=75216) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 19:46:34 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:46:34 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:46:34 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[3083ad1c-13e5-4389-bd91-4e71c8a7860b]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:46:34 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-e1236918-c163-4c4a-851e-a8b13018f236 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75216) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 19:46:34 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:46:34 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.058s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:46:34 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e84108f-4397-43e4-bc95-c0fc55f637b9]: (4, ('1', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:46:34 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-e1236918-c163-4c4a-851e-a8b13018f236 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 19:46:34 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-e1236918-c163-4c4a-851e-a8b13018f236 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] SCSI volumes sdb have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 19:46:34 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1236918-c163-4c4a-851e-a8b13018f236 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5e3cb0b0-5ce9-4795-a7bc-b8d5214a5080')] {{(pid=75216) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 19:46:34 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e3cb0b0-5ce9-4795-a7bc-b8d5214a5080 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:46:34 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e3cb0b0-5ce9-4795-a7bc-b8d5214a5080 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:46:34 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[949d789e-4a4f-4d04-9ccc-ef27676bb372]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:46:34 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1236918-c163-4c4a-851e-a8b13018f236 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:46:34 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e3cb0b0-5ce9-4795-a7bc-b8d5214a5080 -p 172.16.0.220:3260 --logout {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:46:34 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e3cb0b0-5ce9-4795-a7bc-b8d5214a5080 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:46:34 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6fcf930-8191-4ed6-92d7-2125e3f74d89]: (4, ('Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:5e3cb0b0-5ce9-4795-a7bc-b8d5214a5080, portal: 172.16.0.220,3260]\nLogout of [sid: 61, target: iqn.2010-10.org.openstack:5e3cb0b0-5ce9-4795-a7bc-b8d5214a5080, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:46:34 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1236918-c163-4c4a-851e-a8b13018f236 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:5e3cb0b0-5ce9-4795-a7bc-b8d5214a5080, portal: 172.16.0.220,3260]
Nov 13 19:46:34 user nova-compute[75216]: Logout of [sid: 61, target: iqn.2010-10.org.openstack:5e3cb0b0-5ce9-4795-a7bc-b8d5214a5080, portal: 172.16.0.220,3260] successful.
Nov 13 19:46:34 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:46:34 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e3cb0b0-5ce9-4795-a7bc-b8d5214a5080 -p 172.16.0.220:3260 --op delete {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:46:34 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e3cb0b0-5ce9-4795-a7bc-b8d5214a5080 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:46:34 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[bed7c858-366c-451e-9a0c-b79c54d927a9]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:46:34 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1236918-c163-4c4a-851e-a8b13018f236 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:46:34 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-e1236918-c163-4c4a-851e-a8b13018f236 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.340s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 19:46:34 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1236918-c163-4c4a-851e-a8b13018f236 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] <== disconnect_volume: return (341ms) None {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 19:46:34 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e1236918-c163-4c4a-851e-a8b13018f236 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] [instance: accae217-e37a-4262-afc2-6084869847b8] Disconnected iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 19:46:35 user nova-compute[75216]: DEBUG nova.objects.instance [None req-e1236918-c163-4c4a-851e-a8b13018f236 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Lazy-loading 'flavor' on Instance uuid accae217-e37a-4262-afc2-6084869847b8 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:46:35 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e1236918-c163-4c4a-851e-a8b13018f236 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Lock "accae217-e37a-4262-afc2-6084869847b8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.688s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:46:38 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:46:38 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:46:39 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:46:40 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:46:40 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75216) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 19:46:41 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:46:41 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Starting heal instance info cache {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 19:46:41 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Rebuilding the list of instances to heal {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 13 19:46:41 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "refresh_cache-accae217-e37a-4262-afc2-6084869847b8" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 19:46:41 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquired lock "refresh_cache-accae217-e37a-4262-afc2-6084869847b8" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 19:46:41 user nova-compute[75216]: DEBUG nova.network.neutron [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: accae217-e37a-4262-afc2-6084869847b8] Forcefully refreshing network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 19:46:41 user nova-compute[75216]: DEBUG nova.objects.instance [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lazy-loading 'info_cache' on Instance uuid accae217-e37a-4262-afc2-6084869847b8 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:46:41 user nova-compute[75216]: DEBUG nova.network.neutron [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: accae217-e37a-4262-afc2-6084869847b8] Updating instance_info_cache with network_info: [{"id": "275d8444-8b2a-49f6-9982-e36f8995180b", "address": "fa:16:3e:0b:a4:f8", "network": {"id": "648aeeec-8ba8-465a-81f4-83012bb2fe16", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-705892923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e85b16b3854c4604a963f680906e6b77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap275d8444-8b", "ovs_interfaceid": "275d8444-8b2a-49f6-9982-e36f8995180b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:46:41 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Releasing lock "refresh_cache-accae217-e37a-4262-afc2-6084869847b8" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 19:46:41 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: accae217-e37a-4262-afc2-6084869847b8] Updated the network info_cache for instance {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 19:46:42 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:46:43 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:46:45 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:46:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:46:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:46:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:46:45 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Auditing locally available compute resources for user (node: user) {{(pid=75216) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 19:46:45 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/accae217-e37a-4262-afc2-6084869847b8/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:46:45 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/accae217-e37a-4262-afc2-6084869847b8/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:46:45 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/accae217-e37a-4262-afc2-6084869847b8/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:46:45 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/accae217-e37a-4262-afc2-6084869847b8/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:46:46 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 19:46:46 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 19:46:46 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Hypervisor/Node resource view: name=user free_ram=8972MB free_disk=25.21137237548828GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75216) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 19:46:46 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:46:46 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:46:46 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance accae217-e37a-4262-afc2-6084869847b8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 19:46:46 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 19:46:46 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 19:46:46 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Refreshing inventories for resource provider d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 13 19:46:46 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Updating ProviderTree inventory for provider d927e00d-5a8b-43f7-ac04-6437958fac1f from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 13 19:46:46 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Updating inventory in ProviderTree for provider d927e00d-5a8b-43f7-ac04-6437958fac1f with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 13 19:46:46 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Refreshing aggregate associations for resource provider d927e00d-5a8b-43f7-ac04-6437958fac1f, aggregates: None {{(pid=75216) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 13 19:46:46 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Refreshing trait associations for resource provider d927e00d-5a8b-43f7-ac04-6437958fac1f, traits: COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_MMX {{(pid=75216) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 13 19:46:46 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 19:46:46 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 19:46:46 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Compute_service record updated for user:user {{(pid=75216) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 19:46:46 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.274s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:46:48 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:46:49 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:46:51 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:46:53 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:46:53 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:46:53 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75216) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 19:46:53 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 19:46:53 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 19:46:53 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:46:57 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:46:57 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Cleaning up deleted instances {{(pid=75216) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 13 19:46:57 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] There are 0 instances to clean {{(pid=75216) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 13 19:46:58 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:46:58 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:46:58 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75216) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 19:46:58 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 19:46:58 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 19:46:58 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:47:02 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:47:02 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75216) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 13 19:47:03 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:47:05 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-8807a7e7-ef78-40b8-9bd2-cdde2e907374 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Acquiring lock "accae217-e37a-4262-afc2-6084869847b8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:47:05 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-8807a7e7-ef78-40b8-9bd2-cdde2e907374 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Lock "accae217-e37a-4262-afc2-6084869847b8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:47:05 user nova-compute[75216]: DEBUG nova.objects.instance [None req-8807a7e7-ef78-40b8-9bd2-cdde2e907374 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Lazy-loading 'flavor' on Instance uuid accae217-e37a-4262-afc2-6084869847b8 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:47:05 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-8807a7e7-ef78-40b8-9bd2-cdde2e907374 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Lock "accae217-e37a-4262-afc2-6084869847b8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:47:05 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-8807a7e7-ef78-40b8-9bd2-cdde2e907374 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Acquiring lock "accae217-e37a-4262-afc2-6084869847b8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:47:05 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-8807a7e7-ef78-40b8-9bd2-cdde2e907374 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Lock "accae217-e37a-4262-afc2-6084869847b8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:47:05 user nova-compute[75216]: INFO nova.compute.manager [None req-8807a7e7-ef78-40b8-9bd2-cdde2e907374 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] [instance: accae217-e37a-4262-afc2-6084869847b8] Attaching volume f0363abd-ec55-42a3-91ea-fe5fd43919c6 to /dev/vdb
Nov 13 19:47:05 user nova-compute[75216]: DEBUG os_brick.utils [None req-8807a7e7-ef78-40b8-9bd2-cdde2e907374 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 19:47:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:47:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:47:05 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e419b6f-fafa-4bf8-a988-f704c7e519b7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aea6fcfe14b9\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:47:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:47:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:47:05 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[514c84d5-5bf4-4c55-a186-477267e89ee5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:47:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:47:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:47:05 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7dac4f0-e449-47b4-bf09-d6fe532ceda9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:47:05 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[d609afad-7200-42a3-97f5-ee0de3891b8a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:47:05 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-8807a7e7-ef78-40b8-9bd2-cdde2e907374 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Running cmd (subprocess): nvme version {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:47:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-8807a7e7-ef78-40b8-9bd2-cdde2e907374 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] 'nvme version' failed. Not Retrying. {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 19:47:06 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8807a7e7-ef78-40b8-9bd2-cdde2e907374 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] nvme not present on system {{(pid=75216) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 19:47:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:47:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 19:47:06 user nova-compute[75216]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 19:47:06 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[282d7631-a74c-46b2-9b15-c4a44c807bea]: (4, '') {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:47:06 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-8807a7e7-ef78-40b8-9bd2-cdde2e907374 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75216) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 19:47:06 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-8807a7e7-ef78-40b8-9bd2-cdde2e907374 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 19:47:06 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-8807a7e7-ef78-40b8-9bd2-cdde2e907374 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] LIGHTOS: no hostnqn found. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 19:47:06 user nova-compute[75216]: DEBUG os_brick.utils [None req-8807a7e7-ef78-40b8-9bd2-cdde2e907374 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aea6fcfe14b9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 19:47:06 user nova-compute[75216]: DEBUG nova.virt.block_device [None req-8807a7e7-ef78-40b8-9bd2-cdde2e907374 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] [instance: accae217-e37a-4262-afc2-6084869847b8] Updating existing volume attachment record: 4e5929ab-6c96-49b8-b9b9-1304cefda862 {{(pid=75216) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 19:47:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:47:09 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:47:10 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8807a7e7-ef78-40b8-9bd2-cdde2e907374 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] [instance: accae217-e37a-4262-afc2-6084869847b8] Calling os-brick to attach iSCSI Volume {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 19:47:10 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-8807a7e7-ef78-40b8-9bd2-cdde2e907374 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3a8669e40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f0363abd-ec55-42a3-91ea-fe5fd43919c6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nglqreNI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 19:47:10 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-8807a7e7-ef78-40b8-9bd2-cdde2e907374 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 19:47:10 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-8807a7e7-ef78-40b8-9bd2-cdde2e907374 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 19:47:10 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-8807a7e7-ef78-40b8-9bd2-cdde2e907374 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 19:47:10 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-8807a7e7-ef78-40b8-9bd2-cdde2e907374 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 19:47:10 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-8807a7e7-ef78-40b8-9bd2-cdde2e907374 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f0363abd-ec55-42a3-91ea-fe5fd43919c6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 19:47:10 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-8807a7e7-ef78-40b8-9bd2-cdde2e907374 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f0363abd-ec55-42a3-91ea-fe5fd43919c6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 19:47:10 user nova-compute[75216]: INFO os_brick.initiator.connectors.iscsi [None req-8807a7e7-ef78-40b8-9bd2-cdde2e907374 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 19:47:10 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0363abd-ec55-42a3-91ea-fe5fd43919c6 -p 172.16.0.220:3260 {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:47:10 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0363abd-ec55-42a3-91ea-fe5fd43919c6 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:47:10 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd2864e6-ab95-47cb-ab77-8b13f518ebca]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:47:10 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-8807a7e7-ef78-40b8-9bd2-cdde2e907374 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 19:47:10 user nova-compute[75216]:  {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:47:10 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0363abd-ec55-42a3-91ea-fe5fd43919c6 -p 172.16.0.220:3260 --interface default --op new {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:47:10 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0363abd-ec55-42a3-91ea-fe5fd43919c6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:47:10 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b451271-7387-4bc3-9c79-9642da7d07f9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f0363abd-ec55-42a3-91ea-fe5fd43919c6] added\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:47:10 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-8807a7e7-ef78-40b8-9bd2-cdde2e907374 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f0363abd-ec55-42a3-91ea-fe5fd43919c6] added
Nov 13 19:47:10 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:47:10 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0363abd-ec55-42a3-91ea-fe5fd43919c6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:47:10 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0363abd-ec55-42a3-91ea-fe5fd43919c6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:47:10 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[e21ec6f5-092f-48bc-a274-57f012fb7c9e]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:47:10 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-8807a7e7-ef78-40b8-9bd2-cdde2e907374 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:47:10 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0363abd-ec55-42a3-91ea-fe5fd43919c6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:47:10 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0363abd-ec55-42a3-91ea-fe5fd43919c6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:47:10 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab0ddaad-492d-43e2-81eb-80eee075a53b]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:47:10 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-8807a7e7-ef78-40b8-9bd2-cdde2e907374 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:47:10 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0363abd-ec55-42a3-91ea-fe5fd43919c6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nglqreNI {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:47:10 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0363abd-ec55-42a3-91ea-fe5fd43919c6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nglqreNI" returned: 0 in 0.017s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:47:10 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e13c6ea-7fca-45ec-8831-994d5eb87be9]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:47:10 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-8807a7e7-ef78-40b8-9bd2-cdde2e907374 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nglqreNI'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:47:10 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0363abd-ec55-42a3-91ea-fe5fd43919c6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:47:10 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0363abd-ec55-42a3-91ea-fe5fd43919c6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:47:10 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[894524c7-a343-4ac3-9875-ad866bf06ff4]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:47:10 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-8807a7e7-ef78-40b8-9bd2-cdde2e907374 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:47:10 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:47:10 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:47:10 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d3dfc15-f8d2-4b6e-88ef-de59dc33c155]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:47:10 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-8807a7e7-ef78-40b8-9bd2-cdde2e907374 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 13 19:47:10 user nova-compute[75216]:  {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 19:47:10 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-8807a7e7-ef78-40b8-9bd2-cdde2e907374 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 13 19:47:10 user nova-compute[75216]:  {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 19:47:10 user nova-compute[75216]: WARNING os_brick.initiator.connectors.iscsi [None req-8807a7e7-ef78-40b8-9bd2-cdde2e907374 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 13 19:47:10 user nova-compute[75216]: 
Nov 13 19:47:10 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0363abd-ec55-42a3-91ea-fe5fd43919c6 -p 172.16.0.220:3260 --login {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:47:10 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0363abd-ec55-42a3-91ea-fe5fd43919c6 -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:47:10 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[343547b5-8866-42e7-af89-aed30e3bda34]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f0363abd-ec55-42a3-91ea-fe5fd43919c6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f0363abd-ec55-42a3-91ea-fe5fd43919c6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:47:10 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-8807a7e7-ef78-40b8-9bd2-cdde2e907374 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f0363abd-ec55-42a3-91ea-fe5fd43919c6, portal: 172.16.0.220,3260]
Nov 13 19:47:10 user nova-compute[75216]: Login to [iface: default, target: iqn.2010-10.org.openstack:f0363abd-ec55-42a3-91ea-fe5fd43919c6, portal: 172.16.0.220,3260] successful.
Nov 13 19:47:10 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:47:10 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0363abd-ec55-42a3-91ea-fe5fd43919c6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:47:10 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0363abd-ec55-42a3-91ea-fe5fd43919c6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:47:10 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7d1eb1f-6a6c-4417-825a-4869d2dfe92a]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:47:10 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-8807a7e7-ef78-40b8-9bd2-cdde2e907374 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:47:10 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:47:10 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:47:10 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[54443e0d-aa81-4c06-8564-a3fe08eff286]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0363abd-ec55-42a3-91ea-fe5fd43919c6 (non-flash)\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:47:10 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-8807a7e7-ef78-40b8-9bd2-cdde2e907374 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0363abd-ec55-42a3-91ea-fe5fd43919c6 (non-flash)
Nov 13 19:47:10 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 19:47:10 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-8807a7e7-ef78-40b8-9bd2-cdde2e907374 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0363abd-ec55-42a3-91ea-fe5fd43919c6 (non-flash)
Nov 13 19:47:10 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 19:47:10 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-8807a7e7-ef78-40b8-9bd2-cdde2e907374 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f0363abd-ec55-42a3-91ea-fe5fd43919c6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.237s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 19:47:10 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-8807a7e7-ef78-40b8-9bd2-cdde2e907374 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Connected to 172.16.0.220:3260 {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 19:47:10 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-8807a7e7-ef78-40b8-9bd2-cdde2e907374 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] HCTL ('33', '-', '-', 0) found on session 62 with lun 0 {{(pid=75216) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 19:47:10 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-8807a7e7-ef78-40b8-9bd2-cdde2e907374 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75216) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 19:47:10 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:47:10 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:47:10 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[91e77790-0a07-44ae-beff-106ab022f96d]: (4, ('- - 0', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:47:10 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-8807a7e7-ef78-40b8-9bd2-cdde2e907374 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Searching for a device in session 62 and hctl ['33', '*', '*', 0] yield: None {{(pid=75216) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 19:47:11 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-8807a7e7-ef78-40b8-9bd2-cdde2e907374 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Searching for a device in session 62 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75216) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 19:47:11 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-8807a7e7-ef78-40b8-9bd2-cdde2e907374 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:f0363abd-ec55-42a3-91ea-fe5fd43919c6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nglqreNI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 19:47:11 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-8807a7e7-ef78-40b8-9bd2-cdde2e907374 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.269s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 19:47:11 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-8807a7e7-ef78-40b8-9bd2-cdde2e907374 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] <== connect_volume: return (1270ms) {'type': 'block', 'scsi_wwn': '26265353766346639', 'path': '/dev/sdb'} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 19:47:11 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8807a7e7-ef78-40b8-9bd2-cdde2e907374 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] [instance: accae217-e37a-4262-afc2-6084869847b8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26265353766346639', 'path': '/dev/sdb'} {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 19:47:11 user nova-compute[75216]: DEBUG nova.objects.instance [None req-8807a7e7-ef78-40b8-9bd2-cdde2e907374 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Lazy-loading 'flavor' on Instance uuid accae217-e37a-4262-afc2-6084869847b8 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:47:11 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-8807a7e7-ef78-40b8-9bd2-cdde2e907374 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] attach device xml: <disk type="block" device="disk">
Nov 13 19:47:11 user nova-compute[75216]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 19:47:11 user nova-compute[75216]:   <source dev="/dev/sdb"/>
Nov 13 19:47:11 user nova-compute[75216]:   <target dev="vdb" bus="virtio"/>
Nov 13 19:47:11 user nova-compute[75216]:   <serial>f0363abd-ec55-42a3-91ea-fe5fd43919c6</serial>
Nov 13 19:47:11 user nova-compute[75216]: </disk>
Nov 13 19:47:11 user nova-compute[75216]:  {{(pid=75216) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 13 19:47:11 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-8807a7e7-ef78-40b8-9bd2-cdde2e907374 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 19:47:11 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-8807a7e7-ef78-40b8-9bd2-cdde2e907374 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 19:47:11 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-8807a7e7-ef78-40b8-9bd2-cdde2e907374 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] No VIF found with MAC fa:16:3e:0b:a4:f8, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 19:47:11 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-8807a7e7-ef78-40b8-9bd2-cdde2e907374 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Lock "accae217-e37a-4262-afc2-6084869847b8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:47:13 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:47:14 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-d3e6f966-382b-49a6-a237-c5aa9dc60fa9 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Acquiring lock "accae217-e37a-4262-afc2-6084869847b8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:47:14 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-d3e6f966-382b-49a6-a237-c5aa9dc60fa9 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Lock "accae217-e37a-4262-afc2-6084869847b8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:47:14 user nova-compute[75216]: INFO nova.compute.manager [None req-d3e6f966-382b-49a6-a237-c5aa9dc60fa9 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] [instance: accae217-e37a-4262-afc2-6084869847b8] Detaching volume f0363abd-ec55-42a3-91ea-fe5fd43919c6
Nov 13 19:47:14 user nova-compute[75216]: INFO nova.virt.block_device [None req-d3e6f966-382b-49a6-a237-c5aa9dc60fa9 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] [instance: accae217-e37a-4262-afc2-6084869847b8] Attempting to driver detach volume f0363abd-ec55-42a3-91ea-fe5fd43919c6 from mountpoint /dev/vdb
Nov 13 19:47:14 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-d3e6f966-382b-49a6-a237-c5aa9dc60fa9 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Attempting to detach device vdb from instance accae217-e37a-4262-afc2-6084869847b8 from the persistent domain config. {{(pid=75216) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 13 19:47:14 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-d3e6f966-382b-49a6-a237-c5aa9dc60fa9 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 19:47:14 user nova-compute[75216]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 19:47:14 user nova-compute[75216]:   <source dev="/dev/sdb"/>
Nov 13 19:47:14 user nova-compute[75216]:   <target dev="vdb" bus="virtio"/>
Nov 13 19:47:14 user nova-compute[75216]:   <serial>f0363abd-ec55-42a3-91ea-fe5fd43919c6</serial>
Nov 13 19:47:14 user nova-compute[75216]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 19:47:14 user nova-compute[75216]: </disk>
Nov 13 19:47:14 user nova-compute[75216]:  {{(pid=75216) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 19:47:14 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-d3e6f966-382b-49a6-a237-c5aa9dc60fa9 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Successfully detached device vdb from instance accae217-e37a-4262-afc2-6084869847b8 from the persistent domain config.
Nov 13 19:47:14 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-d3e6f966-382b-49a6-a237-c5aa9dc60fa9 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance accae217-e37a-4262-afc2-6084869847b8 from the live domain config. {{(pid=75216) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 13 19:47:14 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-d3e6f966-382b-49a6-a237-c5aa9dc60fa9 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 19:47:14 user nova-compute[75216]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 19:47:14 user nova-compute[75216]:   <source dev="/dev/sdb"/>
Nov 13 19:47:14 user nova-compute[75216]:   <target dev="vdb" bus="virtio"/>
Nov 13 19:47:14 user nova-compute[75216]:   <serial>f0363abd-ec55-42a3-91ea-fe5fd43919c6</serial>
Nov 13 19:47:14 user nova-compute[75216]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 19:47:14 user nova-compute[75216]: </disk>
Nov 13 19:47:14 user nova-compute[75216]:  {{(pid=75216) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 19:47:14 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-d3e6f966-382b-49a6-a237-c5aa9dc60fa9 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance accae217-e37a-4262-afc2-6084869847b8 {{(pid=75216) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 13 19:47:14 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:47:18 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:47:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:47:26 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:47:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:47:33 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:47:34 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-d3e6f966-382b-49a6-a237-c5aa9dc60fa9 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance accae217-e37a-4262-afc2-6084869847b8 is timed out.
Nov 13 19:47:34 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-d3e6f966-382b-49a6-a237-c5aa9dc60fa9 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Successfully detached device vdb from instance accae217-e37a-4262-afc2-6084869847b8 from the live domain config.
Nov 13 19:47:34 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d3e6f966-382b-49a6-a237-c5aa9dc60fa9 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] [instance: accae217-e37a-4262-afc2-6084869847b8] calling os-brick to detach iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 19:47:34 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3e6f966-382b-49a6-a237-c5aa9dc60fa9 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3a8669e40>, {'target_iqn': 'iqn.2010-10.org.openstack:f0363abd-ec55-42a3-91ea-fe5fd43919c6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nglqreNI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 19:47:34 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-d3e6f966-382b-49a6-a237-c5aa9dc60fa9 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 19:47:34 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-d3e6f966-382b-49a6-a237-c5aa9dc60fa9 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 19:47:34 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-d3e6f966-382b-49a6-a237-c5aa9dc60fa9 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 19:47:34 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:47:34 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:47:34 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[41dec6a7-3324-4ebb-80fa-3b519293ce8a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f0363abd-ec55-42a3-91ea-fe5fd43919c6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:47:34 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3e6f966-382b-49a6-a237-c5aa9dc60fa9 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 19:47:34 user nova-compute[75216]: No targets found.
Nov 13 19:47:34 user nova-compute[75216]: iSNS:
Nov 13 19:47:34 user nova-compute[75216]: No targets found.
Nov 13 19:47:34 user nova-compute[75216]: STATIC:
Nov 13 19:47:34 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:f0363abd-ec55-42a3-91ea-fe5fd43919c6
Nov 13 19:47:34 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 19:47:34 user nova-compute[75216]:                 Iface Name: default
Nov 13 19:47:34 user nova-compute[75216]: FIRMWARE:
Nov 13 19:47:34 user nova-compute[75216]: No targets found.
Nov 13 19:47:34 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 19:47:34 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3e6f966-382b-49a6-a237-c5aa9dc60fa9 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 19:47:34 user nova-compute[75216]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 19:47:34 user nova-compute[75216]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75216) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 19:47:34 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3e6f966-382b-49a6-a237-c5aa9dc60fa9 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f0363abd-ec55-42a3-91ea-fe5fd43919c6', 0)] {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 19:47:34 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:47:34 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:47:34 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[e89d1cb2-b218-40e2-acd3-9a41679a9a01]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f0363abd-ec55-42a3-91ea-fe5fd43919c6\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:47:34 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:47:34 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:47:34 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[9371392a-3154-470b-b480-c74cdb816c05]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0363abd-ec55-42a3-91ea-fe5fd43919c6 (non-flash)\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:47:34 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3e6f966-382b-49a6-a237-c5aa9dc60fa9 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0363abd-ec55-42a3-91ea-fe5fd43919c6 (non-flash)
Nov 13 19:47:34 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 19:47:34 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3e6f966-382b-49a6-a237-c5aa9dc60fa9 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0363abd-ec55-42a3-91ea-fe5fd43919c6 (non-flash)
Nov 13 19:47:34 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 19:47:34 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3e6f966-382b-49a6-a237-c5aa9dc60fa9 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe3a834f520>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f0363abd-ec55-42a3-91ea-fe5fd43919c6'): ({'sdb'}, set())}) {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 19:47:34 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-d3e6f966-382b-49a6-a237-c5aa9dc60fa9 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Removing single pathed devices sdb {{(pid=75216) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 19:47:34 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:47:34 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:47:34 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b6d6211-c5b8-43fa-b3ee-faffeac86868]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:47:34 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:47:34 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:47:34 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[81d432c1-5d55-4807-922b-e26cc1fec035]: (4, ('ok\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:47:34 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-d3e6f966-382b-49a6-a237-c5aa9dc60fa9 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Flushing IO for device /dev/sdb {{(pid=75216) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 19:47:34 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:47:34 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:47:34 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d07c101-175e-47eb-b72a-36ab64e95278]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:47:34 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-d3e6f966-382b-49a6-a237-c5aa9dc60fa9 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75216) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 19:47:34 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:47:34 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.034s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:47:34 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[d171850f-2023-41a8-a805-818563d243ad]: (4, ('1', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:47:34 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-d3e6f966-382b-49a6-a237-c5aa9dc60fa9 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 19:47:34 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-d3e6f966-382b-49a6-a237-c5aa9dc60fa9 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] SCSI volumes sdb have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 19:47:34 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3e6f966-382b-49a6-a237-c5aa9dc60fa9 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f0363abd-ec55-42a3-91ea-fe5fd43919c6')] {{(pid=75216) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 19:47:34 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0363abd-ec55-42a3-91ea-fe5fd43919c6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:47:34 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0363abd-ec55-42a3-91ea-fe5fd43919c6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:47:34 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[172e2c26-ffeb-4463-8c6a-cf6295bd86f3]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:47:34 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3e6f966-382b-49a6-a237-c5aa9dc60fa9 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:47:34 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0363abd-ec55-42a3-91ea-fe5fd43919c6 -p 172.16.0.220:3260 --logout {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:47:34 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0363abd-ec55-42a3-91ea-fe5fd43919c6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:47:34 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4d78ea9-37fe-4a10-aaf1-e7e767fdf795]: (4, ('Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:f0363abd-ec55-42a3-91ea-fe5fd43919c6, portal: 172.16.0.220,3260]\nLogout of [sid: 62, target: iqn.2010-10.org.openstack:f0363abd-ec55-42a3-91ea-fe5fd43919c6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:47:34 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3e6f966-382b-49a6-a237-c5aa9dc60fa9 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:f0363abd-ec55-42a3-91ea-fe5fd43919c6, portal: 172.16.0.220,3260]
Nov 13 19:47:34 user nova-compute[75216]: Logout of [sid: 62, target: iqn.2010-10.org.openstack:f0363abd-ec55-42a3-91ea-fe5fd43919c6, portal: 172.16.0.220,3260] successful.
Nov 13 19:47:34 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:47:34 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0363abd-ec55-42a3-91ea-fe5fd43919c6 -p 172.16.0.220:3260 --op delete {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:47:34 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0363abd-ec55-42a3-91ea-fe5fd43919c6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:47:34 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6d1de57-be85-4858-b3e4-2f6a176a1d84]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:47:34 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3e6f966-382b-49a6-a237-c5aa9dc60fa9 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:47:34 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-d3e6f966-382b-49a6-a237-c5aa9dc60fa9 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.284s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 19:47:34 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3e6f966-382b-49a6-a237-c5aa9dc60fa9 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] <== disconnect_volume: return (285ms) None {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 19:47:34 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d3e6f966-382b-49a6-a237-c5aa9dc60fa9 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] [instance: accae217-e37a-4262-afc2-6084869847b8] Disconnected iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 19:47:35 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:47:35 user nova-compute[75216]: DEBUG nova.objects.instance [None req-d3e6f966-382b-49a6-a237-c5aa9dc60fa9 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Lazy-loading 'flavor' on Instance uuid accae217-e37a-4262-afc2-6084869847b8 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:47:35 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-d3e6f966-382b-49a6-a237-c5aa9dc60fa9 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Lock "accae217-e37a-4262-afc2-6084869847b8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.752s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:47:38 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:47:39 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:47:40 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:47:40 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:47:40 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75216) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 19:47:41 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:47:41 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Starting heal instance info cache {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 19:47:41 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Rebuilding the list of instances to heal {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 13 19:47:41 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "refresh_cache-accae217-e37a-4262-afc2-6084869847b8" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 19:47:41 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquired lock "refresh_cache-accae217-e37a-4262-afc2-6084869847b8" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 19:47:41 user nova-compute[75216]: DEBUG nova.network.neutron [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: accae217-e37a-4262-afc2-6084869847b8] Forcefully refreshing network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 19:47:41 user nova-compute[75216]: DEBUG nova.objects.instance [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lazy-loading 'info_cache' on Instance uuid accae217-e37a-4262-afc2-6084869847b8 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:47:41 user nova-compute[75216]: DEBUG nova.network.neutron [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: accae217-e37a-4262-afc2-6084869847b8] Updating instance_info_cache with network_info: [{"id": "275d8444-8b2a-49f6-9982-e36f8995180b", "address": "fa:16:3e:0b:a4:f8", "network": {"id": "648aeeec-8ba8-465a-81f4-83012bb2fe16", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-705892923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e85b16b3854c4604a963f680906e6b77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap275d8444-8b", "ovs_interfaceid": "275d8444-8b2a-49f6-9982-e36f8995180b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:47:41 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Releasing lock "refresh_cache-accae217-e37a-4262-afc2-6084869847b8" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 19:47:41 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: accae217-e37a-4262-afc2-6084869847b8] Updated the network info_cache for instance {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 19:47:42 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:47:43 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:47:47 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:47:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:47:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:47:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:47:47 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Auditing locally available compute resources for user (node: user) {{(pid=75216) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 19:47:47 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/accae217-e37a-4262-afc2-6084869847b8/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:47:47 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/accae217-e37a-4262-afc2-6084869847b8/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:47:47 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/accae217-e37a-4262-afc2-6084869847b8/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:47:47 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/accae217-e37a-4262-afc2-6084869847b8/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:47:48 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 19:47:48 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 19:47:48 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Hypervisor/Node resource view: name=user free_ram=8964MB free_disk=25.21039581298828GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75216) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 19:47:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:47:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:47:48 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance accae217-e37a-4262-afc2-6084869847b8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 19:47:48 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 19:47:48 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 19:47:48 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 19:47:48 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 19:47:48 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Compute_service record updated for user:user {{(pid=75216) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 19:47:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.178s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:47:48 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:47:50 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:47:53 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:47:58 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:48:03 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:48:06 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-6674b718-5466-4162-914e-d07fbed5bb6d tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Acquiring lock "accae217-e37a-4262-afc2-6084869847b8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:48:06 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-6674b718-5466-4162-914e-d07fbed5bb6d tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Lock "accae217-e37a-4262-afc2-6084869847b8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:48:06 user nova-compute[75216]: DEBUG nova.objects.instance [None req-6674b718-5466-4162-914e-d07fbed5bb6d tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Lazy-loading 'flavor' on Instance uuid accae217-e37a-4262-afc2-6084869847b8 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:48:06 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-6674b718-5466-4162-914e-d07fbed5bb6d tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Lock "accae217-e37a-4262-afc2-6084869847b8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:48:06 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-6674b718-5466-4162-914e-d07fbed5bb6d tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Acquiring lock "accae217-e37a-4262-afc2-6084869847b8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:48:06 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-6674b718-5466-4162-914e-d07fbed5bb6d tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Lock "accae217-e37a-4262-afc2-6084869847b8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:48:06 user nova-compute[75216]: INFO nova.compute.manager [None req-6674b718-5466-4162-914e-d07fbed5bb6d tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] [instance: accae217-e37a-4262-afc2-6084869847b8] Attaching volume 5f9798bf-477f-4ccd-8940-89a837abd500 to /dev/vdb
Nov 13 19:48:06 user nova-compute[75216]: DEBUG os_brick.utils [None req-6674b718-5466-4162-914e-d07fbed5bb6d tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 19:48:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:48:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:48:06 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[160bc655-bb13-4f9f-88ee-707c522d77d5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aea6fcfe14b9\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:48:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:48:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:48:06 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[302429de-8a67-4fea-8de5-c9d1d72661b9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:48:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:48:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:48:06 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a1f7c9c-6d85-4a89-9d03-770ca06fbb9c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:48:06 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d23b6ee-37fa-44a6-b668-369aaa9b8683]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:48:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-6674b718-5466-4162-914e-d07fbed5bb6d tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Running cmd (subprocess): nvme version {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:48:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-6674b718-5466-4162-914e-d07fbed5bb6d tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] 'nvme version' failed. Not Retrying. {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 19:48:06 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6674b718-5466-4162-914e-d07fbed5bb6d tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] nvme not present on system {{(pid=75216) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 19:48:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:48:06 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 19:48:06 user nova-compute[75216]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 19:48:06 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b768476-d1fd-4c28-a3f0-ca0637dcd351]: (4, '') {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:48:06 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-6674b718-5466-4162-914e-d07fbed5bb6d tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75216) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 19:48:06 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-6674b718-5466-4162-914e-d07fbed5bb6d tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 19:48:06 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-6674b718-5466-4162-914e-d07fbed5bb6d tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] LIGHTOS: no hostnqn found. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 19:48:06 user nova-compute[75216]: DEBUG os_brick.utils [None req-6674b718-5466-4162-914e-d07fbed5bb6d tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aea6fcfe14b9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 19:48:06 user nova-compute[75216]: DEBUG nova.virt.block_device [None req-6674b718-5466-4162-914e-d07fbed5bb6d tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] [instance: accae217-e37a-4262-afc2-6084869847b8] Updating existing volume attachment record: 30d3d731-095e-46dc-a9fa-3a0c5eb96641 {{(pid=75216) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 19:48:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:48:09 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:48:09 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:48:11 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6674b718-5466-4162-914e-d07fbed5bb6d tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] [instance: accae217-e37a-4262-afc2-6084869847b8] Calling os-brick to attach iSCSI Volume {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 19:48:11 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6674b718-5466-4162-914e-d07fbed5bb6d tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3a8669e40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5f9798bf-477f-4ccd-8940-89a837abd500', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'THAQKajr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 19:48:11 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-6674b718-5466-4162-914e-d07fbed5bb6d tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 19:48:11 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-6674b718-5466-4162-914e-d07fbed5bb6d tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 19:48:11 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-6674b718-5466-4162-914e-d07fbed5bb6d tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 19:48:11 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-6674b718-5466-4162-914e-d07fbed5bb6d tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 19:48:11 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-6674b718-5466-4162-914e-d07fbed5bb6d tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5f9798bf-477f-4ccd-8940-89a837abd500" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 19:48:11 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-6674b718-5466-4162-914e-d07fbed5bb6d tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5f9798bf-477f-4ccd-8940-89a837abd500" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 19:48:11 user nova-compute[75216]: INFO os_brick.initiator.connectors.iscsi [None req-6674b718-5466-4162-914e-d07fbed5bb6d tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 19:48:11 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f9798bf-477f-4ccd-8940-89a837abd500 -p 172.16.0.220:3260 {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:48:11 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f9798bf-477f-4ccd-8940-89a837abd500 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:48:11 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[425df291-1cdc-4f3d-a0a9-cfac48255c09]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:48:11 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6674b718-5466-4162-914e-d07fbed5bb6d tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 19:48:11 user nova-compute[75216]:  {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:48:11 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f9798bf-477f-4ccd-8940-89a837abd500 -p 172.16.0.220:3260 --interface default --op new {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:48:11 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f9798bf-477f-4ccd-8940-89a837abd500 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:48:11 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[d788be83-db53-490f-a4ff-e5e7245b31d3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5f9798bf-477f-4ccd-8940-89a837abd500] added\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:48:11 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6674b718-5466-4162-914e-d07fbed5bb6d tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5f9798bf-477f-4ccd-8940-89a837abd500] added
Nov 13 19:48:11 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:48:11 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f9798bf-477f-4ccd-8940-89a837abd500 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:48:11 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f9798bf-477f-4ccd-8940-89a837abd500 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:48:11 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6fd8e4b-a9ca-4d28-95b8-1cba361e2458]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:48:11 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6674b718-5466-4162-914e-d07fbed5bb6d tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:48:11 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f9798bf-477f-4ccd-8940-89a837abd500 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:48:11 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f9798bf-477f-4ccd-8940-89a837abd500 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:48:11 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9ed9ce6-3c61-4daf-a448-76347eb4e8cd]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:48:11 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6674b718-5466-4162-914e-d07fbed5bb6d tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:48:11 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f9798bf-477f-4ccd-8940-89a837abd500 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v THAQKajr {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:48:11 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f9798bf-477f-4ccd-8940-89a837abd500 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v THAQKajr" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:48:11 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ad9ff68-550c-4bc9-908f-1d68ca4352c6]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:48:11 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6674b718-5466-4162-914e-d07fbed5bb6d tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'THAQKajr'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:48:11 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f9798bf-477f-4ccd-8940-89a837abd500 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:48:11 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f9798bf-477f-4ccd-8940-89a837abd500 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:48:11 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[593a64df-c425-423e-a114-337a3dc15e92]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:48:11 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6674b718-5466-4162-914e-d07fbed5bb6d tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:48:11 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:48:11 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:48:11 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c0d9e4e-d2da-4038-ad2a-b8acd3dae407]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:48:11 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6674b718-5466-4162-914e-d07fbed5bb6d tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 13 19:48:11 user nova-compute[75216]:  {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 19:48:11 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6674b718-5466-4162-914e-d07fbed5bb6d tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 13 19:48:11 user nova-compute[75216]:  {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 19:48:11 user nova-compute[75216]: WARNING os_brick.initiator.connectors.iscsi [None req-6674b718-5466-4162-914e-d07fbed5bb6d tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 13 19:48:11 user nova-compute[75216]: 
Nov 13 19:48:11 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f9798bf-477f-4ccd-8940-89a837abd500 -p 172.16.0.220:3260 --login {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:48:11 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f9798bf-477f-4ccd-8940-89a837abd500 -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:48:11 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f14797e-9b53-4432-828b-c22b1ee8766a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5f9798bf-477f-4ccd-8940-89a837abd500, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5f9798bf-477f-4ccd-8940-89a837abd500, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:48:11 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6674b718-5466-4162-914e-d07fbed5bb6d tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5f9798bf-477f-4ccd-8940-89a837abd500, portal: 172.16.0.220,3260]
Nov 13 19:48:11 user nova-compute[75216]: Login to [iface: default, target: iqn.2010-10.org.openstack:5f9798bf-477f-4ccd-8940-89a837abd500, portal: 172.16.0.220,3260] successful.
Nov 13 19:48:11 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:48:11 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f9798bf-477f-4ccd-8940-89a837abd500 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:48:11 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f9798bf-477f-4ccd-8940-89a837abd500 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:48:11 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5cfd592-d532-4c02-a685-024d659a04cc]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:48:11 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6674b718-5466-4162-914e-d07fbed5bb6d tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:48:11 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:48:11 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:48:11 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ad47341-f62e-4286-9cdf-a707da18260b]: (4, ('tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f9798bf-477f-4ccd-8940-89a837abd500 (non-flash)\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:48:11 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6674b718-5466-4162-914e-d07fbed5bb6d tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f9798bf-477f-4ccd-8940-89a837abd500 (non-flash)
Nov 13 19:48:11 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 19:48:11 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6674b718-5466-4162-914e-d07fbed5bb6d tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] iscsi session list stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f9798bf-477f-4ccd-8940-89a837abd500 (non-flash)
Nov 13 19:48:11 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 19:48:11 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-6674b718-5466-4162-914e-d07fbed5bb6d tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5f9798bf-477f-4ccd-8940-89a837abd500" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.244s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 19:48:11 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6674b718-5466-4162-914e-d07fbed5bb6d tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Connected to 172.16.0.220:3260 {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 19:48:11 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-6674b718-5466-4162-914e-d07fbed5bb6d tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] HCTL ('33', '-', '-', 0) found on session 63 with lun 0 {{(pid=75216) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 19:48:11 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-6674b718-5466-4162-914e-d07fbed5bb6d tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75216) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 19:48:11 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:48:11 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:48:11 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[84784eac-f362-4501-80db-a4bd0b152e7a]: (4, ('- - 0', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:48:11 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-6674b718-5466-4162-914e-d07fbed5bb6d tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Searching for a device in session 63 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75216) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 19:48:11 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6674b718-5466-4162-914e-d07fbed5bb6d tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:5f9798bf-477f-4ccd-8940-89a837abd500', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'THAQKajr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 19:48:12 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-6674b718-5466-4162-914e-d07fbed5bb6d tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.274s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 19:48:12 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-6674b718-5466-4162-914e-d07fbed5bb6d tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] <== connect_volume: return (1275ms) {'type': 'block', 'scsi_wwn': '23630323538356631', 'path': '/dev/sdb'} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 19:48:12 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6674b718-5466-4162-914e-d07fbed5bb6d tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] [instance: accae217-e37a-4262-afc2-6084869847b8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23630323538356631', 'path': '/dev/sdb'} {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 19:48:12 user nova-compute[75216]: DEBUG nova.objects.instance [None req-6674b718-5466-4162-914e-d07fbed5bb6d tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Lazy-loading 'flavor' on Instance uuid accae217-e37a-4262-afc2-6084869847b8 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:48:12 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-6674b718-5466-4162-914e-d07fbed5bb6d tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] attach device xml: <disk type="block" device="disk">
Nov 13 19:48:12 user nova-compute[75216]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 19:48:12 user nova-compute[75216]:   <source dev="/dev/sdb"/>
Nov 13 19:48:12 user nova-compute[75216]:   <target dev="vdb" bus="virtio"/>
Nov 13 19:48:12 user nova-compute[75216]:   <serial>5f9798bf-477f-4ccd-8940-89a837abd500</serial>
Nov 13 19:48:12 user nova-compute[75216]: </disk>
Nov 13 19:48:12 user nova-compute[75216]:  {{(pid=75216) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 13 19:48:12 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-6674b718-5466-4162-914e-d07fbed5bb6d tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 19:48:12 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-6674b718-5466-4162-914e-d07fbed5bb6d tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 19:48:12 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-6674b718-5466-4162-914e-d07fbed5bb6d tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] No VIF found with MAC fa:16:3e:0b:a4:f8, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 19:48:12 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-6674b718-5466-4162-914e-d07fbed5bb6d tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Lock "accae217-e37a-4262-afc2-6084869847b8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.171s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:48:13 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:48:14 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-8fc7b2d3-01c5-462b-84b4-b69c40acbef8 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Acquiring lock "accae217-e37a-4262-afc2-6084869847b8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:48:14 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-8fc7b2d3-01c5-462b-84b4-b69c40acbef8 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Lock "accae217-e37a-4262-afc2-6084869847b8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:48:14 user nova-compute[75216]: INFO nova.compute.manager [None req-8fc7b2d3-01c5-462b-84b4-b69c40acbef8 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] [instance: accae217-e37a-4262-afc2-6084869847b8] Detaching volume 5f9798bf-477f-4ccd-8940-89a837abd500
Nov 13 19:48:14 user nova-compute[75216]: INFO nova.virt.block_device [None req-8fc7b2d3-01c5-462b-84b4-b69c40acbef8 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] [instance: accae217-e37a-4262-afc2-6084869847b8] Attempting to driver detach volume 5f9798bf-477f-4ccd-8940-89a837abd500 from mountpoint /dev/vdb
Nov 13 19:48:14 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:48:14 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-8fc7b2d3-01c5-462b-84b4-b69c40acbef8 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Attempting to detach device vdb from instance accae217-e37a-4262-afc2-6084869847b8 from the persistent domain config. {{(pid=75216) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 13 19:48:14 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-8fc7b2d3-01c5-462b-84b4-b69c40acbef8 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 19:48:14 user nova-compute[75216]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 19:48:14 user nova-compute[75216]:   <source dev="/dev/sdb"/>
Nov 13 19:48:14 user nova-compute[75216]:   <target dev="vdb" bus="virtio"/>
Nov 13 19:48:14 user nova-compute[75216]:   <serial>5f9798bf-477f-4ccd-8940-89a837abd500</serial>
Nov 13 19:48:14 user nova-compute[75216]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 19:48:14 user nova-compute[75216]: </disk>
Nov 13 19:48:14 user nova-compute[75216]:  {{(pid=75216) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 19:48:14 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-8fc7b2d3-01c5-462b-84b4-b69c40acbef8 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Successfully detached device vdb from instance accae217-e37a-4262-afc2-6084869847b8 from the persistent domain config.
Nov 13 19:48:14 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-8fc7b2d3-01c5-462b-84b4-b69c40acbef8 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance accae217-e37a-4262-afc2-6084869847b8 from the live domain config. {{(pid=75216) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 13 19:48:14 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-8fc7b2d3-01c5-462b-84b4-b69c40acbef8 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 19:48:14 user nova-compute[75216]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 19:48:14 user nova-compute[75216]:   <source dev="/dev/sdb"/>
Nov 13 19:48:14 user nova-compute[75216]:   <target dev="vdb" bus="virtio"/>
Nov 13 19:48:14 user nova-compute[75216]:   <serial>5f9798bf-477f-4ccd-8940-89a837abd500</serial>
Nov 13 19:48:14 user nova-compute[75216]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 19:48:14 user nova-compute[75216]: </disk>
Nov 13 19:48:14 user nova-compute[75216]:  {{(pid=75216) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 19:48:15 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-8fc7b2d3-01c5-462b-84b4-b69c40acbef8 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance accae217-e37a-4262-afc2-6084869847b8 {{(pid=75216) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 13 19:48:18 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:48:19 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:48:23 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:48:26 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:48:28 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:48:33 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:48:35 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-8fc7b2d3-01c5-462b-84b4-b69c40acbef8 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance accae217-e37a-4262-afc2-6084869847b8 is timed out.
Nov 13 19:48:35 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-8fc7b2d3-01c5-462b-84b4-b69c40acbef8 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Successfully detached device vdb from instance accae217-e37a-4262-afc2-6084869847b8 from the live domain config.
Nov 13 19:48:35 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8fc7b2d3-01c5-462b-84b4-b69c40acbef8 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] [instance: accae217-e37a-4262-afc2-6084869847b8] calling os-brick to detach iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 19:48:35 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fc7b2d3-01c5-462b-84b4-b69c40acbef8 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3a8669e40>, {'target_iqn': 'iqn.2010-10.org.openstack:5f9798bf-477f-4ccd-8940-89a837abd500', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'THAQKajr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 19:48:35 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-8fc7b2d3-01c5-462b-84b4-b69c40acbef8 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 19:48:35 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-8fc7b2d3-01c5-462b-84b4-b69c40acbef8 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 19:48:35 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-8fc7b2d3-01c5-462b-84b4-b69c40acbef8 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 19:48:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:48:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:48:35 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[20203f8e-6ae7-472e-8684-784b7eec923a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5f9798bf-477f-4ccd-8940-89a837abd500\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:48:35 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fc7b2d3-01c5-462b-84b4-b69c40acbef8 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 19:48:35 user nova-compute[75216]: No targets found.
Nov 13 19:48:35 user nova-compute[75216]: iSNS:
Nov 13 19:48:35 user nova-compute[75216]: No targets found.
Nov 13 19:48:35 user nova-compute[75216]: STATIC:
Nov 13 19:48:35 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:5f9798bf-477f-4ccd-8940-89a837abd500
Nov 13 19:48:35 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 19:48:35 user nova-compute[75216]:                 Iface Name: default
Nov 13 19:48:35 user nova-compute[75216]: FIRMWARE:
Nov 13 19:48:35 user nova-compute[75216]: No targets found.
Nov 13 19:48:35 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 19:48:35 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fc7b2d3-01c5-462b-84b4-b69c40acbef8 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 19:48:35 user nova-compute[75216]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 19:48:35 user nova-compute[75216]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75216) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 19:48:35 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fc7b2d3-01c5-462b-84b4-b69c40acbef8 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5f9798bf-477f-4ccd-8940-89a837abd500', 0)] {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 19:48:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:48:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:48:35 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[95fd3c8e-65c7-4c4c-834b-69d6fd0664bd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f9798bf-477f-4ccd-8940-89a837abd500\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:48:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:48:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:48:35 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[5418f802-ebb6-4edd-8e34-50999617dbc5]: (4, ('tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f9798bf-477f-4ccd-8940-89a837abd500 (non-flash)\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:48:35 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fc7b2d3-01c5-462b-84b4-b69c40acbef8 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f9798bf-477f-4ccd-8940-89a837abd500 (non-flash)
Nov 13 19:48:35 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 19:48:35 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fc7b2d3-01c5-462b-84b4-b69c40acbef8 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] iscsi session list stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f9798bf-477f-4ccd-8940-89a837abd500 (non-flash)
Nov 13 19:48:35 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 19:48:35 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fc7b2d3-01c5-462b-84b4-b69c40acbef8 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe3a82c8940>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5f9798bf-477f-4ccd-8940-89a837abd500'): ({'sdb'}, set())}) {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 19:48:35 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-8fc7b2d3-01c5-462b-84b4-b69c40acbef8 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Removing single pathed devices sdb {{(pid=75216) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 19:48:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:48:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:48:35 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e8f73df-4fc4-41a4-879b-078a500035c7]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:48:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:48:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:48:35 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:48:35 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb802077-42dc-41ad-a2b1-20a683ce9e9c]: (4, ('ok\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:48:35 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-8fc7b2d3-01c5-462b-84b4-b69c40acbef8 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Flushing IO for device /dev/sdb {{(pid=75216) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 19:48:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:48:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:48:35 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0d75dbb-b3ce-47ab-b70e-2105c7b3775d]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:48:35 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-8fc7b2d3-01c5-462b-84b4-b69c40acbef8 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75216) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 19:48:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:48:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:48:35 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ad548f1-a4c5-4933-9850-3051533718e7]: (4, ('1', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:48:35 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-8fc7b2d3-01c5-462b-84b4-b69c40acbef8 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 19:48:35 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-8fc7b2d3-01c5-462b-84b4-b69c40acbef8 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] SCSI volumes sdb have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 19:48:35 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fc7b2d3-01c5-462b-84b4-b69c40acbef8 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5f9798bf-477f-4ccd-8940-89a837abd500')] {{(pid=75216) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 19:48:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f9798bf-477f-4ccd-8940-89a837abd500 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:48:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f9798bf-477f-4ccd-8940-89a837abd500 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:48:35 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf078d0b-ed97-419e-b97a-8ac7be90f276]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:48:35 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fc7b2d3-01c5-462b-84b4-b69c40acbef8 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:48:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f9798bf-477f-4ccd-8940-89a837abd500 -p 172.16.0.220:3260 --logout {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:48:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f9798bf-477f-4ccd-8940-89a837abd500 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:48:35 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[c72f88a0-73f7-4d9e-865a-ee6cc2cd9d8f]: (4, ('Logging out of session [sid: 63, target: iqn.2010-10.org.openstack:5f9798bf-477f-4ccd-8940-89a837abd500, portal: 172.16.0.220,3260]\nLogout of [sid: 63, target: iqn.2010-10.org.openstack:5f9798bf-477f-4ccd-8940-89a837abd500, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:48:35 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fc7b2d3-01c5-462b-84b4-b69c40acbef8 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 63, target: iqn.2010-10.org.openstack:5f9798bf-477f-4ccd-8940-89a837abd500, portal: 172.16.0.220,3260]
Nov 13 19:48:35 user nova-compute[75216]: Logout of [sid: 63, target: iqn.2010-10.org.openstack:5f9798bf-477f-4ccd-8940-89a837abd500, portal: 172.16.0.220,3260] successful.
Nov 13 19:48:35 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:48:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f9798bf-477f-4ccd-8940-89a837abd500 -p 172.16.0.220:3260 --op delete {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:48:35 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f9798bf-477f-4ccd-8940-89a837abd500 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:48:35 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ee6d5b6-6a5e-4eff-9ff8-f7f9cc61e378]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:48:35 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fc7b2d3-01c5-462b-84b4-b69c40acbef8 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:48:35 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-8fc7b2d3-01c5-462b-84b4-b69c40acbef8 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.311s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 19:48:35 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fc7b2d3-01c5-462b-84b4-b69c40acbef8 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] <== disconnect_volume: return (312ms) None {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 19:48:35 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8fc7b2d3-01c5-462b-84b4-b69c40acbef8 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] [instance: accae217-e37a-4262-afc2-6084869847b8] Disconnected iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 19:48:36 user nova-compute[75216]: DEBUG nova.objects.instance [None req-8fc7b2d3-01c5-462b-84b4-b69c40acbef8 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Lazy-loading 'flavor' on Instance uuid accae217-e37a-4262-afc2-6084869847b8 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:48:36 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-8fc7b2d3-01c5-462b-84b4-b69c40acbef8 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Lock "accae217-e37a-4262-afc2-6084869847b8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.557s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:48:38 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:48:40 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:48:40 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75216) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 19:48:41 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:48:42 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:48:42 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Starting heal instance info cache {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 19:48:42 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Rebuilding the list of instances to heal {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 13 19:48:42 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "refresh_cache-accae217-e37a-4262-afc2-6084869847b8" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 19:48:42 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquired lock "refresh_cache-accae217-e37a-4262-afc2-6084869847b8" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 19:48:42 user nova-compute[75216]: DEBUG nova.network.neutron [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: accae217-e37a-4262-afc2-6084869847b8] Forcefully refreshing network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 19:48:42 user nova-compute[75216]: DEBUG nova.objects.instance [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lazy-loading 'info_cache' on Instance uuid accae217-e37a-4262-afc2-6084869847b8 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:48:43 user nova-compute[75216]: DEBUG nova.network.neutron [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: accae217-e37a-4262-afc2-6084869847b8] Updating instance_info_cache with network_info: [{"id": "275d8444-8b2a-49f6-9982-e36f8995180b", "address": "fa:16:3e:0b:a4:f8", "network": {"id": "648aeeec-8ba8-465a-81f4-83012bb2fe16", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-705892923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e85b16b3854c4604a963f680906e6b77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap275d8444-8b", "ovs_interfaceid": "275d8444-8b2a-49f6-9982-e36f8995180b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:48:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Releasing lock "refresh_cache-accae217-e37a-4262-afc2-6084869847b8" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 19:48:43 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: accae217-e37a-4262-afc2-6084869847b8] Updated the network info_cache for instance {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 19:48:43 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:48:43 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:48:43 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:48:43 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:48:43 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75216) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 19:48:43 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 19:48:43 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 19:48:43 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:48:47 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:48:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:48:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:48:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:48:47 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Auditing locally available compute resources for user (node: user) {{(pid=75216) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 19:48:47 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/accae217-e37a-4262-afc2-6084869847b8/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:48:47 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/accae217-e37a-4262-afc2-6084869847b8/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:48:47 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/accae217-e37a-4262-afc2-6084869847b8/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:48:47 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/accae217-e37a-4262-afc2-6084869847b8/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:48:48 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 19:48:48 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 19:48:48 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Hypervisor/Node resource view: name=user free_ram=8944MB free_disk=25.209457397460938GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75216) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 19:48:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:48:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:48:48 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance accae217-e37a-4262-afc2-6084869847b8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 19:48:48 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 19:48:48 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 19:48:48 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 19:48:48 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 19:48:48 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Compute_service record updated for user:user {{(pid=75216) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 19:48:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.269s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:48:48 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:48:52 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:48:53 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:48:53 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:48:53 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75216) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 19:48:53 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 19:48:53 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 19:48:53 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:48:58 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:49:03 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:49:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:49:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:49:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75216) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 19:49:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 19:49:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 19:49:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:49:13 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-4f05c8f2-dd21-43ee-9f50-e139ca555b76 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Acquiring lock "accae217-e37a-4262-afc2-6084869847b8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:49:13 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-4f05c8f2-dd21-43ee-9f50-e139ca555b76 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Lock "accae217-e37a-4262-afc2-6084869847b8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:49:13 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-4f05c8f2-dd21-43ee-9f50-e139ca555b76 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Acquiring lock "accae217-e37a-4262-afc2-6084869847b8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:49:13 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-4f05c8f2-dd21-43ee-9f50-e139ca555b76 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Lock "accae217-e37a-4262-afc2-6084869847b8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:49:13 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-4f05c8f2-dd21-43ee-9f50-e139ca555b76 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Lock "accae217-e37a-4262-afc2-6084869847b8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:49:13 user nova-compute[75216]: INFO nova.compute.manager [None req-4f05c8f2-dd21-43ee-9f50-e139ca555b76 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] [instance: accae217-e37a-4262-afc2-6084869847b8] Terminating instance
Nov 13 19:49:13 user nova-compute[75216]: DEBUG nova.compute.manager [None req-4f05c8f2-dd21-43ee-9f50-e139ca555b76 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] [instance: accae217-e37a-4262-afc2-6084869847b8] Start destroying the instance on the hypervisor. {{(pid=75216) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 19:49:13 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:49:13 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:49:13 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:49:13 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:49:13 user nova-compute[75216]: DEBUG nova.compute.manager [req-bc0a5c8a-cab5-4fe5-a090-78ea48c8ec37 req-a5617fd6-3897-423c-808e-2127a6403185 service nova] [instance: accae217-e37a-4262-afc2-6084869847b8] Received event network-vif-unplugged-275d8444-8b2a-49f6-9982-e36f8995180b {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:49:13 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-bc0a5c8a-cab5-4fe5-a090-78ea48c8ec37 req-a5617fd6-3897-423c-808e-2127a6403185 service nova] Acquiring lock "accae217-e37a-4262-afc2-6084869847b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:49:13 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-bc0a5c8a-cab5-4fe5-a090-78ea48c8ec37 req-a5617fd6-3897-423c-808e-2127a6403185 service nova] Lock "accae217-e37a-4262-afc2-6084869847b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:49:13 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-bc0a5c8a-cab5-4fe5-a090-78ea48c8ec37 req-a5617fd6-3897-423c-808e-2127a6403185 service nova] Lock "accae217-e37a-4262-afc2-6084869847b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:49:13 user nova-compute[75216]: DEBUG nova.compute.manager [req-bc0a5c8a-cab5-4fe5-a090-78ea48c8ec37 req-a5617fd6-3897-423c-808e-2127a6403185 service nova] [instance: accae217-e37a-4262-afc2-6084869847b8] No waiting events found dispatching network-vif-unplugged-275d8444-8b2a-49f6-9982-e36f8995180b {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 19:49:13 user nova-compute[75216]: DEBUG nova.compute.manager [req-bc0a5c8a-cab5-4fe5-a090-78ea48c8ec37 req-a5617fd6-3897-423c-808e-2127a6403185 service nova] [instance: accae217-e37a-4262-afc2-6084869847b8] Received event network-vif-unplugged-275d8444-8b2a-49f6-9982-e36f8995180b for instance with task_state deleting. {{(pid=75216) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 19:49:13 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:49:13 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:49:14 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:49:14 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:49:14 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: accae217-e37a-4262-afc2-6084869847b8] Instance destroyed successfully.
Nov 13 19:49:14 user nova-compute[75216]: DEBUG nova.objects.instance [None req-4f05c8f2-dd21-43ee-9f50-e139ca555b76 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Lazy-loading 'resources' on Instance uuid accae217-e37a-4262-afc2-6084869847b8 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:49:14 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-4f05c8f2-dd21-43ee-9f50-e139ca555b76 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T19:43:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-876672199',display_name='tempest-SnapshotDataIntegrityTests-server-876672199',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-876672199',id=52,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEddoa3sojrKJxv0kpGNp4huLVo9ggpmdLFPx7Vs58mv8TK1QoNxDgnDnfjz28zmE7I6+4XefwA3DYQaWWKUd+yUr7oBrN8Fx8N8XixC31rTHcGB0e8maI+ZCNWfmNdEZQ==',key_name='tempest-keypair-1182363386',keypairs=<?>,launch_index=0,launched_at=2023-11-13T19:43:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e85b16b3854c4604a963f680906e6b77',ramdisk_id='',reservation_id='r-vnxg70um',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-2031098809',owner_user_name='tempest-SnapshotDataIntegrityTests-2031098809-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T19:43:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cd499a78c58f49a98011b91f246be6f6',uuid=accae217-e37a-4262-afc2-6084869847b8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "275d8444-8b2a-49f6-9982-e36f8995180b", "address": "fa:16:3e:0b:a4:f8", "network": {"id": "648aeeec-8ba8-465a-81f4-83012bb2fe16", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-705892923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e85b16b3854c4604a963f680906e6b77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap275d8444-8b", "ovs_interfaceid": "275d8444-8b2a-49f6-9982-e36f8995180b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 19:49:14 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-4f05c8f2-dd21-43ee-9f50-e139ca555b76 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Converting VIF {"id": "275d8444-8b2a-49f6-9982-e36f8995180b", "address": "fa:16:3e:0b:a4:f8", "network": {"id": "648aeeec-8ba8-465a-81f4-83012bb2fe16", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-705892923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e85b16b3854c4604a963f680906e6b77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap275d8444-8b", "ovs_interfaceid": "275d8444-8b2a-49f6-9982-e36f8995180b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 19:49:14 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-4f05c8f2-dd21-43ee-9f50-e139ca555b76 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0b:a4:f8,bridge_name='br-int',has_traffic_filtering=True,id=275d8444-8b2a-49f6-9982-e36f8995180b,network=Network(648aeeec-8ba8-465a-81f4-83012bb2fe16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap275d8444-8b') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 19:49:14 user nova-compute[75216]: DEBUG os_vif [None req-4f05c8f2-dd21-43ee-9f50-e139ca555b76 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0b:a4:f8,bridge_name='br-int',has_traffic_filtering=True,id=275d8444-8b2a-49f6-9982-e36f8995180b,network=Network(648aeeec-8ba8-465a-81f4-83012bb2fe16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap275d8444-8b') {{(pid=75216) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 19:49:14 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:49:14 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap275d8444-8b, bridge=br-int, if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:49:14 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:49:14 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:49:14 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:49:14 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a9b0913f-b1fc-4810-a24d-699b7d22d00c) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:49:14 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:49:14 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:49:14 user nova-compute[75216]: INFO os_vif [None req-4f05c8f2-dd21-43ee-9f50-e139ca555b76 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0b:a4:f8,bridge_name='br-int',has_traffic_filtering=True,id=275d8444-8b2a-49f6-9982-e36f8995180b,network=Network(648aeeec-8ba8-465a-81f4-83012bb2fe16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap275d8444-8b')
Nov 13 19:49:14 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-4f05c8f2-dd21-43ee-9f50-e139ca555b76 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] [instance: accae217-e37a-4262-afc2-6084869847b8] Deleting instance files /opt/stack/data/nova/instances/accae217-e37a-4262-afc2-6084869847b8_del
Nov 13 19:49:14 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-4f05c8f2-dd21-43ee-9f50-e139ca555b76 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] [instance: accae217-e37a-4262-afc2-6084869847b8] Deletion of /opt/stack/data/nova/instances/accae217-e37a-4262-afc2-6084869847b8_del complete
Nov 13 19:49:14 user nova-compute[75216]: INFO nova.compute.manager [None req-4f05c8f2-dd21-43ee-9f50-e139ca555b76 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] [instance: accae217-e37a-4262-afc2-6084869847b8] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 13 19:49:14 user nova-compute[75216]: DEBUG oslo.service.loopingcall [None req-4f05c8f2-dd21-43ee-9f50-e139ca555b76 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75216) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 19:49:14 user nova-compute[75216]: DEBUG nova.compute.manager [-] [instance: accae217-e37a-4262-afc2-6084869847b8] Deallocating network for instance {{(pid=75216) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 19:49:14 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: accae217-e37a-4262-afc2-6084869847b8] deallocate_for_instance() {{(pid=75216) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 19:49:14 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:49:14 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:49:14 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:49:14 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:49:14 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:49:14 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:49:14 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:49:14 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: accae217-e37a-4262-afc2-6084869847b8] Updating instance_info_cache with network_info: [] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:49:14 user nova-compute[75216]: INFO nova.compute.manager [-] [instance: accae217-e37a-4262-afc2-6084869847b8] Took 0.64 seconds to deallocate network for instance.
Nov 13 19:49:14 user nova-compute[75216]: DEBUG nova.compute.manager [req-7f099c87-aaf3-4e68-8c86-20ce9a227e37 req-346f5982-caf0-41c3-a331-d6a0c5e84cbd service nova] [instance: accae217-e37a-4262-afc2-6084869847b8] Received event network-vif-deleted-275d8444-8b2a-49f6-9982-e36f8995180b {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:49:15 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-4f05c8f2-dd21-43ee-9f50-e139ca555b76 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:49:15 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-4f05c8f2-dd21-43ee-9f50-e139ca555b76 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:49:15 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-4f05c8f2-dd21-43ee-9f50-e139ca555b76 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 19:49:15 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-4f05c8f2-dd21-43ee-9f50-e139ca555b76 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 19:49:15 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-4f05c8f2-dd21-43ee-9f50-e139ca555b76 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.119s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:49:15 user nova-compute[75216]: INFO nova.scheduler.client.report [None req-4f05c8f2-dd21-43ee-9f50-e139ca555b76 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Deleted allocations for instance accae217-e37a-4262-afc2-6084869847b8
Nov 13 19:49:15 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-4f05c8f2-dd21-43ee-9f50-e139ca555b76 tempest-SnapshotDataIntegrityTests-2031098809 tempest-SnapshotDataIntegrityTests-2031098809-project-member] Lock "accae217-e37a-4262-afc2-6084869847b8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.867s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:49:15 user nova-compute[75216]: DEBUG nova.compute.manager [req-72169404-63de-400d-bcb0-54d5bafba206 req-10a6d24f-343b-47e3-88f8-6a3405723404 service nova] [instance: accae217-e37a-4262-afc2-6084869847b8] Received event network-vif-plugged-275d8444-8b2a-49f6-9982-e36f8995180b {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:49:15 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-72169404-63de-400d-bcb0-54d5bafba206 req-10a6d24f-343b-47e3-88f8-6a3405723404 service nova] Acquiring lock "accae217-e37a-4262-afc2-6084869847b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:49:15 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-72169404-63de-400d-bcb0-54d5bafba206 req-10a6d24f-343b-47e3-88f8-6a3405723404 service nova] Lock "accae217-e37a-4262-afc2-6084869847b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:49:15 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-72169404-63de-400d-bcb0-54d5bafba206 req-10a6d24f-343b-47e3-88f8-6a3405723404 service nova] Lock "accae217-e37a-4262-afc2-6084869847b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:49:15 user nova-compute[75216]: DEBUG nova.compute.manager [req-72169404-63de-400d-bcb0-54d5bafba206 req-10a6d24f-343b-47e3-88f8-6a3405723404 service nova] [instance: accae217-e37a-4262-afc2-6084869847b8] No waiting events found dispatching network-vif-plugged-275d8444-8b2a-49f6-9982-e36f8995180b {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 19:49:15 user nova-compute[75216]: WARNING nova.compute.manager [req-72169404-63de-400d-bcb0-54d5bafba206 req-10a6d24f-343b-47e3-88f8-6a3405723404 service nova] [instance: accae217-e37a-4262-afc2-6084869847b8] Received unexpected event network-vif-plugged-275d8444-8b2a-49f6-9982-e36f8995180b for instance with vm_state deleted and task_state None.
Nov 13 19:49:19 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:49:24 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:49:24 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:49:24 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75216) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 19:49:24 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 19:49:24 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 19:49:24 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:49:27 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:49:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:49:34 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:49:34 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:49:34 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75216) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 19:49:34 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 19:49:34 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 19:49:34 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:49:35 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:49:39 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:49:39 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:49:39 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75216) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 19:49:39 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 19:49:39 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 19:49:39 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:49:41 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:49:42 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:49:42 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75216) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 19:49:43 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:49:43 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Starting heal instance info cache {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 19:49:43 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Rebuilding the list of instances to heal {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 13 19:49:43 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Didn't find any instances for network info cache update. {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 13 19:49:44 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:49:44 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:49:44 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75216) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 19:49:44 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 19:49:44 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 19:49:44 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:49:44 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:49:44 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:49:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:49:49 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:49:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:49:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:49:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:49:49 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Auditing locally available compute resources for user (node: user) {{(pid=75216) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 19:49:49 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 19:49:49 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 19:49:49 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Hypervisor/Node resource view: name=user free_ram=9078MB free_disk=25.236526489257812GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75216) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 19:49:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:49:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:49:49 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 19:49:49 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 19:49:49 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 19:49:49 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 19:49:49 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Compute_service record updated for user:user {{(pid=75216) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 19:49:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.150s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:49:53 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:49:54 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:49:54 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:49:54 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75216) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 19:49:54 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 19:49:54 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 19:49:54 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:49:59 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:50:04 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:50:07 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:50:08 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:50:09 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:50:09 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:50:11 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:50:14 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:50:19 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:50:24 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:50:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:50:29 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:50:34 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:50:36 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:50:37 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:50:39 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:50:39 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:50:40 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:50:43 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:50:43 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:50:44 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:50:44 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:50:44 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:50:44 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75216) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 19:50:44 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:50:45 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:50:45 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Starting heal instance info cache {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 19:50:45 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Rebuilding the list of instances to heal {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 13 19:50:45 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Didn't find any instances for network info cache update. {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 13 19:50:45 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:50:45 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:50:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:50:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:50:50 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:50:50 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:50:50 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:50:50 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:50:50 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Auditing locally available compute resources for user (node: user) {{(pid=75216) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 19:50:50 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 19:50:50 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 19:50:50 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Hypervisor/Node resource view: name=user free_ram=8785MB free_disk=25.22235107421875GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75216) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 19:50:50 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:50:50 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:50:50 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 19:50:50 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 19:50:50 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 19:50:50 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 19:50:50 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Compute_service record updated for user:user {{(pid=75216) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 19:50:50 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.145s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:50:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a7d7a222-0c6c-468e-bd80-4b7abb1e7e9e tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Acquiring lock "9e347526-5ade-4396-80f8-73af0a2bab85" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:50:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a7d7a222-0c6c-468e-bd80-4b7abb1e7e9e tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Lock "9e347526-5ade-4396-80f8-73af0a2bab85" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:50:51 user nova-compute[75216]: DEBUG nova.compute.manager [None req-a7d7a222-0c6c-468e-bd80-4b7abb1e7e9e tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] [instance: 9e347526-5ade-4396-80f8-73af0a2bab85] Starting instance... {{(pid=75216) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 19:50:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a7d7a222-0c6c-468e-bd80-4b7abb1e7e9e tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:50:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a7d7a222-0c6c-468e-bd80-4b7abb1e7e9e tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:50:51 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-a7d7a222-0c6c-468e-bd80-4b7abb1e7e9e tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75216) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 19:50:51 user nova-compute[75216]: INFO nova.compute.claims [None req-a7d7a222-0c6c-468e-bd80-4b7abb1e7e9e tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] [instance: 9e347526-5ade-4396-80f8-73af0a2bab85] Claim successful on node user
Nov 13 19:50:52 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-a7d7a222-0c6c-468e-bd80-4b7abb1e7e9e tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 19:50:52 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-a7d7a222-0c6c-468e-bd80-4b7abb1e7e9e tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 19:50:52 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a7d7a222-0c6c-468e-bd80-4b7abb1e7e9e tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.217s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:50:52 user nova-compute[75216]: DEBUG nova.compute.manager [None req-a7d7a222-0c6c-468e-bd80-4b7abb1e7e9e tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] [instance: 9e347526-5ade-4396-80f8-73af0a2bab85] Start building networks asynchronously for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 19:50:52 user nova-compute[75216]: DEBUG nova.compute.manager [None req-a7d7a222-0c6c-468e-bd80-4b7abb1e7e9e tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] [instance: 9e347526-5ade-4396-80f8-73af0a2bab85] Allocating IP information in the background. {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 19:50:52 user nova-compute[75216]: DEBUG nova.network.neutron [None req-a7d7a222-0c6c-468e-bd80-4b7abb1e7e9e tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] [instance: 9e347526-5ade-4396-80f8-73af0a2bab85] allocate_for_instance() {{(pid=75216) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 19:50:52 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-a7d7a222-0c6c-468e-bd80-4b7abb1e7e9e tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] [instance: 9e347526-5ade-4396-80f8-73af0a2bab85] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 19:50:52 user nova-compute[75216]: DEBUG nova.compute.manager [None req-a7d7a222-0c6c-468e-bd80-4b7abb1e7e9e tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] [instance: 9e347526-5ade-4396-80f8-73af0a2bab85] Start building block device mappings for instance. {{(pid=75216) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 19:50:52 user nova-compute[75216]: DEBUG nova.policy [None req-a7d7a222-0c6c-468e-bd80-4b7abb1e7e9e tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5e8ea47ec6db4287a661362f82c1d2c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc380bcc607465a99822932ffc27549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75216) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 19:50:52 user nova-compute[75216]: DEBUG nova.compute.manager [None req-a7d7a222-0c6c-468e-bd80-4b7abb1e7e9e tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] [instance: 9e347526-5ade-4396-80f8-73af0a2bab85] Start spawning the instance on the hypervisor. {{(pid=75216) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 19:50:52 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-a7d7a222-0c6c-468e-bd80-4b7abb1e7e9e tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] [instance: 9e347526-5ade-4396-80f8-73af0a2bab85] Creating instance directory {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 19:50:52 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-a7d7a222-0c6c-468e-bd80-4b7abb1e7e9e tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] [instance: 9e347526-5ade-4396-80f8-73af0a2bab85] Creating image(s)
Nov 13 19:50:52 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a7d7a222-0c6c-468e-bd80-4b7abb1e7e9e tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Acquiring lock "/opt/stack/data/nova/instances/9e347526-5ade-4396-80f8-73af0a2bab85/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:50:52 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a7d7a222-0c6c-468e-bd80-4b7abb1e7e9e tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Lock "/opt/stack/data/nova/instances/9e347526-5ade-4396-80f8-73af0a2bab85/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:50:52 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a7d7a222-0c6c-468e-bd80-4b7abb1e7e9e tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Lock "/opt/stack/data/nova/instances/9e347526-5ade-4396-80f8-73af0a2bab85/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:50:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-a7d7a222-0c6c-468e-bd80-4b7abb1e7e9e tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:50:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-a7d7a222-0c6c-468e-bd80-4b7abb1e7e9e tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json" returned: 0 in 0.184s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:50:52 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a7d7a222-0c6c-468e-bd80-4b7abb1e7e9e tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Acquiring lock "88c50a45bec9d6b0427462b3242b9b8e5f49c2b6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:50:52 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a7d7a222-0c6c-468e-bd80-4b7abb1e7e9e tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Lock "88c50a45bec9d6b0427462b3242b9b8e5f49c2b6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:50:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-a7d7a222-0c6c-468e-bd80-4b7abb1e7e9e tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:50:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-a7d7a222-0c6c-468e-bd80-4b7abb1e7e9e tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json" returned: 0 in 0.186s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:50:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-a7d7a222-0c6c-468e-bd80-4b7abb1e7e9e tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6,backing_fmt=raw /opt/stack/data/nova/instances/9e347526-5ade-4396-80f8-73af0a2bab85/disk 1073741824 {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:50:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-a7d7a222-0c6c-468e-bd80-4b7abb1e7e9e tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6,backing_fmt=raw /opt/stack/data/nova/instances/9e347526-5ade-4396-80f8-73af0a2bab85/disk 1073741824" returned: 0 in 0.054s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:50:52 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a7d7a222-0c6c-468e-bd80-4b7abb1e7e9e tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Lock "88c50a45bec9d6b0427462b3242b9b8e5f49c2b6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:50:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-a7d7a222-0c6c-468e-bd80-4b7abb1e7e9e tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:50:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-a7d7a222-0c6c-468e-bd80-4b7abb1e7e9e tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88c50a45bec9d6b0427462b3242b9b8e5f49c2b6 --force-share --output=json" returned: 0 in 0.193s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:50:53 user nova-compute[75216]: DEBUG nova.virt.disk.api [None req-a7d7a222-0c6c-468e-bd80-4b7abb1e7e9e tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9e347526-5ade-4396-80f8-73af0a2bab85/disk. size=1073741824 {{(pid=75216) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 19:50:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-a7d7a222-0c6c-468e-bd80-4b7abb1e7e9e tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e347526-5ade-4396-80f8-73af0a2bab85/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:50:53 user nova-compute[75216]: DEBUG nova.network.neutron [None req-a7d7a222-0c6c-468e-bd80-4b7abb1e7e9e tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] [instance: 9e347526-5ade-4396-80f8-73af0a2bab85] Successfully created port: 665af93f-50b1-4e75-b074-78feda4b8f89 {{(pid=75216) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 19:50:53 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-a7d7a222-0c6c-468e-bd80-4b7abb1e7e9e tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e347526-5ade-4396-80f8-73af0a2bab85/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:50:53 user nova-compute[75216]: DEBUG nova.virt.disk.api [None req-a7d7a222-0c6c-468e-bd80-4b7abb1e7e9e tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Cannot resize image /opt/stack/data/nova/instances/9e347526-5ade-4396-80f8-73af0a2bab85/disk to a smaller size. {{(pid=75216) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 19:50:53 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-a7d7a222-0c6c-468e-bd80-4b7abb1e7e9e tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] [instance: 9e347526-5ade-4396-80f8-73af0a2bab85] Created local disks {{(pid=75216) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 19:50:53 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-a7d7a222-0c6c-468e-bd80-4b7abb1e7e9e tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] [instance: 9e347526-5ade-4396-80f8-73af0a2bab85] Ensure instance console log exists: /opt/stack/data/nova/instances/9e347526-5ade-4396-80f8-73af0a2bab85/console.log {{(pid=75216) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 19:50:53 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a7d7a222-0c6c-468e-bd80-4b7abb1e7e9e tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:50:53 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a7d7a222-0c6c-468e-bd80-4b7abb1e7e9e tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:50:53 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a7d7a222-0c6c-468e-bd80-4b7abb1e7e9e tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:50:53 user nova-compute[75216]: DEBUG nova.network.neutron [None req-a7d7a222-0c6c-468e-bd80-4b7abb1e7e9e tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] [instance: 9e347526-5ade-4396-80f8-73af0a2bab85] Successfully updated port: 665af93f-50b1-4e75-b074-78feda4b8f89 {{(pid=75216) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 19:50:53 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a7d7a222-0c6c-468e-bd80-4b7abb1e7e9e tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Acquiring lock "refresh_cache-9e347526-5ade-4396-80f8-73af0a2bab85" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 19:50:53 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a7d7a222-0c6c-468e-bd80-4b7abb1e7e9e tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Acquired lock "refresh_cache-9e347526-5ade-4396-80f8-73af0a2bab85" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 19:50:53 user nova-compute[75216]: DEBUG nova.network.neutron [None req-a7d7a222-0c6c-468e-bd80-4b7abb1e7e9e tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] [instance: 9e347526-5ade-4396-80f8-73af0a2bab85] Building network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 19:50:53 user nova-compute[75216]: DEBUG nova.compute.manager [req-897398d7-d875-4e7b-b736-11ff9b7573f6 req-8ff16166-b353-42bd-94fa-6d5f4778dd48 service nova] [instance: 9e347526-5ade-4396-80f8-73af0a2bab85] Received event network-changed-665af93f-50b1-4e75-b074-78feda4b8f89 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:50:53 user nova-compute[75216]: DEBUG nova.compute.manager [req-897398d7-d875-4e7b-b736-11ff9b7573f6 req-8ff16166-b353-42bd-94fa-6d5f4778dd48 service nova] [instance: 9e347526-5ade-4396-80f8-73af0a2bab85] Refreshing instance network info cache due to event network-changed-665af93f-50b1-4e75-b074-78feda4b8f89. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 19:50:53 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-897398d7-d875-4e7b-b736-11ff9b7573f6 req-8ff16166-b353-42bd-94fa-6d5f4778dd48 service nova] Acquiring lock "refresh_cache-9e347526-5ade-4396-80f8-73af0a2bab85" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 19:50:53 user nova-compute[75216]: DEBUG nova.network.neutron [None req-a7d7a222-0c6c-468e-bd80-4b7abb1e7e9e tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] [instance: 9e347526-5ade-4396-80f8-73af0a2bab85] Instance cache missing network info. {{(pid=75216) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 19:50:54 user nova-compute[75216]: DEBUG nova.network.neutron [None req-a7d7a222-0c6c-468e-bd80-4b7abb1e7e9e tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] [instance: 9e347526-5ade-4396-80f8-73af0a2bab85] Updating instance_info_cache with network_info: [{"id": "665af93f-50b1-4e75-b074-78feda4b8f89", "address": "fa:16:3e:38:e7:d0", "network": {"id": "030e67c6-1489-4a16-b93e-b8731813e15d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2017692564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adc380bcc607465a99822932ffc27549", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap665af93f-50", "ovs_interfaceid": "665af93f-50b1-4e75-b074-78feda4b8f89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:50:54 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a7d7a222-0c6c-468e-bd80-4b7abb1e7e9e tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Releasing lock "refresh_cache-9e347526-5ade-4396-80f8-73af0a2bab85" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 19:50:54 user nova-compute[75216]: DEBUG nova.compute.manager [None req-a7d7a222-0c6c-468e-bd80-4b7abb1e7e9e tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] [instance: 9e347526-5ade-4396-80f8-73af0a2bab85] Instance network_info: |[{"id": "665af93f-50b1-4e75-b074-78feda4b8f89", "address": "fa:16:3e:38:e7:d0", "network": {"id": "030e67c6-1489-4a16-b93e-b8731813e15d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2017692564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adc380bcc607465a99822932ffc27549", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap665af93f-50", "ovs_interfaceid": "665af93f-50b1-4e75-b074-78feda4b8f89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75216) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 19:50:54 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-897398d7-d875-4e7b-b736-11ff9b7573f6 req-8ff16166-b353-42bd-94fa-6d5f4778dd48 service nova] Acquired lock "refresh_cache-9e347526-5ade-4396-80f8-73af0a2bab85" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 19:50:54 user nova-compute[75216]: DEBUG nova.network.neutron [req-897398d7-d875-4e7b-b736-11ff9b7573f6 req-8ff16166-b353-42bd-94fa-6d5f4778dd48 service nova] [instance: 9e347526-5ade-4396-80f8-73af0a2bab85] Refreshing network info cache for port 665af93f-50b1-4e75-b074-78feda4b8f89 {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 19:50:54 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-a7d7a222-0c6c-468e-bd80-4b7abb1e7e9e tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] [instance: 9e347526-5ade-4396-80f8-73af0a2bab85] Start _get_guest_xml network_info=[{"id": "665af93f-50b1-4e75-b074-78feda4b8f89", "address": "fa:16:3e:38:e7:d0", "network": {"id": "030e67c6-1489-4a16-b93e-b8731813e15d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2017692564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adc380bcc607465a99822932ffc27549", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap665af93f-50", "ovs_interfaceid": "665af93f-50b1-4e75-b074-78feda4b8f89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T18:41:06Z,direct_url=<?>,disk_format='qcow2',id=77bcb5ba-8510-41ec-a88d-96097bb431de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c465b7c26ec44582b6d1b7169536ecc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T18:41:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'guest_format': None, 'boot_index': 0, 'image_id': '77bcb5ba-8510-41ec-a88d-96097bb431de'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 19:50:54 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-a7d7a222-0c6c-468e-bd80-4b7abb1e7e9e tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 19:50:54 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-a7d7a222-0c6c-468e-bd80-4b7abb1e7e9e tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 19:50:54 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-a7d7a222-0c6c-468e-bd80-4b7abb1e7e9e tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 19:50:54 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-a7d7a222-0c6c-468e-bd80-4b7abb1e7e9e tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] CPU controller missing on host. {{(pid=75216) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 19:50:54 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-a7d7a222-0c6c-468e-bd80-4b7abb1e7e9e tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 19:50:54 user nova-compute[75216]: DEBUG nova.virt.libvirt.host [None req-a7d7a222-0c6c-468e-bd80-4b7abb1e7e9e tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] CPU controller found on host. {{(pid=75216) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 19:50:54 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-a7d7a222-0c6c-468e-bd80-4b7abb1e7e9e tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75216) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 19:50:54 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-a7d7a222-0c6c-468e-bd80-4b7abb1e7e9e tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T18:40:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T18:41:06Z,direct_url=<?>,disk_format='qcow2',id=77bcb5ba-8510-41ec-a88d-96097bb431de,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c465b7c26ec44582b6d1b7169536ecc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T18:41:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 19:50:54 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-a7d7a222-0c6c-468e-bd80-4b7abb1e7e9e tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Flavor limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 19:50:54 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-a7d7a222-0c6c-468e-bd80-4b7abb1e7e9e tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Image limits 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 19:50:54 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-a7d7a222-0c6c-468e-bd80-4b7abb1e7e9e tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Flavor pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 19:50:54 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-a7d7a222-0c6c-468e-bd80-4b7abb1e7e9e tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Image pref 0:0:0 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 19:50:54 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-a7d7a222-0c6c-468e-bd80-4b7abb1e7e9e tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 19:50:54 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-a7d7a222-0c6c-468e-bd80-4b7abb1e7e9e tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 19:50:54 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-a7d7a222-0c6c-468e-bd80-4b7abb1e7e9e tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 19:50:54 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-a7d7a222-0c6c-468e-bd80-4b7abb1e7e9e tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Got 1 possible topologies {{(pid=75216) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 19:50:54 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-a7d7a222-0c6c-468e-bd80-4b7abb1e7e9e tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 19:50:54 user nova-compute[75216]: DEBUG nova.virt.hardware [None req-a7d7a222-0c6c-468e-bd80-4b7abb1e7e9e tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75216) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 19:50:54 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-a7d7a222-0c6c-468e-bd80-4b7abb1e7e9e tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T19:50:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1217835648',display_name='tempest-SnapshotDataIntegrityTests-server-1217835648',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1217835648',id=53,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI4rMpsDWGoCUrCti8d7FdGAn/qu4QeH3JxCDmryxoUPPcAsmBiRPeqivOaV/XBdPQXKW3maPsvEHEOsGhPvSQzIy/sAIBTdRyp63MQYOpILnS5NTnmgHLZxERcuggWSjA==',key_name='tempest-keypair-232567432',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='adc380bcc607465a99822932ffc27549',ramdisk_id='',reservation_id='r-pcjx20u4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-2036163840',owner_user_name='tempest-SnapshotDataIntegrityTests-2036163840-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T19:50:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5e8ea47ec6db4287a661362f82c1d2c6',uuid=9e347526-5ade-4396-80f8-73af0a2bab85,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "665af93f-50b1-4e75-b074-78feda4b8f89", "address": "fa:16:3e:38:e7:d0", "network": {"id": "030e67c6-1489-4a16-b93e-b8731813e15d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2017692564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adc380bcc607465a99822932ffc27549", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap665af93f-50", "ovs_interfaceid": "665af93f-50b1-4e75-b074-78feda4b8f89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75216) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 19:50:54 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-a7d7a222-0c6c-468e-bd80-4b7abb1e7e9e tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Converting VIF {"id": "665af93f-50b1-4e75-b074-78feda4b8f89", "address": "fa:16:3e:38:e7:d0", "network": {"id": "030e67c6-1489-4a16-b93e-b8731813e15d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2017692564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adc380bcc607465a99822932ffc27549", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap665af93f-50", "ovs_interfaceid": "665af93f-50b1-4e75-b074-78feda4b8f89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 19:50:54 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-a7d7a222-0c6c-468e-bd80-4b7abb1e7e9e tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:e7:d0,bridge_name='br-int',has_traffic_filtering=True,id=665af93f-50b1-4e75-b074-78feda4b8f89,network=Network(030e67c6-1489-4a16-b93e-b8731813e15d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap665af93f-50') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 19:50:54 user nova-compute[75216]: DEBUG nova.objects.instance [None req-a7d7a222-0c6c-468e-bd80-4b7abb1e7e9e tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Lazy-loading 'pci_devices' on Instance uuid 9e347526-5ade-4396-80f8-73af0a2bab85 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:50:54 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-a7d7a222-0c6c-468e-bd80-4b7abb1e7e9e tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] [instance: 9e347526-5ade-4396-80f8-73af0a2bab85] End _get_guest_xml xml=<domain type="kvm">
Nov 13 19:50:54 user nova-compute[75216]:   <uuid>9e347526-5ade-4396-80f8-73af0a2bab85</uuid>
Nov 13 19:50:54 user nova-compute[75216]:   <name>instance-00000035</name>
Nov 13 19:50:54 user nova-compute[75216]:   <memory>524288</memory>
Nov 13 19:50:54 user nova-compute[75216]:   <vcpu>1</vcpu>
Nov 13 19:50:54 user nova-compute[75216]:   <metadata>
Nov 13 19:50:54 user nova-compute[75216]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 19:50:54 user nova-compute[75216]:       <nova:package version="0.0.0"/>
Nov 13 19:50:54 user nova-compute[75216]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1217835648</nova:name>
Nov 13 19:50:54 user nova-compute[75216]:       <nova:creationTime>2023-11-13 19:50:54</nova:creationTime>
Nov 13 19:50:54 user nova-compute[75216]:       <nova:flavor name="m1.tiny">
Nov 13 19:50:54 user nova-compute[75216]:         <nova:memory>512</nova:memory>
Nov 13 19:50:54 user nova-compute[75216]:         <nova:disk>1</nova:disk>
Nov 13 19:50:54 user nova-compute[75216]:         <nova:swap>0</nova:swap>
Nov 13 19:50:54 user nova-compute[75216]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 19:50:54 user nova-compute[75216]:         <nova:vcpus>1</nova:vcpus>
Nov 13 19:50:54 user nova-compute[75216]:       </nova:flavor>
Nov 13 19:50:54 user nova-compute[75216]:       <nova:owner>
Nov 13 19:50:54 user nova-compute[75216]:         <nova:user uuid="5e8ea47ec6db4287a661362f82c1d2c6">tempest-SnapshotDataIntegrityTests-2036163840-project-member</nova:user>
Nov 13 19:50:54 user nova-compute[75216]:         <nova:project uuid="adc380bcc607465a99822932ffc27549">tempest-SnapshotDataIntegrityTests-2036163840</nova:project>
Nov 13 19:50:54 user nova-compute[75216]:       </nova:owner>
Nov 13 19:50:54 user nova-compute[75216]:       <nova:root type="image" uuid="77bcb5ba-8510-41ec-a88d-96097bb431de"/>
Nov 13 19:50:54 user nova-compute[75216]:       <nova:ports>
Nov 13 19:50:54 user nova-compute[75216]:         <nova:port uuid="665af93f-50b1-4e75-b074-78feda4b8f89">
Nov 13 19:50:54 user nova-compute[75216]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 13 19:50:54 user nova-compute[75216]:         </nova:port>
Nov 13 19:50:54 user nova-compute[75216]:       </nova:ports>
Nov 13 19:50:54 user nova-compute[75216]:     </nova:instance>
Nov 13 19:50:54 user nova-compute[75216]:   </metadata>
Nov 13 19:50:54 user nova-compute[75216]:   <sysinfo type="smbios">
Nov 13 19:50:54 user nova-compute[75216]:     <system>
Nov 13 19:50:54 user nova-compute[75216]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 19:50:54 user nova-compute[75216]:       <entry name="product">OpenStack Nova</entry>
Nov 13 19:50:54 user nova-compute[75216]:       <entry name="version">0.0.0</entry>
Nov 13 19:50:54 user nova-compute[75216]:       <entry name="serial">9e347526-5ade-4396-80f8-73af0a2bab85</entry>
Nov 13 19:50:54 user nova-compute[75216]:       <entry name="uuid">9e347526-5ade-4396-80f8-73af0a2bab85</entry>
Nov 13 19:50:54 user nova-compute[75216]:       <entry name="family">Virtual Machine</entry>
Nov 13 19:50:54 user nova-compute[75216]:     </system>
Nov 13 19:50:54 user nova-compute[75216]:   </sysinfo>
Nov 13 19:50:54 user nova-compute[75216]:   <os>
Nov 13 19:50:54 user nova-compute[75216]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 19:50:54 user nova-compute[75216]:     <boot dev="hd"/>
Nov 13 19:50:54 user nova-compute[75216]:     <smbios mode="sysinfo"/>
Nov 13 19:50:54 user nova-compute[75216]:   </os>
Nov 13 19:50:54 user nova-compute[75216]:   <features>
Nov 13 19:50:54 user nova-compute[75216]:     <acpi/>
Nov 13 19:50:54 user nova-compute[75216]:     <apic/>
Nov 13 19:50:54 user nova-compute[75216]:     <vmcoreinfo/>
Nov 13 19:50:54 user nova-compute[75216]:   </features>
Nov 13 19:50:54 user nova-compute[75216]:   <clock offset="utc">
Nov 13 19:50:54 user nova-compute[75216]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 19:50:54 user nova-compute[75216]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 19:50:54 user nova-compute[75216]:     <timer name="hpet" present="no"/>
Nov 13 19:50:54 user nova-compute[75216]:   </clock>
Nov 13 19:50:54 user nova-compute[75216]:   <cpu mode="custom" match="exact">
Nov 13 19:50:54 user nova-compute[75216]:     <model>Nehalem</model>
Nov 13 19:50:54 user nova-compute[75216]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 19:50:54 user nova-compute[75216]:   </cpu>
Nov 13 19:50:54 user nova-compute[75216]:   <devices>
Nov 13 19:50:54 user nova-compute[75216]:     <disk type="file" device="disk">
Nov 13 19:50:54 user nova-compute[75216]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 19:50:54 user nova-compute[75216]:       <source file="/opt/stack/data/nova/instances/9e347526-5ade-4396-80f8-73af0a2bab85/disk"/>
Nov 13 19:50:54 user nova-compute[75216]:       <target dev="vda" bus="virtio"/>
Nov 13 19:50:54 user nova-compute[75216]:     </disk>
Nov 13 19:50:54 user nova-compute[75216]:     <interface type="ethernet">
Nov 13 19:50:54 user nova-compute[75216]:       <mac address="fa:16:3e:38:e7:d0"/>
Nov 13 19:50:54 user nova-compute[75216]:       <model type="virtio"/>
Nov 13 19:50:54 user nova-compute[75216]:       <mtu size="1442"/>
Nov 13 19:50:54 user nova-compute[75216]:       <target dev="tap665af93f-50"/>
Nov 13 19:50:54 user nova-compute[75216]:     </interface>
Nov 13 19:50:54 user nova-compute[75216]:     <serial type="pty">
Nov 13 19:50:54 user nova-compute[75216]:       <log file="/opt/stack/data/nova/instances/9e347526-5ade-4396-80f8-73af0a2bab85/console.log" append="off"/>
Nov 13 19:50:54 user nova-compute[75216]:     </serial>
Nov 13 19:50:54 user nova-compute[75216]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 19:50:54 user nova-compute[75216]:     <video>
Nov 13 19:50:54 user nova-compute[75216]:       <model type="virtio"/>
Nov 13 19:50:54 user nova-compute[75216]:     </video>
Nov 13 19:50:54 user nova-compute[75216]:     <rng model="virtio">
Nov 13 19:50:54 user nova-compute[75216]:       <backend model="random">/dev/urandom</backend>
Nov 13 19:50:54 user nova-compute[75216]:     </rng>
Nov 13 19:50:54 user nova-compute[75216]:     <controller type="usb" index="0" model="none"/>
Nov 13 19:50:54 user nova-compute[75216]:     <memballoon model="virtio">
Nov 13 19:50:54 user nova-compute[75216]:       <stats period="10"/>
Nov 13 19:50:54 user nova-compute[75216]:     </memballoon>
Nov 13 19:50:54 user nova-compute[75216]:   </devices>
Nov 13 19:50:54 user nova-compute[75216]: </domain>
Nov 13 19:50:54 user nova-compute[75216]:  {{(pid=75216) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 19:50:54 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-a7d7a222-0c6c-468e-bd80-4b7abb1e7e9e tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T19:50:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1217835648',display_name='tempest-SnapshotDataIntegrityTests-server-1217835648',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1217835648',id=53,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI4rMpsDWGoCUrCti8d7FdGAn/qu4QeH3JxCDmryxoUPPcAsmBiRPeqivOaV/XBdPQXKW3maPsvEHEOsGhPvSQzIy/sAIBTdRyp63MQYOpILnS5NTnmgHLZxERcuggWSjA==',key_name='tempest-keypair-232567432',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='adc380bcc607465a99822932ffc27549',ramdisk_id='',reservation_id='r-pcjx20u4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-2036163840',owner_user_name='tempest-SnapshotDataIntegrityTests-2036163840-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T19:50:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5e8ea47ec6db4287a661362f82c1d2c6',uuid=9e347526-5ade-4396-80f8-73af0a2bab85,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "665af93f-50b1-4e75-b074-78feda4b8f89", "address": "fa:16:3e:38:e7:d0", "network": {"id": "030e67c6-1489-4a16-b93e-b8731813e15d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2017692564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adc380bcc607465a99822932ffc27549", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap665af93f-50", "ovs_interfaceid": "665af93f-50b1-4e75-b074-78feda4b8f89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 19:50:54 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-a7d7a222-0c6c-468e-bd80-4b7abb1e7e9e tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Converting VIF {"id": "665af93f-50b1-4e75-b074-78feda4b8f89", "address": "fa:16:3e:38:e7:d0", "network": {"id": "030e67c6-1489-4a16-b93e-b8731813e15d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2017692564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adc380bcc607465a99822932ffc27549", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap665af93f-50", "ovs_interfaceid": "665af93f-50b1-4e75-b074-78feda4b8f89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 19:50:54 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-a7d7a222-0c6c-468e-bd80-4b7abb1e7e9e tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:e7:d0,bridge_name='br-int',has_traffic_filtering=True,id=665af93f-50b1-4e75-b074-78feda4b8f89,network=Network(030e67c6-1489-4a16-b93e-b8731813e15d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap665af93f-50') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 19:50:54 user nova-compute[75216]: DEBUG os_vif [None req-a7d7a222-0c6c-468e-bd80-4b7abb1e7e9e tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:e7:d0,bridge_name='br-int',has_traffic_filtering=True,id=665af93f-50b1-4e75-b074-78feda4b8f89,network=Network(030e67c6-1489-4a16-b93e-b8731813e15d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap665af93f-50') {{(pid=75216) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 19:50:54 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:50:54 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:50:54 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 19:50:54 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:50:54 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:50:54 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8f3f14c9-7fe9-53a3-8046-07d913b21658', '_type': 'linux-noop'}}, row=False) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:50:54 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:50:54 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:50:54 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap665af93f-50, may_exist=True, interface_attrs={}) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:50:54 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap665af93f-50, col_values=(('qos', UUID('cccbe9b8-d893-4465-8a4e-829bfff10723')),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:50:54 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap665af93f-50, col_values=(('external_ids', {'iface-id': '665af93f-50b1-4e75-b074-78feda4b8f89', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:38:e7:d0', 'vm-uuid': '9e347526-5ade-4396-80f8-73af0a2bab85'}),), if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:50:54 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:50:54 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:50:54 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:50:54 user nova-compute[75216]: INFO os_vif [None req-a7d7a222-0c6c-468e-bd80-4b7abb1e7e9e tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:e7:d0,bridge_name='br-int',has_traffic_filtering=True,id=665af93f-50b1-4e75-b074-78feda4b8f89,network=Network(030e67c6-1489-4a16-b93e-b8731813e15d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap665af93f-50')
Nov 13 19:50:54 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-a7d7a222-0c6c-468e-bd80-4b7abb1e7e9e tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 19:50:54 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-a7d7a222-0c6c-468e-bd80-4b7abb1e7e9e tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] No VIF found with MAC fa:16:3e:38:e7:d0, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 19:50:54 user nova-compute[75216]: DEBUG nova.network.neutron [req-897398d7-d875-4e7b-b736-11ff9b7573f6 req-8ff16166-b353-42bd-94fa-6d5f4778dd48 service nova] [instance: 9e347526-5ade-4396-80f8-73af0a2bab85] Updated VIF entry in instance network info cache for port 665af93f-50b1-4e75-b074-78feda4b8f89. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 19:50:54 user nova-compute[75216]: DEBUG nova.network.neutron [req-897398d7-d875-4e7b-b736-11ff9b7573f6 req-8ff16166-b353-42bd-94fa-6d5f4778dd48 service nova] [instance: 9e347526-5ade-4396-80f8-73af0a2bab85] Updating instance_info_cache with network_info: [{"id": "665af93f-50b1-4e75-b074-78feda4b8f89", "address": "fa:16:3e:38:e7:d0", "network": {"id": "030e67c6-1489-4a16-b93e-b8731813e15d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2017692564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adc380bcc607465a99822932ffc27549", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap665af93f-50", "ovs_interfaceid": "665af93f-50b1-4e75-b074-78feda4b8f89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:50:54 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-897398d7-d875-4e7b-b736-11ff9b7573f6 req-8ff16166-b353-42bd-94fa-6d5f4778dd48 service nova] Releasing lock "refresh_cache-9e347526-5ade-4396-80f8-73af0a2bab85" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 19:50:54 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:50:55 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:50:55 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:50:55 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:50:55 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:50:55 user nova-compute[75216]: DEBUG nova.compute.manager [req-36c82040-7ba2-4d54-9e6b-aef8ef544528 req-aa6b9726-48c5-48c6-bf43-6be9dd7910fc service nova] [instance: 9e347526-5ade-4396-80f8-73af0a2bab85] Received event network-vif-plugged-665af93f-50b1-4e75-b074-78feda4b8f89 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:50:55 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-36c82040-7ba2-4d54-9e6b-aef8ef544528 req-aa6b9726-48c5-48c6-bf43-6be9dd7910fc service nova] Acquiring lock "9e347526-5ade-4396-80f8-73af0a2bab85-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:50:55 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-36c82040-7ba2-4d54-9e6b-aef8ef544528 req-aa6b9726-48c5-48c6-bf43-6be9dd7910fc service nova] Lock "9e347526-5ade-4396-80f8-73af0a2bab85-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:50:55 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-36c82040-7ba2-4d54-9e6b-aef8ef544528 req-aa6b9726-48c5-48c6-bf43-6be9dd7910fc service nova] Lock "9e347526-5ade-4396-80f8-73af0a2bab85-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:50:55 user nova-compute[75216]: DEBUG nova.compute.manager [req-36c82040-7ba2-4d54-9e6b-aef8ef544528 req-aa6b9726-48c5-48c6-bf43-6be9dd7910fc service nova] [instance: 9e347526-5ade-4396-80f8-73af0a2bab85] No waiting events found dispatching network-vif-plugged-665af93f-50b1-4e75-b074-78feda4b8f89 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 19:50:55 user nova-compute[75216]: WARNING nova.compute.manager [req-36c82040-7ba2-4d54-9e6b-aef8ef544528 req-aa6b9726-48c5-48c6-bf43-6be9dd7910fc service nova] [instance: 9e347526-5ade-4396-80f8-73af0a2bab85] Received unexpected event network-vif-plugged-665af93f-50b1-4e75-b074-78feda4b8f89 for instance with vm_state building and task_state spawning.
Nov 13 19:50:55 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:50:56 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:50:56 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:50:56 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:50:56 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:50:58 user nova-compute[75216]: DEBUG nova.compute.manager [req-87b3298f-5520-48df-bce8-b7089262fc67 req-4278334c-ba76-4a38-8d62-60639b671aad service nova] [instance: 9e347526-5ade-4396-80f8-73af0a2bab85] Received event network-vif-plugged-665af93f-50b1-4e75-b074-78feda4b8f89 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:50:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-87b3298f-5520-48df-bce8-b7089262fc67 req-4278334c-ba76-4a38-8d62-60639b671aad service nova] Acquiring lock "9e347526-5ade-4396-80f8-73af0a2bab85-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:50:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-87b3298f-5520-48df-bce8-b7089262fc67 req-4278334c-ba76-4a38-8d62-60639b671aad service nova] Lock "9e347526-5ade-4396-80f8-73af0a2bab85-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:50:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-87b3298f-5520-48df-bce8-b7089262fc67 req-4278334c-ba76-4a38-8d62-60639b671aad service nova] Lock "9e347526-5ade-4396-80f8-73af0a2bab85-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:50:58 user nova-compute[75216]: DEBUG nova.compute.manager [req-87b3298f-5520-48df-bce8-b7089262fc67 req-4278334c-ba76-4a38-8d62-60639b671aad service nova] [instance: 9e347526-5ade-4396-80f8-73af0a2bab85] No waiting events found dispatching network-vif-plugged-665af93f-50b1-4e75-b074-78feda4b8f89 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 19:50:58 user nova-compute[75216]: WARNING nova.compute.manager [req-87b3298f-5520-48df-bce8-b7089262fc67 req-4278334c-ba76-4a38-8d62-60639b671aad service nova] [instance: 9e347526-5ade-4396-80f8-73af0a2bab85] Received unexpected event network-vif-plugged-665af93f-50b1-4e75-b074-78feda4b8f89 for instance with vm_state building and task_state spawning.
Nov 13 19:50:58 user nova-compute[75216]: DEBUG nova.compute.manager [None req-a7d7a222-0c6c-468e-bd80-4b7abb1e7e9e tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] [instance: 9e347526-5ade-4396-80f8-73af0a2bab85] Instance event wait completed in 0 seconds for  {{(pid=75216) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 19:50:58 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-a7d7a222-0c6c-468e-bd80-4b7abb1e7e9e tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] [instance: 9e347526-5ade-4396-80f8-73af0a2bab85] Guest created on hypervisor {{(pid=75216) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 19:50:58 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 9e347526-5ade-4396-80f8-73af0a2bab85] Instance spawned successfully.
Nov 13 19:50:58 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-a7d7a222-0c6c-468e-bd80-4b7abb1e7e9e tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] [instance: 9e347526-5ade-4396-80f8-73af0a2bab85] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 19:50:58 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-a7d7a222-0c6c-468e-bd80-4b7abb1e7e9e tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] [instance: 9e347526-5ade-4396-80f8-73af0a2bab85] Found default for hw_cdrom_bus of ide {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 19:50:58 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-a7d7a222-0c6c-468e-bd80-4b7abb1e7e9e tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] [instance: 9e347526-5ade-4396-80f8-73af0a2bab85] Found default for hw_disk_bus of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 19:50:58 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-a7d7a222-0c6c-468e-bd80-4b7abb1e7e9e tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] [instance: 9e347526-5ade-4396-80f8-73af0a2bab85] Found default for hw_input_bus of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 19:50:58 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-a7d7a222-0c6c-468e-bd80-4b7abb1e7e9e tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] [instance: 9e347526-5ade-4396-80f8-73af0a2bab85] Found default for hw_pointer_model of None {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 19:50:58 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-a7d7a222-0c6c-468e-bd80-4b7abb1e7e9e tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] [instance: 9e347526-5ade-4396-80f8-73af0a2bab85] Found default for hw_video_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 19:50:58 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-a7d7a222-0c6c-468e-bd80-4b7abb1e7e9e tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] [instance: 9e347526-5ade-4396-80f8-73af0a2bab85] Found default for hw_vif_model of virtio {{(pid=75216) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 19:50:58 user nova-compute[75216]: INFO nova.compute.manager [None req-a7d7a222-0c6c-468e-bd80-4b7abb1e7e9e tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] [instance: 9e347526-5ade-4396-80f8-73af0a2bab85] Took 5.89 seconds to spawn the instance on the hypervisor.
Nov 13 19:50:58 user nova-compute[75216]: DEBUG nova.compute.manager [None req-a7d7a222-0c6c-468e-bd80-4b7abb1e7e9e tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] [instance: 9e347526-5ade-4396-80f8-73af0a2bab85] Checking state {{(pid=75216) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 19:50:58 user nova-compute[75216]: INFO nova.compute.manager [None req-a7d7a222-0c6c-468e-bd80-4b7abb1e7e9e tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] [instance: 9e347526-5ade-4396-80f8-73af0a2bab85] Took 6.50 seconds to build instance.
Nov 13 19:50:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-a7d7a222-0c6c-468e-bd80-4b7abb1e7e9e tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Lock "9e347526-5ade-4396-80f8-73af0a2bab85" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.636s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:50:59 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:50:59 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:51:04 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:51:09 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:51:09 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:51:14 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:51:14 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:51:19 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:51:19 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:51:24 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:51:24 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:51:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:51:29 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:51:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:51:30 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:51:30 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Triggering sync for uuid 9e347526-5ade-4396-80f8-73af0a2bab85 {{(pid=75216) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 13 19:51:30 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "9e347526-5ade-4396-80f8-73af0a2bab85" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:51:30 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "9e347526-5ade-4396-80f8-73af0a2bab85" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:51:30 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "9e347526-5ade-4396-80f8-73af0a2bab85" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.025s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:51:34 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:51:37 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:51:39 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:51:44 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:51:44 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:51:45 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:51:45 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Starting heal instance info cache {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 19:51:45 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Rebuilding the list of instances to heal {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 13 19:51:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "refresh_cache-9e347526-5ade-4396-80f8-73af0a2bab85" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 19:51:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquired lock "refresh_cache-9e347526-5ade-4396-80f8-73af0a2bab85" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 19:51:45 user nova-compute[75216]: DEBUG nova.network.neutron [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: 9e347526-5ade-4396-80f8-73af0a2bab85] Forcefully refreshing network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 19:51:45 user nova-compute[75216]: DEBUG nova.objects.instance [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lazy-loading 'info_cache' on Instance uuid 9e347526-5ade-4396-80f8-73af0a2bab85 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:51:45 user nova-compute[75216]: DEBUG nova.network.neutron [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: 9e347526-5ade-4396-80f8-73af0a2bab85] Updating instance_info_cache with network_info: [{"id": "665af93f-50b1-4e75-b074-78feda4b8f89", "address": "fa:16:3e:38:e7:d0", "network": {"id": "030e67c6-1489-4a16-b93e-b8731813e15d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2017692564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adc380bcc607465a99822932ffc27549", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap665af93f-50", "ovs_interfaceid": "665af93f-50b1-4e75-b074-78feda4b8f89", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:51:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Releasing lock "refresh_cache-9e347526-5ade-4396-80f8-73af0a2bab85" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 19:51:45 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: 9e347526-5ade-4396-80f8-73af0a2bab85] Updated the network info_cache for instance {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 19:51:45 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:51:46 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:51:46 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:51:46 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75216) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 19:51:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:51:50 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:51:50 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:51:50 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:51:50 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:51:50 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Auditing locally available compute resources for user (node: user) {{(pid=75216) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 19:51:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e347526-5ade-4396-80f8-73af0a2bab85/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:51:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e347526-5ade-4396-80f8-73af0a2bab85/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:51:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e347526-5ade-4396-80f8-73af0a2bab85/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:51:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e347526-5ade-4396-80f8-73af0a2bab85/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:51:51 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 19:51:51 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 19:51:51 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Hypervisor/Node resource view: name=user free_ram=8947MB free_disk=25.191234588623047GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75216) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 19:51:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:51:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:51:51 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance 9e347526-5ade-4396-80f8-73af0a2bab85 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 19:51:51 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 19:51:51 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 19:51:51 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Refreshing inventories for resource provider d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 13 19:51:51 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Updating ProviderTree inventory for provider d927e00d-5a8b-43f7-ac04-6437958fac1f from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 13 19:51:51 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Updating inventory in ProviderTree for provider d927e00d-5a8b-43f7-ac04-6437958fac1f with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 13 19:51:51 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Refreshing aggregate associations for resource provider d927e00d-5a8b-43f7-ac04-6437958fac1f, aggregates: None {{(pid=75216) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 13 19:51:51 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Refreshing trait associations for resource provider d927e00d-5a8b-43f7-ac04-6437958fac1f, traits: COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_MMX {{(pid=75216) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 13 19:51:51 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 19:51:51 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 19:51:51 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Compute_service record updated for user:user {{(pid=75216) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 19:51:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.321s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:51:54 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:51:54 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:51:56 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:51:59 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:52:00 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:52:00 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Cleaning up deleted instances {{(pid=75216) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 13 19:52:00 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] There are 0 instances to clean {{(pid=75216) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 13 19:52:04 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:52:09 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:52:11 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:52:11 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75216) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 13 19:52:14 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:52:14 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:52:19 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:52:24 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:52:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:52:31 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:52:34 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:52:39 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:52:39 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:52:43 user nova-compute[75216]: DEBUG nova.compute.manager [req-5315a6fd-ad79-46a3-a8c9-a61216746335 req-51360e02-3d79-40d6-98d0-032c48566cbb service nova] [instance: 9e347526-5ade-4396-80f8-73af0a2bab85] Received event network-changed-665af93f-50b1-4e75-b074-78feda4b8f89 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:52:43 user nova-compute[75216]: DEBUG nova.compute.manager [req-5315a6fd-ad79-46a3-a8c9-a61216746335 req-51360e02-3d79-40d6-98d0-032c48566cbb service nova] [instance: 9e347526-5ade-4396-80f8-73af0a2bab85] Refreshing instance network info cache due to event network-changed-665af93f-50b1-4e75-b074-78feda4b8f89. {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 19:52:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-5315a6fd-ad79-46a3-a8c9-a61216746335 req-51360e02-3d79-40d6-98d0-032c48566cbb service nova] Acquiring lock "refresh_cache-9e347526-5ade-4396-80f8-73af0a2bab85" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 19:52:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-5315a6fd-ad79-46a3-a8c9-a61216746335 req-51360e02-3d79-40d6-98d0-032c48566cbb service nova] Acquired lock "refresh_cache-9e347526-5ade-4396-80f8-73af0a2bab85" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 19:52:43 user nova-compute[75216]: DEBUG nova.network.neutron [req-5315a6fd-ad79-46a3-a8c9-a61216746335 req-51360e02-3d79-40d6-98d0-032c48566cbb service nova] [instance: 9e347526-5ade-4396-80f8-73af0a2bab85] Refreshing network info cache for port 665af93f-50b1-4e75-b074-78feda4b8f89 {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 19:52:43 user nova-compute[75216]: DEBUG nova.network.neutron [req-5315a6fd-ad79-46a3-a8c9-a61216746335 req-51360e02-3d79-40d6-98d0-032c48566cbb service nova] [instance: 9e347526-5ade-4396-80f8-73af0a2bab85] Updated VIF entry in instance network info cache for port 665af93f-50b1-4e75-b074-78feda4b8f89. {{(pid=75216) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 19:52:43 user nova-compute[75216]: DEBUG nova.network.neutron [req-5315a6fd-ad79-46a3-a8c9-a61216746335 req-51360e02-3d79-40d6-98d0-032c48566cbb service nova] [instance: 9e347526-5ade-4396-80f8-73af0a2bab85] Updating instance_info_cache with network_info: [{"id": "665af93f-50b1-4e75-b074-78feda4b8f89", "address": "fa:16:3e:38:e7:d0", "network": {"id": "030e67c6-1489-4a16-b93e-b8731813e15d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2017692564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adc380bcc607465a99822932ffc27549", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap665af93f-50", "ovs_interfaceid": "665af93f-50b1-4e75-b074-78feda4b8f89", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:52:43 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-5315a6fd-ad79-46a3-a8c9-a61216746335 req-51360e02-3d79-40d6-98d0-032c48566cbb service nova] Releasing lock "refresh_cache-9e347526-5ade-4396-80f8-73af0a2bab85" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 19:52:44 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:52:44 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:52:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e9256b30-43df-4476-b6b1-3eb55ea7e973 tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Acquiring lock "9e347526-5ade-4396-80f8-73af0a2bab85" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:52:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e9256b30-43df-4476-b6b1-3eb55ea7e973 tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Lock "9e347526-5ade-4396-80f8-73af0a2bab85" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:52:45 user nova-compute[75216]: DEBUG nova.objects.instance [None req-e9256b30-43df-4476-b6b1-3eb55ea7e973 tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Lazy-loading 'flavor' on Instance uuid 9e347526-5ade-4396-80f8-73af0a2bab85 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:52:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e9256b30-43df-4476-b6b1-3eb55ea7e973 tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Lock "9e347526-5ade-4396-80f8-73af0a2bab85" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:52:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e9256b30-43df-4476-b6b1-3eb55ea7e973 tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Acquiring lock "9e347526-5ade-4396-80f8-73af0a2bab85" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:52:45 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e9256b30-43df-4476-b6b1-3eb55ea7e973 tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Lock "9e347526-5ade-4396-80f8-73af0a2bab85" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:52:45 user nova-compute[75216]: INFO nova.compute.manager [None req-e9256b30-43df-4476-b6b1-3eb55ea7e973 tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] [instance: 9e347526-5ade-4396-80f8-73af0a2bab85] Attaching volume 3554abff-5d06-4e43-969f-1f6c8a4737a6 to /dev/vdb
Nov 13 19:52:45 user nova-compute[75216]: DEBUG os_brick.utils [None req-e9256b30-43df-4476-b6b1-3eb55ea7e973 tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 19:52:45 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:52:45 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:52:45 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fa9da47-3f2d-43fa-8d5e-ccdd0a10959a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aea6fcfe14b9\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:52:45 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:52:45 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:52:45 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8e4fba7-1f98-457a-9a80-cf1bd51b71e6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:52:45 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:52:45 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:52:45 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a67a89d-7152-45d7-a2d8-015c170e991a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:52:45 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[2039151e-a4ba-46d8-a388-23912b1ac4bc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:52:45 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-e9256b30-43df-4476-b6b1-3eb55ea7e973 tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Running cmd (subprocess): nvme version {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:52:45 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-e9256b30-43df-4476-b6b1-3eb55ea7e973 tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] 'nvme version' failed. Not Retrying. {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 19:52:45 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e9256b30-43df-4476-b6b1-3eb55ea7e973 tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] nvme not present on system {{(pid=75216) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 19:52:45 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:52:45 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 19:52:45 user nova-compute[75216]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 19:52:45 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[965d8ffe-e91c-4850-9443-8e1a3fd4ef87]: (4, '') {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:52:45 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-e9256b30-43df-4476-b6b1-3eb55ea7e973 tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75216) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 19:52:45 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-e9256b30-43df-4476-b6b1-3eb55ea7e973 tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 19:52:45 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-e9256b30-43df-4476-b6b1-3eb55ea7e973 tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] LIGHTOS: no hostnqn found. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 19:52:45 user nova-compute[75216]: DEBUG os_brick.utils [None req-e9256b30-43df-4476-b6b1-3eb55ea7e973 tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] <== get_connector_properties: return (177ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aea6fcfe14b9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 19:52:45 user nova-compute[75216]: DEBUG nova.virt.block_device [None req-e9256b30-43df-4476-b6b1-3eb55ea7e973 tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] [instance: 9e347526-5ade-4396-80f8-73af0a2bab85] Updating existing volume attachment record: 47b67b74-8a05-44d6-82ae-99ce18126b1e {{(pid=75216) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 19:52:46 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:52:46 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:52:46 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75216) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 19:52:47 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:52:47 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Starting heal instance info cache {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 19:52:47 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Rebuilding the list of instances to heal {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 13 19:52:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "refresh_cache-9e347526-5ade-4396-80f8-73af0a2bab85" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 19:52:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquired lock "refresh_cache-9e347526-5ade-4396-80f8-73af0a2bab85" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 19:52:47 user nova-compute[75216]: DEBUG nova.network.neutron [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: 9e347526-5ade-4396-80f8-73af0a2bab85] Forcefully refreshing network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 19:52:47 user nova-compute[75216]: DEBUG nova.objects.instance [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lazy-loading 'info_cache' on Instance uuid 9e347526-5ade-4396-80f8-73af0a2bab85 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:52:47 user nova-compute[75216]: DEBUG nova.network.neutron [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: 9e347526-5ade-4396-80f8-73af0a2bab85] Updating instance_info_cache with network_info: [{"id": "665af93f-50b1-4e75-b074-78feda4b8f89", "address": "fa:16:3e:38:e7:d0", "network": {"id": "030e67c6-1489-4a16-b93e-b8731813e15d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2017692564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adc380bcc607465a99822932ffc27549", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap665af93f-50", "ovs_interfaceid": "665af93f-50b1-4e75-b074-78feda4b8f89", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:52:47 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Releasing lock "refresh_cache-9e347526-5ade-4396-80f8-73af0a2bab85" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 19:52:47 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: 9e347526-5ade-4396-80f8-73af0a2bab85] Updated the network info_cache for instance {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 19:52:47 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:52:47 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:52:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:52:49 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e9256b30-43df-4476-b6b1-3eb55ea7e973 tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] [instance: 9e347526-5ade-4396-80f8-73af0a2bab85] Calling os-brick to attach iSCSI Volume {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 19:52:49 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9256b30-43df-4476-b6b1-3eb55ea7e973 tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3a8669e40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3554abff-5d06-4e43-969f-1f6c8a4737a6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MgBAjTeE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 19:52:49 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-e9256b30-43df-4476-b6b1-3eb55ea7e973 tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 19:52:49 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-e9256b30-43df-4476-b6b1-3eb55ea7e973 tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 19:52:49 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-e9256b30-43df-4476-b6b1-3eb55ea7e973 tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 19:52:49 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-e9256b30-43df-4476-b6b1-3eb55ea7e973 tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 19:52:49 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-e9256b30-43df-4476-b6b1-3eb55ea7e973 tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3554abff-5d06-4e43-969f-1f6c8a4737a6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 19:52:49 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-e9256b30-43df-4476-b6b1-3eb55ea7e973 tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3554abff-5d06-4e43-969f-1f6c8a4737a6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 19:52:49 user nova-compute[75216]: INFO os_brick.initiator.connectors.iscsi [None req-e9256b30-43df-4476-b6b1-3eb55ea7e973 tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 19:52:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3554abff-5d06-4e43-969f-1f6c8a4737a6 -p 172.16.0.220:3260 {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:52:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3554abff-5d06-4e43-969f-1f6c8a4737a6 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:52:49 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8358436-9cfb-4a22-b710-bbf62939eb62]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:52:49 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9256b30-43df-4476-b6b1-3eb55ea7e973 tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 19:52:49 user nova-compute[75216]:  {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:52:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3554abff-5d06-4e43-969f-1f6c8a4737a6 -p 172.16.0.220:3260 --interface default --op new {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:52:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3554abff-5d06-4e43-969f-1f6c8a4737a6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:52:49 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c1c13af-b5a8-4a0c-8e73-8bec32fbcb92]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3554abff-5d06-4e43-969f-1f6c8a4737a6] added\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:52:49 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9256b30-43df-4476-b6b1-3eb55ea7e973 tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3554abff-5d06-4e43-969f-1f6c8a4737a6] added
Nov 13 19:52:49 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:52:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3554abff-5d06-4e43-969f-1f6c8a4737a6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:52:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3554abff-5d06-4e43-969f-1f6c8a4737a6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:52:49 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[f518c792-dbe6-46a1-be0c-e6670c98f990]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:52:49 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9256b30-43df-4476-b6b1-3eb55ea7e973 tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:52:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3554abff-5d06-4e43-969f-1f6c8a4737a6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:52:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3554abff-5d06-4e43-969f-1f6c8a4737a6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:52:49 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7bc4bfc-3a63-43a2-86ad-b903f974d868]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:52:49 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9256b30-43df-4476-b6b1-3eb55ea7e973 tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:52:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3554abff-5d06-4e43-969f-1f6c8a4737a6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MgBAjTeE {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:52:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3554abff-5d06-4e43-969f-1f6c8a4737a6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MgBAjTeE" returned: 0 in 0.022s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:52:49 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d717566-4fc9-46a5-a0a1-7c9a82eddaed]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:52:49 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9256b30-43df-4476-b6b1-3eb55ea7e973 tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MgBAjTeE'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:52:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3554abff-5d06-4e43-969f-1f6c8a4737a6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:52:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3554abff-5d06-4e43-969f-1f6c8a4737a6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:52:49 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d9b035c-3cfb-4e5d-9ff4-c5ef51ef2d90]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:52:49 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9256b30-43df-4476-b6b1-3eb55ea7e973 tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:52:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:52:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:52:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:52:49 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee941c5c-fcd3-4f77-ac7d-209a0182e22b]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:52:49 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9256b30-43df-4476-b6b1-3eb55ea7e973 tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 13 19:52:49 user nova-compute[75216]:  {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 19:52:49 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9256b30-43df-4476-b6b1-3eb55ea7e973 tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 13 19:52:49 user nova-compute[75216]:  {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 19:52:49 user nova-compute[75216]: WARNING os_brick.initiator.connectors.iscsi [None req-e9256b30-43df-4476-b6b1-3eb55ea7e973 tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 13 19:52:49 user nova-compute[75216]: 
Nov 13 19:52:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3554abff-5d06-4e43-969f-1f6c8a4737a6 -p 172.16.0.220:3260 --login {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:52:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3554abff-5d06-4e43-969f-1f6c8a4737a6 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:52:49 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[11521eae-ec82-476f-825f-650bf84c270c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3554abff-5d06-4e43-969f-1f6c8a4737a6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3554abff-5d06-4e43-969f-1f6c8a4737a6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:52:49 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9256b30-43df-4476-b6b1-3eb55ea7e973 tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3554abff-5d06-4e43-969f-1f6c8a4737a6, portal: 172.16.0.220,3260]
Nov 13 19:52:49 user nova-compute[75216]: Login to [iface: default, target: iqn.2010-10.org.openstack:3554abff-5d06-4e43-969f-1f6c8a4737a6, portal: 172.16.0.220,3260] successful.
Nov 13 19:52:49 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:52:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3554abff-5d06-4e43-969f-1f6c8a4737a6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:52:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3554abff-5d06-4e43-969f-1f6c8a4737a6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:52:49 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[425a29d5-f8ce-4ed4-a3c0-4b06bc579259]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:52:49 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9256b30-43df-4476-b6b1-3eb55ea7e973 tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:52:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:52:49 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:52:49 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[688ab2dc-2881-4357-ba77-446776cf3d48]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3554abff-5d06-4e43-969f-1f6c8a4737a6 (non-flash)\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:52:49 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9256b30-43df-4476-b6b1-3eb55ea7e973 tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3554abff-5d06-4e43-969f-1f6c8a4737a6 (non-flash)
Nov 13 19:52:49 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 19:52:49 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9256b30-43df-4476-b6b1-3eb55ea7e973 tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3554abff-5d06-4e43-969f-1f6c8a4737a6 (non-flash)
Nov 13 19:52:49 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 19:52:49 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-e9256b30-43df-4476-b6b1-3eb55ea7e973 tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3554abff-5d06-4e43-969f-1f6c8a4737a6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.254s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 19:52:49 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9256b30-43df-4476-b6b1-3eb55ea7e973 tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Connected to 172.16.0.220:3260 {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 19:52:49 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-e9256b30-43df-4476-b6b1-3eb55ea7e973 tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] HCTL ('33', '-', '-', 0) found on session 67 with lun 0 {{(pid=75216) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 19:52:49 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-e9256b30-43df-4476-b6b1-3eb55ea7e973 tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75216) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 19:52:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:52:50 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:52:50 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[093a9759-4ffe-4cb7-94c6-d6bd09fb32cc]: (4, ('- - 0', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:52:50 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-e9256b30-43df-4476-b6b1-3eb55ea7e973 tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Searching for a device in session 67 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75216) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 19:52:50 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9256b30-43df-4476-b6b1-3eb55ea7e973 tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:3554abff-5d06-4e43-969f-1f6c8a4737a6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MgBAjTeE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 19:52:51 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-e9256b30-43df-4476-b6b1-3eb55ea7e973 tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.285s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 19:52:51 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9256b30-43df-4476-b6b1-3eb55ea7e973 tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] <== connect_volume: return (1287ms) {'type': 'block', 'scsi_wwn': '23339303738653634', 'path': '/dev/sdb'} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 19:52:51 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e9256b30-43df-4476-b6b1-3eb55ea7e973 tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] [instance: 9e347526-5ade-4396-80f8-73af0a2bab85] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23339303738653634', 'path': '/dev/sdb'} {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 19:52:51 user nova-compute[75216]: DEBUG nova.objects.instance [None req-e9256b30-43df-4476-b6b1-3eb55ea7e973 tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Lazy-loading 'flavor' on Instance uuid 9e347526-5ade-4396-80f8-73af0a2bab85 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:52:51 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-e9256b30-43df-4476-b6b1-3eb55ea7e973 tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] attach device xml: <disk type="block" device="disk">
Nov 13 19:52:51 user nova-compute[75216]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 19:52:51 user nova-compute[75216]:   <source dev="/dev/sdb"/>
Nov 13 19:52:51 user nova-compute[75216]:   <target dev="vdb" bus="virtio"/>
Nov 13 19:52:51 user nova-compute[75216]:   <serial>3554abff-5d06-4e43-969f-1f6c8a4737a6</serial>
Nov 13 19:52:51 user nova-compute[75216]: </disk>
Nov 13 19:52:51 user nova-compute[75216]:  {{(pid=75216) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 13 19:52:51 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-e9256b30-43df-4476-b6b1-3eb55ea7e973 tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 19:52:51 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-e9256b30-43df-4476-b6b1-3eb55ea7e973 tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 19:52:51 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-e9256b30-43df-4476-b6b1-3eb55ea7e973 tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] No VIF found with MAC fa:16:3e:38:e7:d0, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 19:52:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-e9256b30-43df-4476-b6b1-3eb55ea7e973 tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Lock "9e347526-5ade-4396-80f8-73af0a2bab85" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.038s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:52:52 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:52:52 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:52:52 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:52:52 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:52:52 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Auditing locally available compute resources for user (node: user) {{(pid=75216) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 19:52:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e347526-5ade-4396-80f8-73af0a2bab85/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:52:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e347526-5ade-4396-80f8-73af0a2bab85/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:52:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e347526-5ade-4396-80f8-73af0a2bab85/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:52:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e347526-5ade-4396-80f8-73af0a2bab85/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:52:52 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 19:52:53 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 19:52:53 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 19:52:53 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Hypervisor/Node resource view: name=user free_ram=8944MB free_disk=25.190292358398438GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75216) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 19:52:53 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:52:53 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:52:53 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance 9e347526-5ade-4396-80f8-73af0a2bab85 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 19:52:53 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 19:52:53 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 19:52:53 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 19:52:53 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 19:52:53 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Compute_service record updated for user:user {{(pid=75216) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 19:52:53 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.173s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:52:54 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:52:54 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:52:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-5bde2da2-44cf-4979-9c62-7c765560fb9c tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Acquiring lock "9e347526-5ade-4396-80f8-73af0a2bab85" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:52:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-5bde2da2-44cf-4979-9c62-7c765560fb9c tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Lock "9e347526-5ade-4396-80f8-73af0a2bab85" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:52:58 user nova-compute[75216]: INFO nova.compute.manager [None req-5bde2da2-44cf-4979-9c62-7c765560fb9c tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] [instance: 9e347526-5ade-4396-80f8-73af0a2bab85] Detaching volume 3554abff-5d06-4e43-969f-1f6c8a4737a6
Nov 13 19:52:59 user nova-compute[75216]: INFO nova.virt.block_device [None req-5bde2da2-44cf-4979-9c62-7c765560fb9c tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] [instance: 9e347526-5ade-4396-80f8-73af0a2bab85] Attempting to driver detach volume 3554abff-5d06-4e43-969f-1f6c8a4737a6 from mountpoint /dev/vdb
Nov 13 19:52:59 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-5bde2da2-44cf-4979-9c62-7c765560fb9c tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Attempting to detach device vdb from instance 9e347526-5ade-4396-80f8-73af0a2bab85 from the persistent domain config. {{(pid=75216) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 13 19:52:59 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-5bde2da2-44cf-4979-9c62-7c765560fb9c tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 19:52:59 user nova-compute[75216]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 19:52:59 user nova-compute[75216]:   <source dev="/dev/sdb"/>
Nov 13 19:52:59 user nova-compute[75216]:   <target dev="vdb" bus="virtio"/>
Nov 13 19:52:59 user nova-compute[75216]:   <serial>3554abff-5d06-4e43-969f-1f6c8a4737a6</serial>
Nov 13 19:52:59 user nova-compute[75216]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 19:52:59 user nova-compute[75216]: </disk>
Nov 13 19:52:59 user nova-compute[75216]:  {{(pid=75216) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 19:52:59 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-5bde2da2-44cf-4979-9c62-7c765560fb9c tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Successfully detached device vdb from instance 9e347526-5ade-4396-80f8-73af0a2bab85 from the persistent domain config.
Nov 13 19:52:59 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-5bde2da2-44cf-4979-9c62-7c765560fb9c tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9e347526-5ade-4396-80f8-73af0a2bab85 from the live domain config. {{(pid=75216) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 13 19:52:59 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-5bde2da2-44cf-4979-9c62-7c765560fb9c tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 19:52:59 user nova-compute[75216]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 19:52:59 user nova-compute[75216]:   <source dev="/dev/sdb"/>
Nov 13 19:52:59 user nova-compute[75216]:   <target dev="vdb" bus="virtio"/>
Nov 13 19:52:59 user nova-compute[75216]:   <serial>3554abff-5d06-4e43-969f-1f6c8a4737a6</serial>
Nov 13 19:52:59 user nova-compute[75216]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 19:52:59 user nova-compute[75216]: </disk>
Nov 13 19:52:59 user nova-compute[75216]:  {{(pid=75216) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 19:52:59 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:52:59 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:52:59 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-5bde2da2-44cf-4979-9c62-7c765560fb9c tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9e347526-5ade-4396-80f8-73af0a2bab85 {{(pid=75216) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 13 19:52:59 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:53:04 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:53:09 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:53:14 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:53:14 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:53:14 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75216) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 19:53:14 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 19:53:14 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 19:53:14 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:53:14 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:53:19 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:53:19 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-5bde2da2-44cf-4979-9c62-7c765560fb9c tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 9e347526-5ade-4396-80f8-73af0a2bab85 is timed out.
Nov 13 19:53:19 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-5bde2da2-44cf-4979-9c62-7c765560fb9c tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Successfully detached device vdb from instance 9e347526-5ade-4396-80f8-73af0a2bab85 from the live domain config.
Nov 13 19:53:19 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5bde2da2-44cf-4979-9c62-7c765560fb9c tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] [instance: 9e347526-5ade-4396-80f8-73af0a2bab85] calling os-brick to detach iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 19:53:19 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bde2da2-44cf-4979-9c62-7c765560fb9c tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3a8669e40>, {'target_iqn': 'iqn.2010-10.org.openstack:3554abff-5d06-4e43-969f-1f6c8a4737a6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MgBAjTeE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 19:53:19 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-5bde2da2-44cf-4979-9c62-7c765560fb9c tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 19:53:19 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-5bde2da2-44cf-4979-9c62-7c765560fb9c tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 19:53:19 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-5bde2da2-44cf-4979-9c62-7c765560fb9c tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 19:53:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:53:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:53:19 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f73713d-92d0-4f62-a7fc-22966d9eaea4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3554abff-5d06-4e43-969f-1f6c8a4737a6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:53:19 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bde2da2-44cf-4979-9c62-7c765560fb9c tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 19:53:19 user nova-compute[75216]: No targets found.
Nov 13 19:53:19 user nova-compute[75216]: iSNS:
Nov 13 19:53:19 user nova-compute[75216]: No targets found.
Nov 13 19:53:19 user nova-compute[75216]: STATIC:
Nov 13 19:53:19 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:3554abff-5d06-4e43-969f-1f6c8a4737a6
Nov 13 19:53:19 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 19:53:19 user nova-compute[75216]:                 Iface Name: default
Nov 13 19:53:19 user nova-compute[75216]: FIRMWARE:
Nov 13 19:53:19 user nova-compute[75216]: No targets found.
Nov 13 19:53:19 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 19:53:19 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bde2da2-44cf-4979-9c62-7c765560fb9c tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 19:53:19 user nova-compute[75216]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 19:53:19 user nova-compute[75216]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75216) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 19:53:19 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bde2da2-44cf-4979-9c62-7c765560fb9c tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3554abff-5d06-4e43-969f-1f6c8a4737a6', 0)] {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 19:53:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:53:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:53:19 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[22ff495d-746e-473b-b156-f9d2811ef2e4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3554abff-5d06-4e43-969f-1f6c8a4737a6\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:53:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:53:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:53:19 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[818a86c4-4a25-4ed4-a3e2-0f110470eb17]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3554abff-5d06-4e43-969f-1f6c8a4737a6 (non-flash)\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:53:19 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bde2da2-44cf-4979-9c62-7c765560fb9c tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3554abff-5d06-4e43-969f-1f6c8a4737a6 (non-flash)
Nov 13 19:53:19 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 19:53:19 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bde2da2-44cf-4979-9c62-7c765560fb9c tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3554abff-5d06-4e43-969f-1f6c8a4737a6 (non-flash)
Nov 13 19:53:19 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 19:53:19 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bde2da2-44cf-4979-9c62-7c765560fb9c tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe3a82ca830>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3554abff-5d06-4e43-969f-1f6c8a4737a6'): ({'sdb'}, set())}) {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 19:53:19 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-5bde2da2-44cf-4979-9c62-7c765560fb9c tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Removing single pathed devices sdb {{(pid=75216) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 19:53:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:53:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:53:19 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dc19203-fae6-4414-b501-567ddac13f90]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:53:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:53:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:53:19 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[a14e7302-5fa5-4b8a-a1ce-e1ea78113dce]: (4, ('ok\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:53:19 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-5bde2da2-44cf-4979-9c62-7c765560fb9c tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Flushing IO for device /dev/sdb {{(pid=75216) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 19:53:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:53:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:53:19 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9e936d3-5ed0-4e78-bb87-8173797a35ea]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:53:19 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-5bde2da2-44cf-4979-9c62-7c765560fb9c tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75216) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 19:53:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:53:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.037s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:53:19 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[031bfc36-d5b1-45e2-8a27-83f096099102]: (4, ('1', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:53:19 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-5bde2da2-44cf-4979-9c62-7c765560fb9c tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 19:53:19 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-5bde2da2-44cf-4979-9c62-7c765560fb9c tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] SCSI volumes sdb have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 19:53:19 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bde2da2-44cf-4979-9c62-7c765560fb9c tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3554abff-5d06-4e43-969f-1f6c8a4737a6')] {{(pid=75216) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 19:53:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3554abff-5d06-4e43-969f-1f6c8a4737a6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:53:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3554abff-5d06-4e43-969f-1f6c8a4737a6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:53:19 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[aba555a5-6f80-4328-a8d6-bb4598c4ddf7]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:53:19 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bde2da2-44cf-4979-9c62-7c765560fb9c tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:53:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3554abff-5d06-4e43-969f-1f6c8a4737a6 -p 172.16.0.220:3260 --logout {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:53:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3554abff-5d06-4e43-969f-1f6c8a4737a6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:53:19 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e2fc81d-df0c-4658-81e0-58e7cd245181]: (4, ('Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:3554abff-5d06-4e43-969f-1f6c8a4737a6, portal: 172.16.0.220,3260]\nLogout of [sid: 67, target: iqn.2010-10.org.openstack:3554abff-5d06-4e43-969f-1f6c8a4737a6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:53:19 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bde2da2-44cf-4979-9c62-7c765560fb9c tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:3554abff-5d06-4e43-969f-1f6c8a4737a6, portal: 172.16.0.220,3260]
Nov 13 19:53:19 user nova-compute[75216]: Logout of [sid: 67, target: iqn.2010-10.org.openstack:3554abff-5d06-4e43-969f-1f6c8a4737a6, portal: 172.16.0.220,3260] successful.
Nov 13 19:53:19 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:53:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3554abff-5d06-4e43-969f-1f6c8a4737a6 -p 172.16.0.220:3260 --op delete {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:53:19 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3554abff-5d06-4e43-969f-1f6c8a4737a6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:53:19 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[f59d9c9d-3a5b-47e0-9477-519ca02fdf56]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:53:19 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bde2da2-44cf-4979-9c62-7c765560fb9c tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:53:19 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-5bde2da2-44cf-4979-9c62-7c765560fb9c tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.296s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 19:53:19 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bde2da2-44cf-4979-9c62-7c765560fb9c tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] <== disconnect_volume: return (297ms) None {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 19:53:19 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5bde2da2-44cf-4979-9c62-7c765560fb9c tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] [instance: 9e347526-5ade-4396-80f8-73af0a2bab85] Disconnected iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 19:53:20 user nova-compute[75216]: DEBUG nova.objects.instance [None req-5bde2da2-44cf-4979-9c62-7c765560fb9c tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Lazy-loading 'flavor' on Instance uuid 9e347526-5ade-4396-80f8-73af0a2bab85 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:53:20 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-5bde2da2-44cf-4979-9c62-7c765560fb9c tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Lock "9e347526-5ade-4396-80f8-73af0a2bab85" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.818s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:53:24 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:53:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:53:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:53:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75216) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 19:53:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 19:53:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 19:53:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:53:31 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:53:34 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:53:39 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:53:39 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:53:39 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75216) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 19:53:39 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 19:53:39 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 19:53:39 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:53:39 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:53:44 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:53:47 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:53:47 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:53:47 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:53:47 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75216) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 19:53:48 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:53:48 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Starting heal instance info cache {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 19:53:48 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Rebuilding the list of instances to heal {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 13 19:53:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "refresh_cache-9e347526-5ade-4396-80f8-73af0a2bab85" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 19:53:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquired lock "refresh_cache-9e347526-5ade-4396-80f8-73af0a2bab85" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 19:53:48 user nova-compute[75216]: DEBUG nova.network.neutron [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: 9e347526-5ade-4396-80f8-73af0a2bab85] Forcefully refreshing network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 19:53:48 user nova-compute[75216]: DEBUG nova.objects.instance [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lazy-loading 'info_cache' on Instance uuid 9e347526-5ade-4396-80f8-73af0a2bab85 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:53:48 user nova-compute[75216]: DEBUG nova.network.neutron [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: 9e347526-5ade-4396-80f8-73af0a2bab85] Updating instance_info_cache with network_info: [{"id": "665af93f-50b1-4e75-b074-78feda4b8f89", "address": "fa:16:3e:38:e7:d0", "network": {"id": "030e67c6-1489-4a16-b93e-b8731813e15d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2017692564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adc380bcc607465a99822932ffc27549", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap665af93f-50", "ovs_interfaceid": "665af93f-50b1-4e75-b074-78feda4b8f89", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:53:48 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Releasing lock "refresh_cache-9e347526-5ade-4396-80f8-73af0a2bab85" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 19:53:48 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: 9e347526-5ade-4396-80f8-73af0a2bab85] Updated the network info_cache for instance {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 19:53:48 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:53:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:53:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-29b642ba-a674-4401-a494-d3246f0c79a2 tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Acquiring lock "9e347526-5ade-4396-80f8-73af0a2bab85" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:53:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-29b642ba-a674-4401-a494-d3246f0c79a2 tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Lock "9e347526-5ade-4396-80f8-73af0a2bab85" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:53:51 user nova-compute[75216]: DEBUG nova.objects.instance [None req-29b642ba-a674-4401-a494-d3246f0c79a2 tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Lazy-loading 'flavor' on Instance uuid 9e347526-5ade-4396-80f8-73af0a2bab85 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:53:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-29b642ba-a674-4401-a494-d3246f0c79a2 tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Lock "9e347526-5ade-4396-80f8-73af0a2bab85" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:53:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-29b642ba-a674-4401-a494-d3246f0c79a2 tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Acquiring lock "9e347526-5ade-4396-80f8-73af0a2bab85" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:53:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-29b642ba-a674-4401-a494-d3246f0c79a2 tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Lock "9e347526-5ade-4396-80f8-73af0a2bab85" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:53:51 user nova-compute[75216]: INFO nova.compute.manager [None req-29b642ba-a674-4401-a494-d3246f0c79a2 tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] [instance: 9e347526-5ade-4396-80f8-73af0a2bab85] Attaching volume b9ee67d0-0cfc-426a-a0e6-13ccb9bbe8d8 to /dev/vdb
Nov 13 19:53:51 user nova-compute[75216]: DEBUG os_brick.utils [None req-29b642ba-a674-4401-a494-d3246f0c79a2 tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 19:53:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:53:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:53:51 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfccfcc5-7237-4a0c-bf0a-f70f21e513f8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aea6fcfe14b9\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:53:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:53:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:53:51 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[0447fc5f-7c24-4a70-9fd6-946d4bf33265]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:53:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:53:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:53:51 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bea424a-b3a9-4d09-8dc0-d0b5e01b7cdd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:53:51 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b8d30a4-0683-4e2d-bda8-fd22651320e7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:53:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-29b642ba-a674-4401-a494-d3246f0c79a2 tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Running cmd (subprocess): nvme version {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:53:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-29b642ba-a674-4401-a494-d3246f0c79a2 tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] 'nvme version' failed. Not Retrying. {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 19:53:51 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.nvmeof [None req-29b642ba-a674-4401-a494-d3246f0c79a2 tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] nvme not present on system {{(pid=75216) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 19:53:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:53:51 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 19:53:51 user nova-compute[75216]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 19:53:51 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[e75b2d15-abe1-423f-a23f-3cca9fa979d8]: (4, '') {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:53:51 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-29b642ba-a674-4401-a494-d3246f0c79a2 tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75216) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 19:53:51 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-29b642ba-a674-4401-a494-d3246f0c79a2 tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 19:53:51 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-29b642ba-a674-4401-a494-d3246f0c79a2 tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] LIGHTOS: no hostnqn found. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 19:53:51 user nova-compute[75216]: DEBUG os_brick.utils [None req-29b642ba-a674-4401-a494-d3246f0c79a2 tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aea6fcfe14b9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 19:53:51 user nova-compute[75216]: DEBUG nova.virt.block_device [None req-29b642ba-a674-4401-a494-d3246f0c79a2 tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] [instance: 9e347526-5ade-4396-80f8-73af0a2bab85] Updating existing volume attachment record: f5fdb697-9d52-4411-b7dd-83f1119c7d69 {{(pid=75216) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 19:53:54 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:53:54 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:53:54 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:53:54 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:53:54 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:53:54 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Auditing locally available compute resources for user (node: user) {{(pid=75216) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 19:53:54 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e347526-5ade-4396-80f8-73af0a2bab85/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:53:54 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e347526-5ade-4396-80f8-73af0a2bab85/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:53:54 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e347526-5ade-4396-80f8-73af0a2bab85/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:53:54 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e347526-5ade-4396-80f8-73af0a2bab85/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:53:54 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:53:55 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 19:53:55 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 19:53:55 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Hypervisor/Node resource view: name=user free_ram=8960MB free_disk=25.189239501953125GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75216) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 19:53:55 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:53:55 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:53:55 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29b642ba-a674-4401-a494-d3246f0c79a2 tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] [instance: 9e347526-5ade-4396-80f8-73af0a2bab85] Calling os-brick to attach iSCSI Volume {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 19:53:55 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-29b642ba-a674-4401-a494-d3246f0c79a2 tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3a8669e40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b9ee67d0-0cfc-426a-a0e6-13ccb9bbe8d8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ITCKfyzE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 19:53:55 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-29b642ba-a674-4401-a494-d3246f0c79a2 tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 19:53:55 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-29b642ba-a674-4401-a494-d3246f0c79a2 tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 19:53:55 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-29b642ba-a674-4401-a494-d3246f0c79a2 tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 19:53:55 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-29b642ba-a674-4401-a494-d3246f0c79a2 tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 19:53:55 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-29b642ba-a674-4401-a494-d3246f0c79a2 tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b9ee67d0-0cfc-426a-a0e6-13ccb9bbe8d8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 19:53:55 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-29b642ba-a674-4401-a494-d3246f0c79a2 tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b9ee67d0-0cfc-426a-a0e6-13ccb9bbe8d8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 19:53:55 user nova-compute[75216]: INFO os_brick.initiator.connectors.iscsi [None req-29b642ba-a674-4401-a494-d3246f0c79a2 tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 19:53:55 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9ee67d0-0cfc-426a-a0e6-13ccb9bbe8d8 -p 172.16.0.220:3260 {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:53:55 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9ee67d0-0cfc-426a-a0e6-13ccb9bbe8d8 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:53:55 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d3ed13b-4598-4315-839f-d2c5ca55469f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:53:55 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-29b642ba-a674-4401-a494-d3246f0c79a2 tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 19:53:55 user nova-compute[75216]:  {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:53:55 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9ee67d0-0cfc-426a-a0e6-13ccb9bbe8d8 -p 172.16.0.220:3260 --interface default --op new {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:53:55 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9ee67d0-0cfc-426a-a0e6-13ccb9bbe8d8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:53:55 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac689819-3322-4ff3-b54f-72afd33f70d6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b9ee67d0-0cfc-426a-a0e6-13ccb9bbe8d8] added\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:53:55 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-29b642ba-a674-4401-a494-d3246f0c79a2 tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b9ee67d0-0cfc-426a-a0e6-13ccb9bbe8d8] added
Nov 13 19:53:55 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:53:55 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9ee67d0-0cfc-426a-a0e6-13ccb9bbe8d8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:53:55 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance 9e347526-5ade-4396-80f8-73af0a2bab85 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 19:53:55 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 19:53:55 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 19:53:55 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9ee67d0-0cfc-426a-a0e6-13ccb9bbe8d8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:53:55 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[145bac17-78d8-4a96-b106-818bb6b04544]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:53:55 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-29b642ba-a674-4401-a494-d3246f0c79a2 tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:53:55 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9ee67d0-0cfc-426a-a0e6-13ccb9bbe8d8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:53:55 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9ee67d0-0cfc-426a-a0e6-13ccb9bbe8d8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:53:55 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[94175f74-cc66-47be-8e9c-76ddc69826ec]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:53:55 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-29b642ba-a674-4401-a494-d3246f0c79a2 tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:53:55 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9ee67d0-0cfc-426a-a0e6-13ccb9bbe8d8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ITCKfyzE {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:53:55 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9ee67d0-0cfc-426a-a0e6-13ccb9bbe8d8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ITCKfyzE" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:53:55 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f392609-31dc-4aff-8a1f-1e353250f267]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:53:55 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-29b642ba-a674-4401-a494-d3246f0c79a2 tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ITCKfyzE'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:53:55 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9ee67d0-0cfc-426a-a0e6-13ccb9bbe8d8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:53:55 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9ee67d0-0cfc-426a-a0e6-13ccb9bbe8d8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:53:55 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[adb352da-1218-41e6-87f3-8e4127ae6ad2]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:53:55 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-29b642ba-a674-4401-a494-d3246f0c79a2 tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:53:55 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:53:55 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:53:55 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d46f9c9-2187-4a74-a1a8-070e12c310f8]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:53:55 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-29b642ba-a674-4401-a494-d3246f0c79a2 tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 13 19:53:55 user nova-compute[75216]:  {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 19:53:55 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-29b642ba-a674-4401-a494-d3246f0c79a2 tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 13 19:53:55 user nova-compute[75216]:  {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 19:53:55 user nova-compute[75216]: WARNING os_brick.initiator.connectors.iscsi [None req-29b642ba-a674-4401-a494-d3246f0c79a2 tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 13 19:53:55 user nova-compute[75216]: 
Nov 13 19:53:55 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9ee67d0-0cfc-426a-a0e6-13ccb9bbe8d8 -p 172.16.0.220:3260 --login {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:53:55 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 19:53:55 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 19:53:55 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Compute_service record updated for user:user {{(pid=75216) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 19:53:55 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.350s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:53:55 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9ee67d0-0cfc-426a-a0e6-13ccb9bbe8d8 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:53:55 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[04401334-732c-4f31-b563-c77bf1d21cf2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b9ee67d0-0cfc-426a-a0e6-13ccb9bbe8d8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b9ee67d0-0cfc-426a-a0e6-13ccb9bbe8d8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:53:55 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-29b642ba-a674-4401-a494-d3246f0c79a2 tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b9ee67d0-0cfc-426a-a0e6-13ccb9bbe8d8, portal: 172.16.0.220,3260]
Nov 13 19:53:55 user nova-compute[75216]: Login to [iface: default, target: iqn.2010-10.org.openstack:b9ee67d0-0cfc-426a-a0e6-13ccb9bbe8d8, portal: 172.16.0.220,3260] successful.
Nov 13 19:53:55 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:53:55 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9ee67d0-0cfc-426a-a0e6-13ccb9bbe8d8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:53:55 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9ee67d0-0cfc-426a-a0e6-13ccb9bbe8d8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:53:55 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5603854-c74a-4696-ade9-ffaa2f9119f0]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:53:55 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-29b642ba-a674-4401-a494-d3246f0c79a2 tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:53:55 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:53:55 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:53:55 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cb05b78-1d55-41cc-bd3e-3f0cbc9b5ab3]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9ee67d0-0cfc-426a-a0e6-13ccb9bbe8d8 (non-flash)\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:53:55 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-29b642ba-a674-4401-a494-d3246f0c79a2 tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9ee67d0-0cfc-426a-a0e6-13ccb9bbe8d8 (non-flash)
Nov 13 19:53:55 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 19:53:55 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-29b642ba-a674-4401-a494-d3246f0c79a2 tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9ee67d0-0cfc-426a-a0e6-13ccb9bbe8d8 (non-flash)
Nov 13 19:53:55 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 19:53:55 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-29b642ba-a674-4401-a494-d3246f0c79a2 tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b9ee67d0-0cfc-426a-a0e6-13ccb9bbe8d8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.249s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 19:53:55 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-29b642ba-a674-4401-a494-d3246f0c79a2 tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Connected to 172.16.0.220:3260 {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 19:53:55 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-29b642ba-a674-4401-a494-d3246f0c79a2 tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] HCTL ('33', '-', '-', 0) found on session 68 with lun 0 {{(pid=75216) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 19:53:55 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-29b642ba-a674-4401-a494-d3246f0c79a2 tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75216) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 19:53:55 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:53:55 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:53:55 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2b616a3-8689-4103-9a33-be41eda4f926]: (4, ('- - 0', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:53:55 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-29b642ba-a674-4401-a494-d3246f0c79a2 tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Searching for a device in session 68 and hctl ['33', '*', '*', 0] yield: None {{(pid=75216) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 19:53:56 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-29b642ba-a674-4401-a494-d3246f0c79a2 tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Searching for a device in session 68 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75216) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 19:53:56 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-29b642ba-a674-4401-a494-d3246f0c79a2 tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:b9ee67d0-0cfc-426a-a0e6-13ccb9bbe8d8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ITCKfyzE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 19:53:56 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-29b642ba-a674-4401-a494-d3246f0c79a2 tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.278s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 19:53:56 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-29b642ba-a674-4401-a494-d3246f0c79a2 tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] <== connect_volume: return (1279ms) {'type': 'block', 'scsi_wwn': '23265366537626139', 'path': '/dev/sdb'} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 19:53:56 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29b642ba-a674-4401-a494-d3246f0c79a2 tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] [instance: 9e347526-5ade-4396-80f8-73af0a2bab85] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23265366537626139', 'path': '/dev/sdb'} {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 19:53:56 user nova-compute[75216]: DEBUG nova.objects.instance [None req-29b642ba-a674-4401-a494-d3246f0c79a2 tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Lazy-loading 'flavor' on Instance uuid 9e347526-5ade-4396-80f8-73af0a2bab85 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:53:56 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-29b642ba-a674-4401-a494-d3246f0c79a2 tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] attach device xml: <disk type="block" device="disk">
Nov 13 19:53:56 user nova-compute[75216]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 19:53:56 user nova-compute[75216]:   <source dev="/dev/sdb"/>
Nov 13 19:53:56 user nova-compute[75216]:   <target dev="vdb" bus="virtio"/>
Nov 13 19:53:56 user nova-compute[75216]:   <serial>b9ee67d0-0cfc-426a-a0e6-13ccb9bbe8d8</serial>
Nov 13 19:53:56 user nova-compute[75216]: </disk>
Nov 13 19:53:56 user nova-compute[75216]:  {{(pid=75216) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 13 19:53:57 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-29b642ba-a674-4401-a494-d3246f0c79a2 tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 19:53:57 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-29b642ba-a674-4401-a494-d3246f0c79a2 tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 19:53:57 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-29b642ba-a674-4401-a494-d3246f0c79a2 tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] No VIF found with MAC fa:16:3e:38:e7:d0, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 19:53:57 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-29b642ba-a674-4401-a494-d3246f0c79a2 tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Lock "9e347526-5ade-4396-80f8-73af0a2bab85" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 5.909s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:53:59 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:53:59 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-625fb21c-99bf-4cb3-b9e1-0d798a46ed7a tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Acquiring lock "9e347526-5ade-4396-80f8-73af0a2bab85" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:53:59 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-625fb21c-99bf-4cb3-b9e1-0d798a46ed7a tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Lock "9e347526-5ade-4396-80f8-73af0a2bab85" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:53:59 user nova-compute[75216]: INFO nova.compute.manager [None req-625fb21c-99bf-4cb3-b9e1-0d798a46ed7a tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] [instance: 9e347526-5ade-4396-80f8-73af0a2bab85] Detaching volume b9ee67d0-0cfc-426a-a0e6-13ccb9bbe8d8
Nov 13 19:53:59 user nova-compute[75216]: INFO nova.virt.block_device [None req-625fb21c-99bf-4cb3-b9e1-0d798a46ed7a tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] [instance: 9e347526-5ade-4396-80f8-73af0a2bab85] Attempting to driver detach volume b9ee67d0-0cfc-426a-a0e6-13ccb9bbe8d8 from mountpoint /dev/vdb
Nov 13 19:53:59 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-625fb21c-99bf-4cb3-b9e1-0d798a46ed7a tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Attempting to detach device vdb from instance 9e347526-5ade-4396-80f8-73af0a2bab85 from the persistent domain config. {{(pid=75216) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 13 19:53:59 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-625fb21c-99bf-4cb3-b9e1-0d798a46ed7a tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 19:53:59 user nova-compute[75216]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 19:53:59 user nova-compute[75216]:   <source dev="/dev/sdb"/>
Nov 13 19:53:59 user nova-compute[75216]:   <target dev="vdb" bus="virtio"/>
Nov 13 19:53:59 user nova-compute[75216]:   <serial>b9ee67d0-0cfc-426a-a0e6-13ccb9bbe8d8</serial>
Nov 13 19:53:59 user nova-compute[75216]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 19:53:59 user nova-compute[75216]: </disk>
Nov 13 19:53:59 user nova-compute[75216]:  {{(pid=75216) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 19:53:59 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-625fb21c-99bf-4cb3-b9e1-0d798a46ed7a tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Successfully detached device vdb from instance 9e347526-5ade-4396-80f8-73af0a2bab85 from the persistent domain config.
Nov 13 19:53:59 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-625fb21c-99bf-4cb3-b9e1-0d798a46ed7a tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9e347526-5ade-4396-80f8-73af0a2bab85 from the live domain config. {{(pid=75216) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 13 19:53:59 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-625fb21c-99bf-4cb3-b9e1-0d798a46ed7a tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 19:53:59 user nova-compute[75216]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 19:53:59 user nova-compute[75216]:   <source dev="/dev/sdb"/>
Nov 13 19:53:59 user nova-compute[75216]:   <target dev="vdb" bus="virtio"/>
Nov 13 19:53:59 user nova-compute[75216]:   <serial>b9ee67d0-0cfc-426a-a0e6-13ccb9bbe8d8</serial>
Nov 13 19:53:59 user nova-compute[75216]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 19:53:59 user nova-compute[75216]: </disk>
Nov 13 19:53:59 user nova-compute[75216]:  {{(pid=75216) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 19:53:59 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:54:00 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-625fb21c-99bf-4cb3-b9e1-0d798a46ed7a tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9e347526-5ade-4396-80f8-73af0a2bab85 {{(pid=75216) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 13 19:54:01 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:54:04 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:54:09 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:54:14 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:54:16 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:54:19 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:54:20 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-625fb21c-99bf-4cb3-b9e1-0d798a46ed7a tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 9e347526-5ade-4396-80f8-73af0a2bab85 is timed out.
Nov 13 19:54:20 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-625fb21c-99bf-4cb3-b9e1-0d798a46ed7a tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Successfully detached device vdb from instance 9e347526-5ade-4396-80f8-73af0a2bab85 from the live domain config.
Nov 13 19:54:20 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-625fb21c-99bf-4cb3-b9e1-0d798a46ed7a tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] [instance: 9e347526-5ade-4396-80f8-73af0a2bab85] calling os-brick to detach iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 19:54:20 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-625fb21c-99bf-4cb3-b9e1-0d798a46ed7a tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3a8669e40>, {'target_iqn': 'iqn.2010-10.org.openstack:b9ee67d0-0cfc-426a-a0e6-13ccb9bbe8d8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ITCKfyzE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 19:54:20 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-625fb21c-99bf-4cb3-b9e1-0d798a46ed7a tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 19:54:20 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-625fb21c-99bf-4cb3-b9e1-0d798a46ed7a tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 19:54:20 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-625fb21c-99bf-4cb3-b9e1-0d798a46ed7a tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 19:54:20 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:54:20 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:54:20 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf5e23c5-07c7-4dc4-8c86-326067f5be6c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b9ee67d0-0cfc-426a-a0e6-13ccb9bbe8d8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:54:20 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-625fb21c-99bf-4cb3-b9e1-0d798a46ed7a tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 19:54:20 user nova-compute[75216]: No targets found.
Nov 13 19:54:20 user nova-compute[75216]: iSNS:
Nov 13 19:54:20 user nova-compute[75216]: No targets found.
Nov 13 19:54:20 user nova-compute[75216]: STATIC:
Nov 13 19:54:20 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:b9ee67d0-0cfc-426a-a0e6-13ccb9bbe8d8
Nov 13 19:54:20 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 19:54:20 user nova-compute[75216]:                 Iface Name: default
Nov 13 19:54:20 user nova-compute[75216]: FIRMWARE:
Nov 13 19:54:20 user nova-compute[75216]: No targets found.
Nov 13 19:54:20 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 19:54:20 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-625fb21c-99bf-4cb3-b9e1-0d798a46ed7a tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 19:54:20 user nova-compute[75216]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 19:54:20 user nova-compute[75216]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75216) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 19:54:20 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-625fb21c-99bf-4cb3-b9e1-0d798a46ed7a tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b9ee67d0-0cfc-426a-a0e6-13ccb9bbe8d8', 0)] {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 19:54:20 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:54:20 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:54:20 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[419d0c92-ebee-4190-8cf6-f83bc91cbae8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b9ee67d0-0cfc-426a-a0e6-13ccb9bbe8d8\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:54:20 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:54:20 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:54:20 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec39ccc2-a781-4b48-a71b-cf4ca0666dac]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9ee67d0-0cfc-426a-a0e6-13ccb9bbe8d8 (non-flash)\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:54:20 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-625fb21c-99bf-4cb3-b9e1-0d798a46ed7a tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9ee67d0-0cfc-426a-a0e6-13ccb9bbe8d8 (non-flash)
Nov 13 19:54:20 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 19:54:20 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-625fb21c-99bf-4cb3-b9e1-0d798a46ed7a tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9ee67d0-0cfc-426a-a0e6-13ccb9bbe8d8 (non-flash)
Nov 13 19:54:20 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 19:54:20 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-625fb21c-99bf-4cb3-b9e1-0d798a46ed7a tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe3a867b370>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b9ee67d0-0cfc-426a-a0e6-13ccb9bbe8d8'): ({'sdb'}, set())}) {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 19:54:20 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-625fb21c-99bf-4cb3-b9e1-0d798a46ed7a tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Removing single pathed devices sdb {{(pid=75216) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 19:54:20 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:54:20 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:54:20 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[b19aa62d-d5be-454f-b43e-70345bc22d76]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:54:20 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:54:20 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.041s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:54:20 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[abe085f3-cc4a-423d-b88b-2df5345e430c]: (4, ('ok\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:54:20 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-625fb21c-99bf-4cb3-b9e1-0d798a46ed7a tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Flushing IO for device /dev/sdb {{(pid=75216) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 19:54:20 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:54:20 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:54:20 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[c899529e-5d7b-45db-b116-147064f68def]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:54:20 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-625fb21c-99bf-4cb3-b9e1-0d798a46ed7a tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75216) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 19:54:20 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:54:20 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:54:20 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dc8e432-73a6-47a0-aeea-521d980bd1b5]: (4, ('1', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:54:20 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-625fb21c-99bf-4cb3-b9e1-0d798a46ed7a tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 19:54:20 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-625fb21c-99bf-4cb3-b9e1-0d798a46ed7a tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] SCSI volumes sdb have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 19:54:20 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-625fb21c-99bf-4cb3-b9e1-0d798a46ed7a tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b9ee67d0-0cfc-426a-a0e6-13ccb9bbe8d8')] {{(pid=75216) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 19:54:20 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9ee67d0-0cfc-426a-a0e6-13ccb9bbe8d8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:54:20 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9ee67d0-0cfc-426a-a0e6-13ccb9bbe8d8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:54:20 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[80ce0902-ef10-49ac-9f71-0c9906d1524b]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:54:20 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-625fb21c-99bf-4cb3-b9e1-0d798a46ed7a tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:54:20 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9ee67d0-0cfc-426a-a0e6-13ccb9bbe8d8 -p 172.16.0.220:3260 --logout {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:54:20 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9ee67d0-0cfc-426a-a0e6-13ccb9bbe8d8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:54:20 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[dca7bfa7-6ccb-4056-aeea-708e973f9897]: (4, ('Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:b9ee67d0-0cfc-426a-a0e6-13ccb9bbe8d8, portal: 172.16.0.220,3260]\nLogout of [sid: 68, target: iqn.2010-10.org.openstack:b9ee67d0-0cfc-426a-a0e6-13ccb9bbe8d8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:54:20 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-625fb21c-99bf-4cb3-b9e1-0d798a46ed7a tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:b9ee67d0-0cfc-426a-a0e6-13ccb9bbe8d8, portal: 172.16.0.220,3260]
Nov 13 19:54:20 user nova-compute[75216]: Logout of [sid: 68, target: iqn.2010-10.org.openstack:b9ee67d0-0cfc-426a-a0e6-13ccb9bbe8d8, portal: 172.16.0.220,3260] successful.
Nov 13 19:54:20 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:54:20 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9ee67d0-0cfc-426a-a0e6-13ccb9bbe8d8 -p 172.16.0.220:3260 --op delete {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:54:20 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9ee67d0-0cfc-426a-a0e6-13ccb9bbe8d8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:54:20 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[f79f8300-34cd-41d9-9614-a01226d08784]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:54:20 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-625fb21c-99bf-4cb3-b9e1-0d798a46ed7a tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:54:20 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-625fb21c-99bf-4cb3-b9e1-0d798a46ed7a tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.328s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 19:54:20 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-625fb21c-99bf-4cb3-b9e1-0d798a46ed7a tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] <== disconnect_volume: return (329ms) None {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 19:54:20 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-625fb21c-99bf-4cb3-b9e1-0d798a46ed7a tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] [instance: 9e347526-5ade-4396-80f8-73af0a2bab85] Disconnected iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 19:54:21 user nova-compute[75216]: DEBUG nova.objects.instance [None req-625fb21c-99bf-4cb3-b9e1-0d798a46ed7a tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Lazy-loading 'flavor' on Instance uuid 9e347526-5ade-4396-80f8-73af0a2bab85 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:54:21 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-625fb21c-99bf-4cb3-b9e1-0d798a46ed7a tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Lock "9e347526-5ade-4396-80f8-73af0a2bab85" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.687s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:54:24 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:54:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:54:33 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:54:34 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:54:39 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:54:41 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:54:44 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:54:47 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:54:48 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:54:49 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:54:49 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Starting heal instance info cache {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 19:54:49 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Rebuilding the list of instances to heal {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 13 19:54:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:54:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "refresh_cache-9e347526-5ade-4396-80f8-73af0a2bab85" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 19:54:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquired lock "refresh_cache-9e347526-5ade-4396-80f8-73af0a2bab85" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 19:54:49 user nova-compute[75216]: DEBUG nova.network.neutron [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: 9e347526-5ade-4396-80f8-73af0a2bab85] Forcefully refreshing network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 19:54:49 user nova-compute[75216]: DEBUG nova.objects.instance [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lazy-loading 'info_cache' on Instance uuid 9e347526-5ade-4396-80f8-73af0a2bab85 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:54:49 user nova-compute[75216]: DEBUG nova.network.neutron [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: 9e347526-5ade-4396-80f8-73af0a2bab85] Updating instance_info_cache with network_info: [{"id": "665af93f-50b1-4e75-b074-78feda4b8f89", "address": "fa:16:3e:38:e7:d0", "network": {"id": "030e67c6-1489-4a16-b93e-b8731813e15d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2017692564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adc380bcc607465a99822932ffc27549", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap665af93f-50", "ovs_interfaceid": "665af93f-50b1-4e75-b074-78feda4b8f89", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:54:49 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Releasing lock "refresh_cache-9e347526-5ade-4396-80f8-73af0a2bab85" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 19:54:49 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: 9e347526-5ade-4396-80f8-73af0a2bab85] Updated the network info_cache for instance {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 19:54:49 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:54:49 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75216) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 19:54:50 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:54:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-3a86b5f6-8307-4387-873c-89ab24d7500b tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Acquiring lock "9e347526-5ade-4396-80f8-73af0a2bab85" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:54:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-3a86b5f6-8307-4387-873c-89ab24d7500b tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Lock "9e347526-5ade-4396-80f8-73af0a2bab85" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:54:51 user nova-compute[75216]: DEBUG nova.objects.instance [None req-3a86b5f6-8307-4387-873c-89ab24d7500b tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Lazy-loading 'flavor' on Instance uuid 9e347526-5ade-4396-80f8-73af0a2bab85 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:54:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-3a86b5f6-8307-4387-873c-89ab24d7500b tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Lock "9e347526-5ade-4396-80f8-73af0a2bab85" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:54:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-3a86b5f6-8307-4387-873c-89ab24d7500b tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Acquiring lock "9e347526-5ade-4396-80f8-73af0a2bab85" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:54:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-3a86b5f6-8307-4387-873c-89ab24d7500b tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Lock "9e347526-5ade-4396-80f8-73af0a2bab85" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:54:51 user nova-compute[75216]: INFO nova.compute.manager [None req-3a86b5f6-8307-4387-873c-89ab24d7500b tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] [instance: 9e347526-5ade-4396-80f8-73af0a2bab85] Attaching volume 376dff80-673f-4b3b-8ed7-3fda2f80e550 to /dev/vdb
Nov 13 19:54:52 user nova-compute[75216]: DEBUG os_brick.utils [None req-3a86b5f6-8307-4387-873c-89ab24d7500b tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 19:54:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:54:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:54:52 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7ebced6-390a-479d-803e-b51c826536f6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aea6fcfe14b9\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:54:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:54:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:54:52 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[0883afa8-3444-46bc-b4fd-19bc1714d2ec]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:54:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:54:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.026s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:54:52 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[99f04119-ef3a-4077-9bdd-9b5c313de2a4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:54:52 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1945dee-1a6c-40d5-9652-00d67772e5b1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:54:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-3a86b5f6-8307-4387-873c-89ab24d7500b tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Running cmd (subprocess): nvme version {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:54:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-3a86b5f6-8307-4387-873c-89ab24d7500b tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] 'nvme version' failed. Not Retrying. {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 19:54:52 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3a86b5f6-8307-4387-873c-89ab24d7500b tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] nvme not present on system {{(pid=75216) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 19:54:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:54:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 19:54:52 user nova-compute[75216]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 19:54:52 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b2a3bdf-7ca9-44ef-a9ab-647e810c6d65]: (4, '') {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:54:52 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-3a86b5f6-8307-4387-873c-89ab24d7500b tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75216) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 19:54:52 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-3a86b5f6-8307-4387-873c-89ab24d7500b tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 19:54:52 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-3a86b5f6-8307-4387-873c-89ab24d7500b tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] LIGHTOS: no hostnqn found. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 19:54:52 user nova-compute[75216]: DEBUG os_brick.utils [None req-3a86b5f6-8307-4387-873c-89ab24d7500b tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aea6fcfe14b9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 19:54:52 user nova-compute[75216]: DEBUG nova.virt.block_device [None req-3a86b5f6-8307-4387-873c-89ab24d7500b tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] [instance: 9e347526-5ade-4396-80f8-73af0a2bab85] Updating existing volume attachment record: 7458bc2f-aebc-482a-bdf4-d10811efa8d3 {{(pid=75216) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 19:54:54 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:54:54 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:54:56 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3a86b5f6-8307-4387-873c-89ab24d7500b tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] [instance: 9e347526-5ade-4396-80f8-73af0a2bab85] Calling os-brick to attach iSCSI Volume {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 19:54:56 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a86b5f6-8307-4387-873c-89ab24d7500b tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3a8669e40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:376dff80-673f-4b3b-8ed7-3fda2f80e550', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MkuvepZl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 19:54:56 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-3a86b5f6-8307-4387-873c-89ab24d7500b tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 19:54:56 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-3a86b5f6-8307-4387-873c-89ab24d7500b tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 19:54:56 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-3a86b5f6-8307-4387-873c-89ab24d7500b tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 19:54:56 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-3a86b5f6-8307-4387-873c-89ab24d7500b tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 19:54:56 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-3a86b5f6-8307-4387-873c-89ab24d7500b tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:376dff80-673f-4b3b-8ed7-3fda2f80e550" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 19:54:56 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-3a86b5f6-8307-4387-873c-89ab24d7500b tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:376dff80-673f-4b3b-8ed7-3fda2f80e550" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 19:54:56 user nova-compute[75216]: INFO os_brick.initiator.connectors.iscsi [None req-3a86b5f6-8307-4387-873c-89ab24d7500b tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 19:54:56 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:376dff80-673f-4b3b-8ed7-3fda2f80e550 -p 172.16.0.220:3260 {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:54:56 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:376dff80-673f-4b3b-8ed7-3fda2f80e550 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:54:56 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[f44b9f52-a537-44b6-87bf-da0f37f1fa77]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:54:56 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a86b5f6-8307-4387-873c-89ab24d7500b tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 19:54:56 user nova-compute[75216]:  {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:54:56 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:376dff80-673f-4b3b-8ed7-3fda2f80e550 -p 172.16.0.220:3260 --interface default --op new {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:54:56 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:376dff80-673f-4b3b-8ed7-3fda2f80e550 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:54:56 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[61f8919f-5425-464c-be1c-62181eaf8e4d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:376dff80-673f-4b3b-8ed7-3fda2f80e550] added\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:54:56 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a86b5f6-8307-4387-873c-89ab24d7500b tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:376dff80-673f-4b3b-8ed7-3fda2f80e550] added
Nov 13 19:54:56 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:54:56 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:376dff80-673f-4b3b-8ed7-3fda2f80e550 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:54:56 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:376dff80-673f-4b3b-8ed7-3fda2f80e550 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:54:56 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[56617311-3274-4e7e-b6dd-55387f249a40]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:54:56 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a86b5f6-8307-4387-873c-89ab24d7500b tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:54:56 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:376dff80-673f-4b3b-8ed7-3fda2f80e550 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:54:56 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:376dff80-673f-4b3b-8ed7-3fda2f80e550 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:54:56 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[a672966a-8c1c-47e2-b42a-9016a6d74299]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:54:56 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a86b5f6-8307-4387-873c-89ab24d7500b tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:54:56 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:376dff80-673f-4b3b-8ed7-3fda2f80e550 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MkuvepZl {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:54:56 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:376dff80-673f-4b3b-8ed7-3fda2f80e550 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MkuvepZl" returned: 0 in 0.017s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:54:56 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a4014ec-69c8-48d0-aff8-66cb9302d419]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:54:56 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a86b5f6-8307-4387-873c-89ab24d7500b tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MkuvepZl'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:54:56 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:376dff80-673f-4b3b-8ed7-3fda2f80e550 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:54:56 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:376dff80-673f-4b3b-8ed7-3fda2f80e550 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:54:56 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d77bb7a-e1f9-40ab-8232-491bfd2be938]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:54:56 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a86b5f6-8307-4387-873c-89ab24d7500b tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:54:56 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:54:56 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:54:56 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[f37acf2f-58db-4dbd-b398-c0e5b5ad41c2]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:54:56 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a86b5f6-8307-4387-873c-89ab24d7500b tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 13 19:54:56 user nova-compute[75216]:  {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 19:54:56 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a86b5f6-8307-4387-873c-89ab24d7500b tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 13 19:54:56 user nova-compute[75216]:  {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 19:54:56 user nova-compute[75216]: WARNING os_brick.initiator.connectors.iscsi [None req-3a86b5f6-8307-4387-873c-89ab24d7500b tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 13 19:54:56 user nova-compute[75216]: 
Nov 13 19:54:56 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:376dff80-673f-4b3b-8ed7-3fda2f80e550 -p 172.16.0.220:3260 --login {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:54:56 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:376dff80-673f-4b3b-8ed7-3fda2f80e550 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:54:56 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a3727e7-2d67-41bf-bfd3-5f937331428f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:376dff80-673f-4b3b-8ed7-3fda2f80e550, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:376dff80-673f-4b3b-8ed7-3fda2f80e550, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:54:56 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a86b5f6-8307-4387-873c-89ab24d7500b tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:376dff80-673f-4b3b-8ed7-3fda2f80e550, portal: 172.16.0.220,3260]
Nov 13 19:54:56 user nova-compute[75216]: Login to [iface: default, target: iqn.2010-10.org.openstack:376dff80-673f-4b3b-8ed7-3fda2f80e550, portal: 172.16.0.220,3260] successful.
Nov 13 19:54:56 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:54:56 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:376dff80-673f-4b3b-8ed7-3fda2f80e550 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:54:56 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:376dff80-673f-4b3b-8ed7-3fda2f80e550 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:54:56 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[895e5062-372e-4d62-a3f5-5249e58508aa]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:54:56 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a86b5f6-8307-4387-873c-89ab24d7500b tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:54:56 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:54:56 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:54:56 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[94815f42-9271-4e00-a0de-60ce41913433]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:376dff80-673f-4b3b-8ed7-3fda2f80e550 (non-flash)\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:54:56 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a86b5f6-8307-4387-873c-89ab24d7500b tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:376dff80-673f-4b3b-8ed7-3fda2f80e550 (non-flash)
Nov 13 19:54:56 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 19:54:56 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a86b5f6-8307-4387-873c-89ab24d7500b tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:376dff80-673f-4b3b-8ed7-3fda2f80e550 (non-flash)
Nov 13 19:54:56 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 19:54:56 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-3a86b5f6-8307-4387-873c-89ab24d7500b tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:376dff80-673f-4b3b-8ed7-3fda2f80e550" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.246s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 19:54:56 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a86b5f6-8307-4387-873c-89ab24d7500b tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Connected to 172.16.0.220:3260 {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 19:54:56 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-3a86b5f6-8307-4387-873c-89ab24d7500b tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] HCTL ('33', '-', '-', 0) found on session 69 with lun 0 {{(pid=75216) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 19:54:56 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-3a86b5f6-8307-4387-873c-89ab24d7500b tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75216) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 19:54:56 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:54:56 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:54:56 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5b79c01-1017-467c-aceb-a9bb45791602]: (4, ('- - 0', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:54:56 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-3a86b5f6-8307-4387-873c-89ab24d7500b tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Searching for a device in session 69 and hctl ['33', '*', '*', 0] yield: None {{(pid=75216) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 19:54:56 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:54:56 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:54:56 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:54:56 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:54:56 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Auditing locally available compute resources for user (node: user) {{(pid=75216) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 19:54:56 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e347526-5ade-4396-80f8-73af0a2bab85/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:54:56 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e347526-5ade-4396-80f8-73af0a2bab85/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:54:56 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e347526-5ade-4396-80f8-73af0a2bab85/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:54:56 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e347526-5ade-4396-80f8-73af0a2bab85/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:54:57 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 19:54:57 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 19:54:57 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Hypervisor/Node resource view: name=user free_ram=8946MB free_disk=25.188182830810547GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75216) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 19:54:57 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:54:57 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:54:57 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance 9e347526-5ade-4396-80f8-73af0a2bab85 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 19:54:57 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 19:54:57 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 19:54:57 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-3a86b5f6-8307-4387-873c-89ab24d7500b tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Searching for a device in session 69 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75216) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 19:54:57 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a86b5f6-8307-4387-873c-89ab24d7500b tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:376dff80-673f-4b3b-8ed7-3fda2f80e550', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MkuvepZl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 19:54:57 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-3a86b5f6-8307-4387-873c-89ab24d7500b tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.275s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 19:54:57 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a86b5f6-8307-4387-873c-89ab24d7500b tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] <== connect_volume: return (1276ms) {'type': 'block', 'scsi_wwn': '23535366165636330', 'path': '/dev/sdb'} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 19:54:57 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3a86b5f6-8307-4387-873c-89ab24d7500b tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] [instance: 9e347526-5ade-4396-80f8-73af0a2bab85] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23535366165636330', 'path': '/dev/sdb'} {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 19:54:57 user nova-compute[75216]: DEBUG nova.objects.instance [None req-3a86b5f6-8307-4387-873c-89ab24d7500b tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Lazy-loading 'flavor' on Instance uuid 9e347526-5ade-4396-80f8-73af0a2bab85 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:54:57 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-3a86b5f6-8307-4387-873c-89ab24d7500b tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] attach device xml: <disk type="block" device="disk">
Nov 13 19:54:57 user nova-compute[75216]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 19:54:57 user nova-compute[75216]:   <source dev="/dev/sdb"/>
Nov 13 19:54:57 user nova-compute[75216]:   <target dev="vdb" bus="virtio"/>
Nov 13 19:54:57 user nova-compute[75216]:   <serial>376dff80-673f-4b3b-8ed7-3fda2f80e550</serial>
Nov 13 19:54:57 user nova-compute[75216]: </disk>
Nov 13 19:54:57 user nova-compute[75216]:  {{(pid=75216) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 13 19:54:57 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 19:54:57 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 19:54:57 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Compute_service record updated for user:user {{(pid=75216) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 19:54:57 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.171s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:54:57 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-3a86b5f6-8307-4387-873c-89ab24d7500b tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 19:54:57 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-3a86b5f6-8307-4387-873c-89ab24d7500b tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 19:54:57 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-3a86b5f6-8307-4387-873c-89ab24d7500b tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] No VIF found with MAC fa:16:3e:38:e7:d0, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 19:54:57 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-3a86b5f6-8307-4387-873c-89ab24d7500b tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Lock "9e347526-5ade-4396-80f8-73af0a2bab85" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 5.938s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:54:59 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:54:59 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:55:00 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-5b8dba0d-79a8-419f-8e10-c20ffbd3d9bc tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Acquiring lock "9e347526-5ade-4396-80f8-73af0a2bab85" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:55:00 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-5b8dba0d-79a8-419f-8e10-c20ffbd3d9bc tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Lock "9e347526-5ade-4396-80f8-73af0a2bab85" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:55:00 user nova-compute[75216]: INFO nova.compute.manager [None req-5b8dba0d-79a8-419f-8e10-c20ffbd3d9bc tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] [instance: 9e347526-5ade-4396-80f8-73af0a2bab85] Detaching volume 376dff80-673f-4b3b-8ed7-3fda2f80e550
Nov 13 19:55:00 user nova-compute[75216]: INFO nova.virt.block_device [None req-5b8dba0d-79a8-419f-8e10-c20ffbd3d9bc tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] [instance: 9e347526-5ade-4396-80f8-73af0a2bab85] Attempting to driver detach volume 376dff80-673f-4b3b-8ed7-3fda2f80e550 from mountpoint /dev/vdb
Nov 13 19:55:00 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-5b8dba0d-79a8-419f-8e10-c20ffbd3d9bc tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Attempting to detach device vdb from instance 9e347526-5ade-4396-80f8-73af0a2bab85 from the persistent domain config. {{(pid=75216) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 13 19:55:00 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-5b8dba0d-79a8-419f-8e10-c20ffbd3d9bc tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 19:55:00 user nova-compute[75216]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 19:55:00 user nova-compute[75216]:   <source dev="/dev/sdb"/>
Nov 13 19:55:00 user nova-compute[75216]:   <target dev="vdb" bus="virtio"/>
Nov 13 19:55:00 user nova-compute[75216]:   <serial>376dff80-673f-4b3b-8ed7-3fda2f80e550</serial>
Nov 13 19:55:00 user nova-compute[75216]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 19:55:00 user nova-compute[75216]: </disk>
Nov 13 19:55:00 user nova-compute[75216]:  {{(pid=75216) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 19:55:00 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-5b8dba0d-79a8-419f-8e10-c20ffbd3d9bc tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Successfully detached device vdb from instance 9e347526-5ade-4396-80f8-73af0a2bab85 from the persistent domain config.
Nov 13 19:55:00 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-5b8dba0d-79a8-419f-8e10-c20ffbd3d9bc tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9e347526-5ade-4396-80f8-73af0a2bab85 from the live domain config. {{(pid=75216) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 13 19:55:00 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-5b8dba0d-79a8-419f-8e10-c20ffbd3d9bc tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 19:55:00 user nova-compute[75216]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 19:55:00 user nova-compute[75216]:   <source dev="/dev/sdb"/>
Nov 13 19:55:00 user nova-compute[75216]:   <target dev="vdb" bus="virtio"/>
Nov 13 19:55:00 user nova-compute[75216]:   <serial>376dff80-673f-4b3b-8ed7-3fda2f80e550</serial>
Nov 13 19:55:00 user nova-compute[75216]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 19:55:00 user nova-compute[75216]: </disk>
Nov 13 19:55:00 user nova-compute[75216]:  {{(pid=75216) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 19:55:00 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-5b8dba0d-79a8-419f-8e10-c20ffbd3d9bc tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9e347526-5ade-4396-80f8-73af0a2bab85 {{(pid=75216) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 13 19:55:01 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:55:04 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:55:04 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:55:09 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:55:14 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:55:19 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:55:20 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-5b8dba0d-79a8-419f-8e10-c20ffbd3d9bc tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 9e347526-5ade-4396-80f8-73af0a2bab85 is timed out.
Nov 13 19:55:20 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-5b8dba0d-79a8-419f-8e10-c20ffbd3d9bc tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Successfully detached device vdb from instance 9e347526-5ade-4396-80f8-73af0a2bab85 from the live domain config.
Nov 13 19:55:20 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b8dba0d-79a8-419f-8e10-c20ffbd3d9bc tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] [instance: 9e347526-5ade-4396-80f8-73af0a2bab85] calling os-brick to detach iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 19:55:20 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b8dba0d-79a8-419f-8e10-c20ffbd3d9bc tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3a8669e40>, {'target_iqn': 'iqn.2010-10.org.openstack:376dff80-673f-4b3b-8ed7-3fda2f80e550', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MkuvepZl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 19:55:20 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-5b8dba0d-79a8-419f-8e10-c20ffbd3d9bc tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 19:55:20 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-5b8dba0d-79a8-419f-8e10-c20ffbd3d9bc tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 19:55:20 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-5b8dba0d-79a8-419f-8e10-c20ffbd3d9bc tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 19:55:20 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:55:20 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:55:20 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[baa715c5-49f2-44b2-9468-6b969be07039]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:376dff80-673f-4b3b-8ed7-3fda2f80e550\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:55:20 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b8dba0d-79a8-419f-8e10-c20ffbd3d9bc tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 19:55:20 user nova-compute[75216]: No targets found.
Nov 13 19:55:20 user nova-compute[75216]: iSNS:
Nov 13 19:55:20 user nova-compute[75216]: No targets found.
Nov 13 19:55:20 user nova-compute[75216]: STATIC:
Nov 13 19:55:20 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:376dff80-673f-4b3b-8ed7-3fda2f80e550
Nov 13 19:55:20 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 19:55:20 user nova-compute[75216]:                 Iface Name: default
Nov 13 19:55:20 user nova-compute[75216]: FIRMWARE:
Nov 13 19:55:20 user nova-compute[75216]: No targets found.
Nov 13 19:55:20 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 19:55:20 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b8dba0d-79a8-419f-8e10-c20ffbd3d9bc tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 19:55:20 user nova-compute[75216]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 19:55:20 user nova-compute[75216]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75216) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 19:55:20 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b8dba0d-79a8-419f-8e10-c20ffbd3d9bc tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:376dff80-673f-4b3b-8ed7-3fda2f80e550', 0)] {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 19:55:20 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:55:20 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:55:20 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4e0839f-d9cd-4714-8402-a40db21dbf58]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:376dff80-673f-4b3b-8ed7-3fda2f80e550\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:55:20 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:55:20 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:55:20 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c6e8944-75db-41bc-98ae-e0bca1d5626d]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:376dff80-673f-4b3b-8ed7-3fda2f80e550 (non-flash)\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:55:20 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b8dba0d-79a8-419f-8e10-c20ffbd3d9bc tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:376dff80-673f-4b3b-8ed7-3fda2f80e550 (non-flash)
Nov 13 19:55:20 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 19:55:20 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b8dba0d-79a8-419f-8e10-c20ffbd3d9bc tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:376dff80-673f-4b3b-8ed7-3fda2f80e550 (non-flash)
Nov 13 19:55:20 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 19:55:20 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b8dba0d-79a8-419f-8e10-c20ffbd3d9bc tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe384698c10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:376dff80-673f-4b3b-8ed7-3fda2f80e550'): ({'sdb'}, set())}) {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 19:55:20 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-5b8dba0d-79a8-419f-8e10-c20ffbd3d9bc tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Removing single pathed devices sdb {{(pid=75216) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 19:55:20 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:55:20 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:55:20 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ca23443-cdbc-4168-883c-a4807cd55acd]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:55:20 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:55:20 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:55:20 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[9396e882-933d-41dd-ba40-f10333e8f00f]: (4, ('ok\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:55:20 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-5b8dba0d-79a8-419f-8e10-c20ffbd3d9bc tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Flushing IO for device /dev/sdb {{(pid=75216) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 19:55:20 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:55:20 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:55:20 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[80c1a926-19ec-4490-83e6-8e46cd95f9c5]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:55:20 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-5b8dba0d-79a8-419f-8e10-c20ffbd3d9bc tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75216) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 19:55:20 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:55:20 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.052s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:55:20 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[66a7603b-b5de-44d8-b041-d150b9aedb02]: (4, ('1', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:55:20 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-5b8dba0d-79a8-419f-8e10-c20ffbd3d9bc tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 19:55:20 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-5b8dba0d-79a8-419f-8e10-c20ffbd3d9bc tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] SCSI volumes sdb have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 19:55:20 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b8dba0d-79a8-419f-8e10-c20ffbd3d9bc tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:376dff80-673f-4b3b-8ed7-3fda2f80e550')] {{(pid=75216) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 19:55:20 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:376dff80-673f-4b3b-8ed7-3fda2f80e550 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:55:20 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:376dff80-673f-4b3b-8ed7-3fda2f80e550 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:55:20 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd10a627-08f6-4f6d-9f43-f659a4e3f6bc]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:55:20 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b8dba0d-79a8-419f-8e10-c20ffbd3d9bc tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:55:20 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:376dff80-673f-4b3b-8ed7-3fda2f80e550 -p 172.16.0.220:3260 --logout {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:55:20 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:376dff80-673f-4b3b-8ed7-3fda2f80e550 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:55:20 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[1148d6c7-bca8-4ad9-b860-b83d883cef3d]: (4, ('Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:376dff80-673f-4b3b-8ed7-3fda2f80e550, portal: 172.16.0.220,3260]\nLogout of [sid: 69, target: iqn.2010-10.org.openstack:376dff80-673f-4b3b-8ed7-3fda2f80e550, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:55:20 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b8dba0d-79a8-419f-8e10-c20ffbd3d9bc tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:376dff80-673f-4b3b-8ed7-3fda2f80e550, portal: 172.16.0.220,3260]
Nov 13 19:55:20 user nova-compute[75216]: Logout of [sid: 69, target: iqn.2010-10.org.openstack:376dff80-673f-4b3b-8ed7-3fda2f80e550, portal: 172.16.0.220,3260] successful.
Nov 13 19:55:20 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:55:20 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:376dff80-673f-4b3b-8ed7-3fda2f80e550 -p 172.16.0.220:3260 --op delete {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:55:20 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:376dff80-673f-4b3b-8ed7-3fda2f80e550 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:55:20 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cd8d11c-a787-4b4c-a1ec-7b18e7eda89a]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:55:20 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b8dba0d-79a8-419f-8e10-c20ffbd3d9bc tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:55:20 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-5b8dba0d-79a8-419f-8e10-c20ffbd3d9bc tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 19:55:20 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b8dba0d-79a8-419f-8e10-c20ffbd3d9bc tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] <== disconnect_volume: return (306ms) None {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 19:55:20 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b8dba0d-79a8-419f-8e10-c20ffbd3d9bc tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] [instance: 9e347526-5ade-4396-80f8-73af0a2bab85] Disconnected iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 19:55:21 user nova-compute[75216]: DEBUG nova.objects.instance [None req-5b8dba0d-79a8-419f-8e10-c20ffbd3d9bc tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Lazy-loading 'flavor' on Instance uuid 9e347526-5ade-4396-80f8-73af0a2bab85 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:55:21 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-5b8dba0d-79a8-419f-8e10-c20ffbd3d9bc tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Lock "9e347526-5ade-4396-80f8-73af0a2bab85" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.601s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:55:24 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:55:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:55:33 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:55:34 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:55:39 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:55:41 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:55:44 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:55:48 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:55:49 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:55:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:55:50 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:55:50 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75216) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 19:55:51 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:55:51 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Starting heal instance info cache {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 19:55:51 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Rebuilding the list of instances to heal {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 13 19:55:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "refresh_cache-9e347526-5ade-4396-80f8-73af0a2bab85" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 19:55:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquired lock "refresh_cache-9e347526-5ade-4396-80f8-73af0a2bab85" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 19:55:51 user nova-compute[75216]: DEBUG nova.network.neutron [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: 9e347526-5ade-4396-80f8-73af0a2bab85] Forcefully refreshing network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 19:55:51 user nova-compute[75216]: DEBUG nova.objects.instance [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lazy-loading 'info_cache' on Instance uuid 9e347526-5ade-4396-80f8-73af0a2bab85 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:55:52 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-147cb48e-5ef2-4cb4-a29a-8aa10a4a258f tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Acquiring lock "9e347526-5ade-4396-80f8-73af0a2bab85" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:55:52 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-147cb48e-5ef2-4cb4-a29a-8aa10a4a258f tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Lock "9e347526-5ade-4396-80f8-73af0a2bab85" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:55:52 user nova-compute[75216]: DEBUG nova.objects.instance [None req-147cb48e-5ef2-4cb4-a29a-8aa10a4a258f tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Lazy-loading 'flavor' on Instance uuid 9e347526-5ade-4396-80f8-73af0a2bab85 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:55:52 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-147cb48e-5ef2-4cb4-a29a-8aa10a4a258f tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Lock "9e347526-5ade-4396-80f8-73af0a2bab85" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:55:52 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-147cb48e-5ef2-4cb4-a29a-8aa10a4a258f tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Acquiring lock "9e347526-5ade-4396-80f8-73af0a2bab85" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:55:52 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-147cb48e-5ef2-4cb4-a29a-8aa10a4a258f tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Lock "9e347526-5ade-4396-80f8-73af0a2bab85" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:55:52 user nova-compute[75216]: INFO nova.compute.manager [None req-147cb48e-5ef2-4cb4-a29a-8aa10a4a258f tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] [instance: 9e347526-5ade-4396-80f8-73af0a2bab85] Attaching volume 9244e627-5c00-402d-8276-a2c5a9858f56 to /dev/vdb
Nov 13 19:55:52 user nova-compute[75216]: DEBUG os_brick.utils [None req-147cb48e-5ef2-4cb4-a29a-8aa10a4a258f tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 19:55:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:55:52 user nova-compute[75216]: DEBUG nova.network.neutron [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: 9e347526-5ade-4396-80f8-73af0a2bab85] Updating instance_info_cache with network_info: [{"id": "665af93f-50b1-4e75-b074-78feda4b8f89", "address": "fa:16:3e:38:e7:d0", "network": {"id": "030e67c6-1489-4a16-b93e-b8731813e15d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2017692564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adc380bcc607465a99822932ffc27549", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap665af93f-50", "ovs_interfaceid": "665af93f-50b1-4e75-b074-78feda4b8f89", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:55:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:55:52 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e1f3c08-b6b2-4f30-a576-d465f955763a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aea6fcfe14b9\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:55:52 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Releasing lock "refresh_cache-9e347526-5ade-4396-80f8-73af0a2bab85" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 19:55:52 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: 9e347526-5ade-4396-80f8-73af0a2bab85] Updated the network info_cache for instance {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 19:55:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:55:52 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:55:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:55:52 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6dde4a2-d0b7-40ba-8cfb-74a562a50a44]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:55:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:55:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:55:52 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dc49fab-d01d-4758-bc5b-c6e7261a3127]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:55:52 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[58b17912-40ae-445b-9e77-7787bf9c1fb4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:55:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-147cb48e-5ef2-4cb4-a29a-8aa10a4a258f tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Running cmd (subprocess): nvme version {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:55:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-147cb48e-5ef2-4cb4-a29a-8aa10a4a258f tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] 'nvme version' failed. Not Retrying. {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 19:55:52 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.nvmeof [None req-147cb48e-5ef2-4cb4-a29a-8aa10a4a258f tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] nvme not present on system {{(pid=75216) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 19:55:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:55:52 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 19:55:52 user nova-compute[75216]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 19:55:52 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3411f43-7267-4542-bacf-83d70f9a968c]: (4, '') {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:55:52 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-147cb48e-5ef2-4cb4-a29a-8aa10a4a258f tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75216) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 19:55:52 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-147cb48e-5ef2-4cb4-a29a-8aa10a4a258f tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 19:55:52 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.lightos [None req-147cb48e-5ef2-4cb4-a29a-8aa10a4a258f tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] LIGHTOS: no hostnqn found. {{(pid=75216) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 19:55:52 user nova-compute[75216]: DEBUG os_brick.utils [None req-147cb48e-5ef2-4cb4-a29a-8aa10a4a258f tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aea6fcfe14b9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 19:55:52 user nova-compute[75216]: DEBUG nova.virt.block_device [None req-147cb48e-5ef2-4cb4-a29a-8aa10a4a258f tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] [instance: 9e347526-5ade-4396-80f8-73af0a2bab85] Updating existing volume attachment record: 1bb9afa2-53de-415f-ad7a-62963e4bf8d5 {{(pid=75216) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 19:55:54 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:55:54 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:55:56 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-147cb48e-5ef2-4cb4-a29a-8aa10a4a258f tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] [instance: 9e347526-5ade-4396-80f8-73af0a2bab85] Calling os-brick to attach iSCSI Volume {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 19:55:56 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-147cb48e-5ef2-4cb4-a29a-8aa10a4a258f tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3a8669e40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9244e627-5c00-402d-8276-a2c5a9858f56', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zgfOJnyW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 19:55:56 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-147cb48e-5ef2-4cb4-a29a-8aa10a4a258f tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 19:55:56 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-147cb48e-5ef2-4cb4-a29a-8aa10a4a258f tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 19:55:56 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-147cb48e-5ef2-4cb4-a29a-8aa10a4a258f tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 19:55:56 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-147cb48e-5ef2-4cb4-a29a-8aa10a4a258f tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 19:55:56 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-147cb48e-5ef2-4cb4-a29a-8aa10a4a258f tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9244e627-5c00-402d-8276-a2c5a9858f56" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 19:55:56 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-147cb48e-5ef2-4cb4-a29a-8aa10a4a258f tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9244e627-5c00-402d-8276-a2c5a9858f56" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 19:55:56 user nova-compute[75216]: INFO os_brick.initiator.connectors.iscsi [None req-147cb48e-5ef2-4cb4-a29a-8aa10a4a258f tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 19:55:56 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9244e627-5c00-402d-8276-a2c5a9858f56 -p 172.16.0.220:3260 {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:55:56 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9244e627-5c00-402d-8276-a2c5a9858f56 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:55:56 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[21f9fcf9-de3a-4f72-96dd-e5734a826217]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:55:56 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-147cb48e-5ef2-4cb4-a29a-8aa10a4a258f tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 19:55:56 user nova-compute[75216]:  {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:55:56 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9244e627-5c00-402d-8276-a2c5a9858f56 -p 172.16.0.220:3260 --interface default --op new {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:55:56 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9244e627-5c00-402d-8276-a2c5a9858f56 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:55:56 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[300e79e4-30de-4e25-af63-8fabe4d7bb7a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9244e627-5c00-402d-8276-a2c5a9858f56] added\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:55:56 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-147cb48e-5ef2-4cb4-a29a-8aa10a4a258f tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9244e627-5c00-402d-8276-a2c5a9858f56] added
Nov 13 19:55:56 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:55:56 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9244e627-5c00-402d-8276-a2c5a9858f56 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:55:56 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9244e627-5c00-402d-8276-a2c5a9858f56 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:55:56 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb0c01f1-80ac-43a3-8543-f4704dc93c17]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:55:56 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-147cb48e-5ef2-4cb4-a29a-8aa10a4a258f tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:55:56 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9244e627-5c00-402d-8276-a2c5a9858f56 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:55:56 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9244e627-5c00-402d-8276-a2c5a9858f56 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:55:56 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[25141a49-3892-4d38-8069-49223f917474]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:55:56 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-147cb48e-5ef2-4cb4-a29a-8aa10a4a258f tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:55:56 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9244e627-5c00-402d-8276-a2c5a9858f56 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zgfOJnyW {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:55:56 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9244e627-5c00-402d-8276-a2c5a9858f56 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zgfOJnyW" returned: 0 in 0.017s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:55:56 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8b226e2-6794-42fd-8cd8-c076ccab253b]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:55:56 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-147cb48e-5ef2-4cb4-a29a-8aa10a4a258f tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zgfOJnyW'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:55:56 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9244e627-5c00-402d-8276-a2c5a9858f56 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:55:56 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9244e627-5c00-402d-8276-a2c5a9858f56 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:55:56 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[a668a845-7ed8-470c-9a4b-0781f38af701]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:55:56 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-147cb48e-5ef2-4cb4-a29a-8aa10a4a258f tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:55:56 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:55:56 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:55:56 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbfb12db-a7bc-4f4a-9c96-dc610e5cf882]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:55:56 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-147cb48e-5ef2-4cb4-a29a-8aa10a4a258f tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 13 19:55:56 user nova-compute[75216]:  {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 19:55:56 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-147cb48e-5ef2-4cb4-a29a-8aa10a4a258f tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 13 19:55:56 user nova-compute[75216]:  {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 19:55:56 user nova-compute[75216]: WARNING os_brick.initiator.connectors.iscsi [None req-147cb48e-5ef2-4cb4-a29a-8aa10a4a258f tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 13 19:55:56 user nova-compute[75216]: 
Nov 13 19:55:56 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9244e627-5c00-402d-8276-a2c5a9858f56 -p 172.16.0.220:3260 --login {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:55:56 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9244e627-5c00-402d-8276-a2c5a9858f56 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:55:56 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e872c1e-e187-4293-abfb-519873b669aa]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9244e627-5c00-402d-8276-a2c5a9858f56, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9244e627-5c00-402d-8276-a2c5a9858f56, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:55:56 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-147cb48e-5ef2-4cb4-a29a-8aa10a4a258f tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9244e627-5c00-402d-8276-a2c5a9858f56, portal: 172.16.0.220,3260]
Nov 13 19:55:56 user nova-compute[75216]: Login to [iface: default, target: iqn.2010-10.org.openstack:9244e627-5c00-402d-8276-a2c5a9858f56, portal: 172.16.0.220,3260] successful.
Nov 13 19:55:56 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:55:56 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9244e627-5c00-402d-8276-a2c5a9858f56 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:55:56 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9244e627-5c00-402d-8276-a2c5a9858f56 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.056s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:55:56 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[35a9fdfc-797b-4113-8c39-827a0a24e490]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:55:56 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-147cb48e-5ef2-4cb4-a29a-8aa10a4a258f tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:55:56 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:55:56 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:55:56 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9cc2f94-fda4-466a-9d20-15e3515f7142]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9244e627-5c00-402d-8276-a2c5a9858f56 (non-flash)\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:55:56 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-147cb48e-5ef2-4cb4-a29a-8aa10a4a258f tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9244e627-5c00-402d-8276-a2c5a9858f56 (non-flash)
Nov 13 19:55:56 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 19:55:56 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-147cb48e-5ef2-4cb4-a29a-8aa10a4a258f tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9244e627-5c00-402d-8276-a2c5a9858f56 (non-flash)
Nov 13 19:55:56 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 19:55:56 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-147cb48e-5ef2-4cb4-a29a-8aa10a4a258f tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9244e627-5c00-402d-8276-a2c5a9858f56" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.303s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 19:55:56 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-147cb48e-5ef2-4cb4-a29a-8aa10a4a258f tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Connected to 172.16.0.220:3260 {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 19:55:56 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-147cb48e-5ef2-4cb4-a29a-8aa10a4a258f tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] HCTL ('33', '-', '-', 0) found on session 70 with lun 0 {{(pid=75216) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 19:55:56 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-147cb48e-5ef2-4cb4-a29a-8aa10a4a258f tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75216) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 19:55:56 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:55:56 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:55:56 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cb06e69-eff1-4e50-9b26-499e8857650c]: (4, ('- - 0', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:55:56 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-147cb48e-5ef2-4cb4-a29a-8aa10a4a258f tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Searching for a device in session 70 and hctl ['33', '*', '*', 0] yield: None {{(pid=75216) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 19:55:57 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-147cb48e-5ef2-4cb4-a29a-8aa10a4a258f tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Searching for a device in session 70 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75216) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 19:55:57 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-147cb48e-5ef2-4cb4-a29a-8aa10a4a258f tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:9244e627-5c00-402d-8276-a2c5a9858f56', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zgfOJnyW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75216) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 19:55:57 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-147cb48e-5ef2-4cb4-a29a-8aa10a4a258f tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.334s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 19:55:57 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-147cb48e-5ef2-4cb4-a29a-8aa10a4a258f tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] <== connect_volume: return (1336ms) {'type': 'block', 'scsi_wwn': '23961643662656162', 'path': '/dev/sdb'} {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 19:55:57 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-147cb48e-5ef2-4cb4-a29a-8aa10a4a258f tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] [instance: 9e347526-5ade-4396-80f8-73af0a2bab85] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23961643662656162', 'path': '/dev/sdb'} {{(pid=75216) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 19:55:57 user nova-compute[75216]: DEBUG nova.objects.instance [None req-147cb48e-5ef2-4cb4-a29a-8aa10a4a258f tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Lazy-loading 'flavor' on Instance uuid 9e347526-5ade-4396-80f8-73af0a2bab85 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:55:57 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-147cb48e-5ef2-4cb4-a29a-8aa10a4a258f tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] attach device xml: <disk type="block" device="disk">
Nov 13 19:55:57 user nova-compute[75216]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 19:55:57 user nova-compute[75216]:   <source dev="/dev/sdb"/>
Nov 13 19:55:57 user nova-compute[75216]:   <target dev="vdb" bus="virtio"/>
Nov 13 19:55:57 user nova-compute[75216]:   <serial>9244e627-5c00-402d-8276-a2c5a9858f56</serial>
Nov 13 19:55:57 user nova-compute[75216]: </disk>
Nov 13 19:55:57 user nova-compute[75216]:  {{(pid=75216) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 13 19:55:57 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-147cb48e-5ef2-4cb4-a29a-8aa10a4a258f tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] No BDM found with device name vda, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 19:55:57 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-147cb48e-5ef2-4cb4-a29a-8aa10a4a258f tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75216) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 19:55:57 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-147cb48e-5ef2-4cb4-a29a-8aa10a4a258f tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] No VIF found with MAC fa:16:3e:38:e7:d0, not building metadata {{(pid=75216) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 19:55:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-147cb48e-5ef2-4cb4-a29a-8aa10a4a258f tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Lock "9e347526-5ade-4396-80f8-73af0a2bab85" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 5.879s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:55:58 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:55:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:55:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:55:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:55:58 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Auditing locally available compute resources for user (node: user) {{(pid=75216) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 19:55:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e347526-5ade-4396-80f8-73af0a2bab85/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:55:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e347526-5ade-4396-80f8-73af0a2bab85/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:55:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e347526-5ade-4396-80f8-73af0a2bab85/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:55:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e347526-5ade-4396-80f8-73af0a2bab85/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:55:58 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75216) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 19:55:59 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 19:55:59 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 19:55:59 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Hypervisor/Node resource view: name=user free_ram=8932MB free_disk=25.187164306640625GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75216) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 19:55:59 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:55:59 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:55:59 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance 9e347526-5ade-4396-80f8-73af0a2bab85 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 19:55:59 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 19:55:59 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 19:55:59 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:55:59 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 19:55:59 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 19:55:59 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Compute_service record updated for user:user {{(pid=75216) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 19:55:59 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.209s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:55:59 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:56:00 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-2f84a933-10f2-4c87-9490-772fde6cc1fa tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Acquiring lock "9e347526-5ade-4396-80f8-73af0a2bab85" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:56:00 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-2f84a933-10f2-4c87-9490-772fde6cc1fa tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Lock "9e347526-5ade-4396-80f8-73af0a2bab85" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:56:00 user nova-compute[75216]: INFO nova.compute.manager [None req-2f84a933-10f2-4c87-9490-772fde6cc1fa tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] [instance: 9e347526-5ade-4396-80f8-73af0a2bab85] Detaching volume 9244e627-5c00-402d-8276-a2c5a9858f56
Nov 13 19:56:00 user nova-compute[75216]: INFO nova.virt.block_device [None req-2f84a933-10f2-4c87-9490-772fde6cc1fa tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] [instance: 9e347526-5ade-4396-80f8-73af0a2bab85] Attempting to driver detach volume 9244e627-5c00-402d-8276-a2c5a9858f56 from mountpoint /dev/vdb
Nov 13 19:56:00 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-2f84a933-10f2-4c87-9490-772fde6cc1fa tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Attempting to detach device vdb from instance 9e347526-5ade-4396-80f8-73af0a2bab85 from the persistent domain config. {{(pid=75216) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 13 19:56:00 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-2f84a933-10f2-4c87-9490-772fde6cc1fa tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 19:56:00 user nova-compute[75216]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 19:56:00 user nova-compute[75216]:   <source dev="/dev/sdb"/>
Nov 13 19:56:00 user nova-compute[75216]:   <target dev="vdb" bus="virtio"/>
Nov 13 19:56:00 user nova-compute[75216]:   <serial>9244e627-5c00-402d-8276-a2c5a9858f56</serial>
Nov 13 19:56:00 user nova-compute[75216]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 19:56:00 user nova-compute[75216]: </disk>
Nov 13 19:56:00 user nova-compute[75216]:  {{(pid=75216) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 19:56:00 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-2f84a933-10f2-4c87-9490-772fde6cc1fa tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Successfully detached device vdb from instance 9e347526-5ade-4396-80f8-73af0a2bab85 from the persistent domain config.
Nov 13 19:56:00 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-2f84a933-10f2-4c87-9490-772fde6cc1fa tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9e347526-5ade-4396-80f8-73af0a2bab85 from the live domain config. {{(pid=75216) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 13 19:56:00 user nova-compute[75216]: DEBUG nova.virt.libvirt.guest [None req-2f84a933-10f2-4c87-9490-772fde6cc1fa tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 19:56:00 user nova-compute[75216]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 19:56:00 user nova-compute[75216]:   <source dev="/dev/sdb"/>
Nov 13 19:56:00 user nova-compute[75216]:   <target dev="vdb" bus="virtio"/>
Nov 13 19:56:00 user nova-compute[75216]:   <serial>9244e627-5c00-402d-8276-a2c5a9858f56</serial>
Nov 13 19:56:00 user nova-compute[75216]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 19:56:00 user nova-compute[75216]: </disk>
Nov 13 19:56:00 user nova-compute[75216]:  {{(pid=75216) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 19:56:00 user nova-compute[75216]: DEBUG nova.virt.libvirt.driver [None req-2f84a933-10f2-4c87-9490-772fde6cc1fa tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9e347526-5ade-4396-80f8-73af0a2bab85 {{(pid=75216) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 13 19:56:01 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:56:04 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:56:04 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:56:09 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:56:14 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:56:16 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:56:19 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:56:20 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-2f84a933-10f2-4c87-9490-772fde6cc1fa tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 9e347526-5ade-4396-80f8-73af0a2bab85 is timed out.
Nov 13 19:56:20 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-2f84a933-10f2-4c87-9490-772fde6cc1fa tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Successfully detached device vdb from instance 9e347526-5ade-4396-80f8-73af0a2bab85 from the live domain config.
Nov 13 19:56:20 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2f84a933-10f2-4c87-9490-772fde6cc1fa tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] [instance: 9e347526-5ade-4396-80f8-73af0a2bab85] calling os-brick to detach iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 19:56:20 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f84a933-10f2-4c87-9490-772fde6cc1fa tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3a8669e40>, {'target_iqn': 'iqn.2010-10.org.openstack:9244e627-5c00-402d-8276-a2c5a9858f56', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zgfOJnyW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 19:56:20 user nova-compute[75216]: WARNING os_brick.initiator.connectors.base [None req-2f84a933-10f2-4c87-9490-772fde6cc1fa tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 19:56:20 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-2f84a933-10f2-4c87-9490-772fde6cc1fa tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 19:56:20 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-2f84a933-10f2-4c87-9490-772fde6cc1fa tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 19:56:20 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:56:20 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:56:20 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9d66325-9712-4417-a5ee-721058d59ea2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9244e627-5c00-402d-8276-a2c5a9858f56\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:56:20 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f84a933-10f2-4c87-9490-772fde6cc1fa tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 19:56:20 user nova-compute[75216]: No targets found.
Nov 13 19:56:20 user nova-compute[75216]: iSNS:
Nov 13 19:56:20 user nova-compute[75216]: No targets found.
Nov 13 19:56:20 user nova-compute[75216]: STATIC:
Nov 13 19:56:20 user nova-compute[75216]: Target: iqn.2010-10.org.openstack:9244e627-5c00-402d-8276-a2c5a9858f56
Nov 13 19:56:20 user nova-compute[75216]:         Portal: 172.16.0.220:3260,-1
Nov 13 19:56:20 user nova-compute[75216]:                 Iface Name: default
Nov 13 19:56:20 user nova-compute[75216]: FIRMWARE:
Nov 13 19:56:20 user nova-compute[75216]: No targets found.
Nov 13 19:56:20 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 19:56:20 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f84a933-10f2-4c87-9490-772fde6cc1fa tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 19:56:20 user nova-compute[75216]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 19:56:20 user nova-compute[75216]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75216) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 19:56:20 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f84a933-10f2-4c87-9490-772fde6cc1fa tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9244e627-5c00-402d-8276-a2c5a9858f56', 0)] {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 19:56:20 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:56:20 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:56:20 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[e244df88-3d33-4854-8ec0-cbe49b11b8bb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9244e627-5c00-402d-8276-a2c5a9858f56\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:56:20 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:56:20 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:56:20 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[45873c3c-d3bb-418e-b619-265bf8d7454c]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9244e627-5c00-402d-8276-a2c5a9858f56 (non-flash)\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:56:20 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f84a933-10f2-4c87-9490-772fde6cc1fa tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9244e627-5c00-402d-8276-a2c5a9858f56 (non-flash)
Nov 13 19:56:20 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 19:56:20 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f84a933-10f2-4c87-9490-772fde6cc1fa tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9244e627-5c00-402d-8276-a2c5a9858f56 (non-flash)
Nov 13 19:56:20 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 19:56:20 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f84a933-10f2-4c87-9490-772fde6cc1fa tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe3a879d900>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9244e627-5c00-402d-8276-a2c5a9858f56'): ({'sdb'}, set())}) {{(pid=75216) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 19:56:20 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-2f84a933-10f2-4c87-9490-772fde6cc1fa tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Removing single pathed devices sdb {{(pid=75216) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 19:56:20 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:56:20 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:56:20 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f56a796-31b5-4b46-a31e-8fd43bb96444]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:56:20 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:56:21 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:56:21 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[a79e4852-b7f5-4ec2-836b-bb8636aa4c9c]: (4, ('ok\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:56:21 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-2f84a933-10f2-4c87-9490-772fde6cc1fa tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Flushing IO for device /dev/sdb {{(pid=75216) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 19:56:21 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:56:21 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:56:21 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f586275-4e22-44da-8477-6206ecc1224e]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:56:21 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-2f84a933-10f2-4c87-9490-772fde6cc1fa tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75216) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 19:56:21 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:56:21 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:56:21 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[efba5307-49f2-43d2-ad30-6498481d4429]: (4, ('1', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:56:21 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-2f84a933-10f2-4c87-9490-772fde6cc1fa tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 19:56:21 user nova-compute[75216]: DEBUG os_brick.initiator.linuxscsi [None req-2f84a933-10f2-4c87-9490-772fde6cc1fa tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] SCSI volumes sdb have been removed. {{(pid=75216) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 19:56:21 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f84a933-10f2-4c87-9490-772fde6cc1fa tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9244e627-5c00-402d-8276-a2c5a9858f56')] {{(pid=75216) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 19:56:21 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9244e627-5c00-402d-8276-a2c5a9858f56 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:56:21 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9244e627-5c00-402d-8276-a2c5a9858f56 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:56:21 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[66afc1da-fff5-4447-9e18-5b6a16472ef1]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:56:21 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f84a933-10f2-4c87-9490-772fde6cc1fa tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:56:21 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9244e627-5c00-402d-8276-a2c5a9858f56 -p 172.16.0.220:3260 --logout {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:56:21 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9244e627-5c00-402d-8276-a2c5a9858f56 -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:56:21 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[24e39d31-0a3d-486e-850f-54f0e24e1149]: (4, ('Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:9244e627-5c00-402d-8276-a2c5a9858f56, portal: 172.16.0.220,3260]\nLogout of [sid: 70, target: iqn.2010-10.org.openstack:9244e627-5c00-402d-8276-a2c5a9858f56, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:56:21 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f84a933-10f2-4c87-9490-772fde6cc1fa tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:9244e627-5c00-402d-8276-a2c5a9858f56, portal: 172.16.0.220,3260]
Nov 13 19:56:21 user nova-compute[75216]: Logout of [sid: 70, target: iqn.2010-10.org.openstack:9244e627-5c00-402d-8276-a2c5a9858f56, portal: 172.16.0.220,3260] successful.
Nov 13 19:56:21 user nova-compute[75216]:  stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:56:21 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9244e627-5c00-402d-8276-a2c5a9858f56 -p 172.16.0.220:3260 --op delete {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:56:21 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9244e627-5c00-402d-8276-a2c5a9858f56 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=85984) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:56:21 user nova-compute[75216]: DEBUG oslo.privsep.daemon [-] privsep: reply[2de073a5-7f8b-4f12-8ff2-974449fbde76]: (4, ('', '')) {{(pid=85984) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 19:56:21 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f84a933-10f2-4c87-9490-772fde6cc1fa tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75216) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 19:56:21 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.base [None req-2f84a933-10f2-4c87-9490-772fde6cc1fa tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.282s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 19:56:21 user nova-compute[75216]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f84a933-10f2-4c87-9490-772fde6cc1fa tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] <== disconnect_volume: return (283ms) None {{(pid=75216) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 19:56:21 user nova-compute[75216]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2f84a933-10f2-4c87-9490-772fde6cc1fa tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] [instance: 9e347526-5ade-4396-80f8-73af0a2bab85] Disconnected iSCSI Volume {{(pid=75216) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 19:56:21 user nova-compute[75216]: DEBUG nova.objects.instance [None req-2f84a933-10f2-4c87-9490-772fde6cc1fa tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Lazy-loading 'flavor' on Instance uuid 9e347526-5ade-4396-80f8-73af0a2bab85 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:56:21 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-2f84a933-10f2-4c87-9490-772fde6cc1fa tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Lock "9e347526-5ade-4396-80f8-73af0a2bab85" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.554s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:56:24 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:56:29 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:56:33 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:56:34 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:56:39 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:56:39 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:56:39 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75216) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 19:56:39 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 19:56:39 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 19:56:39 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:56:43 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:56:44 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:56:49 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:56:49 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:56:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:56:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:56:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75216) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 19:56:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 19:56:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 19:56:49 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:56:51 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:56:51 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Starting heal instance info cache {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 19:56:51 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Rebuilding the list of instances to heal {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 13 19:56:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "refresh_cache-9e347526-5ade-4396-80f8-73af0a2bab85" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 19:56:51 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquired lock "refresh_cache-9e347526-5ade-4396-80f8-73af0a2bab85" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 19:56:51 user nova-compute[75216]: DEBUG nova.network.neutron [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: 9e347526-5ade-4396-80f8-73af0a2bab85] Forcefully refreshing network info cache for instance {{(pid=75216) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 19:56:51 user nova-compute[75216]: DEBUG nova.objects.instance [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lazy-loading 'info_cache' on Instance uuid 9e347526-5ade-4396-80f8-73af0a2bab85 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:56:51 user nova-compute[75216]: DEBUG nova.network.neutron [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: 9e347526-5ade-4396-80f8-73af0a2bab85] Updating instance_info_cache with network_info: [{"id": "665af93f-50b1-4e75-b074-78feda4b8f89", "address": "fa:16:3e:38:e7:d0", "network": {"id": "030e67c6-1489-4a16-b93e-b8731813e15d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2017692564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adc380bcc607465a99822932ffc27549", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap665af93f-50", "ovs_interfaceid": "665af93f-50b1-4e75-b074-78feda4b8f89", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:56:52 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Releasing lock "refresh_cache-9e347526-5ade-4396-80f8-73af0a2bab85" {{(pid=75216) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 19:56:52 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] [instance: 9e347526-5ade-4396-80f8-73af0a2bab85] Updated the network info_cache for instance {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 19:56:52 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:56:52 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:56:52 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75216) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 19:56:54 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:56:54 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:56:54 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75216) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 19:56:54 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 19:56:54 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 19:56:54 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:56:58 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:56:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:56:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:56:58 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:56:58 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Auditing locally available compute resources for user (node: user) {{(pid=75216) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 19:56:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e347526-5ade-4396-80f8-73af0a2bab85/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:56:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e347526-5ade-4396-80f8-73af0a2bab85/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:56:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e347526-5ade-4396-80f8-73af0a2bab85/disk --force-share --output=json {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 19:56:58 user nova-compute[75216]: DEBUG oslo_concurrency.processutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e347526-5ade-4396-80f8-73af0a2bab85/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 19:56:59 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 19:56:59 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 19:56:59 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Hypervisor/Node resource view: name=user free_ram=8954MB free_disk=25.178470611572266GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75216) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 19:56:59 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:56:59 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:56:59 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Instance 9e347526-5ade-4396-80f8-73af0a2bab85 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75216) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 19:56:59 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 19:56:59 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 19:56:59 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Refreshing inventories for resource provider d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 13 19:56:59 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Updating ProviderTree inventory for provider d927e00d-5a8b-43f7-ac04-6437958fac1f from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 13 19:56:59 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Updating inventory in ProviderTree for provider d927e00d-5a8b-43f7-ac04-6437958fac1f with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 13 19:56:59 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Refreshing aggregate associations for resource provider d927e00d-5a8b-43f7-ac04-6437958fac1f, aggregates: None {{(pid=75216) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 13 19:56:59 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Refreshing trait associations for resource provider d927e00d-5a8b-43f7-ac04-6437958fac1f, traits: COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_MMX {{(pid=75216) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 13 19:56:59 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:56:59 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 19:56:59 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 19:56:59 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Compute_service record updated for user:user {{(pid=75216) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 19:56:59 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.315s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:57:00 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-60339962-a14a-481e-b183-855decbb7386 tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Acquiring lock "9e347526-5ade-4396-80f8-73af0a2bab85" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:57:00 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-60339962-a14a-481e-b183-855decbb7386 tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Lock "9e347526-5ade-4396-80f8-73af0a2bab85" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:57:00 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-60339962-a14a-481e-b183-855decbb7386 tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Acquiring lock "9e347526-5ade-4396-80f8-73af0a2bab85-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:57:00 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-60339962-a14a-481e-b183-855decbb7386 tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Lock "9e347526-5ade-4396-80f8-73af0a2bab85-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:57:00 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-60339962-a14a-481e-b183-855decbb7386 tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Lock "9e347526-5ade-4396-80f8-73af0a2bab85-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:57:00 user nova-compute[75216]: INFO nova.compute.manager [None req-60339962-a14a-481e-b183-855decbb7386 tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] [instance: 9e347526-5ade-4396-80f8-73af0a2bab85] Terminating instance
Nov 13 19:57:00 user nova-compute[75216]: DEBUG nova.compute.manager [None req-60339962-a14a-481e-b183-855decbb7386 tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] [instance: 9e347526-5ade-4396-80f8-73af0a2bab85] Start destroying the instance on the hypervisor. {{(pid=75216) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 19:57:00 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:57:00 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:57:00 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:57:00 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:57:00 user nova-compute[75216]: DEBUG nova.compute.manager [req-083d145b-9d2f-45d7-a78e-a1489b9fb8c1 req-4acacb8f-1818-455a-98e0-db063d130719 service nova] [instance: 9e347526-5ade-4396-80f8-73af0a2bab85] Received event network-vif-unplugged-665af93f-50b1-4e75-b074-78feda4b8f89 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:57:00 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-083d145b-9d2f-45d7-a78e-a1489b9fb8c1 req-4acacb8f-1818-455a-98e0-db063d130719 service nova] Acquiring lock "9e347526-5ade-4396-80f8-73af0a2bab85-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:57:00 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-083d145b-9d2f-45d7-a78e-a1489b9fb8c1 req-4acacb8f-1818-455a-98e0-db063d130719 service nova] Lock "9e347526-5ade-4396-80f8-73af0a2bab85-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:57:00 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-083d145b-9d2f-45d7-a78e-a1489b9fb8c1 req-4acacb8f-1818-455a-98e0-db063d130719 service nova] Lock "9e347526-5ade-4396-80f8-73af0a2bab85-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:57:00 user nova-compute[75216]: DEBUG nova.compute.manager [req-083d145b-9d2f-45d7-a78e-a1489b9fb8c1 req-4acacb8f-1818-455a-98e0-db063d130719 service nova] [instance: 9e347526-5ade-4396-80f8-73af0a2bab85] No waiting events found dispatching network-vif-unplugged-665af93f-50b1-4e75-b074-78feda4b8f89 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 19:57:00 user nova-compute[75216]: DEBUG nova.compute.manager [req-083d145b-9d2f-45d7-a78e-a1489b9fb8c1 req-4acacb8f-1818-455a-98e0-db063d130719 service nova] [instance: 9e347526-5ade-4396-80f8-73af0a2bab85] Received event network-vif-unplugged-665af93f-50b1-4e75-b074-78feda4b8f89 for instance with task_state deleting. {{(pid=75216) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 19:57:00 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:57:00 user nova-compute[75216]: INFO nova.virt.libvirt.driver [-] [instance: 9e347526-5ade-4396-80f8-73af0a2bab85] Instance destroyed successfully.
Nov 13 19:57:00 user nova-compute[75216]: DEBUG nova.objects.instance [None req-60339962-a14a-481e-b183-855decbb7386 tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Lazy-loading 'resources' on Instance uuid 9e347526-5ade-4396-80f8-73af0a2bab85 {{(pid=75216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 19:57:00 user nova-compute[75216]: DEBUG nova.virt.libvirt.vif [None req-60339962-a14a-481e-b183-855decbb7386 tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T19:50:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1217835648',display_name='tempest-SnapshotDataIntegrityTests-server-1217835648',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1217835648',id=53,image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI4rMpsDWGoCUrCti8d7FdGAn/qu4QeH3JxCDmryxoUPPcAsmBiRPeqivOaV/XBdPQXKW3maPsvEHEOsGhPvSQzIy/sAIBTdRyp63MQYOpILnS5NTnmgHLZxERcuggWSjA==',key_name='tempest-keypair-232567432',keypairs=<?>,launch_index=0,launched_at=2023-11-13T19:50:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='adc380bcc607465a99822932ffc27549',ramdisk_id='',reservation_id='r-pcjx20u4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77bcb5ba-8510-41ec-a88d-96097bb431de',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-2036163840',owner_user_name='tempest-SnapshotDataIntegrityTests-2036163840-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T19:50:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5e8ea47ec6db4287a661362f82c1d2c6',uuid=9e347526-5ade-4396-80f8-73af0a2bab85,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "665af93f-50b1-4e75-b074-78feda4b8f89", "address": "fa:16:3e:38:e7:d0", "network": {"id": "030e67c6-1489-4a16-b93e-b8731813e15d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2017692564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adc380bcc607465a99822932ffc27549", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap665af93f-50", "ovs_interfaceid": "665af93f-50b1-4e75-b074-78feda4b8f89", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 19:57:00 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-60339962-a14a-481e-b183-855decbb7386 tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Converting VIF {"id": "665af93f-50b1-4e75-b074-78feda4b8f89", "address": "fa:16:3e:38:e7:d0", "network": {"id": "030e67c6-1489-4a16-b93e-b8731813e15d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2017692564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adc380bcc607465a99822932ffc27549", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap665af93f-50", "ovs_interfaceid": "665af93f-50b1-4e75-b074-78feda4b8f89", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 19:57:00 user nova-compute[75216]: DEBUG nova.network.os_vif_util [None req-60339962-a14a-481e-b183-855decbb7386 tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:38:e7:d0,bridge_name='br-int',has_traffic_filtering=True,id=665af93f-50b1-4e75-b074-78feda4b8f89,network=Network(030e67c6-1489-4a16-b93e-b8731813e15d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap665af93f-50') {{(pid=75216) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 19:57:00 user nova-compute[75216]: DEBUG os_vif [None req-60339962-a14a-481e-b183-855decbb7386 tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:38:e7:d0,bridge_name='br-int',has_traffic_filtering=True,id=665af93f-50b1-4e75-b074-78feda4b8f89,network=Network(030e67c6-1489-4a16-b93e-b8731813e15d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap665af93f-50') {{(pid=75216) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 19:57:00 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:57:00 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap665af93f-50, bridge=br-int, if_exists=True) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:57:00 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:57:00 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:57:00 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:57:00 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cccbe9b8-d893-4465-8a4e-829bfff10723) {{(pid=75216) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 19:57:00 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:57:00 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:57:00 user nova-compute[75216]: INFO os_vif [None req-60339962-a14a-481e-b183-855decbb7386 tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:38:e7:d0,bridge_name='br-int',has_traffic_filtering=True,id=665af93f-50b1-4e75-b074-78feda4b8f89,network=Network(030e67c6-1489-4a16-b93e-b8731813e15d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap665af93f-50')
Nov 13 19:57:00 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-60339962-a14a-481e-b183-855decbb7386 tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] [instance: 9e347526-5ade-4396-80f8-73af0a2bab85] Deleting instance files /opt/stack/data/nova/instances/9e347526-5ade-4396-80f8-73af0a2bab85_del
Nov 13 19:57:00 user nova-compute[75216]: INFO nova.virt.libvirt.driver [None req-60339962-a14a-481e-b183-855decbb7386 tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] [instance: 9e347526-5ade-4396-80f8-73af0a2bab85] Deletion of /opt/stack/data/nova/instances/9e347526-5ade-4396-80f8-73af0a2bab85_del complete
Nov 13 19:57:01 user nova-compute[75216]: INFO nova.compute.manager [None req-60339962-a14a-481e-b183-855decbb7386 tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] [instance: 9e347526-5ade-4396-80f8-73af0a2bab85] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 13 19:57:01 user nova-compute[75216]: DEBUG oslo.service.loopingcall [None req-60339962-a14a-481e-b183-855decbb7386 tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75216) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 19:57:01 user nova-compute[75216]: DEBUG nova.compute.manager [-] [instance: 9e347526-5ade-4396-80f8-73af0a2bab85] Deallocating network for instance {{(pid=75216) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 19:57:01 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: 9e347526-5ade-4396-80f8-73af0a2bab85] deallocate_for_instance() {{(pid=75216) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 19:57:01 user nova-compute[75216]: DEBUG nova.network.neutron [-] [instance: 9e347526-5ade-4396-80f8-73af0a2bab85] Updating instance_info_cache with network_info: [] {{(pid=75216) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 19:57:01 user nova-compute[75216]: INFO nova.compute.manager [-] [instance: 9e347526-5ade-4396-80f8-73af0a2bab85] Took 0.70 seconds to deallocate network for instance.
Nov 13 19:57:01 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-60339962-a14a-481e-b183-855decbb7386 tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:57:01 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-60339962-a14a-481e-b183-855decbb7386 tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:57:01 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-60339962-a14a-481e-b183-855decbb7386 tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 19:57:01 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-60339962-a14a-481e-b183-855decbb7386 tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 19:57:01 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-60339962-a14a-481e-b183-855decbb7386 tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.109s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:57:01 user nova-compute[75216]: INFO nova.scheduler.client.report [None req-60339962-a14a-481e-b183-855decbb7386 tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Deleted allocations for instance 9e347526-5ade-4396-80f8-73af0a2bab85
Nov 13 19:57:02 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-60339962-a14a-481e-b183-855decbb7386 tempest-SnapshotDataIntegrityTests-2036163840 tempest-SnapshotDataIntegrityTests-2036163840-project-member] Lock "9e347526-5ade-4396-80f8-73af0a2bab85" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.838s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:57:02 user nova-compute[75216]: DEBUG nova.compute.manager [req-1b7ce93b-647d-485e-828e-c6e113b9a3a3 req-71020741-439a-4753-bbf7-7c6a3f15d883 service nova] [instance: 9e347526-5ade-4396-80f8-73af0a2bab85] Received event network-vif-plugged-665af93f-50b1-4e75-b074-78feda4b8f89 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:57:02 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-1b7ce93b-647d-485e-828e-c6e113b9a3a3 req-71020741-439a-4753-bbf7-7c6a3f15d883 service nova] Acquiring lock "9e347526-5ade-4396-80f8-73af0a2bab85-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:57:02 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-1b7ce93b-647d-485e-828e-c6e113b9a3a3 req-71020741-439a-4753-bbf7-7c6a3f15d883 service nova] Lock "9e347526-5ade-4396-80f8-73af0a2bab85-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:57:02 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [req-1b7ce93b-647d-485e-828e-c6e113b9a3a3 req-71020741-439a-4753-bbf7-7c6a3f15d883 service nova] Lock "9e347526-5ade-4396-80f8-73af0a2bab85-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:57:02 user nova-compute[75216]: DEBUG nova.compute.manager [req-1b7ce93b-647d-485e-828e-c6e113b9a3a3 req-71020741-439a-4753-bbf7-7c6a3f15d883 service nova] [instance: 9e347526-5ade-4396-80f8-73af0a2bab85] No waiting events found dispatching network-vif-plugged-665af93f-50b1-4e75-b074-78feda4b8f89 {{(pid=75216) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 19:57:02 user nova-compute[75216]: WARNING nova.compute.manager [req-1b7ce93b-647d-485e-828e-c6e113b9a3a3 req-71020741-439a-4753-bbf7-7c6a3f15d883 service nova] [instance: 9e347526-5ade-4396-80f8-73af0a2bab85] Received unexpected event network-vif-plugged-665af93f-50b1-4e75-b074-78feda4b8f89 for instance with vm_state deleted and task_state None.
Nov 13 19:57:02 user nova-compute[75216]: DEBUG nova.compute.manager [req-1b7ce93b-647d-485e-828e-c6e113b9a3a3 req-71020741-439a-4753-bbf7-7c6a3f15d883 service nova] [instance: 9e347526-5ade-4396-80f8-73af0a2bab85] Received event network-vif-deleted-665af93f-50b1-4e75-b074-78feda4b8f89 {{(pid=75216) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 19:57:03 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:57:05 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:57:05 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:57:06 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:57:06 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Cleaning up deleted instances {{(pid=75216) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 13 19:57:06 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] There are 0 instances to clean {{(pid=75216) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 13 19:57:10 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:57:10 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:57:10 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75216) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 19:57:10 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 19:57:10 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 19:57:10 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:57:15 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:57:16 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:57:16 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75216) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 13 19:57:20 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:57:20 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:57:20 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75216) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 19:57:20 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 19:57:20 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 19:57:20 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:57:25 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:57:30 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:57:34 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:57:35 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:57:40 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:57:43 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:57:45 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:57:49 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:57:50 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:57:50 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:57:50 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75216) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 19:57:50 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 19:57:50 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75216) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 19:57:50 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:57:51 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:57:51 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:57:51 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Starting heal instance info cache {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 19:57:51 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Rebuilding the list of instances to heal {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 13 19:57:51 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Didn't find any instances for network info cache update. {{(pid=75216) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 13 19:57:51 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:57:52 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:57:52 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:57:52 user nova-compute[75216]: DEBUG nova.compute.manager [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75216) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 19:57:53 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:57:55 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:57:57 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:58:00 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:58:00 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:58:00 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:58:00 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:58:00 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Auditing locally available compute resources for user (node: user) {{(pid=75216) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 19:58:00 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 19:58:00 user nova-compute[75216]: WARNING nova.virt.libvirt.driver [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 19:58:00 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Hypervisor/Node resource view: name=user free_ram=9214MB free_disk=25.20532989501953GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75216) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 19:58:00 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 19:58:00 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 19:58:00 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 19:58:00 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75216) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 19:58:00 user nova-compute[75216]: DEBUG nova.compute.provider_tree [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Inventory has not changed in ProviderTree for provider: d927e00d-5a8b-43f7-ac04-6437958fac1f {{(pid=75216) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 19:58:00 user nova-compute[75216]: DEBUG nova.scheduler.client.report [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Inventory has not changed for provider d927e00d-5a8b-43f7-ac04-6437958fac1f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75216) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 19:58:00 user nova-compute[75216]: DEBUG nova.compute.resource_tracker [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Compute_service record updated for user:user {{(pid=75216) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 19:58:00 user nova-compute[75216]: DEBUG oslo_concurrency.lockutils [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.144s {{(pid=75216) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 19:58:00 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:58:02 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 19:58:05 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:58:11 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 19:58:16 user nova-compute[75216]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75216) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 19:58:17 user nova-compute[75216]: DEBUG oslo_service.periodic_task [None req-84cd7f45-e893-4140-a745-94139cdda2b3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75216) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}